2024-09-15T22:23:56.691 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:23:56.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:23:56.835 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906260' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEy/7PkQ//9/DwwtqQw2ADW8VYlOpuLvIW8n2gSAuppjyuJgKOjnMWcrqt9dP0c5mg97I0dPPtcfU648UyYnCGg= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyDSjMJhUR8fPOkCO83iTDtkvTmDWifJY6U3/4nSaiLg5Zz5iXA7ZmIkhZ5YC3oJDKq3270ov8/oWKwU2TldAs= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkzVMZxvg7KWtdo4KEs5+oUIUXKSlTAVr3653tLhPapuN99iFyhjI9pDeLWsu0MBbRznQqLWD68uufTqzUIAkg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:23:56.835 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:23:56.836 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:23:56.836 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:23:56.838 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:23:56.860 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:23:56.861 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:23:56.861 INFO:teuthology.packaging:ref: None 2024-09-15T22:23:56.861 INFO:teuthology.packaging:tag: None 2024-09-15T22:23:56.861 INFO:teuthology.packaging:branch: squid 2024-09-15T22:23:56.861 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:23:56.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T22:23:57.099 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T22:23:57.100 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:23:57.107 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:23:57.107 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:23:57.114 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:23:57.140 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:23:57.147 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:23:57.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:18:15.120406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEy/7PkQ//9/DwwtqQw2ADW8VYlOpuLvIW8n2gSAuppjyuJgKOjnMWcrqt9dP0c5mg97I0dPPtcfU648UyYnCGg='} 2024-09-15T22:23:57.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:18:15.121942', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyDSjMJhUR8fPOkCO83iTDtkvTmDWifJY6U3/4nSaiLg5Zz5iXA7ZmIkhZ5YC3oJDKq3270ov8/oWKwU2TldAs='} 2024-09-15T22:23:57.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:18:15.118626', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkzVMZxvg7KWtdo4KEs5+oUIUXKSlTAVr3653tLhPapuN99iFyhjI9pDeLWsu0MBbRznQqLWD68uufTqzUIAkg='} 2024-09-15T22:23:57.218 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:23:57.225 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T22:23:57.225 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T22:23:57.225 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T22:23:57.225 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:23:57.306 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f906a293be0>, signals=[15]) 2024-09-15T22:23:57.307 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:23:57.313 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:23:57.313 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:23:57.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:23:57.392 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-15T22:23:57.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:23:57.467 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-09-15T22:23:57.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:23:57.543 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:23:57.549 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-15T22:23:57.569 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-15T22:23:57.569 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-09-15T22:23:57.627 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:23:57.628 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:23:57.629 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-15T22:23:57.650 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-15T22:23:57.668 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-15T22:23:57.668 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-15T22:23:57.726 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-09-15T22:23:57.726 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-09-15T22:23:57.726 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-09-15T22:23:57.726 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:23:57.727 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:23:57.728 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-15T22:23:57.750 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-09-15T22:23:57.769 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-09-15T22:23:57.770 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-09-15T22:23:57.827 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:23:57.828 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:23:57.829 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:23:57.829 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:23:57.829 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:23:57.829 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-09-15T22:23:57.850 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:23:57.861 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:23:57.886 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:23:57.886 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:23:57.889 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:23:57.891 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:23:57.908 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:23:57.915 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:23:57.915 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:23:57.947 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:23:57.950 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:23:58.037 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:23:58.117 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:23:58.131 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:23:58.131 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-15T22:23:58.132 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-15T22:23:58.132 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:23:58.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:23:58.150 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-15T22:23:58.209 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:23:58.209 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-503.el9.x86_64 2024-09-15T22:23:58.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2024-09-15T22:24:01.413 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-15T22:24:03.456 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-15T22:24:09.307 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-15T22:24:10.799 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-15T22:24:11.936 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-15T22:24:17.592 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T22:24:19.691 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:24:19.691 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:24:19.779 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-15T22:24:19.788 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-15T22:24:19.788 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2024-09-15T22:24:19.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:24:19.790 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 79 M 2024-09-15T22:24:19.790 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 126 M 2024-09-15T22:24:19.790 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-15T22:24:19.919 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 274 kB/s | 23 kB 00:00 2024-09-15T22:24:20.411 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-15T22:24:20.744 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-15T22:24:21.553 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-15T22:24:21.553 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:24:21.553 INFO:teuthology.orchestra.run.smithi066.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-15T22:24:22.261 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-15T22:24:22.670 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-15T22:24:22.670 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-15T22:24:23.670 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-15T22:24:23.670 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-15T22:24:26.272 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-15T22:24:26.971 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:24:27.070 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:24:30.000 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:24:30.129 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:24:35.355 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:24:35.388 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:24:40.627 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:25:21.091 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:25:21.133 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:25:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:25:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:25:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:25:21.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:25:22.342 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:25:22.342 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:25:22.342 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-15T22:25:22.342 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.342 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.343 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.343 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.343 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:25:22.343 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-15T22:25:22.677 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:25:22.765 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.765 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:25:22.765 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:25:22.765 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:25:22.766 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:25:22.766 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-15T22:25:22.766 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:25:22.766 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:25:22.826 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:25:22.826 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:25:22.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2024-09-15T22:25:22.866 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2024-09-15T22:25:22.866 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 82.el9 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8274670 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2024-09-15T22:25:22.867 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:25:22.868 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:25:22.869 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:25:22.869 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:25:22.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:25:23.643 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-09-15T22:25:24.996 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:25:25.026 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-09-15T22:25:25.035 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-15T22:25:25.051 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.V57x3RTxIt 2024-09-15T22:25:25.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V57x3RTxIt 2024-09-15T22:25:25.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.V57x3RTxIt 2024-09-15T22:25:25.300 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.V57x3RTxIt is 6KB 2024-09-15T22:25:25.349 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.V57x3RTxIt 2024-09-15T22:25:25.364 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:25:25.428 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:25:25.428 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:25:25.428 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:25:25.428 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:25:25.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:25:25.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-09-15T22:25:55.588 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T22:25:55.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:25:55.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:26:13.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-15T22:26:22.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:26:22.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:26:26.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-15T22:26:38.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:26:38.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:26:41.085 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-15T22:26:56.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:26:56.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:27:28.418 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-15T22:27:28.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:27:28.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:27:28.845 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-15T22:27:28.860 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:27:28.861 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:27:28.861 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:27:28.861 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:27:29.862 DEBUG:teuthology.parallel:result is None 2024-09-15T22:27:29.862 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:27:29.870 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:27:29.870 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:27:29.873 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:27:29.875 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:27:29.894 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:27:29.901 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:27:29.907 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:27:29.907 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:27:29.928 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:27:29.935 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:27:30.072 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:27:30.079 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:27:30.079 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:27:30.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:27:30.096 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:27:30.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:27:30.114 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:27:30.116 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:27:30.138 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:27:30.176 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.197 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.200 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.220 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.227 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.266 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:27:30.268 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:27:30.275 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:27:30.276 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:27:30.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:27:30.280 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:27:30.308 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:27:30.317 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:27:30.317 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:27:30.344 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:27:30.349 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:27:30.365 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:30.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:30.495 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:30.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:30.617 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:27:30.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:27:30.696 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:30.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:30.800 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:30.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:30.927 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:27:30.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:27:30.995 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:31.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:27:31.104 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:31.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:27:31.190 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:27:31.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:27:31.258 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-15T22:27:31.260 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-15T22:27:31.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-09-15T22:27:31.302 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:27:31.308 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:27:31.340 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:27:31.632 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:27:31.643 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:27:31.643 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:27:31.677 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:27:31.685 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:27:31.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-09-15T22:27:31.734 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-09-15T22:27:31.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-09-15T22:27:31.775 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-09-15T22:27:31.777 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-09-15T22:27:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-09-15T22:27:31.822 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:27:31.823 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-09-15T22:27:31.864 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-09-15T22:27:31.864 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-09-15T22:27:31.889 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-09-15T22:27:31.890 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-09-15T22:27:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-09-15T22:27:31.912 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:27:31.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:27:31.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:27:31.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:27:31.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:27:31.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:27:31.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:27:31.994 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:27:31.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:27:32.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:27:32.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:27:32.098 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:27:32.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:27:32.121 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:27:32.122 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi066.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:31:32.164 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-09-15T22:31:32.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:31:32.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:31:32.246 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-15T22:31:32.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-15T22:31:32.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-15T22:31:32.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:31:32.408 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-15T22:31:32.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-15T22:31:32.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-15T22:31:32.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:31:32.559 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-15T22:31:32.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-15T22:31:32.637 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:31:32.647 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:31:32.648 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:31:32.648 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:32.651 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:31:32.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:32.653 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:31:32.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:32.679 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:31:32.683 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:31:32.695 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:31:32.698 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:31:32.709 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:31:32.722 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-09-15T22:31:32.724 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-09-15T22:31:32.724 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:31:32.734 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-09-15T22:31:32.735 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-09-15T22:31:32.749 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:31:32.750 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-09-15T22:31:32.750 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:31:32.761 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:31:32.764 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:31:32.775 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:31:32.790 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:31:32.819 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:32.819 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.823 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.824 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:32.825 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-15T22:31:32.825 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.825 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.825 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.825 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.855 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.859 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:32.860 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:31:32.868 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:31:32.868 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:31:32.868 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:31:32.869 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:31:32.874 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:31:32.875 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:31:32.875 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:31:32.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:31:32.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:31:32.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:31:32.879 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:31:32.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:31:33.030 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:31:33.030 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:31:33.034 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:31:33.034 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:31:33.036 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:31:33.037 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:31:33.139 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:31:33.140 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:31:33.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:31:33.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:31:33.145 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:31:33.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:31:33.153 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:31:33.153 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:31:33.153 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:31:33.166 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:31:33.166 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:31:33.173 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:31:33.174 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:31:33.179 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:31:33.179 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:31:33.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:31:33.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:31:33.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:31:33.310 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:31:33.314 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:31:33.320 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:31:33.375 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-09-15T22:31:33.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-09-15T22:31:33.378 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-09-15T22:31:33.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-09-15T22:31:33.384 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-09-15T22:31:33.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-09-15T22:31:33.603 INFO:teuthology.orchestra.run.smithi184.stdout:45 files removed 2024-09-15T22:31:33.609 INFO:teuthology.orchestra.run.smithi087.stdout:45 files removed 2024-09-15T22:31:33.617 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-09-15T22:31:33.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:31:33.636 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:31:33.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:31:34.155 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 334 kB/s | 83 kB 00:00 2024-09-15T22:31:34.193 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 296 kB/s | 83 kB 00:00 2024-09-15T22:31:34.224 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 312 kB/s | 83 kB 00:00 2024-09-15T22:31:34.422 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-15T22:31:34.477 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:31:34.517 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T22:31:34.690 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-15T22:31:34.752 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T22:31:34.809 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-15T22:31:35.149 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-15T22:31:35.602 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-15T22:31:36.384 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-15T22:31:37.140 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-15T22:31:38.435 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-15T22:31:38.945 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-15T22:31:41.533 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-15T22:31:42.911 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-15T22:31:43.050 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-15T22:31:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-15T22:31:44.180 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-15T22:31:44.670 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-15T22:31:45.130 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-15T22:31:45.957 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-15T22:31:46.318 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-15T22:31:49.602 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-15T22:31:51.613 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-15T22:31:51.707 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-15T22:31:51.857 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:51.858 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:51.871 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:31:51.872 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:31:51.873 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:31:51.874 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:31:51.876 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:31:51.879 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:31:51.880 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:31:51.942 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-09-15T22:31:51.960 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-15T22:31:51.960 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:31:51.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:31:51.962 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:31:51.963 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:31:51.964 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:31:51.965 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:31:51.966 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:31:51.967 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:31:51.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:31:51.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:31:51.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:31:51.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:31:51.972 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout:Install 148 Packages 2024-09-15T22:31:51.973 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 8 Packages 2024-09-15T22:31:51.974 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:31:51.974 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 226 M 2024-09-15T22:31:51.974 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-09-15T22:31:52.554 INFO:teuthology.orchestra.run.smithi184.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-15T22:31:52.762 INFO:teuthology.orchestra.run.smithi184.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-15T22:31:52.879 INFO:teuthology.orchestra.run.smithi184.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-15T22:31:52.904 INFO:teuthology.orchestra.run.smithi184.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.0 MB/s | 145 kB 00:00 2024-09-15T22:31:53.038 INFO:teuthology.orchestra.run.smithi184.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 15 MB/s | 2.4 MB 00:00 2024-09-15T22:31:53.088 INFO:teuthology.orchestra.run.smithi184.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-15T22:31:53.338 INFO:teuthology.orchestra.run.smithi184.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-15T22:31:53.680 INFO:teuthology.orchestra.run.smithi184.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 17 MB/s | 21 MB 00:01 2024-09-15T22:31:53.722 INFO:teuthology.orchestra.run.smithi184.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 608 kB/s | 25 kB 00:00 2024-09-15T22:31:53.931 INFO:teuthology.orchestra.run.smithi184.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 18 MB/s | 11 MB 00:00 2024-09-15T22:31:53.952 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:53.953 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:53.966 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:31:53.967 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:31:53.968 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:31:53.969 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:31:53.971 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:31:53.974 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:31:53.975 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:31:53.989 INFO:teuthology.orchestra.run.smithi184.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.8 MB/s | 228 kB 00:00 2024-09-15T22:31:54.038 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:31:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:31:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:31:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:31:54.060 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:31:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:31:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:31:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:31:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:31:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:31:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:31:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:31:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout:Install 148 Packages 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 8 Packages 2024-09-15T22:31:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:31:54.070 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 226 M 2024-09-15T22:31:54.070 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-15T22:31:54.074 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:54.075 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:31:54.087 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:31:54.087 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:31:54.088 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:31:54.089 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:31:54.091 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:31:54.093 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:31:54.094 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:31:54.156 INFO:teuthology.orchestra.run.smithi184.stdout:(12/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 16 MB/s | 17 MB 00:01 2024-09-15T22:31:54.161 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-15T22:31:54.176 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-15T22:31:54.176 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-15T22:31:54.176 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-15T22:31:54.176 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-15T22:31:54.176 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:31:54.177 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:31:54.178 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:31:54.179 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:31:54.180 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:31:54.181 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:31:54.182 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:31:54.183 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:31:54.184 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:31:54.185 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:31:54.186 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:31:54.187 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-09-15T22:31:54.188 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================== 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout:Install 148 Packages 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 8 Packages 2024-09-15T22:31:54.189 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:31:54.190 INFO:teuthology.orchestra.run.smithi184.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 141 kB/s | 27 kB 00:00 2024-09-15T22:31:54.190 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 226 M 2024-09-15T22:31:54.190 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-15T22:31:54.206 INFO:teuthology.orchestra.run.smithi184.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 637 kB/s | 32 kB 00:00 2024-09-15T22:31:54.240 INFO:teuthology.orchestra.run.smithi184.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-15T22:31:54.265 INFO:teuthology.orchestra.run.smithi184.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-15T22:31:54.291 INFO:teuthology.orchestra.run.smithi184.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:31:54.316 INFO:teuthology.orchestra.run.smithi184.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 9.8 MB/s | 506 kB 00:00 2024-09-15T22:31:54.375 INFO:teuthology.orchestra.run.smithi184.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 774 kB/s | 45 kB 00:00 2024-09-15T22:31:54.458 INFO:teuthology.orchestra.run.smithi184.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T22:31:54.534 INFO:teuthology.orchestra.run.smithi184.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 22 MB/s | 5.3 MB 00:00 2024-09-15T22:31:54.550 INFO:teuthology.orchestra.run.smithi087.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2024-09-15T22:31:54.576 INFO:teuthology.orchestra.run.smithi184.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.3 MB/s | 161 kB 00:00 2024-09-15T22:31:54.609 INFO:teuthology.orchestra.run.smithi184.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 4.2 MB/s | 320 kB 00:00 2024-09-15T22:31:54.634 INFO:teuthology.orchestra.run.smithi184.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:31:54.660 INFO:teuthology.orchestra.run.smithi184.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:31:54.681 INFO:teuthology.orchestra.run.smithi066.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 57 kB/s | 6.5 kB 00:00 2024-09-15T22:31:54.685 INFO:teuthology.orchestra.run.smithi184.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:31:54.777 INFO:teuthology.orchestra.run.smithi184.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-15T22:31:54.783 INFO:teuthology.orchestra.run.smithi087.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.7 MB/s | 896 kB 00:00 2024-09-15T22:31:54.844 INFO:teuthology.orchestra.run.smithi184.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 478 kB/s | 32 kB 00:00 2024-09-15T22:31:54.894 INFO:teuthology.orchestra.run.smithi184.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-15T22:31:54.900 INFO:teuthology.orchestra.run.smithi087.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-15T22:31:54.919 INFO:teuthology.orchestra.run.smithi184.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.9 MB/s | 146 kB 00:00 2024-09-15T22:31:54.925 INFO:teuthology.orchestra.run.smithi087.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.0 MB/s | 145 kB 00:00 2024-09-15T22:31:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 2.4 MB 00:00 2024-09-15T22:31:55.170 INFO:teuthology.orchestra.run.smithi184.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:31:55.270 INFO:teuthology.orchestra.run.smithi184.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.4 MB/s | 249 kB 00:00 2024-09-15T22:31:55.298 INFO:teuthology.orchestra.run.smithi066.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-15T22:31:55.329 INFO:teuthology.orchestra.run.smithi184.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 844 kB/s | 49 kB 00:00 2024-09-15T22:31:55.343 INFO:teuthology.orchestra.run.smithi087.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-15T22:31:55.385 INFO:teuthology.orchestra.run.smithi087.stdout:(7/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 1.5 MB 00:00 2024-09-15T22:31:55.387 INFO:teuthology.orchestra.run.smithi184.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 282 kB/s | 16 kB 00:00 2024-09-15T22:31:55.432 INFO:teuthology.orchestra.run.smithi066.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.1 MB/s | 145 kB 00:00 2024-09-15T22:31:55.846 INFO:teuthology.orchestra.run.smithi184.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-15T22:31:55.996 INFO:teuthology.orchestra.run.smithi184.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-15T22:31:56.046 INFO:teuthology.orchestra.run.smithi184.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 366 kB/s | 18 kB 00:00 2024-09-15T22:31:56.088 INFO:teuthology.orchestra.run.smithi184.stdout:(38/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 407 kB/s | 285 kB 00:00 2024-09-15T22:31:56.135 INFO:teuthology.orchestra.run.smithi087.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 21 MB/s | 17 MB 00:00 2024-09-15T22:31:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 506 kB/s | 25 kB 00:00 2024-09-15T22:31:56.680 INFO:teuthology.orchestra.run.smithi184.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-15T22:31:56.857 INFO:teuthology.orchestra.run.smithi066.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-09-15T22:31:57.189 INFO:teuthology.orchestra.run.smithi184.stdout:(40/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 14 MB/s | 49 MB 00:03 2024-09-15T22:31:57.314 INFO:teuthology.orchestra.run.smithi184.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 654 kB/s | 801 kB 00:01 2024-09-15T22:31:57.427 INFO:teuthology.orchestra.run.smithi087.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 5.2 MB/s | 11 MB 00:02 2024-09-15T22:31:57.502 INFO:teuthology.orchestra.run.smithi087.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.0 MB/s | 228 kB 00:00 2024-09-15T22:31:57.586 INFO:teuthology.orchestra.run.smithi087.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 325 kB/s | 27 kB 00:00 2024-09-15T22:31:57.670 INFO:teuthology.orchestra.run.smithi087.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 380 kB/s | 32 kB 00:00 2024-09-15T22:31:57.773 INFO:teuthology.orchestra.run.smithi184.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 175 kB/s | 191 kB 00:01 2024-09-15T22:31:57.899 INFO:teuthology.orchestra.run.smithi066.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 1.5 MB/s | 1.5 MB 00:01 2024-09-15T22:31:57.911 INFO:teuthology.orchestra.run.smithi087.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 3.0 MB/s | 751 kB 00:00 2024-09-15T22:31:57.948 INFO:teuthology.orchestra.run.smithi184.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-09-15T22:31:58.066 INFO:teuthology.orchestra.run.smithi066.stdout:(6/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 5.4 MB 00:03 2024-09-15T22:31:58.283 INFO:teuthology.orchestra.run.smithi066.stdout:(7/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 5.7 MB/s | 21 MB 00:03 2024-09-15T22:31:58.324 INFO:teuthology.orchestra.run.smithi184.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-15T22:31:58.337 INFO:teuthology.orchestra.run.smithi087.stdout:(15/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 23 MB/s | 49 MB 00:02 2024-09-15T22:31:58.362 INFO:teuthology.orchestra.run.smithi087.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 363 kB/s | 163 kB 00:00 2024-09-15T22:31:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T22:31:58.463 INFO:teuthology.orchestra.run.smithi087.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 4.9 MB/s | 506 kB 00:00 2024-09-15T22:31:58.481 INFO:teuthology.orchestra.run.smithi184.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 150 kB/s | 106 kB 00:00 2024-09-15T22:31:58.529 INFO:teuthology.orchestra.run.smithi087.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 681 kB/s | 45 kB 00:00 2024-09-15T22:31:58.605 INFO:teuthology.orchestra.run.smithi087.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T22:31:58.680 INFO:teuthology.orchestra.run.smithi087.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-15T22:31:58.705 INFO:teuthology.orchestra.run.smithi087.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.6 MB/s | 161 kB 00:00 2024-09-15T22:31:58.733 INFO:teuthology.orchestra.run.smithi087.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 6.3 MB/s | 320 kB 00:00 2024-09-15T22:31:58.733 INFO:teuthology.orchestra.run.smithi184.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-09-15T22:31:58.764 INFO:teuthology.orchestra.run.smithi087.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:31:58.789 INFO:teuthology.orchestra.run.smithi087.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T22:31:58.813 INFO:teuthology.orchestra.run.smithi087.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:31:58.872 INFO:teuthology.orchestra.run.smithi087.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:31:58.891 INFO:teuthology.orchestra.run.smithi066.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 17 MB/s | 11 MB 00:00 2024-09-15T22:31:58.931 INFO:teuthology.orchestra.run.smithi087.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-15T22:31:58.940 INFO:teuthology.orchestra.run.smithi184.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-15T22:31:58.956 INFO:teuthology.orchestra.run.smithi087.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 381 kB/s | 32 kB 00:00 2024-09-15T22:31:58.981 INFO:teuthology.orchestra.run.smithi087.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T22:31:59.008 INFO:teuthology.orchestra.run.smithi066.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 216 kB/s | 25 kB 00:00 2024-09-15T22:31:59.024 INFO:teuthology.orchestra.run.smithi184.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-09-15T22:31:59.049 INFO:teuthology.orchestra.run.smithi184.stdout:(49/156): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-09-15T22:31:59.066 INFO:teuthology.orchestra.run.smithi184.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-15T22:31:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-15T22:31:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 215 kB/s | 22 kB 00:00 2024-09-15T22:31:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 403 kB/s | 33 kB 00:00 2024-09-15T22:31:59.251 INFO:teuthology.orchestra.run.smithi184.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 414 kB/s | 18 kB 00:00 2024-09-15T22:31:59.293 INFO:teuthology.orchestra.run.smithi184.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-15T22:31:59.332 INFO:teuthology.orchestra.run.smithi087.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-15T22:31:59.335 INFO:teuthology.orchestra.run.smithi184.stdout:(56/156): python3-urllib3-1.26.5-6.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-09-15T22:31:59.342 INFO:teuthology.orchestra.run.smithi066.stdout:(10/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86 3.3 MB/s | 4.7 MB 00:01 2024-09-15T22:31:59.360 INFO:teuthology.orchestra.run.smithi184.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-15T22:31:59.382 INFO:teuthology.orchestra.run.smithi087.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-15T22:31:59.417 INFO:teuthology.orchestra.run.smithi066.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.0 MB/s | 228 kB 00:00 2024-09-15T22:31:59.419 INFO:teuthology.orchestra.run.smithi184.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-15T22:31:59.440 INFO:teuthology.orchestra.run.smithi087.stdout:(33/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 7.4 MB/s | 3.6 MB 00:00 2024-09-15T22:31:59.452 INFO:teuthology.orchestra.run.smithi184.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-15T22:31:59.466 INFO:teuthology.orchestra.run.smithi087.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 590 kB/s | 49 kB 00:00 2024-09-15T22:31:59.467 INFO:teuthology.orchestra.run.smithi066.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 543 kB/s | 27 kB 00:00 2024-09-15T22:31:59.478 INFO:teuthology.orchestra.run.smithi184.stdout:(60/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2024-09-15T22:31:59.491 INFO:teuthology.orchestra.run.smithi087.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 327 kB/s | 16 kB 00:00 2024-09-15T22:31:59.503 INFO:teuthology.orchestra.run.smithi184.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-15T22:31:59.516 INFO:teuthology.orchestra.run.smithi087.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:31:59.526 INFO:teuthology.orchestra.run.smithi066.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 545 kB/s | 32 kB 00:00 2024-09-15T22:31:59.536 INFO:teuthology.orchestra.run.smithi184.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-15T22:31:59.558 INFO:teuthology.orchestra.run.smithi087.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 439 kB/s | 18 kB 00:00 2024-09-15T22:31:59.562 INFO:teuthology.orchestra.run.smithi184.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-15T22:31:59.583 INFO:teuthology.orchestra.run.smithi087.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-15T22:31:59.587 INFO:teuthology.orchestra.run.smithi184.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T22:31:59.612 INFO:teuthology.orchestra.run.smithi184.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-15T22:31:59.663 INFO:teuthology.orchestra.run.smithi184.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-15T22:31:59.684 INFO:teuthology.orchestra.run.smithi066.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-15T22:31:59.692 INFO:teuthology.orchestra.run.smithi087.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-15T22:31:59.753 INFO:teuthology.orchestra.run.smithi066.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T22:31:59.763 INFO:teuthology.orchestra.run.smithi184.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-15T22:31:59.792 INFO:teuthology.orchestra.run.smithi087.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-15T22:31:59.802 INFO:teuthology.orchestra.run.smithi066.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:31:59.817 INFO:teuthology.orchestra.run.smithi087.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-15T22:31:59.847 INFO:teuthology.orchestra.run.smithi184.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-15T22:31:59.859 INFO:teuthology.orchestra.run.smithi087.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-15T22:31:59.880 INFO:teuthology.orchestra.run.smithi184.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-15T22:31:59.902 INFO:teuthology.orchestra.run.smithi087.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-15T22:31:59.905 INFO:teuthology.orchestra.run.smithi184.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T22:31:59.927 INFO:teuthology.orchestra.run.smithi087.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 106 kB 00:00 2024-09-15T22:31:59.935 INFO:teuthology.orchestra.run.smithi066.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 3.7 MB/s | 506 kB 00:00 2024-09-15T22:31:59.947 INFO:teuthology.orchestra.run.smithi184.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-15T22:31:59.952 INFO:teuthology.orchestra.run.smithi087.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T22:31:59.981 INFO:teuthology.orchestra.run.smithi184.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T22:31:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-15T22:32:00.006 INFO:teuthology.orchestra.run.smithi184.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-15T22:32:00.011 INFO:teuthology.orchestra.run.smithi087.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-15T22:32:00.098 INFO:teuthology.orchestra.run.smithi184.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-15T22:32:00.123 INFO:teuthology.orchestra.run.smithi184.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-15T22:32:00.148 INFO:teuthology.orchestra.run.smithi184.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-15T22:32:00.174 INFO:teuthology.orchestra.run.smithi184.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-15T22:32:00.199 INFO:teuthology.orchestra.run.smithi184.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-15T22:32:00.216 INFO:teuthology.orchestra.run.smithi184.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-15T22:32:00.245 INFO:teuthology.orchestra.run.smithi087.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-15T22:32:00.249 INFO:teuthology.orchestra.run.smithi184.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T22:32:00.275 INFO:teuthology.orchestra.run.smithi184.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-15T22:32:00.304 INFO:teuthology.orchestra.run.smithi087.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-15T22:32:00.329 INFO:teuthology.orchestra.run.smithi087.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-15T22:32:00.354 INFO:teuthology.orchestra.run.smithi087.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-15T22:32:00.359 INFO:teuthology.orchestra.run.smithi184.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-15T22:32:00.384 INFO:teuthology.orchestra.run.smithi184.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 250 kB 00:00 2024-09-15T22:32:00.396 INFO:teuthology.orchestra.run.smithi087.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 785 kB/s | 33 kB 00:00 2024-09-15T22:32:00.409 INFO:teuthology.orchestra.run.smithi184.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-15T22:32:00.430 INFO:teuthology.orchestra.run.smithi087.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-15T22:32:00.434 INFO:teuthology.orchestra.run.smithi184.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T22:32:00.451 INFO:teuthology.orchestra.run.smithi184.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-15T22:32:00.471 INFO:teuthology.orchestra.run.smithi087.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-15T22:32:00.485 INFO:teuthology.orchestra.run.smithi184.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T22:32:00.510 INFO:teuthology.orchestra.run.smithi184.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-15T22:32:00.522 INFO:teuthology.orchestra.run.smithi087.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-15T22:32:00.535 INFO:teuthology.orchestra.run.smithi184.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-15T22:32:00.561 INFO:teuthology.orchestra.run.smithi184.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:32:00.586 INFO:teuthology.orchestra.run.smithi184.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:32:00.653 INFO:teuthology.orchestra.run.smithi184.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-15T22:32:00.678 INFO:teuthology.orchestra.run.smithi184.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-15T22:32:00.703 INFO:teuthology.orchestra.run.smithi184.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-15T22:32:00.728 INFO:teuthology.orchestra.run.smithi184.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T22:32:00.739 INFO:teuthology.orchestra.run.smithi087.stdout:(56/156): ceph-common-19.1.1-326.g8921c8ef.el9. 3.3 MB/s | 21 MB 00:06 2024-09-15T22:32:00.754 INFO:teuthology.orchestra.run.smithi184.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-15T22:32:00.764 INFO:teuthology.orchestra.run.smithi087.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 662 kB/s | 160 kB 00:00 2024-09-15T22:32:00.779 INFO:teuthology.orchestra.run.smithi184.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-15T22:32:00.804 INFO:teuthology.orchestra.run.smithi184.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-15T22:32:00.830 INFO:teuthology.orchestra.run.smithi184.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T22:32:00.847 INFO:teuthology.orchestra.run.smithi087.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-15T22:32:00.855 INFO:teuthology.orchestra.run.smithi184.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-15T22:32:00.880 INFO:teuthology.orchestra.run.smithi184.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-15T22:32:00.906 INFO:teuthology.orchestra.run.smithi184.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-15T22:32:00.914 INFO:teuthology.orchestra.run.smithi087.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-15T22:32:00.965 INFO:teuthology.orchestra.run.smithi087.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-15T22:32:01.015 INFO:teuthology.orchestra.run.smithi087.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-15T22:32:01.049 INFO:teuthology.orchestra.run.smithi087.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-15T22:32:01.077 INFO:teuthology.orchestra.run.smithi066.stdout:(18/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 24 MB/s | 49 MB 00:02 2024-09-15T22:32:01.099 INFO:teuthology.orchestra.run.smithi087.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-15T22:32:01.149 INFO:teuthology.orchestra.run.smithi087.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-15T22:32:01.152 INFO:teuthology.orchestra.run.smithi066.stdout:(19/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 4.4 MB/s | 5.3 MB 00:01 2024-09-15T22:32:01.174 INFO:teuthology.orchestra.run.smithi087.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 513 kB/s | 38 kB 00:00 2024-09-15T22:32:01.177 INFO:teuthology.orchestra.run.smithi066.stdout:(20/156): python3-ceph-argparse-19.1.1-326.g892 452 kB/s | 45 kB 00:00 2024-09-15T22:32:01.208 INFO:teuthology.orchestra.run.smithi087.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-15T22:32:01.228 INFO:teuthology.orchestra.run.smithi066.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-15T22:32:01.231 INFO:teuthology.orchestra.run.smithi184.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-15T22:32:01.253 INFO:teuthology.orchestra.run.smithi066.stdout:(22/156): python3-ceph-common-19.1.1-326.g8921c 1.3 MB/s | 136 kB 00:00 2024-09-15T22:32:01.256 INFO:teuthology.orchestra.run.smithi184.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 59 kB/s | 22 kB 00:00 2024-09-15T22:32:01.287 INFO:teuthology.orchestra.run.smithi066.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 5.3 MB/s | 320 kB 00:00 2024-09-15T22:32:01.306 INFO:teuthology.orchestra.run.smithi184.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-15T22:32:01.331 INFO:teuthology.orchestra.run.smithi184.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-15T22:32:01.337 INFO:teuthology.orchestra.run.smithi066.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.5 MB/s | 300 kB 00:00 2024-09-15T22:32:01.357 INFO:teuthology.orchestra.run.smithi184.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-15T22:32:01.362 INFO:teuthology.orchestra.run.smithi066.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.3 MB/s | 99 kB 00:00 2024-09-15T22:32:01.382 INFO:teuthology.orchestra.run.smithi184.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:32:01.387 INFO:teuthology.orchestra.run.smithi066.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:32:01.407 INFO:teuthology.orchestra.run.smithi184.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T22:32:01.441 INFO:teuthology.orchestra.run.smithi184.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:32:01.446 INFO:teuthology.orchestra.run.smithi066.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:32:01.475 INFO:teuthology.orchestra.run.smithi184.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T22:32:01.497 INFO:teuthology.orchestra.run.smithi066.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 638 kB/s | 32 kB 00:00 2024-09-15T22:32:01.533 INFO:teuthology.orchestra.run.smithi184.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-15T22:32:01.547 INFO:teuthology.orchestra.run.smithi066.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-15T22:32:01.572 INFO:teuthology.orchestra.run.smithi066.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.9 MB/s | 146 kB 00:00 2024-09-15T22:32:01.575 INFO:teuthology.orchestra.run.smithi184.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-15T22:32:01.600 INFO:teuthology.orchestra.run.smithi087.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-09-15T22:32:01.609 INFO:teuthology.orchestra.run.smithi184.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-15T22:32:01.634 INFO:teuthology.orchestra.run.smithi184.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:32:01.693 INFO:teuthology.orchestra.run.smithi184.stdout:(116/156): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-15T22:32:01.714 INFO:teuthology.orchestra.run.smithi066.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 21 MB/s | 3.6 MB 00:00 2024-09-15T22:32:01.718 INFO:teuthology.orchestra.run.smithi184.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-15T22:32:01.743 INFO:teuthology.orchestra.run.smithi184.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:32:01.764 INFO:teuthology.orchestra.run.smithi066.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-15T22:32:01.768 INFO:teuthology.orchestra.run.smithi184.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-15T22:32:01.794 INFO:teuthology.orchestra.run.smithi184.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-15T22:32:01.806 INFO:teuthology.orchestra.run.smithi066.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 1.2 MB/s | 49 kB 00:00 2024-09-15T22:32:01.819 INFO:teuthology.orchestra.run.smithi184.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:32:01.825 INFO:teuthology.orchestra.run.smithi087.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.0 MB/s | 910 kB 00:00 2024-09-15T22:32:01.848 INFO:teuthology.orchestra.run.smithi066.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 395 kB/s | 16 kB 00:00 2024-09-15T22:32:01.853 INFO:teuthology.orchestra.run.smithi184.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 912 kB/s | 863 kB 00:00 2024-09-15T22:32:01.878 INFO:teuthology.orchestra.run.smithi184.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-15T22:32:01.884 INFO:teuthology.orchestra.run.smithi087.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T22:32:01.898 INFO:teuthology.orchestra.run.smithi066.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T22:32:01.903 INFO:teuthology.orchestra.run.smithi184.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 994 kB/s | 18 kB 00:00 2024-09-15T22:32:01.929 INFO:teuthology.orchestra.run.smithi184.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2024-09-15T22:32:01.954 INFO:teuthology.orchestra.run.smithi184.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 477 kB/s | 23 kB 00:00 2024-09-15T22:32:01.957 INFO:teuthology.orchestra.run.smithi066.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 13 MB/s | 765 kB 00:00 2024-09-15T22:32:01.979 INFO:teuthology.orchestra.run.smithi184.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-15T22:32:01.999 INFO:teuthology.orchestra.run.smithi066.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 440 kB/s | 18 kB 00:00 2024-09-15T22:32:02.004 INFO:teuthology.orchestra.run.smithi184.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-15T22:32:02.029 INFO:teuthology.orchestra.run.smithi184.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:32:02.051 INFO:teuthology.orchestra.run.smithi087.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-09-15T22:32:02.054 INFO:teuthology.orchestra.run.smithi184.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:32:02.080 INFO:teuthology.orchestra.run.smithi184.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:32:02.139 INFO:teuthology.orchestra.run.smithi184.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-15T22:32:02.149 INFO:teuthology.orchestra.run.smithi066.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-15T22:32:02.164 INFO:teuthology.orchestra.run.smithi184.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-15T22:32:02.181 INFO:teuthology.orchestra.run.smithi184.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-09-15T22:32:02.206 INFO:teuthology.orchestra.run.smithi184.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-15T22:32:02.223 INFO:teuthology.orchestra.run.smithi184.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-15T22:32:02.242 INFO:teuthology.orchestra.run.smithi087.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-15T22:32:02.257 INFO:teuthology.orchestra.run.smithi184.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-15T22:32:02.282 INFO:teuthology.orchestra.run.smithi184.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-15T22:32:02.307 INFO:teuthology.orchestra.run.smithi184.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T22:32:02.308 INFO:teuthology.orchestra.run.smithi066.stdout:(39/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 4.0 MB/s | 17 MB 00:04 2024-09-15T22:32:02.332 INFO:teuthology.orchestra.run.smithi184.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-15T22:32:02.343 INFO:teuthology.orchestra.run.smithi087.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.1 MB/s | 4.9 MB 00:01 2024-09-15T22:32:02.358 INFO:teuthology.orchestra.run.smithi184.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-15T22:32:02.368 INFO:teuthology.orchestra.run.smithi087.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 697 kB/s | 87 kB 00:00 2024-09-15T22:32:02.375 INFO:teuthology.orchestra.run.smithi184.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-15T22:32:02.400 INFO:teuthology.orchestra.run.smithi184.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-15T22:32:02.419 INFO:teuthology.orchestra.run.smithi087.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-15T22:32:02.425 INFO:teuthology.orchestra.run.smithi184.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 790 kB/s | 20 kB 00:00 2024-09-15T22:32:02.433 INFO:teuthology.orchestra.run.smithi066.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-15T22:32:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-15T22:32:02.476 INFO:teuthology.orchestra.run.smithi184.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:32:02.483 INFO:teuthology.orchestra.run.smithi066.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-15T22:32:02.501 INFO:teuthology.orchestra.run.smithi184.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:32:02.509 INFO:teuthology.orchestra.run.smithi066.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-15T22:32:02.510 INFO:teuthology.orchestra.run.smithi087.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-15T22:32:02.552 INFO:teuthology.orchestra.run.smithi184.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T22:32:02.559 INFO:teuthology.orchestra.run.smithi066.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-15T22:32:02.594 INFO:teuthology.orchestra.run.smithi087.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-15T22:32:02.601 INFO:teuthology.orchestra.run.smithi066.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-15T22:32:02.644 INFO:teuthology.orchestra.run.smithi087.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-15T22:32:02.659 INFO:teuthology.orchestra.run.smithi066.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-15T22:32:02.695 INFO:teuthology.orchestra.run.smithi087.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-15T22:32:02.718 INFO:teuthology.orchestra.run.smithi066.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-15T22:32:02.752 INFO:teuthology.orchestra.run.smithi066.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-09-15T22:32:02.753 INFO:teuthology.orchestra.run.smithi087.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-15T22:32:02.829 INFO:teuthology.orchestra.run.smithi087.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 464 kB/s | 35 kB 00:00 2024-09-15T22:32:02.894 INFO:teuthology.orchestra.run.smithi066.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-15T22:32:02.935 INFO:teuthology.orchestra.run.smithi066.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-15T22:32:02.961 INFO:teuthology.orchestra.run.smithi066.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-15T22:32:02.986 INFO:teuthology.orchestra.run.smithi066.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-15T22:32:03.011 INFO:teuthology.orchestra.run.smithi066.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-15T22:32:03.036 INFO:teuthology.orchestra.run.smithi066.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-15T22:32:03.078 INFO:teuthology.orchestra.run.smithi066.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-15T22:32:03.129 INFO:teuthology.orchestra.run.smithi066.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-09-15T22:32:03.137 INFO:teuthology.orchestra.run.smithi087.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-15T22:32:03.151 INFO:teuthology.orchestra.run.smithi184.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 4.9 MB/s | 3.2 MB 00:00 2024-09-15T22:32:03.154 INFO:teuthology.orchestra.run.smithi066.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-15T22:32:03.179 INFO:teuthology.orchestra.run.smithi066.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-15T22:32:03.202 INFO:teuthology.orchestra.run.smithi184.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 4.7 MB/s | 3.4 MB 00:00 2024-09-15T22:32:03.204 INFO:teuthology.orchestra.run.smithi066.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-15T22:32:03.237 INFO:teuthology.orchestra.run.smithi087.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-15T22:32:03.246 INFO:teuthology.orchestra.run.smithi066.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T22:32:03.271 INFO:teuthology.orchestra.run.smithi066.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-15T22:32:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-15T22:32:03.321 INFO:teuthology.orchestra.run.smithi087.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-15T22:32:03.322 INFO:teuthology.orchestra.run.smithi066.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-15T22:32:03.347 INFO:teuthology.orchestra.run.smithi066.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-15T22:32:03.373 INFO:teuthology.orchestra.run.smithi066.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T22:32:03.388 INFO:teuthology.orchestra.run.smithi087.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-15T22:32:03.389 INFO:teuthology.orchestra.run.smithi066.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 925 kB/s | 38 kB 00:00 2024-09-15T22:32:03.480 INFO:teuthology.orchestra.run.smithi087.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 463 kB/s | 42 kB 00:00 2024-09-15T22:32:03.531 INFO:teuthology.orchestra.run.smithi066.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-15T22:32:03.552 INFO:teuthology.orchestra.run.smithi184.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-15T22:32:03.572 INFO:teuthology.orchestra.run.smithi087.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-15T22:32:03.599 INFO:teuthology.orchestra.run.smithi066.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-15T22:32:03.622 INFO:teuthology.orchestra.run.smithi087.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T22:32:03.657 INFO:teuthology.orchestra.run.smithi066.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T22:32:03.689 INFO:teuthology.orchestra.run.smithi087.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-15T22:32:03.699 INFO:teuthology.orchestra.run.smithi066.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-15T22:32:03.725 INFO:teuthology.orchestra.run.smithi066.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-15T22:32:03.756 INFO:teuthology.orchestra.run.smithi087.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-09-15T22:32:03.769 INFO:teuthology.orchestra.run.smithi184.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-15T22:32:03.781 INFO:teuthology.orchestra.run.smithi087.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-09-15T22:32:03.791 INFO:teuthology.orchestra.run.smithi066.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-15T22:32:03.806 INFO:teuthology.orchestra.run.smithi087.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:32:03.857 INFO:teuthology.orchestra.run.smithi087.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-15T22:32:03.884 INFO:teuthology.orchestra.run.smithi066.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-15T22:32:03.907 INFO:teuthology.orchestra.run.smithi087.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-15T22:32:03.925 INFO:teuthology.orchestra.run.smithi066.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 655 kB/s | 87 kB 00:00 2024-09-15T22:32:03.965 INFO:teuthology.orchestra.run.smithi087.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T22:32:04.009 INFO:teuthology.orchestra.run.smithi066.stdout:(74/156): ceph-mgr-diskprediction-local-19.1.1- 3.0 MB/s | 7.4 MB 00:02 2024-09-15T22:32:04.016 INFO:teuthology.orchestra.run.smithi087.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-15T22:32:04.034 INFO:teuthology.orchestra.run.smithi066.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-15T22:32:04.076 INFO:teuthology.orchestra.run.smithi066.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-09-15T22:32:04.116 INFO:teuthology.orchestra.run.smithi087.stdout:(96/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-15T22:32:04.141 INFO:teuthology.orchestra.run.smithi087.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-15T22:32:04.151 INFO:teuthology.orchestra.run.smithi066.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-15T22:32:04.177 INFO:teuthology.orchestra.run.smithi066.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-15T22:32:04.192 INFO:teuthology.orchestra.run.smithi087.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T22:32:04.202 INFO:teuthology.orchestra.run.smithi066.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-15T22:32:04.227 INFO:teuthology.orchestra.run.smithi066.stdout:(80/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-15T22:32:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-15T22:32:04.244 INFO:teuthology.orchestra.run.smithi184.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-15T22:32:04.252 INFO:teuthology.orchestra.run.smithi066.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-15T22:32:04.267 INFO:teuthology.orchestra.run.smithi087.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-15T22:32:04.278 INFO:teuthology.orchestra.run.smithi066.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-09-15T22:32:04.301 INFO:teuthology.orchestra.run.smithi087.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-15T22:32:04.303 INFO:teuthology.orchestra.run.smithi066.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-15T22:32:04.326 INFO:teuthology.orchestra.run.smithi087.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-15T22:32:04.328 INFO:teuthology.orchestra.run.smithi066.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T22:32:04.345 INFO:teuthology.orchestra.run.smithi066.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-15T22:32:04.370 INFO:teuthology.orchestra.run.smithi066.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-15T22:32:04.396 INFO:teuthology.orchestra.run.smithi066.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T22:32:04.421 INFO:teuthology.orchestra.run.smithi066.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T22:32:04.443 INFO:teuthology.orchestra.run.smithi087.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-15T22:32:04.444 INFO:teuthology.orchestra.run.smithi184.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 279 kB/s | 249 kB 00:00 2024-09-15T22:32:04.446 INFO:teuthology.orchestra.run.smithi066.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-15T22:32:04.471 INFO:teuthology.orchestra.run.smithi066.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:32:04.497 INFO:teuthology.orchestra.run.smithi066.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:32:04.510 INFO:teuthology.orchestra.run.smithi087.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-15T22:32:04.539 INFO:teuthology.orchestra.run.smithi066.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-15T22:32:04.544 INFO:teuthology.orchestra.run.smithi087.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-15T22:32:04.561 INFO:teuthology.orchestra.run.smithi087.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-15T22:32:04.614 INFO:teuthology.orchestra.run.smithi066.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-15T22:32:04.641 INFO:teuthology.orchestra.run.smithi066.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-15T22:32:04.664 INFO:teuthology.orchestra.run.smithi066.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T22:32:04.681 INFO:teuthology.orchestra.run.smithi066.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 860 kB/s | 36 kB 00:00 2024-09-15T22:32:04.699 INFO:teuthology.orchestra.run.smithi066.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-15T22:32:04.703 INFO:teuthology.orchestra.run.smithi087.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-15T22:32:04.728 INFO:teuthology.orchestra.run.smithi087.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:32:04.741 INFO:teuthology.orchestra.run.smithi066.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.0 MB/s | 304 kB 00:00 2024-09-15T22:32:04.753 INFO:teuthology.orchestra.run.smithi087.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-15T22:32:04.757 INFO:teuthology.orchestra.run.smithi066.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-15T22:32:04.778 INFO:teuthology.orchestra.run.smithi087.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-09-15T22:32:04.783 INFO:teuthology.orchestra.run.smithi066.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-15T22:32:04.800 INFO:teuthology.orchestra.run.smithi066.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T22:32:04.812 INFO:teuthology.orchestra.run.smithi087.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-15T22:32:04.817 INFO:teuthology.orchestra.run.smithi066.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-15T22:32:04.846 INFO:teuthology.orchestra.run.smithi087.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-09-15T22:32:04.879 INFO:teuthology.orchestra.run.smithi087.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-15T22:32:04.896 INFO:teuthology.orchestra.run.smithi087.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T22:32:04.913 INFO:teuthology.orchestra.run.smithi087.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-15T22:32:04.917 INFO:teuthology.orchestra.run.smithi066.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-15T22:32:04.930 INFO:teuthology.orchestra.run.smithi087.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 844 kB/s | 14 kB 00:00 2024-09-15T22:32:04.956 INFO:teuthology.orchestra.run.smithi087.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-15T22:32:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:32:05.014 INFO:teuthology.orchestra.run.smithi087.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T22:32:05.040 INFO:teuthology.orchestra.run.smithi087.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T22:32:05.065 INFO:teuthology.orchestra.run.smithi087.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:32:05.084 INFO:teuthology.orchestra.run.smithi066.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-15T22:32:05.099 INFO:teuthology.orchestra.run.smithi087.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T22:32:05.124 INFO:teuthology.orchestra.run.smithi087.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-15T22:32:05.142 INFO:teuthology.orchestra.run.smithi066.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-15T22:32:05.149 INFO:teuthology.orchestra.run.smithi087.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-15T22:32:05.168 INFO:teuthology.orchestra.run.smithi066.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-15T22:32:05.174 INFO:teuthology.orchestra.run.smithi087.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-15T22:32:05.200 INFO:teuthology.orchestra.run.smithi087.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-15T22:32:05.201 INFO:teuthology.orchestra.run.smithi066.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-15T22:32:05.233 INFO:teuthology.orchestra.run.smithi087.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 592 kB/s | 20 kB 00:00 2024-09-15T22:32:05.235 INFO:teuthology.orchestra.run.smithi066.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-15T22:32:05.268 INFO:teuthology.orchestra.run.smithi066.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-09-15T22:32:05.283 INFO:teuthology.orchestra.run.smithi087.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-15T22:32:05.294 INFO:teuthology.orchestra.run.smithi066.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 857 kB/s | 49 kB 00:00 2024-09-15T22:32:05.309 INFO:teuthology.orchestra.run.smithi087.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:32:05.319 INFO:teuthology.orchestra.run.smithi066.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-15T22:32:05.334 INFO:teuthology.orchestra.run.smithi087.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:32:05.344 INFO:teuthology.orchestra.run.smithi066.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-15T22:32:05.359 INFO:teuthology.orchestra.run.smithi087.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:32:05.393 INFO:teuthology.orchestra.run.smithi087.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-15T22:32:05.411 INFO:teuthology.orchestra.run.smithi066.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-15T22:32:05.418 INFO:teuthology.orchestra.run.smithi087.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-15T22:32:05.436 INFO:teuthology.orchestra.run.smithi066.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:32:05.443 INFO:teuthology.orchestra.run.smithi087.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-15T22:32:05.461 INFO:teuthology.orchestra.run.smithi066.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:32:05.469 INFO:teuthology.orchestra.run.smithi087.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-15T22:32:05.494 INFO:teuthology.orchestra.run.smithi087.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-15T22:32:05.495 INFO:teuthology.orchestra.run.smithi066.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-15T22:32:05.519 INFO:teuthology.orchestra.run.smithi087.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-15T22:32:05.520 INFO:teuthology.orchestra.run.smithi066.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-15T22:32:05.545 INFO:teuthology.orchestra.run.smithi087.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T22:32:05.546 INFO:teuthology.orchestra.run.smithi066.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:32:05.570 INFO:teuthology.orchestra.run.smithi087.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-15T22:32:05.595 INFO:teuthology.orchestra.run.smithi087.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-15T22:32:05.604 INFO:teuthology.orchestra.run.smithi066.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-15T22:32:05.621 INFO:teuthology.orchestra.run.smithi087.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:32:05.629 INFO:teuthology.orchestra.run.smithi066.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-15T22:32:05.646 INFO:teuthology.orchestra.run.smithi087.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-15T22:32:05.655 INFO:teuthology.orchestra.run.smithi066.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-15T22:32:05.671 INFO:teuthology.orchestra.run.smithi087.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-15T22:32:05.680 INFO:teuthology.orchestra.run.smithi066.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-15T22:32:05.696 INFO:teuthology.orchestra.run.smithi087.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-15T22:32:05.706 INFO:teuthology.orchestra.run.smithi066.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T22:32:05.711 INFO:teuthology.orchestra.run.smithi184.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 716 kB/s | 1.4 MB 00:01 2024-09-15T22:32:05.722 INFO:teuthology.orchestra.run.smithi087.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-15T22:32:05.730 INFO:teuthology.orchestra.run.smithi066.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-15T22:32:05.747 INFO:teuthology.orchestra.run.smithi087.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:32:05.756 INFO:teuthology.orchestra.run.smithi066.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-15T22:32:05.781 INFO:teuthology.orchestra.run.smithi066.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-15T22:32:05.806 INFO:teuthology.orchestra.run.smithi066.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-15T22:32:05.832 INFO:teuthology.orchestra.run.smithi066.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T22:32:05.865 INFO:teuthology.orchestra.run.smithi066.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T22:32:05.899 INFO:teuthology.orchestra.run.smithi066.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:32:05.911 INFO:teuthology.orchestra.run.smithi184.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 2.4 MB 00:01 2024-09-15T22:32:05.917 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:32:05.917 INFO:teuthology.orchestra.run.smithi184.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-15T22:32:05.924 INFO:teuthology.orchestra.run.smithi066.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:32:05.947 INFO:teuthology.orchestra.run.smithi087.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.5 MB/s | 16 MB 00:02 2024-09-15T22:32:05.958 INFO:teuthology.orchestra.run.smithi066.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.7 MB/s | 1.0 MB 00:00 2024-09-15T22:32:06.002 INFO:teuthology.orchestra.run.smithi087.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-15T22:32:06.002 INFO:teuthology.orchestra.run.smithi066.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-15T22:32:06.009 INFO:teuthology.orchestra.run.smithi066.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-15T22:32:06.034 INFO:teuthology.orchestra.run.smithi066.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-15T22:32:06.059 INFO:teuthology.orchestra.run.smithi066.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-15T22:32:06.101 INFO:teuthology.orchestra.run.smithi066.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-15T22:32:06.126 INFO:teuthology.orchestra.run.smithi066.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-15T22:32:06.160 INFO:teuthology.orchestra.run.smithi066.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-15T22:32:06.185 INFO:teuthology.orchestra.run.smithi066.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-15T22:32:06.210 INFO:teuthology.orchestra.run.smithi066.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:32:06.227 INFO:teuthology.orchestra.run.smithi066.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-15T22:32:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 9.0 MB/s | 2.3 MB 00:00 2024-09-15T22:32:06.252 INFO:teuthology.orchestra.run.smithi066.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-15T22:32:06.278 INFO:teuthology.orchestra.run.smithi066.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-15T22:32:06.295 INFO:teuthology.orchestra.run.smithi066.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-15T22:32:06.320 INFO:teuthology.orchestra.run.smithi066.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-15T22:32:06.323 INFO:teuthology.orchestra.run.smithi087.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-15T22:32:06.354 INFO:teuthology.orchestra.run.smithi066.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:32:06.374 INFO:teuthology.orchestra.run.smithi087.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-15T22:32:06.390 INFO:teuthology.orchestra.run.smithi087.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 610 kB/s | 41 kB 00:00 2024-09-15T22:32:06.412 INFO:teuthology.orchestra.run.smithi066.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T22:32:06.457 INFO:teuthology.orchestra.run.smithi087.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-15T22:32:06.507 INFO:teuthology.orchestra.run.smithi087.stdout:(154/156): librados2-19.1.1-326.g8921c8ef.el9.x 4.5 MB/s | 3.4 MB 00:00 2024-09-15T22:32:06.558 INFO:teuthology.orchestra.run.smithi087.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-15T22:32:06.583 INFO:teuthology.orchestra.run.smithi087.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-15T22:32:06.589 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:32:06.589 INFO:teuthology.orchestra.run.smithi087.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-15T22:32:06.688 INFO:teuthology.orchestra.run.smithi066.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 8.4 MB/s | 2.3 MB 00:00 2024-09-15T22:32:06.788 INFO:teuthology.orchestra.run.smithi066.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-15T22:32:06.838 INFO:teuthology.orchestra.run.smithi066.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 817 kB/s | 41 kB 00:00 2024-09-15T22:32:06.897 INFO:teuthology.orchestra.run.smithi066.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-15T22:32:06.988 INFO:teuthology.orchestra.run.smithi066.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-15T22:32:07.097 INFO:teuthology.orchestra.run.smithi066.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-15T22:32:07.113 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-09-15T22:32:07.262 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-09-15T22:32:07.262 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-09-15T22:32:07.364 INFO:teuthology.orchestra.run.smithi066.stdout:(155/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 3.1 MB/s | 3.2 MB 00:01 2024-09-15T22:32:07.456 INFO:teuthology.orchestra.run.smithi066.stdout:(156/156): librados2-19.1.1-326.g8921c8ef.el9.x 3.0 MB/s | 3.4 MB 00:01 2024-09-15T22:32:07.463 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:32:07.463 INFO:teuthology.orchestra.run.smithi066.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-15T22:32:07.832 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-15T22:32:07.982 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-15T22:32:07.982 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-15T22:32:08.744 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-15T22:32:08.914 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-15T22:32:08.914 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-15T22:32:09.155 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-09-15T22:32:09.156 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-09-15T22:32:09.783 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-15T22:32:09.783 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-15T22:32:11.192 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-15T22:32:11.192 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-15T22:32:15.589 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-09-15T22:32:15.698 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:32:15.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:32:15.790 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:32:15.823 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:32:15.849 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:32:15.892 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:32:16.026 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-15T22:32:16.129 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:32:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:32:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:32:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:32:16.277 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:32:16.300 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:32:16.334 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:16.339 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:32:16.464 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:16.493 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:16.584 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:16.614 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:32:16.663 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:32:16.761 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:32:16.819 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:32:16.847 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:16.872 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:16.950 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:16.972 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:17.035 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:17.066 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:17.091 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:17.221 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:17.257 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:17.266 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:17.348 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:17.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:32:17.393 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:17.513 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:32:17.525 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:32:17.582 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:32:17.610 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:17.613 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:17.690 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:17.714 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:17.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:17.799 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:17.829 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:17.831 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-15T22:32:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:17.890 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:17.963 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:32:17.995 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:32:18.006 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:32:18.014 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:18.080 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:32:18.089 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:32:18.120 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:32:18.120 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:32:18.145 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:32:18.154 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:32:18.165 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:18.200 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:32:18.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:32:18.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:32:18.295 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:32:18.331 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:32:18.339 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:32:18.372 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:32:18.399 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:32:18.429 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:18.467 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:32:18.507 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:18.538 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:32:18.558 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:32:18.569 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:32:18.613 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:32:18.663 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:18.685 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:32:18.718 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:32:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:18.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:32:18.788 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:32:18.791 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:32:18.814 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:18.852 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:32:18.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:32:18.890 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:32:18.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:32:18.928 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:32:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:32:18.978 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:32:18.980 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:32:19.013 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:32:19.076 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:32:19.116 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:32:19.122 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:32:19.126 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:32:19.154 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:32:19.175 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:32:19.197 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:32:19.208 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:32:19.230 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:32:19.235 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:19.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:32:19.340 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:32:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:32:19.369 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:32:19.416 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:32:19.427 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:32:19.445 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:19.462 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:32:19.466 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:32:19.538 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:32:19.573 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:32:19.616 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:32:19.645 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:32:19.665 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:19.714 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:32:19.715 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:32:19.768 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:32:19.794 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:32:19.832 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:32:19.835 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:32:19.850 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:32:19.875 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:32:19.913 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:32:19.951 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:32:19.955 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:32:19.980 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:32:20.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:32:20.068 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:20.115 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:32:20.145 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:20.186 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:32:20.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:32:20.319 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:32:20.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:32:20.386 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:32:20.387 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:32:20.433 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:32:20.469 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:32:20.498 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:32:20.511 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:32:20.550 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:32:20.554 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:32:20.591 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:32:20.631 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:32:20.633 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:32:20.668 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:32:20.669 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:32:20.697 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:32:20.711 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:32:20.735 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:32:20.747 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:32:20.749 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:32:20.786 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:32:20.788 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:32:20.790 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:32:20.826 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:32:20.869 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:32:20.891 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:32:20.902 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:32:20.929 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:32:20.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:32:20.939 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:32:20.970 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:32:20.996 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:32:21.001 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:32:21.012 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:32:21.021 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:32:21.061 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:32:21.066 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:32:21.091 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:32:21.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:32:21.135 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:32:21.139 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:32:21.180 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:32:21.214 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:32:21.216 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:32:21.221 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:32:21.245 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:32:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:32:21.289 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:32:21.307 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:32:21.317 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:32:21.350 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:32:21.389 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:32:21.392 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:32:21.432 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:32:21.512 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:32:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:32:21.527 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:32:21.557 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:32:21.577 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:32:21.593 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:32:21.626 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:32:21.633 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:32:21.663 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:32:21.673 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:32:21.702 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:32:21.727 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:32:21.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:32:21.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:32:21.770 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:32:21.786 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:32:21.812 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:32:21.825 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:32:21.846 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:32:21.851 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:32:21.875 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:32:21.935 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:32:21.948 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:32:21.984 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:32:22.015 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:32:22.067 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:32:22.099 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:32:22.118 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:32:22.127 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:32:22.161 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:32:22.173 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:32:22.217 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:32:22.281 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:32:22.283 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:32:22.374 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:32:22.409 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:32:22.451 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:32:22.452 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:32:22.490 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:32:22.532 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:32:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:32:22.701 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:32:22.750 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:32:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:32:22.807 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:32:22.883 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:32:22.889 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:32:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:32:22.935 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:32:22.964 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:32:22.971 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:32:23.019 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:32:23.052 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:32:23.054 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:32:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:32:23.097 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:32:23.133 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:32:23.139 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:32:23.174 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:32:23.214 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:32:23.235 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:32:23.283 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:32:23.283 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:32:23.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:32:23.324 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:32:23.359 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:32:23.365 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:32:23.405 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:32:23.492 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:32:23.524 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:32:23.549 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:32:23.699 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:32:23.733 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:32:23.755 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:32:23.764 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:32:23.789 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:32:23.814 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:32:23.841 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:32:23.919 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:32:23.992 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:32:24.039 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:32:24.047 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:32:24.073 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:32:24.079 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:32:24.115 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:32:24.155 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:32:24.170 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:32:24.197 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:32:24.227 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:32:24.241 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:32:24.270 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:32:24.272 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:32:24.296 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:32:24.329 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:32:24.371 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:32:24.373 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:32:24.405 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:32:24.409 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:32:24.482 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:32:24.578 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:32:24.594 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:32:24.599 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:32:24.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:32:24.725 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:32:24.787 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:32:24.825 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:32:24.933 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:32:24.994 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:32:25.372 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:32:25.487 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:32:25.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:32:25.806 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:32:25.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:32:25.840 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:32:25.884 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:32:25.911 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:32:25.936 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:32:25.943 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:32:25.987 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:32:26.032 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:32:26.124 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:32:26.159 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:32:26.237 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:32:26.274 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:26.350 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:32:26.365 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:26.395 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:32:26.398 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:32:26.431 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:32:26.486 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:32:26.686 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:32:26.769 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:32:26.796 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:32:26.829 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:32:26.910 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:32:26.935 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:27.006 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:27.046 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:32:27.136 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:32:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:27.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:32:27.265 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:27.297 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:32:27.307 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:32:27.332 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:32:27.810 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:32:27.836 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:27.895 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:27.921 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:32:28.621 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:32:28.709 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:32:28.737 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:32:28.770 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:32:29.096 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:32:29.141 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:29.241 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:32:29.271 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:32:29.287 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:29.307 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:32:29.316 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:29.815 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:32:29.844 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:29.864 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:29.897 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:29.898 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:32:29.929 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:32:29.989 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:29.989 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:32:29.989 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:32:29.989 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:30.015 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:30.185 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:30.218 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:30.870 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:32:30.870 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:32:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:32.437 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:32.466 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:33.053 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:32:33.095 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:33.186 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:32:33.186 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:32:33.186 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:32:33.186 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:33.238 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:41.894 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-09-15T22:32:41.894 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-09-15T22:32:41.895 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:42.067 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:42.083 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:42.083 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:32:42.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-09-15T22:32:42.746 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:42.924 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:42.940 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:42.941 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:42.941 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:32:42.941 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:43.552 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:43.580 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:43.580 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:43.580 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:32:43.580 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:43.581 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:43.581 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:43.820 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:43.844 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:44.297 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:44.320 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:44.320 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:44.321 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:32:44.321 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:44.321 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:44.321 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:44.418 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:44.426 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:32:44.445 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:44.445 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:44.445 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:32:44.445 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:44.446 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:44.446 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:44.475 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:32:44.531 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:32:44.669 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:44.693 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:44.716 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:32:44.764 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:32:44.833 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:32:44.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:32:45.051 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:32:45.098 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:32:45.128 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:45.129 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:32:45.151 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:45.151 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:45.151 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:32:45.151 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:45.151 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:45.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:45.157 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:32:45.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:32:45.315 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:32:45.369 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:32:45.458 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-09-15T22:32:45.459 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:45.552 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:32:45.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:32:45.619 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:45.639 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:45.648 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:45.656 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:32:45.656 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:45.656 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:32:45.656 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:45.672 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:32:45.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:32:45.741 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:32:45.759 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:32:45.771 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:45.933 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:32:45.978 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:32:46.018 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:32:46.055 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:32:46.508 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:46.537 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:46.568 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:32:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:32:46.668 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:46.807 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:46.839 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:47.184 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:32:47.213 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:47.452 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:32:47.477 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:47.700 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:47.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:47.800 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:47.823 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:47.923 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:47.936 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:32:47.961 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:48.067 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:32:48.084 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:32:48.116 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:48.125 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:32:48.140 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:48.141 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:48.141 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:32:48.141 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:48.141 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:48.142 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:48.190 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:32:48.192 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:48.204 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:48.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:32:48.349 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:32:48.384 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:32:48.454 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:32:48.534 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:32:48.624 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:32:48.694 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:48.728 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:48.766 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:32:48.822 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:32:48.830 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:48.861 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:32:48.890 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:32:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:32:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:49.054 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:49.055 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:32:49.055 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:49.055 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:49.106 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:49.118 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:49.214 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:32:49.262 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:32:49.276 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:32:49.287 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:49.303 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:49.313 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:49.327 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:49.336 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:32:49.370 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:49.392 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:32:49.393 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:49.393 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:49.393 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:32:49.393 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:49.419 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:49.438 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:49.461 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:49.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:49.787 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:32:50.193 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:32:50.225 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:50.249 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:50.249 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:50.249 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:32:50.249 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:50.250 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:50.250 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:50.315 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:50.315 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:32:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:50.383 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:50.524 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:32:50.554 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:50.709 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:32:51.567 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:32:51.596 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:51.706 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:32:51.884 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:32:51.907 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:32:51.933 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:51.982 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:51.995 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:32:52.096 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:32:52.187 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:32:53.167 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:32:53.193 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:32:53.219 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:53.260 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:53.285 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:32:53.285 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:53.285 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:32:53.285 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:53.336 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:32:53.361 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:53.679 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:53.703 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:32:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:32:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:32:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:32:53.704 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:32:54.316 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:32:54.366 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:32:54.407 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:32:54.439 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:32:54.467 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:32:54.646 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:32:54.705 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:32:54.735 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:32:54.764 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:32:54.811 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:32:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:32:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:32:55.329 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:32:55.370 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:32:55.405 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:32:55.407 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:55.441 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:55.461 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:55.586 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:32:55.627 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:32:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:32:55.687 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:32:55.757 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:32:56.281 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:32:56.310 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:56.376 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:56.380 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:32:56.395 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:56.421 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:32:56.502 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:32:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:32:56.591 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:32:56.626 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:32:56.626 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:32:56.710 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:32:56.710 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:32:56.794 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:32:56.819 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:32:56.824 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:56.824 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:32:57.105 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:32:57.167 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:32:57.218 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:32:57.309 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:32:57.349 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:32:57.432 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:32:57.462 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:32:57.487 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:32:57.522 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:32:57.522 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:32:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:32:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:32:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:32:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:32:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:57.892 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:32:57.892 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:32:57.976 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:32:58.047 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:32:58.557 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:32:58.599 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:32:58.640 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:32:58.671 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:32:58.698 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:32:58.909 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:32:58.953 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:32:58.984 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:32:59.013 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:32:59.051 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:32:59.606 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:59.640 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:32:59.661 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:33:00.565 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:33:00.661 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:33:00.707 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:33:00.806 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:33:00.838 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:33:00.864 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:33:00.898 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:33:00.898 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:33:00.974 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:33:00.974 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:33:01.041 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:33:01.066 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:33:01.072 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:33:01.072 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:33:01.260 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:33:01.260 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:33:01.328 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:33:01.395 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:33:02.798 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:33:02.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:33:02.800 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:33:02.813 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:33:02.813 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:33:02.814 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:33:02.815 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:33:02.816 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:33:02.817 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:33:02.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:33:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:33:02.820 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:33:02.821 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:33:02.822 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:33:02.823 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:33:02.824 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:33:03.615 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:03.615 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:33:03.616 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:33:03.617 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:33:03.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:33:03.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:33:03.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:33:03.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:33:03.630 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:33:03.631 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:33:03.632 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:33:03.633 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:33:03.634 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:33:03.635 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:33:03.636 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:33:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:33:03.638 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:33:03.639 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:33:03.640 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:33:03.641 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:33:03.641 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:33:03.641 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:33:03.641 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:05.283 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.284 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.285 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:33:05.286 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.287 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:33:05.288 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:33:05.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:33:05.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:33:05.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:33:05.292 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:33:05.293 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:33:05.294 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:33:05.295 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-09-15T22:33:05.700 DEBUG:teuthology.parallel:result is None 2024-09-15T22:33:06.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:06.417 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:33:06.417 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-09-15T22:33:06.417 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:06.417 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:33:06.418 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.419 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:06.420 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.421 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:33:06.422 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:33:06.423 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.424 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:33:06.425 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:33:06.426 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:33:06.427 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:33:06.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:33:06.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:33:06.430 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:33:06.431 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:33:06.431 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:33:06.431 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-15T22:33:06.836 DEBUG:teuthology.parallel:result is None 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:33:06.843 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:33:06.844 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:33:06.845 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:33:06.857 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:33:06.857 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:33:06.857 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:33:06.858 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:33:06.859 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:33:06.860 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:33:06.861 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:33:06.862 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:33:06.863 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:33:06.864 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:33:06.865 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:33:06.866 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:33:06.867 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:33:06.868 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:33:06.868 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:33:06.868 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:33:09.224 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:33:09.224 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:33:09.225 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.226 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.227 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:33:09.228 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:33:09.229 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:33:09.230 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.231 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:33:09.232 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:33:09.233 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:33:09.234 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:33:09.235 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.236 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:33:09.237 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:33:09.238 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-15T22:33:09.639 DEBUG:teuthology.parallel:result is None 2024-09-15T22:33:09.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:09.780 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:33:09.803 INFO:teuthology.orchestra.run.smithi066.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:09.804 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:09.804 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:33:09.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:09.942 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:33:09.969 INFO:teuthology.orchestra.run.smithi087.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:09.969 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:09.969 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:33:09.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:10.105 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:33:10.131 INFO:teuthology.orchestra.run.smithi184.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:10.131 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:33:10.131 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:33:10.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:33:10.134 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:33:10.134 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:33:10.167 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:33:10.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:33:10.200 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:33:10.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:33:10.231 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:33:10.232 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:33:10.232 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:33:10.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:33:10.332 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:33:10.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:33:10.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:33:10.432 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:33:10.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:33:10.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:33:10.529 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:33:10.530 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:33:10.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:33:10.560 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:33:10.632 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:33:10.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:33:10.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:33:10.729 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:33:10.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:33:10.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:33:10.827 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:33:10.827 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:33:10.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:33:10.858 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:33:10.929 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:33:10.929 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:33:10.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:33:11.026 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:33:11.026 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:33:11.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:33:11.123 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T22:33:11.216 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-15T22:33:11.217 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:11.217 INFO:tasks.cephadm:Cluster fsid is 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:33:11.217 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T22:33:11.217 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.66', 'mon.b': '172.21.15.87', 'mon.c': '172.21.15.184'} 2024-09-15T22:33:11.218 INFO:tasks.cephadm:First mon is mon.a on smithi066 2024-09-15T22:33:11.218 INFO:tasks.cephadm:First mgr is x 2024-09-15T22:33:11.218 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T22:33:11.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-09-15T22:33:11.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname $(hostname -s) 2024-09-15T22:33:11.278 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-09-15T22:33:11.309 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T22:33:11.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:11.450 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T22:33:11.590 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:33:11.591 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:33:11.591 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:33:11.591 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:11.988 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:33 /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:11.989 DEBUG:teuthology.orchestra.run.smithi087:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.361 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:33 /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.361 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.717 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:33 /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.717 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.740 DEBUG:teuthology.orchestra.run.smithi087:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.760 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:33:12.795 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T22:33:12.796 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:33:12.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:33:12.803 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:33:14.386 INFO:teuthology.orchestra.run.smithi087.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:33:14.390 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:33:14.402 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:33:44.869 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-15T22:33:44.869 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:33:44.870 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:33:44.870 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-09-15T22:33:44.870 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:33:44.870 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-09-15T22:33:44.870 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout: "repo_digests": [ 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-15T22:34:20.487 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-15T22:34:54.941 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:34:54.941 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:34:54.942 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:34:54.942 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-09-15T22:34:54.942 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:34:54.942 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T22:34:54.942 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:34:54.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-09-15T22:34:55.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph 2024-09-15T22:34:55.048 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-09-15T22:34:55.083 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-09-15T22:34:55.108 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /etc/ceph 2024-09-15T22:34:55.135 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-09-15T22:34:55.163 INFO:tasks.cephadm:Writing seed config... 2024-09-15T22:34:55.164 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T22:34:55.164 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T22:34:55.165 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T22:34:55.166 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-15T22:34:55.167 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T22:34:55.168 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-15T22:34:55.169 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:34:55.169 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T22:34:55.185 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7d1c9c1c-73b2-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T22:34:55.185 DEBUG:teuthology.orchestra.run.smithi066:mon.a> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T22:34:55.227 DEBUG:teuthology.orchestra.run.smithi066:mgr.x> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T22:34:55.270 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T22:34:55.270 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.66 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:34:55.480 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:34:55.492 INFO:teuthology.orchestra.run.smithi066.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', '7d1c9c1c-73b2-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.66', '--skip-admin-label'] 2024-09-15T22:34:55.492 INFO:teuthology.orchestra.run.smithi066.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T22:34:55.493 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying podman|docker is present... 2024-09-15T22:34:55.505 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:34:55.505 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying lvm2 is present... 2024-09-15T22:34:55.505 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying time synchronization is in place... 2024-09-15T22:34:55.513 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:34:55.513 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:34:55.519 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:34:55.519 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:34:55.526 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-15T22:34:55.533 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-15T22:34:55.533 INFO:teuthology.orchestra.run.smithi066.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:34:55.533 INFO:teuthology.orchestra.run.smithi066.stdout:Repeating the final host check... 2024-09-15T22:34:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:34:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T22:34:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl is present 2024-09-15T22:34:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:lvcreate is present 2024-09-15T22:34:55.563 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:34:55.563 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:34:55.569 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:34:55.569 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:34:55.576 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:Host looks OK 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:Cluster fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:Acquiring lock 140627294594048 on /run/cephadm/7d1c9c1c-73b2-11ef-bceb-c7b262605968.lock 2024-09-15T22:34:55.583 INFO:teuthology.orchestra.run.smithi066.stdout:Lock 140627294594048 acquired on /run/cephadm/7d1c9c1c-73b2-11ef-bceb-c7b262605968.lock 2024-09-15T22:34:55.584 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 3300 ... 2024-09-15T22:34:55.584 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 6789 ... 2024-09-15T22:34:55.584 INFO:teuthology.orchestra.run.smithi066.stdout:Base mon IP(s) is [172.21.15.66:3300, 172.21.15.66:6789], mon addrv is [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-15T22:34:55.587 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.66 metric 100 2024-09-15T22:34:55.587 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.66 metric 100 2024-09-15T22:34:55.590 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T22:34:55.590 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-15T22:34:55.590 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-15T22:34:55.592 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T22:34:55.592 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T22:34:55.592 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:34:55.592 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-15T22:34:55.593 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-15T22:34:55.593 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:34:55.593 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-15T22:34:55.593 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-15T22:34:55.593 INFO:teuthology.orchestra.run.smithi066.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T22:34:55.594 INFO:teuthology.orchestra.run.smithi066.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T22:34:55.595 INFO:teuthology.orchestra.run.smithi066.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:34:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T22:34:58.659 INFO:teuthology.orchestra.run.smithi066.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:34:58.660 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:34:58.660 INFO:teuthology.orchestra.run.smithi066.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T22:35:07.628 INFO:teuthology.orchestra.run.smithi066.stdout:stat: stdout 167 167 2024-09-15T22:35:07.629 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial keys... 2024-09-15T22:35:08.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAbYedmSD7gOBAAty9HavwetBAhh91w08kIYg== 2024-09-15T22:35:09.456 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAcYedmLR6uLxAAqXk3Tc35kjDnuTFYR0h5Lw== 2024-09-15T22:35:10.328 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAdYedm9hygLRAATG0xCqVO2E115PUj+vFAkw== 2024-09-15T22:35:10.329 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial monmap... 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool for a [v2:172.21.15.66:3300,v1:172.21.15.66:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:setting min_mon_release = quincy 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: set fsid to 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:35:11.194 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:35:11.194 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mon... 2024-09-15T22:35:12.125 INFO:teuthology.orchestra.run.smithi066.stdout:create mon.a on 2024-09-15T22:35:12.333 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T22:35:12.535 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T22:35:12.726 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target. 2024-09-15T22:35:12.727 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target. 2024-09-15T22:35:13.010 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:35:13.011 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T22:35:13.264 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target.wants/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@.service. 2024-09-15T22:35:13.946 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:35:13.947 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-15T22:35:13.954 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:35:13.954 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:35:13.954 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-15T22:35:13.954 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:35:13.955 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon to start... 2024-09-15T22:35:13.955 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon... 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout id: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout services: 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.464536s) 2024-09-15T22:35:14.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout data: 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.312+0000 7fe276647640 1 Processor -- start 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.312+0000 7fe276647640 1 -- start start 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.312+0000 7fe276647640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:14.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.312+0000 7fe276647640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe270106eb0 con 0x7fe2701064e0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.313+0000 7fe26ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.313+0000 7fe26ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44344/0 (socket says 172.21.15.66:44344) 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.313+0000 7fe26ffff640 1 -- 172.21.15.66:0/2095970395 learned_addr learned my addr 172.21.15.66:0/2095970395 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.313+0000 7fe26ffff640 1 -- 172.21.15.66:0/2095970395 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2701076e0 con 0x7fe2701064e0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.315+0000 7fe26ffff640 1 --2- 172.21.15.66:0/2095970395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe260009820 tx=0x7fe26002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a42ddd0cee06e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.315+0000 7fe26effd640 1 -- 172.21.15.66:0/2095970395 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe260037070 con 0x7fe2701064e0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.315+0000 7fe26effd640 1 -- 172.21.15.66:0/2095970395 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe260032440 con 0x7fe2701064e0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.315+0000 7fe26effd640 1 -- 172.21.15.66:0/2095970395 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe260032740 con 0x7fe2701064e0 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 -- 172.21.15.66:0/2095970395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 msgr2=0x7fe2701068e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 --2- 172.21.15.66:0/2095970395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe260009820 tx=0x7fe26002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 -- 172.21.15.66:0/2095970395 shutdown_connections 2024-09-15T22:35:14.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 --2- 172.21.15.66:0/2095970395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe2701068e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 -- 172.21.15.66:0/2095970395 >> 172.21.15.66:0/2095970395 conn(0x7fe270101c90 msgr2=0x7fe2701040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 -- 172.21.15.66:0/2095970395 shutdown_connections 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.316+0000 7fe276647640 1 -- 172.21.15.66:0/2095970395 wait complete. 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe276647640 1 Processor -- start 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe276647640 1 -- start start 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe276647640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe276647640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe270107bb0 con 0x7fe2701064e0 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe26ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe26ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44352/0 (socket says 172.21.15.66:44352) 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.317+0000 7fe26ffff640 1 -- 172.21.15.66:0/100398189 learned_addr learned my addr 172.21.15.66:0/100398189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26ffff640 1 -- 172.21.15.66:0/100398189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2701990a0 con 0x7fe2701064e0 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26ffff640 1 --2- 172.21.15.66:0/100398189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe2600090b0 tx=0x7fe2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:14.950 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe260041070 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe26003c7a0 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe270199330 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe260037040 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27019c020 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe260044070 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.318+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe26003d3f0 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.319+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe270108270 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.322+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe260046450 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.383+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fe27002d910 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.384+0000 7fe26d7fa640 1 -- 172.21.15.66:0/100398189 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fe260046630 con 0x7fe2701064e0 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.384+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 msgr2=0x7fe270198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.384+0000 7fe276647640 1 --2- 172.21.15.66:0/100398189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe2600090b0 tx=0x7fe2600046c0 comp rx=0 tx=0).stop 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.385+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 shutdown_connections 2024-09-15T22:35:14.951 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.385+0000 7fe276647640 1 --2- 172.21.15.66:0/100398189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe2701064e0 0x7fe270198b60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.385+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 >> 172.21.15.66:0/100398189 conn(0x7fe270101c90 msgr2=0x7fe270103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.385+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 shutdown_connections 2024-09-15T22:35:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:14.385+0000 7fe276647640 1 -- 172.21.15.66:0/100398189 wait complete. 2024-09-15T22:35:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:mon is available 2024-09-15T22:35:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T22:35:15.936 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:15.936 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:35:15.936 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:15.936 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-15T22:35:15.936 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:35:15.937 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.367+0000 7fd9ebe52640 1 Processor -- start 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.367+0000 7fd9ebe52640 1 -- start start 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9ebe52640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9ebe52640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e407bdf0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9e9bee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9e9bee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44362/0 (socket says 172.21.15.66:44362) 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9e9bee640 1 -- 172.21.15.66:0/872061735 learned_addr learned my addr 172.21.15.66:0/872061735 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.368+0000 7fd9e9bee640 1 -- 172.21.15.66:0/872061735 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e41067e0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.369+0000 7fd9e9bee640 1 --2- 172.21.15.66:0/872061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009820 tx=0x7fd9e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccb6920299ad3be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.369+0000 7fd9e8bec640 1 -- 172.21.15.66:0/872061735 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e0037070 con 0x7fd9e4105ea0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.369+0000 7fd9e8bec640 1 -- 172.21.15.66:0/872061735 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e0032440 con 0x7fd9e4105ea0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.369+0000 7fd9e8bec640 1 -- 172.21.15.66:0/872061735 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e0032740 con 0x7fd9e4105ea0 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 -- 172.21.15.66:0/872061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 msgr2=0x7fd9e41062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:15.938 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 --2- 172.21.15.66:0/872061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009820 tx=0x7fd9e002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 -- 172.21.15.66:0/872061735 shutdown_connections 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 --2- 172.21.15.66:0/872061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e41062a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 -- 172.21.15.66:0/872061735 >> 172.21.15.66:0/872061735 conn(0x7fd9e4101c50 msgr2=0x7fd9e4104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 -- 172.21.15.66:0/872061735 shutdown_connections 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 -- 172.21.15.66:0/872061735 wait complete. 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.370+0000 7fd9ebe52640 1 Processor -- start 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9ebe52640 1 -- start start 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9ebe52640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9ebe52640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4106d80 con 0x7fd9e4105ea0 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9e9bee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9e9bee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44370/0 (socket says 172.21.15.66:44370) 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9e9bee640 1 -- 172.21.15.66:0/3634791028 learned_addr learned my addr 172.21.15.66:0/3634791028 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:15.939 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9e9bee640 1 -- 172.21.15.66:0/3634791028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e419d4e0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9e9bee640 1 --2- 172.21.15.66:0/3634791028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00090b0 tx=0x7fd9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e0041070 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.371+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e003c7a0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.372+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e419d770 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.372+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e0037040 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.372+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a0460 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.372+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9e0044070 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.372+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd9e003d3f0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.373+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e41062a0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.375+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd9e0046450 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.435+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd9e41a1b30 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.438+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fd9e0046630 con 0x7fd9e4105ea0 2024-09-15T22:35:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.438+0000 7fd9d6ffd640 1 -- 172.21.15.66:0/3634791028 <== mon.0 v2:172.21.15.66:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9e00584b0 con 0x7fd9e4105ea0 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 msgr2=0x7fd9e419cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 --2- 172.21.15.66:0/3634791028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00090b0 tx=0x7fd9e00046c0 comp rx=0 tx=0).stop 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 shutdown_connections 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 --2- 172.21.15.66:0/3634791028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9e4105ea0 0x7fd9e419cfa0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 >> 172.21.15.66:0/3634791028 conn(0x7fd9e4101c50 msgr2=0x7fd9e4193580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 shutdown_connections 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:15.439+0000 7fd9ebe52640 1 -- 172.21.15.66:0/3634791028 wait complete. 2024-09-15T22:35:15.941 INFO:teuthology.orchestra.run.smithi066.stdout:Generating new minimal ceph.conf... 2024-09-15T22:35:16.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:15 smithi066 ceph-mon[30822]: from='client.? 172.21.15.66:0/3634791028' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T22:35:16.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52ce40c640 1 Processor -- start 2024-09-15T22:35:16.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52ce40c640 1 -- start start 2024-09-15T22:35:16.941 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52ce40c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52ce40c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52c807d100 con 0x7f52c807e6d0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44380/0 (socket says 172.21.15.66:44380) 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.330+0000 7f52c7fff640 1 -- 172.21.15.66:0/2849783771 learned_addr learned my addr 172.21.15.66:0/2849783771 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.331+0000 7f52c7fff640 1 -- 172.21.15.66:0/2849783771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c807d280 con 0x7f52c807e6d0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.331+0000 7f52c7fff640 1 --2- 172.21.15.66:0/2849783771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009820 tx=0x7f52b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef680d61f2f0cc09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.331+0000 7f52c6ffd640 1 -- 172.21.15.66:0/2849783771 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8037070 con 0x7f52c807e6d0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52c6ffd640 1 -- 172.21.15.66:0/2849783771 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52b8032900 con 0x7f52c807e6d0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52c6ffd640 1 -- 172.21.15.66:0/2849783771 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8030850 con 0x7f52c807e6d0 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 -- 172.21.15.66:0/2849783771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 msgr2=0x7f52c807cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 --2- 172.21.15.66:0/2849783771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009820 tx=0x7f52b802a270 comp rx=0 tx=0).stop 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 -- 172.21.15.66:0/2849783771 shutdown_connections 2024-09-15T22:35:16.942 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 --2- 172.21.15.66:0/2849783771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c807cb30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 -- 172.21.15.66:0/2849783771 >> 172.21.15.66:0/2849783771 conn(0x7f52c8102e70 msgr2=0x7f52c8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 -- 172.21.15.66:0/2849783771 shutdown_connections 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.332+0000 7f52ce40c640 1 -- 172.21.15.66:0/2849783771 wait complete. 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52ce40c640 1 Processor -- start 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52ce40c640 1 -- start start 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52ce40c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52ce40c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52c810dc20 con 0x7f52c807e6d0 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44384/0 (socket says 172.21.15.66:44384) 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.333+0000 7f52c7fff640 1 -- 172.21.15.66:0/1968337487 learned_addr learned my addr 172.21.15.66:0/1968337487 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c7fff640 1 -- 172.21.15.66:0/1968337487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c819dcc0 con 0x7f52c807e6d0 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c7fff640 1 --2- 172.21.15.66:0/1968337487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52b80097f0 tx=0x7f52b8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:16.943 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8037040 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52b8040070 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c819df50 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b803a390 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c81a0c40 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52b803a5e0 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.334+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52b8045950 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.335+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c807cbb0 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.337+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f52b8045460 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.398+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f52c81a0e10 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.398+0000 7f52c57fa640 1 -- 172.21.15.66:0/1968337487 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f52b803b430 con 0x7f52c807e6d0 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 msgr2=0x7f52c819d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 --2- 172.21.15.66:0/1968337487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52b80097f0 tx=0x7f52b8030d80 comp rx=0 tx=0).stop 2024-09-15T22:35:16.944 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 shutdown_connections 2024-09-15T22:35:16.945 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 --2- 172.21.15.66:0/1968337487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52c807e6d0 0x7f52c819d780 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:16.945 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 >> 172.21.15.66:0/1968337487 conn(0x7f52c8102e70 msgr2=0x7f52c81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:16.945 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 shutdown_connections 2024-09-15T22:35:16.945 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:16.399+0000 7f52ce40c640 1 -- 172.21.15.66:0/1968337487 wait complete. 2024-09-15T22:35:16.945 INFO:teuthology.orchestra.run.smithi066.stdout:Restarting the monitor... 2024-09-15T22:35:17.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:16 smithi066 ceph-mon[30822]: from='client.? 172.21.15.66:0/1968337487' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:35:17.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:16 smithi066 systemd[1]: Stopping Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:35:17.645 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a[30818]: 2024-09-15T22:35:17.210+0000 7faeef715640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:35:17.646 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a[30818]: 2024-09-15T22:35:17.210+0000 7faeef715640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T22:35:17.646 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 podman[31064]: 2024-09-15 22:35:17.36514865 +0000 UTC m=+0.257969686 container died c4f5126375eb07d25f66c7daba066af4ee74e335b5838067b5ce8b46b9960ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T22:35:17.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 podman[31064]: 2024-09-15 22:35:17.752823941 +0000 UTC m=+0.645644977 container cleanup c4f5126375eb07d25f66c7daba066af4ee74e335b5838067b5ce8b46b9960ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:35:17.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 bash[31064]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:35:18.316 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:17 smithi066 podman[31076]: 2024-09-15 22:35:17.96195544 +0000 UTC m=+0.591045528 container remove c4f5126375eb07d25f66c7daba066af4ee74e335b5838067b5ce8b46b9960ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:35:18.316 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:35:18.316 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 systemd[1]: Stopped Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:35:18.316 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 systemd[1]: Starting Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:35:18.649 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 podman[31166]: 2024-09-15 22:35:18.218207716 +0000 UTC m=+0.016139853 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:35:18.649 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 podman[31166]: 2024-09-15 22:35:18.321018033 +0000 UTC m=+0.118950158 container create 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:35:18.649 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 podman[31166]: 2024-09-15 22:35:18.64862062 +0000 UTC m=+0.446552745 container init 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T22:35:18.712 INFO:teuthology.orchestra.run.smithi066.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T22:35:18.932 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 podman[31166]: 2024-09-15 22:35:18.652443453 +0000 UTC m=+0.450375590 container start 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:35:18.932 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:35:18.932 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:35:18.932 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: pidfile_write: ignore empty --pid-file 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: load: jerasure load: lrc 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Git sha 0 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: DB SUMMARY 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: DB Session ID: 56C1ELUG6KD222QHDRW1 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105234 ; 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:35:18.933 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:35:18.934 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.env: 0x5566932df940 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.info_log: 0x5566941816e0 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.statistics: (nil) 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.use_fsync: 0 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:35:18.936 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:35:18.937 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:35:18.937 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:35:18.937 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:35:18.937 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:35:18.938 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:35:18.938 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:35:18.938 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:35:18.938 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:35:18.938 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.db_log_dir: 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.wal_dir: 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.write_buffer_manager: 0x556694190dc0 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:35:18.939 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.unordered_write: 0 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.row_cache: None 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.wal_filter: None 2024-09-15T22:35:18.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.wal_compression: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:35:18.941 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:35:18.942 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_open_files: -1 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Compression algorithms supported: 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kZSTD supported: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:35:18.943 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.merge_operator: 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_filter: None 2024-09-15T22:35:18.944 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556694181320) 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:35:18.945 INFO:journalctl@ceph.mon.a.smithi066.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: index_type: 0 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: data_block_index_type: 0 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: index_shortening: 1 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: checksum: 4 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: no_block_cache: 0 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_cache: 0x5566941751f0 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_cache_options: 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: capacity : 536870912 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: num_shard_bits : 4 2024-09-15T22:35:18.946 INFO:journalctl@ceph.mon.a.smithi066.stdout: strict_capacity_limit : 0 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_cache_compressed: (nil) 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: persistent_cache: (nil) 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_size: 4096 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_size_deviation: 10 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_restart_interval: 16 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: index_block_restart_interval: 1 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: metadata_block_size: 4096 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: partition_filters: 0 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: use_delta_encoding: 1 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: filter_policy: bloomfilter 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: whole_key_filtering: 1 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: verify_compression: 0 2024-09-15T22:35:18.947 INFO:journalctl@ceph.mon.a.smithi066.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: format_version: 5 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: enable_index_compression: 1 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: block_align: 0 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: max_auto_readahead_size: 262144 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: prepopulate_block_cache: 0 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression: NoCompression 2024-09-15T22:35:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.num_levels: 7 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:35:18.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:35:18.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:35:18.952 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:35:18.953 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.ttl: 2592000 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:35:18.954 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a7d9f95-a45b-464f-8814-fb3ec3399259 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439718680649, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439718682349, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100314, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98199, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14292, "raw_average_key_size": 49, "raw_value_size": 90457, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726439718, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a7d9f95-a45b-464f-8814-fb3ec3399259", "db_session_id": "56C1ELUG6KD222QHDRW1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439718682492, "job": 1, "event": "recovery_finished"} 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5566941a2e00 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: DB pointer 0x55669429e000 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:35:18.955 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: ** DB Stats ** 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:35:18.956 INFO:journalctl@ceph.mon.a.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: L0 2/0 99.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Sum 2/0 99.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:35:18.957 INFO:journalctl@ceph.mon.a.smithi066.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: Cumulative compaction: 0.00 GB write, 19.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: Interval compaction: 0.00 GB write, 19.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: Block cache BinnedLRUCache@0x5566941751f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: starting mon.a rank 0 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???) e1 preinit fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:18.958 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).mds e1 new map 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).mds e1 print_map 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: e1 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: btime 2024-09-15T22:35:13:921866+0000 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: legacy client fscid: -1 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout: No filesystems configured 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:35:18.959 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 bash[31166]: 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 systemd[1]: Started Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: monmap epoch 1 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: last_changed 2024-09-15T22:35:10.634982+0000 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: min_mon_release 19 (squid) 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: election_strategy: 1 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: fsmap 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:35:18.960 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:18 smithi066 ceph-mon[31185]: mgrmap e1: no daemons active 2024-09-15T22:35:19.750 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f3795fa1640 1 Processor -- start 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f3795fa1640 1 -- start start 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f3795fa1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f3795fa1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3790107fc0 con 0x7f37901075f0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44398/0 (socket says 172.21.15.66:44398) 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.126+0000 7f378f7fe640 1 -- 172.21.15.66:0/2403135236 learned_addr learned my addr 172.21.15.66:0/2403135236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.127+0000 7f378f7fe640 1 -- 172.21.15.66:0/2403135236 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901087f0 con 0x7f37901075f0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.128+0000 7f378f7fe640 1 --2- 172.21.15.66:0/2403135236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3780009820 tx=0x7f378002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4da6c208c7bb030 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.128+0000 7f378e7fc640 1 -- 172.21.15.66:0/2403135236 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3780037070 con 0x7f37901075f0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f378e7fc640 1 -- 172.21.15.66:0/2403135236 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3780032900 con 0x7f37901075f0 2024-09-15T22:35:19.755 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f378e7fc640 1 -- 172.21.15.66:0/2403135236 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3780030850 con 0x7f37901075f0 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 -- 172.21.15.66:0/2403135236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 msgr2=0x7f37901079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 --2- 172.21.15.66:0/2403135236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3780009820 tx=0x7f378002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 -- 172.21.15.66:0/2403135236 shutdown_connections 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 --2- 172.21.15.66:0/2403135236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f37901079f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 -- 172.21.15.66:0/2403135236 >> 172.21.15.66:0/2403135236 conn(0x7f3790102e70 msgr2=0x7f3790105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 -- 172.21.15.66:0/2403135236 shutdown_connections 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.129+0000 7f3795fa1640 1 -- 172.21.15.66:0/2403135236 wait complete. 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f3795fa1640 1 Processor -- start 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f3795fa1640 1 -- start start 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f3795fa1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f3795fa1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f379010bba0 con 0x7f37901075f0 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:19.756 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44412/0 (socket says 172.21.15.66:44412) 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.130+0000 7f378f7fe640 1 -- 172.21.15.66:0/3741743901 learned_addr learned my addr 172.21.15.66:0/3741743901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378f7fe640 1 -- 172.21.15.66:0/3741743901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379019bb20 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378f7fe640 1 --2- 172.21.15.66:0/3741743901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3780009940 tx=0x7f3780032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3780042070 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37800308c0 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379019bdb0 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379019eaa0 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3780037040 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3780045070 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.131+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3780047b70 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.132+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379010bd20 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.134+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f37800327b0 con 0x7f37901075f0 2024-09-15T22:35:19.757 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.194+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f3790107a70 con 0x7f37901075f0 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.197+0000 7f378cff9640 1 -- 172.21.15.66:0/3741743901 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f378003c760 con 0x7f37901075f0 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 msgr2=0x7f379019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 --2- 172.21.15.66:0/3741743901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3780009940 tx=0x7f3780032ce0 comp rx=0 tx=0).stop 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 shutdown_connections 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 --2- 172.21.15.66:0/3741743901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37901075f0 0x7f379019b5e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 >> 172.21.15.66:0/3741743901 conn(0x7f3790102e70 msgr2=0x7f3790103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 shutdown_connections 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:19.198+0000 7f3795fa1640 1 -- 172.21.15.66:0/3741743901 wait complete. 2024-09-15T22:35:19.758 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T22:35:19.780 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:35:19.780 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mgr... 2024-09-15T22:35:19.781 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T22:35:19.781 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T22:35:20.044 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:35:20.044 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T22:35:20.218 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968.target.wants/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@.service. 2024-09-15T22:35:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:20 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3741743901' entity='client.admin' 2024-09-15T22:35:20.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 systemd[1]: Starting Ceph mgr.x for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:35:20.744 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 podman[31395]: 2024-09-15 22:35:20.448645864 +0000 UTC m=+0.113394570 container create fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-15T22:35:20.744 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 podman[31395]: 2024-09-15 22:35:20.351709505 +0000 UTC m=+0.016458222 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:35:20.744 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 podman[31395]: 2024-09-15 22:35:20.667760616 +0000 UTC m=+0.332509341 container init fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T22:35:20.744 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 podman[31395]: 2024-09-15 22:35:20.670751094 +0000 UTC m=+0.335499801 container start fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:35:20.744 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 bash[31395]: fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 2024-09-15T22:35:20.758 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:35:20.758 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-15T22:35:20.766 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:35:20.766 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:35:20.766 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-15T22:35:20.766 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:35:20.776 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:35:20.777 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-15T22:35:20.783 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:35:20.783 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:35:20.783 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-15T22:35:20.784 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T22:35:20.784 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr to start... 2024-09-15T22:35:20.784 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr... 2024-09-15T22:35:21.020 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 systemd[1]: Started Ceph mgr.x for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:35:21.020 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:20.796+0000 7f2e15a02040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:35:21.020 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:20.860+0000 7f2e15a02040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:21.020 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.017+0000 7f2e15a02040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:35:21.290 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.092+0000 7f2e15a02040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:35:21.290 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.251+0000 7f2e15a02040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:21.641 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/805054437' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:35:21.641 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.404+0000 7f2e15a02040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:35:21.941 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.738+0000 7f2e15a02040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:35:21.942 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.801+0000 7f2e15a02040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.947 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:35:21.948 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:21.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:35:21.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:35:21.949 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:35:21.956 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:35:13:921866+0000", 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.957 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:35:13.922580+0000", 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:21.958 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.217+0000 7fb943fff640 1 Processor -- start 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.217+0000 7fb943fff640 1 -- start start 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.217+0000 7fb943fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.217+0000 7fb943fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb94407c630 con 0x7fb944107f30 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.218+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.218+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44438/0 (socket says 172.21.15.66:44438) 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.218+0000 7fb942ffd640 1 -- 172.21.15.66:0/3772964733 learned_addr learned my addr 172.21.15.66:0/3772964733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.218+0000 7fb942ffd640 1 -- 172.21.15.66:0/3772964733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94410a860 con 0x7fb944107f30 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.219+0000 7fb942ffd640 1 --2- 172.21.15.66:0/3772964733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb934009820 tx=0x7fb93402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe743cf908f79b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.219+0000 7fb9427fc640 1 -- 172.21.15.66:0/3772964733 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb934037070 con 0x7fb944107f30 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.219+0000 7fb9427fc640 1 -- 172.21.15.66:0/3772964733 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb934032900 con 0x7fb944107f30 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.219+0000 7fb9427fc640 1 -- 172.21.15.66:0/3772964733 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb934030850 con 0x7fb944107f30 2024-09-15T22:35:21.959 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 -- 172.21.15.66:0/3772964733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 msgr2=0x7fb94410a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 --2- 172.21.15.66:0/3772964733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb934009820 tx=0x7fb93402a270 comp rx=0 tx=0).stop 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 -- 172.21.15.66:0/3772964733 shutdown_connections 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 --2- 172.21.15.66:0/3772964733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94410a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 -- 172.21.15.66:0/3772964733 >> 172.21.15.66:0/3772964733 conn(0x7fb944101ab0 msgr2=0x7fb944103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 -- 172.21.15.66:0/3772964733 shutdown_connections 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.220+0000 7fb943fff640 1 -- 172.21.15.66:0/3772964733 wait complete. 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb943fff640 1 Processor -- start 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb943fff640 1 -- start start 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb943fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb943fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb94410b830 con 0x7fb944107f30 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:21.960 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44448/0 (socket says 172.21.15.66:44448) 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb942ffd640 1 -- 172.21.15.66:0/805054437 learned_addr learned my addr 172.21.15.66:0/805054437 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.221+0000 7fb942ffd640 1 -- 172.21.15.66:0/805054437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94419b930 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb942ffd640 1 --2- 172.21.15.66:0/805054437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb934032ce0 tx=0x7fb934032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb934042070 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9340308c0 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb934037040 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94419bbc0 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94419e8b0 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb934045070 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.222+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb934047b80 con 0x7fb944107f30 2024-09-15T22:35:21.961 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.223+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb944108390 con 0x7fb944107f30 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.225+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb93403c760 con 0x7fb944107f30 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.287+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb94419ea80 con 0x7fb944107f30 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.288+0000 7fb9489fd640 1 -- 172.21.15.66:0/805054437 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb934047e20 con 0x7fb944107f30 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 msgr2=0x7fb94419b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 --2- 172.21.15.66:0/805054437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb934032ce0 tx=0x7fb934032d10 comp rx=0 tx=0).stop 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 shutdown_connections 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 --2- 172.21.15.66:0/805054437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb944107f30 0x7fb94419b3f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 >> 172.21.15.66:0/805054437 conn(0x7fb944101ab0 msgr2=0x7fb944102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.289+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 shutdown_connections 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:21.290+0000 7fb943fff640 1 -- 172.21.15.66:0/805054437 wait complete. 2024-09-15T22:35:21.962 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (1/15)... 2024-09-15T22:35:22.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:21.998+0000 7f2e15a02040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:35:23.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:22.921+0000 7f2e15a02040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:35:23.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:22.991+0000 7f2e15a02040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:35:24.028 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:23.753+0000 7f2e15a02040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:35:24.029 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:23.873+0000 7f2e15a02040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:35:24.326 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.026+0000 7f2e15a02040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:24.326 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.091+0000 7f2e15a02040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:35:24.326 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.250+0000 7f2e15a02040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:35:24.326 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.323+0000 7f2e15a02040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:35:24.628 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2786715769' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:35:24.629 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.388+0000 7f2e15a02040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:35:24.629 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.558+0000 7f2e15a02040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:35:24.629 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.626+0000 7f2e15a02040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:35:24.909 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.696+0000 7f2e15a02040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:35:24.910 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.783+0000 7f2e15a02040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:24.910 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.845+0000 7f2e15a02040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:35:24.910 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:24.907+0000 7f2e15a02040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:35:25.062 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:25.062 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:25.062 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:25.063 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:35:25.064 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:35:25.072 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:35:25.073 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:35:13:921866+0000", 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:35:13.922580+0000", 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.339+0000 7f96a8544640 1 Processor -- start 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.339+0000 7f96a8544640 1 -- start start 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a8544640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a8544640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0106e90 con 0x7f96a01064c0 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a62e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.075 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a62e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33572/0 (socket says 172.21.15.66:33572) 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a62e0640 1 -- 172.21.15.66:0/2612379827 learned_addr learned my addr 172.21.15.66:0/2612379827 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.340+0000 7f96a62e0640 1 -- 172.21.15.66:0/2612379827 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01076c0 con 0x7f96a01064c0 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.341+0000 7f96a62e0640 1 --2- 172.21.15.66:0/2612379827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f969c009820 tx=0x7f969c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767a1b8bbb665c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.341+0000 7f96a52de640 1 -- 172.21.15.66:0/2612379827 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f969c037070 con 0x7f96a01064c0 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.341+0000 7f96a52de640 1 -- 172.21.15.66:0/2612379827 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f969c032900 con 0x7f96a01064c0 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.341+0000 7f96a52de640 1 -- 172.21.15.66:0/2612379827 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f969c030850 con 0x7f96a01064c0 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 -- 172.21.15.66:0/2612379827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 msgr2=0x7f96a01068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 --2- 172.21.15.66:0/2612379827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f969c009820 tx=0x7f969c02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 -- 172.21.15.66:0/2612379827 shutdown_connections 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 --2- 172.21.15.66:0/2612379827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a01068c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 -- 172.21.15.66:0/2612379827 >> 172.21.15.66:0/2612379827 conn(0x7f96a0101c50 msgr2=0x7f96a0104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 -- 172.21.15.66:0/2612379827 shutdown_connections 2024-09-15T22:35:25.076 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.342+0000 7f96a8544640 1 -- 172.21.15.66:0/2612379827 wait complete. 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a8544640 1 Processor -- start 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a8544640 1 -- start start 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a8544640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a8544640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010aa70 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a62e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a62e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33588/0 (socket says 172.21.15.66:33588) 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a62e0640 1 -- 172.21.15.66:0/2786715769 learned_addr learned my addr 172.21.15.66:0/2786715769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.343+0000 7f96a62e0640 1 -- 172.21.15.66:0/2786715769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a019bba0 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96a62e0640 1 --2- 172.21.15.66:0/2786715769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097f0 tx=0x7f969c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f969c042070 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f969c032ca0 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a019be30 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a019eb20 con 0x7f96a01064c0 2024-09-15T22:35:25.077 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f969c037040 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f969c045070 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.344+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f969c047b40 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.345+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96840052c0 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.347+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f969c03da60 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.409+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9684005880 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.409+0000 7f96977fe640 1 -- 172.21.15.66:0/2786715769 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f969c03d430 con 0x7f96a01064c0 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.410+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 msgr2=0x7f96a019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.410+0000 7f96a8544640 1 --2- 172.21.15.66:0/2786715769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097f0 tx=0x7f969c030ec0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.410+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 shutdown_connections 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.410+0000 7f96a8544640 1 --2- 172.21.15.66:0/2786715769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a01064c0 0x7f96a019b660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.410+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 >> 172.21.15.66:0/2786715769 conn(0x7f96a0101c50 msgr2=0x7f96a0102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.411+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 shutdown_connections 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:24.411+0000 7f96a8544640 1 -- 172.21.15.66:0/2786715769 wait complete. 2024-09-15T22:35:25.078 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (2/15)... 2024-09-15T22:35:26.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:25.737+0000 7f2e15a02040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: Activating manager daemon x 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: mgrmap e2: x(active, starting, since 0.00315275s) 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: Manager daemon x is now available 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:35:26.215 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' 2024-09-15T22:35:26.216 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' 2024-09-15T22:35:26.216 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:25 smithi066 ceph-mon[31185]: from='mgr.14100 172.21.15.66:0/314404505' entity='mgr.x' 2024-09-15T22:35:28.177 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:27 smithi066 ceph-mon[31185]: mgrmap e3: x(active, since 1.00744s) 2024-09-15T22:35:28.178 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:27 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2027919418' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:35:28.284 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:28.284 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:35:28.285 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:35:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:35:28.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:35:13:921866+0000", 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:35:13.922580+0000", 2024-09-15T22:35:28.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b8fce640 1 Processor -- start 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b8fce640 1 -- start start 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b8fce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b8fce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14b4107fc0 con 0x7f14b41075f0 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33674/0 (socket says 172.21.15.66:33674) 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b259c640 1 -- 172.21.15.66:0/2829352082 learned_addr learned my addr 172.21.15.66:0/2829352082 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.463+0000 7f14b259c640 1 -- 172.21.15.66:0/2829352082 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b41087f0 con 0x7f14b41075f0 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.464+0000 7f14b259c640 1 --2- 172.21.15.66:0/2829352082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009820 tx=0x7f14a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91fdd2b3166b0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:28.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.464+0000 7f14b1d9b640 1 -- 172.21.15.66:0/2829352082 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a4037070 con 0x7f14b41075f0 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.464+0000 7f14b1d9b640 1 -- 172.21.15.66:0/2829352082 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14a4032900 con 0x7f14b41075f0 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.464+0000 7f14b1d9b640 1 -- 172.21.15.66:0/2829352082 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a4030850 con 0x7f14b41075f0 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 -- 172.21.15.66:0/2829352082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 msgr2=0x7f14b41079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2829352082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009820 tx=0x7f14a402a270 comp rx=0 tx=0).stop 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 -- 172.21.15.66:0/2829352082 shutdown_connections 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2829352082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b41079f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 -- 172.21.15.66:0/2829352082 >> 172.21.15.66:0/2829352082 conn(0x7f14b4102e70 msgr2=0x7f14b4105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 -- 172.21.15.66:0/2829352082 shutdown_connections 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.465+0000 7f14b8fce640 1 -- 172.21.15.66:0/2829352082 wait complete. 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b8fce640 1 Processor -- start 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b8fce640 1 -- start start 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b8fce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:28.299 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b8fce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410bba0 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33688/0 (socket says 172.21.15.66:33688) 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b259c640 1 -- 172.21.15.66:0/2027919418 learned_addr learned my addr 172.21.15.66:0/2027919418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.466+0000 7f14b259c640 1 -- 172.21.15.66:0/2027919418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b419bb20 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14b259c640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009940 tx=0x7f14a4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a4042070 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14a40308c0 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b419bdb0 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a4037040 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.467+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b419c1d0 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.468+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f14a4045070 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.468+0000 7f14ab7fe640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 0x7f14a003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.468+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b4107a70 con 0x7f14b41075f0 2024-09-15T22:35:28.300 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.468+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f14a406c050 con 0x7f14b41075f0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.468+0000 7f14abfff640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 0x7f14a003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.469+0000 7f14abfff640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 0x7f14a003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f149c0098c0 tx=0x7f149c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.473+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14a403cd90 con 0x7f14b41075f0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.720+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f14b407d040 con 0x7f14b41075f0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.720+0000 7f14ab7fe640 1 -- 172.21.15.66:0/2027919418 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f14a405ea70 con 0x7f14b41075f0 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 msgr2=0x7f14a003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 0x7f14a003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f149c0098c0 tx=0x7f149c006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 msgr2=0x7f14b419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009940 tx=0x7f14a4032ce0 comp rx=0 tx=0).stop 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 shutdown_connections 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f14a0039050 0x7f14a003b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 --2- 172.21.15.66:0/2027919418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b41075f0 0x7f14b419b5e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:28.301 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 >> 172.21.15.66:0/2027919418 conn(0x7f14b4102e70 msgr2=0x7f14b4103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:28.302 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 shutdown_connections 2024-09-15T22:35:28.302 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:27.723+0000 7f14b8fce640 1 -- 172.21.15.66:0/2027919418 wait complete. 2024-09-15T22:35:28.302 INFO:teuthology.orchestra.run.smithi066.stdout:mgr is available 2024-09-15T22:35:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:28 smithi066 ceph-mon[31185]: mgrmap e4: x(active, since 2s) 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:35:29.496 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.710+0000 7fae5b829640 1 Processor -- start 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae5b829640 1 -- start start 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae5b829640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae5b829640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae54106290 con 0x7fae541058c0 2024-09-15T22:35:29.497 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae595c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae595c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33692/0 (socket says 172.21.15.66:33692) 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae595c5640 1 -- 172.21.15.66:0/931384757 learned_addr learned my addr 172.21.15.66:0/931384757 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.711+0000 7fae595c5640 1 -- 172.21.15.66:0/931384757 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae541088a0 con 0x7fae541058c0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.712+0000 7fae595c5640 1 --2- 172.21.15.66:0/931384757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae50009820 tx=0x7fae5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8059818e672d6c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.712+0000 7fae4bfff640 1 -- 172.21.15.66:0/931384757 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50037070 con 0x7fae541058c0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.712+0000 7fae4bfff640 1 -- 172.21.15.66:0/931384757 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae50032900 con 0x7fae541058c0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.712+0000 7fae4bfff640 1 -- 172.21.15.66:0/931384757 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50030850 con 0x7fae541058c0 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 -- 172.21.15.66:0/931384757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 msgr2=0x7fae54105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 --2- 172.21.15.66:0/931384757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fae50009820 tx=0x7fae5002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 -- 172.21.15.66:0/931384757 shutdown_connections 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 --2- 172.21.15.66:0/931384757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae54105cc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:29.498 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 -- 172.21.15.66:0/931384757 >> 172.21.15.66:0/931384757 conn(0x7fae541013f0 msgr2=0x7fae54103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 -- 172.21.15.66:0/931384757 shutdown_connections 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.713+0000 7fae5b829640 1 -- 172.21.15.66:0/931384757 wait complete. 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae5b829640 1 Processor -- start 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae5b829640 1 -- start start 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae5b829640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae5b829640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae5410bad0 con 0x7fae541058c0 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae595c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae595c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33708/0 (socket says 172.21.15.66:33708) 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae595c5640 1 -- 172.21.15.66:0/1861644559 learned_addr learned my addr 172.21.15.66:0/1861644559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae595c5640 1 -- 172.21.15.66:0/1861644559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5419bbc0 con 0x7fae541058c0 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.714+0000 7fae595c5640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae50009940 tx=0x7fae50032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50042070 con 0x7fae541058c0 2024-09-15T22:35:29.499 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5419be50 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae500308c0 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50037040 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5419eb40 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.715+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fae50045070 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.716+0000 7fae4a7fc640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 0x7fae4003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.716+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae54105d40 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.716+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fae5006c1e0 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.716+0000 7fae58dc4640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 0x7fae4003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.716+0000 7fae58dc4640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 0x7fae4003b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae440098c0 tx=0x7fae44006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.720+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae5003cd90 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.897+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fae541a02a0 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.898+0000 7fae4a7fc640 1 -- 172.21.15.66:0/1861644559 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fae5002fd90 con 0x7fae541058c0 2024-09-15T22:35:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 msgr2=0x7fae4003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 0x7fae4003b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae440098c0 tx=0x7fae44006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 msgr2=0x7fae5419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae50009940 tx=0x7fae50032ce0 comp rx=0 tx=0).stop 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 shutdown_connections 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fae40039160 0x7fae4003b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 --2- 172.21.15.66:0/1861644559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae541058c0 0x7fae5419b680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 >> 172.21.15.66:0/1861644559 conn(0x7fae541013f0 msgr2=0x7fae54101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 shutdown_connections 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:28.900+0000 7fae5b829640 1 -- 172.21.15.66:0/1861644559 wait complete. 2024-09-15T22:35:29.501 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling cephadm module... 2024-09-15T22:35:30.164 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1861644559' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:35:31.060 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:30 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/613306585' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T22:35:31.060 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setuser ceph since I am not root 2024-09-15T22:35:31.060 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setgroup ceph since I am not root 2024-09-15T22:35:31.060 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:30.894+0000 7fe4e3997040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:35:31.060 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:30.954+0000 7fe4e3997040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:31.342 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.112+0000 7fe4e3997040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:35:31.342 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.183+0000 7fe4e3997040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:35:31.342 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.339+0000 7fe4e3997040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa925341640 1 Processor -- start 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa925341640 1 -- start start 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa925341640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa925341640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa920107fc0 con 0x7fa9201075f0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa91effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa91effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33720/0 (socket says 172.21.15.66:33720) 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa91effd640 1 -- 172.21.15.66:0/685928870 learned_addr learned my addr 172.21.15.66:0/685928870 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.929+0000 7fa91effd640 1 -- 172.21.15.66:0/685928870 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9201087f0 con 0x7fa9201075f0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.930+0000 7fa91effd640 1 --2- 172.21.15.66:0/685928870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa910009820 tx=0x7fa91002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c31ff28dc077414 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.930+0000 7fa91dffb640 1 -- 172.21.15.66:0/685928870 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa910037070 con 0x7fa9201075f0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.930+0000 7fa91dffb640 1 -- 172.21.15.66:0/685928870 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa910032900 con 0x7fa9201075f0 2024-09-15T22:35:31.359 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.930+0000 7fa91dffb640 1 -- 172.21.15.66:0/685928870 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa910030850 con 0x7fa9201075f0 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 -- 172.21.15.66:0/685928870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 msgr2=0x7fa9201079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 --2- 172.21.15.66:0/685928870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa910009820 tx=0x7fa91002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 -- 172.21.15.66:0/685928870 shutdown_connections 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 --2- 172.21.15.66:0/685928870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa9201079f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 -- 172.21.15.66:0/685928870 >> 172.21.15.66:0/685928870 conn(0x7fa920102e70 msgr2=0x7fa920105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 -- 172.21.15.66:0/685928870 shutdown_connections 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 -- 172.21.15.66:0/685928870 wait complete. 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.931+0000 7fa925341640 1 Processor -- start 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa925341640 1 -- start start 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa925341640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:31.360 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa925341640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa92010bba0 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa91effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa91effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33722/0 (socket says 172.21.15.66:33722) 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa91effd640 1 -- 172.21.15.66:0/613306585 learned_addr learned my addr 172.21.15.66:0/613306585 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa91effd640 1 -- 172.21.15.66:0/613306585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92019bb20 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.932+0000 7fa91effd640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa9100097f0 tx=0x7fa910030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.933+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa910037040 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.933+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa910040070 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.933+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92019bdb0 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.933+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa91003a390 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.933+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92019eaa0 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fa91003a630 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92010bd20 con 0x7fa9201075f0 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa907fff640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 0x7fa90803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa91006c410 con 0x7fa9201075f0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa91e7fc640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 0x7fa90803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.934+0000 7fa91e7fc640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 0x7fa90803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa914006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:29.939+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa91006c170 con 0x7fa9201075f0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.161+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa92019ec70 con 0x7fa9201075f0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.750+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa910043760 con 0x7fa9201075f0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.751+0000 7fa907fff640 1 -- 172.21.15.66:0/613306585 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa91002fd40 con 0x7fa9201075f0 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 msgr2=0x7fa90803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 0x7fa90803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa914006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 msgr2=0x7fa92019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa9100097f0 tx=0x7fa910030d80 comp rx=0 tx=0).stop 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 shutdown_connections 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7fa908039160 0x7fa90803b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:31.362 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 --2- 172.21.15.66:0/613306585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9201075f0 0x7fa92019b5e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:31.363 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 >> 172.21.15.66:0/613306585 conn(0x7fa920102e70 msgr2=0x7fa920103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:31.363 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 shutdown_connections 2024-09-15T22:35:31.363 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:30.753+0000 7fa925341640 1 -- 172.21.15.66:0/613306585 wait complete. 2024-09-15T22:35:31.629 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.493+0000 7fe4e3997040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:35:31.902 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/613306585' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T22:35:31.902 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-mon[31185]: mgrmap e5: x(active, since 5s) 2024-09-15T22:35:31.903 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.835+0000 7fe4e3997040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:35:31.903 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:31 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:31.900+0000 7fe4e3997040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:35:32.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:32 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:32.100+0000 7fe4e3997040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:35:32.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.705+0000 7f630c324640 1 Processor -- start 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630c324640 1 -- start start 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630c324640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630c324640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f630407bdf0 con 0x7f6304105ea0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630a0c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630a0c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33752/0 (socket says 172.21.15.66:33752) 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630a0c0640 1 -- 172.21.15.66:0/1424579413 learned_addr learned my addr 172.21.15.66:0/1424579413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.706+0000 7f630a0c0640 1 -- 172.21.15.66:0/1424579413 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63041067e0 con 0x7f6304105ea0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.707+0000 7f630a0c0640 1 --2- 172.21.15.66:0/1424579413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6300009820 tx=0x7f630002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bc9f7c7c264680 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.707+0000 7f63090be640 1 -- 172.21.15.66:0/1424579413 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6300037070 con 0x7f6304105ea0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.707+0000 7f63090be640 1 -- 172.21.15.66:0/1424579413 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6300032900 con 0x7f6304105ea0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.707+0000 7f63090be640 1 -- 172.21.15.66:0/1424579413 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6300030850 con 0x7f6304105ea0 2024-09-15T22:35:32.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 -- 172.21.15.66:0/1424579413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 msgr2=0x7f63041062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 --2- 172.21.15.66:0/1424579413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6300009820 tx=0x7f630002a270 comp rx=0 tx=0).stop 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 -- 172.21.15.66:0/1424579413 shutdown_connections 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 --2- 172.21.15.66:0/1424579413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f63041062a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 -- 172.21.15.66:0/1424579413 >> 172.21.15.66:0/1424579413 conn(0x7f6304101c50 msgr2=0x7f6304104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 -- 172.21.15.66:0/1424579413 shutdown_connections 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.708+0000 7f630c324640 1 -- 172.21.15.66:0/1424579413 wait complete. 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630c324640 1 Processor -- start 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630c324640 1 -- start start 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630c324640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630c324640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63041078e0 con 0x7f6304105ea0 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630a0c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630a0c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33766/0 (socket says 172.21.15.66:33766) 2024-09-15T22:35:32.535 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630a0c0640 1 -- 172.21.15.66:0/1661726717 learned_addr learned my addr 172.21.15.66:0/1661726717 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630a0c0640 1 -- 172.21.15.66:0/1661726717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630419dd40 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.709+0000 7f630a0c0640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6300031000 tx=0x7f63000326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.710+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6300042070 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.710+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6300032be0 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.710+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6300037040 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.710+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630419dfd0 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.710+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041a0cc0 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f6300045070 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63041062a0 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f62fb7fe640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 0x7f62f003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f630006c180 con 0x7f6304105ea0 2024-09-15T22:35:32.536 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f63098bf640 1 -- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 msgr2=0x7f62f003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.711+0000 7f63098bf640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 0x7f62f003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.716+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f630002f2a0 con 0x7f6304105ea0 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.912+0000 7f63098bf640 1 -- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 msgr2=0x7f62f003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.912+0000 7f63098bf640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 0x7f62f003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.942+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f63041a0e90 con 0x7f6304105ea0 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.943+0000 7f62fb7fe640 1 -- 172.21.15.66:0/1661726717 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f6300032d90 con 0x7f6304105ea0 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 msgr2=0x7f62f003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 0x7f62f003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 msgr2=0x7f630419d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6300031000 tx=0x7f63000326e0 comp rx=0 tx=0).stop 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 shutdown_connections 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f62f0039200 0x7f62f003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:32.537 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 --2- 172.21.15.66:0/1661726717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6304105ea0 0x7f630419d800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:32.538 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 >> 172.21.15.66:0/1661726717 conn(0x7f6304101c50 msgr2=0x7f6304191b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:32.538 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 shutdown_connections 2024-09-15T22:35:32.538 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:31.945+0000 7f630c324640 1 -- 172.21.15.66:0/1661726717 wait complete. 2024-09-15T22:35:32.538 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-15T22:35:32.538 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 5... 2024-09-15T22:35:33.054 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1661726717' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:35:33.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:33 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:33.052+0000 7fe4e3997040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:35:33.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:33 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:33.124+0000 7fe4e3997040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:35:34.168 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:33 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:33.892+0000 7fe4e3997040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:35:34.168 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.015+0000 7fe4e3997040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:35:34.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.165+0000 7fe4e3997040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:34.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.230+0000 7fe4e3997040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:35:34.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.388+0000 7fe4e3997040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:35:34.762 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.460+0000 7fe4e3997040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:35:34.762 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.524+0000 7fe4e3997040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:35:34.763 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.691+0000 7fe4e3997040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:35:34.763 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.760+0000 7fe4e3997040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:35:35.046 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.830+0000 7fe4e3997040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:35:35.046 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.918+0000 7fe4e3997040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:35.046 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:34 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:34.981+0000 7fe4e3997040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:35:35.046 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:35.043+0000 7fe4e3997040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:35.884+0000 7fe4e3997040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: Active manager daemon x restarted 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: Activating manager daemon x 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: mgrmap e6: x(active, starting, since 0.00343823s) 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:35:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: Manager daemon x is now available 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:35:36.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:35 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:35:37.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.931+0000 7f6fc3a1b640 1 Processor -- start 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.931+0000 7f6fc3a1b640 1 -- start start 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.931+0000 7f6fc3a1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.931+0000 7f6fc3a1b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc106e60 con 0x7f6fbc106490 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.932+0000 7f6fc17b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.932+0000 7f6fc17b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46558/0 (socket says 172.21.15.66:46558) 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.932+0000 7f6fc17b7640 1 -- 172.21.15.66:0/4287096635 learned_addr learned my addr 172.21.15.66:0/4287096635 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.932+0000 7f6fc17b7640 1 -- 172.21.15.66:0/4287096635 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc107690 con 0x7f6fbc106490 2024-09-15T22:35:37.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fc17b7640 1 --2- 172.21.15.66:0/4287096635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009820 tx=0x7f6fb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b564999b69b1c0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fb3fff640 1 -- 172.21.15.66:0/4287096635 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb8037070 con 0x7f6fbc106490 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fb3fff640 1 -- 172.21.15.66:0/4287096635 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6fb8032900 con 0x7f6fbc106490 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fb3fff640 1 -- 172.21.15.66:0/4287096635 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb8030850 con 0x7f6fbc106490 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/4287096635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 msgr2=0x7f6fbc106890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/4287096635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009820 tx=0x7f6fb802a270 comp rx=0 tx=0).stop 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.933+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/4287096635 shutdown_connections 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/4287096635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc106890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/4287096635 >> 172.21.15.66:0/4287096635 conn(0x7f6fbc101c20 msgr2=0x7f6fbc104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/4287096635 shutdown_connections 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/4287096635 wait complete. 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 Processor -- start 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 -- start start 2024-09-15T22:35:37.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.934+0000 7f6fc3a1b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc10aa40 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc17b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc17b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46562/0 (socket says 172.21.15.66:46562) 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc17b7640 1 -- 172.21.15.66:0/1796022033 learned_addr learned my addr 172.21.15.66:0/1796022033 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc17b7640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc191c00 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc17b7640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097f0 tx=0x7f6fb8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb8037040 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6fb8040070 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc18fdf0 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb803a390 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.935+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc1902d0 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.936+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f6fb803b430 con 0x7f6fbc106490 2024-09-15T22:35:37.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.936+0000 7f6fb27fc640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.936+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6fa803bd80 con 0x7f6fa80391b0 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.937+0000 7f6fc0fb6640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 msgr2=0x7f6fa803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.937+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6fb806c450 con 0x7f6fbc106490 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:32.937+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:33.138+0000 7f6fc0fb6640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 msgr2=0x7f6fa803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:33.138+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:33.539+0000 7f6fc0fb6640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 msgr2=0x7f6fa803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:33.539+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:34.340+0000 7f6fc0fb6640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 msgr2=0x7f6fa803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/4191727117 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:34.340+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:35.888+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f6fb806b250 con 0x7f6fbc106490 2024-09-15T22:35:37.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:35.888+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 msgr2=0x7f6fa803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:35.888+0000 7f6fb27fc640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.891+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f6fb8043c60 con 0x7f6fbc106490 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.891+0000 7f6fb27fc640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 0x7f6fa803eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.891+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6fa803bd80 con 0x7f6fa803cae0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.892+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 0x7f6fa803eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.892+0000 7f6fc0fb6640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 0x7f6fa803eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6fac003980 tx=0x7f6fac006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.893+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f6fa803bd80 con 0x7f6fa803cae0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.900+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6fbc10abc0 con 0x7f6fa803cae0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.900+0000 7f6fb27fc640 1 -- 172.21.15.66:0/1796022033 <== mgr.14118 v2:172.21.15.66:6800/1250063396 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f6fbc10abc0 con 0x7f6fa803cae0 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 msgr2=0x7f6fa803eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 0x7f6fa803eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6fac003980 tx=0x7f6fac006e10 comp rx=0 tx=0).stop 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 msgr2=0x7f6fbc1916c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:37.486 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097f0 tx=0x7f6fb8030d80 comp rx=0 tx=0).stop 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 shutdown_connections 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f6fa803cae0 0x7f6fa803eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:6800/4191727117,v1:172.21.15.66:6801/4191727117] conn(0x7f6fa80391b0 0x7f6fa803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 --2- 172.21.15.66:0/1796022033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fbc106490 0x7f6fbc1916c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 >> 172.21.15.66:0/1796022033 conn(0x7f6fbc101c20 msgr2=0x7f6fbc102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 shutdown_connections 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:36.901+0000 7f6fc3a1b640 1 -- 172.21.15.66:0/1796022033 wait complete. 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 5 is available 2024-09-15T22:35:37.487 INFO:teuthology.orchestra.run.smithi066.stdout:Setting orchestrator backend to cephadm... 2024-09-15T22:35:38.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:37 smithi066 ceph-mon[31185]: Found migration_current of "None". Setting to last migration. 2024-09-15T22:35:38.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:37 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:38.098 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:37 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:38.098 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:37 smithi066 ceph-mon[31185]: mgrmap e7: x(active, since 1.00776s) 2024-09-15T22:35:38.652 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b27a1f640 1 Processor -- start 2024-09-15T22:35:38.652 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b27a1f640 1 -- start start 2024-09-15T22:35:38.652 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b27a1f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.652 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b27a1f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2007bdf0 con 0x7f9b201080a0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b257bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b257bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46618/0 (socket says 172.21.15.66:46618) 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b257bb640 1 -- 172.21.15.66:0/1237383261 learned_addr learned my addr 172.21.15.66:0/1237383261 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.887+0000 7f9b257bb640 1 -- 172.21.15.66:0/1237383261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2010a9d0 con 0x7f9b201080a0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.888+0000 7f9b257bb640 1 --2- 172.21.15.66:0/1237383261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009820 tx=0x7f9b1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80105597e0879332 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.888+0000 7f9b17fff640 1 -- 172.21.15.66:0/1237383261 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1c037070 con 0x7f9b201080a0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.888+0000 7f9b17fff640 1 -- 172.21.15.66:0/1237383261 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b1c032900 con 0x7f9b201080a0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.888+0000 7f9b17fff640 1 -- 172.21.15.66:0/1237383261 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1c030850 con 0x7f9b201080a0 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 -- 172.21.15.66:0/1237383261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 msgr2=0x7f9b2010a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/1237383261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009820 tx=0x7f9b1c02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 -- 172.21.15.66:0/1237383261 shutdown_connections 2024-09-15T22:35:38.653 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/1237383261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2010a490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 -- 172.21.15.66:0/1237383261 >> 172.21.15.66:0/1237383261 conn(0x7f9b20101ca0 msgr2=0x7f9b201040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 -- 172.21.15.66:0/1237383261 shutdown_connections 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.889+0000 7f9b27a1f640 1 -- 172.21.15.66:0/1237383261 wait complete. 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b27a1f640 1 Processor -- start 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b27a1f640 1 -- start start 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b27a1f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b27a1f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2010b9b0 con 0x7f9b201080a0 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b257bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b257bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46622/0 (socket says 172.21.15.66:46622) 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b257bb640 1 -- 172.21.15.66:0/633480513 learned_addr learned my addr 172.21.15.66:0/633480513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.890+0000 7f9b257bb640 1 -- 172.21.15.66:0/633480513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2019bb70 con 0x7f9b201080a0 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b257bb640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0097f0 tx=0x7f9b1c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1c042070 con 0x7f9b201080a0 2024-09-15T22:35:38.654 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b1c032ca0 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2019be00 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1c037040 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.891+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2019eaf0 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.892+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b20108500 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.892+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f9b1c045070 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.892+0000 7f9b167fc640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 0x7f9b0c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.892+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9b1c06c0b0 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.892+0000 7f9b24fba640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 0x7f9b0c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.893+0000 7f9b24fba640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 0x7f9b0c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098c0 tx=0x7f9b10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:37.901+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b1c045360 con 0x7f9b201080a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.095+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f9b20102fd0 con 0x7f9b0c0390a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.101+0000 7f9b167fc640 1 -- 172.21.15.66:0/633480513 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b20102fd0 con 0x7f9b0c0390a0 2024-09-15T22:35:38.655 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 msgr2=0x7f9b0c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 0x7f9b0c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098c0 tx=0x7f9b10006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 msgr2=0x7f9b2019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0097f0 tx=0x7f9b1c030ec0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 shutdown_connections 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f9b0c0390a0 0x7f9b0c03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 --2- 172.21.15.66:0/633480513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b201080a0 0x7f9b2019b630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 >> 172.21.15.66:0/633480513 conn(0x7f9b20101ca0 msgr2=0x7f9b201028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 shutdown_connections 2024-09-15T22:35:38.656 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:38.104+0000 7f9b27a1f640 1 -- 172.21.15.66:0/633480513 wait complete. 2024-09-15T22:35:38.913 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:38 smithi066 ceph-mon[31185]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:35:38.913 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:38 smithi066 ceph-mon[31185]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:35:38.913 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:38 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:38.913 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:38 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:39.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:39.294+0000 7fe44acb1640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:35:39] ENGINE Error in HTTPServer.serve 2024-09-15T22:35:39.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Traceback (most recent call last): 2024-09-15T22:35:39.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:35:39.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._connections.run(self.expiration_interval) 2024-09-15T22:35:39.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._run(expiration_interval) 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s = self.context.wrap_socket( 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: return self.sslsocket_class._create( 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.do_handshake() 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._sslobj.do_handshake() 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:35:39.450 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:40.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-mon[31185]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:40.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-mon[31185]: mgrmap e8: x(active, since 2s) 2024-09-15T22:35:40.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:39 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:40.034 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac0a864640 1 Processor -- start 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac0a864640 1 -- start start 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac0a864640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac0a864640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac04107fd0 con 0x7fac04107600 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac03fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac03fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46624/0 (socket says 172.21.15.66:46624) 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac03fff640 1 -- 172.21.15.66:0/2882558394 learned_addr learned my addr 172.21.15.66:0/2882558394 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.276+0000 7fac03fff640 1 -- 172.21.15.66:0/2882558394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac04108800 con 0x7fac04107600 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.277+0000 7fac03fff640 1 --2- 172.21.15.66:0/2882558394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009820 tx=0x7fabf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd61f871e09df10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.277+0000 7fac02ffd640 1 -- 172.21.15.66:0/2882558394 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf4037070 con 0x7fac04107600 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.277+0000 7fac02ffd640 1 -- 172.21.15.66:0/2882558394 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabf4032900 con 0x7fac04107600 2024-09-15T22:35:40.035 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.277+0000 7fac02ffd640 1 -- 172.21.15.66:0/2882558394 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf4030850 con 0x7fac04107600 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 -- 172.21.15.66:0/2882558394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 msgr2=0x7fac04107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 --2- 172.21.15.66:0/2882558394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009820 tx=0x7fabf402a270 comp rx=0 tx=0).stop 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 -- 172.21.15.66:0/2882558394 shutdown_connections 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 --2- 172.21.15.66:0/2882558394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac04107a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 -- 172.21.15.66:0/2882558394 >> 172.21.15.66:0/2882558394 conn(0x7fac04102e70 msgr2=0x7fac04105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 -- 172.21.15.66:0/2882558394 shutdown_connections 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 -- 172.21.15.66:0/2882558394 wait complete. 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.278+0000 7fac0a864640 1 Processor -- start 2024-09-15T22:35:40.036 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac0a864640 1 -- start start 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac0a864640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac0a864640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac0410bbb0 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac03fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac03fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46634/0 (socket says 172.21.15.66:46634) 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac03fff640 1 -- 172.21.15.66:0/1400884145 learned_addr learned my addr 172.21.15.66:0/1400884145 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac03fff640 1 -- 172.21.15.66:0/1400884145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0407e900 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.279+0000 7fac03fff640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009940 tx=0x7fabf40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.280+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf4042070 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.280+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabf4032be0 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.280+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf4037040 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.280+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0407caf0 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.280+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0407d030 con 0x7fac04107600 2024-09-15T22:35:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fabf4045070 con 0x7fac04107600 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac017fa640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 0x7fabec03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fabf406c1d0 con 0x7fac04107600 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac037fe640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 0x7fabec03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac04107a80 con 0x7fac04107600 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.281+0000 7fac037fe640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 0x7fabec03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098c0 tx=0x7fabf8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.286+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabf4045360 con 0x7fac04107600 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.465+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fac04104130 con 0x7fabec039200 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.465+0000 7fac017fa640 1 -- 172.21.15.66:0/1400884145 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fac04104130 con 0x7fabec039200 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 msgr2=0x7fabec03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 0x7fabec03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098c0 tx=0x7fabf8006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 msgr2=0x7fac0407e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009940 tx=0x7fabf40326e0 comp rx=0 tx=0).stop 2024-09-15T22:35:40.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 shutdown_connections 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fabec039200 0x7fabec03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 --2- 172.21.15.66:0/1400884145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac04107600 0x7fac0407e3c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 >> 172.21.15.66:0/1400884145 conn(0x7fac04102e70 msgr2=0x7fac04103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 shutdown_connections 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:39.468+0000 7fac0a864640 1 -- 172.21.15.66:0/1400884145 wait complete. 2024-09-15T22:35:40.039 INFO:teuthology.orchestra.run.smithi066.stdout:Generating ssh key... 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: [15/Sep/2024:22:35:39] ENGINE Bus STARTING 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: [15/Sep/2024:22:35:39] ENGINE Serving on http://172.21.15.66:8765 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: [15/Sep/2024:22:35:39] ENGINE Serving on https://172.21.15.66:7150 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: [15/Sep/2024:22:35:39] ENGINE Bus STARTED 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: [15/Sep/2024:22:35:39] ENGINE Error in HTTPServer.serve 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: Traceback (most recent call last): 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._run(expiration_interval) 2024-09-15T22:35:40.949 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: s = self.context.wrap_socket( 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: return self.sslsocket_class._create( 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: self.do_handshake() 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._sslobj.do_handshake() 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:40.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Generating public/private rsa key pair. 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Your identification has been saved in /tmp/tmp72tuz68e/key 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Your public key has been saved in /tmp/tmp72tuz68e/key.pub 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: The key fingerprint is: 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: SHA256:iGC/klrj/0WvnTfeUrDKi7AmvTkWUuvLJKahtWHIUY8 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: The key's randomart image is: 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: +---[RSA 3072]----+ 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | o. | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | ..oo... . | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | . Eoo..S o | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: |......o. . . . | 2024-09-15T22:35:40.951 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: |..X ++o..... . | 2024-09-15T22:35:40.952 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: | B O.+*= +o.+. | 2024-09-15T22:35:40.952 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: |o +..=B+o ++.o. | 2024-09-15T22:35:40.952 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: +----[SHA256]-----+ 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.378+0000 7fa4beda1640 1 Processor -- start 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.378+0000 7fa4beda1640 1 -- start start 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4beda1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4beda1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8107fc0 con 0x7fa4b81075f0 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4bcb3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4bcb3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46646/0 (socket says 172.21.15.66:46646) 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4bcb3d640 1 -- 172.21.15.66:0/19950329 learned_addr learned my addr 172.21.15.66:0/19950329 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:41.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.379+0000 7fa4bcb3d640 1 -- 172.21.15.66:0/19950329 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b81087f0 con 0x7fa4b81075f0 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.380+0000 7fa4bcb3d640 1 --2- 172.21.15.66:0/19950329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009820 tx=0x7fa4ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4ace6dd34464bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.380+0000 7fa4b77fe640 1 -- 172.21.15.66:0/19950329 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac037070 con 0x7fa4b81075f0 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.380+0000 7fa4b77fe640 1 -- 172.21.15.66:0/19950329 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4ac032900 con 0x7fa4b81075f0 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.380+0000 7fa4b77fe640 1 -- 172.21.15.66:0/19950329 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac030850 con 0x7fa4b81075f0 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- 172.21.15.66:0/19950329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 msgr2=0x7fa4b81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 --2- 172.21.15.66:0/19950329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009820 tx=0x7fa4ac02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- 172.21.15.66:0/19950329 shutdown_connections 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 --2- 172.21.15.66:0/19950329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b81079f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- 172.21.15.66:0/19950329 >> 172.21.15.66:0/19950329 conn(0x7fa4b8102e70 msgr2=0x7fa4b8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- 172.21.15.66:0/19950329 shutdown_connections 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- 172.21.15.66:0/19950329 wait complete. 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 Processor -- start 2024-09-15T22:35:41.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.381+0000 7fa4beda1640 1 -- start start 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4beda1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4beda1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b810bba0 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4bcb3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4bcb3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46656/0 (socket says 172.21.15.66:46656) 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4bcb3d640 1 -- 172.21.15.66:0/511766791 learned_addr learned my addr 172.21.15.66:0/511766791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4bcb3d640 1 -- 172.21.15.66:0/511766791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b819bb20 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4bcb3d640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0097f0 tx=0x7fa4ac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac037040 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4ac040070 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b819bdb0 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.382+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac03a390 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.383+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b819eaa0 con 0x7fa4b81075f0 2024-09-15T22:35:41.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.383+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa4ac03a630 con 0x7fa4b81075f0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.383+0000 7fa4b5ffb640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 0x7fa4a803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.383+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b8107a70 con 0x7fa4b81075f0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.384+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa4ac06c8d0 con 0x7fa4b81075f0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.384+0000 7fa4b7fff640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 0x7fa4a803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.384+0000 7fa4b7fff640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 0x7fa4a803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40098c0 tx=0x7fa4a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.388+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4ac03b430 con 0x7fa4b81075f0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.566+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa4b8104070 con 0x7fa4a80391b0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.733+0000 7fa4b5ffb640 1 -- 172.21.15.66:0/511766791 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4b8104070 con 0x7fa4a80391b0 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 msgr2=0x7fa4a803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 0x7fa4a803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40098c0 tx=0x7fa4a4006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 msgr2=0x7fa4b819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0097f0 tx=0x7fa4ac030d80 comp rx=0 tx=0).stop 2024-09-15T22:35:41.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 shutdown_connections 2024-09-15T22:35:41.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fa4a80391b0 0x7fa4a803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:41.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 --2- 172.21.15.66:0/511766791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4b81075f0 0x7fa4b819b5e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:41.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 >> 172.21.15.66:0/511766791 conn(0x7fa4b8102e70 msgr2=0x7fa4b8103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:41.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 shutdown_connections 2024-09-15T22:35:41.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:40.735+0000 7fa4beda1640 1 -- 172.21.15.66:0/511766791 wait complete. 2024-09-15T22:35:42.130 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:41 smithi066 ceph-mon[31185]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:42.131 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:41 smithi066 ceph-mon[31185]: Generating ssh key... 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.622+0000 7f734f085640 1 Processor -- start 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.622+0000 7f734f085640 1 -- start start 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.622+0000 7f734f085640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.622+0000 7f734f085640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7348106e90 con 0x7f73481064c0 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.623+0000 7f734ce21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.623+0000 7f734ce21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46664/0 (socket says 172.21.15.66:46664) 2024-09-15T22:35:42.416 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.623+0000 7f734ce21640 1 -- 172.21.15.66:0/3515646044 learned_addr learned my addr 172.21.15.66:0/3515646044 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.623+0000 7f734ce21640 1 -- 172.21.15.66:0/3515646044 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73481076c0 con 0x7f73481064c0 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734ce21640 1 --2- 172.21.15.66:0/3515646044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e80 tx=0x7f734002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e186afb71cf68c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f73477fe640 1 -- 172.21.15.66:0/3515646044 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7340036070 con 0x7f73481064c0 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f73477fe640 1 -- 172.21.15.66:0/3515646044 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73400318c0 con 0x7f73481064c0 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f73477fe640 1 -- 172.21.15.66:0/3515646044 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7340007ab0 con 0x7f73481064c0 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734f085640 1 -- 172.21.15.66:0/3515646044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 msgr2=0x7f73481068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734f085640 1 --2- 172.21.15.66:0/3515646044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e80 tx=0x7f734002a7a0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734f085640 1 -- 172.21.15.66:0/3515646044 shutdown_connections 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734f085640 1 --2- 172.21.15.66:0/3515646044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f73481068c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.417 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.624+0000 7f734f085640 1 -- 172.21.15.66:0/3515646044 >> 172.21.15.66:0/3515646044 conn(0x7f7348101c50 msgr2=0x7f7348104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 -- 172.21.15.66:0/3515646044 shutdown_connections 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 -- 172.21.15.66:0/3515646044 wait complete. 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 Processor -- start 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 -- start start 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.625+0000 7f734f085640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f734810aa70 con 0x7f73481064c0 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734ce21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734ce21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46674/0 (socket says 172.21.15.66:46674) 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734ce21640 1 -- 172.21.15.66:0/3293161874 learned_addr learned my addr 172.21.15.66:0/3293161874 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734ce21640 1 -- 172.21.15.66:0/3293161874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734819bb90 con 0x7f73481064c0 2024-09-15T22:35:42.418 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734ce21640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7340007ce0 tx=0x7f7340031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7340036050 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7340042070 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734819be20 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f734003d8a0 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.626+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734819eb10 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.627+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f734003db50 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.627+0000 7f7345ffb640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 0x7f733003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.627+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7340007e00 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.627+0000 7f7347fff640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 0x7f733003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.627+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734810abf0 con 0x7f73481064c0 2024-09-15T22:35:42.419 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.628+0000 7f7347fff640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 0x7f733003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f733c0098c0 tx=0x7f733c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.632+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7340044310 con 0x7f73481064c0 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.809+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f734802d9b0 con 0x7f7330039200 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.809+0000 7f7345ffb640 1 -- 172.21.15.66:0/3293161874 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f734802d9b0 con 0x7f7330039200 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 msgr2=0x7f733003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 0x7f733003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f733c0098c0 tx=0x7f733c006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 msgr2=0x7f734819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7340007ce0 tx=0x7f7340031ca0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 shutdown_connections 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f7330039200 0x7f733003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.420 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 --2- 172.21.15.66:0/3293161874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73481064c0 0x7f734819b650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 >> 172.21.15.66:0/3293161874 conn(0x7f7348101c50 msgr2=0x7f7348102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 shutdown_connections 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:41.811+0000 7f734f085640 1 -- 172.21.15.66:0/3293161874 wait complete. 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T22:35:42.421 INFO:teuthology.orchestra.run.smithi066.stdout:Adding host smithi066... 2024-09-15T22:35:43.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:42 smithi066 ceph-mon[31185]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:44.060 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:43 smithi066 ceph-mon[31185]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:44.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:44 smithi066 ceph-mon[31185]: Deploying cephadm binary to smithi066 2024-09-15T22:35:47.488 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Added host 'smithi066' with addr '172.21.15.66' 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.825+0000 7f8fbc607640 1 Processor -- start 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.825+0000 7f8fbc607640 1 -- start start 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fbc607640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fbc607640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4107fc0 con 0x7f8fb41075f0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fba3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fba3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57816/0 (socket says 172.21.15.66:57816) 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fba3a3640 1 -- 172.21.15.66:0/3028040119 learned_addr learned my addr 172.21.15.66:0/3028040119 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.826+0000 7f8fba3a3640 1 -- 172.21.15.66:0/3028040119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41087f0 con 0x7f8fb41075f0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.827+0000 7f8fba3a3640 1 --2- 172.21.15.66:0/3028040119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009820 tx=0x7f8fa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9b4bb93ca535b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.827+0000 7f8fb93a1640 1 -- 172.21.15.66:0/3028040119 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa8037070 con 0x7f8fb41075f0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.827+0000 7f8fb93a1640 1 -- 172.21.15.66:0/3028040119 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fa8032900 con 0x7f8fb41075f0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.827+0000 7f8fb93a1640 1 -- 172.21.15.66:0/3028040119 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa8030850 con 0x7f8fb41075f0 2024-09-15T22:35:47.489 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- 172.21.15.66:0/3028040119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 msgr2=0x7f8fb41079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3028040119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009820 tx=0x7f8fa802a270 comp rx=0 tx=0).stop 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- 172.21.15.66:0/3028040119 shutdown_connections 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3028040119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb41079f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- 172.21.15.66:0/3028040119 >> 172.21.15.66:0/3028040119 conn(0x7f8fb4102e70 msgr2=0x7f8fb4105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- 172.21.15.66:0/3028040119 shutdown_connections 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- 172.21.15.66:0/3028040119 wait complete. 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 Processor -- start 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.828+0000 7f8fbc607640 1 -- start start 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fbc607640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fbc607640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb410bba0 con 0x7f8fb41075f0 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fba3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fba3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57822/0 (socket says 172.21.15.66:57822) 2024-09-15T22:35:47.490 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fba3a3640 1 -- 172.21.15.66:0/3059784555 learned_addr learned my addr 172.21.15.66:0/3059784555 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fba3a3640 1 -- 172.21.15.66:0/3059784555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb407e900 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fba3a3640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097f0 tx=0x7f8fa8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa8037040 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fa8040070 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb407caf0 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa803a390 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.829+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb407cfd0 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.830+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8fa8032900 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.831+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb410bd20 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.831+0000 7f8fa77fe640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 0x7f8fa003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.831+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8fa806c6e0 con 0x7f8fb41075f0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.831+0000 7f8fb9ba2640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 0x7f8fa003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.831+0000 7f8fb9ba2640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 0x7f8fa003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00098c0 tx=0x7f8fb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:47.491 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:42.835+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fa8042310 con 0x7f8fb41075f0 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:43.016+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}) -- 0x7f8fb407d880 con 0x7f8fa0039200 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.938+0000 7f8fa77fe640 1 -- 172.21.15.66:0/3059784555 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8fb407d880 con 0x7f8fa0039200 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 msgr2=0x7f8fa003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 0x7f8fa003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00098c0 tx=0x7f8fb0006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 msgr2=0x7f8fb407e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097f0 tx=0x7f8fa8030d80 comp rx=0 tx=0).stop 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 shutdown_connections 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8fa0039200 0x7f8fa003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 --2- 172.21.15.66:0/3059784555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fb41075f0 0x7f8fb407e3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 >> 172.21.15.66:0/3059784555 conn(0x7f8fb4102e70 msgr2=0x7f8fb4103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 shutdown_connections 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:46.941+0000 7f8fbc607640 1 -- 172.21.15.66:0/3059784555 wait complete. 2024-09-15T22:35:47.492 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying unmanaged mon service... 2024-09-15T22:35:48.043 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:47 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:48.044 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:47 smithi066 ceph-mon[31185]: Added host smithi066 2024-09-15T22:35:48.044 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:47 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:35:48.919 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75f093b640 1 Processor -- start 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75f093b640 1 -- start start 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75f093b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75f093b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec107fc0 con 0x7f75ec1075f0 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57832/0 (socket says 172.21.15.66:57832) 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75ea59c640 1 -- 172.21.15.66:0/3106933342 learned_addr learned my addr 172.21.15.66:0/3106933342 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.967+0000 7f75ea59c640 1 -- 172.21.15.66:0/3106933342 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec1087f0 con 0x7f75ec1075f0 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.968+0000 7f75ea59c640 1 --2- 172.21.15.66:0/3106933342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009820 tx=0x7f75dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ce8a631cbf5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:48.920 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.968+0000 7f75e9d9b640 1 -- 172.21.15.66:0/3106933342 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc037070 con 0x7f75ec1075f0 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.968+0000 7f75e9d9b640 1 -- 172.21.15.66:0/3106933342 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75dc032900 con 0x7f75ec1075f0 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.968+0000 7f75e9d9b640 1 -- 172.21.15.66:0/3106933342 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc030850 con 0x7f75ec1075f0 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 -- 172.21.15.66:0/3106933342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 msgr2=0x7f75ec1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 --2- 172.21.15.66:0/3106933342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009820 tx=0x7f75dc02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 -- 172.21.15.66:0/3106933342 shutdown_connections 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 --2- 172.21.15.66:0/3106933342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec1079f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 -- 172.21.15.66:0/3106933342 >> 172.21.15.66:0/3106933342 conn(0x7f75ec102e70 msgr2=0x7f75ec105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 -- 172.21.15.66:0/3106933342 shutdown_connections 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.969+0000 7f75f093b640 1 -- 172.21.15.66:0/3106933342 wait complete. 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75f093b640 1 Processor -- start 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75f093b640 1 -- start start 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75f093b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:48.921 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75f093b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10bba0 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75ea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57836/0 (socket says 172.21.15.66:57836) 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75ea59c640 1 -- 172.21.15.66:0/1307265253 learned_addr learned my addr 172.21.15.66:0/1307265253 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.970+0000 7f75ea59c640 1 -- 172.21.15.66:0/1307265253 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec19bb20 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75ea59c640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009940 tx=0x7f75dc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc042070 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75dc0308c0 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec19bdb0 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc037040 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.971+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec19eaa0 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.972+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f75dc045070 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.972+0000 7f75e37fe640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 0x7f75d803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.972+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec10bd20 con 0x7f75ec1075f0 2024-09-15T22:35:48.922 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.972+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f75dc06c300 con 0x7f75ec1075f0 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.972+0000 7f75e3fff640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 0x7f75d803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.973+0000 7f75e3fff640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 0x7f75d803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098c0 tx=0x7f75d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:47.977+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75dc04b170 con 0x7f75ec1075f0 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.167+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f75ec104070 con 0x7f75d8039200 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.172+0000 7f75e37fe640 1 -- 172.21.15.66:0/1307265253 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f75ec104070 con 0x7f75d8039200 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 msgr2=0x7f75d803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 0x7f75d803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098c0 tx=0x7f75d4006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 msgr2=0x7f75ec19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009940 tx=0x7f75dc032ce0 comp rx=0 tx=0).stop 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 shutdown_connections 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f75d8039200 0x7f75d803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 --2- 172.21.15.66:0/1307265253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75ec1075f0 0x7f75ec19b5e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 >> 172.21.15.66:0/1307265253 conn(0x7f75ec102e70 msgr2=0x7f75ec103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 shutdown_connections 2024-09-15T22:35:48.924 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:48.175+0000 7f75f093b640 1 -- 172.21.15.66:0/1307265253 wait complete. 2024-09-15T22:35:48.924 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying unmanaged mgr service... 2024-09-15T22:35:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:49 smithi066 ceph-mon[31185]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:49 smithi066 ceph-mon[31185]: Saving service mon spec with placement count:5 2024-09-15T22:35:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:49 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:50.776 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.721+0000 7f5add518640 1 Processor -- start 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5add518640 1 -- start start 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5add518640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5add518640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8107fc0 con 0x7f5ad81075f0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5ad6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5ad6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57838/0 (socket says 172.21.15.66:57838) 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5ad6ffd640 1 -- 172.21.15.66:0/3758835679 learned_addr learned my addr 172.21.15.66:0/3758835679 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.722+0000 7f5ad6ffd640 1 -- 172.21.15.66:0/3758835679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad81087f0 con 0x7f5ad81075f0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.723+0000 7f5ad6ffd640 1 --2- 172.21.15.66:0/3758835679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009820 tx=0x7f5ac802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc90ec20aabbf327 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.723+0000 7f5ad5ffb640 1 -- 172.21.15.66:0/3758835679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac8037070 con 0x7f5ad81075f0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.723+0000 7f5ad5ffb640 1 -- 172.21.15.66:0/3758835679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ac8032900 con 0x7f5ad81075f0 2024-09-15T22:35:50.777 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.723+0000 7f5ad5ffb640 1 -- 172.21.15.66:0/3758835679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac8030850 con 0x7f5ad81075f0 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 -- 172.21.15.66:0/3758835679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 msgr2=0x7f5ad81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 --2- 172.21.15.66:0/3758835679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009820 tx=0x7f5ac802a270 comp rx=0 tx=0).stop 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 -- 172.21.15.66:0/3758835679 shutdown_connections 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 --2- 172.21.15.66:0/3758835679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad81079f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 -- 172.21.15.66:0/3758835679 >> 172.21.15.66:0/3758835679 conn(0x7f5ad8102e70 msgr2=0x7f5ad8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 -- 172.21.15.66:0/3758835679 shutdown_connections 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.724+0000 7f5add518640 1 -- 172.21.15.66:0/3758835679 wait complete. 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5add518640 1 Processor -- start 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5add518640 1 -- start start 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5add518640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5add518640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad810bba0 con 0x7f5ad81075f0 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5ad6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5ad6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57848/0 (socket says 172.21.15.66:57848) 2024-09-15T22:35:50.778 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5ad6ffd640 1 -- 172.21.15.66:0/42400429 learned_addr learned my addr 172.21.15.66:0/42400429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5ad6ffd640 1 -- 172.21.15.66:0/42400429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad819bb20 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.725+0000 7f5ad6ffd640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009940 tx=0x7f5ac8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac8042070 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ac80308c0 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad819bdb0 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ac8037040 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad819eaa0 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.726+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5ac8045070 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.727+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad810bd20 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.727+0000 7f5acffff640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 0x7f5ac403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.727+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5ac806c4a0 con 0x7f5ad81075f0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.727+0000 7f5ad67fc640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 0x7f5ac403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.727+0000 7f5ad67fc640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 0x7f5ac403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098c0 tx=0x7f5ac0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:50.779 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.732+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ac8045520 con 0x7f5ad81075f0 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.921+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f5ad8104070 con 0x7f5ac40391b0 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.925+0000 7f5acffff640 1 -- 172.21.15.66:0/42400429 <== mgr.14118 v2:172.21.15.66:6800/1250063396 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5ad8104070 con 0x7f5ac40391b0 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 msgr2=0x7f5ac403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 0x7f5ac403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098c0 tx=0x7f5ac0006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 msgr2=0x7f5ad819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009940 tx=0x7f5ac8032ce0 comp rx=0 tx=0).stop 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 shutdown_connections 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f5ac40391b0 0x7f5ac403b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 --2- 172.21.15.66:0/42400429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ad81075f0 0x7f5ad819b5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 >> 172.21.15.66:0/42400429 conn(0x7f5ad8102e70 msgr2=0x7f5ad8103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 shutdown_connections 2024-09-15T22:35:50.780 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:49.928+0000 7f5add518640 1 -- 172.21.15.66:0/42400429 wait complete. 2024-09-15T22:35:51.047 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:50 smithi066 ceph-mon[31185]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:35:51.047 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:50 smithi066 ceph-mon[31185]: Saving service mgr spec with placement count:2 2024-09-15T22:35:51.047 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:50 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:51.047 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:50 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:51.833 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.136+0000 7f8ae2c2d640 1 Processor -- start 2024-09-15T22:35:51.833 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.136+0000 7f8ae2c2d640 1 -- start start 2024-09-15T22:35:51.833 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.136+0000 7f8ae2c2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.833 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.136+0000 7f8ae2c2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc07bdf0 con 0x7f8adc1080b0 2024-09-15T22:35:51.833 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.137+0000 7f8ae09c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.137+0000 7f8ae09c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57858/0 (socket says 172.21.15.66:57858) 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.137+0000 7f8ae09c9640 1 -- 172.21.15.66:0/1431070293 learned_addr learned my addr 172.21.15.66:0/1431070293 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.137+0000 7f8ae09c9640 1 -- 172.21.15.66:0/1431070293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc10a9e0 con 0x7f8adc1080b0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.138+0000 7f8ae09c9640 1 --2- 172.21.15.66:0/1431070293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009820 tx=0x7f8ad802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ffcf8a7b282e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.138+0000 7f8ad37fe640 1 -- 172.21.15.66:0/1431070293 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8037070 con 0x7f8adc1080b0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.138+0000 7f8ad37fe640 1 -- 172.21.15.66:0/1431070293 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ad8032920 con 0x7f8adc1080b0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.138+0000 7f8ad37fe640 1 -- 172.21.15.66:0/1431070293 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8030810 con 0x7f8adc1080b0 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/1431070293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 msgr2=0x7f8adc10a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/1431070293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009820 tx=0x7f8ad802a270 comp rx=0 tx=0).stop 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/1431070293 shutdown_connections 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/1431070293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc10a4a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.834 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/1431070293 >> 172.21.15.66:0/1431070293 conn(0x7f8adc101c50 msgr2=0x7f8adc104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/1431070293 shutdown_connections 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/1431070293 wait complete. 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 Processor -- start 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.139+0000 7f8ae2c2d640 1 -- start start 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae2c2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae2c2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10ba00 con 0x7f8adc1080b0 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae09c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae09c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57860/0 (socket says 172.21.15.66:57860) 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae09c9640 1 -- 172.21.15.66:0/3203886202 learned_addr learned my addr 172.21.15.66:0/3203886202 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae09c9640 1 -- 172.21.15.66:0/3203886202 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc19bb70 con 0x7f8adc1080b0 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae09c9640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80097f0 tx=0x7f8ad80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8037040 con 0x7f8adc1080b0 2024-09-15T22:35:51.835 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ad8030c40 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc19be00 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.140+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad803a5d0 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.141+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc19eaf0 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.142+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc108510 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.142+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8ad803a810 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.142+0000 7f8ad1ffb640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 0x7f8ac403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.142+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8ad806c8c0 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.142+0000 7f8ad3fff640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 0x7f8ac403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.143+0000 7f8ad3fff640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 0x7f8ac403b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0098c0 tx=0x7f8acc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.147+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ad80319f0 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.324+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f8adc19f0e0 con 0x7f8adc1080b0 2024-09-15T22:35:51.836 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.329+0000 7f8ad1ffb640 1 -- 172.21.15.66:0/3203886202 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f8ad8031c50 con 0x7f8adc1080b0 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 msgr2=0x7f8ac403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 0x7f8ac403b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0098c0 tx=0x7f8acc006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 msgr2=0x7f8adc19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80097f0 tx=0x7f8ad80327b0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 shutdown_connections 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f8ac40391b0 0x7f8ac403b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 --2- 172.21.15.66:0/3203886202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8adc1080b0 0x7f8adc19b630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 >> 172.21.15.66:0/3203886202 conn(0x7f8adc101c50 msgr2=0x7f8adc102850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 shutdown_connections 2024-09-15T22:35:51.837 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:51.332+0000 7f8ae2c2d640 1 -- 172.21.15.66:0/3203886202 wait complete. 2024-09-15T22:35:52.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:52 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:52 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3203886202' entity='client.admin' 2024-09-15T22:35:53.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:53 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/832157926' entity='client.admin' 2024-09-15T22:35:53.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:53 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.209+0000 7fac37bf4640 1 Processor -- start 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.209+0000 7fac37bf4640 1 -- start start 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.209+0000 7fac37bf4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.209+0000 7fac37bf4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac30107fc0 con 0x7fac301075f0 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.209+0000 7fac35990640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:53.700 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.210+0000 7fac35990640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57874/0 (socket says 172.21.15.66:57874) 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.210+0000 7fac35990640 1 -- 172.21.15.66:0/4286457118 learned_addr learned my addr 172.21.15.66:0/4286457118 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.210+0000 7fac35990640 1 -- 172.21.15.66:0/4286457118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301087f0 con 0x7fac301075f0 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.210+0000 7fac35990640 1 --2- 172.21.15.66:0/4286457118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009820 tx=0x7fac2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13eafa0f0013c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac3498e640 1 -- 172.21.15.66:0/4286457118 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c037070 con 0x7fac301075f0 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac3498e640 1 -- 172.21.15.66:0/4286457118 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac2c032920 con 0x7fac301075f0 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac3498e640 1 -- 172.21.15.66:0/4286457118 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c030810 con 0x7fac301075f0 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 -- 172.21.15.66:0/4286457118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 msgr2=0x7fac301079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 --2- 172.21.15.66:0/4286457118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009820 tx=0x7fac2c02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 -- 172.21.15.66:0/4286457118 shutdown_connections 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 --2- 172.21.15.66:0/4286457118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac301079f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 -- 172.21.15.66:0/4286457118 >> 172.21.15.66:0/4286457118 conn(0x7fac30102e70 msgr2=0x7fac30105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 -- 172.21.15.66:0/4286457118 shutdown_connections 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.211+0000 7fac37bf4640 1 -- 172.21.15.66:0/4286457118 wait complete. 2024-09-15T22:35:53.701 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac37bf4640 1 Processor -- start 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac37bf4640 1 -- start start 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac37bf4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac37bf4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010bba0 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac35990640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac35990640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57886/0 (socket says 172.21.15.66:57886) 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac35990640 1 -- 172.21.15.66:0/832157926 learned_addr learned my addr 172.21.15.66:0/832157926 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.212+0000 7fac35990640 1 -- 172.21.15.66:0/832157926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3007e900 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac35990640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac2c030560 tx=0x7fac2c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c037040 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3007caf0 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac2c040070 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c03a740 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.213+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3007d030 con 0x7fac301075f0 2024-09-15T22:35:53.702 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fac2c03a9b0 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac30107a70 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac26ffd640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 0x7fac1c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fac2c06ca00 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac3518f640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 0x7fac1c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.214+0000 7fac3518f640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 0x7fac1c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac200098c0 tx=0x7fac20006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.219+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac2c032920 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.423+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fac3007d2b0 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.426+0000 7fac26ffd640 1 -- 172.21.15.66:0/832157926 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fac2c045460 con 0x7fac301075f0 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 msgr2=0x7fac1c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 0x7fac1c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac200098c0 tx=0x7fac20006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 msgr2=0x7fac3007e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac2c030560 tx=0x7fac2c032670 comp rx=0 tx=0).stop 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 shutdown_connections 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fac1c0391b0 0x7fac1c03b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 --2- 172.21.15.66:0/832157926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac301075f0 0x7fac3007e3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 >> 172.21.15.66:0/832157926 conn(0x7fac30102e70 msgr2=0x7fac30103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 shutdown_connections 2024-09-15T22:35:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:52.429+0000 7fac37bf4640 1 -- 172.21.15.66:0/832157926 wait complete. 2024-09-15T22:35:53.704 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling the dashboard module... 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-mon[31185]: from='mgr.14118 172.21.15.66:0/4034718823' entity='mgr.x' 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/652339475' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setuser ceph since I am not root 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setgroup ceph since I am not root 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.337+0000 7f0dd1f85040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:35:55.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.398+0000 7f0dd1f85040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:55.784 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.557+0000 7f0dd1f85040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:35:55.784 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.627+0000 7f0dd1f85040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:35:55.784 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.782+0000 7f0dd1f85040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:55.989 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.139+0000 7fecc8ac7640 1 Processor -- start 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.139+0000 7fecc8ac7640 1 -- start start 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.139+0000 7fecc8ac7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.139+0000 7fecc8ac7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fecc407bdf0 con 0x7fecc41080a0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.140+0000 7fecc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.140+0000 7fecc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43176/0 (socket says 172.21.15.66:43176) 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.140+0000 7fecc259c640 1 -- 172.21.15.66:0/460790958 learned_addr learned my addr 172.21.15.66:0/460790958 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.140+0000 7fecc259c640 1 -- 172.21.15.66:0/460790958 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc410a9d0 con 0x7fecc41080a0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.141+0000 7fecc259c640 1 --2- 172.21.15.66:0/460790958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009820 tx=0x7fecb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20361642fd316b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.141+0000 7fecc159a640 1 -- 172.21.15.66:0/460790958 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb4037070 con 0x7fecc41080a0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.141+0000 7fecc159a640 1 -- 172.21.15.66:0/460790958 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb4032920 con 0x7fecc41080a0 2024-09-15T22:35:55.990 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.141+0000 7fecc159a640 1 -- 172.21.15.66:0/460790958 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb4030810 con 0x7fecc41080a0 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 -- 172.21.15.66:0/460790958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 msgr2=0x7fecc410a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/460790958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009820 tx=0x7fecb402a270 comp rx=0 tx=0).stop 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 -- 172.21.15.66:0/460790958 shutdown_connections 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/460790958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc410a490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 -- 172.21.15.66:0/460790958 >> 172.21.15.66:0/460790958 conn(0x7fecc4101ca0 msgr2=0x7fecc41040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 -- 172.21.15.66:0/460790958 shutdown_connections 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.142+0000 7fecc8ac7640 1 -- 172.21.15.66:0/460790958 wait complete. 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.143+0000 7fecc8ac7640 1 Processor -- start 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.143+0000 7fecc8ac7640 1 -- start start 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.143+0000 7fecc8ac7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.143+0000 7fecc8ac7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fecc410b9f0 con 0x7fecc41080a0 2024-09-15T22:35:55.991 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43182/0 (socket says 172.21.15.66:43182) 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc259c640 1 -- 172.21.15.66:0/652339475 learned_addr learned my addr 172.21.15.66:0/652339475 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc259c640 1 -- 172.21.15.66:0/652339475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc4107e60 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc259c640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecb4030420 tx=0x7fecb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb4037040 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecb4040070 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc4106050 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecb403a6e0 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.144+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc4106590 con 0x7fecc41080a0 2024-09-15T22:35:55.992 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.145+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fecb403a9e0 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.145+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4108500 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.145+0000 7fecb37fe640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 0x7fecac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.146+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fecb406c8f0 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.146+0000 7fecc1d9b640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 0x7fecac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.146+0000 7fecc1d9b640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 0x7fecac03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fecb80098c0 tx=0x7fecb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.150+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fecb4041270 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:54.377+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fecc4106d30 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.177+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fecb4045a80 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.178+0000 7fecb37fe640 1 -- 172.21.15.66:0/652339475 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fecb4045460 con 0x7fecc41080a0 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 msgr2=0x7fecac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 0x7fecac03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fecb80098c0 tx=0x7fecb8006db0 comp rx=0 tx=0).stop 2024-09-15T22:35:55.993 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 msgr2=0x7fecc4107920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecb4030420 tx=0x7fecb4032670 comp rx=0 tx=0).stop 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 shutdown_connections 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7fecac0391b0 0x7fecac03b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 --2- 172.21.15.66:0/652339475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecc41080a0 0x7fecc4107920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 >> 172.21.15.66:0/652339475 conn(0x7fecc4101ca0 msgr2=0x7fecc41028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 shutdown_connections 2024-09-15T22:35:55.994 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:55.180+0000 7fecc8ac7640 1 -- 172.21.15.66:0/652339475 wait complete. 2024-09-15T22:35:56.099 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:55.930+0000 7f0dd1f85040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:35:56.368 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/652339475' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T22:35:56.368 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:56 smithi066 ceph-mon[31185]: mgrmap e9: x(active, since 19s) 2024-09-15T22:35:56.368 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:56.267+0000 7f0dd1f85040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:35:56.368 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:56.333+0000 7f0dd1f85040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:35:56.699 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:56.530+0000 7f0dd1f85040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:35:57.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:35:57.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T22:35:57.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff0873bf640 1 Processor -- start 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff0873bf640 1 -- start start 2024-09-15T22:35:57.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff0873bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff0873bf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff080108060 con 0x7ff080107690 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff08515b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff08515b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43210/0 (socket says 172.21.15.66:43210) 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.367+0000 7ff08515b640 1 -- 172.21.15.66:0/3467377353 learned_addr learned my addr 172.21.15.66:0/3467377353 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.368+0000 7ff08515b640 1 -- 172.21.15.66:0/3467377353 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff080108890 con 0x7ff080107690 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.368+0000 7ff08515b640 1 --2- 172.21.15.66:0/3467377353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009820 tx=0x7ff07c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e8479d9dcdb5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff077fff640 1 -- 172.21.15.66:0/3467377353 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c037070 con 0x7ff080107690 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff077fff640 1 -- 172.21.15.66:0/3467377353 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07c032920 con 0x7ff080107690 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff077fff640 1 -- 172.21.15.66:0/3467377353 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c030810 con 0x7ff080107690 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff0873bf640 1 -- 172.21.15.66:0/3467377353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 msgr2=0x7ff080107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3467377353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009820 tx=0x7ff07c02a270 comp rx=0 tx=0).stop 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff0873bf640 1 -- 172.21.15.66:0/3467377353 shutdown_connections 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3467377353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff080107a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.369+0000 7ff0873bf640 1 -- 172.21.15.66:0/3467377353 >> 172.21.15.66:0/3467377353 conn(0x7ff080102e00 msgr2=0x7ff080105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.370+0000 7ff0873bf640 1 -- 172.21.15.66:0/3467377353 shutdown_connections 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.370+0000 7ff0873bf640 1 -- 172.21.15.66:0/3467377353 wait complete. 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.370+0000 7ff0873bf640 1 Processor -- start 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.370+0000 7ff0873bf640 1 -- start start 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff0873bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff0873bf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff08010bc40 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff08515b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff08515b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43214/0 (socket says 172.21.15.66:43214) 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff08515b640 1 -- 172.21.15.66:0/3690473200 learned_addr learned my addr 172.21.15.66:0/3690473200 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff08515b640 1 -- 172.21.15.66:0/3690473200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08019bc00 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff08515b640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff07c030560 tx=0x7ff07c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c037040 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff07c040070 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.371+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08019be90 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.372+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08019eb80 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.372+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07c03a6d0 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff07c03a870 con 0x7ff080107690 2024-09-15T22:35:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0640052c0 con 0x7ff080107690 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff0767fc640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 0x7ff06c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff07c06c840 con 0x7ff080107690 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff08495a640 1 -- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 msgr2=0x7ff06c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.373+0000 7ff08495a640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 0x7ff06c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.377+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff07c041270 con 0x7ff080107690 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.574+0000 7ff08495a640 1 -- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 msgr2=0x7ff06c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.574+0000 7ff08495a640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 0x7ff06c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.600+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff064005dc0 con 0x7ff080107690 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.600+0000 7ff0767fc640 1 -- 172.21.15.66:0/3690473200 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff07c045980 con 0x7ff080107690 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 msgr2=0x7ff06c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 0x7ff06c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 msgr2=0x7ff08019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:35:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff07c030560 tx=0x7ff07c032670 comp rx=0 tx=0).stop 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 shutdown_connections 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7ff06c039260 0x7ff06c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.602+0000 7ff0873bf640 1 --2- 172.21.15.66:0/3690473200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff080107690 0x7ff08019b6c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.603+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 >> 172.21.15.66:0/3690473200 conn(0x7ff080102e00 msgr2=0x7ff080103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.603+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 shutdown_connections 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:56.603+0000 7ff0873bf640 1 -- 172.21.15.66:0/3690473200 wait complete. 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-15T22:35:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 9... 2024-09-15T22:35:57.323 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:35:57 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3690473200' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:35:57.648 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:57.483+0000 7f0dd1f85040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:35:57.648 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:57.554+0000 7f0dd1f85040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:35:58.582 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.310+0000 7f0dd1f85040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:35:58.582 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.431+0000 7f0dd1f85040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:35:58.874 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.580+0000 7f0dd1f85040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:35:58.874 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.644+0000 7f0dd1f85040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:35:58.874 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.801+0000 7f0dd1f85040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:35:58.874 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.872+0000 7f0dd1f85040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:35:59.170 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:58.935+0000 7f0dd1f85040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:35:59.170 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.101+0000 7f0dd1f85040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:35:59.171 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.169+0000 7f0dd1f85040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:35:59.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.238+0000 7f0dd1f85040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:35:59.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.325+0000 7f0dd1f85040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:35:59.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.387+0000 7f0dd1f85040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:35:59.948 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:35:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:35:59.449+0000 7f0dd1f85040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: Active manager daemon x restarted 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: Activating manager daemon x 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: mgrmap e10: x(active, starting, since 0.0033208s) 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:00.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: Manager daemon x is now available 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:36:00.534 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:36:00.279+0000 7f0dd1f85040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:36:02.201 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:36:02.201 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T22:36:02.201 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:36:02.201 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00ad200640 1 Processor -- start 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00ad200640 1 -- start start 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00ad200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00ad200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00a807c6a0 con 0x7f00a8108100 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00a6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00a6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43218/0 (socket says 172.21.15.66:43218) 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.646+0000 7f00a6d9d640 1 -- 172.21.15.66:0/374098899 learned_addr learned my addr 172.21.15.66:0/374098899 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.647+0000 7f00a6d9d640 1 -- 172.21.15.66:0/374098899 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a810aa30 con 0x7f00a8108100 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.647+0000 7f00a6d9d640 1 --2- 172.21.15.66:0/374098899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0098009820 tx=0x7f009802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11632ae7459f30e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00a659c640 1 -- 172.21.15.66:0/374098899 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098037070 con 0x7f00a8108100 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00a659c640 1 -- 172.21.15.66:0/374098899 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0098032920 con 0x7f00a8108100 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00a659c640 1 -- 172.21.15.66:0/374098899 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098030810 con 0x7f00a8108100 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 -- 172.21.15.66:0/374098899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 msgr2=0x7f00a810a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:02.202 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 --2- 172.21.15.66:0/374098899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0098009820 tx=0x7f009802a270 comp rx=0 tx=0).stop 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 -- 172.21.15.66:0/374098899 shutdown_connections 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 --2- 172.21.15.66:0/374098899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a810a4f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 -- 172.21.15.66:0/374098899 >> 172.21.15.66:0/374098899 conn(0x7f00a8101cc0 msgr2=0x7f00a8104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.648+0000 7f00ad200640 1 -- 172.21.15.66:0/374098899 shutdown_connections 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.649+0000 7f00ad200640 1 -- 172.21.15.66:0/374098899 wait complete. 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.649+0000 7f00ad200640 1 Processor -- start 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.649+0000 7f00ad200640 1 -- start start 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.649+0000 7f00ad200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.649+0000 7f00ad200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00a810bab0 con 0x7f00a8108100 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43232/0 (socket says 172.21.15.66:43232) 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a6d9d640 1 -- 172.21.15.66:0/3340730730 learned_addr learned my addr 172.21.15.66:0/3340730730 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a6d9d640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a819bb80 con 0x7f00a8108100 2024-09-15T22:36:02.203 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a6d9d640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0098030420 tx=0x7f0098032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098037040 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0098040070 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a819be10 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009803a6e0 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.650+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a819eb00 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.651+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f009803a990 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.652+0000 7f00a4d99640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.652+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f009403be30 con 0x7f0094039260 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.652+0000 7f009ffff640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 msgr2=0x7f009403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.652+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f009806ca60 con 0x7f00a8108100 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.652+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.853+0000 7f009ffff640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 msgr2=0x7f009403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:36:02.204 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:57.853+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:58.254+0000 7f009ffff640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 msgr2=0x7f009403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:58.254+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:59.055+0000 7f009ffff640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 msgr2=0x7f009403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1250063396 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:35:59.055+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:00.283+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f009806b510 con 0x7f00a8108100 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:00.283+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 msgr2=0x7f009403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:00.283+0000 7f00a4d99640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.284+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f0098045460 con 0x7f00a8108100 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.284+0000 7f00a4d99640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 0x7f009403f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.284+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f009403be30 con 0x7f009403cd20 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.285+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 0x7f009403f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.285+0000 7f009ffff640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 0x7f009403f110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0090003980 tx=0x7f00900092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.286+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f009403be30 con 0x7f009403cd20 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.293+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f00a8108560 con 0x7f009403cd20 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.293+0000 7f00a4d99640 1 -- 172.21.15.66:0/3340730730 <== mgr.14150 v2:172.21.15.66:6800/1080608797 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f00a8108560 con 0x7f009403cd20 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 msgr2=0x7f009403f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 0x7f009403f110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0090003980 tx=0x7f00900092b0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 msgr2=0x7f00a819b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0098030420 tx=0x7f0098032670 comp rx=0 tx=0).stop 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 shutdown_connections 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f009403cd20 0x7f009403f110 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:6800/1250063396,v1:172.21.15.66:6801/1250063396] conn(0x7f0094039260 0x7f009403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 --2- 172.21.15.66:0/3340730730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a8108100 0x7f00a819b640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 >> 172.21.15.66:0/3340730730 conn(0x7f00a8101cc0 msgr2=0x7f00a8102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 shutdown_connections 2024-09-15T22:36:02.206 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:01.294+0000 7f00ad200640 1 -- 172.21.15.66:0/3340730730 wait complete. 2024-09-15T22:36:02.207 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 9 is available 2024-09-15T22:36:02.207 INFO:teuthology.orchestra.run.smithi066.stdout:Generating a dashboard self-signed certificate... 2024-09-15T22:36:02.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-mon[31185]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:36:02.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-mon[31185]: mgrmap e11: x(active, since 1.00567s) 2024-09-15T22:36:02.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-mon[31185]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:36:02.545 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:03.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:36:02.861+0000 7f0d3d259640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:36:02] ENGINE Error in HTTPServer.serve 2024-09-15T22:36:03.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Traceback (most recent call last): 2024-09-15T22:36:03.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:36:03.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._connections.run(self.expiration_interval) 2024-09-15T22:36:03.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._run(expiration_interval) 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s = self.context.wrap_socket( 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: return self.sslsocket_class._create( 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.do_handshake() 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._sslobj.do_handshake() 2024-09-15T22:36:03.200 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:36:03.201 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:36:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.626+0000 7f0f5d9e3640 1 Processor -- start 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f5d9e3640 1 -- start start 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f5d9e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f5d9e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5807be10 con 0x7f0f58108090 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34142/0 (socket says 172.21.15.66:34142) 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f56ffd640 1 -- 172.21.15.66:0/3206033730 learned_addr learned my addr 172.21.15.66:0/3206033730 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:03.481 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.627+0000 7f0f56ffd640 1 -- 172.21.15.66:0/3206033730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5810a9c0 con 0x7f0f58108090 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.628+0000 7f0f56ffd640 1 --2- 172.21.15.66:0/3206033730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009820 tx=0x7f0f4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfd02f383a6cb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.628+0000 7f0f55ffb640 1 -- 172.21.15.66:0/3206033730 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48037070 con 0x7f0f58108090 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.628+0000 7f0f55ffb640 1 -- 172.21.15.66:0/3206033730 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f48032920 con 0x7f0f58108090 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.628+0000 7f0f55ffb640 1 -- 172.21.15.66:0/3206033730 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48030810 con 0x7f0f58108090 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3206033730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 msgr2=0x7f0f5810a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3206033730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009820 tx=0x7f0f4802a270 comp rx=0 tx=0).stop 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3206033730 shutdown_connections 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3206033730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5810a480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3206033730 >> 172.21.15.66:0/3206033730 conn(0x7f0f58101c50 msgr2=0x7f0f58104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3206033730 shutdown_connections 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.629+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3206033730 wait complete. 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f5d9e3640 1 Processor -- start 2024-09-15T22:36:03.482 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f5d9e3640 1 -- start start 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f5d9e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f5d9e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5810ba40 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34150/0 (socket says 172.21.15.66:34150) 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.630+0000 7f0f56ffd640 1 -- 172.21.15.66:0/3130022496 learned_addr learned my addr 172.21.15.66:0/3130022496 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f56ffd640 1 -- 172.21.15.66:0/3130022496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5819ddb0 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f56ffd640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f48030420 tx=0x7f0f48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48037040 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f48040070 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5819e040 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4803a6e0 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.631+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f581a0d30 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.632+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f0f4803bb20 con 0x7f0f58108090 2024-09-15T22:36:03.483 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.632+0000 7f0f5c9e1640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 0x7f0f4003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.632+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0f4806c800 con 0x7f0f58108090 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.632+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f581084f0 con 0x7f0f58108090 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.632+0000 7f0f567fc640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 0x7f0f4003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.633+0000 7f0f567fc640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 0x7f0f4003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098c0 tx=0x7f0f4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.641+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f48038280 con 0x7f0f58108090 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.644+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f0f4803b7a0 con 0x7f0f58108090 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.840+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f0f58102ef0 con 0x7f0f400390f0 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.907+0000 7f0f5c9e1640 1 -- 172.21.15.66:0/3130022496 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f0f58102ef0 con 0x7f0f400390f0 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 msgr2=0x7f0f4003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 0x7f0f4003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098c0 tx=0x7f0f4c006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 msgr2=0x7f0f5819d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:03.484 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f48030420 tx=0x7f0f48032670 comp rx=0 tx=0).stop 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 shutdown_connections 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f400390f0 0x7f0f4003b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 --2- 172.21.15.66:0/3130022496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f58108090 0x7f0f5819d870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 >> 172.21.15.66:0/3130022496 conn(0x7f0f58101c50 msgr2=0x7f0f581027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 shutdown_connections 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:02.909+0000 7f0f5d9e3640 1 -- 172.21.15.66:0/3130022496 wait complete. 2024-09-15T22:36:03.485 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial admin user... 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: mgrmap e12: x(active, since 2s) 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: [15/Sep/2024:22:36:02] ENGINE Bus STARTING 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: [15/Sep/2024:22:36:02] ENGINE Serving on https://172.21.15.66:7150 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: [15/Sep/2024:22:36:02] ENGINE Error in HTTPServer.serve 2024-09-15T22:36:03.851 INFO:journalctl@ceph.mon.a.smithi066.stdout: Traceback (most recent call last): 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._run(expiration_interval) 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: s = self.context.wrap_socket( 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: return self.sslsocket_class._create( 2024-09-15T22:36:03.852 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout: self.do_handshake() 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._sslobj.do_handshake() 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: [15/Sep/2024:22:36:02] ENGINE Serving on http://172.21.15.66:8765 2024-09-15T22:36:03.853 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:03 smithi066 ceph-mon[31185]: [15/Sep/2024:22:36:02] ENGINE Bus STARTED 2024-09-15T22:36:04.808 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:04 smithi066 ceph-mon[31185]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:04.808 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:05.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4L.XAtByaG3uhHAAmBtYWOs/GwSK8PphHiZ3BIeIVQa33z5rh9zVG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726439764, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T22:36:05.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.845+0000 7f28a9bb3640 1 Processor -- start 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.845+0000 7f28a9bb3640 1 -- start start 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.845+0000 7f28a9bb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.846+0000 7f28a9bb3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28a407be30 con 0x7f28a4108070 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.846+0000 7f28a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.846+0000 7f28a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34154/0 (socket says 172.21.15.66:34154) 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.846+0000 7f28a37fe640 1 -- 172.21.15.66:0/898724868 learned_addr learned my addr 172.21.15.66:0/898724868 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.846+0000 7f28a37fe640 1 -- 172.21.15.66:0/898724868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a410a9a0 con 0x7f28a4108070 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a37fe640 1 --2- 172.21.15.66:0/898724868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2894009e80 tx=0x7f289402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35388e43d326a58c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a27fc640 1 -- 172.21.15.66:0/898724868 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2894036070 con 0x7f28a4108070 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a27fc640 1 -- 172.21.15.66:0/898724868 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28940318e0 con 0x7f28a4108070 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a27fc640 1 -- 172.21.15.66:0/898724868 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2894007a00 con 0x7f28a4108070 2024-09-15T22:36:05.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a9bb3640 1 -- 172.21.15.66:0/898724868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 msgr2=0x7f28a410a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.847+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/898724868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2894009e80 tx=0x7f289402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 -- 172.21.15.66:0/898724868 shutdown_connections 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/898724868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a410a460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 -- 172.21.15.66:0/898724868 >> 172.21.15.66:0/898724868 conn(0x7f28a4101c50 msgr2=0x7f28a4104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 -- 172.21.15.66:0/898724868 shutdown_connections 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 -- 172.21.15.66:0/898724868 wait complete. 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 Processor -- start 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.848+0000 7f28a9bb3640 1 -- start start 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a9bb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a9bb3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28a410ba20 con 0x7f28a4108070 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34170/0 (socket says 172.21.15.66:34170) 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a37fe640 1 -- 172.21.15.66:0/4163150595 learned_addr learned my addr 172.21.15.66:0/4163150595 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:05.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a37fe640 1 -- 172.21.15.66:0/4163150595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a419bb90 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a37fe640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2894031cf0 tx=0x7f2894031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2894036050 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2894042070 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a419be20 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.849+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289403d9e0 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.850+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a419eb10 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.850+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f289403dce0 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.851+0000 7f28a0ff9640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 0x7f289003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.851+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f289406daa0 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.851+0000 7f28a2ffd640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 0x7f289003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.851+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a41084d0 con 0x7f28a4108070 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.852+0000 7f28a2ffd640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 0x7f289003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098c0 tx=0x7f288c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:05.044 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:03.856+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f289403bd60 con 0x7f28a4108070 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.064+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f28a419c300 con 0x7f2890039200 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.313+0000 7f28a0ff9640 1 -- 172.21.15.66:0/4163150595 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f28a419c300 con 0x7f2890039200 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 msgr2=0x7f289003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 0x7f289003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f288c0098c0 tx=0x7f288c006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 msgr2=0x7f28a419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2894031cf0 tx=0x7f2894031d20 comp rx=0 tx=0).stop 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 shutdown_connections 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2890039200 0x7f289003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 --2- 172.21.15.66:0/4163150595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a4108070 0x7f28a419b650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 >> 172.21.15.66:0/4163150595 conn(0x7f28a4101c50 msgr2=0x7f28a41028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 shutdown_connections 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:04.315+0000 7f28a9bb3640 1 -- 172.21.15.66:0/4163150595 wait complete. 2024-09-15T22:36:05.045 INFO:teuthology.orchestra.run.smithi066.stdout:Fetching dashboard port number... 2024-09-15T22:36:05.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:05 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1103785813' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T22:36:06.392 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.476+0000 7fd481055640 1 Processor -- start 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd481055640 1 -- start start 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd481055640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd481055640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c07be70 con 0x7fd47c108020 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34172/0 (socket says 172.21.15.66:34172) 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd47ad9d640 1 -- 172.21.15.66:0/1592210805 learned_addr learned my addr 172.21.15.66:0/1592210805 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.477+0000 7fd47ad9d640 1 -- 172.21.15.66:0/1592210805 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c10a950 con 0x7fd47c108020 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.478+0000 7fd47ad9d640 1 --2- 172.21.15.66:0/1592210805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009820 tx=0x7fd46c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c328222b73193a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.478+0000 7fd47a59c640 1 -- 172.21.15.66:0/1592210805 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c037070 con 0x7fd47c108020 2024-09-15T22:36:06.393 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.478+0000 7fd47a59c640 1 -- 172.21.15.66:0/1592210805 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd46c032920 con 0x7fd47c108020 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.478+0000 7fd47a59c640 1 -- 172.21.15.66:0/1592210805 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c030810 con 0x7fd47c108020 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 -- 172.21.15.66:0/1592210805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 msgr2=0x7fd47c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 --2- 172.21.15.66:0/1592210805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009820 tx=0x7fd46c02a270 comp rx=0 tx=0).stop 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 -- 172.21.15.66:0/1592210805 shutdown_connections 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 --2- 172.21.15.66:0/1592210805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c10a410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 -- 172.21.15.66:0/1592210805 >> 172.21.15.66:0/1592210805 conn(0x7fd47c101ca0 msgr2=0x7fd47c1040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 -- 172.21.15.66:0/1592210805 shutdown_connections 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.479+0000 7fd481055640 1 -- 172.21.15.66:0/1592210805 wait complete. 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd481055640 1 Processor -- start 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd481055640 1 -- start start 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd481055640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd481055640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c10ba30 con 0x7fd47c108020 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:06.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34188/0 (socket says 172.21.15.66:34188) 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd47ad9d640 1 -- 172.21.15.66:0/1103785813 learned_addr learned my addr 172.21.15.66:0/1103785813 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.480+0000 7fd47ad9d640 1 -- 172.21.15.66:0/1103785813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c107de0 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd47ad9d640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0097f0 tx=0x7fd46c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c037040 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd46c030c40 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c105fd0 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c03a5d0 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.481+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47c106510 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.482+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd46c03a810 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.482+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd47c108480 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.482+0000 7fd478d99640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 0x7fd46803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.482+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd46c06c910 con 0x7fd47c108020 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.482+0000 7fd473fff640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 0x7fd46803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:06.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.483+0000 7fd473fff640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 0x7fd46803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4640098c0 tx=0x7fd464006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.487+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd46c030df0 con 0x7fd47c108020 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.674+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd47c106cb0 con 0x7fd47c108020 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.674+0000 7fd478d99640 1 -- 172.21.15.66:0/1103785813 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd46c03b9d0 con 0x7fd47c108020 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 msgr2=0x7fd46803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 0x7fd46803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4640098c0 tx=0x7fd464006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 msgr2=0x7fd47c1078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0097f0 tx=0x7fd46c0327b0 comp rx=0 tx=0).stop 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 shutdown_connections 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd468039200 0x7fd46803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 --2- 172.21.15.66:0/1103785813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd47c108020 0x7fd47c1078a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 >> 172.21.15.66:0/1103785813 conn(0x7fd47c101ca0 msgr2=0x7fd47c1028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 shutdown_connections 2024-09-15T22:36:06.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:05.676+0000 7fd481055640 1 -- 172.21.15.66:0/1103785813 wait complete. 2024-09-15T22:36:06.400 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:36:06.400 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-15T22:36:06.408 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:36:06.408 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-15T22:36:06.408 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-15T22:36:06.408 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph Dashboard is now available at: 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout: URL: https://smithi066.front.sepia.ceph.com:8443/ 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout: User: admin 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout: Password: 9s981gqibt 2024-09-15T22:36:06.410 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:06.411 INFO:teuthology.orchestra.run.smithi066.stdout:Saving cluster configuration to /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config directory 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d8c24c640 1 Processor -- start 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d8c24c640 1 -- start start 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d8c24c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d8c24c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d841073f0 con 0x7f1d84106a20 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d89fe8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:07.623 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d89fe8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34198/0 (socket says 172.21.15.66:34198) 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.812+0000 7f1d89fe8640 1 -- 172.21.15.66:0/3094544141 learned_addr learned my addr 172.21.15.66:0/3094544141 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.813+0000 7f1d89fe8640 1 -- 172.21.15.66:0/3094544141 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d84107740 con 0x7f1d84106a20 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.813+0000 7f1d89fe8640 1 --2- 172.21.15.66:0/3094544141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000bac0 tx=0x7f1d8002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3229e605f287c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d88fe6640 1 -- 172.21.15.66:0/3094544141 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d800326d0 con 0x7f1d84106a20 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d88fe6640 1 -- 172.21.15.66:0/3094544141 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d80038070 con 0x7f1d84106a20 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d88fe6640 1 -- 172.21.15.66:0/3094544141 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d80033d00 con 0x7f1d84106a20 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 -- 172.21.15.66:0/3094544141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 msgr2=0x7f1d84106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/3094544141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000bac0 tx=0x7f1d8002c920 comp rx=0 tx=0).stop 2024-09-15T22:36:07.624 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 -- 172.21.15.66:0/3094544141 shutdown_connections 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/3094544141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84106e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 -- 172.21.15.66:0/3094544141 >> 172.21.15.66:0/3094544141 conn(0x7f1d841013f0 msgr2=0x7f1d84103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 -- 172.21.15.66:0/3094544141 shutdown_connections 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.814+0000 7f1d8c24c640 1 -- 172.21.15.66:0/3094544141 wait complete. 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d8c24c640 1 Processor -- start 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d8c24c640 1 -- start start 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d8c24c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d8c24c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d84105580 con 0x7f1d84106a20 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d89fe8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d89fe8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34204/0 (socket says 172.21.15.66:34204) 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.815+0000 7f1d89fe8640 1 -- 172.21.15.66:0/2948446740 learned_addr learned my addr 172.21.15.66:0/2948446740 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d89fe8640 1 -- 172.21.15.66:0/2948446740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d84199980 con 0x7f1d84106a20 2024-09-15T22:36:07.625 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d89fe8640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000b2c0 tx=0x7f1d800327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d80042070 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d80032d20 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d84199c10 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8003c5a0 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.816+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8419c900 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.817+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1d8003c7d0 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.817+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d84106ea0 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.817+0000 7f1d7affd640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 0x7f1d7003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.817+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d80030050 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.817+0000 7f1d897e7640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 0x7f1d7003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.818+0000 7f1d897e7640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 0x7f1d7003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d740098c0 tx=0x7f1d74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:06.822+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d8004c270 con 0x7f1d84106a20 2024-09-15T22:36:07.626 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.085+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f1d841928b0 con 0x7f1d84106a20 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.087+0000 7f1d7affd640 1 -- 172.21.15.66:0/2948446740 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f1d80040e60 con 0x7f1d84106a20 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 msgr2=0x7f1d7003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 0x7f1d7003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d740098c0 tx=0x7f1d74006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 msgr2=0x7f1d84199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000b2c0 tx=0x7f1d800327d0 comp rx=0 tx=0).stop 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 shutdown_connections 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d70039300 0x7f1d7003b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 --2- 172.21.15.66:0/2948446740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d84106a20 0x7f1d84199440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 >> 172.21.15.66:0/2948446740 conn(0x7f1d841013f0 msgr2=0x7f1d8418fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 shutdown_connections 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-15T22:36:07.089+0000 7f1d8c24c640 1 -- 172.21.15.66:0/2948446740 wait complete. 2024-09-15T22:36:07.627 INFO:teuthology.orchestra.run.smithi066.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: ceph telemetry on 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout:For more information see: 2024-09-15T22:36:07.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.629 INFO:teuthology.orchestra.run.smithi066.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T22:36:07.629 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:07.629 INFO:teuthology.orchestra.run.smithi066.stdout:Bootstrap complete. 2024-09-15T22:36:07.667 INFO:tasks.cephadm:Fetching config... 2024-09-15T22:36:07.668 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:07.668 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T22:36:07.684 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T22:36:07.685 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:07.685 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T22:36:07.741 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T22:36:07.741 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:07.741 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T22:36:07.807 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T22:36:07.807 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:07.807 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T22:36:07.863 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T22:36:07.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:36:07.925 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:07 smithi066 ceph-mon[31185]: mgrmap e13: x(active, since 6s) 2024-09-15T22:36:07.925 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:07 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2948446740' entity='client.admin' 2024-09-15T22:36:07.940 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:07.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:36:07.994 INFO:teuthology.orchestra.run.smithi087.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:08.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:36:08.048 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5mWRkqIIu77AflUgwzH8SYArR1RuSD8o1xyDEYsJN/5+XCzuB9EPqUzLk8CxfQmnUBaL4s1O57iFkJoLf0GjmqTw6fJwl2ICAZ6rE991z2JV2ttOk6Xx/VOgNhGMrh4/eKdPsp31Aj2L59rZGiWqqyGk7Xl1L5heJ0Q7RPTjmDuKp5E/awdndof9sIb6niXb/oh3dvySrC4QLXYYeheBS+Ua3UBY4QNmxljdGdU4hjJlP3JPz3jARj3Xr6AJhpDLEhd3AM228KgxKg1FfaC3ud/lNhYtBVnU8JRKdHmcVznvJH0fkmnleFw9srdxRChtNLfU69VW40w06FMPtVs2pgeYhx1kKNafeKRdrKOr+Nia8+TEtMaPklO9WyEfJ0qiHoU3JU5g5fyPRZRNXS07n93bd7i9t1jvYtOSDp7oDyf+jvlY2ixQeXS1aFoh6JqinT3ONHL+LT8BIpS8/xyXq7Y6GhF9i2TYUKGT/kkgIo8SYi+uNicnx/MwtvbhzZUM= ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:08.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T22:36:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 -- 172.21.15.66:0/921433534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 msgr2=0x7ff288100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 --2- 172.21.15.66:0/921433534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288100290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff278009880 tx=0x7ff27802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 -- 172.21.15.66:0/921433534 shutdown_connections 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 --2- 172.21.15.66:0/921433534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288100290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 -- 172.21.15.66:0/921433534 >> 172.21.15.66:0/921433534 conn(0x7ff2880fbc80 msgr2=0x7ff2880fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 -- 172.21.15.66:0/921433534 shutdown_connections 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.761+0000 7ff28d47a640 1 -- 172.21.15.66:0/921433534 wait complete. 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff28d47a640 1 Processor -- start 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff28d47a640 1 -- start start 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff28d47a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff28d47a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff288109920 con 0x7ff2880ffe90 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34226/0 (socket says 172.21.15.66:34226) 2024-09-15T22:36:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff286ffd640 1 -- 172.21.15.66:0/107676653 learned_addr learned my addr 172.21.15.66:0/107676653 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.762+0000 7ff286ffd640 1 -- 172.21.15.66:0/107676653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2881994b0 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff286ffd640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff278004f60 tx=0x7ff2780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27803f070 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff288199740 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28819c430 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff278003ad0 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.763+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278035030 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.764+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff278042070 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.764+0000 7ff284ff9640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 0x7ff27403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.764+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff27806d060 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.764+0000 7ff27ffff640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 0x7ff27403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.764+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28810a0a0 con 0x7ff2880ffe90 2024-09-15T22:36:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.765+0000 7ff27ffff640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 0x7ff27403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2700098c0 tx=0x7ff270006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:08.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.769+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff278040260 con 0x7ff2880ffe90 2024-09-15T22:36:08.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.946+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff288192150 con 0x7ff2880ffe90 2024-09-15T22:36:08.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.949+0000 7ff284ff9640 1 -- 172.21.15.66:0/107676653 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff27804ad50 con 0x7ff2880ffe90 2024-09-15T22:36:08.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 msgr2=0x7ff27403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:08.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 0x7ff27403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2700098c0 tx=0x7ff270006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 msgr2=0x7ff288198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff278004f60 tx=0x7ff2780048f0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 shutdown_connections 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff274039300 0x7ff27403b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 --2- 172.21.15.66:0/107676653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2880ffe90 0x7ff288198f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 >> 172.21.15.66:0/107676653 conn(0x7ff2880fbc80 msgr2=0x7ff2880fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 shutdown_connections 2024-09-15T22:36:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:08.951+0000 7ff28d47a640 1 -- 172.21.15.66:0/107676653 wait complete. 2024-09-15T22:36:10.270 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:09 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/107676653' entity='client.admin' 2024-09-15T22:36:10.300 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T22:36:10.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T22:36:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:11.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1363189320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 msgr2=0x7f7fd4100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:11.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1363189320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd4100e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009880 tx=0x7f7fc402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1363189320 shutdown_connections 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1363189320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd4100e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1363189320 >> 172.21.15.66:0/1363189320 conn(0x7f7fd40fb450 msgr2=0x7f7fd40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.074+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1363189320 shutdown_connections 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.075+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1363189320 wait complete. 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.075+0000 7f7fd9c2f640 1 Processor -- start 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.075+0000 7f7fd9c2f640 1 -- start start 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd9c2f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd9c2f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd41065e0 con 0x7f7fd4100a60 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34242/0 (socket says 172.21.15.66:34242) 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd37fe640 1 -- 172.21.15.66:0/1659905522 learned_addr learned my addr 172.21.15.66:0/1659905522 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:11.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd37fe640 1 -- 172.21.15.66:0/1659905522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd40fd850 con 0x7f7fd4100a60 2024-09-15T22:36:11.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.076+0000 7f7fd37fe640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4004f60 tx=0x7f7fc40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.077+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc403f070 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.077+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fc4004cc0 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.077+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd40fba40 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.077+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc4035030 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.077+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd40fbf80 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.078+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7fc4042070 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.078+0000 7f7fd0ff9640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 0x7f7fbc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.078+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7fc40717e0 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.078+0000 7f7fd2ffd640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 0x7f7fbc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.079+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd4106d60 con 0x7f7fd4100a60 2024-09-15T22:36:11.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.079+0000 7f7fd2ffd640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 0x7f7fbc03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80098c0 tx=0x7f7fc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:11.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.086+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fc4039350 con 0x7f7fd4100a60 2024-09-15T22:36:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.282+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7fd4190310 con 0x7f7fbc0392a0 2024-09-15T22:36:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.286+0000 7f7fd0ff9640 1 -- 172.21.15.66:0/1659905522 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7fd4190310 con 0x7f7fbc0392a0 2024-09-15T22:36:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 msgr2=0x7f7fbc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 0x7f7fbc03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80098c0 tx=0x7f7fc8006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 msgr2=0x7f7fd40fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4004f60 tx=0x7f7fc40048f0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 shutdown_connections 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7fbc0392a0 0x7f7fbc03b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 --2- 172.21.15.66:0/1659905522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fd4100a60 0x7f7fd40fd310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 >> 172.21.15.66:0/1659905522 conn(0x7f7fd40fb450 msgr2=0x7f7fd40ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 shutdown_connections 2024-09-15T22:36:11.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:11.288+0000 7f7fd9c2f640 1 -- 172.21.15.66:0/1659905522 wait complete. 2024-09-15T22:36:11.777 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi087 2024-09-15T22:36:11.777 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:36:11.777 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:36:11.795 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:36:11.796 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:11.854 INFO:tasks.cephadm:Adding host smithi087 to orchestrator... 2024-09-15T22:36:11.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch host add smithi087 2024-09-15T22:36:12.216 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:12.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:12.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:12.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:12.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:12.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:36:12.387 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:12.387 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:12.387 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:12 smithi066 ceph-mon[31185]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.719+0000 7f928fa68640 1 -- 172.21.15.66:0/80005067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 msgr2=0x7f92881044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.719+0000 7f928fa68640 1 --2- 172.21.15.66:0/80005067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f92881044c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9284009880 tx=0x7f928402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.719+0000 7f928fa68640 1 -- 172.21.15.66:0/80005067 shutdown_connections 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.719+0000 7f928fa68640 1 --2- 172.21.15.66:0/80005067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f92881044c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.719+0000 7f928fa68640 1 -- 172.21.15.66:0/80005067 >> 172.21.15.66:0/80005067 conn(0x7f92880fbcd0 msgr2=0x7f92880fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 -- 172.21.15.66:0/80005067 shutdown_connections 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 -- 172.21.15.66:0/80005067 wait complete. 2024-09-15T22:36:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 Processor -- start 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 -- start start 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.720+0000 7f928fa68640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9288107670 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928d804640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928d804640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52924/0 (socket says 172.21.15.66:52924) 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928d804640 1 -- 172.21.15.66:0/1299015080 learned_addr learned my addr 172.21.15.66:0/1299015080 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928d804640 1 -- 172.21.15.66:0/1299015080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9288101e90 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928d804640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9284004f60 tx=0x7f92840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f928403f070 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9284003ad0 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9288100080 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284035030 con 0x7f92881020d0 2024-09-15T22:36:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.721+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881005c0 con 0x7f92881020d0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.722+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9284042070 con 0x7f92881020d0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.722+0000 7f927effd640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 0x7f927403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.722+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f928406d0c0 con 0x7f92881020d0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.722+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9288107df0 con 0x7f92881020d0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.723+0000 7f928d003640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 0x7f927403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.723+0000 7f928d003640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 0x7f927403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92780098c0 tx=0x7f9278006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.727+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f928402f300 con 0x7f92881020d0 2024-09-15T22:36:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:12.924+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi087", "target": ["mon-mgr", ""]}) -- 0x7f92881902b0 con 0x7f9274039300 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi087", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:14.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:14.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:14.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:14.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:15 smithi066 ceph-mon[31185]: Deploying cephadm binary to smithi087 2024-09-15T22:36:16.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.853+0000 7f927effd640 1 -- 172.21.15.66:0/1299015080 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f92881902b0 con 0x7f9274039300 2024-09-15T22:36:16.855 INFO:teuthology.orchestra.run.smithi066.stdout:Added host 'smithi087' with addr '172.21.15.87' 2024-09-15T22:36:16.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 msgr2=0x7f927403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:16.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 0x7f927403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92780098c0 tx=0x7f9278006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:16.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 msgr2=0x7f9288101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:16.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9284004f60 tx=0x7f92840048f0 comp rx=0 tx=0).stop 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 shutdown_connections 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9274039300 0x7f927403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 --2- 172.21.15.66:0/1299015080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92881020d0 0x7f9288101950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 >> 172.21.15.66:0/1299015080 conn(0x7f92880fbcd0 msgr2=0x7f92880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 shutdown_connections 2024-09-15T22:36:16.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:16.856+0000 7f928fa68640 1 -- 172.21.15.66:0/1299015080 wait complete. 2024-09-15T22:36:17.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:36:17.751 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:18.130 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:18.130 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:17 smithi066 ceph-mon[31185]: Added host smithi087 2024-09-15T22:36:18.131 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:18.131 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:18.131 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 -- 172.21.15.66:0/1771178557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 msgr2=0x7f4364102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1771178557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f4364102b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4354009810 tx=0x7f435402a540 comp rx=0 tx=0).stop 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 -- 172.21.15.66:0/1771178557 shutdown_connections 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1771178557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f4364102b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 -- 172.21.15.66:0/1771178557 >> 172.21.15.66:0/1771178557 conn(0x7f4364077310 msgr2=0x7f43640fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 -- 172.21.15.66:0/1771178557 shutdown_connections 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.137+0000 7f436a5e2640 1 -- 172.21.15.66:0/1771178557 wait complete. 2024-09-15T22:36:18.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f436a5e2640 1 Processor -- start 2024-09-15T22:36:18.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f436a5e2640 1 -- start start 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f436a5e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f436a5e2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f436410bc80 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f4363fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f4363fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52936/0 (socket says 172.21.15.66:52936) 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.138+0000 7f4363fff640 1 -- 172.21.15.66:0/1965506928 learned_addr learned my addr 172.21.15.66:0/1965506928 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f4363fff640 1 -- 172.21.15.66:0/1965506928 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43641976f0 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f4363fff640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4354009930 tx=0x7f4354004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4354031400 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43540035f0 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435403c440 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4364197980 con 0x7f4364102730 2024-09-15T22:36:18.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.139+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4364197de0 con 0x7f4364102730 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.140+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4354039040 con 0x7f4364102730 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.140+0000 7f43617fa640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 0x7f434c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.140+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f435406e5e0 con 0x7f4364102730 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.140+0000 7f43637fe640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 0x7f434c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.140+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4364069f90 con 0x7f4364102730 2024-09-15T22:36:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.141+0000 7f43637fe640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 0x7f434c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43580098c0 tx=0x7f4358006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.145+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4354040030 con 0x7f4364102730 2024-09-15T22:36:18.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.327+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43641985b0 con 0x7f434c0392a0 2024-09-15T22:36:18.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.328+0000 7f43617fa640 1 -- 172.21.15.66:0/1965506928 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f43641985b0 con 0x7f434c0392a0 2024-09-15T22:36:18.329 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:18.329 INFO:teuthology.orchestra.run.smithi066.stdout:[{"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}] 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 msgr2=0x7f434c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 0x7f434c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43580098c0 tx=0x7f4358006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 msgr2=0x7f43641971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4354009930 tx=0x7f4354004570 comp rx=0 tx=0).stop 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 shutdown_connections 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f434c0392a0 0x7f434c03b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 --2- 172.21.15.66:0/1965506928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4364102730 0x7f43641971b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:18.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 >> 172.21.15.66:0/1965506928 conn(0x7f4364077310 msgr2=0x7f43641034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 shutdown_connections 2024-09-15T22:36:18.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:18.330+0000 7f436a5e2640 1 -- 172.21.15.66:0/1965506928 wait complete. 2024-09-15T22:36:18.920 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2024-09-15T22:36:18.920 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:36:18.920 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:36:18.940 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:36:18.940 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:18.999 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2024-09-15T22:36:18.999 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch host add smithi184 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:19.490 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 -- 172.21.15.66:0/1041866104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 msgr2=0x7f5e18102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 --2- 172.21.15.66:0/1041866104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18102b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009810 tx=0x7f5e1402a540 comp rx=0 tx=0).stop 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 -- 172.21.15.66:0/1041866104 shutdown_connections 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 --2- 172.21.15.66:0/1041866104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18102b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 -- 172.21.15.66:0/1041866104 >> 172.21.15.66:0/1041866104 conn(0x7f5e18077310 msgr2=0x7f5e180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 -- 172.21.15.66:0/1041866104 shutdown_connections 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.688+0000 7f5e205cc640 1 -- 172.21.15.66:0/1041866104 wait complete. 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e205cc640 1 Processor -- start 2024-09-15T22:36:19.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e205cc640 1 -- start start 2024-09-15T22:36:19.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e205cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:19.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e205cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1810bc80 con 0x7f5e18102730 2024-09-15T22:36:19.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e1e368640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e1e368640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52950/0 (socket says 172.21.15.66:52950) 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e1e368640 1 -- 172.21.15.66:0/3523914960 learned_addr learned my addr 172.21.15.66:0/3523914960 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e1e368640 1 -- 172.21.15.66:0/3523914960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e18102280 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.689+0000 7f5e1e368640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e140045e0 tx=0x7f5e14004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.690+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e14030e70 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.690+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e181008d0 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.690+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e140318e0 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.690+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e140049c0 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.690+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e18100d90 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5e14039040 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e18069f90 con 0x7f5e18102730 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e0f7fe640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 0x7f5e0403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:19.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5e1406d590 con 0x7f5e18102730 2024-09-15T22:36:19.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e1db67640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 0x7f5e0403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:19.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.691+0000 7f5e1db67640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 0x7f5e0403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e080098c0 tx=0x7f5e08006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:19.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.696+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e14040030 con 0x7f5e18102730 2024-09-15T22:36:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:19.878+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) -- 0x7f5e181018c0 con 0x7f5e040392a0 2024-09-15T22:36:20.600 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:20 smithi066 ceph-mon[31185]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:36:21.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: Deploying cephadm binary to smithi184 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:22.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:23.599 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:23 smithi066 ceph-mon[31185]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:23.599 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:23 smithi066 ceph-mon[31185]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:36:24.022 INFO:teuthology.orchestra.run.smithi066.stdout:Added host 'smithi184' with addr '172.21.15.184' 2024-09-15T22:36:24.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.019+0000 7f5e0f7fe640 1 -- 172.21.15.66:0/3523914960 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5e181018c0 con 0x7f5e040392a0 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 msgr2=0x7f5e0403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 0x7f5e0403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e080098c0 tx=0x7f5e08006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 msgr2=0x7f5e18100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e140045e0 tx=0x7f5e14004610 comp rx=0 tx=0).stop 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 shutdown_connections 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5e040392a0 0x7f5e0403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 --2- 172.21.15.66:0/3523914960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e18102730 0x7f5e18100390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 >> 172.21.15.66:0/3523914960 conn(0x7f5e18077310 msgr2=0x7f5e181054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 shutdown_connections 2024-09-15T22:36:24.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:24.022+0000 7f5e205cc640 1 -- 172.21.15.66:0/3523914960 wait complete. 2024-09-15T22:36:24.557 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:24 smithi066 ceph-mon[31185]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:24.557 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:24 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:24.557 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:24 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:24.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:36:24.847 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 -- 172.21.15.66:0/2536070783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 msgr2=0x7fcd1c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 --2- 172.21.15.66:0/2536070783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c102b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009880 tx=0x7fcd0c02a670 comp rx=0 tx=0).stop 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 -- 172.21.15.66:0/2536070783 shutdown_connections 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 --2- 172.21.15.66:0/2536070783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c102b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 -- 172.21.15.66:0/2536070783 >> 172.21.15.66:0/2536070783 conn(0x7fcd1c0fc1b0 msgr2=0x7fcd1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 -- 172.21.15.66:0/2536070783 shutdown_connections 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.328+0000 7fcd2093c640 1 -- 172.21.15.66:0/2536070783 wait complete. 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd2093c640 1 Processor -- start 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd2093c640 1 -- start start 2024-09-15T22:36:25.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd2093c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd2093c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c10bcc0 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd1a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39260/0 (socket says 172.21.15.66:39260) 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.329+0000 7fcd1a59c640 1 -- 172.21.15.66:0/3463793451 learned_addr learned my addr 172.21.15.66:0/3463793451 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd1a59c640 1 -- 172.21.15.66:0/3463793451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c197700 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd1a59c640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009230 tx=0x7fcd0c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd0c03f070 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0c03bc80 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c197990 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd0c035030 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.330+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c197df0 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.331+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fcd0c042070 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.331+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c06a7b0 con 0x7fcd1c102750 2024-09-15T22:36:25.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.331+0000 7fcd0b7fe640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 0x7fcd0403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:25.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.331+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcd0c06d050 con 0x7fcd1c102750 2024-09-15T22:36:25.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.331+0000 7fcd19d9b640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 0x7fcd0403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:25.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.332+0000 7fcd19d9b640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 0x7fcd0403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098c0 tx=0x7fcd10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:25.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.336+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd0c03a3c0 con 0x7fcd1c102750 2024-09-15T22:36:25.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.530+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd1c198580 con 0x7fcd04039300 2024-09-15T22:36:25.532 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:25 smithi066 ceph-mon[31185]: Added host smithi184 2024-09-15T22:36:25.532 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:25.532 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:25.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.531+0000 7fcd0b7fe640 1 -- 172.21.15.66:0/3463793451 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fcd1c198580 con 0x7fcd04039300 2024-09-15T22:36:25.532 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:25.533 INFO:teuthology.orchestra.run.smithi066.stdout:[{"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.533+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 msgr2=0x7fcd0403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.533+0000 7fcd2093c640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 0x7fcd0403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098c0 tx=0x7fcd10006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.533+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 msgr2=0x7fcd1c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009230 tx=0x7fcd0c003d40 comp rx=0 tx=0).stop 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 shutdown_connections 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcd04039300 0x7fcd0403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:25.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 --2- 172.21.15.66:0/3463793451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd1c102750 0x7fcd1c1971c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:25.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 >> 172.21.15.66:0/3463793451 conn(0x7fcd1c0fc1b0 msgr2=0x7fcd1c103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:25.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 shutdown_connections 2024-09-15T22:36:25.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:25.534+0000 7fcd2093c640 1 -- 172.21.15.66:0/3463793451 wait complete. 2024-09-15T22:36:26.096 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T22:36:26.096 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T22:36:26.358 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:26.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:26 smithi066 ceph-mon[31185]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:26.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 -- 172.21.15.66:0/315293368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 msgr2=0x7f5444102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 --2- 172.21.15.66:0/315293368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444102bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5440009880 tx=0x7f544002a670 comp rx=0 tx=0).stop 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 -- 172.21.15.66:0/315293368 shutdown_connections 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 --2- 172.21.15.66:0/315293368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444102bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 -- 172.21.15.66:0/315293368 >> 172.21.15.66:0/315293368 conn(0x7f54440fc1b0 msgr2=0x7f54440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 -- 172.21.15.66:0/315293368 shutdown_connections 2024-09-15T22:36:26.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.807+0000 7f544c227640 1 -- 172.21.15.66:0/315293368 wait complete. 2024-09-15T22:36:26.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.808+0000 7f544c227640 1 Processor -- start 2024-09-15T22:36:26.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.808+0000 7f544c227640 1 -- start start 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.808+0000 7f544c227640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.808+0000 7f544c227640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f544410bcb0 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f5449fc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f5449fc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39278/0 (socket says 172.21.15.66:39278) 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f5449fc3640 1 -- 172.21.15.66:0/767819812 learned_addr learned my addr 172.21.15.66:0/767819812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f5449fc3640 1 -- 172.21.15.66:0/767819812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5444102360 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f5449fc3640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5440009230 tx=0x7f5440003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544003f070 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f544003bc80 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54441009b0 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5440035030 con 0x7f5444102810 2024-09-15T22:36:26.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.809+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5444100e70 con 0x7f5444102810 2024-09-15T22:36:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.810+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5440042070 con 0x7f5444102810 2024-09-15T22:36:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.810+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544406a6f0 con 0x7f5444102810 2024-09-15T22:36:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.810+0000 7f543affd640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 0x7f543003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.810+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f544006ccd0 con 0x7f5444102810 2024-09-15T22:36:26.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.811+0000 7f54497c2640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 0x7f543003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:26.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.811+0000 7f54497c2640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 0x7f543003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f54340098c0 tx=0x7f5434006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:26.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.815+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5440031570 con 0x7f5444102810 2024-09-15T22:36:26.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:26.997+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f54441019a0 con 0x7f5444102810 2024-09-15T22:36:27.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.211+0000 7f543affd640 1 -- 172.21.15.66:0/767819812 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f54400372d0 con 0x7f5444102810 2024-09-15T22:36:27.213 INFO:teuthology.orchestra.run.smithi066.stderr:adjusted tunables profile to default 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.214+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 msgr2=0x7f543003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.214+0000 7f544c227640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 0x7f543003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f54340098c0 tx=0x7f5434006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.214+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 msgr2=0x7f5444100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.214+0000 7f544c227640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5440009230 tx=0x7f5440003d40 comp rx=0 tx=0).stop 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.214+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 shutdown_connections 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.215+0000 7f544c227640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54300392a0 0x7f543003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:27.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.215+0000 7f544c227640 1 --2- 172.21.15.66:0/767819812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5444102810 0x7f5444100470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:27.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.215+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 >> 172.21.15.66:0/767819812 conn(0x7f54440fc1b0 msgr2=0x7f54441055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:27.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.215+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 shutdown_connections 2024-09-15T22:36:27.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:27.215+0000 7f544c227640 1 -- 172.21.15.66:0/767819812 wait complete. 2024-09-15T22:36:27.537 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:27 smithi066 ceph-mon[31185]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:36:27.537 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:27 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:36:27.860 INFO:tasks.cephadm:Adding mon.a on smithi066 2024-09-15T22:36:27.860 INFO:tasks.cephadm:Adding mon.b on smithi087 2024-09-15T22:36:27.860 INFO:tasks.cephadm:Adding mon.c on smithi184 2024-09-15T22:36:27.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c' 2024-09-15T22:36:28.177 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T22:36:28.223 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:36:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:28.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:28.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2194265084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 msgr2=0x7f13c8101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2194265084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8101a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009880 tx=0x7f13b802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2194265084 shutdown_connections 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2194265084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8101a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2194265084 >> 172.21.15.184:0/2194265084 conn(0x7f13c80fcdb0 msgr2=0x7f13c80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2194265084 shutdown_connections 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.735+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2194265084 wait complete. 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13cdd1b640 1 Processor -- start 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13cdd1b640 1 -- start start 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13cdd1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:28.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13cdd1b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8107710 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.184:55596/0 (socket says 172.21.15.184:55596) 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.736+0000 7f13c77fe640 1 -- 172.21.15.184:0/2622245968 learned_addr learned my addr 172.21.15.184:0/2622245968 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13c77fe640 1 -- 172.21.15.184:0/2622245968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81972a0 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13c77fe640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13b8004f60 tx=0x7f13b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b803f070 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b8004cc0 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c8197530 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b8035030 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.737+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c819a220 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.738+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f13b8042070 con 0x7f13c8101600 2024-09-15T22:36:28.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.738+0000 7f13c4ff9640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 0x7f13b003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.738+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f13b806d1b0 con 0x7f13c8101600 2024-09-15T22:36:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.738+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8107e90 con 0x7f13c8101600 2024-09-15T22:36:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.738+0000 7f13c6ffd640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 0x7f13b003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.739+0000 7f13c6ffd640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 0x7f13b003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098c0 tx=0x7f13bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:28.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.743+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13b80433b0 con 0x7f13c8101600 2024-09-15T22:36:28.933 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.931+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}) -- 0x7f13c8062630 con 0x7f13b00392a0 2024-09-15T22:36:28.938 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.936+0000 7f13c4ff9640 1 -- 172.21.15.184:0/2622245968 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f13c8062630 con 0x7f13b00392a0 2024-09-15T22:36:28.938 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2024-09-15T22:36:28.940 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.938+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 msgr2=0x7f13b003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:28.940 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.938+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 0x7f13b003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098c0 tx=0x7f13bc006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.940 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 msgr2=0x7f13c8196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13b8004f60 tx=0x7f13b80048f0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 shutdown_connections 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f13b00392a0 0x7f13b003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 --2- 172.21.15.184:0/2622245968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13c8101600 0x7f13c8196d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 >> 172.21.15.184:0/2622245968 conn(0x7f13c80fcdb0 msgr2=0x7f13c80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 shutdown_connections 2024-09-15T22:36:28.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:28.939+0000 7f13cdd1b640 1 -- 172.21.15.184:0/2622245968 wait complete. 2024-09-15T22:36:29.536 DEBUG:teuthology.orchestra.run.smithi087:mon.b> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T22:36:29.539 DEBUG:teuthology.orchestra.run.smithi184:mon.c> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T22:36:29.541 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:36:29.541 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:30.279 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:30.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 -- 172.21.15.184:0/2539937727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 msgr2=0x7f3ffc109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 --2- 172.21.15.184:0/2539937727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc109b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009880 tx=0x7f3fec02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 -- 172.21.15.184:0/2539937727 shutdown_connections 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 --2- 172.21.15.184:0/2539937727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc109b80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 -- 172.21.15.184:0/2539937727 >> 172.21.15.184:0/2539937727 conn(0x7f3ffc0ff480 msgr2=0x7f3ffc1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 -- 172.21.15.184:0/2539937727 shutdown_connections 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.665+0000 7f4000f28640 1 -- 172.21.15.184:0/2539937727 wait complete. 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.666+0000 7f4000f28640 1 Processor -- start 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.666+0000 7f4000f28640 1 -- start start 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.666+0000 7f4000f28640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:30.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f4000f28640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc10de60 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f3ffa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f3ffa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.184:55620/0 (socket says 172.21.15.184:55620) 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f3ffa59c640 1 -- 172.21.15.184:0/2643714543 learned_addr learned my addr 172.21.15.184:0/2643714543 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f3ffa59c640 1 -- 172.21.15.184:0/2643714543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc1998a0 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.667+0000 7f3ffa59c640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009230 tx=0x7f3fec003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.668+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fec03f070 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.668+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc199b90 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.668+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fec03bd40 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.668+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fec035030 con 0x7f3ffc1097a0 2024-09-15T22:36:30.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.668+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc19dc30 con 0x7f3ffc1097a0 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.669+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3fec042070 con 0x7f3ffc1097a0 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.669+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc104ee0 con 0x7f3ffc1097a0 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.669+0000 7f3feb7fe640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 0x7f3fe403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.669+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3fec06cf90 con 0x7f3ffc1097a0 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.669+0000 7f3ff9d9b640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 0x7f3fe403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.670+0000 7f3ff9d9b640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 0x7f3fe403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00098c0 tx=0x7f3ff0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:30.675 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.674+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fec041e50 con 0x7f3ffc1097a0 2024-09-15T22:36:30.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: Saving service mon spec with placement smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c;count:3 2024-09-15T22:36:30.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:30 smithi066 ceph-mon[31185]: Deploying daemon mon.c on smithi184 2024-09-15T22:36:30.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.908+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3ffc19a6c0 con 0x7f3ffc1097a0 2024-09-15T22:36:30.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.909+0000 7f3feb7fe640 1 -- 172.21.15.184:0/2643714543 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f3fec04cb90 con 0x7f3ffc1097a0 2024-09-15T22:36:30.910 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:36:30.910 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","modified":"2024-09-15T22:35:10.634982Z","created":"2024-09-15T22:35:10.634982Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:36:30.910 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-09-15T22:36:30.912 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 msgr2=0x7f3fe403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:30.912 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 0x7f3fe403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00098c0 tx=0x7f3ff0006db0 comp rx=0 tx=0).stop 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 msgr2=0x7f3ffc199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009230 tx=0x7f3fec003d80 comp rx=0 tx=0).stop 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 shutdown_connections 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3fe40392a0 0x7f3fe403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 --2- 172.21.15.184:0/2643714543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ffc1097a0 0x7f3ffc199360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 >> 172.21.15.184:0/2643714543 conn(0x7f3ffc0ff480 msgr2=0x7f3ffc0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 shutdown_connections 2024-09-15T22:36:30.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:30.911+0000 7f4000f28640 1 -- 172.21.15.184:0/2643714543 wait complete. 2024-09-15T22:36:31.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:31 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/2643714543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:32.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:32 smithi066 ceph-mon[31185]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 podman[35184]: 2024-09-15 22:36:33.328281751 +0000 UTC m=+0.114134697 container create c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:36:33.807 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:36:33.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:36:33.831 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 podman[35184]: 2024-09-15 22:36:33.522310395 +0000 UTC m=+0.308163337 container init c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:36:33.831 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 podman[35184]: 2024-09-15 22:36:33.52550504 +0000 UTC m=+0.311357980 container start c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:36:33.831 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: pidfile_write: ignore empty --pid-file 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: load: jerasure load: lrc 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Git sha 0 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: DB SUMMARY 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: DB Session ID: OD7KUQBAPUEN3X1J8TSJ 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:36:33.832 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.env: 0x55d191c30940 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.info_log: 0x55d19278b6e0 2024-09-15T22:36:33.833 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.statistics: (nil) 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.use_fsync: 0 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:36:33.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.db_log_dir: 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.wal_dir: 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:36:33.836 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.write_buffer_manager: 0x55d19279adc0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.unordered_write: 0 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:36:33.837 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.row_cache: None 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.wal_filter: None 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.wal_compression: 0 2024-09-15T22:36:33.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:36:33.839 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_open_files: -1 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:36:33.840 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Compression algorithms supported: 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kZSTD supported: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:36:33.841 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.merge_operator: 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_filter: None 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:36:33.842 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d19278b320) 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_type: 0 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_index_type: 0 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_shortening: 1 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:36:33.843 INFO:journalctl@ceph.mon.c.smithi184.stdout: checksum: 4 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: no_block_cache: 0 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache: 0x55d19277f1f0 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_options: 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: capacity : 536870912 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_shard_bits : 4 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: strict_capacity_limit : 0 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_compressed: (nil) 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: persistent_cache: (nil) 2024-09-15T22:36:33.844 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size: 4096 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size_deviation: 10 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_restart_interval: 16 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_block_restart_interval: 1 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: metadata_block_size: 4096 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: partition_filters: 0 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: use_delta_encoding: 1 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: filter_policy: bloomfilter 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: whole_key_filtering: 1 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: verify_compression: 0 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: format_version: 5 2024-09-15T22:36:33.845 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_index_compression: 1 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_align: 0 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout: max_auto_readahead_size: 262144 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout: prepopulate_block_cache: 0 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression: NoCompression 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:36:33.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.num_levels: 7 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:36:33.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:36:33.848 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:36:33.849 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:36:33.850 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:36:33.851 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.ttl: 2592000 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:36:33.852 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 88cd5448-a155-4973-b190-b15622d52a7f 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439793552144, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:36:33.853 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439793552551, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726439793, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "88cd5448-a155-4973-b190-b15622d52a7f", "db_session_id": "OD7KUQBAPUEN3X1J8TSJ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439793552643, "job": 1, "event": "recovery_finished"} 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d1927ace00 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: DB pointer 0x55d1928a8000 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** DB Stats ** 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:36:33.854 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:33.855 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache BinnedLRUCache@0x55d19277f1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.856 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: using public_addr v2:172.21.15.184:0/0 -> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: starting mon.c rank -1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(???) e0 preinit fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).mds e1 new map 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: e1 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: btime 2024-09-15T22:35:13:921866+0000 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: legacy client fscid: -1 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout: No filesystems configured 2024-09-15T22:36:33.857 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:36:33.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:33.859 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Saving service mon spec with placement smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c;count:3 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: Deploying daemon mon.c on smithi184 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/2643714543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 ceph-mon[35203]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 bash[35184]: c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f 2024-09-15T22:36:33.860 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:33 smithi184 systemd[1]: Started Ceph mon.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:36:34.055 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:36:38.920 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 -- 172.21.15.184:0/1537264345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fec003530 msgr2=0x7f2fec0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:38.920 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 --2- 172.21.15.184:0/1537264345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fec003530 0x7f2fec0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30041016a0 tx=0x7f2ffc02c490 comp rx=0 tx=0).stop 2024-09-15T22:36:38.920 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 -- 172.21.15.184:0/1537264345 shutdown_connections 2024-09-15T22:36:38.920 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 --2- 172.21.15.184:0/1537264345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fec003530 0x7f2fec0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:38.921 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 -- 172.21.15.184:0/1537264345 >> 172.21.15.184:0/1537264345 conn(0x7f30040fc220 msgr2=0x7f30040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:38.921 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 -- 172.21.15.184:0/1537264345 shutdown_connections 2024-09-15T22:36:38.921 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.919+0000 7f300c7b8640 1 -- 172.21.15.184:0/1537264345 wait complete. 2024-09-15T22:36:38.921 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 Processor -- start 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: mon.a calling monitor election 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: mon.c calling monitor election 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: monmap epoch 2 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: last_changed 2024-09-15T22:36:33.577873+0000 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: min_mon_release 19 (squid) 2024-09-15T22:36:38.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: election_strategy: 1 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: fsmap 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: mgrmap e13: x(active, since 38s) 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:38.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 -- start start 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 0x7f300419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3004108670 con 0x7f30041977e0 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.920+0000 7f300c7b8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f30041084f0 con 0x7f2fec003530 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:36048/0 (socket says 172.21.15.184:36048) 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 -- 172.21.15.184:0/3565450432 learned_addr learned my addr 172.21.15.184:0/3565450432 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 -- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 msgr2=0x7f30041972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 -- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 msgr2=0x7f30041972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:36:38.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f3009d53640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 0x7f300419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f300a554640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f3009d53640 1 -- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 msgr2=0x7f30041972a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f3009d53640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.921+0000 7f3009d53640 1 -- 172.21.15.184:0/3565450432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3004197e00 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f3009d53640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 0x7f300419bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b3d0 tx=0x7f2ff800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2ff8011630 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300419c0b0 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff8011cb0 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2ff8010df0 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.922+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300419c670 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.923+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2ff8018020 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.923+0000 7f30037fe640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 0x7f2ff003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.923+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2ff804bf90 con 0x7f30041977e0 2024-09-15T22:36:38.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.923+0000 7f300a554640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 0x7f2ff003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:38.928 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.923+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300419c980 con 0x7f30041977e0 2024-09-15T22:36:38.928 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.924+0000 7f300a554640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 0x7f2ff003b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0129e0 tx=0x7f2ffc02c9d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:38.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:38.929+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ff801f020 con 0x7f30041977e0 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: mon.a calling monitor election 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: mon.c calling monitor election 2024-09-15T22:36:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: monmap epoch 2 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: last_changed 2024-09-15T22:36:33.577873+0000 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: min_mon_release 19 (squid) 2024-09-15T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: election_strategy: 1 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: fsmap 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: mgrmap e13: x(active, since 38s) 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:38.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:39.156 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.156+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3004198660 con 0x7f30041977e0 2024-09-15T22:36:39.157 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.156+0000 7f30037fe640 1 -- 172.21.15.184:0/3565450432 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f2ff8018310 con 0x7f30041977e0 2024-09-15T22:36:39.157 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:36:39.158 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","modified":"2024-09-15T22:36:33.577873Z","created":"2024-09-15T22:35:10.634982Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:36:39.158 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 msgr2=0x7f2ff003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 0x7f2ff003b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0129e0 tx=0x7f2ffc02c9d0 comp rx=0 tx=0).stop 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 msgr2=0x7f300419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 0x7f300419bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800b3d0 tx=0x7f2ff800b890 comp rx=0 tx=0).stop 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 shutdown_connections 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2ff0039040 0x7f2ff003b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30041977e0 0x7f300419bb70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 --2- 172.21.15.184:0/3565450432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec003530 0x7f30041972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 >> 172.21.15.184:0/3565450432 conn(0x7f30040fc220 msgr2=0x7f3004104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 shutdown_connections 2024-09-15T22:36:39.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:39.159+0000 7f300c7b8640 1 -- 172.21.15.184:0/3565450432 wait complete. 2024-09-15T22:36:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:39 smithi184 ceph-mon[35203]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:39 smithi184 ceph-mon[35203]: Deploying daemon mon.b on smithi087 2024-09-15T22:36:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:39 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/3565450432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:39.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:39 smithi066 ceph-mon[31185]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:39.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:39 smithi066 ceph-mon[31185]: Deploying daemon mon.b on smithi087 2024-09-15T22:36:39.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:39 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/3565450432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:39.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:40.726 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:36:40.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:36:40.978 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 -- 172.21.15.184:0/4273187389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 msgr2=0x7fc604106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 --2- 172.21.15.184:0/4273187389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc604106a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009880 tx=0x7fc5f402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 -- 172.21.15.184:0/4273187389 shutdown_connections 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 --2- 172.21.15.184:0/4273187389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc604106a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 -- 172.21.15.184:0/4273187389 >> 172.21.15.184:0/4273187389 conn(0x7fc6040fc280 msgr2=0x7fc6040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 -- 172.21.15.184:0/4273187389 shutdown_connections 2024-09-15T22:36:41.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.403+0000 7fc60a330640 1 -- 172.21.15.184:0/4273187389 wait complete. 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 Processor -- start 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 -- start start 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc60410ac80 con 0x7fc604106650 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc60a330640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc60410ab00 con 0x7fc604196810 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc6037fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc603fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc603fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.184:36440/0 (socket says 172.21.15.184:36440) 2024-09-15T22:36:41.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc6037fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:36064/0 (socket says 172.21.15.184:36064) 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc603fff640 1 -- 172.21.15.184:0/3384134728 learned_addr learned my addr 172.21.15.184:0/3384134728 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc6037fe640 1 -- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 msgr2=0x7fc60419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc6037fe640 1 -- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 msgr2=0x7fc60419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.404+0000 7fc6037fe640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc6037fe640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc603fff640 1 -- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 msgr2=0x7fc60419aba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc603fff640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc603fff640 1 -- 172.21.15.184:0/3384134728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc604196e30 con 0x7fc604106650 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc603fff640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4004650 tx=0x7fc5f4032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc5f4035070 con 0x7fc604106650 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60419b0e0 con 0x7fc604106650 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5f4003ce0 con 0x7fc604106650 2024-09-15T22:36:41.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc5f403bbd0 con 0x7fc604106650 2024-09-15T22:36:41.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.405+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60419b640 con 0x7fc604106650 2024-09-15T22:36:41.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.406+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc5f4042030 con 0x7fc604106650 2024-09-15T22:36:41.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.406+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc604101cc0 con 0x7fc604106650 2024-09-15T22:36:41.410 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.406+0000 7fc6017fa640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 0x7fc5f003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:41.410 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.406+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc5f4040070 con 0x7fc604106650 2024-09-15T22:36:41.410 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.407+0000 7fc6037fe640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 0x7fc5f003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:41.410 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.407+0000 7fc6037fe640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 0x7fc5f003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006fd0 tx=0x7fc5ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:41.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.411+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5f403bd70 con 0x7fc604106650 2024-09-15T22:36:41.640 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.639+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc60419b8f0 con 0x7fc604106650 2024-09-15T22:36:41.641 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.640+0000 7fc6017fa640 1 -- 172.21.15.184:0/3384134728 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fc5f404ad50 con 0x7fc604106650 2024-09-15T22:36:41.641 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:36:41.641 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","modified":"2024-09-15T22:36:33.577873Z","created":"2024-09-15T22:35:10.634982Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:36:41.641 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 msgr2=0x7fc5f003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 0x7fc5f003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006fd0 tx=0x7fc5ec008040 comp rx=0 tx=0).stop 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 msgr2=0x7fc6041962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4004650 tx=0x7fc5f4032c50 comp rx=0 tx=0).stop 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 shutdown_connections 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc5f0039040 0x7fc5f003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc604196810 0x7fc60419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 --2- 172.21.15.184:0/3384134728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc604106650 0x7fc6041962d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:41.644 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 >> 172.21.15.184:0/3384134728 conn(0x7fc6040fc280 msgr2=0x7fc6040fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:41.644 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 shutdown_connections 2024-09-15T22:36:41.644 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:41.642+0000 7fc60a330640 1 -- 172.21.15.184:0/3384134728 wait complete. 2024-09-15T22:36:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:41 smithi184 ceph-mon[35203]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:41 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/3384134728' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:41.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:41 smithi066 ceph-mon[31185]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:41.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:41 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/3384134728' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:42.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 podman[35272]: 2024-09-15 22:36:42.2547251 +0000 UTC m=+0.123081213 container create 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 podman[35272]: 2024-09-15 22:36:42.456945289 +0000 UTC m=+0.325301403 container init 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 podman[35272]: 2024-09-15 22:36:42.459941206 +0000 UTC m=+0.328297320 container start 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pidfile_write: ignore empty --pid-file 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: load: jerasure load: lrc 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Git sha 0 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: DB SUMMARY 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: DB Session ID: O5GI1JSFQQ872R1M4O5A 2024-09-15T22:36:42.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.env: 0x56202fadd940 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.info_log: 0x56203162b6e0 2024-09-15T22:36:42.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:36:42.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.statistics: (nil) 2024-09-15T22:36:42.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.use_fsync: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.db_log_dir: 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.wal_dir: 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:36:42.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.write_buffer_manager: 0x56203163adc0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:36:42.854 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.unordered_write: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.row_cache: None 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.wal_filter: None 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.wal_compression: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:36:42.855 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:36:42.856 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_open_files: -1 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:36:42.857 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Compression algorithms supported: 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kZSTD supported: 0 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:36:42.858 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.merge_operator: 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_filter: None 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56203162b320) 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: index_type: 0 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: data_block_index_type: 0 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: index_shortening: 1 2024-09-15T22:36:42.859 INFO:journalctl@ceph.mon.b.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: checksum: 4 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: no_block_cache: 0 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_cache: 0x56203161f1f0 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_cache_options: 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: capacity : 536870912 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: num_shard_bits : 4 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: strict_capacity_limit : 0 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_cache_compressed: (nil) 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: persistent_cache: (nil) 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_size: 4096 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_size_deviation: 10 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_restart_interval: 16 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: index_block_restart_interval: 1 2024-09-15T22:36:42.860 INFO:journalctl@ceph.mon.b.smithi087.stdout: metadata_block_size: 4096 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: partition_filters: 0 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: use_delta_encoding: 1 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: filter_policy: bloomfilter 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: whole_key_filtering: 1 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: verify_compression: 0 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: format_version: 5 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: enable_index_compression: 1 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: block_align: 0 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: max_auto_readahead_size: 262144 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: prepopulate_block_cache: 0 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:36:42.861 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression: NoCompression 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.num_levels: 7 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:36:42.862 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:36:42.863 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:36:42.864 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:36:42.865 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.ttl: 2592000 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:36:42.866 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 613dadcb-3556-42b1-af8c-34e274b954ac 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439802486670, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:36:42.867 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439802487071, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726439802, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "613dadcb-3556-42b1-af8c-34e274b954ac", "db_session_id": "O5GI1JSFQQ872R1M4O5A", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726439802487162, "job": 1, "event": "recovery_finished"} 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56203164ce00 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: DB pointer 0x562031748000 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: ** DB Stats ** 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:36:42.868 INFO:journalctl@ceph.mon.b.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:36:42.869 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:36:42.870 INFO:journalctl@ceph.mon.b.smithi087.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: Block cache BinnedLRUCache@0x56203161f1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: using public_addr v2:172.21.15.87:0/0 -> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: starting mon.b rank -1 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:42.871 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(???) e0 preinit fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).mds e1 new map 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: e1 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: btime 2024-09-15T22:35:13:921866+0000 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: legacy client fscid: -1 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout: No filesystems configured 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:36:42.872 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/767819812' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.873 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:36:42.874 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Saving service mon spec with placement smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c;count:3 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Deploying daemon mon.c on smithi184 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/2643714543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.a calling monitor election 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.c calling monitor election 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.875 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: monmap epoch 2 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: last_changed 2024-09-15T22:36:33.577873+0000 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: min_mon_release 19 (squid) 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: election_strategy: 1 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: fsmap 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mgrmap e13: x(active, since 38s) 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T22:36:42.876 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: Deploying daemon mon.b on smithi087 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/3565450432' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/3384134728' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 ceph-mon[35290]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 bash[35272]: 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 2024-09-15T22:36:42.877 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:42 smithi087 systemd[1]: Started Ceph mon.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:36:43.205 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:36:43.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:36:43.458 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: mon.c calling monitor election 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: mon.a calling monitor election 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: monmap epoch 3 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: min_mon_release 19 (squid) 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: election_strategy: 1 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: fsmap 2024-09-15T22:36:47.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: mgrmap e13: x(active, since 47s) 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: mon.c calling monitor election 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: mon.a calling monitor election 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: monmap epoch 3 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: min_mon_release 19 (squid) 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: election_strategy: 1 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: fsmap 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: mgrmap e13: x(active, since 47s) 2024-09-15T22:36:47.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T22:36:47.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:47.951 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 -- 172.21.15.184:0/708515068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0064003530 msgr2=0x7f00640059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 --2- 172.21.15.184:0/708515068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0064003530 0x7f00640059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f007806aa60 tx=0x7f007402c490 comp rx=0 tx=0).stop 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 -- 172.21.15.184:0/708515068 shutdown_connections 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 --2- 172.21.15.184:0/708515068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0064003530 0x7f00640059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 -- 172.21.15.184:0/708515068 >> 172.21.15.184:0/708515068 conn(0x7f00780fc220 msgr2=0x7f00780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 -- 172.21.15.184:0/708515068 shutdown_connections 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.279+0000 7f0080612640 1 -- 172.21.15.184:0/708515068 wait complete. 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 Processor -- start 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 -- start start 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:48.283 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 0x7f007819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f007810fd30 con 0x7f00781a3bf0 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f007810fbb0 con 0x7f007819dd70 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f0080612640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f007810feb0 con 0x7f0064003530 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59196/0 (socket says 172.21.15.184:59196) 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 -- 172.21.15.184:0/4181018853 learned_addr learned my addr 172.21.15.184:0/4181018853 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 msgr2=0x7f00781a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 msgr2=0x7f00781a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007dbad640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 0x7f007819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007e3ae640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:36:48.284 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.280+0000 7f007ebaf640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 msgr2=0x7f00781a36b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 msgr2=0x7f007819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007ebaf640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 msgr2=0x7f007819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007ebaf640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 msgr2=0x7f007819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007ebaf640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007ebaf640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 -- 172.21.15.184:0/4181018853 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00781aa510 con 0x7f00781a3bf0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f007dbad640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 0x7f007819d830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f006800b450 tx=0x7f006800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068004230 con 0x7f00781a3bf0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00781aa740 con 0x7f00781a3bf0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00680043d0 con 0x7f00781a3bf0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00781aacd0 con 0x7f00781a3bf0 2024-09-15T22:36:48.285 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.281+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068003c90 con 0x7f00781a3bf0 2024-09-15T22:36:48.286 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.282+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f006800f050 con 0x7f00781a3bf0 2024-09-15T22:36:48.286 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.282+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007806ad10 con 0x7f00781a3bf0 2024-09-15T22:36:48.286 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.283+0000 7f006f7fe640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 0x7f005c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:48.286 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.283+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f006804c190 con 0x7f00781a3bf0 2024-09-15T22:36:48.287 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.283+0000 7f007e3ae640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 0x7f005c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:48.287 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.283+0000 7f007e3ae640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 0x7f005c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f007402ca00 tx=0x7f007402c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:48.289 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.288+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f006800d040 con 0x7f00781a3bf0 2024-09-15T22:36:48.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.524+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f00781aaff0 con 0x7f00781a3bf0 2024-09-15T22:36:48.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.525+0000 7f006f7fe640 1 -- 172.21.15.184:0/4181018853 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f0068003e50 con 0x7f00781a3bf0 2024-09-15T22:36:48.527 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:36:48.527 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":3,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","modified":"2024-09-15T22:36:42.512883Z","created":"2024-09-15T22:35:10.634982Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:36:48.527 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 3 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 msgr2=0x7f005c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 0x7f005c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f007402ca00 tx=0x7f007402c990 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 msgr2=0x7f007819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 0x7f007819d830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f006800b450 tx=0x7f006800b910 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 shutdown_connections 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f005c039730 0x7f005c03bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f007819dd70 0x7f007819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00781a3bf0 0x7f007819d830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 --2- 172.21.15.184:0/4181018853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0064003530 0x7f00781a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:48.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 >> 172.21.15.184:0/4181018853 conn(0x7f00780fc220 msgr2=0x7f00780fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:48.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 shutdown_connections 2024-09-15T22:36:48.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:48.527+0000 7f0080612640 1 -- 172.21.15.184:0/4181018853 wait complete. 2024-09-15T22:36:48.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:48.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:48.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:48 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/4181018853' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:48.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:48.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:48.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:48 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/4181018853' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:49.393 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T22:36:49.393 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T22:36:49.657 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:49.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: mon.c calling monitor election 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: mon.a calling monitor election 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: monmap epoch 3 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: min_mon_release 19 (squid) 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: election_strategy: 1 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: fsmap 2024-09-15T22:36:49.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: mgrmap e13: x(active, since 47s) 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:49.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:49 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/4181018853' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mon.b calling monitor election 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: Reconfiguring daemon mon.a on smithi066 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mon.b calling monitor election 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mon.c calling monitor election 2024-09-15T22:36:50.637 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mon.a calling monitor election 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: monmap epoch 3 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: min_mon_release 19 (squid) 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: election_strategy: 1 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: fsmap 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:50.638 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: mgrmap e13: x(active, since 49s) 2024-09-15T22:36:50.639 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T22:36:50.639 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 -- 172.21.15.66:0/1961078252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8544106560 msgr2=0x7f8544106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 --2- 172.21.15.66:0/1961078252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8544106560 0x7f8544106940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8534009880 tx=0x7f853402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 -- 172.21.15.66:0/1961078252 shutdown_connections 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 --2- 172.21.15.66:0/1961078252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8544106560 0x7f8544106940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 -- 172.21.15.66:0/1961078252 >> 172.21.15.66:0/1961078252 conn(0x7f85440fc1b0 msgr2=0x7f85440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 -- 172.21.15.66:0/1961078252 shutdown_connections 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.635+0000 7f854a786640 1 -- 172.21.15.66:0/1961078252 wait complete. 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 Processor -- start 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 -- start start 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8544106560 0x7f85441962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:50.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 0x7f854419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f854410ab90 con 0x7f854419b0d0 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f854410aa10 con 0x7f8544106560 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f854a786640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f854410ad10 con 0x7f8544196800 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f8548d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f8548d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33092/0 (socket says 172.21.15.66:33092) 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f8548d23640 1 -- 172.21.15.66:0/4023650042 learned_addr learned my addr 172.21.15.66:0/4023650042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f8543fff640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8544106560 0x7f85441962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.636+0000 7f85437fe640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 0x7f854419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 -- 172.21.15.66:0/4023650042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 msgr2=0x7f854419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 0x7f854419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 -- 172.21.15.66:0/4023650042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8544106560 msgr2=0x7f85441962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8544106560 0x7f85441962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 -- 172.21.15.66:0/4023650042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85441a2e40 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f85437fe640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 0x7f854419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f8548d23640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f853c00df40 tx=0x7f853c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c00ea60 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853c00ec00 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8544069ed0 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c016780 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.637+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854406a410 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.638+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f853c0169c0 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.638+0000 7f85417fa640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 0x7f852c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.638+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85441069c0 con 0x7f854419b0d0 2024-09-15T22:36:50.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.638+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f853c04df80 con 0x7f854419b0d0 2024-09-15T22:36:50.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.638+0000 7f8543fff640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 0x7f852c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:50.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.639+0000 7f8543fff640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 0x7f852c03bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8534000c00 tx=0x7f8534005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:50.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.643+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f853c019120 con 0x7f854419b0d0 2024-09-15T22:36:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mon.b calling monitor election 2024-09-15T22:36:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: Reconfiguring daemon mon.a on smithi066 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mon.b calling monitor election 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mon.c calling monitor election 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mon.a calling monitor election 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: monmap epoch 3 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: min_mon_release 19 (squid) 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: election_strategy: 1 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:50.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: fsmap 2024-09-15T22:36:50.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:50.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: mgrmap e13: x(active, since 49s) 2024-09-15T22:36:50.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T22:36:50.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:50.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.822+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f854406a730 con 0x7f854419b0d0 2024-09-15T22:36:50.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.823+0000 7f85417fa640 1 -- 172.21.15.66:0/4023650042 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f853c01edb0 con 0x7f854419b0d0 2024-09-15T22:36:50.824 INFO:teuthology.orchestra.run.smithi066.stdout:# minimal ceph.conf for 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:50.824 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-09-15T22:36:50.825 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:50.825 INFO:teuthology.orchestra.run.smithi066.stdout: mon_host = [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 msgr2=0x7f852c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 0x7f852c03bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8534000c00 tx=0x7f8534005a20 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 msgr2=0x7f854419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f853c00df40 tx=0x7f853c00df70 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 shutdown_connections 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854419b0d0 0x7f854419b580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8544196800 0x7f854419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f852c039730 0x7f852c03bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 --2- 172.21.15.66:0/4023650042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8544106560 0x7f85441962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 >> 172.21.15.66:0/4023650042 conn(0x7f85440fc1b0 msgr2=0x7f85440fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 shutdown_connections 2024-09-15T22:36:50.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:50.825+0000 7f854a786640 1 -- 172.21.15.66:0/4023650042 wait complete. 2024-09-15T22:36:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mon.b calling monitor election 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: Reconfiguring daemon mon.a on smithi066 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mon.b calling monitor election 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mon.c calling monitor election 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mon.a calling monitor election 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: monmap epoch 3 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: last_changed 2024-09-15T22:36:42.512883+0000 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: created 2024-09-15T22:35:10.634982+0000 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: min_mon_release 19 (squid) 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: election_strategy: 1 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.a 2024-09-15T22:36:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: 2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: fsmap 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: mgrmap e13: x(active, since 49s) 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T22:36:50.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4023650042' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.541 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:36:51.542 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:51.542 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:51.542 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.542 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:51 smithi087 ceph-mon[35290]: Reconfiguring daemon mon.b on smithi087 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4023650042' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.659 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:51 smithi066 ceph-mon[31185]: Reconfiguring daemon mon.b on smithi087 2024-09-15T22:36:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4023650042' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:51 smithi184 ceph-mon[35203]: Reconfiguring daemon mon.b on smithi087 2024-09-15T22:36:51.688 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T22:36:51.688 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:51.688 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:36:51.716 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:51.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:51.782 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:36:51.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:36:51.809 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:36:51.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:51.874 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:36:51.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:36:51.906 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:36:51.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:36:51.976 INFO:tasks.cephadm:Adding mgr.x on smithi066 2024-09-15T22:36:51.976 INFO:tasks.cephadm:Adding mgr.y on smithi087 2024-09-15T22:36:51.976 INFO:tasks.cephadm:Adding mgr.z on smithi184 2024-09-15T22:36:51.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi066=x;smithi087=y;smithi184=z' 2024-09-15T22:36:52.262 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.683+0000 7f6962d2d640 1 -- 172.21.15.184:0/56955434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102170 msgr2=0x7f695c104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.683+0000 7f6962d2d640 1 --2- 172.21.15.184:0/56955434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102170 0x7f695c104560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f694c009880 tx=0x7f694c02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.683+0000 7f6962d2d640 1 -- 172.21.15.184:0/56955434 shutdown_connections 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.683+0000 7f6962d2d640 1 --2- 172.21.15.184:0/56955434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102170 0x7f695c104560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.683+0000 7f6962d2d640 1 -- 172.21.15.184:0/56955434 >> 172.21.15.184:0/56955434 conn(0x7f695c0fbdb0 msgr2=0x7f695c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- 172.21.15.184:0/56955434 shutdown_connections 2024-09-15T22:36:52.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- 172.21.15.184:0/56955434 wait complete. 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 Processor -- start 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- start start 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c197460 0x7f695c19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c1978e0 0x7f695c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f695c107730 con 0x7f695c197460 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f695c1075b0 con 0x7f695c1978e0 2024-09-15T22:36:52.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6962d2d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f695c1078b0 con 0x7f695c102170 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.684+0000 7f6960ac9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59210/0 (socket says 172.21.15.184:59210) 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 -- 172.21.15.184:0/1174925473 learned_addr learned my addr 172.21.15.184:0/1174925473 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f695bfff640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c197460 0x7f695c19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f69612ca640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c1978e0 0x7f695c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 -- 172.21.15.184:0/1174925473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c1978e0 msgr2=0x7f695c19ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c1978e0 0x7f695c19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 -- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c197460 msgr2=0x7f695c19c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c197460 0x7f695c19c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 -- 172.21.15.184:0/1174925473 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c19f320 con 0x7f695c102170 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6960ac9640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f694c000c00 tx=0x7f694c004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c03f030 con 0x7f695c102170 2024-09-15T22:36:52.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f694c003ce0 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c035070 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.685+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c19f5b0 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.686+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c19fb70 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.686+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f694c042030 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.687+0000 7f6959ffb640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 0x7f694403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.687+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f694c06cdb0 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.687+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c1025d0 con 0x7f695c102170 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.687+0000 7f695bfff640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 0x7f694403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.688+0000 7f695bfff640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 0x7f694403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f695c198440 tx=0x7f6950009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:52.696 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.693+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f694c03b5d0 con 0x7f695c102170 2024-09-15T22:36:52.881 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.879+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi066=x;smithi087=y;smithi184=z", "target": ["mon-mgr", ""]}) -- 0x7f695c062780 con 0x7f6944039730 2024-09-15T22:36:52.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.886+0000 7f6959ffb640 1 -- 172.21.15.184:0/1174925473 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f695c062780 con 0x7f6944039730 2024-09-15T22:36:52.888 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mgr update... 2024-09-15T22:36:52.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.888+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 msgr2=0x7f694403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:52.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.888+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 0x7f694403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f695c198440 tx=0x7f6950009190 comp rx=0 tx=0).stop 2024-09-15T22:36:52.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.888+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 msgr2=0x7f695c196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:52.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.888+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f694c000c00 tx=0x7f694c004430 comp rx=0 tx=0).stop 2024-09-15T22:36:52.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 shutdown_connections 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6944039730 0x7f694403bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c1978e0 0x7f695c19ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c197460 0x7f695c19c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 --2- 172.21.15.184:0/1174925473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102170 0x7f695c196f20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 >> 172.21.15.184:0/1174925473 conn(0x7f695c0fbdb0 msgr2=0x7f695c0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 shutdown_connections 2024-09-15T22:36:52.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:36:52.889+0000 7f6962d2d640 1 -- 172.21.15.184:0/1174925473 wait complete. 2024-09-15T22:36:53.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:53.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: Reconfiguring daemon mon.c on smithi184 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi066=x;smithi087=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:53.600 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: Saving service mgr spec with placement smithi066=x;smithi087=y;smithi184=z;count:3 2024-09-15T22:36:53.601 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: Reconfiguring daemon mon.c on smithi184 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi066=x;smithi087=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: Saving service mgr spec with placement smithi066=x;smithi087=y;smithi184=z;count:3 2024-09-15T22:36:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: Reconfiguring daemon mon.c on smithi184 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi066=x;smithi087=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: Saving service mgr spec with placement smithi066=x;smithi087=y;smithi184=z;count:3 2024-09-15T22:36:53.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:54.284 DEBUG:teuthology.orchestra.run.smithi087:mgr.y> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T22:36:54.288 DEBUG:teuthology.orchestra.run.smithi184:mgr.z> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T22:36:54.290 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T22:36:54.290 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:36:54.290 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:36:54.309 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:36:54.309 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-15T22:36:54.365 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:36:54.365 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:54.365 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-15 22:36:10.904570801 +0000 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-15 22:31:01.786821039 +0000 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-15 22:31:01.786821039 +0000 2024-09-15T22:36:54.366 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-15 22:31:01.786821039 +0000 2024-09-15T22:36:54.366 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:36:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-15T22:36:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-15T22:36:54.432 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000213242 s, 2.4 MB/s 2024-09-15T22:36:54.434 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:36:54.491 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-15 22:36:10.940570535 +0000 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-15 22:31:02.117819191 +0000 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-15 22:31:02.117819191 +0000 2024-09-15T22:36:54.547 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-15 22:31:02.117819191 +0000 2024-09-15T22:36:54.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:36:54.611 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-15T22:36:54.611 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-15T22:36:54.611 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000234865 s, 2.2 MB/s 2024-09-15T22:36:54.613 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:36:54.670 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-15 22:36:10.976570268 +0000 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-15 22:31:02.460817277 +0000 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-15 22:31:02.460817277 +0000 2024-09-15T22:36:54.726 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-15 22:31:02.460817277 +0000 2024-09-15T22:36:54.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:36:54.790 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-15T22:36:54.790 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-15T22:36:54.790 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000189719 s, 2.7 MB/s 2024-09-15T22:36:54.791 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:36:54.849 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-15T22:36:54.906 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:36:54.906 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:54.906 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-15T22:36:54.906 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:54.906 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:54.907 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-15 22:36:11.012570001 +0000 2024-09-15T22:36:54.907 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-15 22:31:02.926814676 +0000 2024-09-15T22:36:54.907 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-15 22:31:02.926814676 +0000 2024-09-15T22:36:54.907 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-15 22:31:02.926814676 +0000 2024-09-15T22:36:54.907 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:36:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-15T22:36:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-15T22:36:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000220269 s, 2.3 MB/s 2024-09-15T22:36:54.971 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:36:55.029 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-15T22:36:55.029 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:36:55.048 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:36:55.049 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-15 22:36:41.949149651 +0000 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-15 22:31:11.986346248 +0000 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-15 22:31:11.986346248 +0000 2024-09-15T22:36:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-15 22:31:11.986346248 +0000 2024-09-15T22:36:55.108 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:36:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:54 smithi184 ceph-mon[35203]: Deploying daemon mgr.z on smithi184 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.173 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.174 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:54 smithi087 ceph-mon[35290]: Deploying daemon mgr.z on smithi184 2024-09-15T22:36:55.176 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-15T22:36:55.176 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-15T22:36:55.176 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000282333 s, 1.8 MB/s 2024-09-15T22:36:55.177 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:55.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:54 smithi066 ceph-mon[31185]: Deploying daemon mgr.z on smithi184 2024-09-15T22:36:55.238 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-15T22:36:55.296 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-15 22:36:41.949149651 +0000 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-15 22:31:12.327338389 +0000 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-15 22:31:12.327338389 +0000 2024-09-15T22:36:55.297 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-15 22:31:12.327338389 +0000 2024-09-15T22:36:55.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:36:55.365 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-15T22:36:55.365 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-15T22:36:55.365 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000225821 s, 2.3 MB/s 2024-09-15T22:36:55.367 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:36:55.425 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-15 22:36:41.949149651 +0000 2024-09-15T22:36:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-15 22:31:12.658330761 +0000 2024-09-15T22:36:55.484 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-15 22:31:12.658330761 +0000 2024-09-15T22:36:55.484 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-15 22:31:12.658330761 +0000 2024-09-15T22:36:55.484 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:36:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-15T22:36:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-15T22:36:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000209138 s, 2.4 MB/s 2024-09-15T22:36:55.550 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:36:55.608 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:55.665 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-15 22:36:41.950149628 +0000 2024-09-15T22:36:55.666 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-15 22:31:12.971323548 +0000 2024-09-15T22:36:55.666 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-15 22:31:12.971323548 +0000 2024-09-15T22:36:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-15 22:31:12.971323548 +0000 2024-09-15T22:36:55.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:36:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-15T22:36:55.730 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-15T22:36:55.730 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000198857 s, 2.6 MB/s 2024-09-15T22:36:55.731 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:36:55.788 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-15T22:36:55.788 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:36:55.805 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:36:55.806 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:55.862 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-15 22:36:55.668717997 +0000 2024-09-15T22:36:55.863 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-15 22:31:11.448280751 +0000 2024-09-15T22:36:55.863 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-15 22:31:11.448280751 +0000 2024-09-15T22:36:55.863 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-15 22:31:11.448280751 +0000 2024-09-15T22:36:55.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:36:55.905 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:55 smithi184 systemd[1]: Starting Ceph mgr.z for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:36:55.928 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-15T22:36:55.928 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-15T22:36:55.928 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00026578 s, 1.9 MB/s 2024-09-15T22:36:55.929 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:36:55.985 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-09-15T22:36:56.040 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:36:56.040 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:56.040 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-15 22:36:55.668717997 +0000 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-15 22:31:11.789273742 +0000 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-15 22:31:11.789273742 +0000 2024-09-15T22:36:56.041 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-15 22:31:11.789273742 +0000 2024-09-15T22:36:56.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:36:56.114 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-15T22:36:56.115 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-15T22:36:56.115 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00923798 s, 55.4 kB/s 2024-09-15T22:36:56.117 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:36:56.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:55 smithi184 ceph-mon[35203]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:56.172 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:55 smithi184 podman[36785]: 2024-09-15 22:36:55.841326952 +0000 UTC m=+0.015779608 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:36:56.173 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:55 smithi184 podman[36785]: 2024-09-15 22:36:55.968331311 +0000 UTC m=+0.142783964 container create 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:36:56.188 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-09-15T22:36:56.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:55 smithi066 ceph-mon[31185]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:56.243 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:36:56.243 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:56.243 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-15 22:36:55.669717977 +0000 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-15 22:31:12.099267371 +0000 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-15 22:31:12.099267371 +0000 2024-09-15T22:36:56.244 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-15 22:31:12.099267371 +0000 2024-09-15T22:36:56.244 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:36:56.306 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-15T22:36:56.307 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-15T22:36:56.307 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000216009 s, 2.4 MB/s 2024-09-15T22:36:56.308 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:36:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:55 smithi087 ceph-mon[35290]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:56.365 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-09-15T22:36:56.420 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:36:56.420 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:36:56.420 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-15 22:36:55.669717977 +0000 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-15 22:31:12.423260711 +0000 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-15 22:31:12.423260711 +0000 2024-09-15T22:36:56.421 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-09-15 22:31:12.423260711 +0000 2024-09-15T22:36:56.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:36:56.484 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-15T22:36:56.484 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-15T22:36:56.484 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000203714 s, 2.5 MB/s 2024-09-15T22:36:56.485 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:36:56.541 INFO:tasks.cephadm:Deploying osd.0 on smithi066 with /dev/vg_nvme/lv_4... 2024-09-15T22:36:56.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:36:56.589 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 podman[36785]: 2024-09-15 22:36:56.245978641 +0000 UTC m=+0.420431307 container init 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:36:56.589 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 podman[36785]: 2024-09-15 22:36:56.248678336 +0000 UTC m=+0.423130990 container start 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:36:56.589 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-mgr[36926]: -- 172.21.15.184:0/2270438053 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564ae78b10e0 con 0x564ae788f400 2024-09-15T22:36:56.590 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 bash[36785]: 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 2024-09-15T22:36:56.590 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 systemd[1]: Started Ceph mgr.z for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:36:56.590 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.373+0000 7f9f3a63b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:36:56.590 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.434+0000 7f9f3a63b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:36:56.590 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.587+0000 7f9f3a63b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:36:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:56.922 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.653+0000 7f9f3a63b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:36:56.922 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.799+0000 7f9f3a63b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:36:57.251 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:56.940+0000 7f9f3a63b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:36:57.251 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:57.249+0000 7f9f3a63b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:36:57.515 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:57.516 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:57 smithi066 ceph-mon[31185]: Deploying daemon mgr.y on smithi087 2024-09-15T22:36:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:57 smithi087 ceph-mon[35290]: Deploying daemon mgr.y on smithi087 2024-09-15T22:36:57.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:57.309+0000 7f9f3a63b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:36:57.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:57.491+0000 7f9f3a63b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:36:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:57 smithi184 ceph-mon[35203]: Deploying daemon mgr.y on smithi087 2024-09-15T22:36:58.318 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 systemd[1]: Starting Ceph mgr.y for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:36:58.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 podman[36635]: 2024-09-15 22:36:58.317343193 +0000 UTC m=+0.108743703 container create 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T22:36:58.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 podman[36635]: 2024-09-15 22:36:58.224617157 +0000 UTC m=+0.016017666 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:36:58.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 podman[36635]: 2024-09-15 22:36:58.536404218 +0000 UTC m=+0.327804727 container init 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:36:58.600 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 podman[36635]: 2024-09-15 22:36:58.539231962 +0000 UTC m=+0.330632471 container start 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:36:58.600 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 ceph-mgr[36654]: -- 172.21.15.87:0/3607996096 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567f70170e0 con 0x5567f6ff5000 2024-09-15T22:36:58.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:58.366+0000 7f9f3a63b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:36:58.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:58.432+0000 7f9f3a63b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:36:58.878 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 bash[36635]: 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d 2024-09-15T22:36:58.878 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 systemd[1]: Started Ceph mgr.y for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:36:58.878 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:58.661+0000 7f6a9dab2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:36:58.879 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:58.721+0000 7f6a9dab2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:36:58.879 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:58.876+0000 7f6a9dab2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:36:59.141 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:36:59.166 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-09-15T22:36:59.258 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:58.946+0000 7f6a9dab2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:36:59.258 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:59.106+0000 7f6a9dab2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:36:59.258 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:59.256+0000 7f6a9dab2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:36:59.418 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:36:59.443 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.178+0000 7f9f3a63b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:36:59.443 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.295+0000 7f9f3a63b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:36:59.443 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.441+0000 7f9f3a63b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.507+0000 7f9f3a63b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.659+0000 7f9f3a63b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.728+0000 7f9f3a63b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.730 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.731 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:59.583+0000 7f6a9dab2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:59.645+0000 7f6a9dab2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.841 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:36:59.842 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:36:59 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:36:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 -- 172.21.15.66:0/1305762430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a4100b10 msgr2=0x7f78a4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 --2- 172.21.15.66:0/1305762430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a4100b10 0x7f78a4100f10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009900 tx=0x7f78a002a410 comp rx=0 tx=0).stop 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 -- 172.21.15.66:0/1305762430 shutdown_connections 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 --2- 172.21.15.66:0/1305762430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a41026d0 0x7f78a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 --2- 172.21.15.66:0/1305762430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4101d10 0x7f78a4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 --2- 172.21.15.66:0/1305762430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a4100b10 0x7f78a4100f10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 -- 172.21.15.66:0/1305762430 >> 172.21.15.66:0/1305762430 conn(0x7f78a40fc2a0 msgr2=0x7f78a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 -- 172.21.15.66:0/1305762430 shutdown_connections 2024-09-15T22:36:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 -- 172.21.15.66:0/1305762430 wait complete. 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.851+0000 7f78ab835640 1 Processor -- start 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 -- start start 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 0x7f78a4104c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a4101d10 0x7f78a41032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78a410c770 con 0x7f78a41026d0 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f78a410c5f0 con 0x7f78a4100b10 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78ab835640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f78a410c8f0 con 0x7f78a4101d10 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42316/0 (socket says 172.21.15.66:42316) 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a95d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 0x7f78a4104c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 -- 172.21.15.66:0/3341897811 learned_addr learned my addr 172.21.15.66:0/3341897811 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a8dd0640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a4101d10 0x7f78a41032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 -- 172.21.15.66:0/3341897811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a4101d10 msgr2=0x7f78a41032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a4101d10 0x7f78a41032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 -- 172.21.15.66:0/3341897811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 msgr2=0x7f78a4104c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 0x7f78a4104c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 -- 172.21.15.66:0/3341897811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a41040e0 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a95d1640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 0x7f78a4104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.852+0000 7f78a9dd2640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f789c00eb10 tx=0x7f789c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.853+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c004b20 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.853+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f789c004cc0 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.853+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a41a20b0 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.853+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c010760 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.853+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a41a25c0 con 0x7f78a41026d0 2024-09-15T22:36:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.854+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f789c005020 con 0x7f78a41026d0 2024-09-15T22:36:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.854+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a41a2850 con 0x7f78a41026d0 2024-09-15T22:36:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.854+0000 7f789a7fc640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 0x7f789003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:36:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.854+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f789c04cc00 con 0x7f78a41026d0 2024-09-15T22:36:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.854+0000 7f78a95d1640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 0x7f789003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:36:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.855+0000 7f78a95d1640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 0x7f789003b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78a0005ab0 tx=0x7f78a0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:36:59.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:36:59.859+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f789c00a250 con 0x7f78a41026d0 2024-09-15T22:37:00.025 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.788+0000 7f9f3a63b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:37:00.025 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:36:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:36:59.955+0000 7f9f3a63b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:37:00.025 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:00.023+0000 7f9f3a63b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:37:00.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:00.077+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f78a41a2a20 con 0x7f78900394d0 2024-09-15T22:37:00.101 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:36:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:36:59.839+0000 7f6a9dab2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:37:00.289 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:00.089+0000 7f9f3a63b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:37:00.289 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:00.170+0000 7f9f3a63b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:37:00.289 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:00.229+0000 7f9f3a63b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:37:00.289 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:00.287+0000 7f9f3a63b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:00.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: Reconfiguring daemon mgr.x on smithi066 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.099 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:00.723+0000 7f6a9dab2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:37:01.099 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:00.791+0000 7f6a9dab2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:37:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: Reconfiguring daemon mgr.x on smithi066 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:01.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:01.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.172 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:37:01.065+0000 7f9f3a63b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: Reconfiguring daemon mgr.x on smithi066 2024-09-15T22:37:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:01.762 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:01.504+0000 7f6a9dab2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:37:01.762 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:01.620+0000 7f6a9dab2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:37:01.763 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:01.760+0000 7f6a9dab2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:37:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:01.895+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f789c021960 con 0x7f78a41026d0 2024-09-15T22:37:02.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:02.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: Standby manager daemon z started 2024-09-15T22:37:02.002 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:37:02.003 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:02.003 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:37:02.003 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:01 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:02.039 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:01.822+0000 7f6a9dab2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:37:02.039 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:01.970+0000 7f6a9dab2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:37:02.039 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.037+0000 7f6a9dab2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:37:02.039 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:02.039 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: Standby manager daemon z started 2024-09-15T22:37:02.040 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:37:02.040 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:02.040 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:37:02.040 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:01 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: Standby manager daemon z started 2024-09-15T22:37:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:37:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:37:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:01 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/315121264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:02.320 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.097+0000 7f6a9dab2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:37:02.320 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.254+0000 7f6a9dab2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:37:02.320 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.318+0000 7f6a9dab2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:37:02.587 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.383+0000 7f6a9dab2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:37:02.587 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.466+0000 7f6a9dab2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:37:02.587 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.526+0000 7f6a9dab2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:37:02.587 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:02.585+0000 7f6a9dab2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:37:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:03.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:03.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T22:37:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:37:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:03.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:03.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:03.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:03.849 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:37:03.375+0000 7f6a9dab2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:37:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:03.906+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f789c01f340 con 0x7f78a41026d0 2024-09-15T22:37:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: Standby manager daemon y started 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]: dispatch 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]': finished 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:37:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:03 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: Standby manager daemon y started 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]: dispatch 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]': finished 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:37:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: Standby manager daemon y started 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/3235864622' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]: dispatch 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3169407883' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceadf938-3e92-4e02-bf52-56073010f453"}]': finished 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:37:04.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:03 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:04 smithi184 ceph-mon[35203]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T22:37:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:37:05.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:04 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/80486848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:05.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:04 smithi066 ceph-mon[31185]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T22:37:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:37:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:04 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/80486848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:04 smithi087 ceph-mon[35290]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T22:37:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:37:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:04 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/80486848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:05 smithi184 ceph-mon[35203]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:06.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:05 smithi066 ceph-mon[31185]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:05 smithi087 ceph-mon[35290]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:08.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:07 smithi184 ceph-mon[35203]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:08.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:07 smithi066 ceph-mon[31185]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:08.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:07 smithi087 ceph-mon[35290]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:10.166 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:09 smithi087 ceph-mon[35290]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:10.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:09 smithi184 ceph-mon[35203]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:10.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:09 smithi066 ceph-mon[31185]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:12.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:11 smithi184 ceph-mon[35203]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:12.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:37:12.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:12.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:11 smithi066 ceph-mon[31185]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:12.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:37:12.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:12.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:11 smithi087 ceph-mon[35290]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:12.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:37:12.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:13.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:12 smithi066 ceph-mon[31185]: Deploying daemon osd.0 on smithi066 2024-09-15T22:37:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:12 smithi087 ceph-mon[35290]: Deploying daemon osd.0 on smithi066 2024-09-15T22:37:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:12 smithi184 ceph-mon[35203]: Deploying daemon osd.0 on smithi066 2024-09-15T22:37:14.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:13 smithi066 ceph-mon[31185]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:14.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:13 smithi087 ceph-mon[35290]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:14.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:13 smithi184 ceph-mon[35203]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:16.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:15 smithi066 ceph-mon[31185]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:15 smithi087 ceph-mon[35290]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:15 smithi184 ceph-mon[35203]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:18.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:17 smithi066 ceph-mon[31185]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:18.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:17 smithi087 ceph-mon[35290]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:18.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:17 smithi184 ceph-mon[35203]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:19.184 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:18 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:19.184 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:18 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:19.184 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:18 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:18 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:18 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:18 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:18 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:18 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:18 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:20 smithi066 ceph-mon[31185]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:20 smithi087 ceph-mon[35290]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:20 smithi184 ceph-mon[35203]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:22.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:22.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.027 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.028 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:22.028 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:22.028 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:22.365 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 0 on host 'smithi066' 2024-09-15T22:37:22.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.363+0000 7f789a7fc640 1 -- 172.21.15.66:0/3341897811 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78a41a2a20 con 0x7f78900394d0 2024-09-15T22:37:22.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 msgr2=0x7f789003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:22.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 0x7f789003b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78a0005ab0 tx=0x7f78a0000bc0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 msgr2=0x7f78a4103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f789c00eb10 tx=0x7f789c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 shutdown_connections 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78a41026d0 0x7f78a4103820 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78a4101d10 0x7f78a41032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f78900394d0 0x7f789003b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 --2- 172.21.15.66:0/3341897811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78a4100b10 0x7f78a4104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 >> 172.21.15.66:0/3341897811 conn(0x7f78a40fc2a0 msgr2=0x7f78a406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 shutdown_connections 2024-09-15T22:37:22.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:37:22.366+0000 7f78ab835640 1 -- 172.21.15.66:0/3341897811 wait complete. 2024-09-15T22:37:23.014 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:23.014 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.014 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.041 DEBUG:teuthology.orchestra.run.smithi066:osd.0> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T22:37:23.044 INFO:tasks.cephadm:Deploying osd.1 on smithi087 with /dev/vg_nvme/lv_4... 2024-09-15T22:37:23.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:37:23.072 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:23.072 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.072 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:23.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:23.295 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:37:24.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:23 smithi087 ceph-mon[35290]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:24.162 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:23 smithi066 ceph-mon[31185]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:24.162 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:37:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T22:37:23.971+0000 7fdf2d954640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:37:24.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:23 smithi184 ceph-mon[35203]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:24.986 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:24 smithi087 ceph-mon[35290]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:37:25.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:24 smithi184 ceph-mon[35203]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:37:25.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:24 smithi066 ceph-mon[31185]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:37:25.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:37:25.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_4 2024-09-15T22:37:25.878 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:25 smithi066 ceph-mon[31185]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:25.878 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:25 smithi066 ceph-mon[31185]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:37:25.878 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:25 smithi066 ceph-mon[31185]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:37:25.878 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:25 smithi066 ceph-mon[31185]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:37:25.878 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:25.923 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:37:26.044 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:25 smithi087 ceph-mon[35290]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:26.044 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:25 smithi087 ceph-mon[35290]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:37:26.044 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:25 smithi087 ceph-mon[35290]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:37:26.044 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:25 smithi087 ceph-mon[35290]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:37:26.044 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:26.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:25 smithi184 ceph-mon[35203]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:26.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:25 smithi184 ceph-mon[35203]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:37:26.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:25 smithi184 ceph-mon[35203]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:37:26.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:25 smithi184 ceph-mon[35203]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:37:26.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:26.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 -- 172.21.15.87:0/3371745121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff548102660 msgr2=0x7ff548104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:26.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/3371745121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff548102660 0x7ff548104a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff53802a410 comp rx=0 tx=0).stop 2024-09-15T22:37:26.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 -- 172.21.15.87:0/3371745121 shutdown_connections 2024-09-15T22:37:26.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/3371745121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5481078c0 0x7ff548109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:26.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/3371745121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/3371745121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff548102660 0x7ff548104a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 -- 172.21.15.87:0/3371745121 >> 172.21.15.87:0/3371745121 conn(0x7ff5480fc280 msgr2=0x7ff5480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 -- 172.21.15.87:0/3371745121 shutdown_connections 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.383+0000 7ff54d1ca640 1 -- 172.21.15.87:0/3371745121 wait complete. 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 Processor -- start 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 -- start start 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff548102660 0x7ff548197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810d890 con 0x7ff548102660 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810d710 con 0x7ff5481078c0 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.384+0000 7ff54d1ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810da10 con 0x7ff548104f90 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:26.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50644/0 (socket says 172.21.15.87:50644) 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 -- 172.21.15.87:0/2531145479 learned_addr learned my addr 172.21.15.87:0/2531145479 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff546d9d640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff548102660 0x7ff548197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54659c640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 -- 172.21.15.87:0/2531145479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 msgr2=0x7ff548198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 -- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff548102660 msgr2=0x7ff548197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff548102660 0x7ff548197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 -- 172.21.15.87:0/2531145479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54819fb50 con 0x7ff5481078c0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54659c640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54759e640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff54000eb10 tx=0x7ff54000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540004b20 con 0x7ff5481078c0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff540004cc0 con 0x7ff5481078c0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54819fe40 con 0x7ff5481078c0 2024-09-15T22:37:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540010760 con 0x7ff5481078c0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.385+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481a02a0 con 0x7ff5481078c0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.386+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5480fdd70 con 0x7ff5481078c0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.387+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7ff540010900 con 0x7ff5481078c0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.388+0000 7ff52ffff640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 0x7ff5300a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.388+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7ff5400ce520 con 0x7ff5481078c0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.388+0000 7ff546d9d640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 0x7ff5300a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.389+0000 7ff546d9d640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 0x7ff5300a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5380314e0 tx=0x7ff538000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.391+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5400541b0 con 0x7ff5481078c0 2024-09-15T22:37:26.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:26.567+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff548062630 con 0x7ff5300a31e0 2024-09-15T22:37:26.788 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T22:37:26.487+0000 7fdf2a0eb640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:37:26.788 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T22:37:26.490+0000 7fdf216f7640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:37:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi066 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:37:27.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi066 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' 2024-09-15T22:37:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi066 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456]' entity='osd.0' 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] boot 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:37:28.048 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:28.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:37:28.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:37:28.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:28.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:28.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] boot 2024-09-15T22:37:28.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:37:28.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: osd.0 [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] boot 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:37:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:37:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:37:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/1977247956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]': finished 2024-09-15T22:37:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:37:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/350692491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/1977247956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]': finished 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/350692491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/1977247956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]: dispatch 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0556bc3-9d56-4289-b5c7-e121a7c3bcc2"}]': finished 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/350692491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:31 smithi087 ceph-mon[35290]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:31 smithi184 ceph-mon[35203]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:32.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:31 smithi066 ceph-mon[31185]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:33.978 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:33 smithi087 ceph-mon[35290]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:33 smithi184 ceph-mon[35203]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:34.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:33 smithi066 ceph-mon[31185]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:36.080 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:35 smithi087 ceph-mon[35290]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:36.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:35 smithi184 ceph-mon[35203]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:36.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:35 smithi066 ceph-mon[31185]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:38.075 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:37 smithi087 ceph-mon[35290]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:38.075 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:37:38.075 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:38.075 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:37 smithi087 ceph-mon[35290]: Deploying daemon osd.1 on smithi087 2024-09-15T22:37:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:37 smithi184 ceph-mon[35203]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:37:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:37 smithi184 ceph-mon[35203]: Deploying daemon osd.1 on smithi087 2024-09-15T22:37:38.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:37 smithi066 ceph-mon[31185]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:38.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:37:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:37 smithi066 ceph-mon[31185]: Deploying daemon osd.1 on smithi087 2024-09-15T22:37:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:39 smithi087 ceph-mon[35290]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:40.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:39 smithi184 ceph-mon[35203]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:40.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:39 smithi066 ceph-mon[31185]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:42.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:41 smithi087 ceph-mon[35290]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:42.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:41 smithi184 ceph-mon[35203]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:42.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:41 smithi066 ceph-mon[31185]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:44.073 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:43 smithi087 ceph-mon[35290]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:44.073 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:44.073 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:44.073 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:44.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:43 smithi184 ceph-mon[35203]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:44.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:44.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:44.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:43 smithi066 ceph-mon[31185]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:46.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:46.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:46.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.339+0000 7ff52ffff640 1 -- 172.21.15.87:0/2531145479 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff548062630 con 0x7ff5300a31e0 2024-09-15T22:37:46.341 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 1 on host 'smithi087' 2024-09-15T22:37:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 msgr2=0x7ff5300a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 0x7ff5300a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5380314e0 tx=0x7ff538000bc0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 msgr2=0x7ff54819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff54000eb10 tx=0x7ff54000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 shutdown_connections 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5300a31e0 0x7ff5300a56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5481078c0 0x7ff54819f4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff548104f90 0x7ff548198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 --2- 172.21.15.87:0/2531145479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff548102660 0x7ff548197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 >> 172.21.15.87:0/2531145479 conn(0x7ff5480fc280 msgr2=0x7ff548103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 shutdown_connections 2024-09-15T22:37:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:37:46.342+0000 7ff54d1ca640 1 -- 172.21.15.87:0/2531145479 wait complete. 2024-09-15T22:37:46.911 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:46.911 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.911 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:46.938 DEBUG:teuthology.orchestra.run.smithi087:osd.1> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T22:37:46.941 INFO:tasks.cephadm:Deploying osd.2 on smithi184 with /dev/vg_nvme/lv_4... 2024-09-15T22:37:46.942 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:37:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:47.193 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:37:47.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:37:47.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:47.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:47 smithi184 ceph-mon[35203]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:48.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:47 smithi087 ceph-mon[35290]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:48.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:47 smithi066 ceph-mon[31185]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:49.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:48 smithi087 ceph-mon[35290]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:48 smithi087 ceph-mon[35290]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.067 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:37:48 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T22:37:48.771+0000 7f3d01761640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:37:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:48 smithi184 ceph-mon[35203]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:48 smithi184 ceph-mon[35203]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:48 smithi066 ceph-mon[31185]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:48 smithi066 ceph-mon[31185]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:37:49.445 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:37:49.471 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-09-15T22:37:49.714 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.096 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.097 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:50.097 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.097 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:50.097 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:50.097 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:50.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:50.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:50.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 -- 172.21.15.184:0/2358143539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 msgr2=0x7f974c101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:50.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 --2- 172.21.15.184:0/2358143539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c101230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9748009900 tx=0x7f974802a410 comp rx=0 tx=0).stop 2024-09-15T22:37:50.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 -- 172.21.15.184:0/2358143539 shutdown_connections 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 --2- 172.21.15.184:0/2358143539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 0x7f974c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 --2- 172.21.15.184:0/2358143539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c101230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 --2- 172.21.15.184:0/2358143539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 0x7f974c100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 -- 172.21.15.184:0/2358143539 >> 172.21.15.184:0/2358143539 conn(0x7f974c0fc2a0 msgr2=0x7f974c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.176+0000 7f975372f640 1 -- 172.21.15.184:0/2358143539 shutdown_connections 2024-09-15T22:37:50.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.177+0000 7f975372f640 1 -- 172.21.15.184:0/2358143539 wait complete. 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.177+0000 7f975372f640 1 Processor -- start 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.177+0000 7f975372f640 1 -- start start 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.177+0000 7f975372f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 0x7f974c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 0x7f974c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10fa80 con 0x7f974c101770 2024-09-15T22:37:50.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10f900 con 0x7f974c100490 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f974c10fc00 con 0x7f974c100dd0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:37722/0 (socket says 172.21.15.184:37722) 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 -- 172.21.15.184:0/2072354504 learned_addr learned my addr 172.21.15.184:0/2072354504 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f97514cb640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 0x7f974c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9751ccc640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 0x7f974c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 -- 172.21.15.184:0/2072354504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 msgr2=0x7f974c19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 0x7f974c19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 -- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 msgr2=0x7f974c1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 0x7f974c1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 -- 172.21.15.184:0/2072354504 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c1a1cd0 con 0x7f974c100dd0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f9750cca640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9748009230 tx=0x7f9748004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:50.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974803f030 con 0x7f974c100dd0 2024-09-15T22:37:50.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9748003ce0 con 0x7f974c100dd0 2024-09-15T22:37:50.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c1a1f60 con 0x7f974c100dd0 2024-09-15T22:37:50.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748035070 con 0x7f974c100dd0 2024-09-15T22:37:50.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.178+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c1a23b0 con 0x7f974c100dd0 2024-09-15T22:37:50.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.179+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c10b1e0 con 0x7f974c100dd0 2024-09-15T22:37:50.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.180+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f9748042030 con 0x7f974c100dd0 2024-09-15T22:37:50.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.181+0000 7f97427fc640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 0x7f97380a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:37:50.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.181+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f97480ee4e0 con 0x7f974c100dd0 2024-09-15T22:37:50.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.181+0000 7f97514cb640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 0x7f97380a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:37:50.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.182+0000 7f97514cb640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 0x7f97380a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f973c005fd0 tx=0x7f973c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:37:50.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.185+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97480bc520 con 0x7f974c100dd0 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:37:50.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:37:50.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:37:50.360+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f974c062630 con 0x7f97380a31e0 2024-09-15T22:37:50.838 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T22:37:50.493+0000 7f3cfd6e4640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:37:50.838 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T22:37:50.499+0000 7f3cf5504640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi087 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.074 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:51.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:51.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:51.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:50 smithi184 ceph-mon[35203]: from='osd.1 ' entity='osd.1' 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi087 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:51.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:51.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:51.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:50 smithi087 ceph-mon[35290]: from='osd.1 ' entity='osd.1' 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi087 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:37:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:37:51.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:50 smithi066 ceph-mon[31185]: from='osd.1 ' entity='osd.1' 2024-09-15T22:37:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:37:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] boot 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:37:52.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:52.154 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:37:52.154 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:37:52.154 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:52.155 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:52.155 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:52.155 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] boot 2024-09-15T22:37:52.155 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:37:52.155 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: osd.1 [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] boot 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:37:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:37:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:37:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/3598375069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]': finished 2024-09-15T22:37:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:37:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:37:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:53 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/599777089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/3598375069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]': finished 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:37:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:37:53.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:53 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/599777089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/3598375069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]: dispatch 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30d6d931-c774-4f28-b5d8-a727dff41a5c"}]': finished 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:37:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:53 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/599777089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:37:55.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:55 smithi087 ceph-mon[35290]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:55 smithi184 ceph-mon[35203]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:55.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:55 smithi066 ceph-mon[31185]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:57 smithi184 ceph-mon[35203]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:57.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:57 smithi087 ceph-mon[35290]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:57.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:57 smithi066 ceph-mon[31185]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:59.750 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:37:59 smithi184 ceph-mon[35203]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:59.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:37:59 smithi087 ceph-mon[35290]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:37:59.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:37:59 smithi066 ceph-mon[31185]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:01 smithi184 ceph-mon[35203]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:01.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:38:01.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:01.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:01 smithi184 ceph-mon[35203]: Deploying daemon osd.2 on smithi184 2024-09-15T22:38:01.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:01 smithi087 ceph-mon[35290]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:01.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:38:01.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:01.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:01 smithi087 ceph-mon[35290]: Deploying daemon osd.2 on smithi184 2024-09-15T22:38:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:01 smithi066 ceph-mon[31185]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:38:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:01 smithi066 ceph-mon[31185]: Deploying daemon osd.2 on smithi184 2024-09-15T22:38:03.809 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:03 smithi184 ceph-mon[35203]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:03.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:03 smithi087 ceph-mon[35290]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:03.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:03 smithi066 ceph-mon[31185]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:05.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:05 smithi066 ceph-mon[31185]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:05.741 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:05 smithi184 ceph-mon[35203]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:05.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:05 smithi087 ceph-mon[35290]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:07.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:07 smithi184 ceph-mon[35203]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:07.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:07.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:07.634 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:07 smithi087 ceph-mon[35290]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:07.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:07 smithi066 ceph-mon[31185]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:07.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:07.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:07.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:09.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:09.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:09.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:09 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:09.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:09 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:09 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:10.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.846+0000 7f97427fc640 1 -- 172.21.15.184:0/2072354504 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f974c062630 con 0x7f97380a31e0 2024-09-15T22:38:10.849 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 2 on host 'smithi184' 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 msgr2=0x7f97380a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 0x7f97380a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f973c005fd0 tx=0x7f973c00b390 comp rx=0 tx=0).stop 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 msgr2=0x7f974c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9748009230 tx=0x7f9748004360 comp rx=0 tx=0).stop 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 shutdown_connections 2024-09-15T22:38:10.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f974c101770 0x7f974c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f974c100dd0 0x7f974c19a5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f97380a31e0 0x7f97380a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 --2- 172.21.15.184:0/2072354504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f974c100490 0x7f974c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 >> 172.21.15.184:0/2072354504 conn(0x7f974c0fc2a0 msgr2=0x7f974c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 shutdown_connections 2024-09-15T22:38:10.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:38:10.849+0000 7f975372f640 1 -- 172.21.15.184:0/2072354504 wait complete. 2024-09-15T22:38:11.495 DEBUG:teuthology.orchestra.run.smithi184:osd.2> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T22:38:11.498 INFO:tasks.cephadm:Deploying osd.3 on smithi066 with /dev/vg_nvme/lv_3... 2024-09-15T22:38:11.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:38:11.776 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:38:11.812 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:11 smithi184 ceph-mon[35203]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:11.812 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:11.812 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:11.812 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:11.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:11 smithi087 ceph-mon[35290]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:11.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:11.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:11.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:11.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:11 smithi066 ceph-mon[31185]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:11.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:11.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:11.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:13.173 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T22:38:12.976+0000 7feb4d4b0640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:38:13.796 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:13 smithi184 ceph-mon[35203]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:13.796 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:13 smithi184 ceph-mon[35203]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:13.797 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:13 smithi184 ceph-mon[35203]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:13 smithi087 ceph-mon[35290]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:13 smithi087 ceph-mon[35290]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:13 smithi087 ceph-mon[35290]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:13 smithi066 ceph-mon[31185]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:13 smithi066 ceph-mon[31185]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:13 smithi066 ceph-mon[31185]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:38:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:38:14.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-09-15T22:38:14.643 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi184 2024-09-15T22:38:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:14.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:38:14.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi184 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:14.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.925 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T22:38:14.540+0000 7feb49433640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:38:14.925 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T22:38:14.547+0000 7feb4525b640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:38:14.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi184 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 17088M 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:14.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.138+0000 7f7a6442e640 1 -- 172.21.15.66:0/332827365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c102660 msgr2=0x7f7a5c104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.138+0000 7f7a6442e640 1 --2- 172.21.15.66:0/332827365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c102660 0x7f7a5c104a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009900 tx=0x7f7a5802a410 comp rx=0 tx=0).stop 2024-09-15T22:38:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 -- 172.21.15.66:0/332827365 shutdown_connections 2024-09-15T22:38:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 --2- 172.21.15.66:0/332827365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 --2- 172.21.15.66:0/332827365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c104f90 0x7f7a5c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 --2- 172.21.15.66:0/332827365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c102660 0x7f7a5c104a50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 -- 172.21.15.66:0/332827365 >> 172.21.15.66:0/332827365 conn(0x7f7a5c0fc280 msgr2=0x7f7a5c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 -- 172.21.15.66:0/332827365 shutdown_connections 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 -- 172.21.15.66:0/332827365 wait complete. 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 Processor -- start 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.139+0000 7f7a6442e640 1 -- start start 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c102660 0x7f7a5c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 0x7f7a5c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c10d8e0 con 0x7f7a5c1078c0 2024-09-15T22:38:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c10d760 con 0x7f7a5c104f90 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a6442e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c10da60 con 0x7f7a5c102660 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44920/0 (socket says 172.21.15.66:44920) 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 -- 172.21.15.66:0/1547664034 learned_addr learned my addr 172.21.15.66:0/1547664034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a621ca640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c102660 0x7f7a5c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a619c9640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 0x7f7a5c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 -- 172.21.15.66:0/1547664034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c102660 msgr2=0x7f7a5c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c102660 0x7f7a5c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 -- 172.21.15.66:0/1547664034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 msgr2=0x7f7a5c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 0x7f7a5c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 -- 172.21.15.66:0/1547664034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c19fb10 con 0x7f7a5c1078c0 2024-09-15T22:38:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a619c9640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 0x7f7a5c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.140+0000 7f7a629cb640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400b970 tx=0x7f7a5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.141+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54019070 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.141+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a5400cb40 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.141+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5c19fe00 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.141+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54007650 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.141+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a5c1a0330 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.142+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5c0fdd70 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.143+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f7a5401c070 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.143+0000 7f7a537fe640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 0x7f7a480a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.144+0000 7f7a621ca640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 0x7f7a480a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.144+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f7a540cd690 con 0x7f7a5c1078c0 2024-09-15T22:38:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.144+0000 7f7a621ca640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 0x7f7a480a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a580314e0 tx=0x7f7a58000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.152+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a5409b4b0 con 0x7f7a5c1078c0 2024-09-15T22:38:15.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:15.339+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7a5c062630 con 0x7f7a480a3260 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:38:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:38:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:15.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:15.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:17.030 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:38:17.031 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:38:17.031 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:17.031 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] boot 2024-09-15T22:38:17.031 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:38:17.031 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:38:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:38:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] boot 2024-09-15T22:38:17.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:38:17.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:17.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:38:17.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:38:17.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:17.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: osd.2 [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] boot 2024-09-15T22:38:17.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:38:17.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:38:18.044 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]: dispatch 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]': finished 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:38:18.045 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:18.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:18.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]: dispatch 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]': finished 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:38:18.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:18.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]: dispatch 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3457710080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "859cfec4-c8ab-405c-85a5-27dd929dfed7"}]': finished 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: osdmap e20: 4 total, 3 up, 4 in 2024-09-15T22:38:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:18.297 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[49990]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:18.297 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[49990]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:18.298 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[49990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:18.298 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[49990]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:18.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:18.805+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7a5400ccf0 con 0x7f7a5c1078c0 2024-09-15T22:38:19.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:19.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:19.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:19.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43754]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:19.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1824196305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:19.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:18 smithi087 ceph-mon[35290]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:38:19.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:18 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:19.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:18 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:19.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1824196305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:19.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:18 smithi184 ceph-mon[35203]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:38:19.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:18 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:19.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:18 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:19.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1824196305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:19.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:18 smithi066 ceph-mon[31185]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:38:19.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:18 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:19.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:18 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:19.199 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[50039]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:19.199 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[50039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:19.199 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[50039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:19.199 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 22:38:18 smithi066 sudo[50039]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:19.599 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:19.599 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:19.599 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:19.599 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 22:38:19 smithi087 sudo[43757]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:19.797 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43821]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:19.798 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43821]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:19.798 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:19.798 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43821]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:19.798 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43824]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:20.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:19 smithi087 ceph-mon[35290]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:20.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:19 smithi087 ceph-mon[35290]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:38:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:20.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:19 smithi184 ceph-mon[35203]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:20.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:19 smithi184 ceph-mon[35203]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:38:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:20.173 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43824]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:20.173 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:20.173 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 22:38:19 smithi184 sudo[43824]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:20.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:19 smithi066 ceph-mon[31185]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:20.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:19 smithi066 ceph-mon[31185]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:38:20.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:20.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:20.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:20.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:20.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50415]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:21.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50606]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:21.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:21.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:21.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:20 smithi066 sudo[50606]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:21.225 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:20 smithi184 sudo[43827]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:21.225 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:20 smithi184 sudo[43827]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:21.225 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:20 smithi184 sudo[43827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:21.225 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:20 smithi184 sudo[43827]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:21.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 sudo[43830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:21.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 sudo[43830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:21.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 sudo[43830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:21.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 sudo[43830]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:21.726 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43760]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:38:21.726 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:21.726 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:21.726 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43760]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:22.036 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.037 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43763]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43763]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 sudo[43763]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:22.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:22 smithi066 ceph-mon[31185]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:23.052 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:23.053 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:23.053 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:22 smithi087 ceph-mon[35290]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:23.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:38:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:22 smithi184 ceph-mon[35203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:38:24.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:23 smithi087 ceph-mon[35290]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:24.169 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:23 smithi066 ceph-mon[31185]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:24.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:23 smithi184 ceph-mon[35203]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:25.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:25 smithi066 ceph-mon[31185]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:26.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:25 smithi087 ceph-mon[35290]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:26.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:25 smithi184 ceph-mon[35203]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:26.899 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:38:26.900 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:26 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:26.900 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:26 smithi066 ceph-mon[31185]: Deploying daemon osd.3 on smithi066 2024-09-15T22:38:27.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:38:27.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:26 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:27.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:26 smithi087 ceph-mon[35290]: Deploying daemon osd.3 on smithi066 2024-09-15T22:38:27.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:38:27.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:26 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:27.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:26 smithi184 ceph-mon[35203]: Deploying daemon osd.3 on smithi066 2024-09-15T22:38:28.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:27 smithi087 ceph-mon[35290]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:28.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:27 smithi184 ceph-mon[35203]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:27 smithi066 ceph-mon[31185]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:29.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:29 smithi066 ceph-mon[31185]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:29 smithi087 ceph-mon[35290]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:29 smithi184 ceph-mon[35203]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:31.887 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:31 smithi066 ceph-mon[31185]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:31 smithi087 ceph-mon[35290]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:31 smithi184 ceph-mon[35203]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:32.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:32.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:32.889 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:34.399 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:34 smithi066 ceph-mon[31185]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:34.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:34 smithi184 ceph-mon[35203]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:34.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:34 smithi087 ceph-mon[35290]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:35.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.885+0000 7f7a537fe640 1 -- 172.21.15.66:0/1547664034 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a5c062630 con 0x7f7a480a3260 2024-09-15T22:38:35.887 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 3 on host 'smithi066' 2024-09-15T22:38:35.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 msgr2=0x7f7a480a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:35.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 0x7f7a480a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a580314e0 tx=0x7f7a58000bc0 comp rx=0 tx=0).stop 2024-09-15T22:38:35.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 msgr2=0x7f7a5c19f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400b970 tx=0x7f7a5400be30 comp rx=0 tx=0).stop 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 shutdown_connections 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a5c1078c0 0x7f7a5c19f4a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a480a3260 0x7f7a480a5720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a5c104f90 0x7f7a5c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 --2- 172.21.15.66:0/1547664034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c102660 0x7f7a5c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 >> 172.21.15.66:0/1547664034 conn(0x7f7a5c0fc280 msgr2=0x7f7a5c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 shutdown_connections 2024-09-15T22:38:35.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:38:35.888+0000 7f7a6442e640 1 -- 172.21.15.66:0/1547664034 wait complete. 2024-09-15T22:38:36.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:36.495 DEBUG:teuthology.orchestra.run.smithi066:osd.3> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T22:38:36.498 INFO:tasks.cephadm:Deploying osd.4 on smithi087 with /dev/vg_nvme/lv_3... 2024-09-15T22:38:36.498 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:38:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:38:38.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:37 smithi087 ceph-mon[35290]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:38.261 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:37 smithi066 ceph-mon[31185]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:38.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:37 smithi184 ceph-mon[35203]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:38.699 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 22:38:38 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T22:38:38.412+0000 7f87272bb640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:38:39.089 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:38 smithi066 ceph-mon[31185]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:38:39.203 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:38 smithi087 ceph-mon[35290]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:38:39.207 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:38:39.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_3 2024-09-15T22:38:39.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:38 smithi184 ceph-mon[35203]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:38:39.490 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:38:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 -- 172.21.15.87:0/167384268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8101c00 msgr2=0x7f6dd8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:39.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/167384268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8101c00 0x7f6dd8102000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009900 tx=0x7f6dc802a410 comp rx=0 tx=0).stop 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 -- 172.21.15.87:0/167384268 shutdown_connections 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/167384268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd81037c0 0x7f6dd810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/167384268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd8102e00 0x7f6dd8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/167384268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8101c00 0x7f6dd8102000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 -- 172.21.15.87:0/167384268 >> 172.21.15.87:0/167384268 conn(0x7f6dd80fd390 msgr2=0x7f6dd80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 -- 172.21.15.87:0/167384268 shutdown_connections 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.931+0000 7f6ddd81c640 1 -- 172.21.15.87:0/167384268 wait complete. 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 Processor -- start 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 -- start start 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd8101c00 0x7f6dd8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd81037c0 0x7f6dd819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd810d860 con 0x7f6dd81037c0 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd810d6e0 con 0x7f6dd8102e00 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.932+0000 7f6ddd81c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd810d9e0 con 0x7f6dd8101c00 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38804/0 (socket says 172.21.15.87:38804) 2024-09-15T22:38:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 -- 172.21.15.87:0/1829687716 learned_addr learned my addr 172.21.15.87:0/1829687716 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd6ffd640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd8101c00 0x7f6dd8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd77fe640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd81037c0 0x7f6dd819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 -- 172.21.15.87:0/1829687716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd8101c00 msgr2=0x7f6dd8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd8101c00 0x7f6dd8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 -- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd81037c0 msgr2=0x7f6dd819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd81037c0 0x7f6dd819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 -- 172.21.15.87:0/1829687716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd819fa50 con 0x7f6dd8102e00 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6dd67fc640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c920 tx=0x7f6dcc00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc007c70 con 0x7f6dd8102e00 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dcc007e10 con 0x7f6dd8102e00 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd819fd40 con 0x7f6dd8102e00 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.933+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc018890 con 0x7f6dd8102e00 2024-09-15T22:38:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.934+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81a0220 con 0x7f6dd8102e00 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.935+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd8108f30 con 0x7f6dd8102e00 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.937+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6dcc018a30 con 0x7f6dd8102e00 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.937+0000 7f6ddc81a640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 0x7f6dc00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.937+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7f6dcc0ce8c0 con 0x7f6dd8102e00 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.938+0000 7f6dd6ffd640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 0x7f6dc00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.938+0000 7f6dd6ffd640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 0x7f6dc00a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005ab0 tx=0x7f6dc8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:38:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:39.941+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dcc014030 con 0x7f6dd8102e00 2024-09-15T22:38:40.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:40.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:38:40.122+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6dd8062630 con 0x7f6dc00a3270 2024-09-15T22:38:40.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:40.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:38:40.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:38:40.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:40.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:38:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:38:40.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:40.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:38:40.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:40.949 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T22:38:40.661+0000 7f872323e640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:38:40.949 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T22:38:40.666+0000 7f871b05e640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:38:41.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi066 2024-09-15T22:38:41.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-15T22:38:41.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:38:41.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:38:41.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] boot 2024-09-15T22:38:41.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:38:41.102 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:40 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi066 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] boot 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:38:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:40 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi066 2024-09-15T22:38:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-15T22:38:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:38:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809]' entity='osd.3' 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: osd.3 [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] boot 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:38:41.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:40 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:38:42.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:41 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:38:42.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:41 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:38:42.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:41 smithi087 ceph-mon[35290]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:42.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:41 smithi087 ceph-mon[35290]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:38:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:41 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:38:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:41 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:38:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:41 smithi184 ceph-mon[35203]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:41 smithi184 ceph-mon[35203]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:38:42.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:41 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:38:42.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:41 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:38:42.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:41 smithi066 ceph-mon[31185]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:38:42.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:41 smithi066 ceph-mon[31185]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:38:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:42 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/66560953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:42 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:42 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]': finished 2024-09-15T22:38:43.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:42 smithi087 ceph-mon[35290]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:38:43.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:42 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/66560953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:42 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:42 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]': finished 2024-09-15T22:38:43.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:42 smithi184 ceph-mon[35203]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:38:43.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:42 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/66560953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:42 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]: dispatch 2024-09-15T22:38:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:42 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac9282dd-6aa5-4a6f-923c-0d33cd51247b"}]': finished 2024-09-15T22:38:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:42 smithi066 ceph-mon[31185]: osdmap e26: 5 total, 4 up, 5 in 2024-09-15T22:38:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:43 smithi087 ceph-mon[35290]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:43 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/1708689566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:43 smithi087 ceph-mon[35290]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:38:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:43 smithi184 ceph-mon[35203]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:43 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/1708689566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:43 smithi184 ceph-mon[35203]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:38:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:43 smithi066 ceph-mon[31185]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 521 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:43 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/1708689566' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:38:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:43 smithi066 ceph-mon[31185]: osdmap e27: 5 total, 4 up, 5 in 2024-09-15T22:38:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:46.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:45 smithi087 ceph-mon[35290]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:46.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:45 smithi087 ceph-mon[35290]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:38:46.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:45 smithi184 ceph-mon[35203]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:45 smithi184 ceph-mon[35203]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:38:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:45 smithi066 ceph-mon[31185]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:45 smithi066 ceph-mon[31185]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:38:46.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:38:47.973 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:47 smithi087 ceph-mon[35290]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:47 smithi184 ceph-mon[35203]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:48.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:47 smithi066 ceph-mon[31185]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:38:50.065 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:49 smithi087 ceph-mon[35290]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:38:50.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:49 smithi184 ceph-mon[35203]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:38:50.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:49 smithi066 ceph-mon[31185]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:38:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:51 smithi087 ceph-mon[35290]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:38:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:38:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:51 smithi087 ceph-mon[35290]: Deploying daemon osd.4 on smithi087 2024-09-15T22:38:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:51 smithi184 ceph-mon[35203]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:38:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:38:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:51 smithi184 ceph-mon[35203]: Deploying daemon osd.4 on smithi087 2024-09-15T22:38:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:51 smithi066 ceph-mon[31185]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:38:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:38:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:38:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:51 smithi066 ceph-mon[31185]: Deploying daemon osd.4 on smithi087 2024-09-15T22:38:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:53 smithi087 ceph-mon[35290]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:38:54.001 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:53 smithi066 ceph-mon[31185]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:38:54.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:53 smithi184 ceph-mon[35203]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T22:38:55.839 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:55 smithi087 ceph-mon[35290]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:38:56.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:55 smithi184 ceph-mon[35203]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:38:56.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:55 smithi066 ceph-mon[31185]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:38:57.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:57 smithi087 ceph-mon[35290]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:38:57.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:57.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:57.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:57 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:57 smithi184 ceph-mon[35203]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:38:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:57 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:57 smithi066 ceph-mon[31185]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T22:38:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:38:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:38:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:57 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:00.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:38:59 smithi087 ceph-mon[35290]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:00.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:38:59 smithi184 ceph-mon[35203]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:00.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:38:59 smithi066 ceph-mon[31185]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:01.153 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.154 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.154 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:01.154 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:01.154 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:00 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:00 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.191+0000 7f6ddc81a640 1 -- 172.21.15.87:0/1829687716 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6dd8062630 con 0x7f6dc00a3270 2024-09-15T22:39:01.194 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 4 on host 'smithi087' 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 msgr2=0x7f6dc00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 0x7f6dc00a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005ab0 tx=0x7f6dc8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 msgr2=0x7f6dd8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c920 tx=0x7f6dcc00cde0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 shutdown_connections 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd81037c0 0x7f6dd819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dc00a3270 0x7f6dc00a5730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dd8102e00 0x7f6dd8198360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 --2- 172.21.15.87:0/1829687716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd8101c00 0x7f6dd8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:01.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 >> 172.21.15.87:0/1829687716 conn(0x7f6dd80fd390 msgr2=0x7f6dd8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:01.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 shutdown_connections 2024-09-15T22:39:01.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:01.193+0000 7f6ddd81c640 1 -- 172.21.15.87:0/1829687716 wait complete. 2024-09-15T22:39:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:00 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:01.834 DEBUG:teuthology.orchestra.run.smithi087:osd.4> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T22:39:01.836 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_3... 2024-09-15T22:39:01.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:39:02.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:01 smithi087 ceph-mon[35290]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:02.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:02.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:02.066 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:02.091 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:39:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:01 smithi184 ceph-mon[35203]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:02.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:01 smithi066 ceph-mon[31185]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:02.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:02.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:02.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:03.208 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 22:39:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T22:39:02.954+0000 7fbf31762640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:39:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:03 smithi184 ceph-mon[35203]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:03 smithi184 ceph-mon[35203]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:03 smithi184 ceph-mon[35203]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:03 smithi066 ceph-mon[31185]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:03 smithi066 ceph-mon[31185]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:03 smithi066 ceph-mon[31185]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:03 smithi087 ceph-mon[35290]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:03 smithi087 ceph-mon[35290]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:03 smithi087 ceph-mon[35290]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:39:04.478 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:39:04.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-09-15T22:39:04.771 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:39:05.044 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:05.045 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:39:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:39:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:39:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:39:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:05.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:05.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 -- 172.21.15.184:0/2539246359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 msgr2=0x7fe7cc109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:05.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/2539246359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc109d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009ca0 tx=0x7fe7c402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 -- 172.21.15.184:0/2539246359 shutdown_connections 2024-09-15T22:39:05.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/2539246359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc109d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/2539246359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/2539246359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 0x7fe7cc104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.221+0000 7fe7d37e9640 1 -- 172.21.15.184:0/2539246359 >> 172.21.15.184:0/2539246359 conn(0x7fe7cc0fc280 msgr2=0x7fe7cc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- 172.21.15.184:0/2539246359 shutdown_connections 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- 172.21.15.184:0/2539246359 wait complete. 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 Processor -- start 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- start start 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 0x7fe7cc101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc10d880 con 0x7fe7cc102660 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc10d700 con 0x7fe7cc104f90 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d37e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc10da00 con 0x7fe7cc1078c0 2024-09-15T22:39:05.241 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d1d86640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d1d86640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39242/0 (socket says 172.21.15.184:39242) 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.222+0000 7fe7d1d86640 1 -- 172.21.15.184:0/4204652831 learned_addr learned my addr 172.21.15.184:0/4204652831 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d0d84640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1585640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 0x7fe7cc101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 -- 172.21.15.184:0/4204652831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 msgr2=0x7fe7cc100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 -- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 msgr2=0x7fe7cc101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 0x7fe7cc101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 -- 172.21.15.184:0/4204652831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7cc101410 con 0x7fe7cc1078c0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d0d84640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d1d86640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4031ae0 tx=0x7fe7c4031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4003b70 con 0x7fe7cc1078c0 2024-09-15T22:39:05.242 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7cc1a2000 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7c4003d10 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c402fc40 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.223+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7cc1a2510 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.224+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7cc0fdd70 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.226+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe7c4004050 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.226+0000 7fe7c27fc640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 0x7fe7b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.226+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fe7c40efa10 con 0x7fe7cc1078c0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.226+0000 7fe7d1585640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 0x7fe7b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.227+0000 7fe7d1585640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 0x7fe7b80a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009bd0 tx=0x7fe7bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:05.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.234+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7c40bd8c0 con 0x7fe7cc1078c0 2024-09-15T22:39:05.413 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:05.411+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe7cc062630 con 0x7fe7b80a3240 2024-09-15T22:39:05.852 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T22:39:05.593+0000 7fbf2d6e5640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:39:05.852 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T22:39:05.598+0000 7fbf25505640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi087 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:06.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:06.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:06.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:05 smithi184 ceph-mon[35203]: from='osd.4 ' entity='osd.4' 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi087 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:06.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:05 smithi066 ceph-mon[31185]: from='osd.4 ' entity='osd.4' 2024-09-15T22:39:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi087 2024-09-15T22:39:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-15T22:39:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:05 smithi087 ceph-mon[35290]: from='osd.4 ' entity='osd.4' 2024-09-15T22:39:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] boot 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:39:07.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:06 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] boot 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:39:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:06 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:39:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:39:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:07.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: osd.4 [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] boot 2024-09-15T22:39:07.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:39:07.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:06 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:39:08.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:08.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/1338144165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]': finished 2024-09-15T22:39:08.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:39:08.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:08.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:08.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/1338144165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]': finished 2024-09-15T22:39:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:39:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:08.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:39:08.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/1338144165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]: dispatch 2024-09-15T22:39:08.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d89019ce-9967-40f3-9e23-c8f6a843d797"}]': finished 2024-09-15T22:39:08.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:39:08.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:08 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/549834993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:08 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/549834993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:08 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/549834993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:10.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:09 smithi066 ceph-mon[31185]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:10.250 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:09 smithi087 ceph-mon[35290]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:09 smithi184 ceph-mon[35203]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:12.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:11 smithi066 ceph-mon[31185]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:12.215 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:11 smithi184 ceph-mon[35203]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:12.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:11 smithi087 ceph-mon[35290]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:14.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:13 smithi066 ceph-mon[31185]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:14.317 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:13 smithi184 ceph-mon[35203]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:14.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:13 smithi087 ceph-mon[35290]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:16.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:15 smithi184 ceph-mon[35203]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:16.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:39:16.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:16.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:15 smithi066 ceph-mon[31185]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:16.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:39:16.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:15 smithi087 ceph-mon[35290]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:39:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:17.192 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:16 smithi184 ceph-mon[35203]: Deploying daemon osd.5 on smithi184 2024-09-15T22:39:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:16 smithi066 ceph-mon[31185]: Deploying daemon osd.5 on smithi184 2024-09-15T22:39:17.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:16 smithi087 ceph-mon[35290]: Deploying daemon osd.5 on smithi184 2024-09-15T22:39:18.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:17 smithi184 ceph-mon[35203]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:18.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:17 smithi066 ceph-mon[31185]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:18.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:17 smithi087 ceph-mon[35290]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:20.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:19 smithi066 ceph-mon[31185]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:19 smithi087 ceph-mon[35290]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:19 smithi184 ceph-mon[35203]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:21 smithi184 ceph-mon[35203]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:22.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:21 smithi066 ceph-mon[31185]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:21 smithi087 ceph-mon[35290]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:23.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:23.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:23.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:24.257 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:24 smithi184 ceph-mon[35203]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:24 smithi087 ceph-mon[35290]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:24.384 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:24 smithi066 ceph-mon[31185]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:25.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.423+0000 7fe7c27fc640 1 -- 172.21.15.184:0/4204652831 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe7cc062630 con 0x7fe7b80a3240 2024-09-15T22:39:25.425 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 msgr2=0x7fe7b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 0x7fe7b80a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009bd0 tx=0x7fe7bc005f90 comp rx=0 tx=0).stop 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 msgr2=0x7fe7cc100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4031ae0 tx=0x7fe7c4031ee0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 shutdown_connections 2024-09-15T22:39:25.427 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7cc1078c0 0x7fe7cc100b50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe7b80a3240 0x7fe7b80a5700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7cc104f90 0x7fe7cc100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 --2- 172.21.15.184:0/4204652831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc102660 0x7fe7cc101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 >> 172.21.15.184:0/4204652831 conn(0x7fe7cc0fc280 msgr2=0x7fe7cc102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 shutdown_connections 2024-09-15T22:39:25.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:39:25.425+0000 7fe7d37e9640 1 -- 172.21.15.184:0/4204652831 wait complete. 2024-09-15T22:39:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:25.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:25.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:25.993 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T22:39:25.995 INFO:tasks.cephadm:Deploying osd.6 on smithi066 with /dev/vg_nvme/lv_2... 2024-09-15T22:39:25.995 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:39:26.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:26.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:26.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:26.252 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:39:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:27 smithi184 ceph-mon[35203]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:27.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:27 smithi066 ceph-mon[31185]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:28.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:27 smithi087 ceph-mon[35290]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:28.423 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 22:39:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T22:39:28.080+0000 7f69c32f7640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:39:28.855 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:28 smithi184 ceph-mon[35203]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:28.855 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:28 smithi184 ceph-mon[35203]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:28.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:28 smithi066 ceph-mon[31185]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:28.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:28 smithi066 ceph-mon[31185]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:29.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:28 smithi087 ceph-mon[35290]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:29.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:28 smithi087 ceph-mon[35290]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:39:29.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:39:29.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-09-15T22:39:29.401 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:39:29.800 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:29.800 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi184 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.801 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:29.802 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:29.802 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 -- 172.21.15.66:0/1587223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc10e1e0 msgr2=0x7fe0dc1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/1587223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1105d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009ca0 tx=0x7fe0d402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 -- 172.21.15.66:0/1587223344 shutdown_connections 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/1587223344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1105d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/1587223344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc074c50 0x7fe0dc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/1587223344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 0x7fe0dc074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 -- 172.21.15.66:0/1587223344 >> 172.21.15.66:0/1587223344 conn(0x7fe0dc0fd390 msgr2=0x7fe0dc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.885+0000 7fe0e40b7640 1 -- 172.21.15.66:0/1587223344 shutdown_connections 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 -- 172.21.15.66:0/1587223344 wait complete. 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 Processor -- start 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 -- start start 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 0x7fe0dc19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc113ea0 con 0x7fe0dc074c50 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc113d20 con 0x7fe0dc10e1e0 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e40b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc114020 con 0x7fe0dc076220 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e1e53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e1e53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52020/0 (socket says 172.21.15.66:52020) 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e1e53640 1 -- 172.21.15.66:0/940920315 learned_addr learned my addr 172.21.15.66:0/940920315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.886+0000 7fe0e1652640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 0x7fe0dc19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e2654640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 -- 172.21.15.66:0/940920315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 msgr2=0x7fe0dc19ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 0x7fe0dc19ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 -- 172.21.15.66:0/940920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 msgr2=0x7fe0dc1a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 -- 172.21.15.66:0/940920315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1a6110 con 0x7fe0dc074c50 2024-09-15T22:39:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e2654640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:39:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e1e53640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c970 tx=0x7fe0d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8007bb0 con 0x7fe0dc074c50 2024-09-15T22:39:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0d8007d50 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1a6400 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800f450 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.887+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a6990 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.888+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc104290 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.889+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe0d80046c0 con 0x7fe0dc074c50 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.890+0000 7fe0d2ffd640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 0x7fe0c80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.890+0000 7fe0e1652640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 0x7fe0c80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.890+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7fe0d80ce500 con 0x7fe0dc074c50 2024-09-15T22:39:29.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.890+0000 7fe0e1652640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 0x7fe0c80a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc19fa00 tx=0x7fe0cc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:29.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:29.895+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0d8014030 con 0x7fe0dc074c50 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi184 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:30.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:30.081+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe0dc062630 con 0x7fe0c80a32f0 2024-09-15T22:39:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:39:30.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi184 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 8544M 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:30.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:30.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:30.649 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T22:39:30.314+0000 7f69bfa8e640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:39:30.649 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T22:39:30.320+0000 7f69b709a640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:39:30.762 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:39:30.762 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:39:30.762 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:30.763 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:30 smithi066 ceph-mon[31185]: from='osd.5 ' entity='osd.5' 2024-09-15T22:39:30.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:39:30.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:39:30.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:30.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:30.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:30.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:30.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:30.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:30.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:30 smithi184 ceph-mon[35203]: from='osd.5 ' entity='osd.5' 2024-09-15T22:39:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:39:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:39:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:30 smithi087 ceph-mon[35290]: from='osd.5 ' entity='osd.5' 2024-09-15T22:39:31.826 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:39:31.826 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:39:31.826 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:31.827 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:31.827 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] boot 2024-09-15T22:39:31.827 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:39:31.827 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:31 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:31.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:39:31.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:39:31.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:31.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:31.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] boot 2024-09-15T22:39:31.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:39:31.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:31 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:39:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:39:32.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:39:32.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:32.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: osd.5 [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] boot 2024-09-15T22:39:32.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: osdmap e35: 6 total, 6 up, 6 in 2024-09-15T22:39:32.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:31 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:39:32.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:32 smithi184 ceph-mon[35203]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:39:32.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:32 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]: dispatch 2024-09-15T22:39:32.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:32 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]': finished 2024-09-15T22:39:32.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:32 smithi184 ceph-mon[35203]: osdmap e37: 7 total, 6 up, 7 in 2024-09-15T22:39:32.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:32.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:32 smithi066 ceph-mon[31185]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:39:32.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]: dispatch 2024-09-15T22:39:32.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]': finished 2024-09-15T22:39:32.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:32 smithi066 ceph-mon[31185]: osdmap e37: 7 total, 6 up, 7 in 2024-09-15T22:39:32.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:32 smithi087 ceph-mon[35290]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:39:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:32 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]: dispatch 2024-09-15T22:39:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:32 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3487020670' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acfbea05-26e8-46d7-a898-765aac29e742"}]': finished 2024-09-15T22:39:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:32 smithi087 ceph-mon[35290]: osdmap e37: 7 total, 6 up, 7 in 2024-09-15T22:39:33.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:33.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:33 smithi184 ceph-mon[35203]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:33.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1752382656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:33.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:33 smithi184 ceph-mon[35203]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:39:33.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:33 smithi066 ceph-mon[31185]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:33 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1752382656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:33 smithi066 ceph-mon[31185]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:39:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:33 smithi087 ceph-mon[35290]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:33 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1752382656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:33 smithi087 ceph-mon[35290]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:39:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:35 smithi087 ceph-mon[35290]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:35 smithi087 ceph-mon[35290]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:39:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:35 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:35.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:35 smithi184 ceph-mon[35203]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:35.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:35 smithi184 ceph-mon[35203]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:39:35.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:35 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:35.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:35 smithi066 ceph-mon[31185]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:35.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:35 smithi066 ceph-mon[31185]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:39:35.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:35 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:37.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:37 smithi066 ceph-mon[31185]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:37.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:37 smithi087 ceph-mon[35290]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:37.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:37 smithi184 ceph-mon[35203]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:39.681 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:39 smithi066 ceph-mon[31185]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:39:39.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:39 smithi087 ceph-mon[35290]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:39:39.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:39 smithi184 ceph-mon[35203]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:39:41.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:41 smithi066 ceph-mon[31185]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:39:41.776 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:41 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:39:41.776 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:41 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:41.776 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:41 smithi066 ceph-mon[31185]: Deploying daemon osd.6 on smithi066 2024-09-15T22:39:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:41 smithi087 ceph-mon[35290]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:39:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:41 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:39:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:41 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:41 smithi087 ceph-mon[35290]: Deploying daemon osd.6 on smithi066 2024-09-15T22:39:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:41 smithi184 ceph-mon[35203]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-15T22:39:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:41 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:39:41.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:41 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:41.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:41 smithi184 ceph-mon[35203]: Deploying daemon osd.6 on smithi066 2024-09-15T22:39:43.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:43 smithi066 ceph-mon[31185]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-15T22:39:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:43 smithi087 ceph-mon[35290]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-15T22:39:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:43 smithi184 ceph-mon[35203]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-15T22:39:45.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:45 smithi087 ceph-mon[35290]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:39:45.863 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:45 smithi066 ceph-mon[31185]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:39:45.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:45 smithi184 ceph-mon[35203]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:39:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:47 smithi087 ceph-mon[35290]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:39:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:47.854 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:47 smithi066 ceph-mon[31185]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:39:47.854 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:47.854 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:47.854 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:47 smithi184 ceph-mon[35203]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T22:39:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:49 smithi066 ceph-mon[31185]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:49.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:49 smithi087 ceph-mon[35290]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:49.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:49 smithi184 ceph-mon[35203]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:39:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.850+0000 7fe0d2ffd640 1 -- 172.21.15.66:0/940920315 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe0dc062630 con 0x7fe0c80a32f0 2024-09-15T22:39:50.853 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 6 on host 'smithi066' 2024-09-15T22:39:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 msgr2=0x7fe0c80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 0x7fe0c80a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc19fa00 tx=0x7fe0cc00b410 comp rx=0 tx=0).stop 2024-09-15T22:39:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 msgr2=0x7fe0dc19e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c970 tx=0x7fe0d800ce30 comp rx=0 tx=0).stop 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 shutdown_connections 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe0c80a32f0 0x7fe0c80a57b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0dc10e1e0 0x7fe0dc1a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0dc076220 0x7fe0dc19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 --2- 172.21.15.66:0/940920315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0dc074c50 0x7fe0dc19e4e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 >> 172.21.15.66:0/940920315 conn(0x7fe0dc0fd390 msgr2=0x7fe0dc101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 shutdown_connections 2024-09-15T22:39:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:39:50.853+0000 7fe0e40b7640 1 -- 172.21.15.66:0/940920315 wait complete. 2024-09-15T22:39:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:51.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:51.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:51.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.566 DEBUG:teuthology.orchestra.run.smithi066:osd.6> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T22:39:51.568 INFO:tasks.cephadm:Deploying osd.7 on smithi087 with /dev/vg_nvme/lv_2... 2024-09-15T22:39:51.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:39:51.822 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:39:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:51 smithi087 ceph-mon[35290]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:51 smithi184 ceph-mon[35203]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:52.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:51 smithi066 ceph-mon[31185]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:52.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:39:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:52.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:52.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 22:39:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T22:39:52.891+0000 7f928fbc7640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:39:54.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:53 smithi066 ceph-mon[31185]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:54.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:53 smithi066 ceph-mon[31185]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:39:54.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:53 smithi087 ceph-mon[35290]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:54.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:53 smithi087 ceph-mon[35290]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:39:54.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:53 smithi184 ceph-mon[35203]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:54.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:53 smithi184 ceph-mon[35203]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:39:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:39:54.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_2 2024-09-15T22:39:54.717 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:54.845 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.013 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:55.014 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:39:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:39:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 -- 172.21.15.87:0/668155876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c1026a0 msgr2=0x7f2f9c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 --2- 172.21.15.87:0/668155876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c104a90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009900 tx=0x7f2f9802a410 comp rx=0 tx=0).stop 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 -- 172.21.15.87:0/668155876 shutdown_connections 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 --2- 172.21.15.87:0/668155876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c107900 0x7f2f9c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 --2- 172.21.15.87:0/668155876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 0x7f2f9c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 --2- 172.21.15.87:0/668155876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c104a90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.223+0000 7f2fa4646640 1 -- 172.21.15.87:0/668155876 >> 172.21.15.87:0/668155876 conn(0x7f2f9c0fc280 msgr2=0x7f2f9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.224+0000 7f2fa4646640 1 -- 172.21.15.87:0/668155876 shutdown_connections 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.224+0000 7f2fa4646640 1 -- 172.21.15.87:0/668155876 wait complete. 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.224+0000 7f2fa4646640 1 Processor -- start 2024-09-15T22:39:55.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.224+0000 7f2fa4646640 1 -- start start 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 0x7f2f9c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10d860 con 0x7f2f9c1026a0 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10d6e0 con 0x7f2f9c107900 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c10d9e0 con 0x7f2f9c104fd0 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34078/0 (socket says 172.21.15.87:34078) 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa23e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 -- 172.21.15.87:0/870657413 learned_addr learned my addr 172.21.15.87:0/870657413 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa1be1640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 0x7f2f9c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:55.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 -- 172.21.15.87:0/870657413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 msgr2=0x7f2f9c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 0x7f2f9c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 -- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c1026a0 msgr2=0x7f2f9c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 -- 172.21.15.87:0/870657413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c19fba0 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa2be3640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94017070 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f94003e50 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c19fe90 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940106c0 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.225+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c1a02f0 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.227+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9c0fdd70 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.228+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2f94003970 con 0x7f2f9c107900 2024-09-15T22:39:55.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.228+0000 7f2f937fe640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 0x7f2f880a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:39:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.229+0000 7f2fa23e2640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 0x7f2f880a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:39:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.229+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7f2f940ce790 con 0x7f2f9c107900 2024-09-15T22:39:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.229+0000 7f2fa23e2640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 0x7f2f880a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f980314e0 tx=0x7f2f98000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:39:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.233+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f9409bc90 con 0x7f2f9c107900 2024-09-15T22:39:55.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:39:55.414+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2f9c062630 con 0x7f2f880a3270 2024-09-15T22:39:55.846 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T22:39:55.527+0000 7f928bb4a640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:39:55.846 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T22:39:55.534+0000 7f928396a640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:39:55.973 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:55.973 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi066 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:55.974 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:55 smithi087 ceph-mon[35290]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' 2024-09-15T22:39:56.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi066 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:56.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:55 smithi184 ceph-mon[35203]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi066 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:39:56.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:55 smithi066 ceph-mon[31185]: from='osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651]' entity='osd.6' 2024-09-15T22:39:57.131 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] boot 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:39:57.132 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:39:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:39:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] boot 2024-09-15T22:39:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:39:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: osd.6 [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] boot 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: osdmap e42: 7 total, 7 up, 7 in 2024-09-15T22:39:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:39:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:57 smithi087 ceph-mon[35290]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:57 smithi184 ceph-mon[35203]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:58.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:57 smithi066 ceph-mon[31185]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:39:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/2307703565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]': finished 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:39:59.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/1102115625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/2307703565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]': finished 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:39:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/1102115625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:39:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:39:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/2307703565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]: dispatch 2024-09-15T22:39:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7"}]': finished 2024-09-15T22:39:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: osdmap e44: 8 total, 7 up, 8 in 2024-09-15T22:39:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:39:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/1102115625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:39:59 smithi087 ceph-mon[35290]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:39:59 smithi184 ceph-mon[35203]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:39:59 smithi066 ceph-mon[31185]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:00 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T22:40:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:00 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T22:40:01.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:00 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T22:40:02.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:01 smithi087 ceph-mon[35290]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:01 smithi184 ceph-mon[35203]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:02.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:01 smithi066 ceph-mon[31185]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:04.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:03 smithi087 ceph-mon[35290]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:03 smithi184 ceph-mon[35203]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:04.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:03 smithi066 ceph-mon[31185]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:05 smithi087 ceph-mon[35290]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:06.363 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:05 smithi066 ceph-mon[31185]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:05 smithi184 ceph-mon[35203]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:07.133 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:06 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:40:07.133 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:06 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:06 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:40:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:06 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:06 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:40:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:06 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:08.205 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:07 smithi087 ceph-mon[35290]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:08.206 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:07 smithi087 ceph-mon[35290]: Deploying daemon osd.7 on smithi087 2024-09-15T22:40:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:07 smithi184 ceph-mon[35203]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:07 smithi184 ceph-mon[35203]: Deploying daemon osd.7 on smithi087 2024-09-15T22:40:08.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:07 smithi066 ceph-mon[31185]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:08.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:07 smithi066 ceph-mon[31185]: Deploying daemon osd.7 on smithi087 2024-09-15T22:40:10.150 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:09 smithi087 ceph-mon[35290]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:09 smithi184 ceph-mon[35203]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:10.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:09 smithi066 ceph-mon[31185]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:12.318 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:11 smithi087 ceph-mon[35290]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:12.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:11 smithi184 ceph-mon[35203]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:12.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:11 smithi066 ceph-mon[31185]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:14.253 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:14 smithi087 ceph-mon[35290]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:14.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:13 smithi184 ceph-mon[35203]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:14.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:13 smithi066 ceph-mon[31185]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:16.270 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:16.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:16.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:16.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.635+0000 7f2f937fe640 1 -- 172.21.15.87:0/870657413 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f9c062630 con 0x7f2f880a3270 2024-09-15T22:40:16.637 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 7 on host 'smithi087' 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 msgr2=0x7f2f880a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 0x7f2f880a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f980314e0 tx=0x7f2f98000bc0 comp rx=0 tx=0).stop 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 msgr2=0x7f2f9c19f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400b260 comp rx=0 tx=0).stop 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 shutdown_connections 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f880a3270 0x7f2f880a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9c107900 0x7f2f9c19f530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:16.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f9c104fd0 0x7f2f9c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:16.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 --2- 172.21.15.87:0/870657413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f9c1026a0 0x7f2f9c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:16.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.637+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 >> 172.21.15.87:0/870657413 conn(0x7f2f9c0fc280 msgr2=0x7f2f9c103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:16.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.638+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 shutdown_connections 2024-09-15T22:40:16.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:40:16.638+0000 7f2fa4646640 1 -- 172.21.15.87:0/870657413 wait complete. 2024-09-15T22:40:17.316 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:17.317 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.317 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:17 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.346 DEBUG:teuthology.orchestra.run.smithi087:osd.7> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T22:40:17.348 INFO:tasks.cephadm:Deploying osd.8 on smithi184 with /dev/vg_nvme/lv_2... 2024-09-15T22:40:17.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:40:17.376 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:17.377 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.377 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:17 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:17 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:17.606 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:40:18.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:18 smithi087 ceph-mon[35290]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:18.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:18 smithi184 ceph-mon[35203]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:18.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:18 smithi066 ceph-mon[31185]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:18.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 22:40:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T22:40:18.639+0000 7f4605099640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:40:19.339 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:19 smithi184 ceph-mon[35203]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:19.339 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:19 smithi184 ceph-mon[35203]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:19 smithi087 ceph-mon[35290]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:19 smithi087 ceph-mon[35290]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:19 smithi066 ceph-mon[31185]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:19 smithi066 ceph-mon[31185]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:40:20.053 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:40:20.079 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-09-15T22:40:20.257 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T22:40:20.031+0000 7f460101c640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:40:20.257 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T22:40:20.038+0000 7f45fce44640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.258 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:20 smithi087 ceph-mon[35290]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.372 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:40:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:40:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:40:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:20 smithi184 ceph-mon[35203]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: from='osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:20 smithi066 ceph-mon[31185]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/795530071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 msgr2=0x7f1f04107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/795530071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04107400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009900 tx=0x7f1ef402a410 comp rx=0 tx=0).stop 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/795530071 shutdown_connections 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/795530071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 0x7f1f04109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/795530071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04107400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/795530071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 0x7f1f04104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/795530071 >> 172.21.15.184:0/795530071 conn(0x7f1f040fc280 msgr2=0x7f1f040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:20.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/795530071 shutdown_connections 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/795530071 wait complete. 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 Processor -- start 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.861+0000 7f1f0b4a6640 1 -- start start 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 0x7f1f04198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 0x7f1f0419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:20.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0410d930 con 0x7f1f041026e0 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0410d7b0 con 0x7f1f04107940 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0410dab0 con 0x7f1f04105010 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:58770/0 (socket says 172.21.15.184:58770) 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 -- 172.21.15.184:0/1443559134 learned_addr learned my addr 172.21.15.184:0/1443559134 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f09a43640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 0x7f1f0419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f09242640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 0x7f1f04198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 -- 172.21.15.184:0/1443559134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 msgr2=0x7f1f0419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:20.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 0x7f1f0419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:20.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 -- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 msgr2=0x7f1f04198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:20.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 0x7f1f04198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:20.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 -- 172.21.15.184:0/1443559134 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0419fc80 con 0x7f1f04105010 2024-09-15T22:40:20.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f08a41640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4031610 tx=0x7f1ef40043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:20.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef403f030 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef4003ce0 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0419ff10 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.862+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4035070 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.863+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f041a03f0 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.864+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f040fdd70 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.865+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1ef4042030 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.865+0000 7f1efa7fc640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 0x7f1ef00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.865+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f1ef40ef480 con 0x7f1f04105010 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.866+0000 7f1f09242640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 0x7f1ef00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.866+0000 7f1f09242640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 0x7f1ef00a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009890 tx=0x7f1f00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:20.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:20.869+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ef40bce20 con 0x7f1f04105010 2024-09-15T22:40:21.049 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:21.047+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1f04062630 con 0x7f1ef00a32f0 2024-09-15T22:40:21.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:40:21.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:40:21.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] boot 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:40:21.050 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:21 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:21.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] boot 2024-09-15T22:40:21.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:40:21.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:21 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: osd.7 [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] boot 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: osdmap e47: 8 total, 8 up, 8 in 2024-09-15T22:40:21.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:21 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:40:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:40:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:40:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi087 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:22 smithi087 ceph-mon[35290]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi087 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:22.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:22.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:22.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:22 smithi184 ceph-mon[35203]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi087 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:22 smithi066 ceph-mon[31185]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:40:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:40:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/2156597294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]': finished 2024-09-15T22:40:24.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:40:24.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:24.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:24 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/597863037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/2156597294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]': finished 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:24 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/597863037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/2156597294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]: dispatch 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff2b15f-7378-4a0e-9c97-83b9d367c938"}]': finished 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: osdmap e50: 9 total, 8 up, 9 in 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/597863037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:25.537 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:25 smithi066 ceph-mon[31185]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:25.537 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:25 smithi066 ceph-mon[31185]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:40:25.537 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:25 smithi184 ceph-mon[35203]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:25 smithi184 ceph-mon[35203]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:40:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:25 smithi087 ceph-mon[35290]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:25 smithi087 ceph-mon[35290]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:40:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:27 smithi184 ceph-mon[35203]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:27 smithi066 ceph-mon[31185]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:27.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:27 smithi087 ceph-mon[35290]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:29 smithi184 ceph-mon[35203]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:29 smithi066 ceph-mon[31185]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:29.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:29 smithi087 ceph-mon[35290]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:31.543 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:31 smithi184 ceph-mon[35203]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:31 smithi066 ceph-mon[31185]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:31.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:31 smithi087 ceph-mon[35290]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:32.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:40:32.656 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:32.657 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:32 smithi184 ceph-mon[35203]: Deploying daemon osd.8 on smithi184 2024-09-15T22:40:32.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:40:32.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:32.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:32 smithi066 ceph-mon[31185]: Deploying daemon osd.8 on smithi184 2024-09-15T22:40:32.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:40:32.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:32.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:32 smithi087 ceph-mon[35290]: Deploying daemon osd.8 on smithi184 2024-09-15T22:40:33.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:33 smithi184 ceph-mon[35203]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:33.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:33 smithi066 ceph-mon[31185]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:33.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:33 smithi087 ceph-mon[35290]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:35.684 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:35 smithi184 ceph-mon[35203]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:35.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:35 smithi066 ceph-mon[31185]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:35 smithi087 ceph-mon[35290]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:37.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:37 smithi184 ceph-mon[35203]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:37.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:37 smithi066 ceph-mon[31185]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:37.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:37 smithi087 ceph-mon[35290]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:38.654 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:38.654 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:38.654 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:38.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:38.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:38.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:38.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:38.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:38.859 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:40.305 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:39 smithi184 ceph-mon[35203]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:39 smithi087 ceph-mon[35290]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:39 smithi066 ceph-mon[31185]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:41.376 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 8 on host 'smithi184' 2024-09-15T22:40:41.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.374+0000 7f1efa7fc640 1 -- 172.21.15.184:0/1443559134 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f04062630 con 0x7f1ef00a32f0 2024-09-15T22:40:41.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.377+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 msgr2=0x7f1ef00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:41.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.377+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 0x7f1ef00a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009890 tx=0x7f1f00008040 comp rx=0 tx=0).stop 2024-09-15T22:40:41.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 msgr2=0x7f1f04198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:41.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4031610 tx=0x7f1ef40043b0 comp rx=0 tx=0).stop 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 shutdown_connections 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1ef00a32f0 0x7f1ef00a57b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f04107940 0x7f1f0419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f04105010 0x7f1f04198590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 --2- 172.21.15.184:0/1443559134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f041026e0 0x7f1f04198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 >> 172.21.15.184:0/1443559134 conn(0x7f1f040fc280 msgr2=0x7f1f041031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 shutdown_connections 2024-09-15T22:40:41.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:40:41.378+0000 7f1f0b4a6640 1 -- 172.21.15.184:0/1443559134 wait complete. 2024-09-15T22:40:42.045 DEBUG:teuthology.orchestra.run.smithi184:osd.8> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T22:40:42.048 INFO:tasks.cephadm:Deploying osd.9 on smithi066 with /dev/vg_nvme/lv_1... 2024-09-15T22:40:42.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:40:42.317 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:40:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:41 smithi087 ceph-mon[35290]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:41 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:41 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:41 smithi184 ceph-mon[35203]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:41 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:41 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:42.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:41 smithi066 ceph-mon[31185]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:42.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:41 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:42.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:41 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.418 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.418 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:43 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:43 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:43 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:44.094 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 22:40:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T22:40:43.792+0000 7fd65d538640 -1 osd.8 0 log_to_monitors true 2024-09-15T22:40:44.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:44 smithi066 ceph-mon[31185]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:44.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:44 smithi066 ceph-mon[31185]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:44.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:44 smithi066 ceph-mon[31185]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:44.384 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:44 smithi087 ceph-mon[35290]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:44.385 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:44 smithi087 ceph-mon[35290]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:44.385 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:44 smithi087 ceph-mon[35290]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:44 smithi184 ceph-mon[35203]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:44 smithi184 ceph-mon[35203]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:44 smithi184 ceph-mon[35203]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:40:45.069 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:40:45.102 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_1 2024-09-15T22:40:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:40:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-mon[35203]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:40:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-mon[35203]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:40:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-mon[35203]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-mon[35203]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.423 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T22:40:45.140+0000 7fd6594bb640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T22:40:45.423 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 22:40:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T22:40:45.151+0000 7fd6552e3640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:40:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:45 smithi066 ceph-mon[31185]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:40:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:45 smithi066 ceph-mon[31185]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:40:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:45 smithi066 ceph-mon[31185]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:45 smithi066 ceph-mon[31185]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:45 smithi087 ceph-mon[35290]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:40:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:45 smithi087 ceph-mon[35290]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:40:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:45 smithi087 ceph-mon[35290]: from='osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:45 smithi087 ceph-mon[35290]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:40:45.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 -- 172.21.15.66:0/3223392576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994101cd0 msgr2=0x7fb994102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3223392576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994101cd0 0x7fb994102150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009900 tx=0x7fb97c02a410 comp rx=0 tx=0).stop 2024-09-15T22:40:45.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 -- 172.21.15.66:0/3223392576 shutdown_connections 2024-09-15T22:40:45.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3223392576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994102690 0x7fb994108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3223392576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994101cd0 0x7fb994102150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3223392576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 0x7fb994100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 -- 172.21.15.66:0/3223392576 >> 172.21.15.66:0/3223392576 conn(0x7fb9940fc280 msgr2=0x7fb9940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 -- 172.21.15.66:0/3223392576 shutdown_connections 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 -- 172.21.15.66:0/3223392576 wait complete. 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.823+0000 7fb999d2d640 1 Processor -- start 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 -- start start 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 0x7fb994198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994101cd0 0x7fb994198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410c7a0 con 0x7fb994102690 2024-09-15T22:40:45.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410c620 con 0x7fb994101cd0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb999d2d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb99410c920 con 0x7fb994100ad0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46186/0 (socket says 172.21.15.66:46186) 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 -- 172.21.15.66:0/3088827717 learned_addr learned my addr 172.21.15.66:0/3088827717 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb9937fe640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 0x7fb994198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb992ffd640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994101cd0 0x7fb994198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 -- 172.21.15.66:0/3088827717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 msgr2=0x7fb994198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 0x7fb994198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 -- 172.21.15.66:0/3088827717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994101cd0 msgr2=0x7fb994198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994101cd0 0x7fb994198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.824+0000 7fb993fff640 1 -- 172.21.15.66:0/3088827717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99419fc50 con 0x7fb994102690 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb993fff640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c970 tx=0x7fb98c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c007bb0 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99419ff40 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb98c007d50 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00f450 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.825+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941a03f0 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.826+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9941a06e0 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.827+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb98c004f00 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.828+0000 7fb990ff9640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 0x7fb9800a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.828+0000 7fb9937fe640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 0x7fb9800a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.828+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7fb98c0ceec0 con 0x7fb994102690 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.829+0000 7fb9937fe640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 0x7fb9800a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb984005c40 tx=0x7fb98400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:40:45.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:45.831+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb98c014030 con 0x7fb994102690 2024-09-15T22:40:46.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:40:46.019+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb9941a08b0 con 0x7fb9800a3270 2024-09-15T22:40:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi184 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-15T22:40:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi184 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:46.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:40:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi184 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 5696M 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:40:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] boot 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:40:47.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:40:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:40:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] boot 2024-09-15T22:40:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:40:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: osd.8 [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] boot 2024-09-15T22:40:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: osdmap e54: 9 total, 9 up, 9 in 2024-09-15T22:40:47.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:40:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:48 smithi184 ceph-mon[35203]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:48 smithi184 ceph-mon[35203]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:40:48.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:48 smithi066 ceph-mon[31185]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:48.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:48 smithi066 ceph-mon[31185]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:40:48.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:48 smithi087 ceph-mon[35290]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:40:48.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:48 smithi087 ceph-mon[35290]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T22:40:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:49 smithi184 ceph-mon[35203]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:40:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:49 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]: dispatch 2024-09-15T22:40:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:49 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]': finished 2024-09-15T22:40:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:49 smithi184 ceph-mon[35203]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:40:49.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:49 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:49 smithi066 ceph-mon[31185]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:40:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:49 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]: dispatch 2024-09-15T22:40:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:49 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]': finished 2024-09-15T22:40:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:49 smithi066 ceph-mon[31185]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:40:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:49 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:49 smithi087 ceph-mon[35290]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:40:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:49 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]: dispatch 2024-09-15T22:40:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:49 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1542632846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fae9263-8048-49be-aabd-a20fe2ff7153"}]': finished 2024-09-15T22:40:49.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:49 smithi087 ceph-mon[35290]: osdmap e57: 10 total, 9 up, 10 in 2024-09-15T22:40:49.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:49 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:50 smithi184 ceph-mon[35203]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:50 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1388333379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:50 smithi184 ceph-mon[35203]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:40:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:50.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:50 smithi066 ceph-mon[31185]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:50 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1388333379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:50 smithi066 ceph-mon[31185]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:40:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:50 smithi087 ceph-mon[35290]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:50 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1388333379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:40:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:50 smithi087 ceph-mon[35290]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:40:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:40:52.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:52 smithi184 ceph-mon[35203]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:52.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:52 smithi066 ceph-mon[31185]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:52 smithi087 ceph-mon[35290]: pgmap v193: 1 pgs: 1 peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:40:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:54 smithi184 ceph-mon[35203]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-15T22:40:54.444 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:54 smithi087 ceph-mon[35290]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-15T22:40:54.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:54 smithi066 ceph-mon[31185]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-15T22:40:56.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:56 smithi066 ceph-mon[31185]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-15T22:40:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:56 smithi087 ceph-mon[35290]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-15T22:40:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:56 smithi184 ceph-mon[35203]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-15T22:40:58.246 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:58 smithi066 ceph-mon[31185]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:40:58.246 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:40:58.246 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:58 smithi087 ceph-mon[35290]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:40:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:40:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:58.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:58 smithi184 ceph-mon[35203]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:40:58.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:40:58.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:40:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:40:59 smithi066 ceph-mon[31185]: Deploying daemon osd.9 on smithi066 2024-09-15T22:40:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:40:59 smithi087 ceph-mon[35290]: Deploying daemon osd.9 on smithi066 2024-09-15T22:40:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:40:59 smithi184 ceph-mon[35203]: Deploying daemon osd.9 on smithi066 2024-09-15T22:41:00.416 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:00 smithi066 ceph-mon[31185]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T22:41:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:00 smithi087 ceph-mon[35290]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T22:41:00.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:00 smithi184 ceph-mon[35203]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T22:41:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:02 smithi066 ceph-mon[31185]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:41:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:02 smithi087 ceph-mon[35290]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:41:02.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:02 smithi184 ceph-mon[35203]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:41:04.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:04 smithi066 ceph-mon[31185]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:41:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:04 smithi087 ceph-mon[35290]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:41:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:04 smithi184 ceph-mon[35203]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:41:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:06.272 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:06 smithi066 ceph-mon[31185]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:06 smithi087 ceph-mon[35290]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:06.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:06 smithi184 ceph-mon[35203]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:07.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.171+0000 7fb990ff9640 1 -- 172.21.15.66:0/3088827717 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9941a08b0 con 0x7fb9800a3270 2024-09-15T22:41:07.173 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 9 on host 'smithi066' 2024-09-15T22:41:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 msgr2=0x7fb9800a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 0x7fb9800a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb984005c40 tx=0x7fb98400a590 comp rx=0 tx=0).stop 2024-09-15T22:41:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 msgr2=0x7fb99419f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c970 tx=0x7fb98c00ce30 comp rx=0 tx=0).stop 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 shutdown_connections 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb994102690 0x7fb99419f5e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9800a3270 0x7fb9800a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb994101cd0 0x7fb994198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 --2- 172.21.15.66:0/3088827717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb994100ad0 0x7fb994198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 >> 172.21.15.66:0/3088827717 conn(0x7fb9940fc280 msgr2=0x7fb99406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 shutdown_connections 2024-09-15T22:41:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:07.174+0000 7fb999d2d640 1 -- 172.21.15.66:0/3088827717 wait complete. 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:07 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:07 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:07.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:07.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:07.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:07 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:07.936 DEBUG:teuthology.orchestra.run.smithi066:osd.9> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T22:41:07.939 INFO:tasks.cephadm:Deploying osd.10 on smithi087 with /dev/vg_nvme/lv_1... 2024-09-15T22:41:07.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:41:08.194 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:41:09.564 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:09 smithi066 ceph-mon[31185]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:09.567 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:09 smithi066 ceph-mon[31185]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:41:09.567 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 22:41:09 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T22:41:09.267+0000 7f4551c38640 -1 osd.9 0 log_to_monitors true 2024-09-15T22:41:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:09 smithi087 ceph-mon[35290]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:09 smithi087 ceph-mon[35290]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:41:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:09 smithi184 ceph-mon[35203]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:09 smithi184 ceph-mon[35203]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:41:10.665 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T22:41:10.394+0000 7f454dbbb640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T22:41:10.665 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T22:41:10.408+0000 7f45499e3640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:10.665 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-mon[31185]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:41:10.666 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-mon[31185]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:41:10.666 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-mon[31185]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:41:10.666 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:10 smithi184 ceph-mon[35203]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:41:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:10 smithi184 ceph-mon[35203]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:41:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:10 smithi184 ceph-mon[35203]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:41:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:10.756 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:10 smithi087 ceph-mon[35290]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:41:10.756 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:10 smithi087 ceph-mon[35290]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:41:10.756 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:10 smithi087 ceph-mon[35290]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-15T22:41:10.756 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:10.759 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-15T22:41:10.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_1 2024-09-15T22:41:11.036 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi066 2024-09-15T22:41:11.408 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:11.409 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:11 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 -- 172.21.15.87:0/2014723483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b4103870 msgr2=0x7f23b410a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 --2- 172.21.15.87:0/2014723483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b4103870 0x7f23b410a100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009ca0 tx=0x7f23ac02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 -- 172.21.15.87:0/2014723483 shutdown_connections 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 --2- 172.21.15.87:0/2014723483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b4103870 0x7f23b410a100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 --2- 172.21.15.87:0/2014723483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 0x7f23b4103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 --2- 172.21.15.87:0/2014723483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b40ffed0 0x7f23b41002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 -- 172.21.15.87:0/2014723483 >> 172.21.15.87:0/2014723483 conn(0x7f23b40fba40 msgr2=0x7f23b40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 -- 172.21.15.87:0/2014723483 shutdown_connections 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.541+0000 7f23baa73640 1 -- 172.21.15.87:0/2014723483 wait complete. 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 Processor -- start 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 -- start start 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 0x7f23b41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b4103870 0x7f23b419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23b410d890 con 0x7f23b4103870 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23b410d710 con 0x7f23b40ffed0 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23baa73640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f23b410da10 con 0x7f23b4102eb0 2024-09-15T22:41:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34000/0 (socket says 172.21.15.87:34000) 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 -- 172.21.15.87:0/513889794 learned_addr learned my addr 172.21.15.87:0/513889794 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23abfff640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 0x7f23b41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 -- 172.21.15.87:0/513889794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 msgr2=0x7f23b41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 0x7f23b41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 -- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b4103870 msgr2=0x7f23b419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b4103870 0x7f23b419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.542+0000 7f23b880f640 1 -- 172.21.15.87:0/513889794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b419fa90 con 0x7f23b40ffed0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23b880f640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c970 tx=0x7f23b000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0007c10 con 0x7f23b40ffed0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b0007db0 con 0x7f23b40ffed0 2024-09-15T22:41:11.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b419fd80 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b000f940 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.543+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b41a0200 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.544+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b4109060 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.545+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f23b000fae0 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.546+0000 7f23a9ffb640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 0x7f239c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.546+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7f23b00cf4a0 con 0x7f23b40ffed0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.546+0000 7f23abfff640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 0x7f239c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.546+0000 7f23abfff640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 0x7f239c0a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b4199380 tx=0x7f23a400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.550+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23b009ca50 con 0x7f23b40ffed0 2024-09-15T22:41:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi066 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:11.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:11 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi066 2024-09-15T22:41:11.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:11.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:11 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:11.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:11.726+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f23b4062630 con 0x7f239c0a3270 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] boot 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:12.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:12.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:12 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] boot 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:12.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:12.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:12 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:12.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:41:12.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:41:12.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: osd.9 [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] boot 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: osdmap e61: 10 total, 10 up, 10 in 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:12.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:12 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:13 smithi184 ceph-mon[35203]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:13 smithi184 ceph-mon[35203]: osdmap e62: 10 total, 10 up, 10 in 2024-09-15T22:41:13.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:13 smithi066 ceph-mon[31185]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:13.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:13 smithi066 ceph-mon[31185]: osdmap e62: 10 total, 10 up, 10 in 2024-09-15T22:41:13.820 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:13 smithi087 ceph-mon[35290]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:41:13.821 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:13 smithi087 ceph-mon[35290]: osdmap e62: 10 total, 10 up, 10 in 2024-09-15T22:41:14.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:14 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/2676275109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:14 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:14 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]': finished 2024-09-15T22:41:14.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:14 smithi184 ceph-mon[35203]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:41:14.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:14 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:14 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/2676275109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:14 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:14 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]': finished 2024-09-15T22:41:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:14 smithi066 ceph-mon[31185]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:41:14.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:14 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:14.717 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:14 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/2676275109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.717 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:14 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]: dispatch 2024-09-15T22:41:14.717 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:14 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf14352c-0b93-4188-af44-8ad4335c4e3c"}]': finished 2024-09-15T22:41:14.717 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:14 smithi087 ceph-mon[35290]: osdmap e63: 11 total, 10 up, 11 in 2024-09-15T22:41:14.717 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:14 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:15 smithi184 ceph-mon[35203]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:15 smithi184 ceph-mon[35203]: from='client.? 172.21.15.87:0/3031348588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:15.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:15 smithi066 ceph-mon[31185]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:15.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:15 smithi066 ceph-mon[31185]: from='client.? 172.21.15.87:0/3031348588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:15 smithi087 ceph-mon[35290]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:15.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:15 smithi087 ceph-mon[35290]: from='client.? 172.21.15.87:0/3031348588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:17 smithi184 ceph-mon[35203]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:17.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:17 smithi066 ceph-mon[31185]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:17.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:17 smithi087 ceph-mon[35290]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:19 smithi087 ceph-mon[35290]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:19.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:19 smithi066 ceph-mon[31185]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:19.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:19 smithi184 ceph-mon[35203]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:21 smithi184 ceph-mon[35203]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:21.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:21 smithi066 ceph-mon[31185]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:21.787 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:21 smithi087 ceph-mon[35290]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:23 smithi066 ceph-mon[31185]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:41:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:23 smithi066 ceph-mon[31185]: Deploying daemon osd.10 on smithi087 2024-09-15T22:41:23.716 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:23 smithi087 ceph-mon[35290]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:23.716 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:41:23.716 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:23.716 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:23 smithi087 ceph-mon[35290]: Deploying daemon osd.10 on smithi087 2024-09-15T22:41:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:23 smithi184 ceph-mon[35203]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:41:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:23.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:23 smithi184 ceph-mon[35203]: Deploying daemon osd.10 on smithi087 2024-09-15T22:41:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:25 smithi066 ceph-mon[31185]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:25.787 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:25 smithi087 ceph-mon[35290]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:25.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:25 smithi184 ceph-mon[35203]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:27.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:27 smithi066 ceph-mon[31185]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:27.725 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:27 smithi087 ceph-mon[35290]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:27.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:27 smithi184 ceph-mon[35203]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:29 smithi066 ceph-mon[31185]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:29 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:29.755 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:29 smithi087 ceph-mon[35290]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:29.755 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:29.755 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:29.755 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:29 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:29 smithi184 ceph-mon[35203]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:29.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:29.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:29 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:31 smithi087 ceph-mon[35290]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:31 smithi066 ceph-mon[31185]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:31.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:31 smithi184 ceph-mon[35203]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:32.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.620+0000 7f23a9ffb640 1 -- 172.21.15.87:0/513889794 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f23b4062630 con 0x7f239c0a3270 2024-09-15T22:41:32.622 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 10 on host 'smithi087' 2024-09-15T22:41:32.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 msgr2=0x7f239c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:32.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 0x7f239c0a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b4199380 tx=0x7f23a400b410 comp rx=0 tx=0).stop 2024-09-15T22:41:32.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 msgr2=0x7f23b4197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c970 tx=0x7f23b000ce30 comp rx=0 tx=0).stop 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 shutdown_connections 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23b4103870 0x7f23b419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23b4102eb0 0x7f23b41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f239c0a3270 0x7f239c0a5730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 --2- 172.21.15.87:0/513889794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23b40ffed0 0x7f23b4197e60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 >> 172.21.15.87:0/513889794 conn(0x7f23b40fba40 msgr2=0x7f23b4106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 shutdown_connections 2024-09-15T22:41:32.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-15T22:41:32.623+0000 7f23baa73640 1 -- 172.21.15.87:0/513889794 wait complete. 2024-09-15T22:41:32.983 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:32.984 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:32 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:32 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:32 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:33.311 DEBUG:teuthology.orchestra.run.smithi087:osd.10> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T22:41:33.314 INFO:tasks.cephadm:Deploying osd.11 on smithi184 with /dev/vg_nvme/lv_1... 2024-09-15T22:41:33.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:41:33.572 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:41:33.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:33 smithi184 ceph-mon[35203]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:34.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:33 smithi066 ceph-mon[31185]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:33 smithi087 ceph-mon[35290]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:35.542 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 22:41:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T22:41:35.105+0000 7f05e4b82640 -1 osd.10 0 log_to_monitors true 2024-09-15T22:41:36.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:35 smithi184 ceph-mon[35203]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:36.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:35 smithi184 ceph-mon[35203]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:35 smithi184 ceph-mon[35203]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-15T22:41:36.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:35 smithi066 ceph-mon[31185]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:35 smithi066 ceph-mon[31185]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:35 smithi066 ceph-mon[31185]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2024-09-15T22:41:36.235 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:35 smithi087 ceph-mon[35290]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:36.235 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:35 smithi087 ceph-mon[35290]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.235 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:35 smithi087 ceph-mon[35290]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:41:36.480 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- 172.21.15.184:0/2081574462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01002a0 msgr2=0x7f24a01006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/2081574462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01002a0 0x7f24a01006a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2490009900 tx=0x7f249002a410 comp rx=0 tx=0).stop 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- 172.21.15.184:0/2081574462 shutdown_connections 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/2081574462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a0101e60 0x7f24a01086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/2081574462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a01014a0 0x7f24a0101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/2081574462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01002a0 0x7f24a01006a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- 172.21.15.184:0/2081574462 >> 172.21.15.184:0/2081574462 conn(0x7f24a00fba30 msgr2=0x7f24a00fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- 172.21.15.184:0/2081574462 shutdown_connections 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- 172.21.15.184:0/2081574462 wait complete. 2024-09-15T22:41:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 Processor -- start 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.951+0000 7f24a5b4f640 1 -- start start 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a01002a0 0x7f24a0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a0101e60 0x7f24a019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24a010bf80 con 0x7f24a01002a0 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24a010be00 con 0x7f24a0101e60 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24a010c100 con 0x7f24a01014a0 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:57258/0 (socket says 172.21.15.184:57258) 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 -- 172.21.15.184:0/974932761 learned_addr learned my addr 172.21.15.184:0/974932761 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249f7fe640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a01002a0 0x7f24a0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249ffff640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a0101e60 0x7f24a019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 -- 172.21.15.184:0/974932761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a0101e60 msgr2=0x7f24a019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a0101e60 0x7f24a019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 -- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a01002a0 msgr2=0x7f24a0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a01002a0 0x7f24a0198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 -- 172.21.15.184:0/974932761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a019fc90 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249effd640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f249400b4a0 tx=0x7f249400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494014070 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a019ff80 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2494010af0 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494017d10 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.952+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a01a0500 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.953+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a01a0790 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.954+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2494017070 con 0x7f24a01014a0 2024-09-15T22:41:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.955+0000 7f249cff9640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 0x7f24880a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.955+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7f24940ce870 con 0x7f24a01014a0 2024-09-15T22:41:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.955+0000 7f249f7fe640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 0x7f24880a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.956+0000 7f249f7fe640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 0x7f24880a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24900314e0 tx=0x7f24900315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:36.958+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f249409bd00 con 0x7f24a01014a0 2024-09-15T22:41:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:37.135+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f24a01a0960 con 0x7f24880a3270 2024-09-15T22:41:37.137 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:41:37.137 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:41:37.137 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi087 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.138 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:37.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:37.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi087 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:37.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.349 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T22:41:36.905+0000 7f05e0b05640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T22:41:37.349 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T22:41:36.917+0000 7f05dc92d640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:41:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: osdmap e64: 11 total, 10 up, 11 in 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi087 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-15T22:41:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:37.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:37.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:41:37.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:38.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] boot 2024-09-15T22:41:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:41:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:37 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:38.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:38.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] boot 2024-09-15T22:41:38.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:41:38.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:37 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:41:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-15T22:41:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: osd.10 [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] boot 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: osdmap e66: 11 total, 11 up, 11 in 2024-09-15T22:41:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:37 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:41:39.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:38 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:41:39.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:38 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:41:39.160 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:38 smithi184 ceph-mon[35203]: osdmap e67: 11 total, 11 up, 11 in 2024-09-15T22:41:39.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:38 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:41:39.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:38 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:41:39.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:38 smithi066 ceph-mon[31185]: osdmap e67: 11 total, 11 up, 11 in 2024-09-15T22:41:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:38 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:41:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:38 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:41:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:38 smithi087 ceph-mon[35290]: osdmap e67: 11 total, 11 up, 11 in 2024-09-15T22:41:40.069 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:40.069 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/1795340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.069 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.069 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]': finished 2024-09-15T22:41:40.069 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:41:40.070 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:40.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:40.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/1795340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]': finished 2024-09-15T22:41:40.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:41:40.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/1795340628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]: dispatch 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dac66f9a-0a5d-40ca-85e7-f48d9aaee71a"}]': finished 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: osdmap e68: 12 total, 11 up, 12 in 2024-09-15T22:41:40.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:41.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:40 smithi066 ceph-mon[31185]: from='client.? 172.21.15.184:0/3729762837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:40 smithi087 ceph-mon[35290]: from='client.? 172.21.15.184:0/3729762837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:40 smithi184 ceph-mon[35203]: from='client.? 172.21.15.184:0/3729762837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:41:42.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:41 smithi066 ceph-mon[31185]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:42.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:41 smithi066 ceph-mon[31185]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:41:42.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:41 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:42.250 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:41 smithi087 ceph-mon[35290]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:42.251 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:41 smithi087 ceph-mon[35290]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:41:42.251 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:41 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:41 smithi184 ceph-mon[35203]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:41 smithi184 ceph-mon[35203]: osdmap e69: 12 total, 11 up, 12 in 2024-09-15T22:41:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:41 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:43.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:42 smithi066 ceph-mon[31185]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:41:43.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:42 smithi087 ceph-mon[35290]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:41:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:42 smithi184 ceph-mon[35203]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:41:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:41:44.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:43 smithi066 ceph-mon[31185]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:41:44.326 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:43 smithi184 ceph-mon[35203]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:41:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:43 smithi087 ceph-mon[35290]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:41:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:45 smithi184 ceph-mon[35203]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-15T22:41:46.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:45 smithi066 ceph-mon[31185]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-15T22:41:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:45 smithi087 ceph-mon[35290]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-15T22:41:48.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:47 smithi066 ceph-mon[31185]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:41:48.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:47 smithi087 ceph-mon[35290]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:41:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:47 smithi184 ceph-mon[35203]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T22:41:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:41:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:48 smithi184 ceph-mon[35203]: Deploying daemon osd.11 on smithi184 2024-09-15T22:41:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:41:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:48 smithi087 ceph-mon[35290]: Deploying daemon osd.11 on smithi184 2024-09-15T22:41:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:41:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:41:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:48 smithi066 ceph-mon[31185]: Deploying daemon osd.11 on smithi184 2024-09-15T22:41:50.196 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:49 smithi184 ceph-mon[35203]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:41:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:49 smithi087 ceph-mon[35290]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:41:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:49 smithi066 ceph-mon[31185]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:41:52.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:51 smithi087 ceph-mon[35290]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:41:52.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:51 smithi184 ceph-mon[35203]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:41:52.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:51 smithi066 ceph-mon[31185]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:41:54.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:53 smithi087 ceph-mon[35290]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:53 smithi184 ceph-mon[35203]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:54.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:53 smithi066 ceph-mon[31185]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:55.089 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:55.089 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:55.089 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:55.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:41:55.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:55.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:56 smithi087 ceph-mon[35290]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:56 smithi184 ceph-mon[35203]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:56.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:56 smithi066 ceph-mon[31185]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:57.259 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.257+0000 7f249cff9640 1 -- 172.21.15.184:0/974932761 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f24a01a0960 con 0x7f24880a3270 2024-09-15T22:41:57.259 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 11 on host 'smithi184' 2024-09-15T22:41:57.261 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 msgr2=0x7f24880a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.261 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 0x7f24880a5730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24900314e0 tx=0x7f24900315b0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 msgr2=0x7f24a01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f249400b4a0 tx=0x7f249400b960 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 shutdown_connections 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f24880a3270 0x7f24880a5730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24a0101e60 0x7f24a019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a01014a0 0x7f24a01985a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 --2- 172.21.15.184:0/974932761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24a01002a0 0x7f24a0198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 >> 172.21.15.184:0/974932761 conn(0x7f24a00fba30 msgr2=0x7f24a00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 shutdown_connections 2024-09-15T22:41:57.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:41:57.260+0000 7f24a5b4f640 1 -- 172.21.15.184:0/974932761 wait complete. 2024-09-15T22:41:57.954 DEBUG:teuthology.orchestra.run.smithi184:osd.11> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T22:41:57.956 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T22:41:57.957 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:41:58.226 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:41:58.504 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:58 smithi066 ceph-mon[31185]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:58.505 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.505 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.505 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.505 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:58 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.508 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:58 smithi184 ceph-mon[35203]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:58.508 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.508 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.508 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.508 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:58 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:58 smithi087 ceph-mon[35290]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:41:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:58 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:41:58.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 -- 172.21.15.66:0/2977653880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 msgr2=0x7f0784103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 --2- 172.21.15.66:0/2977653880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f0784103280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0778009900 tx=0x7f077802a410 comp rx=0 tx=0).stop 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 -- 172.21.15.66:0/2977653880 shutdown_connections 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 --2- 172.21.15.66:0/2977653880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07841037c0 0x7f078410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 --2- 172.21.15.66:0/2977653880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f0784103280 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 --2- 172.21.15.66:0/2977653880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0784101c00 0x7f0784102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 -- 172.21.15.66:0/2977653880 >> 172.21.15.66:0/2977653880 conn(0x7f07840fd390 msgr2=0x7f07840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 -- 172.21.15.66:0/2977653880 shutdown_connections 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.700+0000 7f078a318640 1 -- 172.21.15.66:0/2977653880 wait complete. 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 Processor -- start 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 -- start start 2024-09-15T22:41:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0784101c00 0x7f078419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07841037c0 0x7f07841a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f078410d900 con 0x7f0784102e00 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f078410d780 con 0x7f0784101c00 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f078a318640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f078410da80 con 0x7f07841037c0 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55986/0 (socket says 172.21.15.66:55986) 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 -- 172.21.15.66:0/200689985 learned_addr learned my addr 172.21.15.66:0/200689985 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07888b5640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07841037c0 0x7f07841a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f0783fff640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0784101c00 0x7f078419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 -- 172.21.15.66:0/200689985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07841037c0 msgr2=0x7f07841a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07841037c0 0x7f07841a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 -- 172.21.15.66:0/200689985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0784101c00 msgr2=0x7f078419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0784101c00 0x7f078419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.701+0000 7f07837fe640 1 -- 172.21.15.66:0/200689985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07841a1dd0 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f07837fe640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0778009230 tx=0x7f0778004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077803f030 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778003ce0 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778035070 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07841a2060 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.702+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07841a2610 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.703+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07841a2870 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.705+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0778042030 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.705+0000 7f07817fa640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 0x7f076c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.706+0000 7f0783fff640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 0x7f076c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.706+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f07780efd20 con 0x7f0784102e00 2024-09-15T22:41:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.706+0000 7f0783fff640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 0x7f076c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0774005fd0 tx=0x7f0774005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:41:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.709+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07780bd020 con 0x7f0784102e00 2024-09-15T22:41:58.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.885+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f07841a2f40 con 0x7f0784102e00 2024-09-15T22:41:58.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.886+0000 7f07817fa640 1 -- 172.21.15.66:0/200689985 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f07780bc920 con 0x7f0784102e00 2024-09-15T22:41:58.888 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 msgr2=0x7f076c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 0x7f076c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0774005fd0 tx=0x7f0774005850 comp rx=0 tx=0).stop 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 msgr2=0x7f078419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0778009230 tx=0x7f0778004360 comp rx=0 tx=0).stop 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 shutdown_connections 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07841037c0 0x7f07841a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0784102e00 0x7f078419a6e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f076c0a32f0 0x7f076c0a57b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 --2- 172.21.15.66:0/200689985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0784101c00 0x7f078419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:41:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 >> 172.21.15.66:0/200689985 conn(0x7f07840fd390 msgr2=0x7f0784074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:41:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 shutdown_connections 2024-09-15T22:41:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:41:58.888+0000 7f078a318640 1 -- 172.21.15.66:0/200689985 wait complete. 2024-09-15T22:41:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:41:59 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/200689985' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:41:59.529 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:41:59 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/200689985' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:41:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:41:59 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/200689985' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:41:59.932 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726440097,"num_in_osds":12,"osd_in_since":1726440099,"num_remapped_pgs":0} 2024-09-15T22:42:00.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:00 smithi066 ceph-mon[31185]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:00 smithi087 ceph-mon[35290]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:00.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:00 smithi184 ceph-mon[35203]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:00.673 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 22:42:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T22:42:00.355+0000 7fdca71a7640 -1 osd.11 0 log_to_monitors true 2024-09-15T22:42:00.934 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:42:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.613 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:01.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:01.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- 172.21.15.66:0/2002959330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4100360 msgr2=0x7fb7d4100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:01.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 --2- 172.21.15.66:0/2002959330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4100360 0x7fb7d4100810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009ca0 tx=0x7fb7c402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- 172.21.15.66:0/2002959330 shutdown_connections 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 --2- 172.21.15.66:0/2002959330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4100360 0x7fb7d4100810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 --2- 172.21.15.66:0/2002959330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4102ae0 0x7fb7d40ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 --2- 172.21.15.66:0/2002959330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 0x7fb7d4102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- 172.21.15.66:0/2002959330 >> 172.21.15.66:0/2002959330 conn(0x7fb7d40fba30 msgr2=0x7fb7d40fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- 172.21.15.66:0/2002959330 shutdown_connections 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- 172.21.15.66:0/2002959330 wait complete. 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 Processor -- start 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.695+0000 7fb7d9757640 1 -- start start 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 0x7fb7d419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:01.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 0x7fb7d419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410fb10 con 0x7fb7d4102ae0 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410f990 con 0x7fb7d4100360 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410fc90 con 0x7fb7d4102110 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55998/0 (socket says 172.21.15.66:55998) 2024-09-15T22:42:01.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 -- 172.21.15.66:0/809573931 learned_addr learned my addr 172.21.15.66:0/809573931 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d27fc640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 0x7fb7d419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d2ffd640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 0x7fb7d419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 -- 172.21.15.66:0/809573931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 msgr2=0x7fb7d419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 0x7fb7d419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 -- 172.21.15.66:0/809573931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 msgr2=0x7fb7d419a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 0x7fb7d419a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 -- 172.21.15.66:0/809573931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d41a1d60 con 0x7fb7d4102ae0 2024-09-15T22:42:01.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d2ffd640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 0x7fb7d419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d37fe640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40319f0 tx=0x7fb7c402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4003c70 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.696+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d41a1ff0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.697+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7c4003e10 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.697+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c402fd30 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.697+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d41a24f0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.697+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d410bac0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.699+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb7c4004040 con 0x7fb7d4102ae0 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.699+0000 7fb7cbfff640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 0x7fb7c00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:01.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.699+0000 7fb7d2ffd640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 0x7fb7c00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:01.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.699+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6831+0+0 (secure 0 0 0) 0x7fb7c40f08d0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.700+0000 7fb7d2ffd640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 0x7fb7c00a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0058c0 tx=0x7fb7cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:01.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.703+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7c40bdbc0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.878+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb7d402d9c0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.879+0000 7fb7cbfff640 1 -- 172.21.15.66:0/809573931 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fb7c40bd4c0 con 0x7fb7d4102ae0 2024-09-15T22:42:01.882 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 msgr2=0x7fb7c00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 0x7fb7c00a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0058c0 tx=0x7fb7cc005850 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 msgr2=0x7fb7d41a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40319f0 tx=0x7fb7c402f450 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 shutdown_connections 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7d4102ae0 0x7fb7d41a16f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d4102110 0x7fb7d419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7c00a3270 0x7fb7c00a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 --2- 172.21.15.66:0/809573931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7d4100360 0x7fb7d419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:01.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.881+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 >> 172.21.15.66:0/809573931 conn(0x7fb7d40fba30 msgr2=0x7fb7d40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:01.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.882+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 shutdown_connections 2024-09-15T22:42:01.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:01.882+0000 7fb7d9757640 1 -- 172.21.15.66:0/809573931 wait complete. 2024-09-15T22:42:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: Detected new or changed devices on smithi184 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:02.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:02.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:02 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/809573931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:02.672 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T22:42:02.285+0000 7fdca312a640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T22:42:02.672 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T22:42:02.297+0000 7fdc9ef52640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: Detected new or changed devices on smithi184 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:02.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:02.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:02.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:02 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/809573931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: Detected new or changed devices on smithi184 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 4272M 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:02.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-09-15T22:42:02.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:02.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:02.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:02.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:02.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:02 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/809573931' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:02.711 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726440097,"num_in_osds":12,"osd_in_since":1726440099,"num_remapped_pgs":0} 2024-09-15T22:42:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:03 smithi087 ceph-mon[35290]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:42:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:03 smithi087 ceph-mon[35290]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:42:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:03 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:03 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:03 smithi184 ceph-mon[35203]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:42:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:03 smithi184 ceph-mon[35203]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:42:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:03 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:03 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:03 smithi066 ceph-mon[31185]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-09-15T22:42:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:03 smithi066 ceph-mon[31185]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:42:03.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:03 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:03.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:42:03.982 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: purged_snaps scrub starts 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: purged_snaps scrub ok 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] boot 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:42:04.381 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:04 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 -- 172.21.15.66:0/3685981909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c105070 msgr2=0x7f6c1c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 --2- 172.21.15.66:0/3685981909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c105070 0x7f6c1c107460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009900 tx=0x7f6c0c02a410 comp rx=0 tx=0).stop 2024-09-15T22:42:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 -- 172.21.15.66:0/3685981909 shutdown_connections 2024-09-15T22:42:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 --2- 172.21.15.66:0/3685981909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 --2- 172.21.15.66:0/3685981909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c105070 0x7f6c1c107460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 --2- 172.21.15.66:0/3685981909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c102740 0x7f6c1c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.459+0000 7f6c23441640 1 -- 172.21.15.66:0/3685981909 >> 172.21.15.66:0/3685981909 conn(0x7f6c1c0fc2a0 msgr2=0x7f6c1c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- 172.21.15.66:0/3685981909 shutdown_connections 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- 172.21.15.66:0/3685981909 wait complete. 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 Processor -- start 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- start start 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c102740 0x7f6c1c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c105070 0x7f6c1c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d870 con 0x7f6c1c1079a0 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d6f0 con 0x7f6c1c105070 2024-09-15T22:42:04.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c23441640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10d9f0 con 0x7f6c1c102740 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.460+0000 7f6c219de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34412/0 (socket says 172.21.15.66:34412) 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 -- 172.21.15.66:0/2002716099 learned_addr learned my addr 172.21.15.66:0/2002716099 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c211dd640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c102740 0x7f6c1c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c209dc640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c105070 0x7f6c1c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 -- 172.21.15.66:0/2002716099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c102740 msgr2=0x7f6c1c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c102740 0x7f6c1c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 -- 172.21.15.66:0/2002716099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c105070 msgr2=0x7f6c1c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c105070 0x7f6c1c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 -- 172.21.15.66:0/2002716099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c19fad0 con 0x7f6c1c1079a0 2024-09-15T22:42:04.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c219de640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400cce0 tx=0x7f6c1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400f450 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c1400fad0 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14018c10 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c19fdc0 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.461+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1a0220 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.462+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c0fdd90 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.463+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6c1400f5f0 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.464+0000 7f6c127fc640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 0x7f6c080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.464+0000 7f6c211dd640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 0x7f6c080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.464+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6c140cfa60 con 0x7f6c1c1079a0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.464+0000 7f6c211dd640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 0x7f6c080a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800bbe0 tx=0x7f6c1800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:04.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.468+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c14014030 con 0x7f6c1c1079a0 2024-09-15T22:42:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: purged_snaps scrub starts 2024-09-15T22:42:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: purged_snaps scrub ok 2024-09-15T22:42:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:04.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] boot 2024-09-15T22:42:04.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:42:04.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:04 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.642+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6c1c062e90 con 0x7f6c1c1079a0 2024-09-15T22:42:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.643+0000 7f6c127fc640 1 -- 172.21.15.66:0/2002716099 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f6c1409cc20 con 0x7f6c1c1079a0 2024-09-15T22:42:04.645 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:04.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.644+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 msgr2=0x7f6c080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 0x7f6c080a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800bbe0 tx=0x7f6c1800b390 comp rx=0 tx=0).stop 2024-09-15T22:42:04.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 msgr2=0x7f6c1c19f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:04.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400cce0 tx=0x7f6c1400a620 comp rx=0 tx=0).stop 2024-09-15T22:42:04.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 shutdown_connections 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c1c1079a0 0x7f6c1c19f460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6c080a3270 0x7f6c080a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c1c105070 0x7f6c1c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 --2- 172.21.15.66:0/2002716099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c1c102740 0x7f6c1c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 >> 172.21.15.66:0/2002716099 conn(0x7f6c1c0fc2a0 msgr2=0x7f6c1c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 shutdown_connections 2024-09-15T22:42:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:04.645+0000 7f6c23441640 1 -- 172.21.15.66:0/2002716099 wait complete. 2024-09-15T22:42:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: purged_snaps scrub starts 2024-09-15T22:42:04.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: purged_snaps scrub ok 2024-09-15T22:42:04.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:42:04.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: osd.11 [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] boot 2024-09-15T22:42:04.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: osdmap e73: 12 total, 12 up, 12 in 2024-09-15T22:42:04.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:04 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:42:05.359 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726440123,"num_in_osds":12,"osd_in_since":1726440099,"num_remapped_pgs":0} 2024-09-15T22:42:05.359 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:42:05.384 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:05 smithi066 ceph-mon[31185]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:42:05.384 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:05 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2002716099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:05 smithi087 ceph-mon[35290]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:42:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:05 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2002716099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:05.616 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:05 smithi184 ceph-mon[35203]: osdmap e74: 12 total, 12 up, 12 in 2024-09-15T22:42:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:05 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2002716099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:42:06.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.141+0000 7f13295f2640 1 -- 172.21.15.66:0/1084725467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 msgr2=0x7f132410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.141+0000 7f13295f2640 1 --2- 172.21.15.66:0/1084725467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f132410bb30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1318009900 tx=0x7f131802a480 comp rx=0 tx=0).stop 2024-09-15T22:42:06.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 -- 172.21.15.66:0/1084725467 shutdown_connections 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 --2- 172.21.15.66:0/1084725467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 --2- 172.21.15.66:0/1084725467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f132410bb30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 --2- 172.21.15.66:0/1084725467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 0x7f1324103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 -- 172.21.15.66:0/1084725467 >> 172.21.15.66:0/1084725467 conn(0x7f13240fc780 msgr2=0x7f13240feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 -- 172.21.15.66:0/1084725467 shutdown_connections 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 -- 172.21.15.66:0/1084725467 wait complete. 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 Processor -- start 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.142+0000 7f13295f2640 1 -- start start 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 0x7f1324198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1324111f90 con 0x7f1324103640 2024-09-15T22:42:06.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1324111e10 con 0x7f1324102d20 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13295f2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1324112110 con 0x7f132410c150 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34424/0 (socket says 172.21.15.66:34424) 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 -- 172.21.15.66:0/1543776423 learned_addr learned my addr 172.21.15.66:0/1543776423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f1322ffd640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 0x7f1324198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13237fe640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 -- 172.21.15.66:0/1543776423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 msgr2=0x7f132419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 -- 172.21.15.66:0/1543776423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 msgr2=0x7f1324198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 0x7f1324198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 -- 172.21.15.66:0/1543776423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132419d420 con 0x7f1324103640 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13237fe640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f13227fc640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1318005ab0 tx=0x7f13180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:06.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.143+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131803f030 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.144+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1318003ce0 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.144+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132419d6b0 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.144+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318035070 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.144+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13241a4ff0 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.145+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132406b070 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.146+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1318042030 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.146+0000 7f130bfff640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 0x7f130c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.146+0000 7f1322ffd640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 0x7f130c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.147+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f13180efc90 con 0x7f1324103640 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.147+0000 7f1322ffd640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 0x7f130c0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1314009990 tx=0x7f1314009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:06.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.150+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13180bce50 con 0x7f1324103640 2024-09-15T22:42:06.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.327+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13241071c0 con 0x7f1324103640 2024-09-15T22:42:06.330 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:06 smithi066 ceph-mon[31185]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:06.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.328+0000 7f130bfff640 1 -- 172.21.15.66:0/1543776423 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18422 (secure 0 0 0) 0x7f13180bc750 con 0x7f1324103640 2024-09-15T22:42:06.331 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:06.331 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:42:04.291111+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:42:06.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 msgr2=0x7f130c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 0x7f130c0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1314009990 tx=0x7f1314009110 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 msgr2=0x7f1324198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1318005ab0 tx=0x7f13180042f0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 shutdown_connections 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f132410c150 0x7f132419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1324103640 0x7f1324198a50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f130c0a3240 0x7f130c0a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 --2- 172.21.15.66:0/1543776423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1324102d20 0x7f1324198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 >> 172.21.15.66:0/1543776423 conn(0x7f13240fc780 msgr2=0x7f13240fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.331+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 shutdown_connections 2024-09-15T22:42:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:06.332+0000 7f13295f2640 1 -- 172.21.15.66:0/1543776423 wait complete. 2024-09-15T22:42:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:06 smithi087 ceph-mon[35290]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:06.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:06 smithi184 ceph-mon[35203]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:07.040 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:38:16.784964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:42:07.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T22:42:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:07 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1543776423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:42:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:07 smithi087 ceph-mon[35290]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:07.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:07 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1543776423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:42:07.614 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:07 smithi066 ceph-mon[31185]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:07 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1543776423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:42:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:07 smithi184 ceph-mon[35203]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 -- 172.21.15.66:0/119174603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 msgr2=0x7f6f3c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 --2- 172.21.15.66:0/119174603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c10d950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009cd0 tx=0x7f6f3402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 -- 172.21.15.66:0/119174603 shutdown_connections 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 --2- 172.21.15.66:0/119174603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c10d950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 --2- 172.21.15.66:0/119174603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c100a80 0x7f6f3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 --2- 172.21.15.66:0/119174603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c106a80 0x7f6f3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 -- 172.21.15.66:0/119174603 >> 172.21.15.66:0/119174603 conn(0x7f6f3c0fc7a0 msgr2=0x7f6f3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 -- 172.21.15.66:0/119174603 shutdown_connections 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.849+0000 7f6f444f3640 1 -- 172.21.15.66:0/119174603 wait complete. 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 Processor -- start 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 -- start start 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 0x7f6f3c0fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c106a80 0x7f6f3c0fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c110f20 con 0x7f6f3c101420 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c110da0 con 0x7f6f3c106a80 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f444f3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1110a0 con 0x7f6f3c100a80 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34444/0 (socket says 172.21.15.66:34444) 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 -- 172.21.15.66:0/3172337540 learned_addr learned my addr 172.21.15.66:0/3172337540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f4228f640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 0x7f6f3c0fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 -- 172.21.15.66:0/3172337540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 msgr2=0x7f6f3c0fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 0x7f6f3c0fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 -- 172.21.15.66:0/3172337540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c106a80 msgr2=0x7f6f3c0fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c106a80 0x7f6f3c0fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f41a8e640 1 -- 172.21.15.66:0/3172337540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c1a6a00 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.850+0000 7f6f4228f640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 0x7f6f3c0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f41a8e640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00b4a0 tx=0x7f6f2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c014070 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c1a6cf0 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f2c010af0 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c017d10 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.851+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3c1a71d0 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.852+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3c100f60 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.853+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6f2c017070 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.854+0000 7f6f337fe640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 0x7f6f280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.854+0000 7f6f4228f640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 0x7f6f280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.854+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6f2c0ce890 con 0x7f6f3c101420 2024-09-15T22:42:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.854+0000 7f6f4228f640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 0x7f6f280a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f38006fd0 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:07.858+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f2c09ba50 con 0x7f6f3c101420 2024-09-15T22:42:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.034+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f3c02d7c0 con 0x7f6f3c101420 2024-09-15T22:42:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.034+0000 7f6f337fe640 1 -- 172.21.15.66:0/3172337540 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f6f2c09b350 con 0x7f6f3c101420 2024-09-15T22:42:08.037 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 msgr2=0x7f6f280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 0x7f6f280a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f38006fd0 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 msgr2=0x7f6f3c0fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00b4a0 tx=0x7f6f2c00b960 comp rx=0 tx=0).stop 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 shutdown_connections 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6f280a3240 0x7f6f280a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f3c106a80 0x7f6f3c0fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f3c101420 0x7f6f3c0fd370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.036+0000 7f6f444f3640 1 --2- 172.21.15.66:0/3172337540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f3c100a80 0x7f6f3c0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.037+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 >> 172.21.15.66:0/3172337540 conn(0x7f6f3c0fc7a0 msgr2=0x7f6f3c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.037+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 shutdown_connections 2024-09-15T22:42:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:08.037+0000 7f6f444f3640 1 -- 172.21.15.66:0/3172337540 wait complete. 2024-09-15T22:42:08.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:08 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3172337540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:42:08.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:08 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3172337540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:42:08.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:08 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3172337540' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.a on smithi066 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.d on smithi066 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.g on smithi066 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.j on smithi066 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.b on smithi087 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.e on smithi087 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.h on smithi087 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.k on smithi087 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.c on smithi184 2024-09-15T22:42:08.834 INFO:tasks.cephadm:Adding mds.f on smithi184 2024-09-15T22:42:08.835 INFO:tasks.cephadm:Adding mds.i on smithi184 2024-09-15T22:42:08.835 INFO:tasks.cephadm:Adding mds.l on smithi184 2024-09-15T22:42:08.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l' 2024-09-15T22:42:09.094 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:42:09.470 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:09 smithi184 ceph-mon[35203]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:09.570 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 -- 172.21.15.184:0/2178372587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180102e00 msgr2=0x7f3180103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.570 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2178372587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180102e00 0x7f3180103280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317002a410 comp rx=0 tx=0).stop 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 -- 172.21.15.184:0/2178372587 shutdown_connections 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2178372587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31801037c0 0x7f318010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2178372587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180102e00 0x7f3180103280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2178372587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180101c00 0x7f3180102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 -- 172.21.15.184:0/2178372587 >> 172.21.15.184:0/2178372587 conn(0x7f31800fd390 msgr2=0x7f31800ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 -- 172.21.15.184:0/2178372587 shutdown_connections 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.551+0000 7f3184b2a640 1 -- 172.21.15.184:0/2178372587 wait complete. 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 Processor -- start 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 -- start start 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180101c00 0x7f3180197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180102e00 0x7f3180198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f318010d880 con 0x7f3180102e00 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f318010d700 con 0x7f3180101c00 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f3184b2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f318010da00 con 0x7f31801037c0 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f317ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f317ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:43552/0 (socket says 172.21.15.184:43552) 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.552+0000 7f317ed9d640 1 -- 172.21.15.184:0/2039577770 learned_addr learned my addr 172.21.15.184:0/2039577770 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317e59c640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180101c00 0x7f3180197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317dd9b640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180102e00 0x7f3180198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 -- 172.21.15.184:0/2039577770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180101c00 msgr2=0x7f3180197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180101c00 0x7f3180197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 -- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180102e00 msgr2=0x7f3180198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180102e00 0x7f3180198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 -- 172.21.15.184:0/2039577770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318019fb00 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f317ed9d640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f317800eaa0 tx=0x7f317800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317800cdb0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3178005020 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318019fdf0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31780116b0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.553+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31801a02f0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.554+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3180108fb0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.555+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3178005560 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.556+0000 7f31777fe640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 0x7f316c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.556+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f31780cf5c0 con 0x7f31801037c0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.556+0000 7f317e59c640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 0x7f316c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:09.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.557+0000 7f317e59c640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 0x7f316c0a57b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3180102c60 tx=0x7f316800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:09.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.560+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3178016030 con 0x7f31801037c0 2024-09-15T22:42:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:09 smithi087 ceph-mon[35290]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:09.676 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:09 smithi066 ceph-mon[31185]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:09.737 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.736+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}) -- 0x7f3180062830 con 0x7f316c0a32f0 2024-09-15T22:42:09.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.743+0000 7f31777fe640 1 -- 172.21.15.184:0/2039577770 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3180062830 con 0x7f316c0a32f0 2024-09-15T22:42:09.745 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mds.all update... 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 msgr2=0x7f316c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 0x7f316c0a57b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3180102c60 tx=0x7f316800b390 comp rx=0 tx=0).stop 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 msgr2=0x7f318019f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f317800eaa0 tx=0x7f317800ef60 comp rx=0 tx=0).stop 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 shutdown_connections 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31801037c0 0x7f318019f490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180102e00 0x7f3180198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f316c0a32f0 0x7f316c0a57b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 --2- 172.21.15.184:0/2039577770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180101c00 0x7f3180197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 >> 172.21.15.184:0/2039577770 conn(0x7f31800fd390 msgr2=0x7f3180106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 shutdown_connections 2024-09-15T22:42:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-15T22:42:09.745+0000 7f3184b2a640 1 -- 172.21.15.184:0/2039577770 wait complete. 2024-09-15T22:42:10.447 DEBUG:teuthology.orchestra.run.smithi066:mds.a> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T22:42:10.450 DEBUG:teuthology.orchestra.run.smithi066:mds.d> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T22:42:10.493 DEBUG:teuthology.orchestra.run.smithi066:mds.g> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T22:42:10.536 DEBUG:teuthology.orchestra.run.smithi066:mds.j> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T22:42:10.579 DEBUG:teuthology.orchestra.run.smithi087:mds.b> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T22:42:10.582 DEBUG:teuthology.orchestra.run.smithi087:mds.e> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T22:42:10.625 DEBUG:teuthology.orchestra.run.smithi087:mds.h> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T22:42:10.668 DEBUG:teuthology.orchestra.run.smithi087:mds.k> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T22:42:10.711 DEBUG:teuthology.orchestra.run.smithi184:mds.c> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T22:42:10.713 DEBUG:teuthology.orchestra.run.smithi184:mds.f> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T22:42:10.756 DEBUG:teuthology.orchestra.run.smithi184:mds.i> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T22:42:10.799 DEBUG:teuthology.orchestra.run.smithi184:mds.l> sudo journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T22:42:10.842 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T22:42:10.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:10.866 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:42:10.866 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: Saving service mds.all spec with placement smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-15T22:42:10.866 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:10.866 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:10.867 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:10 smithi066 ceph-mon[31185]: Deploying daemon mds.l on smithi184 2024-09-15T22:42:11.029 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:42:11.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: Saving service mds.all spec with placement smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-15T22:42:11.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:11.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:11.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:11.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:11.203 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:11.203 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:11.203 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:11.203 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:11.203 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:10 smithi184 ceph-mon[35203]: Deploying daemon mds.l on smithi184 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: Saving service mds.all spec with placement smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:11.204 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:11.205 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:11.205 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:11.205 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:11.205 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:10 smithi087 ceph-mon[35290]: Deploying daemon mds.l on smithi184 2024-09-15T22:42:11.205 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:11.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- 172.21.15.66:0/3396877356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110112b90 msgr2=0x7ff110114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- 172.21.15.66:0/3396877356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110112b90 0x7ff110114f80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff108009ca0 tx=0x7ff10802a950 comp rx=0 tx=0).stop 2024-09-15T22:42:11.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- 172.21.15.66:0/3396877356 shutdown_connections 2024-09-15T22:42:11.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- 172.21.15.66:0/3396877356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110112b90 0x7ff110114f80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- 172.21.15.66:0/3396877356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110074eb0 0x7ff110112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- 172.21.15.66:0/3396877356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff110074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- 172.21.15.66:0/3396877356 >> 172.21.15.66:0/3396877356 conn(0x7ff1100fd8c0 msgr2=0x7ff1100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- 172.21.15.66:0/3396877356 shutdown_connections 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- 172.21.15.66:0/3396877356 wait complete. 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 Processor -- start 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- start start 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff1101a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110112b90 0x7ff11019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff1101185a0 con 0x7ff110074eb0 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff110118420 con 0x7ff110074590 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.573+0000 7ff115787640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff110118720 con 0x7ff110112b90 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34476/0 (socket says 172.21.15.66:34476) 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 -- 172.21.15.66:0/1654800689 learned_addr learned my addr 172.21.15.66:0/1654800689 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:11.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10f7fe640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110112b90 0x7ff11019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10effd640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff1101a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 -- 172.21.15.66:0/1654800689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110112b90 msgr2=0x7ff11019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110112b90 0x7ff11019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 -- 172.21.15.66:0/1654800689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 msgr2=0x7ff1101a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff1101a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 -- 172.21.15.66:0/1654800689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11019ef90 con 0x7ff110074eb0 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10effd640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff1101a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff107fff640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800d950 tx=0x7ff0f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8017070 con 0x7ff110074eb0 2024-09-15T22:42:11.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11019f280 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0f8009c30 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800f6b0 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.574+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1101ab4d0 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.575+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff110075cd0 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.576+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff0f80109d0 con 0x7ff110074eb0 2024-09-15T22:42:11.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.577+0000 7ff10cff9640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 0x7ff0fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:11.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.577+0000 7ff10effd640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 0x7ff0fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:11.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.577+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff0f80cf000 con 0x7ff110074eb0 2024-09-15T22:42:11.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.578+0000 7ff10effd640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 0x7ff0fc0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff10000abe0 tx=0x7ff10000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:11.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.582+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0f8009de0 con 0x7ff110074eb0 2024-09-15T22:42:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.793+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1101ab700 con 0x7ff110074eb0 2024-09-15T22:42:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.794+0000 7ff10cff9640 1 -- 172.21.15.66:0/1654800689 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff0f809c1c0 con 0x7ff110074eb0 2024-09-15T22:42:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:11.798 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":1,"btime":"2024-09-15T22:35:13:921866+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T22:42:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 1 2024-09-15T22:42:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 msgr2=0x7ff0fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 0x7ff0fc0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff10000abe0 tx=0x7ff10000a5c0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 msgr2=0x7ff1101a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800d950 tx=0x7ff0f800de10 comp rx=0 tx=0).stop 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 shutdown_connections 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff110112b90 0x7ff11019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff110074eb0 0x7ff1101a4bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff0fc0a3240 0x7ff0fc0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 --2- 172.21.15.66:0/1654800689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff110074590 0x7ff1101a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 >> 172.21.15.66:0/1654800689 conn(0x7ff1100fd8c0 msgr2=0x7ff1100feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 shutdown_connections 2024-09-15T22:42:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:11.796+0000 7ff115787640 1 -- 172.21.15.66:0/1654800689 wait complete. 2024-09-15T22:42:12.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:12 smithi184 ceph-mon[35203]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:12.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:12 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1654800689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:12.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:12 smithi066 ceph-mon[31185]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:12.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:12 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1654800689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:12.556 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 22:42:12 smithi184 podman[64308]: 2024-09-15 22:42:12.532759802 +0000 UTC m=+0.356136090 container start 175baf2129576c32a35207e64e0fa3487258052de6160ee4f5f1c9acb69650ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T22:42:12.556 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 22:42:12 smithi184 ceph-mds[64327]: -- 172.21.15.184:0/3271777350 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55865b725860 con 0x55865b702800 2024-09-15T22:42:12.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:12 smithi087 ceph-mon[35290]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:12.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:12 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1654800689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:12.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 22:42:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: starting mds.l at 2024-09-15T22:42:12.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 22:42:12 smithi184 bash[64308]: 175baf2129576c32a35207e64e0fa3487258052de6160ee4f5f1c9acb69650ed 2024-09-15T22:42:12.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 22:42:12 smithi184 systemd[1]: Started Ceph mds.l for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6832/1400845283,v1:172.21.15.184:6833/1400845283] up:boot 2024-09-15T22:42:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: fsmap 1 up:standby 2024-09-15T22:42:13.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:13.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:13 smithi087 ceph-mon[35290]: Deploying daemon mds.k on smithi087 2024-09-15T22:42:13.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:13.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6832/1400845283,v1:172.21.15.184:6833/1400845283] up:boot 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: fsmap 1 up:standby 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:13.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:13 smithi184 ceph-mon[35203]: Deploying daemon mds.k on smithi087 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6832/1400845283,v1:172.21.15.184:6833/1400845283] up:boot 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: fsmap 1 up:standby 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:13.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:13 smithi066 ceph-mon[31185]: Deploying daemon mds.k on smithi087 2024-09-15T22:42:14.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:14.884 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:15.065 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:14 smithi087 systemd[1]: Starting Ceph mds.k for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:15.323 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 podman[64541]: 2024-09-15 22:42:14.965446623 +0000 UTC m=+0.015863728 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:15.323 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 podman[64541]: 2024-09-15 22:42:15.078472098 +0000 UTC m=+0.128889188 container create ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T22:42:15.324 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 podman[64541]: 2024-09-15 22:42:15.322803138 +0000 UTC m=+0.373220229 container init ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 -- 172.21.15.66:0/479230234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec10c170 msgr2=0x7fcaec10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 --2- 172.21.15.66:0/479230234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec10c170 0x7fcaec10e610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009ca0 tx=0x7fcae402a950 comp rx=0 tx=0).stop 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 -- 172.21.15.66:0/479230234 shutdown_connections 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 --2- 172.21.15.66:0/479230234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec10c170 0x7fcaec10e610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 --2- 172.21.15.66:0/479230234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec103660 0x7fcaec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 --2- 172.21.15.66:0/479230234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec102d40 0x7fcaec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 -- 172.21.15.66:0/479230234 >> 172.21.15.66:0/479230234 conn(0x7fcaec0fc7a0 msgr2=0x7fcaec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 -- 172.21.15.66:0/479230234 shutdown_connections 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 -- 172.21.15.66:0/479230234 wait complete. 2024-09-15T22:42:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.423+0000 7fcaf29de640 1 Processor -- start 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 -- start start 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 0x7fcaec100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec10c170 0x7fcaec101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec111f70 con 0x7fcaec102d40 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec111df0 con 0x7fcaec10c170 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf29de640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec1120f0 con 0x7fcaec103660 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58196/0 (socket says 172.21.15.66:58196) 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 -- 172.21.15.66:0/1693713179 learned_addr learned my addr 172.21.15.66:0/1693713179 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaeb7fe640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 0x7fcaec100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaf0f7b640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec10c170 0x7fcaec101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 -- 172.21.15.66:0/1693713179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 msgr2=0x7fcaec100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 0x7fcaec100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 -- 172.21.15.66:0/1693713179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec10c170 msgr2=0x7fcaec101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec10c170 0x7fcaec101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaebfff640 1 -- 172.21.15.66:0/1693713179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec1a68d0 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.424+0000 7fcaeb7fe640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 0x7fcaec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcaebfff640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d770 tx=0x7fcadc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc017070 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcadc005500 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec1a6bc0 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc004e00 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.425+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec1a7100 con 0x7fcaec102d40 2024-09-15T22:42:15.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.426+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec103120 con 0x7fcaec102d40 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.427+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcadc004fa0 con 0x7fcaec102d40 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.428+0000 7fcae97fa640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 0x7fcad40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.428+0000 7fcaeb7fe640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 0x7fcad40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.428+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fcadc0ceee0 con 0x7fcaec102d40 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.428+0000 7fcaeb7fe640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 0x7fcad40a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaec102430 tx=0x7fcae0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.432+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcadc09c0a0 con 0x7fcaec102d40 2024-09-15T22:42:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 podman[64541]: 2024-09-15 22:42:15.325952108 +0000 UTC m=+0.376369210 container start ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:42:15.600 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-mds[64560]: -- 172.21.15.87:0/1430873692 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e42bdf1860 con 0x55e42bdcf000 2024-09-15T22:42:15.601 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: starting mds.k at 2024-09-15T22:42:15.601 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 bash[64541]: ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac 2024-09-15T22:42:15.601 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 22:42:15 smithi087 systemd[1]: Started Ceph mds.k for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:15.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.647+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaec1a73e0 con 0x7fcaec102d40 2024-09-15T22:42:15.649 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:15.650 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:15 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:15.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.647+0000 7fcae97fa640 1 -- 172.21.15.66:0/1693713179 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fcadc09b9a0 con 0x7fcaec102d40 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":3,"btime":"2024-09-15T22:42:15:565460+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:42:15.651 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 3 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 msgr2=0x7fcad40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 0x7fcad40a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaec102430 tx=0x7fcae0005f90 comp rx=0 tx=0).stop 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 msgr2=0x7fcaec1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:15.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d770 tx=0x7fcadc00dc30 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 shutdown_connections 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fcad40a32c0 0x7fcad40a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaec10c170 0x7fcaec101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaec103660 0x7fcaec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 --2- 172.21.15.66:0/1693713179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaec102d40 0x7fcaec1009a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 >> 172.21.15.66:0/1693713179 conn(0x7fcaec0fc7a0 msgr2=0x7fcaec0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 shutdown_connections 2024-09-15T22:42:15.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:15.650+0000 7fcaf29de640 1 -- 172.21.15.66:0/1693713179 wait complete. 2024-09-15T22:42:15.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:15.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:15.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:15 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:16.697 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:16 smithi066 ceph-mon[31185]: Deploying daemon mds.j on smithi066 2024-09-15T22:42:16.697 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:16 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6832/3190263553,v1:172.21.15.87:6833/3190263553] up:boot 2024-09-15T22:42:16.697 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:16 smithi066 ceph-mon[31185]: fsmap 2 up:standby 2024-09-15T22:42:16.697 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:16 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:42:16.697 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:16 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1693713179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:16.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:16 smithi087 ceph-mon[35290]: Deploying daemon mds.j on smithi066 2024-09-15T22:42:16.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:16 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6832/3190263553,v1:172.21.15.87:6833/3190263553] up:boot 2024-09-15T22:42:16.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:16 smithi087 ceph-mon[35290]: fsmap 2 up:standby 2024-09-15T22:42:16.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:16 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:42:16.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:16 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1693713179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:16.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:16 smithi184 ceph-mon[35203]: Deploying daemon mds.j on smithi066 2024-09-15T22:42:16.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:16 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6832/3190263553,v1:172.21.15.87:6833/3190263553] up:boot 2024-09-15T22:42:16.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:16 smithi184 ceph-mon[35203]: fsmap 2 up:standby 2024-09-15T22:42:16.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:16 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:42:16.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:16 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1693713179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:17.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:17 smithi087 ceph-mon[35290]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:17.874 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:17 smithi066 ceph-mon[31185]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:17.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:17 smithi184 ceph-mon[35203]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:18.199 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 systemd[1]: Starting Ceph mds.j for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:18.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:18.546 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 podman[70698]: 2024-09-15 22:42:18.174065021 +0000 UTC m=+0.016656891 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:18.546 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 podman[70698]: 2024-09-15 22:42:18.292165529 +0000 UTC m=+0.134757387 container create 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:42:18.546 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 podman[70698]: 2024-09-15 22:42:18.544928267 +0000 UTC m=+0.387520126 container init 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:42:18.717 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:18.840 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 podman[70698]: 2024-09-15 22:42:18.548581372 +0000 UTC m=+0.391173231 container start 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e) 2024-09-15T22:42:18.841 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 ceph-mds[70735]: -- 172.21.15.66:0/2577882850 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640ac361860 con 0x5640ac33f400 2024-09-15T22:42:18.841 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j[70716]: starting mds.j at 2024-09-15T22:42:18.841 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 bash[70698]: 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 2024-09-15T22:42:18.841 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 22:42:18 smithi066 systemd[1]: Started Ceph mds.j for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:19.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 -- 172.21.15.66:0/278480973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 msgr2=0x7f0f20100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:19.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/278480973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f20100ee0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009930 tx=0x7f0f0802a420 comp rx=0 tx=0).stop 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 -- 172.21.15.66:0/278480973 shutdown_connections 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/278480973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20101420 0x7f0f2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/278480973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f20100ee0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/278480973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20106a80 0x7f0f20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 -- 172.21.15.66:0/278480973 >> 172.21.15.66:0/278480973 conn(0x7f0f200fc7a0 msgr2=0x7f0f200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:19.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 -- 172.21.15.66:0/278480973 shutdown_connections 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.223+0000 7f0f24ca9640 1 -- 172.21.15.66:0/278480973 wait complete. 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 Processor -- start 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 -- start start 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20101420 0x7f0f20198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:19.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20106a80 0x7f0f2019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:19.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20110e80 con 0x7f0f20100a80 2024-09-15T22:42:19.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20110d00 con 0x7f0f20106a80 2024-09-15T22:42:19.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f24ca9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20111000 con 0x7f0f20101420 2024-09-15T22:42:19.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f1e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:19.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f1e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58244/0 (socket says 172.21.15.66:58244) 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.224+0000 7f0f1e59c640 1 -- 172.21.15.66:0/3807054990 learned_addr learned my addr 172.21.15.66:0/3807054990 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1dd9b640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20101420 0x7f0f20198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 -- 172.21.15.66:0/3807054990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20101420 msgr2=0x7f0f20198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20101420 0x7f0f20198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1ed9d640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20106a80 0x7f0f2019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:19.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 -- 172.21.15.66:0/3807054990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20106a80 msgr2=0x7f0f2019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20106a80 0x7f0f2019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 -- 172.21.15.66:0/3807054990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2019d380 con 0x7f0f20100a80 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f1e59c640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800cce0 tx=0x7f0f1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004b20 con 0x7f0f20100a80 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f18004cc0 con 0x7f0f20100a80 2024-09-15T22:42:19.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2019d670 con 0x7f0f20100a80 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800f8c0 con 0x7f0f20100a80 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.225+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f201a4f50 con 0x7f0f20100a80 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.226+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20100ee0 con 0x7f0f20100a80 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.227+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0f1800fa60 con 0x7f0f20100a80 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.228+0000 7f0f177fe640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 0x7f0f0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:19.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.228+0000 7f0f1dd9b640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 0x7f0f0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:19.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.228+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0f180cf580 con 0x7f0f20100a80 2024-09-15T22:42:19.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.229+0000 7f0f1dd9b640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 0x7f0f0c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f080096c0 tx=0x7f0f08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:19.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.233+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f18014030 con 0x7f0f20100a80 2024-09-15T22:42:19.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.452+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f20109a70 con 0x7f0f20100a80 2024-09-15T22:42:19.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.452+0000 7f0f177fe640 1 -- 172.21.15.66:0/3807054990 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f0f1809c740 con 0x7f0f20100a80 2024-09-15T22:42:19.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:19.455 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":3,"btime":"2024-09-15T22:42:15:565460+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:42:19.455 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 3 2024-09-15T22:42:19.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 msgr2=0x7f0f0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 0x7f0f0c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f080096c0 tx=0x7f0f08000bc0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 msgr2=0x7f0f201983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800cce0 tx=0x7f0f1800a620 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 shutdown_connections 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0f0c0a3240 0x7f0f0c0a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f20106a80 0x7f0f2019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f20101420 0x7f0f20198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 --2- 172.21.15.66:0/3807054990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f20100a80 0x7f0f201983d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 >> 172.21.15.66:0/3807054990 conn(0x7f0f200fc7a0 msgr2=0x7f0f2006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 shutdown_connections 2024-09-15T22:42:19.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:19.455+0000 7f0f24ca9640 1 -- 172.21.15.66:0/3807054990 wait complete. 2024-09-15T22:42:19.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:19.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:19.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:19.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:19.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: Deploying daemon mds.d on smithi066 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3807054990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6834/2455952425,v1:172.21.15.66:6835/2455952425] up:boot 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: fsmap 3 up:standby 2024-09-15T22:42:19.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:19 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:42:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:20.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:20.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:20.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: Deploying daemon mds.d on smithi066 2024-09-15T22:42:20.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3807054990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:20.101 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6834/2455952425,v1:172.21.15.66:6835/2455952425] up:boot 2024-09-15T22:42:20.102 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: fsmap 3 up:standby 2024-09-15T22:42:20.102 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:19 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:42:20.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: Deploying daemon mds.d on smithi066 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3807054990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6834/2455952425,v1:172.21.15.66:6835/2455952425] up:boot 2024-09-15T22:42:20.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: fsmap 3 up:standby 2024-09-15T22:42:20.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:19 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:42:21.699 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:21 smithi066 systemd[1]: Starting Ceph mds.d for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:21.961 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:21 smithi066 podman[71113]: 2024-09-15 22:42:21.718909171 +0000 UTC m=+0.016688095 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:21.961 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:21 smithi066 podman[71113]: 2024-09-15 22:42:21.833105045 +0000 UTC m=+0.130884000 container create 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T22:42:21.961 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:21 smithi066 ceph-mon[31185]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:22.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:21 smithi087 ceph-mon[35290]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:21 smithi184 ceph-mon[35203]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:22.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 podman[71113]: 2024-09-15 22:42:22.085733003 +0000 UTC m=+0.383511915 container init 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 podman[71113]: 2024-09-15 22:42:22.088654601 +0000 UTC m=+0.386433514 container start 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 ceph-mds[71133]: -- 172.21.15.66:0/2097201137 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561dff87d860 con 0x561dff85b000 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d[71129]: starting mds.d at 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 bash[71113]: 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff 2024-09-15T22:42:22.341 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 22:42:22 smithi066 systemd[1]: Started Ceph mds.d for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:22.576 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 -- 172.21.15.66:0/3618691227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30112ba0 msgr2=0x7f1d30114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/3618691227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30112ba0 0x7f1d30114f90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009ca0 tx=0x7f1d2802a950 comp rx=0 tx=0).stop 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 -- 172.21.15.66:0/3618691227 shutdown_connections 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/3618691227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30112ba0 0x7f1d30114f90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/3618691227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30074eb0 0x7f1d30112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/3618691227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074590 0x7f1d30074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.074+0000 7f1d37e5a640 1 -- 172.21.15.66:0/3618691227 >> 172.21.15.66:0/3618691227 conn(0x7f1d300fd8b0 msgr2=0x7f1d300ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.075+0000 7f1d37e5a640 1 -- 172.21.15.66:0/3618691227 shutdown_connections 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.075+0000 7f1d37e5a640 1 -- 172.21.15.66:0/3618691227 wait complete. 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.075+0000 7f1d37e5a640 1 Processor -- start 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.075+0000 7f1d37e5a640 1 -- start start 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 0x7f1d301a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30112ba0 0x7f1d3019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d30118560 con 0x7f1d30074590 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d301183e0 con 0x7f1d30112ba0 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d301186e0 con 0x7f1d30074eb0 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37452/0 (socket says 172.21.15.66:37452) 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 -- 172.21.15.66:0/2603690502 learned_addr learned my addr 172.21.15.66:0/2603690502 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d363f7640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30112ba0 0x7f1d3019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d353f5640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 0x7f1d301a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 -- 172.21.15.66:0/2603690502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 msgr2=0x7f1d301a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 0x7f1d301a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 -- 172.21.15.66:0/2603690502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30112ba0 msgr2=0x7f1d3019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30112ba0 0x7f1d3019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 -- 172.21.15.66:0/2603690502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3019efc0 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d353f5640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 0x7f1d301a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d35bf6640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d950 tx=0x7f1d2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d2c009c30 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3019f2b0 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00f6b0 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.076+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d301ab5a0 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.078+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d30074970 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.079+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d2c0109d0 con 0x7f1d30074590 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.079+0000 7f1d26ffd640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 0x7f1d1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.079+0000 7f1d353f5640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 0x7f1d1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.080+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1d2c0cf0b0 con 0x7f1d30074590 2024-09-15T22:42:23.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.080+0000 7f1d353f5640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 0x7f1d1c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005e00 tx=0x7f1d20005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:23.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.082+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d2c009de0 con 0x7f1d30074590 2024-09-15T22:42:23.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.299+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d301ab8d0 con 0x7f1d30074590 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: Deploying daemon mds.e on smithi087 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6836/3213913697,v1:172.21.15.66:6837/3213913697] up:boot 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: fsmap 4 up:standby 2024-09-15T22:42:23.301 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:23 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:42:23.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.299+0000 7f1d26ffd640 1 -- 172.21.15.66:0/2603690502 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f1d2c09c270 con 0x7f1d30074590 2024-09-15T22:42:23.302 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:23.302 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":5,"btime":"2024-09-15T22:42:22:700407+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T22:42:23.302 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 5 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 msgr2=0x7f1d1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 0x7f1d1c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005e00 tx=0x7f1d20005c70 comp rx=0 tx=0).stop 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 msgr2=0x7f1d301a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d950 tx=0x7f1d2c00de10 comp rx=0 tx=0).stop 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 shutdown_connections 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1d1c0a3240 0x7f1d1c0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d30112ba0 0x7f1d3019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d30074eb0 0x7f1d301a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 --2- 172.21.15.66:0/2603690502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d30074590 0x7f1d301a46d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:23.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 >> 172.21.15.66:0/2603690502 conn(0x7f1d300fd8b0 msgr2=0x7f1d300ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:23.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 shutdown_connections 2024-09-15T22:42:23.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:23.302+0000 7f1d37e5a640 1 -- 172.21.15.66:0/2603690502 wait complete. 2024-09-15T22:42:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: Deploying daemon mds.e on smithi087 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6836/3213913697,v1:172.21.15.66:6837/3213913697] up:boot 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: fsmap 4 up:standby 2024-09-15T22:42:23.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:23 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:42:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: Deploying daemon mds.e on smithi087 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6836/3213913697,v1:172.21.15.66:6837/3213913697] up:boot 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: fsmap 4 up:standby 2024-09-15T22:42:23.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:23 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:42:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:24 smithi066 ceph-mon[31185]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:24.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2603690502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:24.523 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:24 smithi087 ceph-mon[35290]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:24.524 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:24 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2603690502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:24.524 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 systemd[1]: Starting Ceph mds.e for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:24.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:24 smithi184 ceph-mon[35203]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:24.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:24 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2603690502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:24.780 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 podman[64851]: 2024-09-15 22:42:24.425473401 +0000 UTC m=+0.016031364 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:24.780 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 podman[64851]: 2024-09-15 22:42:24.551684672 +0000 UTC m=+0.142242679 container create 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T22:42:24.780 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 podman[64851]: 2024-09-15 22:42:24.779583812 +0000 UTC m=+0.370141763 container init 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T22:42:25.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 podman[64851]: 2024-09-15 22:42:24.782465094 +0000 UTC m=+0.373023047 container start 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T22:42:25.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 ceph-mds[64871]: -- 172.21.15.87:0/1112004968 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556750b21860 con 0x556750afe800 2024-09-15T22:42:25.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-15T22:42:25.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 bash[64851]: 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a 2024-09-15T22:42:25.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 22:42:24 smithi087 systemd[1]: Started Ceph mds.e for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:26.120 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:26.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:26.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: Deploying daemon mds.f on smithi184 2024-09-15T22:42:26.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6834/1324797641,v1:172.21.15.87:6835/1324797641] up:boot 2024-09-15T22:42:26.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: fsmap 5 up:standby 2024-09-15T22:42:26.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:25 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:42:26.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:26.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: Deploying daemon mds.f on smithi184 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6834/1324797641,v1:172.21.15.87:6835/1324797641] up:boot 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: fsmap 5 up:standby 2024-09-15T22:42:26.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:25 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:42:26.393 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:26.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:26.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:26.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: Deploying daemon mds.f on smithi184 2024-09-15T22:42:26.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6834/1324797641,v1:172.21.15.87:6835/1324797641] up:boot 2024-09-15T22:42:26.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: fsmap 5 up:standby 2024-09-15T22:42:26.408 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:25 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:42:26.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 -- 172.21.15.66:0/2349036049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102ef0 msgr2=0x7f1d0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2349036049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102ef0 0x7f1d0810da40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009ca0 tx=0x7f1d0002a950 comp rx=0 tx=0).stop 2024-09-15T22:42:26.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 -- 172.21.15.66:0/2349036049 shutdown_connections 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2349036049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102ef0 0x7f1d0810da40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2349036049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08102570 0x7f1d081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2349036049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08100e20 0x7f1d08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 -- 172.21.15.66:0/2349036049 >> 172.21.15.66:0/2349036049 conn(0x7f1d080fc7d0 msgr2=0x7f1d080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 -- 172.21.15.66:0/2349036049 shutdown_connections 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.900+0000 7f1d0e324640 1 -- 172.21.15.66:0/2349036049 wait complete. 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 Processor -- start 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 -- start start 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08100e20 0x7f1d08198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08102ef0 0x7f1d0819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08110f80 con 0x7f1d08102570 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08110e00 con 0x7f1d08102ef0 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1d0e324640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08111100 con 0x7f1d08100e20 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.901+0000 7f1cfffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37484/0 (socket says 172.21.15.66:37484) 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 -- 172.21.15.66:0/2450670159 learned_addr learned my addr 172.21.15.66:0/2450670159 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d07fff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08100e20 0x7f1d08198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d0c8c1640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08102ef0 0x7f1d0819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 -- 172.21.15.66:0/2450670159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08100e20 msgr2=0x7f1d08198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08100e20 0x7f1d08198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 -- 172.21.15.66:0/2450670159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08102ef0 msgr2=0x7f1d0819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08102ef0 0x7f1d0819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 -- 172.21.15.66:0/2450670159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0819d440 con 0x7f1d08102570 2024-09-15T22:42:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1cfffff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e9f0 tx=0x7f1cf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000ccc0 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf000ce60 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0819d730 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0010690 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.902+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081a5010 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.903+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08101200 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.905+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1cf00046c0 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.905+0000 7f1d05ffb640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 0x7f1cf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.906+0000 7f1d07fff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 0x7f1cf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.906+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1cf00cfa50 con 0x7f1d08102570 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.906+0000 7f1d07fff640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 0x7f1cf40a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800abe0 tx=0x7f1cf800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:26.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:26.908+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cf00541b0 con 0x7f1d08102570 2024-09-15T22:42:27.084 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:26 smithi184 systemd[1]: Starting Ceph mds.f for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.122+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d081997f0 con 0x7f1d08102570 2024-09-15T22:42:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.123+0000 7f1d05ffb640 1 -- 172.21.15.66:0/2450670159 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f1d081997f0 con 0x7f1d08102570 2024-09-15T22:42:27.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:27.124 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":6,"btime":"2024-09-15T22:42:25:249458+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-15T22:42:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 6 2024-09-15T22:42:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 msgr2=0x7f1cf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 0x7f1cf40a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800abe0 tx=0x7f1cf800a2d0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 msgr2=0x7f1d081989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e9f0 tx=0x7f1cf000edf0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 shutdown_connections 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1cf40a3240 0x7f1cf40a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d08102ef0 0x7f1d0819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d08102570 0x7f1d081989d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 --2- 172.21.15.66:0/2450670159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d08100e20 0x7f1d08198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 >> 172.21.15.66:0/2450670159 conn(0x7f1d080fc7d0 msgr2=0x7f1d0806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.126+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 shutdown_connections 2024-09-15T22:42:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:27.127+0000 7f1d0e324640 1 -- 172.21.15.66:0/2450670159 wait complete. 2024-09-15T22:42:27.370 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 podman[64607]: 2024-09-15 22:42:26.985219897 +0000 UTC m=+0.015567551 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:27.371 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 podman[64607]: 2024-09-15 22:42:27.125925072 +0000 UTC m=+0.156272725 container create f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:42:27.371 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 podman[64607]: 2024-09-15 22:42:27.370308604 +0000 UTC m=+0.400656259 container init f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:42:27.672 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 podman[64607]: 2024-09-15 22:42:27.373196983 +0000 UTC m=+0.403544641 container start f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-15T22:42:27.672 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mds[64626]: -- 172.21.15.184:0/4078637347 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55920bc21c20 con 0x55920bbff400 2024-09-15T22:42:27.673 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: starting mds.f at 2024-09-15T22:42:27.673 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 bash[64607]: f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a 2024-09-15T22:42:27.673 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 22:42:27 smithi184 systemd[1]: Started Ceph mds.f for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:28.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:28.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2450670159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:28.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:27 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2450670159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:27 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2450670159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:28.216 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:28.217 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:27 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:29.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:28 smithi184 ceph-mon[35203]: Deploying daemon mds.c on smithi184 2024-09-15T22:42:29.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:28 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:boot 2024-09-15T22:42:29.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:28 smithi184 ceph-mon[35203]: fsmap 6 up:standby 2024-09-15T22:42:29.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:28 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:42:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:28 smithi066 ceph-mon[31185]: Deploying daemon mds.c on smithi184 2024-09-15T22:42:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:28 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:boot 2024-09-15T22:42:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:28 smithi066 ceph-mon[31185]: fsmap 6 up:standby 2024-09-15T22:42:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:28 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:42:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:28 smithi087 ceph-mon[35290]: Deploying daemon mds.c on smithi184 2024-09-15T22:42:29.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:28 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:boot 2024-09-15T22:42:29.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:28 smithi087 ceph-mon[35290]: fsmap 6 up:standby 2024-09-15T22:42:29.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:28 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:42:29.605 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 systemd[1]: Starting Ceph mds.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:29.885 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:29.901 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 podman[64908]: 2024-09-15 22:42:29.508269061 +0000 UTC m=+0.016111947 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:29.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 podman[64908]: 2024-09-15 22:42:29.614729829 +0000 UTC m=+0.122572756 container create 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T22:42:29.902 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 podman[64908]: 2024-09-15 22:42:29.901014527 +0000 UTC m=+0.408857413 container init 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:42:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:29 smithi184 ceph-mon[35203]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:30.173 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 podman[64908]: 2024-09-15 22:42:29.904279549 +0000 UTC m=+0.412122434 container start 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:42:30.173 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 ceph-mds[64927]: -- 172.21.15.184:0/1693594091 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7b6eeb860 con 0x55e7b6ec8800 2024-09-15T22:42:30.173 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: starting mds.c at 2024-09-15T22:42:30.173 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 bash[64908]: 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab 2024-09-15T22:42:30.173 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 22:42:29 smithi184 systemd[1]: Started Ceph mds.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:30.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:29 smithi066 ceph-mon[31185]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:29 smithi087 ceph-mon[35290]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 -- 172.21.15.66:0/3750010361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204100a80 msgr2=0x7f6204100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 --2- 172.21.15.66:0/3750010361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204100a80 0x7f6204100ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009930 tx=0x7f61f402a420 comp rx=0 tx=0).stop 2024-09-15T22:42:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 -- 172.21.15.66:0/3750010361 shutdown_connections 2024-09-15T22:42:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 --2- 172.21.15.66:0/3750010361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204101420 0x7f620410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 --2- 172.21.15.66:0/3750010361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204100a80 0x7f6204100ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 --2- 172.21.15.66:0/3750010361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204106a80 0x7f6204106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 -- 172.21.15.66:0/3750010361 >> 172.21.15.66:0/3750010361 conn(0x7f62040fc7a0 msgr2=0x7f62040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 -- 172.21.15.66:0/3750010361 shutdown_connections 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.659+0000 7f620beb0640 1 -- 172.21.15.66:0/3750010361 wait complete. 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 Processor -- start 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 -- start start 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 0x7f6204197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 0x7f620419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6204110e40 con 0x7f6204101420 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6204110cc0 con 0x7f6204106a80 2024-09-15T22:42:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620beb0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6204110fc0 con 0x7f6204100a80 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620944b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620944b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37514/0 (socket says 172.21.15.66:37514) 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620944b640 1 -- 172.21.15.66:0/1603009195 learned_addr learned my addr 172.21.15.66:0/1603009195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f6209c4c640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 0x7f6204197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.660+0000 7f620a44d640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 0x7f620419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 -- 172.21.15.66:0/1603009195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 msgr2=0x7f6204197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 0x7f6204197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 -- 172.21.15.66:0/1603009195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 msgr2=0x7f620419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 0x7f620419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 -- 172.21.15.66:0/1603009195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620419c2b0 con 0x7f6204101420 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f6209c4c640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 0x7f6204197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620a44d640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 0x7f620419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:30.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620944b640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009230 tx=0x7f61f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f403f030 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f4003ad0 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620419c540 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4035070 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.661+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62041a3e80 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.662+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6204100ee0 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.663+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f61f4042030 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.664+0000 7f61faffd640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 0x7f61f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.664+0000 7f6209c4c640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 0x7f61f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.664+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f61f40efaf0 con 0x7f6204101420 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.664+0000 7f6209c4c640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 0x7f61f00a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6200005e10 tx=0x7f6200005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.668+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61f40bccb0 con 0x7f6204101420 2024-09-15T22:42:30.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.881+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6204198660 con 0x7f6204101420 2024-09-15T22:42:30.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.882+0000 7f61faffd640 1 -- 172.21.15.66:0/1603009195 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f6204198660 con 0x7f6204101420 2024-09-15T22:42:30.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:30.884 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":8,"btime":"2024-09-15T22:42:29:942475+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T22:42:30.884 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 8 2024-09-15T22:42:30.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 msgr2=0x7f61f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 0x7f61f00a5780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6200005e10 tx=0x7f6200005da0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 msgr2=0x7f6204197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009230 tx=0x7f61f4004270 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 shutdown_connections 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61f00a32c0 0x7f61f00a5780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6204106a80 0x7f620419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6204101420 0x7f6204197840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 --2- 172.21.15.66:0/1603009195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6204100a80 0x7f6204197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 >> 172.21.15.66:0/1603009195 conn(0x7f62040fc7a0 msgr2=0x7f62040fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 shutdown_connections 2024-09-15T22:42:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:30.884+0000 7f620beb0640 1 -- 172.21.15.66:0/1603009195 wait complete. 2024-09-15T22:42:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:boot 2024-09-15T22:42:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: fsmap 7 up:standby 2024-09-15T22:42:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:42:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: Deploying daemon mds.h on smithi087 2024-09-15T22:42:31.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:30 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1603009195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:boot 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: fsmap 7 up:standby 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:31.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:31.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:31.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: Deploying daemon mds.h on smithi087 2024-09-15T22:42:31.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:30 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1603009195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:boot 2024-09-15T22:42:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: fsmap 7 up:standby 2024-09-15T22:42:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:42:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: Deploying daemon mds.h on smithi087 2024-09-15T22:42:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:30 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1603009195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:32.300 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:32 smithi087 ceph-mon[35290]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:32.300 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 systemd[1]: Starting Ceph mds.h for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:32.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:32 smithi184 ceph-mon[35203]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:32.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:32 smithi066 ceph-mon[31185]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:32.587 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 podman[65157]: 2024-09-15 22:42:32.201569746 +0000 UTC m=+0.015935978 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:32.587 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 podman[65157]: 2024-09-15 22:42:32.329898582 +0000 UTC m=+0.144264809 container create 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:42:32.587 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 podman[65157]: 2024-09-15 22:42:32.586594477 +0000 UTC m=+0.400960705 container init 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:42:32.849 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 podman[65157]: 2024-09-15 22:42:32.589507177 +0000 UTC m=+0.403873410 container start 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:42:32.849 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 ceph-mds[65176]: -- 172.21.15.87:0/1167914588 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d0a819860 con 0x563d0a7f6800 2024-09-15T22:42:32.849 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: starting mds.h at 2024-09-15T22:42:32.849 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 bash[65157]: 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 2024-09-15T22:42:32.850 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 22:42:32 smithi087 systemd[1]: Started Ceph mds.h for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:33.588 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:33.860 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:33.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: Deploying daemon mds.i on smithi184 2024-09-15T22:42:33.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:boot 2024-09-15T22:42:33.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: fsmap 8 up:standby 2024-09-15T22:42:33.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:33 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:42:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: Deploying daemon mds.i on smithi184 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:boot 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: fsmap 8 up:standby 2024-09-15T22:42:34.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:33 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:42:34.135 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:34.135 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.135 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.135 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: Deploying daemon mds.i on smithi184 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:boot 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: fsmap 8 up:standby 2024-09-15T22:42:34.136 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:33 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:42:34.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 -- 172.21.15.66:0/3716459790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658103780 msgr2=0x7f5658107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 --2- 172.21.15.66:0/3716459790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658103780 0x7f5658107bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f564c009930 tx=0x7f564c02a420 comp rx=0 tx=0).stop 2024-09-15T22:42:34.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 -- 172.21.15.66:0/3716459790 shutdown_connections 2024-09-15T22:42:34.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 --2- 172.21.15.66:0/3716459790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 0x7f565810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 --2- 172.21.15.66:0/3716459790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658103780 0x7f5658107bc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 --2- 172.21.15.66:0/3716459790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658102dd0 0x7f56581031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 -- 172.21.15.66:0/3716459790 >> 172.21.15.66:0/3716459790 conn(0x7f56580fc7d0 msgr2=0x7f56580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 -- 172.21.15.66:0/3716459790 shutdown_connections 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.333+0000 7f565e371640 1 -- 172.21.15.66:0/3716459790 wait complete. 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 Processor -- start 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 -- start start 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658103780 0x7f5658198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 0x7f565819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5658112070 con 0x7f5658102dd0 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5658111ef0 con 0x7f5658103780 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565e371640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f56581121f0 con 0x7f5658108300 2024-09-15T22:42:34.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53990/0 (socket says 172.21.15.66:53990) 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 -- 172.21.15.66:0/54576673 learned_addr learned my addr 172.21.15.66:0/54576673 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f56577fe640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658103780 0x7f5658198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f565c90e640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 0x7f565819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 -- 172.21.15.66:0/54576673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 msgr2=0x7f565819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 0x7f565819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 -- 172.21.15.66:0/54576673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658103780 msgr2=0x7f5658198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658103780 0x7f5658198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.334+0000 7f5657fff640 1 -- 172.21.15.66:0/54576673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565819d5a0 con 0x7f5658102dd0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f5657fff640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f564800d950 tx=0x7f564800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648017030 con 0x7f5658102dd0 2024-09-15T22:42:34.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5648004020 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480047a0 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565819d890 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.335+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56581a5170 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.336+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56581031b0 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.337+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f56480041d0 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.338+0000 7f56557fa640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 0x7f56400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.338+0000 7f56577fe640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 0x7f56400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.338+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f56480ceda0 con 0x7f5658102dd0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.338+0000 7f56577fe640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 0x7f56400a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f564c005940 tx=0x7f564c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:34.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.342+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f564809bf60 con 0x7f5658102dd0 2024-09-15T22:42:34.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.554+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f565810a2e0 con 0x7f5658102dd0 2024-09-15T22:42:34.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.555+0000 7f56557fa640 1 -- 172.21.15.66:0/54576673 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f565810a2e0 con 0x7f5658102dd0 2024-09-15T22:42:34.556 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:34.556 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":9,"btime":"2024-09-15T22:42:33:056796+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-15T22:42:34.556 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 9 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 msgr2=0x7f56400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 0x7f56400a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f564c005940 tx=0x7f564c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 msgr2=0x7f56581985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f564800d950 tx=0x7f564800de10 comp rx=0 tx=0).stop 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 shutdown_connections 2024-09-15T22:42:34.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658108300 0x7f565819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f56400a3240 0x7f56400a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5658103780 0x7f5658198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 --2- 172.21.15.66:0/54576673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5658102dd0 0x7f56581985f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 >> 172.21.15.66:0/54576673 conn(0x7f56580fc7d0 msgr2=0x7f5658105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 shutdown_connections 2024-09-15T22:42:34.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:34.557+0000 7f565e371640 1 -- 172.21.15.66:0/54576673 wait complete. 2024-09-15T22:42:34.672 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:34 smithi184 systemd[1]: Starting Ceph mds.i for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:34.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:34 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/54576673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:35.090 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:34 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/54576673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:35.091 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:34 smithi184 podman[65207]: 2024-09-15 22:42:34.709277799 +0000 UTC m=+0.015939011 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:35.091 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:34 smithi184 podman[65207]: 2024-09-15 22:42:34.82041111 +0000 UTC m=+0.127072304 container create ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-15T22:42:35.091 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 podman[65207]: 2024-09-15 22:42:35.089989681 +0000 UTC m=+0.396650880 container init ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:42:35.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:34 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/54576673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:35.422 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 podman[65207]: 2024-09-15 22:42:35.092794302 +0000 UTC m=+0.399455497 container start ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:42:35.422 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 ceph-mds[65227]: -- 172.21.15.184:0/3754981172 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563835541860 con 0x56383551f400 2024-09-15T22:42:35.422 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: starting mds.i at 2024-09-15T22:42:35.422 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 bash[65207]: ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 2024-09-15T22:42:35.423 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:42:35 smithi184 systemd[1]: Started Ceph mds.i for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: Deploying daemon mds.g on smithi066 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:boot 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: fsmap 9 up:standby 2024-09-15T22:42:36.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:36 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:42:36.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:36.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: Deploying daemon mds.g on smithi066 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:boot 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: fsmap 9 up:standby 2024-09-15T22:42:36.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:36 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: Deploying daemon mds.g on smithi066 2024-09-15T22:42:36.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:boot 2024-09-15T22:42:36.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: fsmap 9 up:standby 2024-09-15T22:42:36.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:36 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:42:37.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:37.317 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 systemd[1]: Starting Ceph mds.g for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:37.615 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 podman[71908]: 2024-09-15 22:42:37.371898703 +0000 UTC m=+0.016948798 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:37.615 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 podman[71908]: 2024-09-15 22:42:37.501326841 +0000 UTC m=+0.146376924 container create 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:42:37.888 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 podman[71908]: 2024-09-15 22:42:37.754643765 +0000 UTC m=+0.399693855 container init 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 podman[71908]: 2024-09-15 22:42:37.758536412 +0000 UTC m=+0.403586496 container start 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 ceph-mds[71953]: -- 172.21.15.66:0/2543622477 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557300bd860 con 0x55573009b000 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: starting mds.g at 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 bash[71908]: 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 2024-09-15T22:42:37.949 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 22:42:37 smithi066 systemd[1]: Started Ceph mds.g for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:38.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:38.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.294 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:38.294 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:38.294 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:38 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:38.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 -- 172.21.15.66:0/1476343468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418101420 msgr2=0x7f541810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 --2- 172.21.15.66:0/1476343468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418101420 0x7f541810d950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5410009cd0 tx=0x7f541002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 -- 172.21.15.66:0/1476343468 shutdown_connections 2024-09-15T22:42:38.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 --2- 172.21.15.66:0/1476343468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418101420 0x7f541810d950 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 --2- 172.21.15.66:0/1476343468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 0x7f5418100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 --2- 172.21.15.66:0/1476343468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418106a80 0x7f5418106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 -- 172.21.15.66:0/1476343468 >> 172.21.15.66:0/1476343468 conn(0x7f54180fc7a0 msgr2=0x7f54180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 -- 172.21.15.66:0/1476343468 shutdown_connections 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.375+0000 7f541e781640 1 -- 172.21.15.66:0/1476343468 wait complete. 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 Processor -- start 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 -- start start 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 0x7f54181983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 0x7f5418198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5418110ea0 con 0x7f5418106a80 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5418110d20 con 0x7f5418100a80 2024-09-15T22:42:38.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541e781640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5418111020 con 0x7f5418101420 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541cd1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541cd1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54026/0 (socket says 172.21.15.66:54026) 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.376+0000 7f541cd1e640 1 -- 172.21.15.66:0/1163628546 learned_addr learned my addr 172.21.15.66:0/1163628546 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f54177fe640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 0x7f5418198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f5417fff640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 0x7f54181983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 -- 172.21.15.66:0/1163628546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 msgr2=0x7f5418198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 0x7f5418198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 -- 172.21.15.66:0/1163628546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 msgr2=0x7f54181983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 0x7f54181983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 -- 172.21.15.66:0/1163628546 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541819d3a0 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f54177fe640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 0x7f5418198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541cd1e640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5410006010 tx=0x7f5410003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410004450 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5410003e10 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541819d630 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54100466e0 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.377+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181a4f70 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.378+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5418100ee0 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.379+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f54100305a0 con 0x7f5418106a80 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.380+0000 7f54157fa640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 0x7f54000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.380+0000 7f5417fff640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 0x7f54000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:38.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.380+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f541002e030 con 0x7f5418106a80 2024-09-15T22:42:38.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.381+0000 7f5417fff640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 0x7f54000a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5408005e10 tx=0x7f5408005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:38.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.384+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f541004b060 con 0x7f5418106a80 2024-09-15T22:42:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:38.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:38.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:38 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.623+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f541810a020 con 0x7f5418106a80 2024-09-15T22:42:38.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.624+0000 7f54157fa640 1 -- 172.21.15.66:0/1163628546 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f5410039380 con 0x7f5418106a80 2024-09-15T22:42:38.625 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:38.626 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":11,"btime":"2024-09-15T22:42:38:242298+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:42:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 11 2024-09-15T22:42:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 msgr2=0x7f54000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 0x7f54000a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5408005e10 tx=0x7f5408005da0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 msgr2=0x7f541819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:38.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5410006010 tx=0x7f5410003c20 comp rx=0 tx=0).stop 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 shutdown_connections 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5418106a80 0x7f541819ccc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5418101420 0x7f5418198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54000a3240 0x7f54000a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 --2- 172.21.15.66:0/1163628546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5418100a80 0x7f54181983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 >> 172.21.15.66:0/1163628546 conn(0x7f54180fc7a0 msgr2=0x7f541806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 shutdown_connections 2024-09-15T22:42:38.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:38.626+0000 7f541e781640 1 -- 172.21.15.66:0/1163628546 wait complete. 2024-09-15T22:42:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:38 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:39.570 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:39 smithi066 ceph-mon[31185]: Deploying daemon mds.a on smithi066 2024-09-15T22:42:39.570 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:39 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6838/2023001898,v1:172.21.15.66:6839/2023001898] up:boot 2024-09-15T22:42:39.571 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:39 smithi066 ceph-mon[31185]: fsmap 10 up:standby 2024-09-15T22:42:39.571 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:39 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:42:39.571 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:39 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1163628546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:39 smithi087 ceph-mon[35290]: Deploying daemon mds.a on smithi066 2024-09-15T22:42:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:39 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6838/2023001898,v1:172.21.15.66:6839/2023001898] up:boot 2024-09-15T22:42:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:39 smithi087 ceph-mon[35290]: fsmap 10 up:standby 2024-09-15T22:42:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:39 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:42:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:39 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1163628546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:39 smithi184 ceph-mon[35203]: Deploying daemon mds.a on smithi066 2024-09-15T22:42:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:39 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6838/2023001898,v1:172.21.15.66:6839/2023001898] up:boot 2024-09-15T22:42:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:39 smithi184 ceph-mon[35203]: fsmap 10 up:standby 2024-09-15T22:42:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:39 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:42:39.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:39 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1163628546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:40.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:40 smithi184 ceph-mon[35203]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:40.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:40 smithi087 ceph-mon[35290]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:40.623 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:40 smithi066 ceph-mon[31185]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:40.911 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:40 smithi066 podman[72305]: 2024-09-15 22:42:40.753732295 +0000 UTC m=+0.016347005 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:40.911 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:40 smithi066 podman[72305]: 2024-09-15 22:42:40.910263053 +0000 UTC m=+0.172877751 container create 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:42:41.182 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 podman[72305]: 2024-09-15 22:42:41.154870749 +0000 UTC m=+0.417485448 container init 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T22:42:41.182 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 podman[72305]: 2024-09-15 22:42:41.157759828 +0000 UTC m=+0.420374527 container start 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:42:41.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:41.448 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 ceph-mds[72326]: -- 172.21.15.66:0/567441089 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bf1bb5860 con 0x559bf1b93000 2024-09-15T22:42:41.448 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: starting mds.a at 2024-09-15T22:42:41.448 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 bash[72305]: 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 2024-09-15T22:42:41.449 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 22:42:41 smithi066 systemd[1]: Started Ceph mds.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:41.694 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:42.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 -- 172.21.15.66:0/1293290528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70102790 msgr2=0x7fab701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 --2- 172.21.15.66:0/1293290528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70102790 0x7fab701067e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fab58009900 tx=0x7fab5802a410 comp rx=0 tx=0).stop 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 -- 172.21.15.66:0/1293290528 shutdown_connections 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 --2- 172.21.15.66:0/1293290528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70106f10 0x7fab7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 --2- 172.21.15.66:0/1293290528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70102790 0x7fab701067e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 --2- 172.21.15.66:0/1293290528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 0x7fab701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 -- 172.21.15.66:0/1293290528 >> 172.21.15.66:0/1293290528 conn(0x7fab700fd8c0 msgr2=0x7fab700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 -- 172.21.15.66:0/1293290528 shutdown_connections 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.167+0000 7fab76fed640 1 -- 172.21.15.66:0/1293290528 wait complete. 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 Processor -- start 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 -- start start 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 0x7fab70198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70102790 0x7fab70198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab70111f70 con 0x7fab70106f10 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab70111df0 con 0x7fab70101de0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab76fed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fab701120f0 con 0x7fab70102790 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54066/0 (socket says 172.21.15.66:54066) 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 -- 172.21.15.66:0/3318230363 learned_addr learned my addr 172.21.15.66:0/3318230363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab6ffff640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70102790 0x7fab70198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab74d89640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 0x7fab70198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 -- 172.21.15.66:0/3318230363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70102790 msgr2=0x7fab70198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70102790 0x7fab70198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 -- 172.21.15.66:0/3318230363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 msgr2=0x7fab70198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 0x7fab70198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.168+0000 7fab7558a640 1 -- 172.21.15.66:0/3318230363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7019d400 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab7558a640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fab6800d750 tx=0x7fab6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68017070 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab68005500 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7019d6f0 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68004d90 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.169+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab701a4fd0 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.170+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab701021c0 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.171+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fab68004f30 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.172+0000 7fab6dffb640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 0x7fab5c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.172+0000 7fab74d89640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 0x7fab5c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.172+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fab680cf060 con 0x7fab70106f10 2024-09-15T22:42:42.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.173+0000 7fab74d89640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 0x7fab5c0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab60005c40 tx=0x7fab6000a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:42.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.175+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab6809bc50 con 0x7fab70106f10 2024-09-15T22:42:42.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.389+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab701997b0 con 0x7fab70106f10 2024-09-15T22:42:42.391 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:42.391 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6840/3123963280,v1:172.21.15.66:6841/3123963280] up:boot 2024-09-15T22:42:42.391 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: fsmap 11 up:standby 2024-09-15T22:42:42.391 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:42:42.391 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:42.392 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:42 smithi066 ceph-mon[31185]: Deploying daemon mds.b on smithi087 2024-09-15T22:42:42.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.390+0000 7fab6dffb640 1 -- 172.21.15.66:0/3318230363 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7fab701997b0 con 0x7fab70106f10 2024-09-15T22:42:42.393 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:42.393 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":12,"btime":"2024-09-15T22:42:41:258094+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:42:42.394 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 12 2024-09-15T22:42:42.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 msgr2=0x7fab5c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 0x7fab5c0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab60005c40 tx=0x7fab6000a590 comp rx=0 tx=0).stop 2024-09-15T22:42:42.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 msgr2=0x7fab7019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:42.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fab6800d750 tx=0x7fab6800dc10 comp rx=0 tx=0).stop 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 shutdown_connections 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab70106f10 0x7fab7019cd20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab70102790 0x7fab70198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fab5c0a32c0 0x7fab5c0a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 --2- 172.21.15.66:0/3318230363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab70101de0 0x7fab70198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 >> 172.21.15.66:0/3318230363 conn(0x7fab700fd8c0 msgr2=0x7fab700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.392+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 shutdown_connections 2024-09-15T22:42:42.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:42.393+0000 7fab76fed640 1 -- 172.21.15.66:0/3318230363 wait complete. 2024-09-15T22:42:42.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6840/3123963280,v1:172.21.15.66:6841/3123963280] up:boot 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: fsmap 11 up:standby 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:42.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:42 smithi087 ceph-mon[35290]: Deploying daemon mds.b on smithi087 2024-09-15T22:42:42.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:42.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6840/3123963280,v1:172.21.15.66:6841/3123963280] up:boot 2024-09-15T22:42:42.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: fsmap 11 up:standby 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:42.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:42 smithi184 ceph-mon[35203]: Deploying daemon mds.b on smithi087 2024-09-15T22:42:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:43 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3318230363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:43 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3318230363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:43.600 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 systemd[1]: Starting Ceph mds.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T22:42:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:43 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3318230363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:43.903 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 podman[65458]: 2024-09-15 22:42:43.526886718 +0000 UTC m=+0.016380442 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:42:43.903 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 podman[65458]: 2024-09-15 22:42:43.658067404 +0000 UTC m=+0.147561115 container create 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:42:43.903 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 podman[65458]: 2024-09-15 22:42:43.90244143 +0000 UTC m=+0.391935141 container init 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:42:44.272 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 podman[65458]: 2024-09-15 22:42:43.905707999 +0000 UTC m=+0.395201718 container start 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:42:44.272 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 ceph-mds[65477]: -- 172.21.15.87:0/1379364016 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556143ed7860 con 0x556143eb4800 2024-09-15T22:42:44.272 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:43 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: starting mds.b at 2024-09-15T22:42:44.272 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:44 smithi087 bash[65458]: 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 2024-09-15T22:42:44.273 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:44 smithi087 systemd[1]: Started Ceph mds.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T22:42:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:44 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:44.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:44.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:44 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:44.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:44.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:44.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:44 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:45.096 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:42:45.362 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:45 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:boot 2024-09-15T22:42:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:45 smithi066 ceph-mon[31185]: fsmap 12 up:standby 2024-09-15T22:42:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:45 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:42:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:45 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:boot 2024-09-15T22:42:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:45 smithi087 ceph-mon[35290]: fsmap 12 up:standby 2024-09-15T22:42:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:45 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:42:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:45 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:boot 2024-09-15T22:42:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:45 smithi184 ceph-mon[35203]: fsmap 12 up:standby 2024-09-15T22:42:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:45 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- 172.21.15.66:0/1235309291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea4103760 msgr2=0x7f1ea4107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/1235309291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea4103760 0x7f1ea4107ba0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009930 tx=0x7f1e9802a420 comp rx=0 tx=0).stop 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- 172.21.15.66:0/1235309291 shutdown_connections 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/1235309291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea41082e0 0x7f1ea410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/1235309291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea4103760 0x7f1ea4107ba0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/1235309291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4102db0 0x7f1ea4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- 172.21.15.66:0/1235309291 >> 172.21.15.66:0/1235309291 conn(0x7f1ea40fc7d0 msgr2=0x7f1ea40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- 172.21.15.66:0/1235309291 shutdown_connections 2024-09-15T22:42:45.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- 172.21.15.66:0/1235309291 wait complete. 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 Processor -- start 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.847+0000 7f1eac3b3640 1 -- start start 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea4102db0 0x7f1ea41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 0x7f1ea4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4112070 con 0x7f1ea41082e0 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4111ef0 con 0x7f1ea4103760 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41121f0 con 0x7f1ea4102db0 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38756/0 (socket says 172.21.15.66:38756) 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 -- 172.21.15.66:0/650561121 learned_addr learned my addr 172.21.15.66:0/650561121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:45.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa14f640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea4102db0 0x7f1ea41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1ea994e640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 0x7f1ea4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 -- 172.21.15.66:0/650561121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea4102db0 msgr2=0x7f1ea41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea4102db0 0x7f1ea41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 -- 172.21.15.66:0/650561121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 msgr2=0x7f1ea4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 0x7f1ea4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 -- 172.21.15.66:0/650561121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea419d580 con 0x7f1ea41082e0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1ea994e640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 0x7f1ea4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eaa950640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00e970 tx=0x7f1e9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00ccc0 con 0x7f1ea41082e0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e9c00ce60 con 0x7f1ea41082e0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea419d870 con 0x7f1ea41082e0 2024-09-15T22:42:45.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.848+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c010490 con 0x7f1ea41082e0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.849+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41a5150 con 0x7f1ea41082e0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.849+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4103190 con 0x7f1ea41082e0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.851+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1e9c005000 con 0x7f1ea41082e0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.851+0000 7f1ea37fe640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 0x7f1e8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.852+0000 7f1eaa14f640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 0x7f1e8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.852+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1e9c0cfac0 con 0x7f1ea41082e0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.852+0000 7f1eaa14f640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 0x7f1e8c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1e94005fd0 tx=0x7f1e94009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:45.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:45.854+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e9c0541b0 con 0x7f1ea41082e0 2024-09-15T22:42:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.076+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ea410a2c0 con 0x7f1ea41082e0 2024-09-15T22:42:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.077+0000 7f1ea37fe640 1 -- 172.21.15.66:0/650561121 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f1e9c09cc80 con 0x7f1ea41082e0 2024-09-15T22:42:46.079 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:46.079 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":13,"btime":"2024-09-15T22:42:44:268996+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-15T22:42:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 13 2024-09-15T22:42:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 msgr2=0x7f1e8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 0x7f1e8c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1e94005fd0 tx=0x7f1e94009760 comp rx=0 tx=0).stop 2024-09-15T22:42:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 msgr2=0x7f1ea419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00e970 tx=0x7f1e9c00ed70 comp rx=0 tx=0).stop 2024-09-15T22:42:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 shutdown_connections 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea41082e0 0x7f1ea419cea0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f1e8c0a3240 0x7f1e8c0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea4103760 0x7f1ea4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 --2- 172.21.15.66:0/650561121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea4102db0 0x7f1ea41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 >> 172.21.15.66:0/650561121 conn(0x7f1ea40fc7d0 msgr2=0x7f1ea4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 shutdown_connections 2024-09-15T22:42:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:46.080+0000 7f1eac3b3640 1 -- 172.21.15.66:0/650561121 wait complete. 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:46 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/650561121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:46 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/650561121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:46 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/650561121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:42:46.816 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:47 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:47.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:47.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:47 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:47.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:47.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:47 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:42:47.722 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:48.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 -- 172.21.15.66:0/1844600338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff614102d40 msgr2=0x7ff614103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:48.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 --2- 172.21.15.66:0/1844600338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff614102d40 0x7ff614103120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009900 tx=0x7ff5fc02a480 comp rx=0 tx=0).stop 2024-09-15T22:42:48.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 -- 172.21.15.66:0/1844600338 shutdown_connections 2024-09-15T22:42:48.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 --2- 172.21.15.66:0/1844600338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff61410c170 0x7ff61410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 --2- 172.21.15.66:0/1844600338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614103660 0x7ff61410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 --2- 172.21.15.66:0/1844600338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff614102d40 0x7ff614103120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 -- 172.21.15.66:0/1844600338 >> 172.21.15.66:0/1844600338 conn(0x7ff6140fc7a0 msgr2=0x7ff6140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 -- 172.21.15.66:0/1844600338 shutdown_connections 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.184+0000 7ff61ac30640 1 -- 172.21.15.66:0/1844600338 wait complete. 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 Processor -- start 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 -- start start 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 0x7ff61419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 0x7ff61419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff614111f70 con 0x7ff61410c170 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff614111df0 con 0x7ff614102d40 2024-09-15T22:42:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff61ac30640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141120f0 con 0x7ff614103660 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff6191cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff6189cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 0x7ff61419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff6191cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38772/0 (socket says 172.21.15.66:38772) 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff6189cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 0x7ff61419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:56506/0 (socket says 172.21.15.66:56506) 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.185+0000 7ff6191cd640 1 -- 172.21.15.66:0/4160815247 learned_addr learned my addr 172.21.15.66:0/4160815247 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff613fff640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 0x7ff61419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 -- 172.21.15.66:0/4160815247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 msgr2=0x7ff61419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 0x7ff61419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 -- 172.21.15.66:0/4160815247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 msgr2=0x7ff61419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 0x7ff61419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 -- 172.21.15.66:0/4160815247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61419f5f0 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff613fff640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 0x7ff61419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff6191cd640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00eaa0 tx=0x7ff60c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00cdb0 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff60c005020 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0116b0 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.186+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61419f8e0 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.187+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a71c0 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.188+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff614103120 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.188+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff60c005560 con 0x7ff61410c170 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.189+0000 7ff611ffb640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 0x7ff6000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:48.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.189+0000 7ff6189cc640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 0x7ff6000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:48.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.189+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff60c0cf620 con 0x7ff61410c170 2024-09-15T22:42:48.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.190+0000 7ff6189cc640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 0x7ff6000a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009230 tx=0x7ff5fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:48.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.193+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff60c016030 con 0x7ff61410c170 2024-09-15T22:42:48.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.382+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff6141a7530 con 0x7ff61410c170 2024-09-15T22:42:48.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.383+0000 7ff611ffb640 1 -- 172.21.15.66:0/4160815247 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7ff60c09c7e0 con 0x7ff61410c170 2024-09-15T22:42:48.384 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:42:48.385 INFO:teuthology.orchestra.run.smithi066.stdout:[ 2024-09-15T22:42:48.385 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T22:42:48.385 INFO:teuthology.orchestra.run.smithi066.stdout: "poolnum": 1, 2024-09-15T22:42:48.385 INFO:teuthology.orchestra.run.smithi066.stdout: "poolname": ".mgr" 2024-09-15T22:42:48.385 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:42:48.386 INFO:teuthology.orchestra.run.smithi066.stdout:] 2024-09-15T22:42:48.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 msgr2=0x7ff6000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:48.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 0x7ff6000a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009230 tx=0x7ff5fc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 msgr2=0x7ff61419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00eaa0 tx=0x7ff60c00ef60 comp rx=0 tx=0).stop 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 shutdown_connections 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff61410c170 0x7ff61419ef10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff614103660 0x7ff61419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6000a3240 0x7ff6000a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 --2- 172.21.15.66:0/4160815247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff614102d40 0x7ff61419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 >> 172.21.15.66:0/4160815247 conn(0x7ff6140fc7a0 msgr2=0x7ff6140fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 shutdown_connections 2024-09-15T22:42:48.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:48.386+0000 7ff61ac30640 1 -- 172.21.15.66:0/4160815247 wait complete. 2024-09-15T22:42:49.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:48 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.018 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:48 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4160815247' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:42:49.050 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:42:49.050 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:42:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:48 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:48 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4160815247' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:42:49.331 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:48 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:48 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4160815247' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.780+0000 7f8f211db640 1 -- 172.21.15.66:0/3322224498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 msgr2=0x7f8f1c10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.780+0000 7f8f211db640 1 --2- 172.21.15.66:0/3322224498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c10eac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009ca0 tx=0x7f8f1402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 -- 172.21.15.66:0/3322224498 shutdown_connections 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 --2- 172.21.15.66:0/3322224498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c10eac0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 --2- 172.21.15.66:0/3322224498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c1027c0 0x7f8f1c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 --2- 172.21.15.66:0/3322224498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c101e10 0x7f8f1c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 -- 172.21.15.66:0/3322224498 >> 172.21.15.66:0/3322224498 conn(0x7f8f1c0fd8d0 msgr2=0x7f8f1c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 -- 172.21.15.66:0/3322224498 shutdown_connections 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 -- 172.21.15.66:0/3322224498 wait complete. 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.781+0000 7f8f211db640 1 Processor -- start 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 -- start start 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c101e10 0x7f8f1c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c1027c0 0x7f8f1c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c111fc0 con 0x7f8f1c106f40 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c111e40 con 0x7f8f1c1027c0 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f211db640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c112140 con 0x7f8f1c101e10 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f1b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f1b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38796/0 (socket says 172.21.15.66:38796) 2024-09-15T22:42:49.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f1b59e640 1 -- 172.21.15.66:0/2514016045 learned_addr learned my addr 172.21.15.66:0/2514016045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f1ad9d640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c101e10 0x7f8f1c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.782+0000 7f8f1a59c640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c1027c0 0x7f8f1c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 -- 172.21.15.66:0/2514016045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c101e10 msgr2=0x7f8f1c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c101e10 0x7f8f1c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 -- 172.21.15.66:0/2514016045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c1027c0 msgr2=0x7f8f1c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c1027c0 0x7f8f1c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 -- 172.21.15.66:0/2514016045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c19d400 con 0x7f8f1c106f40 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f1b59e640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f14031a20 tx=0x7f8f14031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14003c30 con 0x7f8f1c106f40 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c19d690 con 0x7f8f1c106f40 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f14003dd0 con 0x7f8f1c106f40 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1402fcf0 con 0x7f8f1c106f40 2024-09-15T22:42:49.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.783+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c1a4fd0 con 0x7f8f1c106f40 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.784+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c1021f0 con 0x7f8f1c106f40 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.785+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8f14004050 con 0x7f8f1c106f40 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.786+0000 7f8f03fff640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 0x7f8f040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.786+0000 7f8f1ad9d640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 0x7f8f040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.786+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8f140f0900 con 0x7f8f1c106f40 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.787+0000 7f8f1ad9d640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 0x7f8f040a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00bbe0 tx=0x7f8f0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:49.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.789+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f140bdb50 con 0x7f8f1c106f40 2024-09-15T22:42:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:49.964+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8f1c1997b0 con 0x7f8f1c106f40 2024-09-15T22:42:50.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.447+0000 7f8f03fff640 1 -- 172.21.15.66:0/2514016045 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f8f1c1997b0 con 0x7f8f1c106f40 2024-09-15T22:42:50.449 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' created 2024-09-15T22:42:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 msgr2=0x7f8f040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 0x7f8f040a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00bbe0 tx=0x7f8f0c00b390 comp rx=0 tx=0).stop 2024-09-15T22:42:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 msgr2=0x7f8f1c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8f14031a20 tx=0x7f8f14031a50 comp rx=0 tx=0).stop 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 shutdown_connections 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f1c106f40 0x7f8f1c19cd20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8f040a32c0 0x7f8f040a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f1c1027c0 0x7f8f1c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 --2- 172.21.15.66:0/2514016045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f1c101e10 0x7f8f1c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 >> 172.21.15.66:0/2514016045 conn(0x7f8f1c0fd8d0 msgr2=0x7f8f1c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 shutdown_connections 2024-09-15T22:42:50.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:50.450+0000 7f8f211db640 1 -- 172.21.15.66:0/2514016045 wait complete. 2024-09-15T22:42:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:42:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:42:50.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:42:51.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T22:42:51.423 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:42:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:51 smithi184 ceph-mon[35203]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:42:51.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:51 smithi184 ceph-mon[35203]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:42:51.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:42:51.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:51 smithi066 ceph-mon[31185]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:51.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:42:51.693 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:51 smithi066 ceph-mon[31185]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:42:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:42:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:51 smithi087 ceph-mon[35290]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2514016045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:42:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:51 smithi087 ceph-mon[35290]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 -- 172.21.15.66:0/2336452361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe984100ca0 msgr2=0x7fe984106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 --2- 172.21.15.66:0/2336452361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe984100ca0 0x7fe984106840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009930 tx=0x7fe96c02a420 comp rx=0 tx=0).stop 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 -- 172.21.15.66:0/2336452361 shutdown_connections 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 --2- 172.21.15.66:0/2336452361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 0x7fe98410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 --2- 172.21.15.66:0/2336452361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe984100ca0 0x7fe984106840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 --2- 172.21.15.66:0/2336452361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9841002f0 0x7fe9841006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 -- 172.21.15.66:0/2336452361 >> 172.21.15.66:0/2336452361 conn(0x7fe984077210 msgr2=0x7fe9840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 -- 172.21.15.66:0/2336452361 shutdown_connections 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.901+0000 7fe988d46640 1 -- 172.21.15.66:0/2336452361 wait complete. 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 Processor -- start 2024-09-15T22:42:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 -- start start 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe984100ca0 0x7fe984198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 0x7fe98419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe984112060 con 0x7fe9841002f0 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe984111ee0 con 0x7fe984106f50 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe988d46640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe9841121e0 con 0x7fe984100ca0 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.902+0000 7fe98259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38826/0 (socket says 172.21.15.66:38826) 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 -- 172.21.15.66:0/3206448976 learned_addr learned my addr 172.21.15.66:0/3206448976 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe981d9b640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe984100ca0 0x7fe984198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe982d9d640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 0x7fe98419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 -- 172.21.15.66:0/3206448976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe984100ca0 msgr2=0x7fe984198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe984100ca0 0x7fe984198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 -- 172.21.15.66:0/3206448976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 msgr2=0x7fe98419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 0x7fe98419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 -- 172.21.15.66:0/3206448976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98419d650 con 0x7fe9841002f0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe98259c640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00b4a0 tx=0x7fe97c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c014070 con 0x7fe9841002f0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe97c010af0 con 0x7fe9841002f0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98419d940 con 0x7fe9841002f0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c017d10 con 0x7fe9841002f0 2024-09-15T22:42:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.903+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9841a5220 con 0x7fe9841002f0 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.904+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe984100750 con 0x7fe9841002f0 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.906+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe97c017070 con 0x7fe9841002f0 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.906+0000 7fe97b7fe640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 0x7fe9700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.907+0000 7fe981d9b640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 0x7fe9700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.907+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fe97c0ce970 con 0x7fe9841002f0 2024-09-15T22:42:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.907+0000 7fe981d9b640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 0x7fe9700a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe96c031550 tx=0x7fe96c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:51.911+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe97c09b370 con 0x7fe9841002f0 2024-09-15T22:42:52.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.086+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe98410a140 con 0x7fe9841002f0 2024-09-15T22:42:52.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.524+0000 7fe97b7fe640 1 -- 172.21.15.66:0/3206448976 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7fe97c09f670 con 0x7fe9841002f0 2024-09-15T22:42:52.526 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' created 2024-09-15T22:42:52.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 msgr2=0x7fe9700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 0x7fe9700a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe96c031550 tx=0x7fe96c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 msgr2=0x7fe9841986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00b4a0 tx=0x7fe97c00b960 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 shutdown_connections 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe9700a3240 0x7fe9700a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984106f50 0x7fe98419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe984100ca0 0x7fe984198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 --2- 172.21.15.66:0/3206448976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9841002f0 0x7fe9841986a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 >> 172.21.15.66:0/3206448976 conn(0x7fe984077210 msgr2=0x7fe984105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 shutdown_connections 2024-09-15T22:42:52.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:52.527+0000 7fe988d46640 1 -- 172.21.15.66:0/3206448976 wait complete. 2024-09-15T22:42:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:52 smithi184 ceph-mon[35203]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:42:52.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:52 smithi087 ceph-mon[35290]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:42:52.901 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:52 smithi066 ceph-mon[31185]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:42:53.261 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:42:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:53.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:53 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:42:53.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:53 smithi066 ceph-mon[31185]: pgmap v272: 33 pgs: 5 creating+peering, 22 active+clean, 6 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:53.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:53 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:42:53.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:53 smithi066 ceph-mon[31185]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:42:53.775 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:53 smithi066 ceph-mon[31185]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:42:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:53 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:42:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:53 smithi087 ceph-mon[35290]: pgmap v272: 33 pgs: 5 creating+peering, 22 active+clean, 6 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:53 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:42:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:53 smithi087 ceph-mon[35290]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:42:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:53 smithi087 ceph-mon[35290]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:42:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:53 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:42:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:53 smithi184 ceph-mon[35203]: pgmap v272: 33 pgs: 5 creating+peering, 22 active+clean, 6 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:53 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3206448976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:42:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:53 smithi184 ceph-mon[35203]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:42:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:53 smithi184 ceph-mon[35203]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:42:54.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 -- 172.21.15.66:0/2973011700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1884102d30 msgr2=0x7f1884103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 --2- 172.21.15.66:0/2973011700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1884102d30 0x7f1884103110 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1874009930 tx=0x7f187402a420 comp rx=0 tx=0).stop 2024-09-15T22:42:54.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 -- 172.21.15.66:0/2973011700 shutdown_connections 2024-09-15T22:42:54.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 --2- 172.21.15.66:0/2973011700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18841082a0 0x7f188410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 --2- 172.21.15.66:0/2973011700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 0x7f1884107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 --2- 172.21.15.66:0/2973011700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1884102d30 0x7f1884103110 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.030+0000 7f1889501640 1 -- 172.21.15.66:0/2973011700 >> 172.21.15.66:0/2973011700 conn(0x7f18840fc7d0 msgr2=0x7f18840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.031+0000 7f1889501640 1 -- 172.21.15.66:0/2973011700 shutdown_connections 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.031+0000 7f1889501640 1 -- 172.21.15.66:0/2973011700 wait complete. 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.031+0000 7f1889501640 1 Processor -- start 2024-09-15T22:42:54.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.031+0000 7f1889501640 1 -- start start 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1884102d30 0x7f18841a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 0x7f18841a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1884112100 con 0x7f18841082a0 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1884111f80 con 0x7f18841036e0 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1884112280 con 0x7f1884102d30 2024-09-15T22:42:54.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58150/0 (socket says 172.21.15.66:58150) 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 -- 172.21.15.66:0/1958612987 learned_addr learned my addr 172.21.15.66:0/1958612987 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18827fc640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 0x7f18841a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1882ffd640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1884102d30 0x7f18841a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 -- 172.21.15.66:0/1958612987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1884102d30 msgr2=0x7f18841a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1884102d30 0x7f18841a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 -- 172.21.15.66:0/1958612987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 msgr2=0x7f18841a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 0x7f18841a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 -- 172.21.15.66:0/1958612987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188419aea0 con 0x7f18841082a0 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f18837fe640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b970 tx=0x7f187c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:54.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c019070 con 0x7f18841082a0 2024-09-15T22:42:54.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f187c00cb40 con 0x7f18841082a0 2024-09-15T22:42:54.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188419b190 con 0x7f18841082a0 2024-09-15T22:42:54.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.032+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c007650 con 0x7f18841082a0 2024-09-15T22:42:54.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.033+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18841a74e0 con 0x7f18841082a0 2024-09-15T22:42:54.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.033+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188406a850 con 0x7f18841082a0 2024-09-15T22:42:54.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.035+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f187c01c070 con 0x7f18841082a0 2024-09-15T22:42:54.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.035+0000 7f186bfff640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:54.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.036+0000 7f1882ffd640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:54.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.036+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f187c0cf1b0 con 0x7f18841082a0 2024-09-15T22:42:54.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.036+0000 7f1882ffd640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 0x7f186c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1874000c00 tx=0x7f1874031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:54.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.039+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f187c09ba30 con 0x7f18841082a0 2024-09-15T22:42:54.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.254+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f188410c2c0 con 0x7f18841082a0 2024-09-15T22:42:54.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.781+0000 7f186bfff640 1 -- 172.21.15.66:0/1958612987 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f187c09fd30 con 0x7f18841082a0 2024-09-15T22:42:54.782 INFO:teuthology.orchestra.run.smithi066.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:42:54.783 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:54 smithi066 ceph-mon[31185]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:42:54.783 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:54 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:42:54.783 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:54 smithi066 ceph-mon[31185]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:42:54.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 msgr2=0x7f186c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 0x7f186c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1874000c00 tx=0x7f1874031490 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 msgr2=0x7f188419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b970 tx=0x7f187c00be30 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 shutdown_connections 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18841082a0 0x7f188419a630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18841036e0 0x7f18841a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 --2- 172.21.15.66:0/1958612987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1884102d30 0x7f18841a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 >> 172.21.15.66:0/1958612987 conn(0x7f18840fc7d0 msgr2=0x7f1884100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 shutdown_connections 2024-09-15T22:42:54.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:54.784+0000 7f1889501640 1 -- 172.21.15.66:0/1958612987 wait complete. 2024-09-15T22:42:54.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:54 smithi087 ceph-mon[35290]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:42:54.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:54 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:42:54.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:54 smithi087 ceph-mon[35290]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:42:54.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:54 smithi184 ceph-mon[35203]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:42:54.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:54 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:42:54.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:54 smithi184 ceph-mon[35203]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:42:55.510 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T22:42:55.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T22:42:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:55 smithi087 ceph-mon[35290]: pgmap v275: 97 pgs: 17 creating+peering, 35 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:55 smithi087 ceph-mon[35290]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:42:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:55 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:42:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:55 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:42:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:55 smithi087 ceph-mon[35290]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:42:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:55.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:55 smithi066 ceph-mon[31185]: pgmap v275: 97 pgs: 17 creating+peering, 35 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:55.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:55 smithi066 ceph-mon[31185]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:42:55.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:55 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:42:55.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:55 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:42:55.894 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:55 smithi066 ceph-mon[31185]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:42:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:55 smithi184 ceph-mon[35203]: pgmap v275: 97 pgs: 17 creating+peering, 35 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:55 smithi184 ceph-mon[35203]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:42:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:55 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1958612987' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:42:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:55 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:42:55.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:55 smithi184 ceph-mon[35203]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/1327910171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8106f10 msgr2=0x7ff6d810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/1327910171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8106f10 0x7ff6d810ea90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009ca0 tx=0x7ff6d002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/1327910171 shutdown_connections 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/1327910171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8106f10 0x7ff6d810ea90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/1327910171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/1327910171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8101de0 0x7ff6d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.246+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/1327910171 >> 172.21.15.66:0/1327910171 conn(0x7ff6d80fd8c0 msgr2=0x7ff6d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/1327910171 shutdown_connections 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/1327910171 wait complete. 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 Processor -- start 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- start start 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8106f10 0x7ff6d8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8111f70 con 0x7ff6d8101de0 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8111df0 con 0x7ff6d8102790 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.247+0000 7ff6dd5ed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81120f0 con 0x7ff6d8106f10 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58156/0 (socket says 172.21.15.66:58156) 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 -- 172.21.15.66:0/579083472 learned_addr learned my addr 172.21.15.66:0/579083472 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d77fe640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8106f10 0x7ff6d8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6cffff640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 -- 172.21.15.66:0/579083472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8106f10 msgr2=0x7ff6d8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8106f10 0x7ff6d8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 -- 172.21.15.66:0/579083472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 msgr2=0x7ff6d8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 -- 172.21.15.66:0/579083472 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d81a6890 con 0x7ff6d8101de0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6cffff640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d6ffd640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800d770 tx=0x7ff6c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8017070 con 0x7ff6d8101de0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81a6b80 con 0x7ff6d8101de0 2024-09-15T22:42:56.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6c8005500 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8004e00 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.248+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81a70c0 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.250+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d81021c0 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.251+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff6c8004fa0 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.251+0000 7ff6d4ff9640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 0x7ff6c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.251+0000 7ff6cffff640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 0x7ff6c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.251+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7ff6c80cf2f0 con 0x7ff6d8101de0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.252+0000 7ff6cffff640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 0x7ff6c40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8075f80 tx=0x7ff6c00094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:56.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.256+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6c809c160 con 0x7ff6d8101de0 2024-09-15T22:42:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.446+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff6d802d7c0 con 0x7ff6d8101de0 2024-09-15T22:42:56.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.797+0000 7ff6d4ff9640 1 -- 172.21.15.66:0/579083472 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7ff6c809ba60 con 0x7ff6d8101de0 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.800+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 msgr2=0x7ff6c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.800+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 0x7ff6c40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8075f80 tx=0x7ff6c00094b0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 msgr2=0x7ff6d80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800d770 tx=0x7ff6c800dc30 comp rx=0 tx=0).stop 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 shutdown_connections 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d8106f10 0x7ff6d8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff6c40a3240 0x7ff6c40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6d8102790 0x7ff6d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 --2- 172.21.15.66:0/579083472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6d8101de0 0x7ff6d80744f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 >> 172.21.15.66:0/579083472 conn(0x7ff6d80fd8c0 msgr2=0x7ff6d80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 shutdown_connections 2024-09-15T22:42:56.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:56.801+0000 7ff6dd5ed640 1 -- 172.21.15.66:0/579083472 wait complete. 2024-09-15T22:42:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:56 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:active 2024-09-15T22:42:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:56 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:56 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:42:57.128 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:56 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:active 2024-09-15T22:42:57.128 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:56 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.128 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:56 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.128 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:42:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:56 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] up:active 2024-09-15T22:42:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:56 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:56 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:42:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:42:57.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:42:57.778 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:42:58.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:57 smithi066 ceph-mon[31185]: pgmap v277: 97 pgs: 12 creating+peering, 56 active+clean, 29 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:58.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:57 smithi066 ceph-mon[31185]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:42:58.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:57 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T22:42:58.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:57 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:42:58.039 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:57 smithi066 ceph-mon[31185]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:42:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:57 smithi087 ceph-mon[35290]: pgmap v277: 97 pgs: 12 creating+peering, 56 active+clean, 29 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:57 smithi087 ceph-mon[35290]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:42:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:57 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T22:42:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:57 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:42:58.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:57 smithi087 ceph-mon[35290]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:42:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:57 smithi184 ceph-mon[35203]: pgmap v277: 97 pgs: 12 creating+peering, 56 active+clean, 29 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:42:58.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:57 smithi184 ceph-mon[35203]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:42:58.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:57 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T22:42:58.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:57 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/579083472' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:42:58.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:57 smithi184 ceph-mon[35203]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 -- 172.21.15.66:0/2040293598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c103660 msgr2=0x7f057c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 --2- 172.21.15.66:0/2040293598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c103660 0x7f057c10bb50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f056c009900 tx=0x7f056c02a480 comp rx=0 tx=0).stop 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 -- 172.21.15.66:0/2040293598 shutdown_connections 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 --2- 172.21.15.66:0/2040293598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c10c170 0x7f057c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 --2- 172.21.15.66:0/2040293598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c103660 0x7f057c10bb50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 --2- 172.21.15.66:0/2040293598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 0x7f057c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 -- 172.21.15.66:0/2040293598 >> 172.21.15.66:0/2040293598 conn(0x7f057c0fc7a0 msgr2=0x7f057c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 -- 172.21.15.66:0/2040293598 shutdown_connections 2024-09-15T22:42:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.263+0000 7f05844fb640 1 -- 172.21.15.66:0/2040293598 wait complete. 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 Processor -- start 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 -- start start 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 0x7f057c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c103660 0x7f057c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f057c111f70 con 0x7f057c10c170 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f057c111df0 con 0x7f057c103660 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f05844fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f057c1120f0 con 0x7f057c102d40 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f0582a98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.264+0000 7f0582a98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58182/0 (socket says 172.21.15.66:58182) 2024-09-15T22:42:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 -- 172.21.15.66:0/2625164831 learned_addr learned my addr 172.21.15.66:0/2625164831 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0581a96640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c103660 0x7f057c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582297640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 0x7f057c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 -- 172.21.15.66:0/2625164831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 msgr2=0x7f057c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 0x7f057c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 -- 172.21.15.66:0/2625164831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c103660 msgr2=0x7f057c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c103660 0x7f057c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 -- 172.21.15.66:0/2625164831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c19d360 con 0x7f057c10c170 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f0582a98640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f057400cce0 tx=0x7f057400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057400f450 con 0x7f057c10c170 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057400fad0 con 0x7f057c10c170 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c19d650 con 0x7f057c10c170 2024-09-15T22:42:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574018b60 con 0x7f057c10c170 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.265+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c1a4f30 con 0x7f057c10c170 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.266+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c103120 con 0x7f057c10c170 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.267+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f057400fc80 con 0x7f057c10c170 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.268+0000 7f05737fe640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 0x7f05680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.268+0000 7f0582297640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 0x7f05680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.268+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8277+0+0 (secure 0 0 0) 0x7f05740cfd60 con 0x7f057c10c170 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.269+0000 7f0582297640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 0x7f05680a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f057800abe0 tx=0x7f057800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:42:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.272+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0574014030 con 0x7f057c10c170 2024-09-15T22:42:58.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:58.452+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f057c02d7c0 con 0x7f057c10c170 2024-09-15T22:42:59.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:42:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:42:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:42:59.599 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:42:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T22:42:59.283+0000 7fd9cbb77640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:42:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.794+0000 7f05737fe640 1 -- 172.21.15.66:0/2625164831 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7f057409ca50 con 0x7f057c10c170 2024-09-15T22:42:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data_ec' created 2024-09-15T22:42:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.796+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 msgr2=0x7f05680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.796+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 0x7f05680a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f057800abe0 tx=0x7f057800a2d0 comp rx=0 tx=0).stop 2024-09-15T22:42:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.796+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 msgr2=0x7f057c19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:42:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.796+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f057400cce0 tx=0x7f057400a620 comp rx=0 tx=0).stop 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.796+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 shutdown_connections 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f057c10c170 0x7f057c19cc80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f05680a3240 0x7f05680a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f057c103660 0x7f057c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 --2- 172.21.15.66:0/2625164831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f057c102d40 0x7f057c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 >> 172.21.15.66:0/2625164831 conn(0x7f057c0fc7a0 msgr2=0x7f057c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:42:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.797+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 shutdown_connections 2024-09-15T22:42:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:42:59.798+0000 7f05844fb640 1 -- 172.21.15.66:0/2625164831 wait complete. 2024-09-15T22:43:00.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:59 smithi087 ceph-mon[35290]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:00.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:42:59 smithi087 ceph-mon[35290]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:43:00.136 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:59 smithi066 ceph-mon[31185]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:00.136 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:42:59 smithi066 ceph-mon[31185]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:43:00.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:59 smithi184 ceph-mon[35203]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:00.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:42:59 smithi184 ceph-mon[35203]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:43:00.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T22:43:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:00 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:43:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:00 smithi087 ceph-mon[35290]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:43:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:00 smithi087 ceph-mon[35290]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:43:01.157 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:00 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:43:01.157 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:00 smithi066 ceph-mon[31185]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:43:01.157 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:00 smithi066 ceph-mon[31185]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:43:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:00 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2625164831' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:43:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:00 smithi184 ceph-mon[35203]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:43:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:00 smithi184 ceph-mon[35203]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:43:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 -- 172.21.15.66:0/4021038527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 msgr2=0x7f348c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 --2- 172.21.15.66:0/4021038527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c103120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f347c009900 tx=0x7f347c02a480 comp rx=0 tx=0).stop 2024-09-15T22:43:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 -- 172.21.15.66:0/4021038527 shutdown_connections 2024-09-15T22:43:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 --2- 172.21.15.66:0/4021038527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c10c170 0x7f348c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 --2- 172.21.15.66:0/4021038527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c103660 0x7f348c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 --2- 172.21.15.66:0/4021038527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c103120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 -- 172.21.15.66:0/4021038527 >> 172.21.15.66:0/4021038527 conn(0x7f348c0fc7a0 msgr2=0x7f348c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 -- 172.21.15.66:0/4021038527 shutdown_connections 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.243+0000 7f3492456640 1 -- 172.21.15.66:0/4021038527 wait complete. 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 Processor -- start 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 -- start start 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c103660 0x7f348c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c10c170 0x7f348c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f348c111f70 con 0x7f348c102d40 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f348c111df0 con 0x7f348c10c170 2024-09-15T22:43:01.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.244+0000 7f3492456640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f348c1120f0 con 0x7f348c103660 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58202/0 (socket says 172.21.15.66:58202) 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 -- 172.21.15.66:0/353221057 learned_addr learned my addr 172.21.15.66:0/353221057 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f34909f3640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c10c170 0x7f348c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348b7fe640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c103660 0x7f348c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 -- 172.21.15.66:0/353221057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c103660 msgr2=0x7f348c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c103660 0x7f348c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 -- 172.21.15.66:0/353221057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c10c170 msgr2=0x7f348c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c10c170 0x7f348c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 -- 172.21.15.66:0/353221057 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c1a68e0 con 0x7f348c102d40 2024-09-15T22:43:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f348bfff640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f347c006010 tx=0x7f347c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c03f030 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1a6b70 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347c003ce0 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c035070 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.245+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1a7050 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.247+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c103120 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.248+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f347c042030 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.249+0000 7f34897fa640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 0x7f34740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.249+0000 7f348b7fe640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 0x7f34740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.249+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7f347c0f02f0 con 0x7f348c102d40 2024-09-15T22:43:01.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.249+0000 7f348b7fe640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 0x7f34740a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f348c102430 tx=0x7f3480005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:01.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.252+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f347c0bceb0 con 0x7f348c102d40 2024-09-15T22:43:01.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.429+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f348c101ed0 con 0x7f348c102d40 2024-09-15T22:43:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.810+0000 7f34897fa640 1 -- 172.21.15.66:0/353221057 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v84) ==== 169+0+0 (secure 0 0 0) 0x7f347c0bc7b0 con 0x7f348c102d40 2024-09-15T22:43:01.811 INFO:teuthology.orchestra.run.smithi066.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T22:43:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 msgr2=0x7f34740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 0x7f34740a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f348c102430 tx=0x7f3480005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 msgr2=0x7f348c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:01.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f347c006010 tx=0x7f347c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 shutdown_connections 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f34740a3240 0x7f34740a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f348c10c170 0x7f348c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f348c103660 0x7f348c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 --2- 172.21.15.66:0/353221057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f348c102d40 0x7f348c1009a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 >> 172.21.15.66:0/353221057 conn(0x7f348c0fc7a0 msgr2=0x7f348c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 shutdown_connections 2024-09-15T22:43:01.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:01.812+0000 7f3492456640 1 -- 172.21.15.66:0/353221057 wait complete. 2024-09-15T22:43:02.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:01 smithi087 ceph-mon[35290]: pgmap v282: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:02.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:01 smithi087 ceph-mon[35290]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:43:02.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:01 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:43:02.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:01 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:43:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:01 smithi184 ceph-mon[35203]: pgmap v282: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:01 smithi184 ceph-mon[35203]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:43:02.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:01 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:43:02.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:01 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:43:02.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:01 smithi066 ceph-mon[31185]: pgmap v282: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-15T22:43:02.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:01 smithi066 ceph-mon[31185]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:43:02.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:01 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:43:02.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:01 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/353221057' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:43:02.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T22:43:02.789 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:03.084 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:02 smithi066 ceph-mon[31185]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:43:03.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:02 smithi087 ceph-mon[35290]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:43:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:02 smithi184 ceph-mon[35203]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:43:03.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 -- 172.21.15.66:0/2566924121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 msgr2=0x7f15d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 --2- 172.21.15.66:0/2566924121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01021c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009900 tx=0x7f15c002a410 comp rx=0 tx=0).stop 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 -- 172.21.15.66:0/2566924121 shutdown_connections 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 --2- 172.21.15.66:0/2566924121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0106f10 0x7f15d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 --2- 172.21.15.66:0/2566924121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0102790 0x7f15d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 --2- 172.21.15.66:0/2566924121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01021c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 -- 172.21.15.66:0/2566924121 >> 172.21.15.66:0/2566924121 conn(0x7f15d00fd8c0 msgr2=0x7f15d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 -- 172.21.15.66:0/2566924121 shutdown_connections 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.306+0000 7f15d4f28640 1 -- 172.21.15.66:0/2566924121 wait complete. 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.307+0000 7f15d4f28640 1 Processor -- start 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.307+0000 7f15d4f28640 1 -- start start 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.307+0000 7f15d4f28640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.307+0000 7f15d4f28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 0x7f15d0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.307+0000 7f15d4f28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 0x7f15d019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15d4f28640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0112010 con 0x7f15d0101de0 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15d4f28640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0111e90 con 0x7f15d0102790 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15d4f28640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0112190 con 0x7f15d0106f10 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39260/0 (socket says 172.21.15.66:39260) 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 -- 172.21.15.66:0/497338950 learned_addr learned my addr 172.21.15.66:0/497338950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 0x7f15d0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 -- 172.21.15.66:0/497338950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 msgr2=0x7f15d019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ced9d640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 0x7f15d019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 0x7f15d019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 -- 172.21.15.66:0/497338950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 msgr2=0x7f15d0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 0x7f15d0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 -- 172.21.15.66:0/497338950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d019d560 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 0x7f15d0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ced9d640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 0x7f15d019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15ce59c640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005ab0 tx=0x7f15c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c003f030 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d019d7f0 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0003ce0 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0035070 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.308+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01a5130 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.309+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d0102240 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.311+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f15c0042030 con 0x7f15d0101de0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.311+0000 7f15bf7fe640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 0x7f15b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.312+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 0x7f15b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:03.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.312+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7f15c00f0750 con 0x7f15d0101de0 2024-09-15T22:43:03.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.312+0000 7f15cdd9b640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 0x7f15b80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15d00ffde0 tx=0x7f15c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:03.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.315+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15c00bd250 con 0x7f15d0101de0 2024-09-15T22:43:03.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.531+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f15d010a0f0 con 0x7f15d0101de0 2024-09-15T22:43:03.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.829+0000 7f15bf7fe640 1 -- 172.21.15.66:0/497338950 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f15c00bcb50 con 0x7f15d0101de0 2024-09-15T22:43:03.831 INFO:teuthology.orchestra.run.smithi066.stderr:added data pool 4 to fsmap 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.832+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 msgr2=0x7f15b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.832+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 0x7f15b80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15d00ffde0 tx=0x7f15c4008040 comp rx=0 tx=0).stop 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.832+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 msgr2=0x7f15d01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.832+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15c0005ab0 tx=0x7f15c00042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 shutdown_connections 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d0106f10 0x7f15d019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f15b80a3240 0x7f15b80a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d0102790 0x7f15d0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 --2- 172.21.15.66:0/497338950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0101de0 0x7f15d01985b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:03.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 >> 172.21.15.66:0/497338950 conn(0x7f15d00fd8c0 msgr2=0x7f15d00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:03.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 shutdown_connections 2024-09-15T22:43:03.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:03.833+0000 7f15d4f28640 1 -- 172.21.15.66:0/497338950 wait complete. 2024-09-15T22:43:04.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:03 smithi087 ceph-mon[35290]: pgmap v285: 129 pgs: 9 unknown, 120 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:04.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:43:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:03 smithi184 ceph-mon[35203]: pgmap v285: 129 pgs: 9 unknown, 120 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:43:04.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:03 smithi066 ceph-mon[31185]: pgmap v285: 129 pgs: 9 unknown, 120 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:04.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:43:04.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:43:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:05.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:04 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:43:05.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:04 smithi066 ceph-mon[31185]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:43:05.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:04 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:04 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:43:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:04 smithi087 ceph-mon[35290]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:43:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:04 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:04 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/497338950' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:43:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:04 smithi184 ceph-mon[35203]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:43:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:04 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 -- 172.21.15.66:0/4125296526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8102d40 msgr2=0x7f2fa8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 --2- 172.21.15.66:0/4125296526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8102d40 0x7f2fa8103120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009900 tx=0x7f2fa402a480 comp rx=0 tx=0).stop 2024-09-15T22:43:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 -- 172.21.15.66:0/4125296526 shutdown_connections 2024-09-15T22:43:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 --2- 172.21.15.66:0/4125296526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 --2- 172.21.15.66:0/4125296526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8103660 0x7f2fa810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 --2- 172.21.15.66:0/4125296526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8102d40 0x7f2fa8103120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 -- 172.21.15.66:0/4125296526 >> 172.21.15.66:0/4125296526 conn(0x7f2fa80fc7a0 msgr2=0x7f2fa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.314+0000 7f2fb0721640 1 -- 172.21.15.66:0/4125296526 shutdown_connections 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 -- 172.21.15.66:0/4125296526 wait complete. 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 Processor -- start 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 -- start start 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8102d40 0x7f2fa8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8111f70 con 0x7f2fa8103660 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8111df0 con 0x7f2fa8102d40 2024-09-15T22:43:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fb0721640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81120f0 con 0x7f2fa810c170 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fadcbc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fadcbc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39284/0 (socket says 172.21.15.66:39284) 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.315+0000 7f2fadcbc640 1 -- 172.21.15.66:0/2886650603 learned_addr learned my addr 172.21.15.66:0/2886650603 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2faecbe640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 -- 172.21.15.66:0/2886650603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 msgr2=0x7f2fa819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fae4bd640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8102d40 0x7f2fa8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 -- 172.21.15.66:0/2886650603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8102d40 msgr2=0x7f2fa8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8102d40 0x7f2fa8198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 -- 172.21.15.66:0/2886650603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa819d300 con 0x7f2fa8103660 2024-09-15T22:43:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2faecbe640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fadcbc640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c970 tx=0x7f2f9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007bb0 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa819d5f0 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f98007d50 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98018820 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.316+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a4ed0 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.317+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa8103120 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.318+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2f980189c0 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.319+0000 7f2f9f7fe640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 0x7f2f940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.319+0000 7f2fae4bd640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 0x7f2f940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.319+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f2f980cfce0 con 0x7f2fa8103660 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.319+0000 7f2fae4bd640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 0x7f2f940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40096c0 tx=0x7f2fa4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.323+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f98014030 con 0x7f2fa8103660 2024-09-15T22:43:05.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.536+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fa81996b0 con 0x7f2fa8103660 2024-09-15T22:43:05.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.537+0000 7f2f9f7fe640 1 -- 172.21.15.66:0/2886650603 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f2f9801f300 con 0x7f2fa8103660 2024-09-15T22:43:05.538 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:05.538 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"btime":"2024-09-15T22:43:03:829044+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:03.533171+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24461,"qdb_cluster":[24461]},"id":1}]} 2024-09-15T22:43:05.539 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-09-15T22:43:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 msgr2=0x7f2f940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 0x7f2f940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40096c0 tx=0x7f2fa4000bc0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 msgr2=0x7f2fa8198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c970 tx=0x7f2f9800ce30 comp rx=0 tx=0).stop 2024-09-15T22:43:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 shutdown_connections 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fa810c170 0x7f2fa819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fa8103660 0x7f2fa8198890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2f940a3240 0x7f2f940a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 --2- 172.21.15.66:0/2886650603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fa8102d40 0x7f2fa8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 >> 172.21.15.66:0/2886650603 conn(0x7f2fa80fc7a0 msgr2=0x7f2fa80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 shutdown_connections 2024-09-15T22:43:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:05.539+0000 7f2fb0721640 1 -- 172.21.15.66:0/2886650603 wait complete. 2024-09-15T22:43:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:05 smithi087 ceph-mon[35290]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:05 smithi087 ceph-mon[35290]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:43:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:05 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T22:43:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:05 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2886650603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:05 smithi184 ceph-mon[35203]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:05 smithi184 ceph-mon[35203]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:43:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:05 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T22:43:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:05 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2886650603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:06.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:05 smithi066 ceph-mon[31185]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:05 smithi066 ceph-mon[31185]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:43:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:05 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T22:43:06.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:05 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2886650603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:06.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:06.501 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 -- 172.21.15.66:0/3552324206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0106a80 msgr2=0x7f14a0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 --2- 172.21.15.66:0/3552324206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0106a80 0x7f14a0106e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1490009930 tx=0x7f149002a420 comp rx=0 tx=0).stop 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 -- 172.21.15.66:0/3552324206 shutdown_connections 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 --2- 172.21.15.66:0/3552324206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 0x7f14a010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 --2- 172.21.15.66:0/3552324206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0100a80 0x7f14a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 --2- 172.21.15.66:0/3552324206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0106a80 0x7f14a0106e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.990+0000 7f14a4d55640 1 -- 172.21.15.66:0/3552324206 >> 172.21.15.66:0/3552324206 conn(0x7f14a00fc7a0 msgr2=0x7f14a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.991+0000 7f14a4d55640 1 -- 172.21.15.66:0/3552324206 shutdown_connections 2024-09-15T22:43:07.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.991+0000 7f14a4d55640 1 -- 172.21.15.66:0/3552324206 wait complete. 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.991+0000 7f14a4d55640 1 Processor -- start 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.991+0000 7f14a4d55640 1 -- start start 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.991+0000 7f14a4d55640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 0x7f14a0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 0x7f14a01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0110ea0 con 0x7f14a0100a80 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0110d20 con 0x7f14a0106a80 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0111020 con 0x7f14a0101420 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39310/0 (socket says 172.21.15.66:39310) 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 -- 172.21.15.66:0/2640955360 learned_addr learned my addr 172.21.15.66:0/2640955360 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149ed9d640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 0x7f14a01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:07.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149dd9b640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 0x7f14a0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:07.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 -- 172.21.15.66:0/2640955360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 msgr2=0x7f14a0102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:07.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 0x7f14a0102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 -- 172.21.15.66:0/2640955360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 msgr2=0x7f14a01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:07.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 0x7f14a01030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 -- 172.21.15.66:0/2640955360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a01a68d0 con 0x7f14a0100a80 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149ed9d640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 0x7f14a01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f149e59c640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1490009a50 tx=0x7f1490004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149003f030 con 0x7f14a0100a80 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1490003ce0 con 0x7f14a0100a80 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a01a6b60 con 0x7f14a0100a80 2024-09-15T22:43:07.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.992+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490035070 con 0x7f14a0100a80 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.993+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a01a7040 con 0x7f14a0100a80 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.993+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a0100ee0 con 0x7f14a0100a80 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.995+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1490042030 con 0x7f14a0100a80 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.996+0000 7f148f7fe640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 0x7f14880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.996+0000 7f149dd9b640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 0x7f14880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.996+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f14900f05b0 con 0x7f14a0100a80 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.996+0000 7f149dd9b640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 0x7f14880a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14a01040e0 tx=0x7f1494005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:07.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:06.999+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14900bd090 con 0x7f14a0100a80 2024-09-15T22:43:07.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.178+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14a01a7320 con 0x7f14a0100a80 2024-09-15T22:43:07.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.180+0000 7f148f7fe640 1 -- 172.21.15.66:0/2640955360 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7f14900bc990 con 0x7f14a0100a80 2024-09-15T22:43:07.182 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:07.182 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 msgr2=0x7f14880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 0x7f14880a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14a01040e0 tx=0x7f1494005cc0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 msgr2=0x7f14a0102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1490009a50 tx=0x7f1490004270 comp rx=0 tx=0).stop 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 shutdown_connections 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f14880a3240 0x7f14880a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14a0106a80 0x7f14a01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14a0101420 0x7f14a0102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 --2- 172.21.15.66:0/2640955360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14a0100a80 0x7f14a0102650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:07.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 >> 172.21.15.66:0/2640955360 conn(0x7f14a00fc7a0 msgr2=0x7f14a0104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:07.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 shutdown_connections 2024-09-15T22:43:07.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:07.183+0000 7f14a4d55640 1 -- 172.21.15.66:0/2640955360 wait complete. 2024-09-15T22:43:07.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:08.102 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:08.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:07 smithi184 ceph-mon[35203]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:08.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:07 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2640955360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:07 smithi066 ceph-mon[31185]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:08.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:07 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2640955360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:08.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:07 smithi087 ceph-mon[35290]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:08.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:07 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2640955360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 -- 172.21.15.66:0/1511395490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4106f10 msgr2=0x7fa5b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1511395490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4106f10 0x7fa5b410ea90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009ca0 tx=0x7fa5ac02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 -- 172.21.15.66:0/1511395490 shutdown_connections 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1511395490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4106f10 0x7fa5b410ea90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1511395490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4102790 0x7fa5b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1511395490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4101de0 0x7fa5b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 -- 172.21.15.66:0/1511395490 >> 172.21.15.66:0/1511395490 conn(0x7fa5b40fd8c0 msgr2=0x7fa5b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 -- 172.21.15.66:0/1511395490 shutdown_connections 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 -- 172.21.15.66:0/1511395490 wait complete. 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.593+0000 7fa5bc243640 1 Processor -- start 2024-09-15T22:43:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 -- start start 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4102790 0x7fa5b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 0x7fa5b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b4111f70 con 0x7fa5b4101de0 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b4111df0 con 0x7fa5b4106f10 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5bc243640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b41120f0 con 0x7fa5b4102790 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39328/0 (socket says 172.21.15.66:39328) 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 -- 172.21.15.66:0/1400026596 learned_addr learned my addr 172.21.15.66:0/1400026596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b97de640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4102790 0x7fa5b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5ba7e0640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 0x7fa5b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 -- 172.21.15.66:0/1400026596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4102790 msgr2=0x7fa5b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4102790 0x7fa5b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 -- 172.21.15.66:0/1400026596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 msgr2=0x7fa5b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 0x7fa5b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 -- 172.21.15.66:0/1400026596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b41a68b0 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5ba7e0640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 0x7fa5b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.594+0000 7fa5b9fdf640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000e9f0 tx=0x7fa5b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.595+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000cd80 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.595+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5b0005500 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.595+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b41a6ba0 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.595+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0010690 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.595+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b41a7090 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.596+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b41021c0 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.597+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa5b00046c0 con 0x7fa5b4101de0 2024-09-15T22:43:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.598+0000 7fa5aaffd640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 0x7fa5a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.598+0000 7fa5b97de640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 0x7fa5a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.598+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fa5b00d0020 con 0x7fa5b4101de0 2024-09-15T22:43:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.598+0000 7fa5b97de640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 0x7fa5a00a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4075f80 tx=0x7fa5a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.602+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5b009cb00 con 0x7fa5b4101de0 2024-09-15T22:43:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.779+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5b4075a20 con 0x7fa5b4101de0 2024-09-15T22:43:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.780+0000 7fa5aaffd640 1 -- 172.21.15.66:0/1400026596 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7fa5b009c400 con 0x7fa5b4101de0 2024-09-15T22:43:08.782 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:08.782 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 msgr2=0x7fa5a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 0x7fa5a00a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4075f80 tx=0x7fa5a4005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 msgr2=0x7fa5b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000e9f0 tx=0x7fa5b000edf0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 shutdown_connections 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa5a00a3240 0x7fa5a00a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5b4106f10 0x7fa5b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5b4102790 0x7fa5b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 --2- 172.21.15.66:0/1400026596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5b4101de0 0x7fa5b40744f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 >> 172.21.15.66:0/1400026596 conn(0x7fa5b40fd8c0 msgr2=0x7fa5b40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 shutdown_connections 2024-09-15T22:43:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:08.783+0000 7fa5bc243640 1 -- 172.21.15.66:0/1400026596 wait complete. 2024-09-15T22:43:09.097 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:08 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1400026596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:08 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1400026596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:08 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1400026596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:09.460 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:43:09.727 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:10.126 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:09 smithi066 ceph-mon[31185]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:10.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:09 smithi184 ceph-mon[35203]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 -- 172.21.15.66:0/2341794712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 msgr2=0x7f71f8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2341794712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8101200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009900 tx=0x7f71e802a480 comp rx=0 tx=0).stop 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 -- 172.21.15.66:0/2341794712 shutdown_connections 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2341794712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2341794712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2341794712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8101200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 -- 172.21.15.66:0/2341794712 >> 172.21.15.66:0/2341794712 conn(0x7f71f80fc7d0 msgr2=0x7f71f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 -- 172.21.15.66:0/2341794712 shutdown_connections 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 -- 172.21.15.66:0/2341794712 wait complete. 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.207+0000 7f71fdb93640 1 Processor -- start 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 -- start start 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8111010 con 0x7f71f8100e20 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8110e90 con 0x7f71f8102ef0 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71fdb93640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8111190 con 0x7f71f8102570 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39352/0 (socket says 172.21.15.66:39352) 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 -- 172.21.15.66:0/2785094176 learned_addr learned my addr 172.21.15.66:0/2785094176 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f6ffd640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f7fff640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 -- 172.21.15.66:0/2785094176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 msgr2=0x7f71f81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 -- 172.21.15.66:0/2785094176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 msgr2=0x7f71f819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 -- 172.21.15.66:0/2785094176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f819c420 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f6ffd640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f7fff640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.208+0000 7f71f77fe640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71e802aa70 tx=0x7f71e8003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.209+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e803f070 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.209+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f819c6b0 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.209+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e8031c20 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.209+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8035030 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.209+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f81a3ff0 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.210+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f8101200 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.211+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f71e8042070 con 0x7f71f8100e20 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.212+0000 7f71f4ff9640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 0x7f71e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.212+0000 7f71f6ffd640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 0x7f71e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.212+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f71e80f03d0 con 0x7f71f8100e20 2024-09-15T22:43:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.212+0000 7f71f6ffd640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 0x7f71e00a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0058c0 tx=0x7f71ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.216+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71e8031dd0 con 0x7f71f8100e20 2024-09-15T22:43:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:09 smithi087 ceph-mon[35290]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.429+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71f81a41c0 con 0x7f71f8100e20 2024-09-15T22:43:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.430+0000 7f71f4ff9640 1 -- 172.21.15.66:0/2785094176 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f71e80bceb0 con 0x7f71f8100e20 2024-09-15T22:43:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:10.431 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"btime":"2024-09-15T22:43:03:829044+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:03.533171+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24461,"qdb_cluster":[24461]},"id":1}]} 2024-09-15T22:43:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-09-15T22:43:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 msgr2=0x7f71e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 0x7f71e00a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0058c0 tx=0x7f71ec005850 comp rx=0 tx=0).stop 2024-09-15T22:43:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 msgr2=0x7f71f8197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71e802aa70 tx=0x7f71e8003b60 comp rx=0 tx=0).stop 2024-09-15T22:43:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 shutdown_connections 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71e00a3240 0x7f71e00a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f8102ef0 0x7f71f819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f8102570 0x7f71f81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 --2- 172.21.15.66:0/2785094176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71f8100e20 0x7f71f8197470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 >> 172.21.15.66:0/2785094176 conn(0x7f71f80fc7d0 msgr2=0x7f71f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 shutdown_connections 2024-09-15T22:43:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:10.432+0000 7f71fdb93640 1 -- 172.21.15.66:0/2785094176 wait complete. 2024-09-15T22:43:11.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:10 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2785094176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:11.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:11.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:10 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2785094176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:10 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2785094176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 -- 172.21.15.66:0/643286672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581036e0 msgr2=0x7f9258107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 --2- 172.21.15.66:0/643286672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581036e0 0x7f9258107b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f924c009930 tx=0x7f924c02a420 comp rx=0 tx=0).stop 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 -- 172.21.15.66:0/643286672 shutdown_connections 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 --2- 172.21.15.66:0/643286672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581082a0 0x7f925810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 --2- 172.21.15.66:0/643286672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581036e0 0x7f9258107b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 --2- 172.21.15.66:0/643286672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 -- 172.21.15.66:0/643286672 >> 172.21.15.66:0/643286672 conn(0x7f92580fc7d0 msgr2=0x7f92580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 -- 172.21.15.66:0/643286672 shutdown_connections 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.934+0000 7f925fe06640 1 -- 172.21.15.66:0/643286672 wait complete. 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 Processor -- start 2024-09-15T22:43:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 -- start start 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581036e0 0x7f9258100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 0x7f9258101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9258112060 con 0x7f92581082a0 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9258111ee0 con 0x7f92581036e0 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925fe06640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f92581121e0 con 0x7f9258102d30 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925dba2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 0x7f9258101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925dba2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51532/0 (socket says 172.21.15.66:51532) 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925dba2640 1 -- 172.21.15.66:0/2753726990 learned_addr learned my addr 172.21.15.66:0/2753726990 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925d3a1640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581036e0 0x7f9258100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 -- 172.21.15.66:0/2753726990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 msgr2=0x7f9258100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 -- 172.21.15.66:0/2753726990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581036e0 msgr2=0x7f9258100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581036e0 0x7f9258100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.935+0000 7f925e3a3640 1 -- 172.21.15.66:0/2753726990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92581a6a60 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f925e3a3640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 0x7f9258101410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f924800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924800ce20 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92581a6d50 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9248005020 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248010720 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.936+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92581a7210 con 0x7f92581082a0 2024-09-15T22:43:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.937+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9258103110 con 0x7f92581082a0 2024-09-15T22:43:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.938+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9248005540 con 0x7f92581082a0 2024-09-15T22:43:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.939+0000 7f9256ffd640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.939+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f92480d0270 con 0x7f92581082a0 2024-09-15T22:43:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.939+0000 7f925dba2640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.939+0000 7f925dba2640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 0x7f92400a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9250005fd0 tx=0x7f925000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:11.943+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f924809cd50 con 0x7f92581082a0 2024-09-15T22:43:12.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.119+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f925810a2b0 con 0x7f92581082a0 2024-09-15T22:43:12.120 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:11 smithi066 ceph-mon[31185]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:12.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.120+0000 7f9256ffd640 1 -- 172.21.15.66:0/2753726990 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7f924809c650 con 0x7f92581082a0 2024-09-15T22:43:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:12.122 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 msgr2=0x7f92400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 0x7f92400a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9250005fd0 tx=0x7f925000b4a0 comp rx=0 tx=0).stop 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 msgr2=0x7f9258101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 0x7f9258101410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f924800ef10 comp rx=0 tx=0).stop 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 shutdown_connections 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92581082a0 0x7f9258101410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:12.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92581036e0 0x7f9258100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 --2- 172.21.15.66:0/2753726990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9258102d30 0x7f9258100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.122+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 >> 172.21.15.66:0/2753726990 conn(0x7f92580fc7d0 msgr2=0x7f9258105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.123+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 shutdown_connections 2024-09-15T22:43:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:12.123+0000 7f925fe06640 1 -- 172.21.15.66:0/2753726990 wait complete. 2024-09-15T22:43:12.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:11 smithi184 ceph-mon[35203]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:12.250 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:11 smithi087 ceph-mon[35290]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:12.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:42:54.256195+0000', 'modified': '2024-09-15T22:43:03.533171+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24461': {'gid': 24461, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.87:6839/426418588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 426418588}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 426418588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24461, 'qdb_cluster': [24461]} 2024-09-15T22:43:12.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:43:12.898 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:43:13.155 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:13.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:12 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2753726990' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:13.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:12 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2753726990' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:13.262 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:12 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2753726990' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- 172.21.15.66:0/2525393195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 msgr2=0x7fae20103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 --2- 172.21.15.66:0/2525393195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20103110 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae18009930 tx=0x7fae1802a440 comp rx=0 tx=0).stop 2024-09-15T22:43:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- 172.21.15.66:0/2525393195 shutdown_connections 2024-09-15T22:43:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 --2- 172.21.15.66:0/2525393195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 0x7fae2010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 --2- 172.21.15.66:0/2525393195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 0x7fae20107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 --2- 172.21.15.66:0/2525393195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20103110 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- 172.21.15.66:0/2525393195 >> 172.21.15.66:0/2525393195 conn(0x7fae200fc7d0 msgr2=0x7fae200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- 172.21.15.66:0/2525393195 shutdown_connections 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- 172.21.15.66:0/2525393195 wait complete. 2024-09-15T22:43:13.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 Processor -- start 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.609+0000 7fae27972640 1 -- start start 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 0x7fae20198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 0x7fae2019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae201120e0 con 0x7fae20102d30 2024-09-15T22:43:13.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae20111f60 con 0x7fae201082a0 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae27972640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae20112260 con 0x7fae201036e0 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37402/0 (socket says 172.21.15.66:37402) 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 -- 172.21.15.66:0/1607547454 learned_addr learned my addr 172.21.15.66:0/1607547454 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae25f0f640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 0x7fae2019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae24f0d640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 0x7fae20198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 -- 172.21.15.66:0/1607547454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 msgr2=0x7fae20198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 0x7fae20198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 -- 172.21.15.66:0/1607547454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 msgr2=0x7fae2019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 0x7fae2019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 -- 172.21.15.66:0/1607547454 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2019d610 con 0x7fae20102d30 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.610+0000 7fae2570e640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae18009230 tx=0x7fae18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.611+0000 7fae1e7fc640 1 -- 172.21.15.66:0/1607547454 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1803f030 con 0x7fae20102d30 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.611+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2019d8a0 con 0x7fae20102d30 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.611+0000 7fae1e7fc640 1 -- 172.21.15.66:0/1607547454 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae18003ad0 con 0x7fae20102d30 2024-09-15T22:43:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.611+0000 7fae1e7fc640 1 -- 172.21.15.66:0/1607547454 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18035070 con 0x7fae20102d30 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.611+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae201a51e0 con 0x7fae20102d30 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.613+0000 7fae1e7fc640 1 -- 172.21.15.66:0/1607547454 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fae18042030 con 0x7fae20102d30 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.613+0000 7fae29d4b740 1 Processor -- start 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.613+0000 7fae29d4b740 1 -- start start 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c239d0 0x555887c23db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 0x555887c30fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555887b8a090 con 0x555887c242f0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555887b31a70 con 0x555887c2ebb0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae29d4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555887b86050 con 0x555887c239d0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae2570e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae2570e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c2e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37414/0 (socket says 172.21.15.66:37414) 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae2570e640 1 -- 172.21.15.66:0/3683815300 learned_addr learned my addr 172.21.15.66:0/3683815300 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 0x555887c30fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae25f0f640 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c239d0 0x555887c23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae1e7fc640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 0x7fae080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae25f0f640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 0x7fae080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 -- 172.21.15.66:0/3683815300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c239d0 msgr2=0x555887c23db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c239d0 0x555887c23db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 -- 172.21.15.66:0/3683815300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 msgr2=0x555887c2e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c2e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 -- 172.21.15.66:0/3683815300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555887b3e130 con 0x555887c2ebb0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae1e7fc640 1 -- 172.21.15.66:0/1607547454 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fae180f0020 con 0x7fae20102d30 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.614+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 0x555887c30fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae2006a370 tx=0x7fae1400bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad1627e8ded68316 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae25f0f640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 0x7fae080a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae10009fd0 tx=0x7fae10004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae077fe640 1 -- 172.21.15.66:0/3683815300 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1400be10 con 0x555887c2ebb0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae077fe640 1 -- 172.21.15.66:0/3683815300 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae14019070 con 0x555887c2ebb0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae077fe640 1 -- 172.21.15.66:0/3683815300 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14014dd0 con 0x555887c2ebb0 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 -- 172.21.15.66:0/3683815300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 msgr2=0x555887c30fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 0x555887c30fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae2006a370 tx=0x7fae1400bbc0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 -- 172.21.15.66:0/3683815300 shutdown_connections 2024-09-15T22:43:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c2ebb0 0x555887c30fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c2e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3683815300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c239d0 0x555887c23db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 -- 172.21.15.66:0/3683815300 >> 172.21.15.66:0/3683815300 conn(0x555887c1ff60 msgr2=0x555887c20340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 -- 172.21.15.66:0/3683815300 shutdown_connections 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.615+0000 7fae29d4b740 1 -- 172.21.15.66:0/3683815300 wait complete. 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 -- start start 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 Processor -- start 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c2e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c2b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555887c31780 con 0x555887c2ebb0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555887b44f20 con 0x555887c239d0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555887c31900 con 0x555887c242f0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae29d4b740 10 client.0 _ll_register_callbacks cb 0x555887b0e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae25f0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae25f0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37416/0 (socket says 172.21.15.66:37416) 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae25f0f640 1 -- 172.21.15.66:0/1411415954 learned_addr learned my addr 172.21.15.66:0/1411415954 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae2570e640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c2e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.616+0000 7fae24f0d640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c2b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 -- 172.21.15.66:0/1411415954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 msgr2=0x555887c2b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c2b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 -- 172.21.15.66:0/1411415954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 msgr2=0x555887c2bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 -- 172.21.15.66:0/1411415954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558878fb2b0 con 0x555887c239d0 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae25f0f640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae2570e640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c2e370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae180edc50 tx=0x7fae180f0320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85587f8254d6b5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18049050 con 0x555887c239d0 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fae18003c80 con 0x555887c239d0 2024-09-15T22:43:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae14019070 con 0x555887c239d0 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fae180bc1d0 con 0x555887c239d0 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae29d4b740 10 client.24524 fetch_fsmap learned FSMap version 17 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x555887c3cfb0 con 0x555887c239d0 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae14019070 con 0x555887c239d0 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fae180b8a70 con 0x555887c239d0 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.617+0000 7fae29d4b740 10 client.24524 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae29d4b740 10 client.24524 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:43:13.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae29d4b740 20 client.24524 populate_metadata read hostname 'smithi066' 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887c3f5c0 0x555887c40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae29d4b740 4 client.24524 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555887b97600 con 0x555887c3f5c0 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.618+0000 7fae24f0d640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887c3f5c0 0x555887c40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.619+0000 7fae04ff9640 10 client.24524 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.619+0000 7fae24f0d640 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887c3f5c0 0x555887c40a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde48c19f7c53133 server_cookie=64d133bd31f45b4a in_seq=0 out_seq=0 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae04ff9640 1 -- 172.21.15.66:0/1411415954 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555887b97600 con 0x555887c3f5c0 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae04ff9640 10 client.24524 handle_command_reply: tid=0 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 client.24524 shutdown 2024-09-15T22:43:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 msgr2=0x555887c2e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c2e370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae180edc50 tx=0x7fae180f0320 comp rx=0 tx=0).stop 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 shutdown_connections 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c2bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c2b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887c3f5c0 0x555887c40a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 --2- 172.21.15.66:0/1411415954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c2e370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae04ff9640 0 client.24524 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 >> 172.21.15.66:0/1411415954 conn(0x555887c1ff60 msgr2=0x555887c25c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 shutdown_connections 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 1 -- 172.21.15.66:0/1411415954 wait complete. 2024-09-15T22:43:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.620+0000 7fae29d4b740 20 client.24524 trim_cache size 0 max 16384 2024-09-15T22:43:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 Processor -- start 2024-09-15T22:43:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 -- start start 2024-09-15T22:43:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c20340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555887c3ed70 con 0x555887c2ebb0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555887c3f440 con 0x555887c239d0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae29d4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555887c3fb10 con 0x555887c242f0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae25f0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae25f0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37428/0 (socket says 172.21.15.66:37428) 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae25f0f640 1 -- 172.21.15.66:0/2495740116 learned_addr learned my addr 172.21.15.66:0/2495740116 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae2570e640 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.638+0000 7fae24f0d640 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c20340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 -- 172.21.15.66:0/2495740116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 msgr2=0x555887c20340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c20340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 -- 172.21.15.66:0/2495740116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 msgr2=0x555887c40a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c40a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 -- 172.21.15.66:0/2495740116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555887c2e6e0 con 0x555887c2ebb0 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae25f0f640 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae10005bd0 tx=0x7fae10009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b136e354529d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae06ffd640 1 -- 172.21.15.66:0/2495740116 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10010460 con 0x555887c2ebb0 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae06ffd640 1 -- 172.21.15.66:0/2495740116 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae10028020 con 0x555887c2ebb0 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.639+0000 7fae06ffd640 1 -- 172.21.15.66:0/2495740116 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae100238a0 con 0x555887c2ebb0 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- 172.21.15.66:0/2495740116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 msgr2=0x555887c29f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae10005bd0 tx=0x7fae10009920 comp rx=0 tx=0).stop 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- 172.21.15.66:0/2495740116 shutdown_connections 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c2ebb0 0x555887c29f90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c242f0 0x555887c20340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 --2- 172.21.15.66:0/2495740116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c40a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- 172.21.15.66:0/2495740116 >> 172.21.15.66:0/2495740116 conn(0x555887c1ff60 msgr2=0x555887c2b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- 172.21.15.66:0/2495740116 shutdown_connections 2024-09-15T22:43:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- 172.21.15.66:0/2495740116 wait complete. 2024-09-15T22:43:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 -- start start 2024-09-15T22:43:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.640+0000 7fae29d4b740 1 Processor -- start 2024-09-15T22:43:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c2ebb0 0x555887c42120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555887c408b0 con 0x555887c242f0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555887c401e0 con 0x555887c239d0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555887c40f80 con 0x555887c2ebb0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae29d4b740 10 client.0 _ll_register_callbacks cb 0x7fae180f37f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae2570e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37430/0 (socket says 172.21.15.66:37430) 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae2570e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42374/0 (socket says 172.21.15.66:42374) 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 -- 172.21.15.66:0/3332809064 learned_addr learned my addr 172.21.15.66:0/3332809064 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae25f0f640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c2ebb0 0x555887c42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 -- 172.21.15.66:0/3332809064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c2ebb0 msgr2=0x555887c42120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c2ebb0 0x555887c42120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 -- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 msgr2=0x555887c48dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 -- 172.21.15.66:0/3332809064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555887c427b0 con 0x555887c242f0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae2570e640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae24f0d640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae14014690 tx=0x7fae140149d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aee37a2ef898e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.641+0000 7fae04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1402c060 con 0x555887c242f0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae10028020 con 0x555887c242f0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fae1400db30 con 0x555887c242f0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fae14033050 con 0x555887c242f0 2024-09-15T22:43:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 10 client.14721 fetch_fsmap learned FSMap version 17 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x555887c47260 con 0x555887c242f0 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae10028020 con 0x555887c242f0 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fae14026030 con 0x555887c242f0 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 10 client.14721 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 10 client.14721 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 20 client.14721 populate_metadata read hostname 'smithi066' 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887cade20 0x555887cacb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 4 client.14721 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.642+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "status"}) -- 0x555887b91b10 con 0x555887cade20 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae2570e640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887cade20 0x555887cacb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae2570e640 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887cade20 0x555887cacb30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e02f56610a6dc3 server_cookie=5e2b995c88165314 in_seq=0 out_seq=0 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae04ff9640 10 client.14721 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae04ff9640 1 -- 172.21.15.66:0/3332809064 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x555887b91b10 con 0x555887cade20 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae04ff9640 10 client.14721 handle_command_reply: tid=0 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 client.14721 shutdown 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 msgr2=0x555887c49300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae14014690 tx=0x7fae140149d0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 shutdown_connections 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555887c2ebb0 0x555887c42120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555887c242f0 0x555887c49300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555887cade20 0x555887cacb30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 --2- 172.21.15.66:0/3332809064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555887c239d0 0x555887c48dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae04ff9640 0 client.14721 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:43:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 >> 172.21.15.66:0/3332809064 conn(0x555887c1ff60 msgr2=0x555887c29f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.643+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 shutdown_connections 2024-09-15T22:43:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae29d4b740 1 -- 172.21.15.66:0/3332809064 wait complete. 2024-09-15T22:43:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae29d4b740 20 client.14721 trim_cache size 0 max 16384 2024-09-15T22:43:13.653 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:43:13.653 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:43:13.653 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-09-15T22:43:13.653 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24461, 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 18.860937965000002, 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 17, 2024-09-15T22:43:13.654 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 85, 2024-09-15T22:43:13.655 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 84, 2024-09-15T22:43:13.655 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 29.712628011 2024-09-15T22:43:13.655 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:43:13.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 msgr2=0x7fae080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 0x7fae080a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae10009fd0 tx=0x7fae10004ab0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 msgr2=0x7fae20198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:13.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae18009230 tx=0x7fae18004270 comp rx=0 tx=0).stop 2024-09-15T22:43:13.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 shutdown_connections 2024-09-15T22:43:13.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fae080a3240 0x7fae080a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae201082a0 0x7fae2019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae201036e0 0x7fae20198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 --2- 172.21.15.66:0/1607547454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae20102d30 0x7fae20198660 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 >> 172.21.15.66:0/1607547454 conn(0x7fae200fc7d0 msgr2=0x7fae20105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 shutdown_connections 2024-09-15T22:43:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:13.644+0000 7fae27972640 1 -- 172.21.15.66:0/1607547454 wait complete. 2024-09-15T22:43:14.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:13 smithi184 ceph-mon[35203]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:14.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:13 smithi066 ceph-mon[31185]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:14.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:13 smithi087 ceph-mon[35290]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:14.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:43:14.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:14.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:43:14.678 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 -- 172.21.15.66:0/2838806681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 msgr2=0x7fea98107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 --2- 172.21.15.66:0/2838806681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98107b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea80009930 tx=0x7fea8002a420 comp rx=0 tx=0).stop 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 -- 172.21.15.66:0/2838806681 shutdown_connections 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 --2- 172.21.15.66:0/2838806681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea981082a0 0x7fea9810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 --2- 172.21.15.66:0/2838806681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98107b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 --2- 172.21.15.66:0/2838806681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea98102d30 0x7fea98103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 -- 172.21.15.66:0/2838806681 >> 172.21.15.66:0/2838806681 conn(0x7fea980fc7d0 msgr2=0x7fea980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 -- 172.21.15.66:0/2838806681 shutdown_connections 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.117+0000 7fea9cd53640 1 -- 172.21.15.66:0/2838806681 wait complete. 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 Processor -- start 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 -- start start 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea98102d30 0x7fea98198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea981082a0 0x7fea9819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fea981120a0 con 0x7fea981036e0 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fea98111f20 con 0x7fea98102d30 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9cd53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fea98112220 con 0x7fea981082a0 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37450/0 (socket says 172.21.15.66:37450) 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea95d9b640 1 -- 172.21.15.66:0/3820704231 learned_addr learned my addr 172.21.15.66:0/3820704231 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea96d9d640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea981082a0 0x7fea9819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.118+0000 7fea9659c640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea98102d30 0x7fea98198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 -- 172.21.15.66:0/3820704231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea981082a0 msgr2=0x7fea9819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea981082a0 0x7fea9819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 -- 172.21.15.66:0/3820704231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea98102d30 msgr2=0x7fea98198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea98102d30 0x7fea98198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 -- 172.21.15.66:0/3820704231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9819d5b0 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea95d9b640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea80005940 tx=0x7fea800040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8003f030 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea800044c0 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9819d840 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80035070 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.119+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea981a5180 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.120+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9806a850 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.121+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fea80042030 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.122+0000 7fea8f7fe640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 0x7fea840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.122+0000 7fea9659c640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 0x7fea840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.122+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fea800f0160 con 0x7fea981036e0 2024-09-15T22:43:15.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.123+0000 7fea9659c640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 0x7fea840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea90005fd0 tx=0x7fea9000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:15.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.125+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea800bc5f0 con 0x7fea981036e0 2024-09-15T22:43:15.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.339+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea9810a2b0 con 0x7fea981036e0 2024-09-15T22:43:15.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.339+0000 7fea8f7fe640 1 -- 172.21.15.66:0/3820704231 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fea800c08f0 con 0x7fea981036e0 2024-09-15T22:43:15.340 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:43:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 msgr2=0x7fea840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:15.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 0x7fea840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea90005fd0 tx=0x7fea9000b390 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 msgr2=0x7fea98198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea80005940 tx=0x7fea800040c0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 shutdown_connections 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea981082a0 0x7fea9819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea981036e0 0x7fea98198b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fea840a3240 0x7fea840a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 --2- 172.21.15.66:0/3820704231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea98102d30 0x7fea98198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 >> 172.21.15.66:0/3820704231 conn(0x7fea980fc7d0 msgr2=0x7fea98105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 shutdown_connections 2024-09-15T22:43:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:15.341+0000 7fea9cd53640 1 -- 172.21.15.66:0/3820704231 wait complete. 2024-09-15T22:43:15.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:15 smithi066 ceph-mon[31185]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:15.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:15 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3820704231' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:15.987 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:43:15.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:43:15.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:43:15.988 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:43:15.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:15.988 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-09-15T22:43:16.005 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:43:16.005 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:43:16.005 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:43:16.006 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42251sec preferred_lft 42251sec 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-15T22:43:16.007 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:43:16.008 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:43:16.008 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:43:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:43:16.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:15 smithi184 ceph-mon[35203]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:16.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:15 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3820704231' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:43:16.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:16.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:16.211 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:43:16.237 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-09-15T22:43:16.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:16.239 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-09-15T22:43:16.309 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-09-15T22:43:16.310 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:43:16.310 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:43:16.310 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:43:16.310 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:43:16.310 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:43:16.311 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:43:16.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:43:16.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:43:16.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:43:16.311 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:43:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:15 smithi087 ceph-mon[35290]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:15 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3820704231' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:43:16.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:43:16.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:16.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:16.649 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-15T22:43:16.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:16.666 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-09-15T22:43:16.721 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:43:16.721 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:43:16.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:43:16.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T22:43:16.722 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:43:16.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:43:16.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:16.844 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T22:43:16.844 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:43:16.844 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T22:43:16.845 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:43:16.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:43:16.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:16.974 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:43:16.974 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:43:16.974 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-09-15T22:43:16.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:43:16.975 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:43:17.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:43:17.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:17.054 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T22:43:17.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:43:17.054 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:17.070 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:43:17.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:43:17.071 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:17.127 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-09-15T22:43:17.194 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-09-15T22:43:17.252 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-09-15T22:43:17.253 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-09-15T22:43:17.254 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/db5098c66505346a6b7b38298a8fb536b099ac613dd0310a50958686376bf507/merged 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/950db2dba2914c03abe075642a82ca5a43fad439cab8a78be7df930568e335e2/merged 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/0 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/9b6b213ce88bfd8a9a759d687624405d18e1094a4e1b3cb81e47bd194c58e163/merged 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/a714757f5a1ae2a581d69022ea7f61973dcc4f8ae1f44f78730c346bc72791eb/merged 2024-09-15T22:43:17.255 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/5f53d4e9faf936a74973b08e75c6f91a8f28c86953c15767eee6fffa2d6604cc/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/b30566ef8c2185b75c103009b9d6cb965e2d39f39897336ceba6d22e9589b8dd/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/cac2c66f2194a1fc5d88c86884bdb879c53180f1e12287440475771612194d93/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/1747ef2777759569495f87820bc043c7498cc2389d98263b51c3029a173282f2/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/c1973fa905d3334a76523cdb3e83c4c5d454aa9d53531e1fa1a5ad2531310f19/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/d316f42818f2492a63d957056e58909d84530027e1632e21c2753e9380c084b4/merged 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:43:17.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:17.257 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-09-15T22:43:17.308 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:43:17.308 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T22:43:17.352 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2024-09-15T22:43:17.377 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:43:17.434 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2024-09-15T22:43:17.434 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2024-09-15T22:43:17.434 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2024-09-15T22:43:17.435 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/db5098c66505346a6b7b38298a8fb536b099ac613dd0310a50958686376bf507/merged 2024-09-15T22:43:17.436 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/950db2dba2914c03abe075642a82ca5a43fad439cab8a78be7df930568e335e2/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/0 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/9b6b213ce88bfd8a9a759d687624405d18e1094a4e1b3cb81e47bd194c58e163/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/a714757f5a1ae2a581d69022ea7f61973dcc4f8ae1f44f78730c346bc72791eb/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/5f53d4e9faf936a74973b08e75c6f91a8f28c86953c15767eee6fffa2d6604cc/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/b30566ef8c2185b75c103009b9d6cb965e2d39f39897336ceba6d22e9589b8dd/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/cac2c66f2194a1fc5d88c86884bdb879c53180f1e12287440475771612194d93/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/1747ef2777759569495f87820bc043c7498cc2389d98263b51c3029a173282f2/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/c1973fa905d3334a76523cdb3e83c4c5d454aa9d53531e1fa1a5ad2531310f19/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/containers/storage/overlay/d316f42818f2492a63d957056e58909d84530027e1632e21c2753e9380c084b4/merged 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:43:17.437 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:43:17.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:17.438 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2024-09-15T22:43:17.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:2024-09-15T22:43:17.462+0000 7ff0cc232480 -1 init, newargv = 0x560a4cde0b80 newargc=15 2024-09-15T22:43:17.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[75482]: starting ceph client 2024-09-15T22:43:17.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[75482]: starting fuse 2024-09-15T22:43:17.479 INFO:teuthology.orchestra.run.smithi066.stdout:120 2024-09-15T22:43:17.479 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-15T22:43:17.479 DEBUG:teuthology.orchestra.run.smithi066:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> import glob 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> import re 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> import os 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> import subprocess 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> def _find_admin_socket(client_name): 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> files = glob.glob(asok_path) 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> # Given a non-glob path, it better be there 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> if "*" not in asok_path: 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> assert(len(files) == 1) 2024-09-15T22:43:17.480 DEBUG:teuthology.orchestra.run.smithi066:> return files[0] 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> for f in files: 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> contents = proc_f.read() 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> if mountpoint in contents: 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> return f 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> print(_find_admin_socket("client.admin")) 2024-09-15T22:43:17.481 DEBUG:teuthology.orchestra.run.smithi066:> ' 2024-09-15T22:43:17.603 INFO:teuthology.orchestra.run.smithi066.stdout:/var/run/ceph/ceph-client.admin.75482.asok 2024-09-15T22:43:17.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:17.613 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75482.asok 2024-09-15T22:43:17.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:17.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75482.asok status 2024-09-15T22:43:17.754 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:43:17.754 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": { 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "entity_id": "admin", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": "smithi066", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "pid": "75482", 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "root": "/" 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_count": 0, 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_pinned_count": 0, 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 14733, 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "inst": { 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "name": { 2024-09-15T22:43:17.755 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "client", 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "num": 14733 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 3968178685 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 3968178685 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:43:17.756 INFO:teuthology.orchestra.run.smithi066.stdout: "inst_str": "client.14733 192.168.0.1:0/3968178685", 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "addr_str": "192.168.0.1:0/3968178685", 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "inode_count": 1, 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_epoch": 17, 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch": 85, 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklisted": false, 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs" 2024-09-15T22:43:17.757 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:43:17.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:17.763 DEBUG:teuthology.orchestra.run.smithi066:> stat --file-system '--printf=%T 2024-09-15T22:43:17.763 DEBUG:teuthology.orchestra.run.smithi066:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:17.779 INFO:teuthology.orchestra.run.smithi066.stdout:fuseblk 2024-09-15T22:43:17.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:17.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:17.847 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T22:43:17.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:43:17.955 INFO:teuthology.orchestra.run.smithi066.stdout:# file: . 2024-09-15T22:43:17.955 INFO:teuthology.orchestra.run.smithi066.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T22:43:17.956 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:17.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:43:17.962 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:43:17.962 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:43:17.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:43:18.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:17 smithi184 ceph-mon[35203]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:18.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:17 smithi066 ceph-mon[31185]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:18.283 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:18.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:17 smithi087 ceph-mon[35290]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:43:18.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 -- 172.21.15.66:0/444772564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 msgr2=0x7fb9e01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:18.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/444772564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01021d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009900 tx=0x7fb9dc02a410 comp rx=0 tx=0).stop 2024-09-15T22:43:18.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 -- 172.21.15.66:0/444772564 shutdown_connections 2024-09-15T22:43:18.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/444772564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e0106f20 0x7fb9e010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/444772564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e01027a0 0x7fb9e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/444772564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01021d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 -- 172.21.15.66:0/444772564 >> 172.21.15.66:0/444772564 conn(0x7fb9e00fd8f0 msgr2=0x7fb9e00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 -- 172.21.15.66:0/444772564 shutdown_connections 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.762+0000 7fb9e86c6640 1 -- 172.21.15.66:0/444772564 wait complete. 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 Processor -- start 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 -- start start 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e01027a0 0x7fb9e01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e0106f20 0x7fb9e019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0111fc0 con 0x7fb9e0101df0 2024-09-15T22:43:18.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0111e40 con 0x7fb9e01027a0 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e86c6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0112140 con 0x7fb9e0106f20 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e6462640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e6462640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37470/0 (socket says 172.21.15.66:37470) 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.763+0000 7fb9e6462640 1 -- 172.21.15.66:0/4275852768 learned_addr learned my addr 172.21.15.66:0/4275852768 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6c63640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e0106f20 0x7fb9e019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e5c61640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e01027a0 0x7fb9e01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 -- 172.21.15.66:0/4275852768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e0106f20 msgr2=0x7fb9e019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e0106f20 0x7fb9e019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 -- 172.21.15.66:0/4275852768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e01027a0 msgr2=0x7fb9e01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e01027a0 0x7fb9e01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 -- 172.21.15.66:0/4275852768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e019d450 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e6462640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc006010 tx=0x7fb9dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc03f030 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9dc003ce0 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e019d6e0 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc035070 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.764+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01a5020 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.766+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e01032d0 con 0x7fb9e0101df0 2024-09-15T22:43:18.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.767+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb9dc042030 con 0x7fb9e0101df0 2024-09-15T22:43:18.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.768+0000 7fb9d77fe640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:18.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.768+0000 7fb9e5c61640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:18.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.768+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb9dc0f0400 con 0x7fb9e0101df0 2024-09-15T22:43:18.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.768+0000 7fb9e5c61640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00fdd10 tx=0x7fb9d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:18.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.771+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9dc0bc950 con 0x7fb9e0101df0 2024-09-15T22:43:18.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.963+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9e010a100 con 0x7fb9e0101df0 2024-09-15T22:43:18.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.964+0000 7fb9d77fe640 1 -- 172.21.15.66:0/4275852768 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+592 (secure 0 0 0) 0x7fb9dc0c0c50 con 0x7fb9e0101df0 2024-09-15T22:43:18.965 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/4222885037 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:18.965 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1307325821 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:18.965 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:18.965 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3360541639 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3357213114 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1680944887 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2189919935 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:18.966 INFO:teuthology.orchestra.run.smithi066.stderr:listed 10 entries 2024-09-15T22:43:18.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 msgr2=0x7fb9cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:18.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00fdd10 tx=0x7fb9d000b390 comp rx=0 tx=0).stop 2024-09-15T22:43:18.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 msgr2=0x7fb9e01984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:18.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc006010 tx=0x7fb9dc0042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 shutdown_connections 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9e0106f20 0x7fb9e019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9e01027a0 0x7fb9e01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 --2- 172.21.15.66:0/4275852768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9e0101df0 0x7fb9e01984a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 >> 172.21.15.66:0/4275852768 conn(0x7fb9e00fd8f0 msgr2=0x7fb9e00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 shutdown_connections 2024-09-15T22:43:18.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:18.966+0000 7fb9e86c6640 1 -- 172.21.15.66:0/4275852768 wait complete. 2024-09-15T22:43:19.785 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:43:19.785 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:43:19.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:43:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:20.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:19 smithi184 ceph-mon[35203]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:19 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4275852768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:20.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:19 smithi066 ceph-mon[31185]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:20.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:19 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4275852768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:19 smithi087 ceph-mon[35290]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:19 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4275852768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 -- 172.21.15.66:0/341084056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710100e20 msgr2=0x7f0710101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 --2- 172.21.15.66:0/341084056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710100e20 0x7f0710101200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0700009900 tx=0x7f070002a480 comp rx=0 tx=0).stop 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 -- 172.21.15.66:0/341084056 shutdown_connections 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 --2- 172.21.15.66:0/341084056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 0x7f071010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 --2- 172.21.15.66:0/341084056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710102570 0x7f07101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 --2- 172.21.15.66:0/341084056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710100e20 0x7f0710101200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 -- 172.21.15.66:0/341084056 >> 172.21.15.66:0/341084056 conn(0x7f07100fc7d0 msgr2=0x7f07100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 -- 172.21.15.66:0/341084056 shutdown_connections 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 -- 172.21.15.66:0/341084056 wait complete. 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.600+0000 7f0714d6b640 1 Processor -- start 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 -- start start 2024-09-15T22:43:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710100e20 0x7f07101973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 0x7f071019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0710110f80 con 0x7f0710102570 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0710110e00 con 0x7f0710102ef0 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0714d6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0710111100 con 0x7f0710100e20 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37492/0 (socket says 172.21.15.66:37492) 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 -- 172.21.15.66:0/1112950826 learned_addr learned my addr 172.21.15.66:0/1112950826 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f070e59c640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710100e20 0x7f07101973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f070ed9d640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 0x7f071019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 -- 172.21.15.66:0/1112950826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710100e20 msgr2=0x7f07101973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710100e20 0x7f07101973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 -- 172.21.15.66:0/1112950826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 msgr2=0x7f071019bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 0x7f071019bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.601+0000 7f0705d9b640 1 -- 172.21.15.66:0/1112950826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071019c3a0 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0705d9b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06f800d950 tx=0x7f06f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8017070 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8009c30 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071019c690 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f800f6b0 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.602+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101a3f70 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.603+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710101200 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.604+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f06f80109d0 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.605+0000 7f0707fff640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 0x7f06fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.605+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f06f80cf7e0 con 0x7f0710102570 2024-09-15T22:43:20.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.605+0000 7f070e59c640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 0x7f06fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:20.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.605+0000 7f070e59c640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 0x7f06fc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0700009230 tx=0x7f07000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:20.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.609+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06f8009de0 con 0x7f0710102570 2024-09-15T22:43:20.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.798+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0710109090 con 0x7f0710102570 2024-09-15T22:43:20.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.798+0000 7f0707fff640 1 -- 172.21.15.66:0/1112950826 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+592 (secure 0 0 0) 0x7f06f809c2c0 con 0x7f0710102570 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/4222885037 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1307325821 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3360541639 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3357213114 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1680944887 2024-09-16T22:36:00.281528+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2189919935 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:20.800 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi066.stderr:listed 10 entries 2024-09-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 msgr2=0x7f06fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 0x7f06fc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0700009230 tx=0x7f07000058d0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 msgr2=0x7f0710197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06f800d950 tx=0x7f06f800de10 comp rx=0 tx=0).stop 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 shutdown_connections 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f06fc0a3240 0x7f06fc0a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0710102ef0 0x7f071019bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0710102570 0x7f0710197930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 --2- 172.21.15.66:0/1112950826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0710100e20 0x7f07101973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.800+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 >> 172.21.15.66:0/1112950826 conn(0x7f07100fc7d0 msgr2=0x7f07100fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.801+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 shutdown_connections 2024-09-15T22:43:20.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:20.801+0000 7f0714d6b640 1 -- 172.21.15.66:0/1112950826 wait complete. 2024-09-15T22:43:21.165 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:20 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1112950826' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:21.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:20 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1112950826' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:20 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1112950826' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:43:21.477 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi066.front.sepia.ceph.com... 2024-09-15T22:43:21.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:21.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:43:21.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi066.stderr:ceph-fuse[75482]: fuse finished with error 0 and tester_r 0 2024-09-15T22:43:21.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:43:22.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:21 smithi184 ceph-mon[35203]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:22.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:21 smithi066 ceph-mon[31185]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:21 smithi087 ceph-mon[35290]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:24.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:23 smithi184 ceph-mon[35203]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:24.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:23 smithi066 ceph-mon[31185]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:24.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:23 smithi087 ceph-mon[35290]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:43:26.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:25 smithi184 ceph-mon[35203]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:26.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:25 smithi066 ceph-mon[31185]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:26.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:25 smithi087 ceph-mon[35290]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:27.607 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:43:27.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:43:27.608 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T22:43:27.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:27.928 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:27.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:27 smithi066 ceph-mon[31185]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:28.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:27 smithi184 ceph-mon[35203]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:27 smithi087 ceph-mon[35290]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:28.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.423+0000 7f37a2d99640 1 -- 172.21.15.66:0/3648175080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c106f10 msgr2=0x7f379c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.423+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3648175080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c106f10 0x7f379c10ea90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3794009ca0 tx=0x7f379402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 -- 172.21.15.66:0/3648175080 shutdown_connections 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3648175080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c106f10 0x7f379c10ea90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3648175080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c102790 0x7f379c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3648175080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c101de0 0x7f379c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 -- 172.21.15.66:0/3648175080 >> 172.21.15.66:0/3648175080 conn(0x7f379c0fd8c0 msgr2=0x7f379c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 -- 172.21.15.66:0/3648175080 shutdown_connections 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 -- 172.21.15.66:0/3648175080 wait complete. 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 Processor -- start 2024-09-15T22:43:28.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 -- start start 2024-09-15T22:43:28.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:28.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c102790 0x7f379c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:28.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.424+0000 7f37a2d99640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c106f10 0x7f379c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a2d99640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f379c111fb0 con 0x7f379c101de0 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a2d99640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f379c111e30 con 0x7f379c106f10 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a2d99640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112130 con 0x7f379c102790 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56356/0 (socket says 172.21.15.66:56356) 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 -- 172.21.15.66:0/3131146839 learned_addr learned my addr 172.21.15.66:0/3131146839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a1336640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c106f10 0x7f379c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 -- 172.21.15.66:0/3131146839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c102790 msgr2=0x7f379c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c102790 0x7f379c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 -- 172.21.15.66:0/3131146839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c106f10 msgr2=0x7f379c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c106f10 0x7f379c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 -- 172.21.15.66:0/3131146839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c19d440 con 0x7f379c101de0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a0b35640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f379000d770 tx=0x7f379000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790017070 con 0x7f379c101de0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790005500 con 0x7f379c101de0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c19d730 con 0x7f379c101de0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.425+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790004e00 con 0x7f379c101de0 2024-09-15T22:43:28.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.426+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1a5010 con 0x7f379c101de0 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.427+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c1021c0 con 0x7f379c101de0 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.428+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3790004fa0 con 0x7f379c101de0 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.428+0000 7f3799ffb640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 0x7f378c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.429+0000 7f379bfff640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 0x7f378c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.429+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f37900cf630 con 0x7f379c101de0 2024-09-15T22:43:28.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.429+0000 7f379bfff640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 0x7f378c0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f379c1088e0 tx=0x7f3788006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:28.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.433+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f379009c110 con 0x7f379c101de0 2024-09-15T22:43:28.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.611+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f379c10a0f0 con 0x7f379c101de0 2024-09-15T22:43:28.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.612+0000 7f3799ffb640 1 -- 172.21.15.66:0/3131146839 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7f379009ba10 con 0x7f379c101de0 2024-09-15T22:43:28.614 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:28.614 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 msgr2=0x7f378c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 0x7f378c0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f379c1088e0 tx=0x7f3788006c90 comp rx=0 tx=0).stop 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 msgr2=0x7f379c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f379000d770 tx=0x7f379000dc30 comp rx=0 tx=0).stop 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 shutdown_connections 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f378c0a3240 0x7f378c0a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f379c106f10 0x7f379c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f379c102790 0x7f379c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 --2- 172.21.15.66:0/3131146839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f379c101de0 0x7f379c198490 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:28.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 >> 172.21.15.66:0/3131146839 conn(0x7f379c0fd8c0 msgr2=0x7f379c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:28.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 shutdown_connections 2024-09-15T22:43:28.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:28.615+0000 7f37a2d99640 1 -- 172.21.15.66:0/3131146839 wait complete. 2024-09-15T22:43:29.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3131146839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3131146839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3131146839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:29.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:29.655 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:30.043 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:29 smithi066 ceph-mon[31185]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.124+0000 7fddc5308640 1 -- 172.21.15.66:0/2193596837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0101410 msgr2=0x7fddc010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.124+0000 7fddc5308640 1 --2- 172.21.15.66:0/2193596837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0101410 0x7fddc010d940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009cd0 tx=0x7fddb802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 -- 172.21.15.66:0/2193596837 shutdown_connections 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 --2- 172.21.15.66:0/2193596837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0101410 0x7fddc010d940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 --2- 172.21.15.66:0/2193596837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0100a70 0x7fddc0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 --2- 172.21.15.66:0/2193596837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 0x7fddc0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 -- 172.21.15.66:0/2193596837 >> 172.21.15.66:0/2193596837 conn(0x7fddc00fc790 msgr2=0x7fddc00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 -- 172.21.15.66:0/2193596837 shutdown_connections 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 -- 172.21.15.66:0/2193596837 wait complete. 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 Processor -- start 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.125+0000 7fddc5308640 1 -- start start 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0101410 0x7fddc0110eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 0x7fddc01113f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006ad60 con 0x7fddc0100a70 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006abe0 con 0x7fddc0101410 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006aee0 con 0x7fddc0106a70 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56378/0 (socket says 172.21.15.66:56378) 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 -- 172.21.15.66:0/544942989 learned_addr learned my addr 172.21.15.66:0/544942989 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbf7fe640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 0x7fddc01113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbe7fc640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0101410 0x7fddc0110eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 -- 172.21.15.66:0/544942989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 msgr2=0x7fddc01113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 0x7fddc01113f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 -- 172.21.15.66:0/544942989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0101410 msgr2=0x7fddc0110eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0101410 0x7fddc0110eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 -- 172.21.15.66:0/544942989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc01a6870 con 0x7fddc0100a70 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddbeffd640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fddb000e9f0 tx=0x7fddb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb000cd80 con 0x7fddc0100a70 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddb0005500 con 0x7fddc0100a70 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.126+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc01a6b60 con 0x7fddc0100a70 2024-09-15T22:43:30.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.127+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0010690 con 0x7fddc0100a70 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.127+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc01a7050 con 0x7fddc0100a70 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.127+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc0100ed0 con 0x7fddc0100a70 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.129+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fddb00046c0 con 0x7fddc0100a70 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.129+0000 7fdda7fff640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 0x7fdda80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.129+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fddb00cffb0 con 0x7fddc0100a70 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.129+0000 7fddbe7fc640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 0x7fdda80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.130+0000 7fddbe7fc640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 0x7fdda80a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005e10 tx=0x7fddb4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:30.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.134+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddb009ca90 con 0x7fddc0100a70 2024-09-15T22:43:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:29 smithi184 ceph-mon[35203]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:30.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.311+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddc01a7350 con 0x7fddc0100a70 2024-09-15T22:43:30.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.313+0000 7fdda7fff640 1 -- 172.21.15.66:0/544942989 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7fddb009c390 con 0x7fddc0100a70 2024-09-15T22:43:30.314 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:30.314 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 msgr2=0x7fdda80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 0x7fdda80a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005e10 tx=0x7fddb4005da0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 msgr2=0x7fddc0110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fddb000e9f0 tx=0x7fddb000edf0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 shutdown_connections 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddc0106a70 0x7fddc01113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fdda80a3240 0x7fdda80a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddc0101410 0x7fddc0110eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 --2- 172.21.15.66:0/544942989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fddc0100a70 0x7fddc0110970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 >> 172.21.15.66:0/544942989 conn(0x7fddc00fc790 msgr2=0x7fddc00fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 shutdown_connections 2024-09-15T22:43:30.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:30.315+0000 7fddc5308640 1 -- 172.21.15.66:0/544942989 wait complete. 2024-09-15T22:43:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:29 smithi087 ceph-mon[35290]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:43:31.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:43:31.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:30 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/544942989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:31.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:30 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/544942989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:30 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/544942989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:31.356 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:32.050 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:31 smithi066 ceph-mon[31185]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:32.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 -- 172.21.15.66:0/886050337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c4102d30 msgr2=0x7f18c4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:32.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 --2- 172.21.15.66:0/886050337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c4102d30 0x7f18c4103110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009930 tx=0x7f18bc02a440 comp rx=0 tx=0).stop 2024-09-15T22:43:32.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 -- 172.21.15.66:0/886050337 shutdown_connections 2024-09-15T22:43:32.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 --2- 172.21.15.66:0/886050337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41082a0 0x7f18c410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 --2- 172.21.15.66:0/886050337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c41036e0 0x7f18c4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 --2- 172.21.15.66:0/886050337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c4102d30 0x7f18c4103110 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 -- 172.21.15.66:0/886050337 >> 172.21.15.66:0/886050337 conn(0x7f18c40fc7d0 msgr2=0x7f18c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.048+0000 7f18cb1df640 1 -- 172.21.15.66:0/886050337 shutdown_connections 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.049+0000 7f18cb1df640 1 -- 172.21.15.66:0/886050337 wait complete. 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.049+0000 7f18cb1df640 1 Processor -- start 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.049+0000 7f18cb1df640 1 -- start start 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c4102d30 0x7f18c4198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41036e0 0x7f18c4198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4112160 con 0x7f18c41082a0 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4111fe0 con 0x7f18c4102d30 2024-09-15T22:43:32.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18cb1df640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41122e0 con 0x7f18c41036e0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56394/0 (socket says 172.21.15.66:56394) 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 -- 172.21.15.66:0/980769548 learned_addr learned my addr 172.21.15.66:0/980769548 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c8f7b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c4102d30 0x7f18c4198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c3fff640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41036e0 0x7f18c4198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 -- 172.21.15.66:0/980769548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41036e0 msgr2=0x7f18c4198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41036e0 0x7f18c4198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 -- 172.21.15.66:0/980769548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c4102d30 msgr2=0x7f18c4198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c4102d30 0x7f18c4198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 -- 172.21.15.66:0/980769548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c419d6d0 con 0x7f18c41082a0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.050+0000 7f18c977c640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009fd0 tx=0x7f18ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:32.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.051+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac011830 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.051+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ac016070 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.051+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c419d9c0 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.051+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00f2e0 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.051+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c41008c0 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.052+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c406a850 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.053+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f18ac0119d0 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.054+0000 7f18c1ffb640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 0x7f18b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.054+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f18ac0cf110 con 0x7f18c41082a0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.054+0000 7f18c8f7b640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 0x7f18b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:32.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.054+0000 7f18c8f7b640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 0x7f18b00a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009900 tx=0x7f18bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:32.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.058+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18ac09bbf0 con 0x7f18c41082a0 2024-09-15T22:43:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:31 smithi184 ceph-mon[35203]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:32.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.273+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f18c410a2b0 con 0x7f18c41082a0 2024-09-15T22:43:32.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:31 smithi087 ceph-mon[35290]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:32.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.919+0000 7f18c1ffb640 1 -- 172.21.15.66:0/980769548 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f18ac09b4f0 con 0x7f18c41082a0 2024-09-15T22:43:32.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 msgr2=0x7f18b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:32.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 0x7f18b00a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009900 tx=0x7f18bc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 msgr2=0x7f18c419cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009fd0 tx=0x7f18ac00b8e0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 shutdown_connections 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c41082a0 0x7f18c419cff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18c41036e0 0x7f18c4198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f18b00a32c0 0x7f18b00a5780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 --2- 172.21.15.66:0/980769548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18c4102d30 0x7f18c4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:32.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 >> 172.21.15.66:0/980769548 conn(0x7f18c40fc7d0 msgr2=0x7f18c4105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:32.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 shutdown_connections 2024-09-15T22:43:32.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:32.922+0000 7f18cb1df640 1 -- 172.21.15.66:0/980769548 wait complete. 2024-09-15T22:43:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:32 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:43:33.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:43:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:32 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:43:33.681 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-15T22:43:33.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-15T22:43:33.946 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:33 smithi184 ceph-mon[35203]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:43:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:33 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:34.189 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:33 smithi066 ceph-mon[31185]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:34.189 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:33 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:43:34.189 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:33 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:33 smithi087 ceph-mon[35290]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:33 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/980769548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:43:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:33 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 -- 172.21.15.66:0/3589837137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc100a80 msgr2=0x7f54fc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 --2- 172.21.15.66:0/3589837137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc100a80 0x7f54fc100ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009930 tx=0x7f54e402a420 comp rx=0 tx=0).stop 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 -- 172.21.15.66:0/3589837137 shutdown_connections 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 --2- 172.21.15.66:0/3589837137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc101420 0x7f54fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 --2- 172.21.15.66:0/3589837137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc100a80 0x7f54fc100ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 --2- 172.21.15.66:0/3589837137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc106a80 0x7f54fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 -- 172.21.15.66:0/3589837137 >> 172.21.15.66:0/3589837137 conn(0x7f54fc0fc7a0 msgr2=0x7f54fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 -- 172.21.15.66:0/3589837137 shutdown_connections 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.424+0000 7f5500cac640 1 -- 172.21.15.66:0/3589837137 wait complete. 2024-09-15T22:43:34.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 Processor -- start 2024-09-15T22:43:34.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 -- start start 2024-09-15T22:43:34.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 0x7f54fc0fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:34.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc101420 0x7f54fc0fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:34.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:34.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc110ea0 con 0x7f54fc106a80 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc110d20 con 0x7f54fc100a80 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.425+0000 7f5500cac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc111020 con 0x7f54fc101420 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33072/0 (socket says 172.21.15.66:33072) 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 -- 172.21.15.66:0/1094637237 learned_addr learned my addr 172.21.15.66:0/1094637237 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fa59c640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 0x7f54fc0fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54f3fff640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc101420 0x7f54fc0fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 -- 172.21.15.66:0/1094637237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc101420 msgr2=0x7f54fc0fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc101420 0x7f54fc0fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 -- 172.21.15.66:0/1094637237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 msgr2=0x7f54fc0fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 0x7f54fc0fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 -- 172.21.15.66:0/1094637237 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc1a6940 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fa59c640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 0x7f54fc0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54fad9d640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54f400eb10 tx=0x7f54f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4004b20 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc1a6c30 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f4004cc0 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4010760 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.426+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc1a7170 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.427+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc100ee0 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.429+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f54f4010900 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.429+0000 7f54f37fe640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 0x7f54e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.429+0000 7f54fa59c640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 0x7f54e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.429+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f54f40d0490 con 0x7f54fc106a80 2024-09-15T22:43:34.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.430+0000 7f54fa59c640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 0x7f54e80a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54ec006fd0 tx=0x7f54ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:34.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.433+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54f40541b0 con 0x7f54fc106a80 2024-09-15T22:43:34.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.648+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f54fc02d7c0 con 0x7f54fc106a80 2024-09-15T22:43:34.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.926+0000 7f54f37fe640 1 -- 172.21.15.66:0/1094637237 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f54f409cf10 con 0x7f54fc106a80 2024-09-15T22:43:34.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 msgr2=0x7f54e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:34.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 0x7f54e80a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54ec006fd0 tx=0x7f54ec008040 comp rx=0 tx=0).stop 2024-09-15T22:43:34.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 msgr2=0x7f54fc0fd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:34.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54f400eb10 tx=0x7f54f400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 shutdown_connections 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54fc106a80 0x7f54fc0fd840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54fc101420 0x7f54fc0fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54e80a3240 0x7f54e80a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 --2- 172.21.15.66:0/1094637237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54fc100a80 0x7f54fc0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 >> 172.21.15.66:0/1094637237 conn(0x7f54fc0fc7a0 msgr2=0x7f54fc06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 shutdown_connections 2024-09-15T22:43:34.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:34.929+0000 7f5500cac640 1 -- 172.21.15.66:0/1094637237 wait complete. 2024-09-15T22:43:35.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:34 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:43:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:34 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:43:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:34 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-15T22:43:35.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T22:43:36.064 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-15T22:43:36.186 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:35 smithi066 ceph-mon[31185]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-15T22:43:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:43:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:43:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:43:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-15T22:43:36.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:35 smithi087 ceph-mon[35290]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-15T22:43:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:43:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-15T22:43:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1094637237' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-15T22:43:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-15T22:43:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:43:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-15T22:43:36.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:35 smithi184 ceph-mon[35203]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 -- 172.21.15.66:0/3290261666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0102790 msgr2=0x7f29f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 --2- 172.21.15.66:0/3290261666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0102790 0x7f29f01067e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009900 tx=0x7f29d802a410 comp rx=0 tx=0).stop 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 -- 172.21.15.66:0/3290261666 shutdown_connections 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 --2- 172.21.15.66:0/3290261666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0106f10 0x7f29f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 --2- 172.21.15.66:0/3290261666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0102790 0x7f29f01067e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 --2- 172.21.15.66:0/3290261666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0101de0 0x7f29f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 -- 172.21.15.66:0/3290261666 >> 172.21.15.66:0/3290261666 conn(0x7f29f00fd8c0 msgr2=0x7f29f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 -- 172.21.15.66:0/3290261666 shutdown_connections 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.551+0000 7f29f5d24640 1 -- 172.21.15.66:0/3290261666 wait complete. 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 Processor -- start 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 -- start start 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 0x7f29f01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 0x7f29f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0111f70 con 0x7f29f0101de0 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0111df0 con 0x7f29f0106f10 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29f5d24640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f29f01120f0 con 0x7f29f0102790 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33088/0 (socket says 172.21.15.66:33088) 2024-09-15T22:43:36.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.552+0000 7f29ef7fe640 1 -- 172.21.15.66:0/4245748772 learned_addr learned my addr 172.21.15.66:0/4245748772 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29effff640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 0x7f29f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29eeffd640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 0x7f29f01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 -- 172.21.15.66:0/4245748772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 msgr2=0x7f29f01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 0x7f29f01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 -- 172.21.15.66:0/4245748772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 msgr2=0x7f29f019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 0x7f29f019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 -- 172.21.15.66:0/4245748772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f019d440 con 0x7f29f0101de0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29eeffd640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 0x7f29f01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29effff640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 0x7f29f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ef7fe640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cce0 tx=0x7f29e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0004b20 con 0x7f29f0101de0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f019d730 con 0x7f29f0101de0 2024-09-15T22:43:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e0004cc0 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e000f7d0 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.553+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01a5010 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.554+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f01021c0 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.555+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f29e000f970 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.556+0000 7f29ecff9640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 0x7f29dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.556+0000 7f29eeffd640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 0x7f29dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.556+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f29e00cfcd0 con 0x7f29f0101de0 2024-09-15T22:43:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.557+0000 7f29eeffd640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 0x7f29dc0a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.560+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29e0014030 con 0x7f29f0101de0 2024-09-15T22:43:36.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.772+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f29f010a0f0 con 0x7f29f0101de0 2024-09-15T22:43:36.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.946+0000 7f29ecff9640 1 -- 172.21.15.66:0/4245748772 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f29e009c7b0 con 0x7f29f0101de0 2024-09-15T22:43:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 msgr2=0x7f29dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 0x7f29dc0a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8032c70 comp rx=0 tx=0).stop 2024-09-15T22:43:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 msgr2=0x7f29f0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cce0 tx=0x7f29e000a620 comp rx=0 tx=0).stop 2024-09-15T22:43:36.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 shutdown_connections 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f29dc0a3240 0x7f29dc0a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0106f10 0x7f29f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f0102790 0x7f29f01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 --2- 172.21.15.66:0/4245748772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29f0101de0 0x7f29f0198490 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 >> 172.21.15.66:0/4245748772 conn(0x7f29f00fd8c0 msgr2=0x7f29f00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 shutdown_connections 2024-09-15T22:43:36.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:36.948+0000 7f29f5d24640 1 -- 172.21.15.66:0/4245748772 wait complete. 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:active 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-15T22:43:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:36 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:43:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:active 2024-09-15T22:43:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:43:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-15T22:43:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-15T22:43:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-15T22:43:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:36 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:43:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] up:active 2024-09-15T22:43:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-15T22:43:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-15T22:43:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-15T22:43:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-15T22:43:37.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:36 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:43:37.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T22:43:37.987 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:38.238 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T22:43:38.238 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:43:38.238 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:active 2024-09-15T22:43:38.239 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:43:38.239 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-15T22:43:38.239 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-15T22:43:38.239 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:37 smithi066 ceph-mon[31185]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:active 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-15T22:43:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-15T22:43:38.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:37 smithi087 ceph-mon[35290]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-15T22:43:38.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T22:43:38.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4245748772' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:43:38.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] up:active 2024-09-15T22:43:38.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-15T22:43:38.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-15T22:43:38.430 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-15T22:43:38.430 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:37 smithi184 ceph-mon[35203]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-15T22:43:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.461+0000 7ff5ed29d640 1 -- 172.21.15.66:0/3106593688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e81027a0 msgr2=0x7ff5e81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.461+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/3106593688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e81027a0 0x7ff5e81067f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009900 tx=0x7ff5d002a410 comp rx=0 tx=0).stop 2024-09-15T22:43:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- 172.21.15.66:0/3106593688 shutdown_connections 2024-09-15T22:43:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/3106593688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 0x7ff5e810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/3106593688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e81027a0 0x7ff5e81067f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/3106593688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e8101df0 0x7ff5e81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- 172.21.15.66:0/3106593688 >> 172.21.15.66:0/3106593688 conn(0x7ff5e80fd8b0 msgr2=0x7ff5e80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- 172.21.15.66:0/3106593688 shutdown_connections 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- 172.21.15.66:0/3106593688 wait complete. 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 Processor -- start 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- start start 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e81027a0 0x7ff5e8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 0x7ff5e819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8111f80 con 0x7ff5e8101df0 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8111e00 con 0x7ff5e81027a0 2024-09-15T22:43:38.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.462+0000 7ff5ed29d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8112100 con 0x7ff5e8106f20 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33104/0 (socket says 172.21.15.66:33104) 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 -- 172.21.15.66:0/2659954818 learned_addr learned my addr 172.21.15.66:0/2659954818 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e77fe640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 0x7ff5e819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5dffff640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e81027a0 0x7ff5e8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 -- 172.21.15.66:0/2659954818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 msgr2=0x7ff5e819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 0x7ff5e819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 -- 172.21.15.66:0/2659954818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e81027a0 msgr2=0x7ff5e8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e81027a0 0x7ff5e8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 -- 172.21.15.66:0/2659954818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e819d390 con 0x7ff5e8101df0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e6ffd640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800d950 tx=0x7ff5d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8017030 con 0x7ff5e8101df0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e819d680 con 0x7ff5e8101df0 2024-09-15T22:43:38.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5d8004020 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80047a0 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.463+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e81a4f60 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.464+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e81021d0 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.465+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff5d80041d0 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.466+0000 7ff5e4ff9640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 0x7ff5d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.466+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7ff5d80cf530 con 0x7ff5e8101df0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.466+0000 7ff5dffff640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 0x7ff5d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.467+0000 7ff5dffff640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 0x7ff5d40a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80fdd40 tx=0x7ff5d0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:38.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.470+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5d809c010 con 0x7ff5e8101df0 2024-09-15T22:43:38.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.685+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff5e8109b70 con 0x7ff5e8101df0 2024-09-15T22:43:38.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.784+0000 7ff5e4ff9640 1 -- 172.21.15.66:0/2659954818 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7ff5d809b910 con 0x7ff5e8101df0 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 msgr2=0x7ff5d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 0x7ff5d40a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80fdd40 tx=0x7ff5d0005a20 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 msgr2=0x7ff5e81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800d950 tx=0x7ff5d800de10 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 shutdown_connections 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5e8106f20 0x7ff5e819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff5d40a3240 0x7ff5d40a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5e81027a0 0x7ff5e8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 --2- 172.21.15.66:0/2659954818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e8101df0 0x7ff5e81983e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:38.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 >> 172.21.15.66:0/2659954818 conn(0x7ff5e80fd8b0 msgr2=0x7ff5e80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:38.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 shutdown_connections 2024-09-15T22:43:38.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:38.787+0000 7ff5ed29d640 1 -- 172.21.15.66:0/2659954818 wait complete. 2024-09-15T22:43:39.107 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:active 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:active 2024-09-15T22:43:39.108 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:38 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:43:39.288 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:active 2024-09-15T22:43:39.288 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:43:39.288 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:active 2024-09-15T22:43:39.289 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:38 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:43:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] up:active 2024-09-15T22:43:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-15T22:43:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-15T22:43:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2659954818' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] up:active 2024-09-15T22:43:39.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:38 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:43:39.548 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-15T22:43:39.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T22:43:39.599 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:43:39 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T22:43:39.286+0000 7fd9cbb77640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-15T22:43:39.599 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:43:39 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T22:43:39.286+0000 7fd9cbb77640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-15T22:43:39.599 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:43:39 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T22:43:39.286+0000 7fd9cbb77640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-15T22:43:39.599 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 22:43:39 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T22:43:39.286+0000 7fd9cbb77640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-15T22:43:39.808 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:40.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:39 smithi066 ceph-mon[31185]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 -- 172.21.15.66:0/2605854806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 msgr2=0x7fc11c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 --2- 172.21.15.66:0/2605854806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c1067e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009900 tx=0x7fc10c02a410 comp rx=0 tx=0).stop 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 -- 172.21.15.66:0/2605854806 shutdown_connections 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 --2- 172.21.15.66:0/2605854806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c106f10 0x7fc11c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 --2- 172.21.15.66:0/2605854806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c1067e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 --2- 172.21.15.66:0/2605854806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c101de0 0x7fc11c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 -- 172.21.15.66:0/2605854806 >> 172.21.15.66:0/2605854806 conn(0x7fc11c0fd8c0 msgr2=0x7fc11c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 -- 172.21.15.66:0/2605854806 shutdown_connections 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.288+0000 7fc123d18640 1 -- 172.21.15.66:0/2605854806 wait complete. 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 Processor -- start 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 -- start start 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 0x7fc11c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c106f10 0x7fc11c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c111f90 con 0x7fc11c102790 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c111e10 con 0x7fc11c101de0 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc123d18640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c112110 con 0x7fc11c106f10 2024-09-15T22:43:40.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc1212b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc1212b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33114/0 (socket says 172.21.15.66:33114) 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc1212b3640 1 -- 172.21.15.66:0/4181206441 learned_addr learned my addr 172.21.15.66:0/4181206441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc1222b5640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c106f10 0x7fc11c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.289+0000 7fc121ab4640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 0x7fc11c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 -- 172.21.15.66:0/4181206441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c106f10 msgr2=0x7fc11c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c106f10 0x7fc11c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 -- 172.21.15.66:0/4181206441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 msgr2=0x7fc11c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 0x7fc11c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 -- 172.21.15.66:0/4181206441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c1a68e0 con 0x7fc11c102790 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc121ab4640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 0x7fc11c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc1212b3640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005ab0 tx=0x7fc10c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:40.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c03f030 con 0x7fc11c102790 2024-09-15T22:43:40.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11c1a6b70 con 0x7fc11c102790 2024-09-15T22:43:40.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc10c003ce0 con 0x7fc11c102790 2024-09-15T22:43:40.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c035070 con 0x7fc11c102790 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.290+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11c1a7050 con 0x7fc11c102790 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.291+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11c1021c0 con 0x7fc11c102790 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.292+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc10c042030 con 0x7fc11c102790 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.293+0000 7fc112ffd640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 0x7fc1080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.293+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc10c0f0660 con 0x7fc11c102790 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.293+0000 7fc121ab4640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 0x7fc1080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:40.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.293+0000 7fc121ab4640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 0x7fc1080a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc11800abe0 tx=0x7fc11800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:40.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.296+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc10c0bd140 con 0x7fc11c102790 2024-09-15T22:43:40.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:39 smithi184 ceph-mon[35203]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:39 smithi087 ceph-mon[35290]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:40.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.495+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc11c062630 con 0x7fc1080a3240 2024-09-15T22:43:40.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.521+0000 7fc112ffd640 1 -- 172.21.15.66:0/4181206441 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc11c062630 con 0x7fc1080a3240 2024-09-15T22:43:40.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 msgr2=0x7fc1080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:40.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 0x7fc1080a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc11800abe0 tx=0x7fc11800a5c0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 msgr2=0x7fc11c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:40.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005ab0 tx=0x7fc10c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 shutdown_connections 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c106f10 0x7fc11c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc11c102790 0x7fc11c074a30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc1080a3240 0x7fc1080a5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 --2- 172.21.15.66:0/4181206441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc11c101de0 0x7fc11c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 >> 172.21.15.66:0/4181206441 conn(0x7fc11c0fd8c0 msgr2=0x7fc11c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 shutdown_connections 2024-09-15T22:43:40.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:40.523+0000 7fc123d18640 1 -- 172.21.15.66:0/4181206441 wait complete. 2024-09-15T22:43:40.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:43:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:43:40.500+0000 7f0d3db1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:43:40.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:43:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:43:40.500+0000 7f0d3db1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:43:40.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:43:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:43:40.500+0000 7f0d3db1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:43:40.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:43:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:43:40.500+0000 7f0d3db1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:43:40.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:43:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:43:40.500+0000 7f0d3db1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:43:41.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T22:43:41.479 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:41.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 -- 172.21.15.66:0/229030602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 msgr2=0x7f71ac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 --2- 172.21.15.66:0/229030602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1029b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7194009900 tx=0x7f719402a480 comp rx=0 tx=0).stop 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 -- 172.21.15.66:0/229030602 shutdown_connections 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 --2- 172.21.15.66:0/229030602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac102ef0 0x7f71ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 --2- 172.21.15.66:0/229030602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1029b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 --2- 172.21.15.66:0/229030602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac100e20 0x7f71ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 -- 172.21.15.66:0/229030602 >> 172.21.15.66:0/229030602 conn(0x7f71ac0fc7d0 msgr2=0x7f71ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 -- 172.21.15.66:0/229030602 shutdown_connections 2024-09-15T22:43:41.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.986+0000 7f71b0866640 1 -- 172.21.15.66:0/229030602 wait complete. 2024-09-15T22:43:41.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 Processor -- start 2024-09-15T22:43:41.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 -- start start 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac100e20 0x7f71ac1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac102ef0 0x7f71ac19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac110f80 con 0x7f71ac102570 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac110e00 con 0x7f71ac100e20 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71b0866640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac111100 con 0x7f71ac102ef0 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71a9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71a9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33150/0 (socket says 172.21.15.66:33150) 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.987+0000 7f71a9d9b640 1 -- 172.21.15.66:0/2492976638 learned_addr learned my addr 172.21.15.66:0/2492976638 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71aad9d640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac102ef0 0x7f71ac19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71aa59c640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac100e20 0x7f71ac1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 -- 172.21.15.66:0/2492976638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac102ef0 msgr2=0x7f71ac19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac102ef0 0x7f71ac19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 -- 172.21.15.66:0/2492976638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac100e20 msgr2=0x7f71ac1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac100e20 0x7f71ac1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 -- 172.21.15.66:0/2492976638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac19d460 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a9d9b640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7194006010 tx=0x7f7194003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719403f070 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7194031e30 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194035030 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac19d6f0 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.988+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1a5030 con 0x7f71ac102570 2024-09-15T22:43:41.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.989+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac1021b0 con 0x7f71ac102570 2024-09-15T22:43:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.991+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7194042070 con 0x7f71ac102570 2024-09-15T22:43:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.991+0000 7f71a37fe640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 0x7f71980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.992+0000 7f71aa59c640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 0x7f71980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.992+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f71940f0550 con 0x7f71ac102570 2024-09-15T22:43:41.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.992+0000 7f71aa59c640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 0x7f71980a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f719c005e10 tx=0x7f719c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:41.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:41.995+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71940bd030 con 0x7f71ac102570 2024-09-15T22:43:42.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:41 smithi066 ceph-mon[31185]: pgmap v305: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:42.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:41 smithi066 ceph-mon[31185]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:42.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.197+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f71ac062630 con 0x7f71980a3240 2024-09-15T22:43:42.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.223+0000 7f71a37fe640 1 -- 172.21.15.66:0/2492976638 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f71ac062630 con 0x7f71980a3240 2024-09-15T22:43:42.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 msgr2=0x7f71980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 0x7f71980a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f719c005e10 tx=0x7f719c005da0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 msgr2=0x7f71ac1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7194006010 tx=0x7f7194003c80 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 shutdown_connections 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac102ef0 0x7f71ac19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71ac102570 0x7f71ac1989f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f71980a3240 0x7f71980a5700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 --2- 172.21.15.66:0/2492976638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac100e20 0x7f71ac1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 >> 172.21.15.66:0/2492976638 conn(0x7f71ac0fc7d0 msgr2=0x7f71ac06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:42.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 shutdown_connections 2024-09-15T22:43:42.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:42.225+0000 7f71b0866640 1 -- 172.21.15.66:0/2492976638 wait complete. 2024-09-15T22:43:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:41 smithi087 ceph-mon[35290]: pgmap v305: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:41 smithi087 ceph-mon[35290]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:41 smithi184 ceph-mon[35203]: pgmap v305: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2024-09-15T22:43:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:41 smithi184 ceph-mon[35203]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:42.944 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T22:43:43.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:42 smithi066 ceph-mon[31185]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:43.217 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:42 smithi087 ceph-mon[35290]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:42 smithi184 ceph-mon[35203]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 -- 172.21.15.66:0/3759437140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 msgr2=0x7f44f81006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/3759437140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f81006d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009cd0 tx=0x7f44e802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 -- 172.21.15.66:0/3759437140 shutdown_connections 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/3759437140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 0x7f44f810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/3759437140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 0x7f44f8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.705+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/3759437140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f81006d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.706+0000 7f44fcd3e640 1 -- 172.21.15.66:0/3759437140 >> 172.21.15.66:0/3759437140 conn(0x7f44f8077210 msgr2=0x7f44f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.706+0000 7f44fcd3e640 1 -- 172.21.15.66:0/3759437140 shutdown_connections 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.706+0000 7f44fcd3e640 1 -- 172.21.15.66:0/3759437140 wait complete. 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.706+0000 7f44fcd3e640 1 Processor -- start 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.706+0000 7f44fcd3e640 1 -- start start 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 0x7f44f81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 0x7f44f8101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8111ff0 con 0x7f44f81002f0 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8111e70 con 0x7f44f8106f50 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44fcd3e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8112170 con 0x7f44f8100ca0 2024-09-15T22:43:43.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32914/0 (socket says 172.21.15.66:32914) 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 -- 172.21.15.66:0/2999673162 learned_addr learned my addr 172.21.15.66:0/2999673162 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f6d9d640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 0x7f44f8101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f5d9b640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 0x7f44f81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 -- 172.21.15.66:0/2999673162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 msgr2=0x7f44f81017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 0x7f44f81017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 -- 172.21.15.66:0/2999673162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 msgr2=0x7f44f8101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 0x7f44f8101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 -- 172.21.15.66:0/2999673162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f81a69e0 con 0x7f44f81002f0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.707+0000 7f44f659c640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44e8033040 tx=0x7f44e80039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.708+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8004040 con 0x7f44f81002f0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.708+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e80046c0 con 0x7f44f81002f0 2024-09-15T22:43:43.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.708+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8046480 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.708+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f81a6c70 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.708+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f81a71b0 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.709+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f81006d0 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.710+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f44e8030710 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.711+0000 7f44e77fe640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 0x7f44e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.711+0000 7f44f5d9b640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 0x7f44e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.711+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f44e802e030 con 0x7f44f81002f0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.711+0000 7f44f5d9b640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 0x7f44e00a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44f8104890 tx=0x7f44ec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:43.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.715+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44e804b060 con 0x7f44f81002f0 2024-09-15T22:43:43.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.922+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f44f810a1a0 con 0x7f44e00a3350 2024-09-15T22:43:43.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.928+0000 7f44e77fe640 1 -- 172.21.15.66:0/2999673162 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f44f810a1a0 con 0x7f44e00a3350 2024-09-15T22:43:43.930 INFO:teuthology.orchestra.run.smithi066.stdout:/volumes/qa/sv_0/18e67fb5-c680-473b-aa9a-4cd8d0b5bb2b 2024-09-15T22:43:43.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 msgr2=0x7f44e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 0x7f44e00a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f44f8104890 tx=0x7f44ec00b410 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 msgr2=0x7f44f8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44e8033040 tx=0x7f44e80039f0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 shutdown_connections 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44e00a3350 0x7f44e00a5810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44f8106f50 0x7f44f8101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8100ca0 0x7f44f81017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 --2- 172.21.15.66:0/2999673162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44f81002f0 0x7f44f8101270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 >> 172.21.15.66:0/2999673162 conn(0x7f44f8077210 msgr2=0x7f44f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 shutdown_connections 2024-09-15T22:43:43.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:43.930+0000 7f44fcd3e640 1 -- 172.21.15.66:0/2999673162 wait complete. 2024-09-15T22:43:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:43 smithi066 ceph-mon[31185]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-15T22:43:44.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:43 smithi066 ceph-mon[31185]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:43:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:43 smithi087 ceph-mon[35290]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-15T22:43:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:43 smithi087 ceph-mon[35290]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:43:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:43 smithi184 ceph-mon[35203]: pgmap v306: 129 pgs: 129 active+clean; 587 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-09-15T22:43:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:43 smithi184 ceph-mon[35203]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:43:44.606 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T22:43:44.869 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:45.287 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:44 smithi066 ceph-mon[31185]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:44 smithi087 ceph-mon[35290]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:45.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 -- 172.21.15.66:0/2147055159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c10c170 msgr2=0x7f4a8c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 --2- 172.21.15.66:0/2147055159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c10c170 0x7f4a8c10e610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a84009ca0 tx=0x7f4a8402a970 comp rx=0 tx=0).stop 2024-09-15T22:43:45.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 -- 172.21.15.66:0/2147055159 shutdown_connections 2024-09-15T22:43:45.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 --2- 172.21.15.66:0/2147055159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c10c170 0x7f4a8c10e610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 --2- 172.21.15.66:0/2147055159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c103660 0x7f4a8c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 --2- 172.21.15.66:0/2147055159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c102d40 0x7f4a8c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 -- 172.21.15.66:0/2147055159 >> 172.21.15.66:0/2147055159 conn(0x7f4a8c0fc7a0 msgr2=0x7f4a8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 -- 172.21.15.66:0/2147055159 shutdown_connections 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 -- 172.21.15.66:0/2147055159 wait complete. 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.373+0000 7f4a919c6640 1 Processor -- start 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 -- start start 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c102d40 0x7f4a8c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c10c170 0x7f4a8c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c111fd0 con 0x7f4a8c103660 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c111e50 con 0x7f4a8c10c170 2024-09-15T22:43:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a919c6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c112150 con 0x7f4a8c102d40 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32934/0 (socket says 172.21.15.66:32934) 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 -- 172.21.15.66:0/4074777302 learned_addr learned my addr 172.21.15.66:0/4074777302 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8b7fe640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c10c170 0x7f4a8c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8affd640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c102d40 0x7f4a8c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 -- 172.21.15.66:0/4074777302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c102d40 msgr2=0x7f4a8c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c102d40 0x7f4a8c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 -- 172.21.15.66:0/4074777302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c10c170 msgr2=0x7f4a8c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c10c170 0x7f4a8c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 -- 172.21.15.66:0/4074777302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c1a68b0 con 0x7f4a8c103660 2024-09-15T22:43:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.374+0000 7f4a8a7fc640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000b3c0 tx=0x7f4a8000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.375+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80015020 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.375+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a80011d10 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.375+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c1a6ba0 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.375+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000f2e0 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.375+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1a70e0 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.376+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c103120 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.377+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4a80018020 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.377+0000 7f4a909c4640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 0x7f4a740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.378+0000 7f4a8affd640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 0x7f4a740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.378+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f4a800cf4b0 con 0x7f4a8c103660 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.378+0000 7f4a8affd640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 0x7f4a740a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00abe0 tx=0x7f4a7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.382+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a8001f020 con 0x7f4a8c103660 2024-09-15T22:43:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:44 smithi184 ceph-mon[35203]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:45.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.584+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4a8c0feac0 con 0x7f4a740a32d0 2024-09-15T22:43:45.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.608+0000 7f4a909c4640 1 -- 172.21.15.66:0/4074777302 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a8c0feac0 con 0x7f4a740a32d0 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 msgr2=0x7f4a740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 0x7f4a740a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00abe0 tx=0x7f4a7c00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 msgr2=0x7f4a8c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000b3c0 tx=0x7f4a8000b7c0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 shutdown_connections 2024-09-15T22:43:45.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4a740a32d0 0x7f4a740a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a8c10c170 0x7f4a8c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c103660 0x7f4a8c100ee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 --2- 172.21.15.66:0/4074777302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a8c102d40 0x7f4a8c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 >> 172.21.15.66:0/4074777302 conn(0x7f4a8c0fc7a0 msgr2=0x7f4a8c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 shutdown_connections 2024-09-15T22:43:45.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:45.610+0000 7f4a919c6640 1 -- 172.21.15.66:0/4074777302 wait complete. 2024-09-15T22:43:46.254 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:45 smithi066 ceph-mon[31185]: pgmap v307: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-15T22:43:46.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T22:43:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:45 smithi087 ceph-mon[35290]: pgmap v307: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-15T22:43:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:45 smithi184 ceph-mon[35203]: pgmap v307: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-15T22:43:46.515 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- 172.21.15.66:0/3719319992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 msgr2=0x7f70281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 --2- 172.21.15.66:0/3719319992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f70281029b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7010009900 tx=0x7f701002a480 comp rx=0 tx=0).stop 2024-09-15T22:43:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- 172.21.15.66:0/3719319992 shutdown_connections 2024-09-15T22:43:47.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 --2- 172.21.15.66:0/3719319992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 0x7f702810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 --2- 172.21.15.66:0/3719319992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f70281029b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 --2- 172.21.15.66:0/3719319992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 0x7f7028101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- 172.21.15.66:0/3719319992 >> 172.21.15.66:0/3719319992 conn(0x7f70280fc7d0 msgr2=0x7f70280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- 172.21.15.66:0/3719319992 shutdown_connections 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- 172.21.15.66:0/3719319992 wait complete. 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 Processor -- start 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.006+0000 7f702e691640 1 -- start start 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 0x7f702819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 0x7f702819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7028110ff0 con 0x7f7028102570 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7028110e70 con 0x7f7028100e20 2024-09-15T22:43:47.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702e691640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7028111170 con 0x7f7028102ef0 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32948/0 (socket says 172.21.15.66:32948) 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 -- 172.21.15.66:0/3939181962 learned_addr learned my addr 172.21.15.66:0/3939181962 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f7027fff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 0x7f702819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 -- 172.21.15.66:0/3939181962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 msgr2=0x7f702819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f702cc2e640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 0x7f702819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 0x7f702819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 -- 172.21.15.66:0/3939181962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 msgr2=0x7f702819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 0x7f702819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 -- 172.21.15.66:0/3939181962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702819f670 con 0x7f7028102570 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.007+0000 7f701ffff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7010006010 tx=0x7f7010003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.008+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701003f070 con 0x7f7028102570 2024-09-15T22:43:47.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.008+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7010003e30 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.008+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702819f900 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.008+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010035030 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.008+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70281a7240 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.009+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7028101200 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.010+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7010042070 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.011+0000 7f7025ffb640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 0x7f70140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.011+0000 7f7027fff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 0x7f70140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.011+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f70100f06a0 con 0x7f7028102570 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.011+0000 7f7027fff640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 0x7f70140a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f701800abe0 tx=0x7f701800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:47.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.015+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70100bcfc0 con 0x7f7028102570 2024-09-15T22:43:47.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:46 smithi066 ceph-mon[31185]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:47.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.221+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f70281066f0 con 0x7f70140a3350 2024-09-15T22:43:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.226+0000 7f7025ffb640 1 -- 172.21.15.66:0/3939181962 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f70281066f0 con 0x7f70140a3350 2024-09-15T22:43:47.227 INFO:teuthology.orchestra.run.smithi066.stdout:/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1 2024-09-15T22:43:47.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 msgr2=0x7f70140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 0x7f70140a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f701800abe0 tx=0x7f701800a2d0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 msgr2=0x7f702819ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7010006010 tx=0x7f7010003c10 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 shutdown_connections 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028102ef0 0x7f702819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7028102570 0x7f702819ac00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f70140a3350 0x7f70140a5810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 --2- 172.21.15.66:0/3939181962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028100e20 0x7f702819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 >> 172.21.15.66:0/3939181962 conn(0x7f70280fc7d0 msgr2=0x7f702806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 shutdown_connections 2024-09-15T22:43:47.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:47.228+0000 7f702e691640 1 -- 172.21.15.66:0/3939181962 wait complete. 2024-09-15T22:43:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:46 smithi087 ceph-mon[35290]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:46 smithi184 ceph-mon[35203]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:47.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:43:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:48.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:47 smithi066 ceph-mon[31185]: pgmap v308: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-15T22:43:48.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:47 smithi066 ceph-mon[31185]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:48.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:47 smithi087 ceph-mon[35290]: pgmap v308: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-15T22:43:48.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:47 smithi087 ceph-mon[35290]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:47 smithi184 ceph-mon[35203]: pgmap v308: 129 pgs: 129 active+clean; 607 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-15T22:43:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:47 smithi184 ceph-mon[35203]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 -- 172.21.15.66:0/3155495592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 msgr2=0x7fb52c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 --2- 172.21.15.66:0/3155495592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c1067e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb514009900 tx=0x7fb51402a410 comp rx=0 tx=0).stop 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 -- 172.21.15.66:0/3155495592 shutdown_connections 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 --2- 172.21.15.66:0/3155495592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c106f10 0x7fb52c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 --2- 172.21.15.66:0/3155495592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c1067e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 --2- 172.21.15.66:0/3155495592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c101de0 0x7fb52c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 -- 172.21.15.66:0/3155495592 >> 172.21.15.66:0/3155495592 conn(0x7fb52c0fd8c0 msgr2=0x7fb52c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 -- 172.21.15.66:0/3155495592 shutdown_connections 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.603+0000 7fb530e74640 1 -- 172.21.15.66:0/3155495592 wait complete. 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 Processor -- start 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 -- start start 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c111f70 con 0x7fb52c102790 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c111df0 con 0x7fb52c101de0 2024-09-15T22:43:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb530e74640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c1120f0 con 0x7fb52c106f10 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb523fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb523fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32980/0 (socket says 172.21.15.66:32980) 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb523fff640 1 -- 172.21.15.66:0/2553207433 learned_addr learned my addr 172.21.15.66:0/2553207433 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb52a59c640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.604+0000 7fb52ad9d640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 -- 172.21.15.66:0/2553207433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c106f10 msgr2=0x7fb52c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 -- 172.21.15.66:0/2553207433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c101de0 msgr2=0x7fb52c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 -- 172.21.15.66:0/2553207433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c1a6970 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb523fff640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb514006010 tx=0x7fb5140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51403f030 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c1a6c00 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb514003ce0 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514035070 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.605+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c1a70e0 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.606+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c1021c0 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.607+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb514042030 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.608+0000 7fb5237fe640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 0x7fb5180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.608+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fb5140f04a0 con 0x7fb52c102790 2024-09-15T22:43:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.608+0000 7fb52a59c640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 0x7fb5180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.609+0000 7fb52a59c640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 0x7fb5180a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fd0 tx=0x7fb51c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.611+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5140bce20 con 0x7fb52c102790 2024-09-15T22:43:48.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.826+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb52c10a150 con 0x7fb52c102790 2024-09-15T22:43:48.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.827+0000 7fb5237fe640 1 -- 172.21.15.66:0/2553207433 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fb5140bc720 con 0x7fb52c102790 2024-09-15T22:43:48.828 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:48.829 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:43:48.829 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:43:48.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 msgr2=0x7fb5180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:48.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 0x7fb5180a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fd0 tx=0x7fb51c00b390 comp rx=0 tx=0).stop 2024-09-15T22:43:48.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 msgr2=0x7fb52c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:48.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb514006010 tx=0x7fb5140042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 shutdown_connections 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb5180a32d0 0x7fb5180a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 --2- 172.21.15.66:0/2553207433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 >> 172.21.15.66:0/2553207433 conn(0x7fb52c0fd8c0 msgr2=0x7fb52c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 shutdown_connections 2024-09-15T22:43:48.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:48.829+0000 7fb530e74640 1 -- 172.21.15.66:0/2553207433 wait complete. 2024-09-15T22:43:49.151 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:48 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2553207433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:49.370 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:49 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2553207433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:49.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:48 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2553207433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:43:49.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:50.189 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:50 smithi066 ceph-mon[31185]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2024-09-15T22:43:50.190 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:50 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:43:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:50 smithi087 ceph-mon[35290]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2024-09-15T22:43:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:50 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:43:50.402 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:50 smithi184 ceph-mon[35203]: pgmap v309: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2024-09-15T22:43:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:50 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 -- 172.21.15.66:0/2978476863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1082a0 msgr2=0x7f919c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 --2- 172.21.15.66:0/2978476863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1082a0 0x7f919c10ec40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9194009cd0 tx=0x7f919402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 -- 172.21.15.66:0/2978476863 shutdown_connections 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 --2- 172.21.15.66:0/2978476863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1082a0 0x7f919c10ec40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 --2- 172.21.15.66:0/2978476863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c1036e0 0x7f919c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 --2- 172.21.15.66:0/2978476863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c102d30 0x7f919c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.916+0000 7f91a1213640 1 -- 172.21.15.66:0/2978476863 >> 172.21.15.66:0/2978476863 conn(0x7f919c0fc7d0 msgr2=0x7f919c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:50.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.917+0000 7f91a1213640 1 -- 172.21.15.66:0/2978476863 shutdown_connections 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.917+0000 7f91a1213640 1 -- 172.21.15.66:0/2978476863 wait complete. 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.917+0000 7f91a1213640 1 Processor -- start 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.917+0000 7f91a1213640 1 -- start start 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 0x7f919c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 0x7f919c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f919c1120a0 con 0x7f919c1036e0 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f919c111f20 con 0x7f919c1082a0 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f91a1213640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f919c112220 con 0x7f919c102d30 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32998/0 (socket says 172.21.15.66:32998) 2024-09-15T22:43:50.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919a59c640 1 -- 172.21.15.66:0/3592148009 learned_addr learned my addr 172.21.15.66:0/3592148009 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 0x7f919c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919ad9d640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 0x7f919c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 -- 172.21.15.66:0/3592148009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 msgr2=0x7f919c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 0x7f919c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 -- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 msgr2=0x7f919c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 -- 172.21.15.66:0/3592148009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c19d4e0 con 0x7f919c1082a0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919ad9d640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 0x7f919c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919a59c640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.918+0000 7f919b59e640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 0x7f919c19ce00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f919402ae00 tx=0x7f9194031df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.919+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194003d80 con 0x7f919c1082a0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.919+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c19d770 con 0x7f919c1082a0 2024-09-15T22:43:50.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.919+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9194004520 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.919+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194030d00 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.919+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1a50b0 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.920+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c103110 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.921+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91940046d0 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.922+0000 7f9193fff640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 0x7f91880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.922+0000 7f919ad9d640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 0x7f91880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.922+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f919402e030 con 0x7f919c1082a0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.922+0000 7f919ad9d640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 0x7f91880a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c009fc0 tx=0x7f918c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:50.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:50.929+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f919404b060 con 0x7f919c1082a0 2024-09-15T22:43:51.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.121+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f919c10a2b0 con 0x7f919c1082a0 2024-09-15T22:43:51.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.122+0000 7f9193fff640 1 -- 172.21.15.66:0/3592148009 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7f91940bdb80 con 0x7f919c1082a0 2024-09-15T22:43:51.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:51.124 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:51.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 msgr2=0x7f91880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:51.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 0x7f91880a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c009fc0 tx=0x7f918c005f90 comp rx=0 tx=0).stop 2024-09-15T22:43:51.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 msgr2=0x7f919c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:51.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 0x7f919c19ce00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f919402ae00 tx=0x7f9194031df0 comp rx=0 tx=0).stop 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 shutdown_connections 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f91880a32d0 0x7f91880a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f919c1082a0 0x7f919c19ce00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f919c1036e0 0x7f919c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 --2- 172.21.15.66:0/3592148009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f919c102d30 0x7f919c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 >> 172.21.15.66:0/3592148009 conn(0x7f919c0fc7d0 msgr2=0x7f919c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 shutdown_connections 2024-09-15T22:43:51.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:51.125+0000 7f91a1213640 1 -- 172.21.15.66:0/3592148009 wait complete. 2024-09-15T22:43:51.746 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:43:51.746 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:43:52.023 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3592148009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:52.144 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-15T22:43:52.145 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.145 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.145 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.145 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.145 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3592148009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: pgmap v310: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-15T22:43:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3592148009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:43:52.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.561+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2675122669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288102570 msgr2=0x7fc2881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.561+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2675122669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288102570 0x7fc2881029b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc278009900 tx=0x7fc27802a480 comp rx=0 tx=0).stop 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2675122669 shutdown_connections 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2675122669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 0x7fc28810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2675122669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288102570 0x7fc2881029b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2675122669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288100e20 0x7fc288101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2675122669 >> 172.21.15.66:0/2675122669 conn(0x7fc2880fc7d0 msgr2=0x7fc2880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2675122669 shutdown_connections 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2675122669 wait complete. 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 Processor -- start 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- start start 2024-09-15T22:43:52.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 0x7fc288199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 0x7fc2881a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.562+0000 7fc28f0b1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc288110f80 con 0x7fc288100e20 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28f0b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc288110e00 con 0x7fc288102570 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28f0b1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc288111100 con 0x7fc288102ef0 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34002/0 (socket says 172.21.15.66:34002) 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 -- 172.21.15.66:0/2000907088 learned_addr learned my addr 172.21.15.66:0/2000907088 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28d64e640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 0x7fc2881a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc27ffff640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 0x7fc288199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 -- 172.21.15.66:0/2000907088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 msgr2=0x7fc2881a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 0x7fc2881a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 -- 172.21.15.66:0/2000907088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 msgr2=0x7fc288199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 0x7fc288199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 -- 172.21.15.66:0/2000907088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2881a4910 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc27ffff640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 0x7fc288199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28ce4d640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c890 tx=0x7fc28400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284004220 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2881a4ae0 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2840043c0 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.563+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284004a00 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.564+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2881a4fd0 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.565+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc288101200 con 0x7fc288100e20 2024-09-15T22:43:52.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.566+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc2840079b0 con 0x7fc288100e20 2024-09-15T22:43:52.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.566+0000 7fc27dffb640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 0x7fc2700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:52.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.566+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc2840cfde0 con 0x7fc288100e20 2024-09-15T22:43:52.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.566+0000 7fc27ffff640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 0x7fc2700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:52.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.567+0000 7fc27ffff640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 0x7fc2700a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc28806aac0 tx=0x7fc278005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:52.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.570+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc284014030 con 0x7fc288100e20 2024-09-15T22:43:52.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.742+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc288109100 con 0x7fc2700a32d0 2024-09-15T22:43:52.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.754+0000 7fc27dffb640 1 -- 172.21.15.66:0/2000907088 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340386 (secure 0 0 0) 0x7fc2780043b0 con 0x7fc2700a32d0 2024-09-15T22:43:52.759 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:52.761 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 msgr2=0x7fc2700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 0x7fc2700a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc28806aac0 tx=0x7fc278005a20 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 msgr2=0x7fc288199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c890 tx=0x7fc28400cd50 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 shutdown_connections 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc288102ef0 0x7fc2881a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc2700a32d0 0x7fc2700a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc288102570 0x7fc288199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 --2- 172.21.15.66:0/2000907088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc288100e20 0x7fc288199350 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 >> 172.21.15.66:0/2000907088 conn(0x7fc2880fc7d0 msgr2=0x7fc2881068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 shutdown_connections 2024-09-15T22:43:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:52.757+0000 7fc28f0b1640 1 -- 172.21.15.66:0/2000907088 wait complete. 2024-09-15T22:43:53.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:52 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:52 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:52 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:53.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:52 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:53.187 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:52 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:52 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:52 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:52 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:52 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:52 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.404 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-15T22:43:52.375375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640762,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":289,"num_read_kb":248,"num_write":414,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383476,"kb_used_data":13428,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558348,"statfs":{"total":1151940427776,"available":1151547748352,"internally_reserved":0,"allocated":13750272,"data_stored":7589534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42850,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":153,"num_read_kb":129,"num_write":82,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003091"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:45.803041+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:43:45.803041+0000","last_peered":"2024-09-15T22:43:45.803041+0000","last_clean":"2024-09-15T22:43:45.803041+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:43:45.803041+0000","last_undegraded":"2024-09-15T22:43:45.803041+0000","last_fullsized":"2024-09-15T22:43:45.803041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923885+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:43:03.923885+0000","last_peered":"2024-09-15T22:43:03.923885+0000","last_clean":"2024-09-15T22:43:03.923885+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:43:03.923885+0000","last_undegraded":"2024-09-15T22:43:03.923885+0000","last_fullsized":"2024-09-15T22:43:03.923885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833292+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:43:03.833292+0000","last_peered":"2024-09-15T22:43:03.833292+0000","last_clean":"2024-09-15T22:43:03.833292+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:43:03.833292+0000","last_undegraded":"2024-09-15T22:43:03.833292+0000","last_fullsized":"2024-09-15T22:43:03.833292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924108+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:43:03.924108+0000","last_peered":"2024-09-15T22:43:03.924108+0000","last_clean":"2024-09-15T22:43:03.924108+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:43:03.924108+0000","last_undegraded":"2024-09-15T22:43:03.924108+0000","last_fullsized":"2024-09-15T22:43:03.924108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923034+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:43:03.923034+0000","last_peered":"2024-09-15T22:43:03.923034+0000","last_clean":"2024-09-15T22:43:03.923034+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:43:03.923034+0000","last_undegraded":"2024-09-15T22:43:03.923034+0000","last_fullsized":"2024-09-15T22:43:03.923034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923115+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:43:03.923115+0000","last_peered":"2024-09-15T22:43:03.923115+0000","last_clean":"2024-09-15T22:43:03.923115+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:43:03.923115+0000","last_undegraded":"2024-09-15T22:43:03.923115+0000","last_fullsized":"2024-09-15T22:43:03.923115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.790577+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:43:38.790577+0000","last_peered":"2024-09-15T22:43:38.790577+0000","last_clean":"2024-09-15T22:43:38.790577+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:43:38.790577+0000","last_undegraded":"2024-09-15T22:43:38.790577+0000","last_fullsized":"2024-09-15T22:43:38.790577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835350+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:43:03.835350+0000","last_peered":"2024-09-15T22:43:03.835350+0000","last_clean":"2024-09-15T22:43:03.835350+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:43:03.835350+0000","last_undegraded":"2024-09-15T22:43:03.835350+0000","last_fullsized":"2024-09-15T22:43:03.835350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923880+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:43:03.923880+0000","last_peered":"2024-09-15T22:43:03.923880+0000","last_clean":"2024-09-15T22:43:03.923880+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:43:03.923880+0000","last_undegraded":"2024-09-15T22:43:03.923880+0000","last_fullsized":"2024-09-15T22:43:03.923880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970678+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:43:37.970678+0000","last_peered":"2024-09-15T22:43:37.970678+0000","last_clean":"2024-09-15T22:43:37.970678+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:43:37.970678+0000","last_undegraded":"2024-09-15T22:43:37.970678+0000","last_fullsized":"2024-09-15T22:43:37.970678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924727+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:43:03.924727+0000","last_peered":"2024-09-15T22:43:03.924727+0000","last_clean":"2024-09-15T22:43:03.924727+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:43:03.924727+0000","last_undegraded":"2024-09-15T22:43:03.924727+0000","last_fullsized":"2024-09-15T22:43:03.924727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923576+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:43:03.923576+0000","last_peered":"2024-09-15T22:43:03.923576+0000","last_clean":"2024-09-15T22:43:03.923576+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:43:03.923576+0000","last_undegraded":"2024-09-15T22:43:03.923576+0000","last_fullsized":"2024-09-15T22:43:03.923576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923942+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:43:03.923942+0000","last_peered":"2024-09-15T22:43:03.923942+0000","last_clean":"2024-09-15T22:43:03.923942+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:43:03.923942+0000","last_undegraded":"2024-09-15T22:43:03.923942+0000","last_fullsized":"2024-09-15T22:43:03.923942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:34.944074+0000","last_change":"2024-09-15T22:42:51.465697+0000","last_active":"2024-09-15T22:43:34.944074+0000","last_peered":"2024-09-15T22:43:34.944074+0000","last_clean":"2024-09-15T22:43:34.944074+0000","last_became_active":"2024-09-15T22:42:51.464496+0000","last_became_peered":"2024-09-15T22:42:51.464496+0000","last_unstale":"2024-09-15T22:43:34.944074+0000","last_undegraded":"2024-09-15T22:43:34.944074+0000","last_fullsized":"2024-09-15T22:43:34.944074+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:38.216763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923957+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:43:03.923957+0000","last_peered":"2024-09-15T22:43:03.923957+0000","last_clean":"2024-09-15T22:43:03.923957+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:43:03.923957+0000","last_undegraded":"2024-09-15T22:43:03.923957+0000","last_fullsized":"2024-09-15T22:43:03.923957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923587+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:43:03.923587+0000","last_peered":"2024-09-15T22:43:03.923587+0000","last_clean":"2024-09-15T22:43:03.923587+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:43:03.923587+0000","last_undegraded":"2024-09-15T22:43:03.923587+0000","last_fullsized":"2024-09-15T22:43:03.923587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.963287+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:43:36.963287+0000","last_peered":"2024-09-15T22:43:36.963287+0000","last_clean":"2024-09-15T22:43:36.963287+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:43:36.963287+0000","last_undegraded":"2024-09-15T22:43:36.963287+0000","last_fullsized":"2024-09-15T22:43:36.963287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923703+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:43:03.923703+0000","last_peered":"2024-09-15T22:43:03.923703+0000","last_clean":"2024-09-15T22:43:03.923703+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:43:03.923703+0000","last_undegraded":"2024-09-15T22:43:03.923703+0000","last_fullsized":"2024-09-15T22:43:03.923703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923711+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:43:03.923711+0000","last_peered":"2024-09-15T22:43:03.923711+0000","last_clean":"2024-09-15T22:43:03.923711+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:43:03.923711+0000","last_undegraded":"2024-09-15T22:43:03.923711+0000","last_fullsized":"2024-09-15T22:43:03.923711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969791+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:43:37.969791+0000","last_peered":"2024-09-15T22:43:37.969791+0000","last_clean":"2024-09-15T22:43:37.969791+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:43:37.969791+0000","last_undegraded":"2024-09-15T22:43:37.969791+0000","last_fullsized":"2024-09-15T22:43:37.969791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889991+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:43:03.889991+0000","last_peered":"2024-09-15T22:43:03.889991+0000","last_clean":"2024-09-15T22:43:03.889991+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:43:03.889991+0000","last_undegraded":"2024-09-15T22:43:03.889991+0000","last_fullsized":"2024-09-15T22:43:03.889991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923550+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:43:03.923550+0000","last_peered":"2024-09-15T22:43:03.923550+0000","last_clean":"2024-09-15T22:43:03.923550+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:43:03.923550+0000","last_undegraded":"2024-09-15T22:43:03.923550+0000","last_fullsized":"2024-09-15T22:43:03.923550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:34.942659+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:43:34.942659+0000","last_peered":"2024-09-15T22:43:34.942659+0000","last_clean":"2024-09-15T22:43:34.942659+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:43:34.942659+0000","last_undegraded":"2024-09-15T22:43:34.942659+0000","last_fullsized":"2024-09-15T22:43:34.942659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924957+0000","last_change":"2024-09-15T22:43:00.825184+0000","last_active":"2024-09-15T22:43:03.924957+0000","last_peered":"2024-09-15T22:43:03.924957+0000","last_clean":"2024-09-15T22:43:03.924957+0000","last_became_active":"2024-09-15T22:43:00.824758+0000","last_became_peered":"2024-09-15T22:43:00.824758+0000","last_unstale":"2024-09-15T22:43:03.924957+0000","last_undegraded":"2024-09-15T22:43:03.924957+0000","last_fullsized":"2024-09-15T22:43:03.924957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923091+0000","last_change":"2024-09-15T22:42:53.546237+0000","last_active":"2024-09-15T22:43:03.923091+0000","last_peered":"2024-09-15T22:43:03.923091+0000","last_clean":"2024-09-15T22:43:03.923091+0000","last_became_active":"2024-09-15T22:42:53.545941+0000","last_became_peered":"2024-09-15T22:42:53.545941+0000","last_unstale":"2024-09-15T22:43:03.923091+0000","last_undegraded":"2024-09-15T22:43:03.923091+0000","last_fullsized":"2024-09-15T22:43:03.923091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:36.030343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969078+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:43:37.969078+0000","last_peered":"2024-09-15T22:43:37.969078+0000","last_clean":"2024-09-15T22:43:37.969078+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:43:37.969078+0000","last_undegraded":"2024-09-15T22:43:37.969078+0000","last_fullsized":"2024-09-15T22:43:37.969078+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833318+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:43:03.833318+0000","last_peered":"2024-09-15T22:43:03.833318+0000","last_clean":"2024-09-15T22:43:03.833318+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:43:03.833318+0000","last_undegraded":"2024-09-15T22:43:03.833318+0000","last_fullsized":"2024-09-15T22:43:03.833318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924085+0000","last_change":"2024-09-15T22:42:53.544658+0000","last_active":"2024-09-15T22:43:03.924085+0000","last_peered":"2024-09-15T22:43:03.924085+0000","last_clean":"2024-09-15T22:43:03.924085+0000","last_became_active":"2024-09-15T22:42:53.544382+0000","last_became_peered":"2024-09-15T22:42:53.544382+0000","last_unstale":"2024-09-15T22:43:03.924085+0000","last_undegraded":"2024-09-15T22:43:03.924085+0000","last_fullsized":"2024-09-15T22:43:03.924085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:13.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:44.794168+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:43:44.794168+0000","last_peered":"2024-09-15T22:43:44.794168+0000","last_clean":"2024-09-15T22:43:44.794168+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:43:44.794168+0000","last_undegraded":"2024-09-15T22:43:44.794168+0000","last_fullsized":"2024-09-15T22:43:44.794168+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923416+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:43:03.923416+0000","last_peered":"2024-09-15T22:43:03.923416+0000","last_clean":"2024-09-15T22:43:03.923416+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:43:03.923416+0000","last_undegraded":"2024-09-15T22:43:03.923416+0000","last_fullsized":"2024-09-15T22:43:03.923416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833070+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:43:03.833070+0000","last_peered":"2024-09-15T22:43:03.833070+0000","last_clean":"2024-09-15T22:43:03.833070+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:43:03.833070+0000","last_undegraded":"2024-09-15T22:43:03.833070+0000","last_fullsized":"2024-09-15T22:43:03.833070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970912+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:43:37.970912+0000","last_peered":"2024-09-15T22:43:37.970912+0000","last_clean":"2024-09-15T22:43:37.970912+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:43:37.970912+0000","last_undegraded":"2024-09-15T22:43:37.970912+0000","last_fullsized":"2024-09-15T22:43:37.970912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924151+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:43:03.924151+0000","last_peered":"2024-09-15T22:43:03.924151+0000","last_clean":"2024-09-15T22:43:03.924151+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:43:03.924151+0000","last_undegraded":"2024-09-15T22:43:03.924151+0000","last_fullsized":"2024-09-15T22:43:03.924151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924861+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:43:03.924861+0000","last_peered":"2024-09-15T22:43:03.924861+0000","last_clean":"2024-09-15T22:43:03.924861+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:43:03.924861+0000","last_undegraded":"2024-09-15T22:43:03.924861+0000","last_fullsized":"2024-09-15T22:43:03.924861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889917+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:43:03.889917+0000","last_peered":"2024-09-15T22:43:03.889917+0000","last_clean":"2024-09-15T22:43:03.889917+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:43:03.889917+0000","last_undegraded":"2024-09-15T22:43:03.889917+0000","last_fullsized":"2024-09-15T22:43:03.889917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923673+0000","last_change":"2024-09-15T22:43:00.823437+0000","last_active":"2024-09-15T22:43:03.923673+0000","last_peered":"2024-09-15T22:43:03.923673+0000","last_clean":"2024-09-15T22:43:03.923673+0000","last_became_active":"2024-09-15T22:43:00.822815+0000","last_became_peered":"2024-09-15T22:43:00.822815+0000","last_unstale":"2024-09-15T22:43:03.923673+0000","last_undegraded":"2024-09-15T22:43:03.923673+0000","last_fullsized":"2024-09-15T22:43:03.923673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:22.880248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924717+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:43:03.924717+0000","last_peered":"2024-09-15T22:43:03.924717+0000","last_clean":"2024-09-15T22:43:03.924717+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:43:03.924717+0000","last_undegraded":"2024-09-15T22:43:03.924717+0000","last_fullsized":"2024-09-15T22:43:03.924717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.808259+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:43:49.808259+0000","last_peered":"2024-09-15T22:43:49.808259+0000","last_clean":"2024-09-15T22:43:49.808259+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:43:49.808259+0000","last_undegraded":"2024-09-15T22:43:49.808259+0000","last_fullsized":"2024-09-15T22:43:49.808259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832839+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:43:03.832839+0000","last_peered":"2024-09-15T22:43:03.832839+0000","last_clean":"2024-09-15T22:43:03.832839+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:43:03.832839+0000","last_undegraded":"2024-09-15T22:43:03.832839+0000","last_fullsized":"2024-09-15T22:43:03.832839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924145+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:43:03.924145+0000","last_peered":"2024-09-15T22:43:03.924145+0000","last_clean":"2024-09-15T22:43:03.924145+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:43:03.924145+0000","last_undegraded":"2024-09-15T22:43:03.924145+0000","last_fullsized":"2024-09-15T22:43:03.924145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:50.809852+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:43:50.809852+0000","last_peered":"2024-09-15T22:43:50.809852+0000","last_clean":"2024-09-15T22:43:50.809852+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:43:50.809852+0000","last_undegraded":"2024-09-15T22:43:50.809852+0000","last_fullsized":"2024-09-15T22:43:50.809852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833009+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:43:03.833009+0000","last_peered":"2024-09-15T22:43:03.833009+0000","last_clean":"2024-09-15T22:43:03.833009+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:43:03.833009+0000","last_undegraded":"2024-09-15T22:43:03.833009+0000","last_fullsized":"2024-09-15T22:43:03.833009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832514+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:43:03.832514+0000","last_peered":"2024-09-15T22:43:03.832514+0000","last_clean":"2024-09-15T22:43:03.832514+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:43:03.832514+0000","last_undegraded":"2024-09-15T22:43:03.832514+0000","last_fullsized":"2024-09-15T22:43:03.832514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:35.948491+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:43:35.948491+0000","last_peered":"2024-09-15T22:43:35.948491+0000","last_clean":"2024-09-15T22:43:35.948491+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:43:35.948491+0000","last_undegraded":"2024-09-15T22:43:35.948491+0000","last_fullsized":"2024-09-15T22:43:35.948491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925176+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:43:03.925176+0000","last_peered":"2024-09-15T22:43:03.925176+0000","last_clean":"2024-09-15T22:43:03.925176+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:43:03.925176+0000","last_undegraded":"2024-09-15T22:43:03.925176+0000","last_fullsized":"2024-09-15T22:43:03.925176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923640+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:43:03.923640+0000","last_peered":"2024-09-15T22:43:03.923640+0000","last_clean":"2024-09-15T22:43:03.923640+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:43:03.923640+0000","last_undegraded":"2024-09-15T22:43:03.923640+0000","last_fullsized":"2024-09-15T22:43:03.923640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.791356+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:43:38.791356+0000","last_peered":"2024-09-15T22:43:38.791356+0000","last_clean":"2024-09-15T22:43:38.791356+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:43:38.791356+0000","last_undegraded":"2024-09-15T22:43:38.791356+0000","last_fullsized":"2024-09-15T22:43:38.791356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923362+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:43:03.923362+0000","last_peered":"2024-09-15T22:43:03.923362+0000","last_clean":"2024-09-15T22:43:03.923362+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:43:03.923362+0000","last_undegraded":"2024-09-15T22:43:03.923362+0000","last_fullsized":"2024-09-15T22:43:03.923362+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924345+0000","last_change":"2024-09-15T22:43:00.818418+0000","last_active":"2024-09-15T22:43:03.924345+0000","last_peered":"2024-09-15T22:43:03.924345+0000","last_clean":"2024-09-15T22:43:03.924345+0000","last_became_active":"2024-09-15T22:43:00.818013+0000","last_became_peered":"2024-09-15T22:43:00.818013+0000","last_unstale":"2024-09-15T22:43:03.924345+0000","last_undegraded":"2024-09-15T22:43:03.924345+0000","last_fullsized":"2024-09-15T22:43:03.924345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:32.460336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924406+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:43:03.924406+0000","last_peered":"2024-09-15T22:43:03.924406+0000","last_clean":"2024-09-15T22:43:03.924406+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:43:03.924406+0000","last_undegraded":"2024-09-15T22:43:03.924406+0000","last_fullsized":"2024-09-15T22:43:03.924406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.809189+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:43:49.809189+0000","last_peered":"2024-09-15T22:43:49.809189+0000","last_clean":"2024-09-15T22:43:49.809189+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:43:49.809189+0000","last_undegraded":"2024-09-15T22:43:49.809189+0000","last_fullsized":"2024-09-15T22:43:49.809189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835217+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:43:03.835217+0000","last_peered":"2024-09-15T22:43:03.835217+0000","last_clean":"2024-09-15T22:43:03.835217+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:43:03.835217+0000","last_undegraded":"2024-09-15T22:43:03.835217+0000","last_fullsized":"2024-09-15T22:43:03.835217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923589+0000","last_change":"2024-09-15T22:42:53.551009+0000","last_active":"2024-09-15T22:43:03.923589+0000","last_peered":"2024-09-15T22:43:03.923589+0000","last_clean":"2024-09-15T22:43:03.923589+0000","last_became_active":"2024-09-15T22:42:53.550312+0000","last_became_peered":"2024-09-15T22:42:53.550312+0000","last_unstale":"2024-09-15T22:43:03.923589+0000","last_undegraded":"2024-09-15T22:43:03.923589+0000","last_fullsized":"2024-09-15T22:43:03.923589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:24.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969702+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:43:37.969702+0000","last_peered":"2024-09-15T22:43:37.969702+0000","last_clean":"2024-09-15T22:43:37.969702+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:43:37.969702+0000","last_undegraded":"2024-09-15T22:43:37.969702+0000","last_fullsized":"2024-09-15T22:43:37.969702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922873+0000","last_change":"2024-09-15T22:43:00.815559+0000","last_active":"2024-09-15T22:43:03.922873+0000","last_peered":"2024-09-15T22:43:03.922873+0000","last_clean":"2024-09-15T22:43:03.922873+0000","last_became_active":"2024-09-15T22:43:00.815204+0000","last_became_peered":"2024-09-15T22:43:00.815204+0000","last_unstale":"2024-09-15T22:43:03.922873+0000","last_undegraded":"2024-09-15T22:43:03.922873+0000","last_fullsized":"2024-09-15T22:43:03.922873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:30.736201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923638+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:43:03.923638+0000","last_peered":"2024-09-15T22:43:03.923638+0000","last_clean":"2024-09-15T22:43:03.923638+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:43:03.923638+0000","last_undegraded":"2024-09-15T22:43:03.923638+0000","last_fullsized":"2024-09-15T22:43:03.923638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970862+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:43:37.970862+0000","last_peered":"2024-09-15T22:43:37.970862+0000","last_clean":"2024-09-15T22:43:37.970862+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:43:37.970862+0000","last_undegraded":"2024-09-15T22:43:37.970862+0000","last_fullsized":"2024-09-15T22:43:37.970862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923809+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:43:03.923809+0000","last_peered":"2024-09-15T22:43:03.923809+0000","last_clean":"2024-09-15T22:43:03.923809+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:43:03.923809+0000","last_undegraded":"2024-09-15T22:43:03.923809+0000","last_fullsized":"2024-09-15T22:43:03.923809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924699+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:43:03.924699+0000","last_peered":"2024-09-15T22:43:03.924699+0000","last_clean":"2024-09-15T22:43:03.924699+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:43:03.924699+0000","last_undegraded":"2024-09-15T22:43:03.924699+0000","last_fullsized":"2024-09-15T22:43:03.924699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.944822+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:43:37.944822+0000","last_peered":"2024-09-15T22:43:37.944822+0000","last_clean":"2024-09-15T22:43:37.944822+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:43:37.944822+0000","last_undegraded":"2024-09-15T22:43:37.944822+0000","last_fullsized":"2024-09-15T22:43:37.944822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925057+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:43:03.925057+0000","last_peered":"2024-09-15T22:43:03.925057+0000","last_clean":"2024-09-15T22:43:03.925057+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:43:03.925057+0000","last_undegraded":"2024-09-15T22:43:03.925057+0000","last_fullsized":"2024-09-15T22:43:03.925057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925234+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:43:03.925234+0000","last_peered":"2024-09-15T22:43:03.925234+0000","last_clean":"2024-09-15T22:43:03.925234+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:43:03.925234+0000","last_undegraded":"2024-09-15T22:43:03.925234+0000","last_fullsized":"2024-09-15T22:43:03.925234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.971190+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:43:37.971190+0000","last_peered":"2024-09-15T22:43:37.971190+0000","last_clean":"2024-09-15T22:43:37.971190+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:43:37.971190+0000","last_undegraded":"2024-09-15T22:43:37.971190+0000","last_fullsized":"2024-09-15T22:43:37.971190+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833181+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:43:03.833181+0000","last_peered":"2024-09-15T22:43:03.833181+0000","last_clean":"2024-09-15T22:43:03.833181+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:43:03.833181+0000","last_undegraded":"2024-09-15T22:43:03.833181+0000","last_fullsized":"2024-09-15T22:43:03.833181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923071+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:43:03.923071+0000","last_peered":"2024-09-15T22:43:03.923071+0000","last_clean":"2024-09-15T22:43:03.923071+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:43:03.923071+0000","last_undegraded":"2024-09-15T22:43:03.923071+0000","last_fullsized":"2024-09-15T22:43:03.923071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:50.810302+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:43:50.810302+0000","last_peered":"2024-09-15T22:43:50.810302+0000","last_clean":"2024-09-15T22:43:50.810302+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:43:50.810302+0000","last_undegraded":"2024-09-15T22:43:50.810302+0000","last_fullsized":"2024-09-15T22:43:50.810302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.890087+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:43:03.890087+0000","last_peered":"2024-09-15T22:43:03.890087+0000","last_clean":"2024-09-15T22:43:03.890087+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:43:03.890087+0000","last_undegraded":"2024-09-15T22:43:03.890087+0000","last_fullsized":"2024-09-15T22:43:03.890087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923505+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:43:03.923505+0000","last_peered":"2024-09-15T22:43:03.923505+0000","last_clean":"2024-09-15T22:43:03.923505+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:43:03.923505+0000","last_undegraded":"2024-09-15T22:43:03.923505+0000","last_fullsized":"2024-09-15T22:43:03.923505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969945+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:43:37.969945+0000","last_peered":"2024-09-15T22:43:37.969945+0000","last_clean":"2024-09-15T22:43:37.969945+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:43:37.969945+0000","last_undegraded":"2024-09-15T22:43:37.969945+0000","last_fullsized":"2024-09-15T22:43:37.969945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925159+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:43:03.925159+0000","last_peered":"2024-09-15T22:43:03.925159+0000","last_clean":"2024-09-15T22:43:03.925159+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:43:03.925159+0000","last_undegraded":"2024-09-15T22:43:03.925159+0000","last_fullsized":"2024-09-15T22:43:03.925159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832894+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:43:03.832894+0000","last_peered":"2024-09-15T22:43:03.832894+0000","last_clean":"2024-09-15T22:43:03.832894+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:43:03.832894+0000","last_undegraded":"2024-09-15T22:43:03.832894+0000","last_fullsized":"2024-09-15T22:43:03.832894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.790862+0000","last_change":"2024-09-15T22:42:51.463562+0000","last_active":"2024-09-15T22:43:38.790862+0000","last_peered":"2024-09-15T22:43:38.790862+0000","last_clean":"2024-09-15T22:43:38.790862+0000","last_became_active":"2024-09-15T22:42:51.463223+0000","last_became_peered":"2024-09-15T22:42:51.463223+0000","last_unstale":"2024-09-15T22:43:38.790862+0000","last_undegraded":"2024-09-15T22:43:38.790862+0000","last_fullsized":"2024-09-15T22:43:38.790862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:16.228599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924713+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:43:03.924713+0000","last_peered":"2024-09-15T22:43:03.924713+0000","last_clean":"2024-09-15T22:43:03.924713+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:43:03.924713+0000","last_undegraded":"2024-09-15T22:43:03.924713+0000","last_fullsized":"2024-09-15T22:43:03.924713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924409+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:43:03.924409+0000","last_peered":"2024-09-15T22:43:03.924409+0000","last_clean":"2024-09-15T22:43:03.924409+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:43:03.924409+0000","last_undegraded":"2024-09-15T22:43:03.924409+0000","last_fullsized":"2024-09-15T22:43:03.924409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'27","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:47.808905+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:43:47.808905+0000","last_peered":"2024-09-15T22:43:47.808905+0000","last_clean":"2024-09-15T22:43:47.808905+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:43:47.808905+0000","last_undegraded":"2024-09-15T22:43:47.808905+0000","last_fullsized":"2024-09-15T22:43:47.808905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":55,"num_write":29,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889730+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:43:03.889730+0000","last_peered":"2024-09-15T22:43:03.889730+0000","last_clean":"2024-09-15T22:43:03.889730+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:43:03.889730+0000","last_undegraded":"2024-09-15T22:43:03.889730+0000","last_fullsized":"2024-09-15T22:43:03.889730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835500+0000","last_change":"2024-09-15T22:42:53.552514+0000","last_active":"2024-09-15T22:43:03.835500+0000","last_peered":"2024-09-15T22:43:03.835500+0000","last_clean":"2024-09-15T22:43:03.835500+0000","last_became_active":"2024-09-15T22:42:53.552169+0000","last_became_peered":"2024-09-15T22:42:53.552169+0000","last_unstale":"2024-09-15T22:43:03.835500+0000","last_undegraded":"2024-09-15T22:43:03.835500+0000","last_fullsized":"2024-09-15T22:43:03.835500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:37.174924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.961709+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:43:36.961709+0000","last_peered":"2024-09-15T22:43:36.961709+0000","last_clean":"2024-09-15T22:43:36.961709+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:43:36.961709+0000","last_undegraded":"2024-09-15T22:43:36.961709+0000","last_fullsized":"2024-09-15T22:43:36.961709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924190+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:43:03.924190+0000","last_peered":"2024-09-15T22:43:03.924190+0000","last_clean":"2024-09-15T22:43:03.924190+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:43:03.924190+0000","last_undegraded":"2024-09-15T22:43:03.924190+0000","last_fullsized":"2024-09-15T22:43:03.924190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923056+0000","last_change":"2024-09-15T22:42:53.548636+0000","last_active":"2024-09-15T22:43:03.923056+0000","last_peered":"2024-09-15T22:43:03.923056+0000","last_clean":"2024-09-15T22:43:03.923056+0000","last_became_active":"2024-09-15T22:42:53.548229+0000","last_became_peered":"2024-09-15T22:42:53.548229+0000","last_unstale":"2024-09-15T22:43:03.923056+0000","last_undegraded":"2024-09-15T22:43:03.923056+0000","last_fullsized":"2024-09-15T22:43:03.923056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970822+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:43:37.970822+0000","last_peered":"2024-09-15T22:43:37.970822+0000","last_clean":"2024-09-15T22:43:37.970822+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:43:37.970822+0000","last_undegraded":"2024-09-15T22:43:37.970822+0000","last_fullsized":"2024-09-15T22:43:37.970822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889546+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:43:03.889546+0000","last_peered":"2024-09-15T22:43:03.889546+0000","last_clean":"2024-09-15T22:43:03.889546+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:43:03.889546+0000","last_undegraded":"2024-09-15T22:43:03.889546+0000","last_fullsized":"2024-09-15T22:43:03.889546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835616+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:43:03.835616+0000","last_peered":"2024-09-15T22:43:03.835616+0000","last_clean":"2024-09-15T22:43:03.835616+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:43:03.835616+0000","last_undegraded":"2024-09-15T22:43:03.835616+0000","last_fullsized":"2024-09-15T22:43:03.835616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:47.805781+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:43:47.805781+0000","last_peered":"2024-09-15T22:43:47.805781+0000","last_clean":"2024-09-15T22:43:47.805781+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:43:47.805781+0000","last_undegraded":"2024-09-15T22:43:47.805781+0000","last_fullsized":"2024-09-15T22:43:47.805781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923541+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:43:03.923541+0000","last_peered":"2024-09-15T22:43:03.923541+0000","last_clean":"2024-09-15T22:43:03.923541+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:43:03.923541+0000","last_undegraded":"2024-09-15T22:43:03.923541+0000","last_fullsized":"2024-09-15T22:43:03.923541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923160+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:43:03.923160+0000","last_peered":"2024-09-15T22:43:03.923160+0000","last_clean":"2024-09-15T22:43:03.923160+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:43:03.923160+0000","last_undegraded":"2024-09-15T22:43:03.923160+0000","last_fullsized":"2024-09-15T22:43:03.923160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889574+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:43:03.889574+0000","last_peered":"2024-09-15T22:43:03.889574+0000","last_clean":"2024-09-15T22:43:03.889574+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:43:03.889574+0000","last_undegraded":"2024-09-15T22:43:03.889574+0000","last_fullsized":"2024-09-15T22:43:03.889574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969363+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:43:37.969363+0000","last_peered":"2024-09-15T22:43:37.969363+0000","last_clean":"2024-09-15T22:43:37.969363+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:43:37.969363+0000","last_undegraded":"2024-09-15T22:43:37.969363+0000","last_fullsized":"2024-09-15T22:43:37.969363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924931+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:43:03.924931+0000","last_peered":"2024-09-15T22:43:03.924931+0000","last_clean":"2024-09-15T22:43:03.924931+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:43:03.924931+0000","last_undegraded":"2024-09-15T22:43:03.924931+0000","last_fullsized":"2024-09-15T22:43:03.924931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923600+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:43:03.923600+0000","last_peered":"2024-09-15T22:43:03.923600+0000","last_clean":"2024-09-15T22:43:03.923600+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:43:03.923600+0000","last_undegraded":"2024-09-15T22:43:03.923600+0000","last_fullsized":"2024-09-15T22:43:03.923600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:35.947760+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:43:35.947760+0000","last_peered":"2024-09-15T22:43:35.947760+0000","last_clean":"2024-09-15T22:43:35.947760+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:43:35.947760+0000","last_undegraded":"2024-09-15T22:43:35.947760+0000","last_fullsized":"2024-09-15T22:43:35.947760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.963521+0000","last_change":"2024-09-15T22:42:51.466199+0000","last_active":"2024-09-15T22:43:36.963521+0000","last_peered":"2024-09-15T22:43:36.963521+0000","last_clean":"2024-09-15T22:43:36.963521+0000","last_became_active":"2024-09-15T22:42:51.465819+0000","last_became_peered":"2024-09-15T22:42:51.465819+0000","last_unstale":"2024-09-15T22:43:36.963521+0000","last_undegraded":"2024-09-15T22:43:36.963521+0000","last_fullsized":"2024-09-15T22:43:36.963521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:22.225892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924721+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:43:03.924721+0000","last_peered":"2024-09-15T22:43:03.924721+0000","last_clean":"2024-09-15T22:43:03.924721+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:43:03.924721+0000","last_undegraded":"2024-09-15T22:43:03.924721+0000","last_fullsized":"2024-09-15T22:43:03.924721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833516+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:43:03.833516+0000","last_peered":"2024-09-15T22:43:03.833516+0000","last_clean":"2024-09-15T22:43:03.833516+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:43:03.833516+0000","last_undegraded":"2024-09-15T22:43:03.833516+0000","last_fullsized":"2024-09-15T22:43:03.833516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.809107+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:43:49.809107+0000","last_peered":"2024-09-15T22:43:49.809107+0000","last_clean":"2024-09-15T22:43:49.809107+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:43:49.809107+0000","last_undegraded":"2024-09-15T22:43:49.809107+0000","last_fullsized":"2024-09-15T22:43:49.809107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923850+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:43:03.923850+0000","last_peered":"2024-09-15T22:43:03.923850+0000","last_clean":"2024-09-15T22:43:03.923850+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:43:03.923850+0000","last_undegraded":"2024-09-15T22:43:03.923850+0000","last_fullsized":"2024-09-15T22:43:03.923850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833839+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:43:03.833839+0000","last_peered":"2024-09-15T22:43:03.833839+0000","last_clean":"2024-09-15T22:43:03.833839+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:43:03.833839+0000","last_undegraded":"2024-09-15T22:43:03.833839+0000","last_fullsized":"2024-09-15T22:43:03.833839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923492+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:43:03.923492+0000","last_peered":"2024-09-15T22:43:03.923492+0000","last_clean":"2024-09-15T22:43:03.923492+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:43:03.923492+0000","last_undegraded":"2024-09-15T22:43:03.923492+0000","last_fullsized":"2024-09-15T22:43:03.923492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833583+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:43:03.833583+0000","last_peered":"2024-09-15T22:43:03.833583+0000","last_clean":"2024-09-15T22:43:03.833583+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:43:03.833583+0000","last_undegraded":"2024-09-15T22:43:03.833583+0000","last_fullsized":"2024-09-15T22:43:03.833583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833266+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:43:03.833266+0000","last_peered":"2024-09-15T22:43:03.833266+0000","last_clean":"2024-09-15T22:43:03.833266+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:43:03.833266+0000","last_undegraded":"2024-09-15T22:43:03.833266+0000","last_fullsized":"2024-09-15T22:43:03.833266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922972+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:43:03.922972+0000","last_peered":"2024-09-15T22:43:03.922972+0000","last_clean":"2024-09-15T22:43:03.922972+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:43:03.922972+0000","last_undegraded":"2024-09-15T22:43:03.922972+0000","last_fullsized":"2024-09-15T22:43:03.922972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832888+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:43:03.832888+0000","last_peered":"2024-09-15T22:43:03.832888+0000","last_clean":"2024-09-15T22:43:03.832888+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:43:03.832888+0000","last_undegraded":"2024-09-15T22:43:03.832888+0000","last_fullsized":"2024-09-15T22:43:03.832888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925398+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:43:03.925398+0000","last_peered":"2024-09-15T22:43:03.925398+0000","last_clean":"2024-09-15T22:43:03.925398+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:43:03.925398+0000","last_undegraded":"2024-09-15T22:43:03.925398+0000","last_fullsized":"2024-09-15T22:43:03.925398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833927+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:43:03.833927+0000","last_peered":"2024-09-15T22:43:03.833927+0000","last_clean":"2024-09-15T22:43:03.833927+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:43:03.833927+0000","last_undegraded":"2024-09-15T22:43:03.833927+0000","last_fullsized":"2024-09-15T22:43:03.833927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924034+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:43:03.924034+0000","last_peered":"2024-09-15T22:43:03.924034+0000","last_clean":"2024-09-15T22:43:03.924034+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:43:03.924034+0000","last_undegraded":"2024-09-15T22:43:03.924034+0000","last_fullsized":"2024-09-15T22:43:03.924034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924032+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:43:03.924032+0000","last_peered":"2024-09-15T22:43:03.924032+0000","last_clean":"2024-09-15T22:43:03.924032+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:43:03.924032+0000","last_undegraded":"2024-09-15T22:43:03.924032+0000","last_fullsized":"2024-09-15T22:43:03.924032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923561+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:43:03.923561+0000","last_peered":"2024-09-15T22:43:03.923561+0000","last_clean":"2024-09-15T22:43:03.923561+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:43:03.923561+0000","last_undegraded":"2024-09-15T22:43:03.923561+0000","last_fullsized":"2024-09-15T22:43:03.923561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835384+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:43:03.835384+0000","last_peered":"2024-09-15T22:43:03.835384+0000","last_clean":"2024-09-15T22:43:03.835384+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:43:03.835384+0000","last_undegraded":"2024-09-15T22:43:03.835384+0000","last_fullsized":"2024-09-15T22:43:03.835384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832837+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:43:03.832837+0000","last_peered":"2024-09-15T22:43:03.832837+0000","last_clean":"2024-09-15T22:43:03.832837+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:43:03.832837+0000","last_undegraded":"2024-09-15T22:43:03.832837+0000","last_fullsized":"2024-09-15T22:43:03.832837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924848+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:43:03.924848+0000","last_peered":"2024-09-15T22:43:03.924848+0000","last_clean":"2024-09-15T22:43:03.924848+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:43:03.924848+0000","last_undegraded":"2024-09-15T22:43:03.924848+0000","last_fullsized":"2024-09-15T22:43:03.924848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833963+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:43:03.833963+0000","last_peered":"2024-09-15T22:43:03.833963+0000","last_clean":"2024-09-15T22:43:03.833963+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:43:03.833963+0000","last_undegraded":"2024-09-15T22:43:03.833963+0000","last_fullsized":"2024-09-15T22:43:03.833963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.890064+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:43:03.890064+0000","last_peered":"2024-09-15T22:43:03.890064+0000","last_clean":"2024-09-15T22:43:03.890064+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:43:03.890064+0000","last_undegraded":"2024-09-15T22:43:03.890064+0000","last_fullsized":"2024-09-15T22:43:03.890064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925281+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:43:03.925281+0000","last_peered":"2024-09-15T22:43:03.925281+0000","last_clean":"2024-09-15T22:43:03.925281+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:43:03.925281+0000","last_undegraded":"2024-09-15T22:43:03.925281+0000","last_fullsized":"2024-09-15T22:43:03.925281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835020+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:43:03.835020+0000","last_peered":"2024-09-15T22:43:03.835020+0000","last_clean":"2024-09-15T22:43:03.835020+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:43:03.835020+0000","last_undegraded":"2024-09-15T22:43:03.835020+0000","last_fullsized":"2024-09-15T22:43:03.835020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922782+0000","last_change":"2024-09-15T22:42:53.550831+0000","last_active":"2024-09-15T22:43:03.922782+0000","last_peered":"2024-09-15T22:43:03.922782+0000","last_clean":"2024-09-15T22:43:03.922782+0000","last_became_active":"2024-09-15T22:42:53.550486+0000","last_became_peered":"2024-09-15T22:42:53.550486+0000","last_unstale":"2024-09-15T22:43:03.922782+0000","last_undegraded":"2024-09-15T22:43:03.922782+0000","last_fullsized":"2024-09-15T22:43:03.922782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:44.502057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922723+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:43:03.922723+0000","last_peered":"2024-09-15T22:43:03.922723+0000","last_clean":"2024-09-15T22:43:03.922723+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:43:03.922723+0000","last_undegraded":"2024-09-15T22:43:03.922723+0000","last_fullsized":"2024-09-15T22:43:03.922723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832832+0000","last_change":"2024-09-15T22:42:53.539288+0000","last_active":"2024-09-15T22:43:03.832832+0000","last_peered":"2024-09-15T22:43:03.832832+0000","last_clean":"2024-09-15T22:43:03.832832+0000","last_became_active":"2024-09-15T22:42:53.538831+0000","last_became_peered":"2024-09-15T22:42:53.538831+0000","last_unstale":"2024-09-15T22:43:03.832832+0000","last_undegraded":"2024-09-15T22:43:03.832832+0000","last_fullsized":"2024-09-15T22:43:03.832832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:55.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924490+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:43:03.924490+0000","last_peered":"2024-09-15T22:43:03.924490+0000","last_clean":"2024-09-15T22:43:03.924490+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:43:03.924490+0000","last_undegraded":"2024-09-15T22:43:03.924490+0000","last_fullsized":"2024-09-15T22:43:03.924490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924334+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:43:03.924334+0000","last_peered":"2024-09-15T22:43:03.924334+0000","last_clean":"2024-09-15T22:43:03.924334+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:43:03.924334+0000","last_undegraded":"2024-09-15T22:43:03.924334+0000","last_fullsized":"2024-09-15T22:43:03.924334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925042+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:43:03.925042+0000","last_peered":"2024-09-15T22:43:03.925042+0000","last_clean":"2024-09-15T22:43:03.925042+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:43:03.925042+0000","last_undegraded":"2024-09-15T22:43:03.925042+0000","last_fullsized":"2024-09-15T22:43:03.925042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835758+0000","last_change":"2024-09-15T22:42:53.545411+0000","last_active":"2024-09-15T22:43:03.835758+0000","last_peered":"2024-09-15T22:43:03.835758+0000","last_clean":"2024-09-15T22:43:03.835758+0000","last_became_active":"2024-09-15T22:42:53.545102+0000","last_became_peered":"2024-09-15T22:42:53.545102+0000","last_unstale":"2024-09-15T22:43:03.835758+0000","last_undegraded":"2024-09-15T22:43:03.835758+0000","last_fullsized":"2024-09-15T22:43:03.835758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:13.364426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923480+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:43:03.923480+0000","last_peered":"2024-09-15T22:43:03.923480+0000","last_clean":"2024-09-15T22:43:03.923480+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:43:03.923480+0000","last_undegraded":"2024-09-15T22:43:03.923480+0000","last_fullsized":"2024-09-15T22:43:03.923480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923275+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:43:03.923275+0000","last_peered":"2024-09-15T22:43:03.923275+0000","last_clean":"2024-09-15T22:43:03.923275+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:43:03.923275+0000","last_undegraded":"2024-09-15T22:43:03.923275+0000","last_fullsized":"2024-09-15T22:43:03.923275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924585+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:43:03.924585+0000","last_peered":"2024-09-15T22:43:03.924585+0000","last_clean":"2024-09-15T22:43:03.924585+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:43:03.924585+0000","last_undegraded":"2024-09-15T22:43:03.924585+0000","last_fullsized":"2024-09-15T22:43:03.924585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923716+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:43:03.923716+0000","last_peered":"2024-09-15T22:43:03.923716+0000","last_clean":"2024-09-15T22:43:03.923716+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:43:03.923716+0000","last_undegraded":"2024-09-15T22:43:03.923716+0000","last_fullsized":"2024-09-15T22:43:03.923716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924381+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:43:03.924381+0000","last_peered":"2024-09-15T22:43:03.924381+0000","last_clean":"2024-09-15T22:43:03.924381+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:43:03.924381+0000","last_undegraded":"2024-09-15T22:43:03.924381+0000","last_fullsized":"2024-09-15T22:43:03.924381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922875+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:43:03.922875+0000","last_peered":"2024-09-15T22:43:03.922875+0000","last_clean":"2024-09-15T22:43:03.922875+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:43:03.922875+0000","last_undegraded":"2024-09-15T22:43:03.922875+0000","last_fullsized":"2024-09-15T22:43:03.922875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922992+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:43:03.922992+0000","last_peered":"2024-09-15T22:43:03.922992+0000","last_clean":"2024-09-15T22:43:03.922992+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:43:03.922992+0000","last_undegraded":"2024-09-15T22:43:03.922992+0000","last_fullsized":"2024-09-15T22:43:03.922992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925188+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:43:03.925188+0000","last_peered":"2024-09-15T22:43:03.925188+0000","last_clean":"2024-09-15T22:43:03.925188+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:43:03.925188+0000","last_undegraded":"2024-09-15T22:43:03.925188+0000","last_fullsized":"2024-09-15T22:43:03.925188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50160,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":129,"num_write":231,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":168606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":473376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1103537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005090,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":477402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":473684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1070183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":469203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1065372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":472884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":468518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":522468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":522641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":45081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:43:53.410 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:43:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:52 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:52 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:52 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:43:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:52 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:43:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:52 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:43:53.667 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:54.101 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:53 smithi066 ceph-mon[31185]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-09-15T22:43:54.101 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:53 smithi066 ceph-mon[31185]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:54.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 -- 172.21.15.66:0/456005389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 msgr2=0x7f0a7410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 --2- 172.21.15.66:0/456005389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a7410bb50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009900 tx=0x7f0a6802a480 comp rx=0 tx=0).stop 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 -- 172.21.15.66:0/456005389 shutdown_connections 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 --2- 172.21.15.66:0/456005389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 0x7f0a7410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 --2- 172.21.15.66:0/456005389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a7410bb50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 --2- 172.21.15.66:0/456005389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 0x7f0a74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 -- 172.21.15.66:0/456005389 >> 172.21.15.66:0/456005389 conn(0x7f0a740fc7a0 msgr2=0x7f0a740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 -- 172.21.15.66:0/456005389 shutdown_connections 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.181+0000 7f0a791dc640 1 -- 172.21.15.66:0/456005389 wait complete. 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.182+0000 7f0a791dc640 1 Processor -- start 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.182+0000 7f0a791dc640 1 -- start start 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 0x7f0a741984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 0x7f0a7419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111fb0 con 0x7f0a74103660 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111e30 con 0x7f0a7410c170 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a791dc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74112130 con 0x7f0a74102d40 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34014/0 (socket says 172.21.15.66:34014) 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 -- 172.21.15.66:0/1898053979 learned_addr learned my addr 172.21.15.66:0/1898053979 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7359e640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 0x7f0a7419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a72d9d640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 0x7f0a741984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 -- 172.21.15.66:0/1898053979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 msgr2=0x7f0a741984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 0x7f0a741984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 -- 172.21.15.66:0/1898053979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 msgr2=0x7f0a7419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 0x7f0a7419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.183+0000 7f0a7259c640 1 -- 172.21.15.66:0/1898053979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7419d460 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a7259c640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a68006010 tx=0x7f0a680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6803f030 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a68003ce0 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7419d6f0 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68035070 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.184+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a741a5030 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.185+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7406b070 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.186+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0a68042030 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.186+0000 7f0a5bfff640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 0x7f0a5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.187+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f0a680f0220 con 0x7f0a74103660 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.187+0000 7f0a72d9d640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 0x7f0a5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.187+0000 7f0a72d9d640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 0x7f0a5c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009890 tx=0x7f0a64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:54.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.191+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a680bcd00 con 0x7f0a74103660 2024-09-15T22:43:54.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:53 smithi087 ceph-mon[35290]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-09-15T22:43:54.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:53 smithi087 ceph-mon[35290]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:54.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.363+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a74062630 con 0x7f0a5c0a32d0 2024-09-15T22:43:54.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.371+0000 7f0a5bfff640 1 -- 172.21.15.66:0/1898053979 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340386 (secure 0 0 0) 0x7f0a74062630 con 0x7f0a5c0a32d0 2024-09-15T22:43:54.376 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:54.378 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 msgr2=0x7f0a5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 0x7f0a5c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009890 tx=0x7f0a64008040 comp rx=0 tx=0).stop 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 msgr2=0x7f0a741989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a68006010 tx=0x7f0a680042f0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 shutdown_connections 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0a5c0a32d0 0x7f0a5c0a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a7410c170 0x7f0a7419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a74103660 0x7f0a741989f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 --2- 172.21.15.66:0/1898053979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a74102d40 0x7f0a741984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:54.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 >> 172.21.15.66:0/1898053979 conn(0x7f0a740fc7a0 msgr2=0x7f0a740fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:54.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 shutdown_connections 2024-09-15T22:43:54.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:54.375+0000 7f0a791dc640 1 -- 172.21.15.66:0/1898053979 wait complete. 2024-09-15T22:43:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:53 smithi184 ceph-mon[35203]: pgmap v311: 129 pgs: 129 active+clean; 626 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-09-15T22:43:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:53 smithi184 ceph-mon[35203]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:55.072 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-15T22:43:52.375375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640762,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":289,"num_read_kb":248,"num_write":414,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383476,"kb_used_data":13428,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558348,"statfs":{"total":1151940427776,"available":1151547748352,"internally_reserved":0,"allocated":13750272,"data_stored":7589534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42850,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":153,"num_read_kb":129,"num_write":82,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003091"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:45.803041+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:43:45.803041+0000","last_peered":"2024-09-15T22:43:45.803041+0000","last_clean":"2024-09-15T22:43:45.803041+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:43:45.803041+0000","last_undegraded":"2024-09-15T22:43:45.803041+0000","last_fullsized":"2024-09-15T22:43:45.803041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923885+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:43:03.923885+0000","last_peered":"2024-09-15T22:43:03.923885+0000","last_clean":"2024-09-15T22:43:03.923885+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:43:03.923885+0000","last_undegraded":"2024-09-15T22:43:03.923885+0000","last_fullsized":"2024-09-15T22:43:03.923885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833292+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:43:03.833292+0000","last_peered":"2024-09-15T22:43:03.833292+0000","last_clean":"2024-09-15T22:43:03.833292+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:43:03.833292+0000","last_undegraded":"2024-09-15T22:43:03.833292+0000","last_fullsized":"2024-09-15T22:43:03.833292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924108+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:43:03.924108+0000","last_peered":"2024-09-15T22:43:03.924108+0000","last_clean":"2024-09-15T22:43:03.924108+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:43:03.924108+0000","last_undegraded":"2024-09-15T22:43:03.924108+0000","last_fullsized":"2024-09-15T22:43:03.924108+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923034+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:43:03.923034+0000","last_peered":"2024-09-15T22:43:03.923034+0000","last_clean":"2024-09-15T22:43:03.923034+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:43:03.923034+0000","last_undegraded":"2024-09-15T22:43:03.923034+0000","last_fullsized":"2024-09-15T22:43:03.923034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923115+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:43:03.923115+0000","last_peered":"2024-09-15T22:43:03.923115+0000","last_clean":"2024-09-15T22:43:03.923115+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:43:03.923115+0000","last_undegraded":"2024-09-15T22:43:03.923115+0000","last_fullsized":"2024-09-15T22:43:03.923115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.790577+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:43:38.790577+0000","last_peered":"2024-09-15T22:43:38.790577+0000","last_clean":"2024-09-15T22:43:38.790577+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:43:38.790577+0000","last_undegraded":"2024-09-15T22:43:38.790577+0000","last_fullsized":"2024-09-15T22:43:38.790577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835350+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:43:03.835350+0000","last_peered":"2024-09-15T22:43:03.835350+0000","last_clean":"2024-09-15T22:43:03.835350+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:43:03.835350+0000","last_undegraded":"2024-09-15T22:43:03.835350+0000","last_fullsized":"2024-09-15T22:43:03.835350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923880+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:43:03.923880+0000","last_peered":"2024-09-15T22:43:03.923880+0000","last_clean":"2024-09-15T22:43:03.923880+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:43:03.923880+0000","last_undegraded":"2024-09-15T22:43:03.923880+0000","last_fullsized":"2024-09-15T22:43:03.923880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970678+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:43:37.970678+0000","last_peered":"2024-09-15T22:43:37.970678+0000","last_clean":"2024-09-15T22:43:37.970678+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:43:37.970678+0000","last_undegraded":"2024-09-15T22:43:37.970678+0000","last_fullsized":"2024-09-15T22:43:37.970678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924727+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:43:03.924727+0000","last_peered":"2024-09-15T22:43:03.924727+0000","last_clean":"2024-09-15T22:43:03.924727+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:43:03.924727+0000","last_undegraded":"2024-09-15T22:43:03.924727+0000","last_fullsized":"2024-09-15T22:43:03.924727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923576+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:43:03.923576+0000","last_peered":"2024-09-15T22:43:03.923576+0000","last_clean":"2024-09-15T22:43:03.923576+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:43:03.923576+0000","last_undegraded":"2024-09-15T22:43:03.923576+0000","last_fullsized":"2024-09-15T22:43:03.923576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923942+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:43:03.923942+0000","last_peered":"2024-09-15T22:43:03.923942+0000","last_clean":"2024-09-15T22:43:03.923942+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:43:03.923942+0000","last_undegraded":"2024-09-15T22:43:03.923942+0000","last_fullsized":"2024-09-15T22:43:03.923942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:34.944074+0000","last_change":"2024-09-15T22:42:51.465697+0000","last_active":"2024-09-15T22:43:34.944074+0000","last_peered":"2024-09-15T22:43:34.944074+0000","last_clean":"2024-09-15T22:43:34.944074+0000","last_became_active":"2024-09-15T22:42:51.464496+0000","last_became_peered":"2024-09-15T22:42:51.464496+0000","last_unstale":"2024-09-15T22:43:34.944074+0000","last_undegraded":"2024-09-15T22:43:34.944074+0000","last_fullsized":"2024-09-15T22:43:34.944074+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:38.216763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923957+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:43:03.923957+0000","last_peered":"2024-09-15T22:43:03.923957+0000","last_clean":"2024-09-15T22:43:03.923957+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:43:03.923957+0000","last_undegraded":"2024-09-15T22:43:03.923957+0000","last_fullsized":"2024-09-15T22:43:03.923957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923587+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:43:03.923587+0000","last_peered":"2024-09-15T22:43:03.923587+0000","last_clean":"2024-09-15T22:43:03.923587+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:43:03.923587+0000","last_undegraded":"2024-09-15T22:43:03.923587+0000","last_fullsized":"2024-09-15T22:43:03.923587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.963287+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:43:36.963287+0000","last_peered":"2024-09-15T22:43:36.963287+0000","last_clean":"2024-09-15T22:43:36.963287+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:43:36.963287+0000","last_undegraded":"2024-09-15T22:43:36.963287+0000","last_fullsized":"2024-09-15T22:43:36.963287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923703+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:43:03.923703+0000","last_peered":"2024-09-15T22:43:03.923703+0000","last_clean":"2024-09-15T22:43:03.923703+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:43:03.923703+0000","last_undegraded":"2024-09-15T22:43:03.923703+0000","last_fullsized":"2024-09-15T22:43:03.923703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923711+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:43:03.923711+0000","last_peered":"2024-09-15T22:43:03.923711+0000","last_clean":"2024-09-15T22:43:03.923711+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:43:03.923711+0000","last_undegraded":"2024-09-15T22:43:03.923711+0000","last_fullsized":"2024-09-15T22:43:03.923711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969791+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:43:37.969791+0000","last_peered":"2024-09-15T22:43:37.969791+0000","last_clean":"2024-09-15T22:43:37.969791+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:43:37.969791+0000","last_undegraded":"2024-09-15T22:43:37.969791+0000","last_fullsized":"2024-09-15T22:43:37.969791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889991+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:43:03.889991+0000","last_peered":"2024-09-15T22:43:03.889991+0000","last_clean":"2024-09-15T22:43:03.889991+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:43:03.889991+0000","last_undegraded":"2024-09-15T22:43:03.889991+0000","last_fullsized":"2024-09-15T22:43:03.889991+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923550+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:43:03.923550+0000","last_peered":"2024-09-15T22:43:03.923550+0000","last_clean":"2024-09-15T22:43:03.923550+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:43:03.923550+0000","last_undegraded":"2024-09-15T22:43:03.923550+0000","last_fullsized":"2024-09-15T22:43:03.923550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:34.942659+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:43:34.942659+0000","last_peered":"2024-09-15T22:43:34.942659+0000","last_clean":"2024-09-15T22:43:34.942659+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:43:34.942659+0000","last_undegraded":"2024-09-15T22:43:34.942659+0000","last_fullsized":"2024-09-15T22:43:34.942659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924957+0000","last_change":"2024-09-15T22:43:00.825184+0000","last_active":"2024-09-15T22:43:03.924957+0000","last_peered":"2024-09-15T22:43:03.924957+0000","last_clean":"2024-09-15T22:43:03.924957+0000","last_became_active":"2024-09-15T22:43:00.824758+0000","last_became_peered":"2024-09-15T22:43:00.824758+0000","last_unstale":"2024-09-15T22:43:03.924957+0000","last_undegraded":"2024-09-15T22:43:03.924957+0000","last_fullsized":"2024-09-15T22:43:03.924957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923091+0000","last_change":"2024-09-15T22:42:53.546237+0000","last_active":"2024-09-15T22:43:03.923091+0000","last_peered":"2024-09-15T22:43:03.923091+0000","last_clean":"2024-09-15T22:43:03.923091+0000","last_became_active":"2024-09-15T22:42:53.545941+0000","last_became_peered":"2024-09-15T22:42:53.545941+0000","last_unstale":"2024-09-15T22:43:03.923091+0000","last_undegraded":"2024-09-15T22:43:03.923091+0000","last_fullsized":"2024-09-15T22:43:03.923091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:36.030343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969078+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:43:37.969078+0000","last_peered":"2024-09-15T22:43:37.969078+0000","last_clean":"2024-09-15T22:43:37.969078+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:43:37.969078+0000","last_undegraded":"2024-09-15T22:43:37.969078+0000","last_fullsized":"2024-09-15T22:43:37.969078+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833318+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:43:03.833318+0000","last_peered":"2024-09-15T22:43:03.833318+0000","last_clean":"2024-09-15T22:43:03.833318+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:43:03.833318+0000","last_undegraded":"2024-09-15T22:43:03.833318+0000","last_fullsized":"2024-09-15T22:43:03.833318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924085+0000","last_change":"2024-09-15T22:42:53.544658+0000","last_active":"2024-09-15T22:43:03.924085+0000","last_peered":"2024-09-15T22:43:03.924085+0000","last_clean":"2024-09-15T22:43:03.924085+0000","last_became_active":"2024-09-15T22:42:53.544382+0000","last_became_peered":"2024-09-15T22:42:53.544382+0000","last_unstale":"2024-09-15T22:43:03.924085+0000","last_undegraded":"2024-09-15T22:43:03.924085+0000","last_fullsized":"2024-09-15T22:43:03.924085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:13.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:44.794168+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:43:44.794168+0000","last_peered":"2024-09-15T22:43:44.794168+0000","last_clean":"2024-09-15T22:43:44.794168+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:43:44.794168+0000","last_undegraded":"2024-09-15T22:43:44.794168+0000","last_fullsized":"2024-09-15T22:43:44.794168+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923416+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:43:03.923416+0000","last_peered":"2024-09-15T22:43:03.923416+0000","last_clean":"2024-09-15T22:43:03.923416+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:43:03.923416+0000","last_undegraded":"2024-09-15T22:43:03.923416+0000","last_fullsized":"2024-09-15T22:43:03.923416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833070+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:43:03.833070+0000","last_peered":"2024-09-15T22:43:03.833070+0000","last_clean":"2024-09-15T22:43:03.833070+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:43:03.833070+0000","last_undegraded":"2024-09-15T22:43:03.833070+0000","last_fullsized":"2024-09-15T22:43:03.833070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970912+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:43:37.970912+0000","last_peered":"2024-09-15T22:43:37.970912+0000","last_clean":"2024-09-15T22:43:37.970912+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:43:37.970912+0000","last_undegraded":"2024-09-15T22:43:37.970912+0000","last_fullsized":"2024-09-15T22:43:37.970912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924151+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:43:03.924151+0000","last_peered":"2024-09-15T22:43:03.924151+0000","last_clean":"2024-09-15T22:43:03.924151+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:43:03.924151+0000","last_undegraded":"2024-09-15T22:43:03.924151+0000","last_fullsized":"2024-09-15T22:43:03.924151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924861+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:43:03.924861+0000","last_peered":"2024-09-15T22:43:03.924861+0000","last_clean":"2024-09-15T22:43:03.924861+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:43:03.924861+0000","last_undegraded":"2024-09-15T22:43:03.924861+0000","last_fullsized":"2024-09-15T22:43:03.924861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889917+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:43:03.889917+0000","last_peered":"2024-09-15T22:43:03.889917+0000","last_clean":"2024-09-15T22:43:03.889917+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:43:03.889917+0000","last_undegraded":"2024-09-15T22:43:03.889917+0000","last_fullsized":"2024-09-15T22:43:03.889917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923673+0000","last_change":"2024-09-15T22:43:00.823437+0000","last_active":"2024-09-15T22:43:03.923673+0000","last_peered":"2024-09-15T22:43:03.923673+0000","last_clean":"2024-09-15T22:43:03.923673+0000","last_became_active":"2024-09-15T22:43:00.822815+0000","last_became_peered":"2024-09-15T22:43:00.822815+0000","last_unstale":"2024-09-15T22:43:03.923673+0000","last_undegraded":"2024-09-15T22:43:03.923673+0000","last_fullsized":"2024-09-15T22:43:03.923673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:22.880248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924717+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:43:03.924717+0000","last_peered":"2024-09-15T22:43:03.924717+0000","last_clean":"2024-09-15T22:43:03.924717+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:43:03.924717+0000","last_undegraded":"2024-09-15T22:43:03.924717+0000","last_fullsized":"2024-09-15T22:43:03.924717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.808259+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:43:49.808259+0000","last_peered":"2024-09-15T22:43:49.808259+0000","last_clean":"2024-09-15T22:43:49.808259+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:43:49.808259+0000","last_undegraded":"2024-09-15T22:43:49.808259+0000","last_fullsized":"2024-09-15T22:43:49.808259+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832839+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:43:03.832839+0000","last_peered":"2024-09-15T22:43:03.832839+0000","last_clean":"2024-09-15T22:43:03.832839+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:43:03.832839+0000","last_undegraded":"2024-09-15T22:43:03.832839+0000","last_fullsized":"2024-09-15T22:43:03.832839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924145+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:43:03.924145+0000","last_peered":"2024-09-15T22:43:03.924145+0000","last_clean":"2024-09-15T22:43:03.924145+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:43:03.924145+0000","last_undegraded":"2024-09-15T22:43:03.924145+0000","last_fullsized":"2024-09-15T22:43:03.924145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:50.809852+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:43:50.809852+0000","last_peered":"2024-09-15T22:43:50.809852+0000","last_clean":"2024-09-15T22:43:50.809852+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:43:50.809852+0000","last_undegraded":"2024-09-15T22:43:50.809852+0000","last_fullsized":"2024-09-15T22:43:50.809852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833009+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:43:03.833009+0000","last_peered":"2024-09-15T22:43:03.833009+0000","last_clean":"2024-09-15T22:43:03.833009+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:43:03.833009+0000","last_undegraded":"2024-09-15T22:43:03.833009+0000","last_fullsized":"2024-09-15T22:43:03.833009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832514+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:43:03.832514+0000","last_peered":"2024-09-15T22:43:03.832514+0000","last_clean":"2024-09-15T22:43:03.832514+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:43:03.832514+0000","last_undegraded":"2024-09-15T22:43:03.832514+0000","last_fullsized":"2024-09-15T22:43:03.832514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:35.948491+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:43:35.948491+0000","last_peered":"2024-09-15T22:43:35.948491+0000","last_clean":"2024-09-15T22:43:35.948491+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:43:35.948491+0000","last_undegraded":"2024-09-15T22:43:35.948491+0000","last_fullsized":"2024-09-15T22:43:35.948491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925176+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:43:03.925176+0000","last_peered":"2024-09-15T22:43:03.925176+0000","last_clean":"2024-09-15T22:43:03.925176+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:43:03.925176+0000","last_undegraded":"2024-09-15T22:43:03.925176+0000","last_fullsized":"2024-09-15T22:43:03.925176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923640+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:43:03.923640+0000","last_peered":"2024-09-15T22:43:03.923640+0000","last_clean":"2024-09-15T22:43:03.923640+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:43:03.923640+0000","last_undegraded":"2024-09-15T22:43:03.923640+0000","last_fullsized":"2024-09-15T22:43:03.923640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.791356+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:43:38.791356+0000","last_peered":"2024-09-15T22:43:38.791356+0000","last_clean":"2024-09-15T22:43:38.791356+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:43:38.791356+0000","last_undegraded":"2024-09-15T22:43:38.791356+0000","last_fullsized":"2024-09-15T22:43:38.791356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":350,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923362+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:43:03.923362+0000","last_peered":"2024-09-15T22:43:03.923362+0000","last_clean":"2024-09-15T22:43:03.923362+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:43:03.923362+0000","last_undegraded":"2024-09-15T22:43:03.923362+0000","last_fullsized":"2024-09-15T22:43:03.923362+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924345+0000","last_change":"2024-09-15T22:43:00.818418+0000","last_active":"2024-09-15T22:43:03.924345+0000","last_peered":"2024-09-15T22:43:03.924345+0000","last_clean":"2024-09-15T22:43:03.924345+0000","last_became_active":"2024-09-15T22:43:00.818013+0000","last_became_peered":"2024-09-15T22:43:00.818013+0000","last_unstale":"2024-09-15T22:43:03.924345+0000","last_undegraded":"2024-09-15T22:43:03.924345+0000","last_fullsized":"2024-09-15T22:43:03.924345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:32.460336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924406+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:43:03.924406+0000","last_peered":"2024-09-15T22:43:03.924406+0000","last_clean":"2024-09-15T22:43:03.924406+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:43:03.924406+0000","last_undegraded":"2024-09-15T22:43:03.924406+0000","last_fullsized":"2024-09-15T22:43:03.924406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.809189+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:43:49.809189+0000","last_peered":"2024-09-15T22:43:49.809189+0000","last_clean":"2024-09-15T22:43:49.809189+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:43:49.809189+0000","last_undegraded":"2024-09-15T22:43:49.809189+0000","last_fullsized":"2024-09-15T22:43:49.809189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835217+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:43:03.835217+0000","last_peered":"2024-09-15T22:43:03.835217+0000","last_clean":"2024-09-15T22:43:03.835217+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:43:03.835217+0000","last_undegraded":"2024-09-15T22:43:03.835217+0000","last_fullsized":"2024-09-15T22:43:03.835217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923589+0000","last_change":"2024-09-15T22:42:53.551009+0000","last_active":"2024-09-15T22:43:03.923589+0000","last_peered":"2024-09-15T22:43:03.923589+0000","last_clean":"2024-09-15T22:43:03.923589+0000","last_became_active":"2024-09-15T22:42:53.550312+0000","last_became_peered":"2024-09-15T22:42:53.550312+0000","last_unstale":"2024-09-15T22:43:03.923589+0000","last_undegraded":"2024-09-15T22:43:03.923589+0000","last_fullsized":"2024-09-15T22:43:03.923589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:24.690160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969702+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:43:37.969702+0000","last_peered":"2024-09-15T22:43:37.969702+0000","last_clean":"2024-09-15T22:43:37.969702+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:43:37.969702+0000","last_undegraded":"2024-09-15T22:43:37.969702+0000","last_fullsized":"2024-09-15T22:43:37.969702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922873+0000","last_change":"2024-09-15T22:43:00.815559+0000","last_active":"2024-09-15T22:43:03.922873+0000","last_peered":"2024-09-15T22:43:03.922873+0000","last_clean":"2024-09-15T22:43:03.922873+0000","last_became_active":"2024-09-15T22:43:00.815204+0000","last_became_peered":"2024-09-15T22:43:00.815204+0000","last_unstale":"2024-09-15T22:43:03.922873+0000","last_undegraded":"2024-09-15T22:43:03.922873+0000","last_fullsized":"2024-09-15T22:43:03.922873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:30.736201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923638+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:43:03.923638+0000","last_peered":"2024-09-15T22:43:03.923638+0000","last_clean":"2024-09-15T22:43:03.923638+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:43:03.923638+0000","last_undegraded":"2024-09-15T22:43:03.923638+0000","last_fullsized":"2024-09-15T22:43:03.923638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970862+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:43:37.970862+0000","last_peered":"2024-09-15T22:43:37.970862+0000","last_clean":"2024-09-15T22:43:37.970862+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:43:37.970862+0000","last_undegraded":"2024-09-15T22:43:37.970862+0000","last_fullsized":"2024-09-15T22:43:37.970862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923809+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:43:03.923809+0000","last_peered":"2024-09-15T22:43:03.923809+0000","last_clean":"2024-09-15T22:43:03.923809+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:43:03.923809+0000","last_undegraded":"2024-09-15T22:43:03.923809+0000","last_fullsized":"2024-09-15T22:43:03.923809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924699+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:43:03.924699+0000","last_peered":"2024-09-15T22:43:03.924699+0000","last_clean":"2024-09-15T22:43:03.924699+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:43:03.924699+0000","last_undegraded":"2024-09-15T22:43:03.924699+0000","last_fullsized":"2024-09-15T22:43:03.924699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.944822+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:43:37.944822+0000","last_peered":"2024-09-15T22:43:37.944822+0000","last_clean":"2024-09-15T22:43:37.944822+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:43:37.944822+0000","last_undegraded":"2024-09-15T22:43:37.944822+0000","last_fullsized":"2024-09-15T22:43:37.944822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925057+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:43:03.925057+0000","last_peered":"2024-09-15T22:43:03.925057+0000","last_clean":"2024-09-15T22:43:03.925057+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:43:03.925057+0000","last_undegraded":"2024-09-15T22:43:03.925057+0000","last_fullsized":"2024-09-15T22:43:03.925057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925234+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:43:03.925234+0000","last_peered":"2024-09-15T22:43:03.925234+0000","last_clean":"2024-09-15T22:43:03.925234+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:43:03.925234+0000","last_undegraded":"2024-09-15T22:43:03.925234+0000","last_fullsized":"2024-09-15T22:43:03.925234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.971190+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:43:37.971190+0000","last_peered":"2024-09-15T22:43:37.971190+0000","last_clean":"2024-09-15T22:43:37.971190+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:43:37.971190+0000","last_undegraded":"2024-09-15T22:43:37.971190+0000","last_fullsized":"2024-09-15T22:43:37.971190+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833181+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:43:03.833181+0000","last_peered":"2024-09-15T22:43:03.833181+0000","last_clean":"2024-09-15T22:43:03.833181+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:43:03.833181+0000","last_undegraded":"2024-09-15T22:43:03.833181+0000","last_fullsized":"2024-09-15T22:43:03.833181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923071+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:43:03.923071+0000","last_peered":"2024-09-15T22:43:03.923071+0000","last_clean":"2024-09-15T22:43:03.923071+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:43:03.923071+0000","last_undegraded":"2024-09-15T22:43:03.923071+0000","last_fullsized":"2024-09-15T22:43:03.923071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:50.810302+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:43:50.810302+0000","last_peered":"2024-09-15T22:43:50.810302+0000","last_clean":"2024-09-15T22:43:50.810302+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:43:50.810302+0000","last_undegraded":"2024-09-15T22:43:50.810302+0000","last_fullsized":"2024-09-15T22:43:50.810302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.890087+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:43:03.890087+0000","last_peered":"2024-09-15T22:43:03.890087+0000","last_clean":"2024-09-15T22:43:03.890087+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:43:03.890087+0000","last_undegraded":"2024-09-15T22:43:03.890087+0000","last_fullsized":"2024-09-15T22:43:03.890087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923505+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:43:03.923505+0000","last_peered":"2024-09-15T22:43:03.923505+0000","last_clean":"2024-09-15T22:43:03.923505+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:43:03.923505+0000","last_undegraded":"2024-09-15T22:43:03.923505+0000","last_fullsized":"2024-09-15T22:43:03.923505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969945+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:43:37.969945+0000","last_peered":"2024-09-15T22:43:37.969945+0000","last_clean":"2024-09-15T22:43:37.969945+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:43:37.969945+0000","last_undegraded":"2024-09-15T22:43:37.969945+0000","last_fullsized":"2024-09-15T22:43:37.969945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925159+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:43:03.925159+0000","last_peered":"2024-09-15T22:43:03.925159+0000","last_clean":"2024-09-15T22:43:03.925159+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:43:03.925159+0000","last_undegraded":"2024-09-15T22:43:03.925159+0000","last_fullsized":"2024-09-15T22:43:03.925159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832894+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:43:03.832894+0000","last_peered":"2024-09-15T22:43:03.832894+0000","last_clean":"2024-09-15T22:43:03.832894+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:43:03.832894+0000","last_undegraded":"2024-09-15T22:43:03.832894+0000","last_fullsized":"2024-09-15T22:43:03.832894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:38.790862+0000","last_change":"2024-09-15T22:42:51.463562+0000","last_active":"2024-09-15T22:43:38.790862+0000","last_peered":"2024-09-15T22:43:38.790862+0000","last_clean":"2024-09-15T22:43:38.790862+0000","last_became_active":"2024-09-15T22:42:51.463223+0000","last_became_peered":"2024-09-15T22:42:51.463223+0000","last_unstale":"2024-09-15T22:43:38.790862+0000","last_undegraded":"2024-09-15T22:43:38.790862+0000","last_fullsized":"2024-09-15T22:43:38.790862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:16.228599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924713+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:43:03.924713+0000","last_peered":"2024-09-15T22:43:03.924713+0000","last_clean":"2024-09-15T22:43:03.924713+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:43:03.924713+0000","last_undegraded":"2024-09-15T22:43:03.924713+0000","last_fullsized":"2024-09-15T22:43:03.924713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924409+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:43:03.924409+0000","last_peered":"2024-09-15T22:43:03.924409+0000","last_clean":"2024-09-15T22:43:03.924409+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:43:03.924409+0000","last_undegraded":"2024-09-15T22:43:03.924409+0000","last_fullsized":"2024-09-15T22:43:03.924409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'27","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:47.808905+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:43:47.808905+0000","last_peered":"2024-09-15T22:43:47.808905+0000","last_clean":"2024-09-15T22:43:47.808905+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:43:47.808905+0000","last_undegraded":"2024-09-15T22:43:47.808905+0000","last_fullsized":"2024-09-15T22:43:47.808905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":55,"num_write":29,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889730+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:43:03.889730+0000","last_peered":"2024-09-15T22:43:03.889730+0000","last_clean":"2024-09-15T22:43:03.889730+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:43:03.889730+0000","last_undegraded":"2024-09-15T22:43:03.889730+0000","last_fullsized":"2024-09-15T22:43:03.889730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835500+0000","last_change":"2024-09-15T22:42:53.552514+0000","last_active":"2024-09-15T22:43:03.835500+0000","last_peered":"2024-09-15T22:43:03.835500+0000","last_clean":"2024-09-15T22:43:03.835500+0000","last_became_active":"2024-09-15T22:42:53.552169+0000","last_became_peered":"2024-09-15T22:42:53.552169+0000","last_unstale":"2024-09-15T22:43:03.835500+0000","last_undegraded":"2024-09-15T22:43:03.835500+0000","last_fullsized":"2024-09-15T22:43:03.835500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:37.174924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.961709+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:43:36.961709+0000","last_peered":"2024-09-15T22:43:36.961709+0000","last_clean":"2024-09-15T22:43:36.961709+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:43:36.961709+0000","last_undegraded":"2024-09-15T22:43:36.961709+0000","last_fullsized":"2024-09-15T22:43:36.961709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924190+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:43:03.924190+0000","last_peered":"2024-09-15T22:43:03.924190+0000","last_clean":"2024-09-15T22:43:03.924190+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:43:03.924190+0000","last_undegraded":"2024-09-15T22:43:03.924190+0000","last_fullsized":"2024-09-15T22:43:03.924190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923056+0000","last_change":"2024-09-15T22:42:53.548636+0000","last_active":"2024-09-15T22:43:03.923056+0000","last_peered":"2024-09-15T22:43:03.923056+0000","last_clean":"2024-09-15T22:43:03.923056+0000","last_became_active":"2024-09-15T22:42:53.548229+0000","last_became_peered":"2024-09-15T22:42:53.548229+0000","last_unstale":"2024-09-15T22:43:03.923056+0000","last_undegraded":"2024-09-15T22:43:03.923056+0000","last_fullsized":"2024-09-15T22:43:03.923056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.970822+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:43:37.970822+0000","last_peered":"2024-09-15T22:43:37.970822+0000","last_clean":"2024-09-15T22:43:37.970822+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:43:37.970822+0000","last_undegraded":"2024-09-15T22:43:37.970822+0000","last_fullsized":"2024-09-15T22:43:37.970822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889546+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:43:03.889546+0000","last_peered":"2024-09-15T22:43:03.889546+0000","last_clean":"2024-09-15T22:43:03.889546+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:43:03.889546+0000","last_undegraded":"2024-09-15T22:43:03.889546+0000","last_fullsized":"2024-09-15T22:43:03.889546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835616+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:43:03.835616+0000","last_peered":"2024-09-15T22:43:03.835616+0000","last_clean":"2024-09-15T22:43:03.835616+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:43:03.835616+0000","last_undegraded":"2024-09-15T22:43:03.835616+0000","last_fullsized":"2024-09-15T22:43:03.835616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:47.805781+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:43:47.805781+0000","last_peered":"2024-09-15T22:43:47.805781+0000","last_clean":"2024-09-15T22:43:47.805781+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:43:47.805781+0000","last_undegraded":"2024-09-15T22:43:47.805781+0000","last_fullsized":"2024-09-15T22:43:47.805781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923541+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:43:03.923541+0000","last_peered":"2024-09-15T22:43:03.923541+0000","last_clean":"2024-09-15T22:43:03.923541+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:43:03.923541+0000","last_undegraded":"2024-09-15T22:43:03.923541+0000","last_fullsized":"2024-09-15T22:43:03.923541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923160+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:43:03.923160+0000","last_peered":"2024-09-15T22:43:03.923160+0000","last_clean":"2024-09-15T22:43:03.923160+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:43:03.923160+0000","last_undegraded":"2024-09-15T22:43:03.923160+0000","last_fullsized":"2024-09-15T22:43:03.923160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.889574+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:43:03.889574+0000","last_peered":"2024-09-15T22:43:03.889574+0000","last_clean":"2024-09-15T22:43:03.889574+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:43:03.889574+0000","last_undegraded":"2024-09-15T22:43:03.889574+0000","last_fullsized":"2024-09-15T22:43:03.889574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:37.969363+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:43:37.969363+0000","last_peered":"2024-09-15T22:43:37.969363+0000","last_clean":"2024-09-15T22:43:37.969363+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:43:37.969363+0000","last_undegraded":"2024-09-15T22:43:37.969363+0000","last_fullsized":"2024-09-15T22:43:37.969363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924931+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:43:03.924931+0000","last_peered":"2024-09-15T22:43:03.924931+0000","last_clean":"2024-09-15T22:43:03.924931+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:43:03.924931+0000","last_undegraded":"2024-09-15T22:43:03.924931+0000","last_fullsized":"2024-09-15T22:43:03.924931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923600+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:43:03.923600+0000","last_peered":"2024-09-15T22:43:03.923600+0000","last_clean":"2024-09-15T22:43:03.923600+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:43:03.923600+0000","last_undegraded":"2024-09-15T22:43:03.923600+0000","last_fullsized":"2024-09-15T22:43:03.923600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:35.947760+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:43:35.947760+0000","last_peered":"2024-09-15T22:43:35.947760+0000","last_clean":"2024-09-15T22:43:35.947760+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:43:35.947760+0000","last_undegraded":"2024-09-15T22:43:35.947760+0000","last_fullsized":"2024-09-15T22:43:35.947760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:36.963521+0000","last_change":"2024-09-15T22:42:51.466199+0000","last_active":"2024-09-15T22:43:36.963521+0000","last_peered":"2024-09-15T22:43:36.963521+0000","last_clean":"2024-09-15T22:43:36.963521+0000","last_became_active":"2024-09-15T22:42:51.465819+0000","last_became_peered":"2024-09-15T22:42:51.465819+0000","last_unstale":"2024-09-15T22:43:36.963521+0000","last_undegraded":"2024-09-15T22:43:36.963521+0000","last_fullsized":"2024-09-15T22:43:36.963521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:22.225892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924721+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:43:03.924721+0000","last_peered":"2024-09-15T22:43:03.924721+0000","last_clean":"2024-09-15T22:43:03.924721+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:43:03.924721+0000","last_undegraded":"2024-09-15T22:43:03.924721+0000","last_fullsized":"2024-09-15T22:43:03.924721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833516+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:43:03.833516+0000","last_peered":"2024-09-15T22:43:03.833516+0000","last_clean":"2024-09-15T22:43:03.833516+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:43:03.833516+0000","last_undegraded":"2024-09-15T22:43:03.833516+0000","last_fullsized":"2024-09-15T22:43:03.833516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:49.809107+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:43:49.809107+0000","last_peered":"2024-09-15T22:43:49.809107+0000","last_clean":"2024-09-15T22:43:49.809107+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:43:49.809107+0000","last_undegraded":"2024-09-15T22:43:49.809107+0000","last_fullsized":"2024-09-15T22:43:49.809107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923850+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:43:03.923850+0000","last_peered":"2024-09-15T22:43:03.923850+0000","last_clean":"2024-09-15T22:43:03.923850+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:43:03.923850+0000","last_undegraded":"2024-09-15T22:43:03.923850+0000","last_fullsized":"2024-09-15T22:43:03.923850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833839+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:43:03.833839+0000","last_peered":"2024-09-15T22:43:03.833839+0000","last_clean":"2024-09-15T22:43:03.833839+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:43:03.833839+0000","last_undegraded":"2024-09-15T22:43:03.833839+0000","last_fullsized":"2024-09-15T22:43:03.833839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923492+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:43:03.923492+0000","last_peered":"2024-09-15T22:43:03.923492+0000","last_clean":"2024-09-15T22:43:03.923492+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:43:03.923492+0000","last_undegraded":"2024-09-15T22:43:03.923492+0000","last_fullsized":"2024-09-15T22:43:03.923492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833583+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:43:03.833583+0000","last_peered":"2024-09-15T22:43:03.833583+0000","last_clean":"2024-09-15T22:43:03.833583+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:43:03.833583+0000","last_undegraded":"2024-09-15T22:43:03.833583+0000","last_fullsized":"2024-09-15T22:43:03.833583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833266+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:43:03.833266+0000","last_peered":"2024-09-15T22:43:03.833266+0000","last_clean":"2024-09-15T22:43:03.833266+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:43:03.833266+0000","last_undegraded":"2024-09-15T22:43:03.833266+0000","last_fullsized":"2024-09-15T22:43:03.833266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922972+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:43:03.922972+0000","last_peered":"2024-09-15T22:43:03.922972+0000","last_clean":"2024-09-15T22:43:03.922972+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:43:03.922972+0000","last_undegraded":"2024-09-15T22:43:03.922972+0000","last_fullsized":"2024-09-15T22:43:03.922972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832888+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:43:03.832888+0000","last_peered":"2024-09-15T22:43:03.832888+0000","last_clean":"2024-09-15T22:43:03.832888+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:43:03.832888+0000","last_undegraded":"2024-09-15T22:43:03.832888+0000","last_fullsized":"2024-09-15T22:43:03.832888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925398+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:43:03.925398+0000","last_peered":"2024-09-15T22:43:03.925398+0000","last_clean":"2024-09-15T22:43:03.925398+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:43:03.925398+0000","last_undegraded":"2024-09-15T22:43:03.925398+0000","last_fullsized":"2024-09-15T22:43:03.925398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833927+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:43:03.833927+0000","last_peered":"2024-09-15T22:43:03.833927+0000","last_clean":"2024-09-15T22:43:03.833927+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:43:03.833927+0000","last_undegraded":"2024-09-15T22:43:03.833927+0000","last_fullsized":"2024-09-15T22:43:03.833927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924034+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:43:03.924034+0000","last_peered":"2024-09-15T22:43:03.924034+0000","last_clean":"2024-09-15T22:43:03.924034+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:43:03.924034+0000","last_undegraded":"2024-09-15T22:43:03.924034+0000","last_fullsized":"2024-09-15T22:43:03.924034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924032+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:43:03.924032+0000","last_peered":"2024-09-15T22:43:03.924032+0000","last_clean":"2024-09-15T22:43:03.924032+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:43:03.924032+0000","last_undegraded":"2024-09-15T22:43:03.924032+0000","last_fullsized":"2024-09-15T22:43:03.924032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923561+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:43:03.923561+0000","last_peered":"2024-09-15T22:43:03.923561+0000","last_clean":"2024-09-15T22:43:03.923561+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:43:03.923561+0000","last_undegraded":"2024-09-15T22:43:03.923561+0000","last_fullsized":"2024-09-15T22:43:03.923561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835384+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:43:03.835384+0000","last_peered":"2024-09-15T22:43:03.835384+0000","last_clean":"2024-09-15T22:43:03.835384+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:43:03.835384+0000","last_undegraded":"2024-09-15T22:43:03.835384+0000","last_fullsized":"2024-09-15T22:43:03.835384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832837+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:43:03.832837+0000","last_peered":"2024-09-15T22:43:03.832837+0000","last_clean":"2024-09-15T22:43:03.832837+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:43:03.832837+0000","last_undegraded":"2024-09-15T22:43:03.832837+0000","last_fullsized":"2024-09-15T22:43:03.832837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924848+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:43:03.924848+0000","last_peered":"2024-09-15T22:43:03.924848+0000","last_clean":"2024-09-15T22:43:03.924848+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:43:03.924848+0000","last_undegraded":"2024-09-15T22:43:03.924848+0000","last_fullsized":"2024-09-15T22:43:03.924848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.833963+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:43:03.833963+0000","last_peered":"2024-09-15T22:43:03.833963+0000","last_clean":"2024-09-15T22:43:03.833963+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:43:03.833963+0000","last_undegraded":"2024-09-15T22:43:03.833963+0000","last_fullsized":"2024-09-15T22:43:03.833963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.890064+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:43:03.890064+0000","last_peered":"2024-09-15T22:43:03.890064+0000","last_clean":"2024-09-15T22:43:03.890064+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:43:03.890064+0000","last_undegraded":"2024-09-15T22:43:03.890064+0000","last_fullsized":"2024-09-15T22:43:03.890064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925281+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:43:03.925281+0000","last_peered":"2024-09-15T22:43:03.925281+0000","last_clean":"2024-09-15T22:43:03.925281+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:43:03.925281+0000","last_undegraded":"2024-09-15T22:43:03.925281+0000","last_fullsized":"2024-09-15T22:43:03.925281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835020+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:43:03.835020+0000","last_peered":"2024-09-15T22:43:03.835020+0000","last_clean":"2024-09-15T22:43:03.835020+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:43:03.835020+0000","last_undegraded":"2024-09-15T22:43:03.835020+0000","last_fullsized":"2024-09-15T22:43:03.835020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922782+0000","last_change":"2024-09-15T22:42:53.550831+0000","last_active":"2024-09-15T22:43:03.922782+0000","last_peered":"2024-09-15T22:43:03.922782+0000","last_clean":"2024-09-15T22:43:03.922782+0000","last_became_active":"2024-09-15T22:42:53.550486+0000","last_became_peered":"2024-09-15T22:42:53.550486+0000","last_unstale":"2024-09-15T22:43:03.922782+0000","last_undegraded":"2024-09-15T22:43:03.922782+0000","last_fullsized":"2024-09-15T22:43:03.922782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:53:44.502057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922723+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:43:03.922723+0000","last_peered":"2024-09-15T22:43:03.922723+0000","last_clean":"2024-09-15T22:43:03.922723+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:43:03.922723+0000","last_undegraded":"2024-09-15T22:43:03.922723+0000","last_fullsized":"2024-09-15T22:43:03.922723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.832832+0000","last_change":"2024-09-15T22:42:53.539288+0000","last_active":"2024-09-15T22:43:03.832832+0000","last_peered":"2024-09-15T22:43:03.832832+0000","last_clean":"2024-09-15T22:43:03.832832+0000","last_became_active":"2024-09-15T22:42:53.538831+0000","last_became_peered":"2024-09-15T22:42:53.538831+0000","last_unstale":"2024-09-15T22:43:03.832832+0000","last_undegraded":"2024-09-15T22:43:03.832832+0000","last_fullsized":"2024-09-15T22:43:03.832832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:55.922398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924490+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:43:03.924490+0000","last_peered":"2024-09-15T22:43:03.924490+0000","last_clean":"2024-09-15T22:43:03.924490+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:43:03.924490+0000","last_undegraded":"2024-09-15T22:43:03.924490+0000","last_fullsized":"2024-09-15T22:43:03.924490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924334+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:43:03.924334+0000","last_peered":"2024-09-15T22:43:03.924334+0000","last_clean":"2024-09-15T22:43:03.924334+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:43:03.924334+0000","last_undegraded":"2024-09-15T22:43:03.924334+0000","last_fullsized":"2024-09-15T22:43:03.924334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925042+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:43:03.925042+0000","last_peered":"2024-09-15T22:43:03.925042+0000","last_clean":"2024-09-15T22:43:03.925042+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:43:03.925042+0000","last_undegraded":"2024-09-15T22:43:03.925042+0000","last_fullsized":"2024-09-15T22:43:03.925042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.835758+0000","last_change":"2024-09-15T22:42:53.545411+0000","last_active":"2024-09-15T22:43:03.835758+0000","last_peered":"2024-09-15T22:43:03.835758+0000","last_clean":"2024-09-15T22:43:03.835758+0000","last_became_active":"2024-09-15T22:42:53.545102+0000","last_became_peered":"2024-09-15T22:42:53.545102+0000","last_unstale":"2024-09-15T22:43:03.835758+0000","last_undegraded":"2024-09-15T22:43:03.835758+0000","last_fullsized":"2024-09-15T22:43:03.835758+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:13.364426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923480+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:43:03.923480+0000","last_peered":"2024-09-15T22:43:03.923480+0000","last_clean":"2024-09-15T22:43:03.923480+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:43:03.923480+0000","last_undegraded":"2024-09-15T22:43:03.923480+0000","last_fullsized":"2024-09-15T22:43:03.923480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923275+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:43:03.923275+0000","last_peered":"2024-09-15T22:43:03.923275+0000","last_clean":"2024-09-15T22:43:03.923275+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:43:03.923275+0000","last_undegraded":"2024-09-15T22:43:03.923275+0000","last_fullsized":"2024-09-15T22:43:03.923275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924585+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:43:03.924585+0000","last_peered":"2024-09-15T22:43:03.924585+0000","last_clean":"2024-09-15T22:43:03.924585+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:43:03.924585+0000","last_undegraded":"2024-09-15T22:43:03.924585+0000","last_fullsized":"2024-09-15T22:43:03.924585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.923716+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:43:03.923716+0000","last_peered":"2024-09-15T22:43:03.923716+0000","last_clean":"2024-09-15T22:43:03.923716+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:43:03.923716+0000","last_undegraded":"2024-09-15T22:43:03.923716+0000","last_fullsized":"2024-09-15T22:43:03.923716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.924381+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:43:03.924381+0000","last_peered":"2024-09-15T22:43:03.924381+0000","last_clean":"2024-09-15T22:43:03.924381+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:43:03.924381+0000","last_undegraded":"2024-09-15T22:43:03.924381+0000","last_fullsized":"2024-09-15T22:43:03.924381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922875+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:43:03.922875+0000","last_peered":"2024-09-15T22:43:03.922875+0000","last_clean":"2024-09-15T22:43:03.922875+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:43:03.922875+0000","last_undegraded":"2024-09-15T22:43:03.922875+0000","last_fullsized":"2024-09-15T22:43:03.922875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.922992+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:43:03.922992+0000","last_peered":"2024-09-15T22:43:03.922992+0000","last_clean":"2024-09-15T22:43:03.922992+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:43:03.922992+0000","last_undegraded":"2024-09-15T22:43:03.922992+0000","last_fullsized":"2024-09-15T22:43:03.922992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T22:43:03.925188+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:43:03.925188+0000","last_peered":"2024-09-15T22:43:03.925188+0000","last_clean":"2024-09-15T22:43:03.925188+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:43:03.925188+0000","last_undegraded":"2024-09-15T22:43:03.925188+0000","last_fullsized":"2024-09-15T22:43:03.925188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50160,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":129,"num_write":231,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":168606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":473376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841564,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1103537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005090,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":477402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":473684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1070183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":469203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1065372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":472884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":468518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":522468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":522641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":45081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:43:55.077 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:43:55.078 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T22:43:55.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T22:43:55.336 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:55.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 -- 172.21.15.66:0/1860558058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8102690 msgr2=0x7f7cd8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:55.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 --2- 172.21.15.66:0/1860558058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8102690 0x7f7cd8108f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009ca0 tx=0x7f7cd002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 -- 172.21.15.66:0/1860558058 shutdown_connections 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 --2- 172.21.15.66:0/1860558058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8102690 0x7f7cd8108f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 --2- 172.21.15.66:0/1860558058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8101cd0 0x7f7cd8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 --2- 172.21.15.66:0/1860558058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 0x7f7cd8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 -- 172.21.15.66:0/1860558058 >> 172.21.15.66:0/1860558058 conn(0x7f7cd80fc280 msgr2=0x7f7cd80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 -- 172.21.15.66:0/1860558058 shutdown_connections 2024-09-15T22:43:55.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.829+0000 7f7cde40b640 1 -- 172.21.15.66:0/1860558058 wait complete. 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 Processor -- start 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 -- start start 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 0x7f7cd8104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8102690 0x7f7cd81035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810c750 con 0x7f7cd8101cd0 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810c5d0 con 0x7f7cd8100ad0 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.830+0000 7f7cde40b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd810c8d0 con 0x7f7cd8102690 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34032/0 (socket says 172.21.15.66:34032) 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 -- 172.21.15.66:0/642485905 learned_addr learned my addr 172.21.15.66:0/642485905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd7fff640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 0x7f7cd8104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cdc9a8640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8102690 0x7f7cd81035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 -- 172.21.15.66:0/642485905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8102690 msgr2=0x7f7cd81035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8102690 0x7f7cd81035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 -- 172.21.15.66:0/642485905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 msgr2=0x7f7cd8104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 0x7f7cd8104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 -- 172.21.15.66:0/642485905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd8103b30 con 0x7f7cd8101cd0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd77fe640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00d770 tx=0x7f7ccc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc017070 con 0x7f7cd8101cd0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ccc005500 con 0x7f7cd8101cd0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd8103e20 con 0x7f7cd8101cd0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc004e00 con 0x7f7cd8101cd0 2024-09-15T22:43:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.831+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd81a6970 con 0x7f7cd8101cd0 2024-09-15T22:43:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.833+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd8100ed0 con 0x7f7cd8101cd0 2024-09-15T22:43:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.834+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7ccc004fa0 con 0x7f7cd8101cd0 2024-09-15T22:43:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.834+0000 7f7cd57fa640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 0x7f7cc00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.835+0000 7f7cd7fff640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 0x7f7cc00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.835+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f7ccc0cf5f0 con 0x7f7cd8101cd0 2024-09-15T22:43:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.835+0000 7f7cd7fff640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 0x7f7cc00a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8101b30 tx=0x7f7cc800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:55.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:55.839+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ccc09b920 con 0x7f7cd8101cd0 2024-09-15T22:43:56.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.082+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7cd81a6e20 con 0x7f7cd8101cd0 2024-09-15T22:43:56.084 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:55 smithi066 ceph-mon[31185]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:56.084 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:55 smithi066 ceph-mon[31185]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-15T22:43:56.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.085+0000 7f7cd57fa640 1 -- 172.21.15.66:0/642485905 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f7ccc09fc20 con 0x7f7cd8101cd0 2024-09-15T22:43:56.089 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-09-15T22:43:56.089 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAsY+dm/Vf+BBAAKVj5ej5y/qxel2Ce7Kzrbw== 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 msgr2=0x7f7cc00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 0x7f7cc00a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8101b30 tx=0x7f7cc800b390 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 msgr2=0x7f7cd81030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00d770 tx=0x7f7ccc00dc30 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 shutdown_connections 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cd8102690 0x7f7cd81035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8101cd0 0x7f7cd81030b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7cc00a3350 0x7f7cc00a5810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 --2- 172.21.15.66:0/642485905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd8100ad0 0x7f7cd8104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 >> 172.21.15.66:0/642485905 conn(0x7f7cd80fc280 msgr2=0x7f7cd80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 shutdown_connections 2024-09-15T22:43:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:56.088+0000 7f7cde40b640 1 -- 172.21.15.66:0/642485905 wait complete. 2024-09-15T22:43:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:55 smithi087 ceph-mon[35290]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:55 smithi087 ceph-mon[35290]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-15T22:43:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:55 smithi184 ceph-mon[35203]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:43:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:55 smithi184 ceph-mon[35203]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-15T22:43:56.837 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:43:56.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T22:43:56.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:43:56.876 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:43:56.876 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:43:56.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T22:43:57.176 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:57.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:43:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:43:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:43:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:43:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:43:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/642485905' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 -- 172.21.15.66:0/473680155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b60103660 msgr2=0x7f4b6010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/473680155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b60103660 0x7f4b6010bb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009900 tx=0x7f4b5402a480 comp rx=0 tx=0).stop 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 -- 172.21.15.66:0/473680155 shutdown_connections 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/473680155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b6010c170 0x7f4b6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/473680155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b60103660 0x7f4b6010bb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/473680155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 0x7f4b60103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 -- 172.21.15.66:0/473680155 >> 172.21.15.66:0/473680155 conn(0x7f4b600fc7a0 msgr2=0x7f4b600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 -- 172.21.15.66:0/473680155 shutdown_connections 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.698+0000 7f4b64f6f640 1 -- 172.21.15.66:0/473680155 wait complete. 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 Processor -- start 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 -- start start 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 0x7f4b601984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b60103660 0x7f4b601989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60111fd0 con 0x7f4b6010c170 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60111e50 con 0x7f4b60103660 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b64f6f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112150 con 0x7f4b60102d40 2024-09-15T22:43:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b5ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b5ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34044/0 (socket says 172.21.15.66:34044) 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b5ed9d640 1 -- 172.21.15.66:0/3441420612 learned_addr learned my addr 172.21.15.66:0/3441420612 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b5e59c640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 0x7f4b601984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.699+0000 7f4b5dd9b640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b60103660 0x7f4b601989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 -- 172.21.15.66:0/3441420612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 msgr2=0x7f4b601984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 0x7f4b601984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 -- 172.21.15.66:0/3441420612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b60103660 msgr2=0x7f4b601989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b60103660 0x7f4b601989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 -- 172.21.15.66:0/3441420612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6019d450 con 0x7f4b6010c170 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b5ed9d640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009fd0 tx=0x7f4b5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011830 con 0x7f4b6010c170 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b58016070 con 0x7f4b6010c170 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6019d740 con 0x7f4b6010c170 2024-09-15T22:43:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800f2e0 con 0x7f4b6010c170 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.700+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601a5020 con 0x7f4b6010c170 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.701+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b60103120 con 0x7f4b6010c170 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.702+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b580119d0 con 0x7f4b6010c170 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.703+0000 7f4b4f7fe640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.703+0000 7f4b5e59c640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.703+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f4b580cf1d0 con 0x7f4b6010c170 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.704+0000 7f4b5e59c640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 0x7f4b480a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005fd0 tx=0x7f4b50009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.708+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b5809bc60 con 0x7f4b6010c170 2024-09-15T22:43:57.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.934+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4b60107240 con 0x7f4b6010c170 2024-09-15T22:43:57.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.939+0000 7f4b4f7fe640 1 -- 172.21.15.66:0/3441420612 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7f4b5809b560 con 0x7f4b6010c170 2024-09-15T22:43:57.944 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 msgr2=0x7f4b480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 0x7f4b480a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005fd0 tx=0x7f4b50009680 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 msgr2=0x7f4b6019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009fd0 tx=0x7f4b5800b8e0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 shutdown_connections 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b6010c170 0x7f4b6019cd70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b480a32d0 0x7f4b480a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b60103660 0x7f4b601989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 --2- 172.21.15.66:0/3441420612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b60102d40 0x7f4b601984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.942+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 >> 172.21.15.66:0/3441420612 conn(0x7f4b600fc7a0 msgr2=0x7f4b600fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:57.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.943+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 shutdown_connections 2024-09-15T22:43:57.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:57.943+0000 7f4b64f6f640 1 -- 172.21.15.66:0/3441420612 wait complete. 2024-09-15T22:43:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:58 smithi066 ceph-mon[31185]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-15T22:43:58.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:43:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3441420612' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:43:58.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:58 smithi087 ceph-mon[35290]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-15T22:43:58.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:43:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3441420612' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:43:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:58 smithi184 ceph-mon[35203]: pgmap v313: 129 pgs: 129 active+clean; 635 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-15T22:43:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:43:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3441420612' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:43:58.651 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1080608797},{"type":"v1","addr":"172.21.15.66:6801","nonce":1080608797}]},"active_addr":"172.21.15.66:6801/1080608797","active_change":"2024-09-15T22:36:00.281636+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.66:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":2430511108}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3471066820}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3964165811}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3162528820}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":808606198}]}]} 2024-09-15T22:43:58.657 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T22:43:58.657 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T22:43:58.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:43:58.917 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:43:59.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 -- 172.21.15.66:0/3209694867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 msgr2=0x7f8ba810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:59.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 --2- 172.21.15.66:0/3209694867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba810ea90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ca0 tx=0x7f8ba002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 -- 172.21.15.66:0/3209694867 shutdown_connections 2024-09-15T22:43:59.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 --2- 172.21.15.66:0/3209694867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba810ea90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 --2- 172.21.15.66:0/3209694867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8102790 0x7f8ba81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 --2- 172.21.15.66:0/3209694867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8101de0 0x7f8ba81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 -- 172.21.15.66:0/3209694867 >> 172.21.15.66:0/3209694867 conn(0x7f8ba80fd8c0 msgr2=0x7f8ba80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 -- 172.21.15.66:0/3209694867 shutdown_connections 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.381+0000 7f8baf304640 1 -- 172.21.15.66:0/3209694867 wait complete. 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 Processor -- start 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 -- start start 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 0x7f8ba80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 0x7f8ba8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8111f90 con 0x7f8ba8106f10 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8111e10 con 0x7f8ba8102790 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8baf304640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8112110 con 0x7f8ba8101de0 2024-09-15T22:43:59.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8bad8a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8bad8a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34066/0 (socket says 172.21.15.66:34066) 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.382+0000 7f8bad8a1640 1 -- 172.21.15.66:0/3899015945 learned_addr learned my addr 172.21.15.66:0/3899015945 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bac89f640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 0x7f8ba8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad0a0640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 0x7f8ba80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 -- 172.21.15.66:0/3899015945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 msgr2=0x7f8ba80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 0x7f8ba80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 -- 172.21.15.66:0/3899015945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 msgr2=0x7f8ba8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 0x7f8ba8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 -- 172.21.15.66:0/3899015945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba81aaf00 con 0x7f8ba8106f10 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad0a0640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 0x7f8ba80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bac89f640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 0x7f8ba8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8bad8a1640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0031a20 tx=0x7f8ba0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:59.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0003c30 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba0003dd0 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba81ab0d0 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba002fcf0 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.383+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba81ab610 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.384+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba81021c0 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.385+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8ba0004050 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.386+0000 7f8b9a7fc640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 0x7f8b940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.386+0000 7f8bad0a0640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 0x7f8b940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.387+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f8ba00f1020 con 0x7f8ba8106f10 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.387+0000 7f8bad0a0640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 0x7f8b940a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009b40 tx=0x7f8ba4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:43:59.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.390+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ba00bdb40 con 0x7f8ba8106f10 2024-09-15T22:43:59.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.566+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba810a150 con 0x7f8ba8106f10 2024-09-15T22:43:59.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.568+0000 7f8b9a7fc640 1 -- 172.21.15.66:0/3899015945 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24166 (secure 0 0 0) 0x7f8ba002fe90 con 0x7f8ba8106f10 2024-09-15T22:43:59.573 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:43:59.573 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":85,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:43:03.533035+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 msgr2=0x7f8b940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 0x7f8b940a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009b40 tx=0x7f8ba4005e50 comp rx=0 tx=0).stop 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 msgr2=0x7f8ba8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0031a20 tx=0x7f8ba0031a50 comp rx=0 tx=0).stop 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 shutdown_connections 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ba8106f10 0x7f8ba8074f70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8b940a32d0 0x7f8b940a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba8102790 0x7f8ba8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 --2- 172.21.15.66:0/3899015945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba8101de0 0x7f8ba80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:43:59.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 >> 172.21.15.66:0/3899015945 conn(0x7f8ba80fd8c0 msgr2=0x7f8ba80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:43:59.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 shutdown_connections 2024-09-15T22:43:59.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:43:59.571+0000 7f8baf304640 1 -- 172.21.15.66:0/3899015945 wait complete. 2024-09-15T22:44:00.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:00 smithi066 ceph-mon[31185]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-15T22:44:00.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:00 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3899015945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:00.258 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T22:44:00.258 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:44:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:00 smithi087 ceph-mon[35290]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-15T22:44:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:00 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3899015945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:00 smithi184 ceph-mon[35203]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-15T22:44:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:00 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3899015945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:00.514 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:01.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- 172.21.15.66:0/1919138134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1036e0 msgr2=0x7f017c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:01.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 --2- 172.21.15.66:0/1919138134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1036e0 0x7f017c107b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0170009930 tx=0x7f017002a420 comp rx=0 tx=0).stop 2024-09-15T22:44:01.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- 172.21.15.66:0/1919138134 shutdown_connections 2024-09-15T22:44:01.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 --2- 172.21.15.66:0/1919138134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1082a0 0x7f017c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 --2- 172.21.15.66:0/1919138134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1036e0 0x7f017c107b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 --2- 172.21.15.66:0/1919138134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 0x7f017c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- 172.21.15.66:0/1919138134 >> 172.21.15.66:0/1919138134 conn(0x7f017c0fc7d0 msgr2=0x7f017c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- 172.21.15.66:0/1919138134 shutdown_connections 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- 172.21.15.66:0/1919138134 wait complete. 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 Processor -- start 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.014+0000 7f0183c6e640 1 -- start start 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 0x7f017c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1036e0 0x7f017c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f017c1120c0 con 0x7f017c1082a0 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f017c111f40 con 0x7f017c102d30 2024-09-15T22:44:01.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0183c6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f017c112240 con 0x7f017c1036e0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34094/0 (socket says 172.21.15.66:34094) 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 -- 172.21.15.66:0/3016750891 learned_addr learned my addr 172.21.15.66:0/3016750891 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0181209640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1036e0 0x7f017c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f0181a0a640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 0x7f017c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 -- 172.21.15.66:0/3016750891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1036e0 msgr2=0x7f017c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1036e0 0x7f017c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 -- 172.21.15.66:0/3016750891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 msgr2=0x7f017c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 0x7f017c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 -- 172.21.15.66:0/3016750891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c19d570 con 0x7f017c1082a0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f018220b640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0174009fd0 tx=0x7f017400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.015+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174011830 con 0x7f017c1082a0 2024-09-15T22:44:01.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.016+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c19d860 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.016+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0174016070 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.016+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017400f2e0 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.016+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c1a5140 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.017+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c103110 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.018+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01740119d0 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.019+0000 7f017affd640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 0x7f01640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.019+0000 7f0181a0a640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 0x7f01640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.019+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f01740cf300 con 0x7f017c1082a0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.019+0000 7f0181a0a640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 0x7f01640a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f016c007350 tx=0x7f016c0072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:01.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.023+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f017409bd90 con 0x7f017c1082a0 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T22:44:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-09-15T22:44:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.205+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f017c10a2b0 con 0x7f017c1082a0 2024-09-15T22:44:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.206+0000 7f017affd640 1 -- 172.21.15.66:0/3016750891 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24664 (secure 0 0 0) 0x7f017409b690 con 0x7f017c1082a0 2024-09-15T22:44:01.208 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:01.208 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":86,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:44:01.091697+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 msgr2=0x7f01640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 0x7f01640a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f016c007350 tx=0x7f016c0072e0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 msgr2=0x7f017c19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0174009fd0 tx=0x7f017400b8e0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 shutdown_connections 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f017c1082a0 0x7f017c19ce90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f017c1036e0 0x7f017c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f01640a32d0 0x7f01640a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 --2- 172.21.15.66:0/3016750891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f017c102d30 0x7f017c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:01.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.208+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 >> 172.21.15.66:0/3016750891 conn(0x7f017c0fc7d0 msgr2=0x7f017c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:01.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.209+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 shutdown_connections 2024-09-15T22:44:01.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:01.209+0000 7f0183c6e640 1 -- 172.21.15.66:0/3016750891 wait complete. 2024-09-15T22:44:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-15T22:44:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T22:44:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-09-15T22:44:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-15T22:44:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-15T22:44:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-15T22:44:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-15T22:44:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-15T22:44:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-15T22:44:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-15T22:44:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T22:44:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]: dispatch 2024-09-15T22:44:01.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T22:44:01.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T22:44:01.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T22:44:01.805 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T22:44:01.805 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T22:44:01.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T22:44:01.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T22:44:01.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T22:44:01.807 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T22:44:01.807 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T22:44:01.808 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T22:44:01.808 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T22:44:02.113 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:44:02.113 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:44:02.114 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:02 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3016750891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:44:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-15T22:44:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-15T22:44:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:44:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:02 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3016750891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-15T22:44:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-15T22:44:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-15T22:44:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:44:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:02 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3016750891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:02.628 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.629 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.630 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.630 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.630 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.635 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.635 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.640 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.644 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.648 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.648 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:02.720 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:03.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:03 smithi066 ceph-mon[31185]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:44:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:03 smithi184 ceph-mon[35203]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:44:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:03 smithi087 ceph-mon[35290]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:44:04.229 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:04 smithi066 ceph-mon[31185]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-15T22:44:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:04 smithi184 ceph-mon[35203]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-15T22:44:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:04 smithi087 ceph-mon[35290]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 -- 172.21.15.66:0/1440014292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 msgr2=0x7fd6b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1440014292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81067e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009900 tx=0x7fd6a802a410 comp rx=0 tx=0).stop 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 -- 172.21.15.66:0/1440014292 shutdown_connections 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1440014292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 0x7fd6b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1440014292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81067e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1440014292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b8101de0 0x7fd6b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 -- 172.21.15.66:0/1440014292 >> 172.21.15.66:0/1440014292 conn(0x7fd6b80fd8c0 msgr2=0x7fd6b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 -- 172.21.15.66:0/1440014292 shutdown_connections 2024-09-15T22:44:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.637+0000 7fd6bede2640 1 -- 172.21.15.66:0/1440014292 wait complete. 2024-09-15T22:44:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 Processor -- start 2024-09-15T22:44:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 -- start start 2024-09-15T22:44:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b8101de0 0x7fd6b8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 0x7fd6b819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111f70 con 0x7fd6b8102790 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111df0 con 0x7fd6b8101de0 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bede2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b81120f0 con 0x7fd6b8106f10 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6affff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50516/0 (socket says 172.21.15.66:50516) 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6affff640 1 -- 172.21.15.66:0/1204527908 learned_addr learned my addr 172.21.15.66:0/1204527908 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:04.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.638+0000 7fd6bcb7e640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b8101de0 0x7fd6b8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6bd37f640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 0x7fd6b819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 -- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 msgr2=0x7fd6b819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 0x7fd6b819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 -- 172.21.15.66:0/1204527908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b8101de0 msgr2=0x7fd6b8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b8101de0 0x7fd6b8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b819d410 con 0x7fd6b8102790 2024-09-15T22:44:04.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6bd37f640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6b8106f10 0x7fd6b819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6affff640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81989a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006010 tx=0x7fd6a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a803f030 con 0x7fd6b8102790 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a8003ce0 con 0x7fd6b8102790 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b819d6a0 con 0x7fd6b8102790 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8035070 con 0x7fd6b8102790 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.639+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b81a4fe0 con 0x7fd6b8102790 2024-09-15T22:44:04.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.640+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b8062980 con 0x7fd6b8102790 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.641+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd6a8042030 con 0x7fd6b8102790 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6adffb640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd6a00a32d0 0x7fd6a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6bcb7e640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd6a00a32d0 0x7fd6a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fd6a80f0a40 con 0x7fd6b8102790 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6adffb640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] conn(0x7fd6a00ae420 0x7fd6a00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6a8040e70 con 0x7fd6a00ae420 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.642+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd6a80f0e90 con 0x7fd6b8102790 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.643+0000 7fd6bcb7e640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd6a00a32d0 0x7fd6a00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400bbe0 tx=0x7fd6b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.643+0000 7fd6bd37f640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] conn(0x7fd6a00ae420 0x7fd6a00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.643+0000 7fd6bd37f640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] conn(0x7fd6a00ae420 0x7fd6a00b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.644+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== osd.8 v2:172.21.15.184:6816/2711654009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6a8040e70 con 0x7fd6a00ae420 2024-09-15T22:44:04.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.658+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 --> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6b8062e00 con 0x7fd6a00ae420 2024-09-15T22:44:04.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.658+0000 7fd6adffb640 1 -- 172.21.15.66:0/1204527908 <== osd.8 v2:172.21.15.184:6816/2711654009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd6b8062e00 con 0x7fd6a00ae420 2024-09-15T22:44:04.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] conn(0x7fd6a00ae420 msgr2=0x7fd6a00b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] conn(0x7fd6a00ae420 0x7fd6a00b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd6a00a32d0 msgr2=0x7fd6a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd6a00a32d0 0x7fd6a00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400bbe0 tx=0x7fd6b400b390 comp rx=0 tx=0).stop 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 msgr2=0x7fd6b81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 --2- 172.21.15.66:0/1204527908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6b8102790 0x7fd6b81989a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006010 tx=0x7fd6a80042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bd37f640 1 -- 172.21.15.66:0/1204527908 reap_dead start 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 shutdown_connections 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 >> 172.21.15.66:0/1204527908 conn(0x7fd6b80fd8c0 msgr2=0x7fd6b80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 shutdown_connections 2024-09-15T22:44:04.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.659+0000 7fd6bede2640 1 -- 172.21.15.66:0/1204527908 wait complete. 2024-09-15T22:44:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 -- 172.21.15.66:0/3764521428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400106a80 msgr2=0x7f7400106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 --2- 172.21.15.66:0/3764521428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400106a80 0x7f7400106e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009930 tx=0x7f73fc02a420 comp rx=0 tx=0).stop 2024-09-15T22:44:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 -- 172.21.15.66:0/3764521428 shutdown_connections 2024-09-15T22:44:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 --2- 172.21.15.66:0/3764521428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7400101420 0x7f740010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 --2- 172.21.15.66:0/3764521428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7400100a80 0x7f7400100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 --2- 172.21.15.66:0/3764521428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400106a80 0x7f7400106e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 -- 172.21.15.66:0/3764521428 >> 172.21.15.66:0/3764521428 conn(0x7f74000fc7a0 msgr2=0x7f74000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:04.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 -- 172.21.15.66:0/3764521428 shutdown_connections 2024-09-15T22:44:04.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.840+0000 7f7407ef1640 1 -- 172.21.15.66:0/3764521428 wait complete. 2024-09-15T22:44:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 Processor -- start 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 -- start start 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 0x7f74001992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7400101420 0x7f7400199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7400106a80 0x7f74001a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7400110e80 con 0x7f7400100a80 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7400110d00 con 0x7f7400106a80 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7407ef1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7400111000 con 0x7f7400101420 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7405c8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 0x7f74001992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7405c8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 0x7f74001992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50536/0 (socket says 172.21.15.66:50536) 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f7405c8d640 1 -- 172.21.15.66:0/822412670 learned_addr learned my addr 172.21.15.66:0/822412670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f740648e640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7400106a80 0x7f74001a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.841+0000 7f740548c640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7400101420 0x7f7400199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 -- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7400101420 msgr2=0x7f7400199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7400101420 0x7f7400199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 -- 172.21.15.66:0/822412670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7400106a80 msgr2=0x7f74001a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7400106a80 0x7f74001a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74001a48b0 con 0x7f7400100a80 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7405c8d640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 0x7f74001992f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009230 tx=0x7f73fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc03f030 con 0x7f7400100a80 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73fc003ad0 con 0x7f7400100a80 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74001a4a80 con 0x7f7400100a80 2024-09-15T22:44:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.842+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74001a4f30 con 0x7f7400100a80 2024-09-15T22:44:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.843+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc035070 con 0x7f7400100a80 2024-09-15T22:44:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.843+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73e4001030 con 0x7f7400100a80 2024-09-15T22:44:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.845+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f73fc042030 con 0x7f7400100a80 2024-09-15T22:44:04.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f73f6ffd640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f73ec0a3350 0x7f73ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f740548c640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f73ec0a3350 0x7f73ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f73fc0f0560 con 0x7f7400100a80 2024-09-15T22:44:04.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f73f6ffd640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] conn(0x7f73ec0ae4a0 0x7f73ec0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:04.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73ec0b1010 con 0x7f73ec0ae4a0 2024-09-15T22:44:04.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.846+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f73fc0f09b0 con 0x7f7400100a80 2024-09-15T22:44:04.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.847+0000 7f740648e640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] conn(0x7f73ec0ae4a0 0x7f73ec0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:04.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.847+0000 7f740548c640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f73ec0a3350 0x7f73ec0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f740006b2e0 tx=0x7f73f000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.847+0000 7f740648e640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] conn(0x7f73ec0ae4a0 0x7f73ec0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:04.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.848+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== osd.11 v2:172.21.15.184:6824/848932004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73ec0b1010 con 0x7f73ec0ae4a0 2024-09-15T22:44:04.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.862+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 --> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73e4002dd0 con 0x7f73ec0ae4a0 2024-09-15T22:44:04.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.862+0000 7f73f6ffd640 1 -- 172.21.15.66:0/822412670 <== osd.11 v2:172.21.15.184:6824/848932004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f73e4002dd0 con 0x7f73ec0ae4a0 2024-09-15T22:44:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] conn(0x7f73ec0ae4a0 msgr2=0x7f73ec0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] conn(0x7f73ec0ae4a0 0x7f73ec0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f73ec0a3350 msgr2=0x7f73ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f73ec0a3350 0x7f73ec0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f740006b2e0 tx=0x7f73f000a4c0 comp rx=0 tx=0).stop 2024-09-15T22:44:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 msgr2=0x7f74001992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 --2- 172.21.15.66:0/822412670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7400100a80 0x7f74001992f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009230 tx=0x7f73fc004270 comp rx=0 tx=0).stop 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f740648e640 1 -- 172.21.15.66:0/822412670 reap_dead start 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 shutdown_connections 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 >> 172.21.15.66:0/822412670 conn(0x7f74000fc7a0 msgr2=0x7f74000fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 shutdown_connections 2024-09-15T22:44:04.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:04.863+0000 7f7407ef1640 1 -- 172.21.15.66:0/822412670 wait complete. 2024-09-15T22:44:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:05 smithi184 ceph-mon[35203]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-15T22:44:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:05 smithi066 ceph-mon[31185]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-15T22:44:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:05 smithi087 ceph-mon[35290]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-15T22:44:06.181 INFO:teuthology.orchestra.run.smithi066.stdout:313532612636 2024-09-15T22:44:06.181 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T22:44:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 -- 172.21.15.66:0/1595071702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 msgr2=0x7f9e54107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 --2- 172.21.15.66:0/1595071702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54107bc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009930 tx=0x7f9e4402a420 comp rx=0 tx=0).stop 2024-09-15T22:44:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 -- 172.21.15.66:0/1595071702 shutdown_connections 2024-09-15T22:44:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 --2- 172.21.15.66:0/1595071702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e54108300 0x7f9e5410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 --2- 172.21.15.66:0/1595071702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54107bc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 --2- 172.21.15.66:0/1595071702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54102dd0 0x7f9e541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 -- 172.21.15.66:0/1595071702 >> 172.21.15.66:0/1595071702 conn(0x7f9e540fc7d0 msgr2=0x7f9e540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 -- 172.21.15.66:0/1595071702 shutdown_connections 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.361+0000 7f9e5c244640 1 -- 172.21.15.66:0/1595071702 wait complete. 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 Processor -- start 2024-09-15T22:44:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 -- start start 2024-09-15T22:44:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54102dd0 0x7f9e541985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e54108300 0x7f9e5419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54112070 con 0x7f9e54103780 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54111ef0 con 0x7f9e54108300 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.362+0000 7f9e5c244640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541121f0 con 0x7f9e54102dd0 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50560/0 (socket says 172.21.15.66:50560) 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 -- 172.21.15.66:0/3201942872 learned_addr learned my addr 172.21.15.66:0/3201942872 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e59fe0640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54102dd0 0x7f9e541985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e5a7e1640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e54108300 0x7f9e5419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 -- 172.21.15.66:0/3201942872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54102dd0 msgr2=0x7f9e541985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e54102dd0 0x7f9e541985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 -- 172.21.15.66:0/3201942872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e54108300 msgr2=0x7f9e5419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e54108300 0x7f9e5419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419d5a0 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e597df640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54198b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005940 tx=0x7f9e440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.363+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4403f030 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.364+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e44003ce0 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.364+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419d830 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.364+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44035070 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.364+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e541a5170 con 0x7f9e54103780 2024-09-15T22:44:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.364+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e54062980 con 0x7f9e54103780 2024-09-15T22:44:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.367+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9e44042030 con 0x7f9e54103780 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.367+0000 7f9e4affd640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9e400a32d0 0x7f9e400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f9e440f0880 con 0x7f9e54103780 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e59fe0640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9e400a32d0 0x7f9e400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e4affd640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] conn(0x7f9e400ae420 0x7f9e400b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e400b0f90 con 0x7f9e400ae420 2024-09-15T22:44:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f9e440f0cd0 con 0x7f9e54103780 2024-09-15T22:44:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e5a7e1640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] conn(0x7f9e400ae420 0x7f9e400b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e59fe0640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9e400a32d0 0x7f9e400a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e500058c0 tx=0x7f9e5000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.368+0000 7f9e5a7e1640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] conn(0x7f9e400ae420 0x7f9e400b08c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.369+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== osd.9 v2:172.21.15.66:6826/655656094 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e400b0f90 con 0x7f9e400ae420 2024-09-15T22:44:06.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.384+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 --> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e54062e00 con 0x7f9e400ae420 2024-09-15T22:44:06.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e4affd640 1 -- 172.21.15.66:0/3201942872 <== osd.9 v2:172.21.15.66:6826/655656094 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9e54062e00 con 0x7f9e400ae420 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] conn(0x7f9e400ae420 msgr2=0x7f9e400b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] conn(0x7f9e400ae420 0x7f9e400b08c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9e400a32d0 msgr2=0x7f9e400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9e400a32d0 0x7f9e400a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e500058c0 tx=0x7f9e5000a250 comp rx=0 tx=0).stop 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 msgr2=0x7f9e54198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5c244640 1 --2- 172.21.15.66:0/3201942872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e54103780 0x7f9e54198b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005940 tx=0x7f9e440042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.385+0000 7f9e5a7e1640 1 -- 172.21.15.66:0/3201942872 reap_dead start 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.386+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 shutdown_connections 2024-09-15T22:44:06.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.386+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 >> 172.21.15.66:0/3201942872 conn(0x7f9e540fc7d0 msgr2=0x7f9e54105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:06.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.386+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 shutdown_connections 2024-09-15T22:44:06.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.386+0000 7f9e5c244640 1 -- 172.21.15.66:0/3201942872 wait complete. 2024-09-15T22:44:06.422 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:06 smithi066 ceph-mon[31185]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:06 smithi184 ceph-mon[35203]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- 172.21.15.66:0/2612842080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8100e20 msgr2=0x7f44c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 --2- 172.21.15.66:0/2612842080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8100e20 0x7f44c8101200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009900 tx=0x7f44b802a480 comp rx=0 tx=0).stop 2024-09-15T22:44:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- 172.21.15.66:0/2612842080 shutdown_connections 2024-09-15T22:44:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 --2- 172.21.15.66:0/2612842080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8102ef0 0x7f44c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 --2- 172.21.15.66:0/2612842080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102570 0x7f44c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 --2- 172.21.15.66:0/2612842080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8100e20 0x7f44c8101200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- 172.21.15.66:0/2612842080 >> 172.21.15.66:0/2612842080 conn(0x7f44c80fc7d0 msgr2=0x7f44c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- 172.21.15.66:0/2612842080 shutdown_connections 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- 172.21.15.66:0/2612842080 wait complete. 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 Processor -- start 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.504+0000 7f44cd7af640 1 -- start start 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8100e20 0x7f44c8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 0x7f44c8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102ef0 0x7f44c819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8110f80 con 0x7f44c8102570 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8110e00 con 0x7f44c8102ef0 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44cd7af640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8111100 con 0x7f44c8100e20 2024-09-15T22:44:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 0x7f44c8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 0x7f44c8198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50582/0 (socket says 172.21.15.66:50582) 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 -- 172.21.15.66:0/1289331917 learned_addr learned my addr 172.21.15.66:0/1289331917 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44c6ffd640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8100e20 0x7f44c8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44c77fe640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102ef0 0x7f44c819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 -- 172.21.15.66:0/1289331917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8100e20 msgr2=0x7f44c8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8100e20 0x7f44c8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 -- 172.21.15.66:0/1289331917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102ef0 msgr2=0x7f44c819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102ef0 0x7f44c819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c819d540 con 0x7f44c8102570 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44c6ffd640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44c8100e20 0x7f44c8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44c77fe640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8102ef0 0x7f44c819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.505+0000 7f44bffff640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 0x7f44c8198ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d950 tx=0x7f44b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0017030 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c819d830 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44b0004020 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00047a0 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81a5110 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.506+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44c8062980 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.508+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f44b00041d0 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c4ff9640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44b40a32d0 0x7f44b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f44b00cff50 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c6ffd640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44b40a32d0 0x7f44b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c4ff9640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] conn(0x7f44b40ae420 0x7f44b40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44b40b0f90 con 0x7f44b40ae420 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f44b00d03a0 con 0x7f44c8102570 2024-09-15T22:44:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c77fe640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] conn(0x7f44b40ae420 0x7f44b40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c6ffd640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44b40a32d0 0x7f44b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005ab0 tx=0x7f44b8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.509+0000 7f44c77fe640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] conn(0x7f44b40ae420 0x7f44b40b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.510+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== osd.6 v2:172.21.15.66:6818/1408845651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44b40b0f90 con 0x7f44b40ae420 2024-09-15T22:44:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 --> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44c8062e00 con 0x7f44b40ae420 2024-09-15T22:44:06.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44c4ff9640 1 -- 172.21.15.66:0/1289331917 <== osd.6 v2:172.21.15.66:6818/1408845651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f44c8062e00 con 0x7f44b40ae420 2024-09-15T22:44:06.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] conn(0x7f44b40ae420 msgr2=0x7f44b40b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] conn(0x7f44b40ae420 0x7f44b40b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44b40a32d0 msgr2=0x7f44b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44b40a32d0 0x7f44b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005ab0 tx=0x7f44b8005a20 comp rx=0 tx=0).stop 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 msgr2=0x7f44c8198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 --2- 172.21.15.66:0/1289331917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44c8102570 0x7f44c8198ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d950 tx=0x7f44b000de10 comp rx=0 tx=0).stop 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44c77fe640 1 -- 172.21.15.66:0/1289331917 reap_dead start 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 shutdown_connections 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 >> 172.21.15.66:0/1289331917 conn(0x7f44c80fc7d0 msgr2=0x7f44c806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 shutdown_connections 2024-09-15T22:44:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:06.524+0000 7f44cd7af640 1 -- 172.21.15.66:0/1289331917 wait complete. 2024-09-15T22:44:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:06 smithi087 ceph-mon[35290]: pgmap v319: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:07.199 INFO:teuthology.orchestra.run.smithi066.stdout:261993005094 2024-09-15T22:44:07.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T22:44:07.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 -- 172.21.15.66:0/3233046522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320106f40 msgr2=0x7fe32010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 --2- 172.21.15.66:0/3233046522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320106f40 0x7fe32010eac0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe318009ca0 tx=0x7fe31802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 -- 172.21.15.66:0/3233046522 shutdown_connections 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 --2- 172.21.15.66:0/3233046522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320106f40 0x7fe32010eac0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 --2- 172.21.15.66:0/3233046522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3201027c0 0x7fe320106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 --2- 172.21.15.66:0/3233046522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe320101e10 0x7fe3201021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 -- 172.21.15.66:0/3233046522 >> 172.21.15.66:0/3233046522 conn(0x7fe3200fd8d0 msgr2=0x7fe3200ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 -- 172.21.15.66:0/3233046522 shutdown_connections 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.360+0000 7fe326184640 1 -- 172.21.15.66:0/3233046522 wait complete. 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 Processor -- start 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 -- start start 2024-09-15T22:44:07.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 0x7fe32019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3201027c0 0x7fe32019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe320106f40 0x7fe32019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe320111fa0 con 0x7fe320101e10 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe320111e20 con 0x7fe3201027c0 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe326184640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe320112120 con 0x7fe320106f40 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 0x7fe32019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 0x7fe32019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50602/0 (socket says 172.21.15.66:50602) 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe31f7fe640 1 -- 172.21.15.66:0/4048924736 learned_addr learned my addr 172.21.15.66:0/4048924736 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe31ffff640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe320106f40 0x7fe32019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.361+0000 7fe31effd640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3201027c0 0x7fe32019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 -- 172.21.15.66:0/4048924736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe320106f40 msgr2=0x7fe32019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe320106f40 0x7fe32019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 -- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3201027c0 msgr2=0x7fe32019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3201027c0 0x7fe32019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32019f5c0 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31effd640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3201027c0 0x7fe32019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31f7fe640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 0x7fe32019a610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e9f0 tx=0x7fe30800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30800cd80 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32019f8b0 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe308010910 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308018990 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.362+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3201a7190 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.363+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe3200fefb0 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.365+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe308010ac0 con 0x7fe320101e10 2024-09-15T22:44:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31cff9640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe30c0a32d0 0x7fe30c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fe3080d0830 con 0x7fe320101e10 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31effd640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe30c0a32d0 0x7fe30c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31cff9640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] conn(0x7fe30c0ae420 0x7fe30c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe30c0b0f90 con 0x7fe30c0ae420 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.366+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe3080d0c80 con 0x7fe320101e10 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.367+0000 7fe31ffff640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] conn(0x7fe30c0ae420 0x7fe30c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.367+0000 7fe31effd640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe30c0a32d0 0x7fe30c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe310005fd0 tx=0x7fe31000b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:07.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.367+0000 7fe31ffff640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] conn(0x7fe30c0ae420 0x7fe30c0b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:07.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.368+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== osd.1 v2:172.21.15.87:6800/2341073129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe30c0b0f90 con 0x7fe30c0ae420 2024-09-15T22:44:07.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.382+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 --> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe3201032f0 con 0x7fe30c0ae420 2024-09-15T22:44:07.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe31cff9640 1 -- 172.21.15.66:0/4048924736 <== osd.1 v2:172.21.15.87:6800/2341073129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe3201032f0 con 0x7fe30c0ae420 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] conn(0x7fe30c0ae420 msgr2=0x7fe30c0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] conn(0x7fe30c0ae420 0x7fe30c0b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe30c0a32d0 msgr2=0x7fe30c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe30c0a32d0 0x7fe30c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe310005fd0 tx=0x7fe31000b5d0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 msgr2=0x7fe32019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 --2- 172.21.15.66:0/4048924736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe320101e10 0x7fe32019a610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e9f0 tx=0x7fe30800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe31ffff640 1 -- 172.21.15.66:0/4048924736 reap_dead start 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 shutdown_connections 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.383+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 >> 172.21.15.66:0/4048924736 conn(0x7fe3200fd8d0 msgr2=0x7fe3200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.384+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 shutdown_connections 2024-09-15T22:44:07.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.384+0000 7fe326184640 1 -- 172.21.15.66:0/4048924736 wait complete. 2024-09-15T22:44:08.244 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:08 smithi066 ceph-mon[31185]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.392+0000 7ff35c844640 1 -- 172.21.15.66:0/359647958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358106ed0 msgr2=0x7ff35810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.392+0000 7ff35c844640 1 --2- 172.21.15.66:0/359647958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358106ed0 0x7ff35810eaa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff350009ca0 tx=0x7ff35002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 -- 172.21.15.66:0/359647958 shutdown_connections 2024-09-15T22:44:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 --2- 172.21.15.66:0/359647958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358106ed0 0x7ff35810eaa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 --2- 172.21.15.66:0/359647958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff358100eb0 0x7ff3581067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 --2- 172.21.15.66:0/359647958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff358100500 0x7ff3581008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 -- 172.21.15.66:0/359647958 >> 172.21.15.66:0/359647958 conn(0x7ff3580fc5c0 msgr2=0x7ff3580fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 -- 172.21.15.66:0/359647958 shutdown_connections 2024-09-15T22:44:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 -- 172.21.15.66:0/359647958 wait complete. 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 Processor -- start 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.393+0000 7ff35c844640 1 -- start start 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 0x7ff3581983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff358100eb0 0x7ff3581988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff358106ed0 0x7ff35819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff358111f40 con 0x7ff358100500 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff358111dc0 con 0x7ff358106ed0 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35c844640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581120c0 con 0x7ff358100eb0 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 0x7ff3581983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 0x7ff3581983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50644/0 (socket says 172.21.15.66:50644) 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 -- 172.21.15.66:0/1294720619 learned_addr learned my addr 172.21.15.66:0/1294720619 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff356d9d640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff358106ed0 0x7ff35819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff355d9b640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff358100eb0 0x7ff3581988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 -- 172.21.15.66:0/1294720619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff358100eb0 msgr2=0x7ff3581988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff358100eb0 0x7ff3581988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 -- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff358106ed0 msgr2=0x7ff35819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff358106ed0 0x7ff35819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35819d350 con 0x7ff358100500 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.394+0000 7ff35659c640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 0x7ff3581983a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.395+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff358100500 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.395+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff348009c30 con 0x7ff358100500 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.395+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35819d640 con 0x7ff358100500 2024-09-15T22:44:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.395+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800f6b0 con 0x7ff358100500 2024-09-15T22:44:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.395+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581a4f20 con 0x7ff358100500 2024-09-15T22:44:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.396+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff358062980 con 0x7ff358100500 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.397+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff3480109d0 con 0x7ff358100500 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff3477fe640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff3400a32d0 0x7ff3400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff355d9b640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff3400a32d0 0x7ff3400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7ff3480cfda0 con 0x7ff358100500 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff3477fe640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] conn(0x7ff3400ae420 0x7ff3400b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3400b0f90 con 0x7ff3400ae420 2024-09-15T22:44:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff3480d01f0 con 0x7ff358100500 2024-09-15T22:44:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff355d9b640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff3400a32d0 0x7ff3400a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005d90 tx=0x7ff34c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.398+0000 7ff356d9d640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] conn(0x7ff3400ae420 0x7ff3400b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.399+0000 7ff356d9d640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] conn(0x7ff3400ae420 0x7ff3400b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.399+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== osd.10 v2:172.21.15.87:6824/1638725655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3400b0f90 con 0x7ff3400ae420 2024-09-15T22:44:08.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.413+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 --> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff358062e00 con 0x7ff3400ae420 2024-09-15T22:44:08.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff3477fe640 1 -- 172.21.15.66:0/1294720619 <== osd.10 v2:172.21.15.87:6824/1638725655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff358062e00 con 0x7ff3400ae420 2024-09-15T22:44:08.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] conn(0x7ff3400ae420 msgr2=0x7ff3400b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] conn(0x7ff3400ae420 0x7ff3400b08c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff3400a32d0 msgr2=0x7ff3400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff3400a32d0 0x7ff3400a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005d90 tx=0x7ff34c005d20 comp rx=0 tx=0).stop 2024-09-15T22:44:08.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 msgr2=0x7ff3581983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 --2- 172.21.15.66:0/1294720619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff358100500 0x7ff3581983a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d950 tx=0x7ff34800de10 comp rx=0 tx=0).stop 2024-09-15T22:44:08.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff356d9d640 1 -- 172.21.15.66:0/1294720619 reap_dead start 2024-09-15T22:44:08.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 shutdown_connections 2024-09-15T22:44:08.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 >> 172.21.15.66:0/1294720619 conn(0x7ff3580fc5c0 msgr2=0x7ff3581056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 shutdown_connections 2024-09-15T22:44:08.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.414+0000 7ff35c844640 1 -- 172.21.15.66:0/1294720619 wait complete. 2024-09-15T22:44:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:08 smithi184 ceph-mon[35203]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:08.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:08 smithi087 ceph-mon[35290]: pgmap v320: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 383 B/s wr, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- 172.21.15.66:0/994705491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc774102d30 msgr2=0x7fc774103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 --2- 172.21.15.66:0/994705491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc774102d30 0x7fc774103110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc764009930 tx=0x7fc76402a420 comp rx=0 tx=0).stop 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- 172.21.15.66:0/994705491 shutdown_connections 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 --2- 172.21.15.66:0/994705491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7741082a0 0x7fc77410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 --2- 172.21.15.66:0/994705491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741036e0 0x7fc774107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 --2- 172.21.15.66:0/994705491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc774102d30 0x7fc774103110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- 172.21.15.66:0/994705491 >> 172.21.15.66:0/994705491 conn(0x7fc7740fc7d0 msgr2=0x7fc7740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- 172.21.15.66:0/994705491 shutdown_connections 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- 172.21.15.66:0/994705491 wait complete. 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 Processor -- start 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.586+0000 7fc779b42640 1 -- start start 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc774102d30 0x7fc7741985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 0x7fc774198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741082a0 0x7fc77419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741120a0 con 0x7fc7741036e0 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc774111f20 con 0x7fc7741082a0 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc779b42640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc774112220 con 0x7fc774102d30 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 0x7fc774198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 0x7fc774198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50664/0 (socket says 172.21.15.66:50664) 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 -- 172.21.15.66:0/605981092 learned_addr learned my addr 172.21.15.66:0/605981092 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc773fff640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741082a0 0x7fc77419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc7737fe640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc774102d30 0x7fc7741985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 -- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc774102d30 msgr2=0x7fc7741985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc774102d30 0x7fc7741985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 -- 172.21.15.66:0/605981092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741082a0 msgr2=0x7fc77419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741082a0 0x7fc77419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77419d560 con 0x7fc7741036e0 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc773fff640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7741082a0 0x7fc77419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.587+0000 7fc772ffd640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 0x7fc774198af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d740 tx=0x7fc76800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.588+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768017070 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.588+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc76800de50 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.588+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77419d850 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.588+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76800f6b0 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.588+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a5130 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.589+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc774062980 con 0x7fc7741036e0 2024-09-15T22:44:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.590+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc76801a070 con 0x7fc7741036e0 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.590+0000 7fc770ff9640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc75c0a32d0 0x7fc75c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc7737fe640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc75c0a32d0 0x7fc75c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc7680cfbd0 con 0x7fc7741036e0 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc770ff9640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] conn(0x7fc75c0ae420 0x7fc75c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc76801de50 con 0x7fc75c0ae420 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc7680d0020 con 0x7fc7741036e0 2024-09-15T22:44:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc7737fe640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc75c0a32d0 0x7fc75c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.591+0000 7fc773fff640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] conn(0x7fc75c0ae420 0x7fc75c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.592+0000 7fc773fff640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] conn(0x7fc75c0ae420 0x7fc75c0b08c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:08.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.592+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== osd.5 v2:172.21.15.184:6808/1677940591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc76801de50 con 0x7fc75c0ae420 2024-09-15T22:44:08.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.606+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 --> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc774062d80 con 0x7fc75c0ae420 2024-09-15T22:44:08.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc770ff9640 1 -- 172.21.15.66:0/605981092 <== osd.5 v2:172.21.15.184:6808/1677940591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc774062d80 con 0x7fc75c0ae420 2024-09-15T22:44:08.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] conn(0x7fc75c0ae420 msgr2=0x7fc75c0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] conn(0x7fc75c0ae420 0x7fc75c0b08c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:08.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc75c0a32d0 msgr2=0x7fc75c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc75c0a32d0 0x7fc75c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764005a20 comp rx=0 tx=0).stop 2024-09-15T22:44:08.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 msgr2=0x7fc774198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:08.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 --2- 172.21.15.66:0/605981092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7741036e0 0x7fc774198af0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d740 tx=0x7fc76800dc00 comp rx=0 tx=0).stop 2024-09-15T22:44:08.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc773fff640 1 -- 172.21.15.66:0/605981092 reap_dead start 2024-09-15T22:44:08.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 shutdown_connections 2024-09-15T22:44:08.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 >> 172.21.15.66:0/605981092 conn(0x7fc7740fc7d0 msgr2=0x7fc774105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:08.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.607+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 shutdown_connections 2024-09-15T22:44:08.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:08.608+0000 7fc779b42640 1 -- 172.21.15.66:0/605981092 wait complete. 2024-09-15T22:44:09.521 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:09 smithi066 ceph-mon[31185]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-15T22:44:09.521 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:09 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T22:44:09.551 INFO:teuthology.orchestra.run.smithi066.stdout:231928234027 2024-09-15T22:44:09.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T22:44:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:09 smithi087 ceph-mon[35290]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-15T22:44:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:09 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 -- 172.21.15.66:0/3139812136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180112b90 msgr2=0x7f3180114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 --2- 172.21.15.66:0/3139812136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180112b90 0x7f3180114f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a950 comp rx=0 tx=0).stop 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 -- 172.21.15.66:0/3139812136 shutdown_connections 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 --2- 172.21.15.66:0/3139812136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180112b90 0x7f3180114f80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 --2- 172.21.15.66:0/3139812136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180074eb0 0x7f3180112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 --2- 172.21.15.66:0/3139812136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180074590 0x7f3180074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 -- 172.21.15.66:0/3139812136 >> 172.21.15.66:0/3139812136 conn(0x7f31800fd8c0 msgr2=0x7f31800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 -- 172.21.15.66:0/3139812136 shutdown_connections 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.567+0000 7f31870d4640 1 -- 172.21.15.66:0/3139812136 wait complete. 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 Processor -- start 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 -- start start 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180074590 0x7f31801a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 0x7f31801a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180112b90 0x7f318019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3180118600 con 0x7f3180074eb0 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3180118480 con 0x7f3180074590 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.568+0000 7f31870d4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3180118780 con 0x7f3180112b90 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 0x7f31801a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 0x7f31801a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50496/0 (socket says 172.21.15.66:50496) 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 -- 172.21.15.66:0/4185632301 learned_addr learned my addr 172.21.15.66:0/4185632301 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f3184e70640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180074590 0x7f31801a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f3185671640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180112b90 0x7f318019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 -- 172.21.15.66:0/4185632301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180112b90 msgr2=0x7f318019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3180112b90 0x7f318019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 -- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180074590 msgr2=0x7f31801a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3180074590 0x7f31801a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318019efa0 con 0x7f3180074eb0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317ffff640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 0x7f31801a4bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f317400b4a0 tx=0x7f317400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174015020 con 0x7f3180074eb0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174011d10 con 0x7f3180074eb0 2024-09-15T22:44:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318019f290 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.569+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317400f2e0 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.570+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31801ab580 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.570+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31800ff900 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.571+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3174018020 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f317dffb640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f31680a32d0 0x7f31680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f3184e70640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f31680a32d0 0x7f31680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f31740cfb80 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f317dffb640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] conn(0x7f31680ae420 0x7f31680b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31680b0f90 con 0x7f31680ae420 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.572+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f31740cffd0 con 0x7f3180074eb0 2024-09-15T22:44:09.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.573+0000 7f3184e70640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f31680a32d0 0x7f31680a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f318019f9b0 tx=0x7f317000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.573+0000 7f3185671640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] conn(0x7f31680ae420 0x7f31680b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.573+0000 7f3185671640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] conn(0x7f31680ae420 0x7f31680b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.574+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== osd.4 v2:172.21.15.87:6808/58379283 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31680b0f90 con 0x7f31680ae420 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.588+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 --> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3180075cd0 con 0x7f31680ae420 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.588+0000 7f317dffb640 1 -- 172.21.15.66:0/4185632301 <== osd.4 v2:172.21.15.87:6808/58379283 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3180075cd0 con 0x7f31680ae420 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] conn(0x7f31680ae420 msgr2=0x7f31680b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] conn(0x7f31680ae420 0x7f31680b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f31680a32d0 msgr2=0x7f31680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f31680a32d0 0x7f31680a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f318019f9b0 tx=0x7f317000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 msgr2=0x7f31801a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 --2- 172.21.15.66:0/4185632301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3180074eb0 0x7f31801a4bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f317400b4a0 tx=0x7f317400b8a0 comp rx=0 tx=0).stop 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f3185671640 1 -- 172.21.15.66:0/4185632301 reap_dead start 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 shutdown_connections 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 >> 172.21.15.66:0/4185632301 conn(0x7f31800fd8c0 msgr2=0x7f31800feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 shutdown_connections 2024-09-15T22:44:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:03.589+0000 7f31870d4640 1 -- 172.21.15.66:0/4185632301 wait complete. 2024-09-15T22:44:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:09 smithi184 ceph-mon[35203]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-15T22:44:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:09 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T22:44:10.262 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:10 smithi066 ceph-mon[31185]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:10.263 INFO:teuthology.orchestra.run.smithi066.stdout:133143986239 2024-09-15T22:44:10.264 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 -- 172.21.15.66:0/216657986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c101440 msgr2=0x7f443c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 --2- 172.21.15.66:0/216657986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c101440 0x7f443c10df30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f442c009900 tx=0x7f442c02a410 comp rx=0 tx=0).stop 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 -- 172.21.15.66:0/216657986 shutdown_connections 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 --2- 172.21.15.66:0/216657986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 0x7f443c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 --2- 172.21.15.66:0/216657986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c101440 0x7f443c10df30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 --2- 172.21.15.66:0/216657986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c100b20 0x7f443c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 -- 172.21.15.66:0/216657986 >> 172.21.15.66:0/216657986 conn(0x7f443c0fc7d0 msgr2=0x7f443c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 -- 172.21.15.66:0/216657986 shutdown_connections 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.418+0000 7f4443eea640 1 -- 172.21.15.66:0/216657986 wait complete. 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 Processor -- start 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 -- start start 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 0x7f443c1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c101440 0x7f443c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 0x7f443c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f443c1142f0 con 0x7f443c100b20 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f443c114170 con 0x7f443c10e500 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.419+0000 7f4443eea640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f443c114470 con 0x7f443c101440 2024-09-15T22:44:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 0x7f443c1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 0x7f443c1a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50670/0 (socket says 172.21.15.66:50670) 2024-09-15T22:44:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 -- 172.21.15.66:0/1683681009 learned_addr learned my addr 172.21.15.66:0/1683681009 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441485640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c101440 0x7f443c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4442487640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 0x7f443c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 -- 172.21.15.66:0/1683681009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c101440 msgr2=0x7f443c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f443c101440 0x7f443c1a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 -- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 msgr2=0x7f443c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 0x7f443c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c19aea0 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4442487640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f443c10e500 0x7f443c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4441c86640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 0x7f443c1a0560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f443800d770 tx=0x7f443800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438017070 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443c19b190 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4438005500 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438004e00 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.420+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443c1a7310 con 0x7f443c100b20 2024-09-15T22:44:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.421+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f443c062940 con 0x7f443c100b20 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.423+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4438004fa0 con 0x7f443c100b20 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.423+0000 7f4432ffd640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44280a32d0 0x7f44280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.423+0000 7f4441485640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44280a32d0 0x7f44280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.423+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f44380cfd00 con 0x7f443c100b20 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4432ffd640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] conn(0x7f44280ae420 0x7f44280b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4438001d30 con 0x7f44280ae420 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f44380d0150 con 0x7f443c100b20 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4441485640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44280a32d0 0x7f44280a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f442c0096c0 tx=0x7f442c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4442487640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] conn(0x7f44280ae420 0x7f44280b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.424+0000 7f4442487640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] conn(0x7f44280ae420 0x7f44280b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.425+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== osd.7 v2:172.21.15.87:6816/1077446470 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4438001d30 con 0x7f44280ae420 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.439+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 --> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f443c062d40 con 0x7f44280ae420 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4432ffd640 1 -- 172.21.15.66:0/1683681009 <== osd.7 v2:172.21.15.87:6816/1077446470 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f443c062d40 con 0x7f44280ae420 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] conn(0x7f44280ae420 msgr2=0x7f44280b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] conn(0x7f44280ae420 0x7f44280b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44280a32d0 msgr2=0x7f44280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f44280a32d0 0x7f44280a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f442c0096c0 tx=0x7f442c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 msgr2=0x7f443c1a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 --2- 172.21.15.66:0/1683681009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f443c100b20 0x7f443c1a0560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f443800d770 tx=0x7f443800dc30 comp rx=0 tx=0).stop 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4442487640 1 -- 172.21.15.66:0/1683681009 reap_dead start 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 shutdown_connections 2024-09-15T22:44:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.440+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 >> 172.21.15.66:0/1683681009 conn(0x7f443c0fc7d0 msgr2=0x7f443c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:10.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.441+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 shutdown_connections 2024-09-15T22:44:10.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:10.441+0000 7f4443eea640 1 -- 172.21.15.66:0/1683681009 wait complete. 2024-09-15T22:44:10.574 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:10 smithi184 ceph-mon[35203]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:10 smithi087 ceph-mon[35290]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:11.328 INFO:teuthology.orchestra.run.smithi066.stdout:180388626485 2024-09-15T22:44:11.328 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T22:44:11.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- 172.21.15.66:0/4237574255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc101df0 msgr2=0x7f52fc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 --2- 172.21.15.66:0/4237574255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc101df0 0x7f52fc1021d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009900 tx=0x7f52f402a410 comp rx=0 tx=0).stop 2024-09-15T22:44:11.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- 172.21.15.66:0/4237574255 shutdown_connections 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 --2- 172.21.15.66:0/4237574255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52fc106f20 0x7f52fc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 --2- 172.21.15.66:0/4237574255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 0x7f52fc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 --2- 172.21.15.66:0/4237574255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc101df0 0x7f52fc1021d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- 172.21.15.66:0/4237574255 >> 172.21.15.66:0/4237574255 conn(0x7f52fc0fd8b0 msgr2=0x7f52fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- 172.21.15.66:0/4237574255 shutdown_connections 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- 172.21.15.66:0/4237574255 wait complete. 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 Processor -- start 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.787+0000 7f530305b640 1 -- start start 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52fc101df0 0x7f52fc1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 0x7f52fc198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 0x7f52fc19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc112020 con 0x7f52fc106f20 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc111ea0 con 0x7f52fc101df0 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc1121a0 con 0x7f52fc1027a0 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 0x7f52fc19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 0x7f52fc19cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50622/0 (socket says 172.21.15.66:50622) 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 -- 172.21.15.66:0/2640997544 learned_addr learned my addr 172.21.15.66:0/2640997544 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f5300df7640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52fc101df0 0x7f52fc1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f52fbfff640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 0x7f52fc198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 -- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 msgr2=0x7f52fc198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 0x7f52fc198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 -- 172.21.15.66:0/2640997544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52fc101df0 msgr2=0x7f52fc1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52fc101df0 0x7f52fc1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52fc19d660 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f52fbfff640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52fc1027a0 0x7f52fc198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f53015f8640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 0x7f52fc19cf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009fd0 tx=0x7f52e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4011830 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52e4016070 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.788+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52fc19d950 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.789+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e400f2e0 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.789+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52fc1a5230 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.789+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52fc062900 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.791+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f52e40119d0 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.791+0000 7f52f9ffb640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f52e80a32d0 0x7f52e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f5300df7640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f52e80a32d0 0x7f52e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f52e40cfe30 con 0x7f52fc106f20 2024-09-15T22:44:11.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f52f9ffb640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] conn(0x7f52e80ae420 0x7f52e80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52e401ee50 con 0x7f52e80ae420 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f52e40d0280 con 0x7f52fc106f20 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f5300df7640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f52e80a32d0 0x7f52e80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000c00 tx=0x7f52f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.792+0000 7f52fbfff640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] conn(0x7f52e80ae420 0x7f52e80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.793+0000 7f52fbfff640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] conn(0x7f52e80ae420 0x7f52e80b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.794+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== osd.2 v2:172.21.15.184:6800/3684058507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52e401ee50 con 0x7f52e80ae420 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.808+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 --> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52fc062d00 con 0x7f52e80ae420 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.808+0000 7f52f9ffb640 1 -- 172.21.15.66:0/2640997544 <== osd.2 v2:172.21.15.184:6800/3684058507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f52fc062d00 con 0x7f52e80ae420 2024-09-15T22:44:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.808+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] conn(0x7f52e80ae420 msgr2=0x7f52e80b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.808+0000 7f530305b640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] conn(0x7f52e80ae420 0x7f52e80b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f52e80a32d0 msgr2=0x7f52e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f52e80a32d0 0x7f52e80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52f4000c00 tx=0x7f52f40058d0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 msgr2=0x7f52fc19cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 --2- 172.21.15.66:0/2640997544 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52fc106f20 0x7f52fc19cf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009fd0 tx=0x7f52e400b8e0 comp rx=0 tx=0).stop 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f53015f8640 1 -- 172.21.15.66:0/2640997544 reap_dead start 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 shutdown_connections 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 >> 172.21.15.66:0/2640997544 conn(0x7f52fc0fd8b0 msgr2=0x7f52fc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 shutdown_connections 2024-09-15T22:44:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:07.809+0000 7f530305b640 1 -- 172.21.15.66:0/2640997544 wait complete. 2024-09-15T22:44:12.043 INFO:teuthology.orchestra.run.smithi066.stdout:77309411402 2024-09-15T22:44:12.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T22:44:12.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:12 smithi066 ceph-mon[31185]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 330 B/s wr, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:12.503 INFO:teuthology.orchestra.run.smithi066.stdout:201863462960 2024-09-15T22:44:12.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T22:44:12.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:12 smithi087 ceph-mon[35290]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 330 B/s wr, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:12.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:12 smithi184 ceph-mon[35203]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 330 B/s wr, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-15T22:44:12.854 INFO:teuthology.orchestra.run.smithi066.stdout:150323855419 2024-09-15T22:44:12.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T22:44:13.315 INFO:teuthology.orchestra.run.smithi066.stdout:283467841569 2024-09-15T22:44:13.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T22:44:13.733 INFO:teuthology.orchestra.run.smithi066.stdout:55834574926 2024-09-15T22:44:13.734 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T22:44:14.480 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:14 smithi066 ceph-mon[31185]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 299 B/s wr, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.497+0000 7f396e90a640 1 -- 172.21.15.66:0/3341956371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 msgr2=0x7f3968101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.497+0000 7f396e90a640 1 --2- 172.21.15.66:0/3341956371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f3968101200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3958009900 tx=0x7f395802a480 comp rx=0 tx=0).stop 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 -- 172.21.15.66:0/3341956371 shutdown_connections 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 --2- 172.21.15.66:0/3341956371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3968102ef0 0x7f396810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 --2- 172.21.15.66:0/3341956371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102570 0x7f39681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 --2- 172.21.15.66:0/3341956371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f3968101200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 -- 172.21.15.66:0/3341956371 >> 172.21.15.66:0/3341956371 conn(0x7f39680fc7d0 msgr2=0x7f39680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 -- 172.21.15.66:0/3341956371 shutdown_connections 2024-09-15T22:44:14.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 -- 172.21.15.66:0/3341956371 wait complete. 2024-09-15T22:44:14.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.498+0000 7f396e90a640 1 Processor -- start 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 -- start start 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f39680fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3968102570 0x7f39680fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102ef0 0x7f39680fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3968110fa0 con 0x7f3968100e20 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3968110e20 con 0x7f3968102ef0 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f396e90a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3968111120 con 0x7f3968102570 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f3967fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f39680fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f3967fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f39680fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44018/0 (socket says 172.21.15.66:44018) 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f3967fff640 1 -- 172.21.15.66:0/342610529 learned_addr learned my addr 172.21.15.66:0/342610529 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.499+0000 7f39677fe640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3968102570 0x7f39680fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f396cea7640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102ef0 0x7f39680fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 -- 172.21.15.66:0/342610529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3968102570 msgr2=0x7f39680fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3968102570 0x7f39680fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 -- 172.21.15.66:0/342610529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102ef0 msgr2=0x7f39680fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102ef0 0x7f39680fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39681a6ab0 con 0x7f3968100e20 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f396cea7640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3968102ef0 0x7f39680fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f3967fff640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f39680fcc80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3958006010 tx=0x7f3958003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395803f070 con 0x7f3968100e20 2024-09-15T22:44:14.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3958031e30 con 0x7f3968100e20 2024-09-15T22:44:14.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39681a6d40 con 0x7f3968100e20 2024-09-15T22:44:14.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958035030 con 0x7f3968100e20 2024-09-15T22:44:14.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.500+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39681a71c0 con 0x7f3968100e20 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.501+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39680628c0 con 0x7f3968100e20 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.502+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3958042070 con 0x7f3968100e20 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39657fa640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39677fe640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f39580f0d60 con 0x7f3968100e20 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39657fa640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] conn(0x7f39500ae420 0x7f39500b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3958038e90 con 0x7f39500ae420 2024-09-15T22:44:14.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.503+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f39580f11b0 con 0x7f3968100e20 2024-09-15T22:44:14.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.504+0000 7f396cea7640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] conn(0x7f39500ae420 0x7f39500b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.504+0000 7f39677fe640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f39680fe710 tx=0x7f395c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.504+0000 7f396cea7640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] conn(0x7f39500ae420 0x7f39500b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.505+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== osd.0 v2:172.21.15.66:6802/1159962456 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3958038e90 con 0x7f39500ae420 2024-09-15T22:44:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.519+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 --> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3968062d70 con 0x7f39500ae420 2024-09-15T22:44:14.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.519+0000 7f39657fa640 1 -- 172.21.15.66:0/342610529 <== osd.0 v2:172.21.15.66:6802/1159962456 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3968062d70 con 0x7f39500ae420 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] conn(0x7f39500ae420 msgr2=0x7f39500b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] conn(0x7f39500ae420 0x7f39500b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 msgr2=0x7f39500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f39680fe710 tx=0x7f395c00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 msgr2=0x7f39680fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 --2- 172.21.15.66:0/342610529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3968100e20 0x7f39680fcc80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3958006010 tx=0x7f3958003c80 comp rx=0 tx=0).stop 2024-09-15T22:44:14.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396cea7640 1 -- 172.21.15.66:0/342610529 reap_dead start 2024-09-15T22:44:14.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 shutdown_connections 2024-09-15T22:44:14.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 >> 172.21.15.66:0/342610529 conn(0x7f39680fc7d0 msgr2=0x7f396806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 shutdown_connections 2024-09-15T22:44:14.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.520+0000 7f396e90a640 1 -- 172.21.15.66:0/342610529 wait complete. 2024-09-15T22:44:14.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:14 smithi087 ceph-mon[35290]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 299 B/s wr, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:44:14.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:14 smithi184 ceph-mon[35203]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 299 B/s wr, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-15T22:44:14.698 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:14.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/3575020264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0102a50 msgr2=0x7f2cc0102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/3575020264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0102a50 0x7f2cc0102e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb402a410 comp rx=0 tx=0).stop 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/3575020264 shutdown_connections 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/3575020264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0100c80 0x7f2cc0110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/3575020264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc0100100 0x7f2cc0100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/3575020264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0102a50 0x7f2cc0102e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/3575020264 >> 172.21.15.66:0/3575020264 conn(0x7f2cc0077230 msgr2=0x7f2cc00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/3575020264 shutdown_connections 2024-09-15T22:44:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.697+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/3575020264 wait complete. 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 Processor -- start 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 -- start start 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0100100 0x7f2cc019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 0x7f2cc019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc0102a50 0x7f2cc019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0114100 con 0x7f2cc0100c80 2024-09-15T22:44:14.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0113f80 con 0x7f2cc0100100 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cc6b1c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0114280 con 0x7f2cc0102a50 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 0x7f2cc019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 0x7f2cc019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44034/0 (socket says 172.21.15.66:44034) 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.698+0000 7f2cbffff640 1 -- 172.21.15.66:0/2505419319 learned_addr learned my addr 172.21.15.66:0/2505419319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cc48b8640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0100100 0x7f2cc019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cc50b9640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc0102a50 0x7f2cc019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 -- 172.21.15.66:0/2505419319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc0102a50 msgr2=0x7f2cc019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cc0102a50 0x7f2cc019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 -- 172.21.15.66:0/2505419319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0100100 msgr2=0x7f2cc019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0100100 0x7f2cc019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc019f5c0 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbffff640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 0x7f2cc019ab50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d950 tx=0x7f2cac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac017030 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.699+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc019f8b0 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.700+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac004020 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.700+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0047a0 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.700+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc01a7190 con 0x7f2cc0100c80 2024-09-15T22:44:14.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.700+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cc0062940 con 0x7f2cc0100c80 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.702+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2cac0041d0 con 0x7f2cc0100c80 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cbdffb640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2cb00a3350 0x7f2cb00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f2cac0d0180 con 0x7f2cc0100c80 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cc48b8640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2cb00a3350 0x7f2cb00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cbdffb640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] conn(0x7f2cb00ae4a0 0x7f2cb00b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cac00ae50 con 0x7f2cb00ae4a0 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f2cac0d05d0 con 0x7f2cc0100c80 2024-09-15T22:44:14.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.703+0000 7f2cc50b9640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] conn(0x7f2cb00ae4a0 0x7f2cb00b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.704+0000 7f2cc48b8640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2cb00a3350 0x7f2cb00a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009230 tx=0x7f2cb40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.704+0000 7f2cc50b9640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] conn(0x7f2cb00ae4a0 0x7f2cb00b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:14.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.705+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== osd.3 v2:172.21.15.66:6810/2160125809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cac00ae50 con 0x7f2cb00ae4a0 2024-09-15T22:44:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.720+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 --> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2cc0062d40 con 0x7f2cb00ae4a0 2024-09-15T22:44:14.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.720+0000 7f2cbdffb640 1 -- 172.21.15.66:0/2505419319 <== osd.3 v2:172.21.15.66:6810/2160125809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2cc0062d40 con 0x7f2cb00ae4a0 2024-09-15T22:44:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] conn(0x7f2cb00ae4a0 msgr2=0x7f2cb00b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] conn(0x7f2cb00ae4a0 0x7f2cb00b0940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2cb00a3350 msgr2=0x7f2cb00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2cb00a3350 0x7f2cb00a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009230 tx=0x7f2cb40058d0 comp rx=0 tx=0).stop 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 msgr2=0x7f2cc019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 --2- 172.21.15.66:0/2505419319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2cc0100c80 0x7f2cc019ab50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d950 tx=0x7f2cac00de10 comp rx=0 tx=0).stop 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc50b9640 1 -- 172.21.15.66:0/2505419319 reap_dead start 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 shutdown_connections 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 >> 172.21.15.66:0/2505419319 conn(0x7f2cc0077230 msgr2=0x7f2cc00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 shutdown_connections 2024-09-15T22:44:14.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:14.721+0000 7f2cc6b1c640 1 -- 172.21.15.66:0/2505419319 wait complete. 2024-09-15T22:44:15.235 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:15.237 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:15.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 -- 172.21.15.66:0/2025187017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e810c170 msgr2=0x7fb7e810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2025187017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e810c170 0x7fb7e810e610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009900 tx=0x7fb7e002a480 comp rx=0 tx=0).stop 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 -- 172.21.15.66:0/2025187017 shutdown_connections 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2025187017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e810c170 0x7fb7e810e610 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2025187017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 0x7fb7e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2025187017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e8102d40 0x7fb7e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 -- 172.21.15.66:0/2025187017 >> 172.21.15.66:0/2025187017 conn(0x7fb7e80fc7a0 msgr2=0x7fb7e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 -- 172.21.15.66:0/2025187017 shutdown_connections 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.918+0000 7fb7eeced640 1 -- 172.21.15.66:0/2025187017 wait complete. 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eeced640 1 Processor -- start 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eeced640 1 -- start start 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eeced640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eeced640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 0x7fb7e81a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eeced640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 0x7fb7e810ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eca89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.919+0000 7fb7eca89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44054/0 (socket says 172.21.15.66:44054) 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7eca89640 1 -- 172.21.15.66:0/2629695326 learned_addr learned my addr 172.21.15.66:0/2629695326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8111fb0 con 0x7fb7e8102d40 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8111e30 con 0x7fb7e8103660 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e8112130 con 0x7fb7e810c170 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 0x7fb7e810ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7e7fff640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 0x7fb7e81a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 -- 172.21.15.66:0/2629695326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 msgr2=0x7fb7e81a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 0x7fb7e81a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 -- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 msgr2=0x7fb7e81a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.920+0000 7fb7ed28a640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e810b4a0 con 0x7fb7e810c170 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.921+0000 7fb7eca89640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.921+0000 7fb7ed28a640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 0x7fb7e810ad50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009230 tx=0x7fb7e0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.921+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e003f030 con 0x7fb7e810c170 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.921+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e0003ad0 con 0x7fb7e810c170 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.921+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e810b730 con 0x7fb7e810c170 2024-09-15T22:44:15.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.922+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0035070 con 0x7fb7e810c170 2024-09-15T22:44:15.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.922+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81ab670 con 0x7fb7e810c170 2024-09-15T22:44:15.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.923+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8103120 con 0x7fb7e810c170 2024-09-15T22:44:15.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.925+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb7e0042030 con 0x7fb7e810c170 2024-09-15T22:44:15.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.926+0000 7fb7e5ffb640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 0x7fb7d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:15.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.926+0000 7fb7eca89640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 0x7fb7d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:15.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.926+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fb7e00f0890 con 0x7fb7e810c170 2024-09-15T22:44:15.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.926+0000 7fb7eca89640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 0x7fb7d40a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00058c0 tx=0x7fb7d0005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:15.929 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:15.929 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:15.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:15.929+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7e00bd110 con 0x7fb7e810c170 2024-09-15T22:44:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.111+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb7e81ab840 con 0x7fb7e810c170 2024-09-15T22:44:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.111+0000 7fb7e5ffb640 1 -- 172.21.15.66:0/2629695326 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb7e00bca10 con 0x7fb7e810c170 2024-09-15T22:44:16.114 INFO:teuthology.orchestra.run.smithi066.stdout:133143986241 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 msgr2=0x7fb7d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 0x7fb7d40a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00058c0 tx=0x7fb7d0005f60 comp rx=0 tx=0).stop 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 msgr2=0x7fb7e810ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 0x7fb7e810ad50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009230 tx=0x7fb7e0004270 comp rx=0 tx=0).stop 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 shutdown_connections 2024-09-15T22:44:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e810c170 0x7fb7e810ad50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fb7d40a32d0 0x7fb7d40a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e8103660 0x7fb7e81a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 --2- 172.21.15.66:0/2629695326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7e8102d40 0x7fb7e81a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 >> 172.21.15.66:0/2629695326 conn(0x7fb7e80fc7a0 msgr2=0x7fb7e81008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 shutdown_connections 2024-09-15T22:44:16.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.115+0000 7fb7eeced640 1 -- 172.21.15.66:0/2629695326 wait complete. 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 -- 172.21.15.66:0/3768607230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1036e0 msgr2=0x7f536c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 --2- 172.21.15.66:0/3768607230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1036e0 0x7f536c107b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5360009930 tx=0x7f536002a420 comp rx=0 tx=0).stop 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 -- 172.21.15.66:0/3768607230 shutdown_connections 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 --2- 172.21.15.66:0/3768607230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c1082a0 0x7f536c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 --2- 172.21.15.66:0/3768607230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1036e0 0x7f536c107b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 --2- 172.21.15.66:0/3768607230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c102d30 0x7f536c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 -- 172.21.15.66:0/3768607230 >> 172.21.15.66:0/3768607230 conn(0x7f536c0fc7d0 msgr2=0x7f536c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 -- 172.21.15.66:0/3768607230 shutdown_connections 2024-09-15T22:44:16.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.131+0000 7f53714c7640 1 -- 172.21.15.66:0/3768607230 wait complete. 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 Processor -- start 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 -- start start 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c102d30 0x7f536c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c1036e0 0x7f536c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1120a0 con 0x7f536c1082a0 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f536c111f20 con 0x7f536c1036e0 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.132+0000 7f53714c7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f536c112220 con 0x7f536c102d30 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44082/0 (socket says 172.21.15.66:44082) 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 -- 172.21.15.66:0/2779598935 learned_addr learned my addr 172.21.15.66:0/2779598935 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:16.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536a7fc640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c1036e0 0x7f536c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536affd640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c102d30 0x7f536c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 -- 172.21.15.66:0/2779598935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c102d30 msgr2=0x7f536c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c102d30 0x7f536c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 -- 172.21.15.66:0/2779598935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c1036e0 msgr2=0x7f536c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c1036e0 0x7f536c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 -- 172.21.15.66:0/2779598935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c19d5f0 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f536b7fe640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f536400eaa0 tx=0x7f536400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536400cdb0 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c19d8e0 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5364005020 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53640116d0 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.133+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c1008c0 con 0x7f536c1082a0 2024-09-15T22:44:16.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.135+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536c06a850 con 0x7f536c1082a0 2024-09-15T22:44:16.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.137+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f53640054d0 con 0x7f536c1082a0 2024-09-15T22:44:16.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.137+0000 7f5353fff640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 0x7f53540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:16.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.138+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f53640cffe0 con 0x7f536c1082a0 2024-09-15T22:44:16.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.138+0000 7f536affd640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 0x7f53540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:16.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.139+0000 7f536affd640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 0x7f53540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f535c005fd0 tx=0x7f535c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:16.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.145+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5364016030 con 0x7f536c1082a0 2024-09-15T22:44:16.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.324+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f536c10a2b0 con 0x7f536c1082a0 2024-09-15T22:44:16.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.324+0000 7f5353fff640 1 -- 172.21.15.66:0/2779598935 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f536409c860 con 0x7f536c1082a0 2024-09-15T22:44:16.326 INFO:teuthology.orchestra.run.smithi066.stdout:313532612638 2024-09-15T22:44:16.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 msgr2=0x7f53540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 0x7f53540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f535c005fd0 tx=0x7f535c005850 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 msgr2=0x7f536c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f536400eaa0 tx=0x7f536400ef60 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 shutdown_connections 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f536c1082a0 0x7f536c19cf10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f53540a32d0 0x7f53540a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f536c1036e0 0x7f536c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 --2- 172.21.15.66:0/2779598935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f536c102d30 0x7f536c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 >> 172.21.15.66:0/2779598935 conn(0x7f536c0fc7d0 msgr2=0x7f536c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 shutdown_connections 2024-09-15T22:44:16.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:16.326+0000 7f53714c7640 1 -- 172.21.15.66:0/2779598935 wait complete. 2024-09-15T22:44:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:16 smithi087 ceph-mon[35290]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-15T22:44:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:16 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2629695326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:44:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:16 smithi184 ceph-mon[35203]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-15T22:44:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:16 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2629695326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:44:16.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:16 smithi066 ceph-mon[31185]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-15T22:44:16.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:16 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2629695326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:44:17.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986239 got 133143986241 for osd.4 2024-09-15T22:44:17.211 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:17 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2779598935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:44:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:17 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2779598935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.641+0000 7fc9bc359640 1 -- 172.21.15.66:0/3902303010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 msgr2=0x7fc9b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.641+0000 7fc9bc359640 1 --2- 172.21.15.66:0/3902303010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b41067e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009900 tx=0x7fc9a402a410 comp rx=0 tx=0).stop 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- 172.21.15.66:0/3902303010 shutdown_connections 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- 172.21.15.66:0/3902303010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4106f10 0x7fc9b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- 172.21.15.66:0/3902303010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b41067e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- 172.21.15.66:0/3902303010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4101de0 0x7fc9b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- 172.21.15.66:0/3902303010 >> 172.21.15.66:0/3902303010 conn(0x7fc9b40fd8c0 msgr2=0x7fc9b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- 172.21.15.66:0/3902303010 shutdown_connections 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- 172.21.15.66:0/3902303010 wait complete. 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 Processor -- start 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- start start 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4101de0 0x7fc9b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4106f10 0x7fc9b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4111f70 con 0x7fc9b4102790 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4111df0 con 0x7fc9b4101de0 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.642+0000 7fc9bc359640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41120f0 con 0x7fc9b4106f10 2024-09-15T22:44:17.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44096/0 (socket says 172.21.15.66:44096) 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 -- 172.21.15.66:0/4046848571 learned_addr learned my addr 172.21.15.66:0/4046848571 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9ba0f5640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4101de0 0x7fc9b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9ba8f6640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4106f10 0x7fc9b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 -- 172.21.15.66:0/4046848571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4106f10 msgr2=0x7fc9b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4106f10 0x7fc9b4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 -- 172.21.15.66:0/4046848571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4101de0 msgr2=0x7fc9b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4101de0 0x7fc9b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 -- 172.21.15.66:0/4046848571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b41a6950 con 0x7fc9b4102790 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9b98f4640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4006010 tx=0x7fc9a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a403f030 con 0x7fc9b4102790 2024-09-15T22:44:17.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b41a6be0 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a4003ce0 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4035070 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.643+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b41a7110 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.644+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b41021c0 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.646+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc9a4042030 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.646+0000 7fc9ab7fe640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 0x7fc9a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.646+0000 7fc9ba0f5640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 0x7fc9a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.646+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc9a40f02f0 con 0x7fc9b4102790 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.647+0000 7fc9ba0f5640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 0x7fc9a00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:17.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.650+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9a40bcc30 con 0x7fc9b4102790 2024-09-15T22:44:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:17 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2779598935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:44:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.829+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc9b410a120 con 0x7fc9b4102790 2024-09-15T22:44:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.830+0000 7fc9ab7fe640 1 -- 172.21.15.66:0/4046848571 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9a40bc530 con 0x7fc9b4102790 2024-09-15T22:44:17.832 INFO:teuthology.orchestra.run.smithi066.stdout:261993005096 2024-09-15T22:44:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 msgr2=0x7fc9a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 0x7fc9a00a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b000b390 comp rx=0 tx=0).stop 2024-09-15T22:44:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 msgr2=0x7fc9b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4006010 tx=0x7fc9a40042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 shutdown_connections 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9b4106f10 0x7fc9b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9b4102790 0x7fc9b4074a30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc9a00a32d0 0x7fc9a00a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 --2- 172.21.15.66:0/4046848571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9b4101de0 0x7fc9b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 >> 172.21.15.66:0/4046848571 conn(0x7fc9b40fd8c0 msgr2=0x7fc9b40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 shutdown_connections 2024-09-15T22:44:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:17.832+0000 7fc9bc359640 1 -- 172.21.15.66:0/4046848571 wait complete. 2024-09-15T22:44:18.126 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:18.154 INFO:teuthology.orchestra.run.smithi066.stdout:103079215173 2024-09-15T22:44:18.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T22:44:18.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:18 smithi066 ceph-mon[31185]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:18.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4046848571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:44:18.537 INFO:teuthology.orchestra.run.smithi066.stdout:34359738453 2024-09-15T22:44:18.538 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T22:44:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:18 smithi087 ceph-mon[35290]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4046848571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:44:18.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:18 smithi184 ceph-mon[35203]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:18.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4046848571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 -- 172.21.15.66:0/797059065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 msgr2=0x7f871c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 --2- 172.21.15.66:0/797059065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c10da40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8714009ca0 tx=0x7f871402a950 comp rx=0 tx=0).stop 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 -- 172.21.15.66:0/797059065 shutdown_connections 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 --2- 172.21.15.66:0/797059065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c10da40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 --2- 172.21.15.66:0/797059065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c102570 0x7f871c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 --2- 172.21.15.66:0/797059065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c100e20 0x7f871c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 -- 172.21.15.66:0/797059065 >> 172.21.15.66:0/797059065 conn(0x7f871c0fc7d0 msgr2=0x7f871c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 -- 172.21.15.66:0/797059065 shutdown_connections 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.688+0000 7f8723bd1640 1 -- 172.21.15.66:0/797059065 wait complete. 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 Processor -- start 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 -- start start 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 0x7f871c107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c102570 0x7f871c108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f871c110f80 con 0x7f871c102ef0 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f871c110e00 con 0x7f871c100e20 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f8723bd1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f871c111100 con 0x7f871c102570 2024-09-15T22:44:18.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f872216e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f872216e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44118/0 (socket says 172.21.15.66:44118) 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.689+0000 7f872216e640 1 -- 172.21.15.66:0/1407966075 learned_addr learned my addr 172.21.15.66:0/1407966075 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872116c640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c102570 0x7f871c108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872196d640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 0x7f871c107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 -- 172.21.15.66:0/1407966075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c102570 msgr2=0x7f871c108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c102570 0x7f871c108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 -- 172.21.15.66:0/1407966075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 msgr2=0x7f871c107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 0x7f871c107ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 -- 172.21.15.66:0/1407966075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c1a6910 con 0x7f871c102ef0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872196d640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 0x7f871c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f872216e640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8714004af0 tx=0x7f871402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714034040 con 0x7f871c102ef0 2024-09-15T22:44:18.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714030920 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714004820 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c1a6ba0 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.690+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1a7030 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.691+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871c101200 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.692+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8714037020 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.693+0000 7f8712ffd640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 0x7f87080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.693+0000 7f872196d640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 0x7f87080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.693+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f87140f0c80 con 0x7f871c102ef0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.694+0000 7f872196d640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 0x7f87080a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8718009b50 tx=0x7f8718005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:18.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.697+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87140bd610 con 0x7f871c102ef0 2024-09-15T22:44:18.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.880+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f871c1a7260 con 0x7f871c102ef0 2024-09-15T22:44:18.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.881+0000 7f8712ffd640 1 -- 172.21.15.66:0/1407966075 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f87140bcf10 con 0x7f871c102ef0 2024-09-15T22:44:18.883 INFO:teuthology.orchestra.run.smithi066.stdout:201863462962 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 msgr2=0x7f87080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 0x7f87080a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8718009b50 tx=0x7f8718005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 msgr2=0x7f871c108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8714004af0 tx=0x7f871402f5b0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 shutdown_connections 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f871c102ef0 0x7f871c108560 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871c102570 0x7f871c108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87080a32d0 0x7f87080a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 --2- 172.21.15.66:0/1407966075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f871c100e20 0x7f871c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:18.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 >> 172.21.15.66:0/1407966075 conn(0x7f871c0fc7d0 msgr2=0x7f871c103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:18.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 shutdown_connections 2024-09-15T22:44:18.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:18.883+0000 7f8723bd1640 1 -- 172.21.15.66:0/1407966075 wait complete. 2024-09-15T22:44:19.337 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:19 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1407966075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:44:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:19 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1407966075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:44:19.659 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612636 got 313532612638 for osd.11 2024-09-15T22:44:19.660 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:19 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1407966075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:44:20.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:20 smithi066 ceph-mon[31185]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:20.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:20 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/368068986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:44:20.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462960 got 201863462962 for osd.7 2024-09-15T22:44:20.375 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 -- 172.21.15.66:0/4036162684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0102ef0 msgr2=0x7fe3d010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 --2- 172.21.15.66:0/4036162684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0102ef0 0x7fe3d010da40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ca0 tx=0x7fe3c802a950 comp rx=0 tx=0).stop 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 -- 172.21.15.66:0/4036162684 shutdown_connections 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 --2- 172.21.15.66:0/4036162684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0102ef0 0x7fe3d010da40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 --2- 172.21.15.66:0/4036162684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102570 0x7fe3d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 --2- 172.21.15.66:0/4036162684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0100e20 0x7fe3d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 -- 172.21.15.66:0/4036162684 >> 172.21.15.66:0/4036162684 conn(0x7fe3d00fc7d0 msgr2=0x7fe3d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 -- 172.21.15.66:0/4036162684 shutdown_connections 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.808+0000 7fe3d833c640 1 -- 172.21.15.66:0/4036162684 wait complete. 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 Processor -- start 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 -- start start 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0102570 0x7fe3d019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 0x7fe3d019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0112090 con 0x7fe3d0100e20 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0111f10 con 0x7fe3d0102570 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d833c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0112210 con 0x7fe3d0102ef0 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d60d8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d60d8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44134/0 (socket says 172.21.15.66:44134) 2024-09-15T22:44:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d60d8640 1 -- 172.21.15.66:0/368068986 learned_addr learned my addr 172.21.15.66:0/368068986 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.809+0000 7fe3d58d7640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0102570 0x7fe3d019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d68d9640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 0x7fe3d019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 -- 172.21.15.66:0/368068986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 msgr2=0x7fe3d019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 0x7fe3d019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 -- 172.21.15.66:0/368068986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0102570 msgr2=0x7fe3d019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0102570 0x7fe3d019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 -- 172.21.15.66:0/368068986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d019f660 con 0x7fe3d0100e20 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d68d9640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 0x7fe3d019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d60d8640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c890 tx=0x7fe3cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004220 con 0x7fe3d0100e20 2024-09-15T22:44:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3cc0043c0 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0049e0 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d019f950 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.810+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01a7230 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.811+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d0101200 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.812+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe3cc0079b0 con 0x7fe3d0100e20 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.813+0000 7fe3c77fe640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 0x7fe3bc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.813+0000 7fe3d58d7640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 0x7fe3bc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.813+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fe3cc0cfde0 con 0x7fe3d0100e20 2024-09-15T22:44:20.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.814+0000 7fe3d58d7640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 0x7fe3bc0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe3d010ddf0 tx=0x7fe3c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stdout:231928234030 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.816+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3cc014030 con 0x7fe3d0100e20 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.996+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe3d019ba10 con 0x7fe3d0100e20 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.996+0000 7fe3c77fe640 1 -- 172.21.15.66:0/368068986 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe3cc09c6e0 con 0x7fe3d0100e20 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 msgr2=0x7fe3bc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 0x7fe3bc0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe3d010ddf0 tx=0x7fe3c000b390 comp rx=0 tx=0).stop 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 msgr2=0x7fe3d019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c890 tx=0x7fe3cc00cd50 comp rx=0 tx=0).stop 2024-09-15T22:44:20.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 shutdown_connections 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3d0102ef0 0x7fe3d019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe3bc0a3350 0x7fe3bc0a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d0102570 0x7fe3d019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 --2- 172.21.15.66:0/368068986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d0100e20 0x7fe3d019a6b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 >> 172.21.15.66:0/368068986 conn(0x7fe3d00fc7d0 msgr2=0x7fe3d0106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 shutdown_connections 2024-09-15T22:44:20.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:19.999+0000 7fe3d833c640 1 -- 172.21.15.66:0/368068986 wait complete. 2024-09-15T22:44:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:20 smithi087 ceph-mon[35290]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:20 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/368068986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:44:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:20 smithi184 ceph-mon[35203]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:20 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/368068986' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:44:21.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234027 got 231928234030 for osd.8 2024-09-15T22:44:21.195 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 -- 172.21.15.66:0/1792164591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 msgr2=0x7f7a68100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/1792164591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68100ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009930 tx=0x7f7a5c02a420 comp rx=0 tx=0).stop 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 -- 172.21.15.66:0/1792164591 shutdown_connections 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/1792164591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/1792164591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68100ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/1792164591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 0x7f7a68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 -- 172.21.15.66:0/1792164591 >> 172.21.15.66:0/1792164591 conn(0x7f7a680fc7a0 msgr2=0x7f7a680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 -- 172.21.15.66:0/1792164591 shutdown_connections 2024-09-15T22:44:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.369+0000 7f7a6c98d640 1 -- 172.21.15.66:0/1792164591 wait complete. 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.370+0000 7f7a6c98d640 1 Processor -- start 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.370+0000 7f7a6c98d640 1 -- start start 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.370+0000 7f7a6c98d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a68198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 0x7f7a6819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a68111f60 con 0x7f7a68100a80 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a68111de0 con 0x7f7a68101420 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a681120e0 con 0x7f7a68106a80 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44162/0 (socket says 172.21.15.66:44162) 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 -- 172.21.15.66:0/3646157304 learned_addr learned my addr 172.21.15.66:0/3646157304 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a65d9b640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a68198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a66d9d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 0x7f7a6819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 -- 172.21.15.66:0/3646157304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 msgr2=0x7f7a6819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 0x7f7a6819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 -- 172.21.15.66:0/3646157304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 msgr2=0x7f7a68198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a68198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 -- 172.21.15.66:0/3646157304 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6819d3f0 con 0x7f7a68100a80 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a65d9b640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a68198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6659c640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800d950 tx=0x7f7a5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:21.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58017030 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6819d6e0 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a58004020 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.371+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580047a0 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.372+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a681a4fc0 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.373+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a68100ee0 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.374+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7a580041d0 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.374+0000 7f7a577fe640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 0x7f7a500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.374+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7a580cf860 con 0x7f7a68100a80 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.374+0000 7f7a65d9b640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 0x7f7a500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:21.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.375+0000 7f7a65d9b640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 0x7f7a500a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000c00 tx=0x7f7a5c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:21.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.379+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a5809c0e0 con 0x7f7a68100a80 2024-09-15T22:44:21.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.569+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7a68108a80 con 0x7f7a68100a80 2024-09-15T22:44:21.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.569+0000 7f7a577fe640 1 -- 172.21.15.66:0/3646157304 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7a5809b9e0 con 0x7f7a68100a80 2024-09-15T22:44:21.571 INFO:teuthology.orchestra.run.smithi066.stdout:150323855421 2024-09-15T22:44:21.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 msgr2=0x7f7a500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 0x7f7a500a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000c00 tx=0x7f7a5c005a20 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 msgr2=0x7f7a68198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800d950 tx=0x7f7a5800de10 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 shutdown_connections 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a68106a80 0x7f7a6819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7a500a32d0 0x7f7a500a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a68101420 0x7f7a68198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 --2- 172.21.15.66:0/3646157304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a68100a80 0x7f7a68198440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 >> 172.21.15.66:0/3646157304 conn(0x7f7a680fc7a0 msgr2=0x7f7a680fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 shutdown_connections 2024-09-15T22:44:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:21.571+0000 7f7a6c98d640 1 -- 172.21.15.66:0/3646157304 wait complete. 2024-09-15T22:44:22.338 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:22 smithi066 ceph-mon[31185]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:22.338 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:22 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3646157304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:44:22.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855419 got 150323855421 for osd.5 2024-09-15T22:44:22.367 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:22.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:22 smithi087 ceph-mon[35290]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:22.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:22 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3646157304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:44:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:22.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:22 smithi184 ceph-mon[35203]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:22.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:22 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3646157304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:44:23.041 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005094 got 261993005096 for osd.9 2024-09-15T22:44:23.042 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.197+0000 7fd40939f640 1 -- 172.21.15.66:0/3536846404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 msgr2=0x7fd40410e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.197+0000 7fd40939f640 1 --2- 172.21.15.66:0/3536846404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40410e460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ca0 tx=0x7fd3fc02a950 comp rx=0 tx=0).stop 2024-09-15T22:44:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 -- 172.21.15.66:0/3536846404 shutdown_connections 2024-09-15T22:44:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 --2- 172.21.15.66:0/3536846404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40410e460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 --2- 172.21.15.66:0/3536846404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 0x7fd40410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 --2- 172.21.15.66:0/3536846404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 0x7fd404102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 -- 172.21.15.66:0/3536846404 >> 172.21.15.66:0/3536846404 conn(0x7fd4040fc630 msgr2=0x7fd4040fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 -- 172.21.15.66:0/3536846404 shutdown_connections 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 -- 172.21.15.66:0/3536846404 wait complete. 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 Processor -- start 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.198+0000 7fd40939f640 1 -- start start 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 0x7fd404198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 0x7fd404198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111d90 con 0x7fd40410bfc0 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111c10 con 0x7fd404102b90 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd40939f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111f10 con 0x7fd4041034b0 2024-09-15T22:44:23.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38360/0 (socket says 172.21.15.66:38360) 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 -- 172.21.15.66:0/2298430596 learned_addr learned my addr 172.21.15.66:0/2298430596 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd403fff640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 0x7fd404198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd4037fe640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 0x7fd404198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 -- 172.21.15.66:0/2298430596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 msgr2=0x7fd404198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 0x7fd404198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 -- 172.21.15.66:0/2298430596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 msgr2=0x7fd404198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 0x7fd404198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.199+0000 7fd408b9e640 1 -- 172.21.15.66:0/2298430596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40419d1e0 con 0x7fd40410bfc0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd408b9e640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc02ae70 tx=0x7fd3fc02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc034040 con 0x7fd40410bfc0 2024-09-15T22:44:23.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3fc030920 con 0x7fd40410bfc0 2024-09-15T22:44:23.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40419d470 con 0x7fd40410bfc0 2024-09-15T22:44:23.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0047b0 con 0x7fd40410bfc0 2024-09-15T22:44:23.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.200+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4041a4db0 con 0x7fd40410bfc0 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.201+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40406b070 con 0x7fd40410bfc0 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.202+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd3fc037020 con 0x7fd40410bfc0 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.203+0000 7fd4017fa640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 0x7fd3ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.203+0000 7fd403fff640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 0x7fd3ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.203+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fd3fc0f0ab0 con 0x7fd40410bfc0 2024-09-15T22:44:23.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.203+0000 7fd403fff640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 0x7fd3ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400abe0 tx=0x7fd3f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.207+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3fc0bd440 con 0x7fd40410bfc0 2024-09-15T22:44:23.276 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:23.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.394+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd404107030 con 0x7fd40410bfc0 2024-09-15T22:44:23.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.394+0000 7fd4017fa640 1 -- 172.21.15.66:0/2298430596 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3fc0bcd40 con 0x7fd40410bfc0 2024-09-15T22:44:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:55834574929 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 msgr2=0x7fd3ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 0x7fd3ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400abe0 tx=0x7fd3f400a2d0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 msgr2=0x7fd40419cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc02ae70 tx=0x7fd3fc02f5b0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 shutdown_connections 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd40410bfc0 0x7fd40419cb00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4041034b0 0x7fd404198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fd3ec0a32d0 0x7fd3ec0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 --2- 172.21.15.66:0/2298430596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd404102b90 0x7fd404198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 >> 172.21.15.66:0/2298430596 conn(0x7fd4040fc630 msgr2=0x7fd4040fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:23.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 shutdown_connections 2024-09-15T22:44:23.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.397+0000 7fd40939f640 1 -- 172.21.15.66:0/2298430596 wait complete. 2024-09-15T22:44:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.895+0000 7f5159081640 1 -- 172.21.15.66:0/1616703243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154103780 msgr2=0x7f5154107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.895+0000 7f5159081640 1 --2- 172.21.15.66:0/1616703243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154103780 0x7f5154107bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f513c009930 tx=0x7f513c02a420 comp rx=0 tx=0).stop 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 -- 172.21.15.66:0/1616703243 shutdown_connections 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 --2- 172.21.15.66:0/1616703243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 0x7f515410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 --2- 172.21.15.66:0/1616703243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154103780 0x7f5154107bc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 --2- 172.21.15.66:0/1616703243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154102dd0 0x7f51541031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 -- 172.21.15.66:0/1616703243 >> 172.21.15.66:0/1616703243 conn(0x7f51540fc7d0 msgr2=0x7f51540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 -- 172.21.15.66:0/1616703243 shutdown_connections 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 -- 172.21.15.66:0/1616703243 wait complete. 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 Processor -- start 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.896+0000 7f5159081640 1 -- start start 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 0x7f5154100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 0x7f51541014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5154112070 con 0x7f5154102dd0 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5154111ef0 con 0x7f5154103780 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5159081640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f51541121f0 con 0x7f5154108300 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5152d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 0x7f5154100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5152d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38390/0 (socket says 172.21.15.66:38390) 2024-09-15T22:44:23.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5152d9d640 1 -- 172.21.15.66:0/3192643034 learned_addr learned my addr 172.21.15.66:0/3192643034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515359e640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 0x7f51541014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 -- 172.21.15.66:0/3192643034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 msgr2=0x7f51541014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 0x7f51541014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 -- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 msgr2=0x7f5154100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f515259c640 1 -- 172.21.15.66:0/3192643034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541a6ab0 con 0x7f5154103780 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.897+0000 7f5152d9d640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f515259c640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 0x7f5154100f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f513c02a940 tx=0x7f513c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c03f070 con 0x7f5154103780 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51541a6d40 con 0x7f5154103780 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c03b460 con 0x7f5154103780 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c035070 con 0x7f5154103780 2024-09-15T22:44:23.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.898+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541a71e0 con 0x7f5154103780 2024-09-15T22:44:23.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.899+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51541031b0 con 0x7f5154103780 2024-09-15T22:44:23.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.900+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f513c03b610 con 0x7f5154103780 2024-09-15T22:44:23.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.901+0000 7f514bfff640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 0x7f51400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:23.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.901+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f513c0efcc0 con 0x7f5154103780 2024-09-15T22:44:23.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.901+0000 7f5152d9d640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 0x7f51400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:23.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.902+0000 7f5152d9d640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 0x7f51400a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f514c005fd0 tx=0x7f514c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:23.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:23.905+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f513c0bbef0 con 0x7f5154103780 2024-09-15T22:44:24.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.082+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f515410a290 con 0x7f5154103780 2024-09-15T22:44:24.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.083+0000 7f514bfff640 1 -- 172.21.15.66:0/3192643034 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f513c0c01f0 con 0x7f5154103780 2024-09-15T22:44:24.085 INFO:teuthology.orchestra.run.smithi066.stdout:283467841571 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 msgr2=0x7f51400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 0x7f51400a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f514c005fd0 tx=0x7f514c00b480 comp rx=0 tx=0).stop 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 msgr2=0x7f5154100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 0x7f5154100f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f513c02a940 tx=0x7f513c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 shutdown_connections 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154108300 0x7f51541014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51400a32d0 0x7f51400a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5154103780 0x7f5154100f70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 --2- 172.21.15.66:0/3192643034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154102dd0 0x7f5154100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:24.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 >> 172.21.15.66:0/3192643034 conn(0x7f51540fc7d0 msgr2=0x7f5154105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:24.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 shutdown_connections 2024-09-15T22:44:24.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:24.085+0000 7f5159081640 1 -- 172.21.15.66:0/3192643034 wait complete. 2024-09-15T22:44:24.356 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:24 smithi066 ceph-mon[31185]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:24.356 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2298430596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:44:24.356 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:24 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3192643034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:44:24.357 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574929 for osd.1 2024-09-15T22:44:24.357 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:24.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:24 smithi087 ceph-mon[35290]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:24.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:24 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2298430596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:44:24.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:24 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3192643034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:44:24.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:24 smithi184 ceph-mon[35203]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:24.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:24 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2298430596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:44:24.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:24 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3192643034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:44:25.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 -- 172.21.15.66:0/1734143200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110100a70 msgr2=0x7f811010ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 --2- 172.21.15.66:0/1734143200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110100a70 0x7f811010ea60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8108009900 tx=0x7f810802a410 comp rx=0 tx=0).stop 2024-09-15T22:44:25.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 -- 172.21.15.66:0/1734143200 shutdown_connections 2024-09-15T22:44:25.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 --2- 172.21.15.66:0/1734143200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110100a70 0x7f811010ea60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 --2- 172.21.15.66:0/1734143200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81101000d0 0x7f8110100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 --2- 172.21.15.66:0/1734143200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8110106ba0 0x7f8110106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 -- 172.21.15.66:0/1734143200 >> 172.21.15.66:0/1734143200 conn(0x7f8110077210 msgr2=0x7f81100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 -- 172.21.15.66:0/1734143200 shutdown_connections 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 -- 172.21.15.66:0/1734143200 wait complete. 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.031+0000 7f8118761640 1 Processor -- start 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 -- start start 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81101000d0 0x7f81101983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8110100a70 0x7f8110198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8110112090 con 0x7f8110106ba0 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8110111f10 con 0x7f81101000d0 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8118761640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8110112210 con 0x7f8110100a70 2024-09-15T22:44:25.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38412/0 (socket says 172.21.15.66:38412) 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 -- 172.21.15.66:0/173214407 learned_addr learned my addr 172.21.15.66:0/173214407 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8115cfc640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8110100a70 0x7f8110198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f81164fd640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81101000d0 0x7f81101983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 -- 172.21.15.66:0/173214407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8110100a70 msgr2=0x7f8110198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8110100a70 0x7f8110198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 -- 172.21.15.66:0/173214407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81101000d0 msgr2=0x7f81101983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81101000d0 0x7f81101983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 -- 172.21.15.66:0/173214407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811019d380 con 0x7f8110106ba0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.032+0000 7f8116cfe640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8108004770 tx=0x7f8108003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.033+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810803f070 con 0x7f8110106ba0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.033+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8108031c30 con 0x7f8110106ba0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.033+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811019d610 con 0x7f8110106ba0 2024-09-15T22:44:25.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.033+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108035030 con 0x7f8110106ba0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.033+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101a4f50 con 0x7f8110106ba0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.034+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81101033f0 con 0x7f8110106ba0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.035+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8108042070 con 0x7f8110106ba0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.035+0000 7f810f7fe640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 0x7f80f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.036+0000 7f81164fd640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 0x7f80f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.036+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f81080f0cf0 con 0x7f8110106ba0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.036+0000 7f81164fd640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 0x7f80f80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8100007ec0 tx=0x7f81000075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.039+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81080bcf20 con 0x7f8110106ba0 2024-09-15T22:44:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.220+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f81101a5120 con 0x7f8110106ba0 2024-09-15T22:44:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.220+0000 7f810f7fe640 1 -- 172.21.15.66:0/173214407 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f81080c1220 con 0x7f8110106ba0 2024-09-15T22:44:25.223 INFO:teuthology.orchestra.run.smithi066.stdout:180388626489 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 msgr2=0x7f80f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 0x7f80f80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8100007ec0 tx=0x7f81000075b0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 msgr2=0x7f811019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8108004770 tx=0x7f8108003c10 comp rx=0 tx=0).stop 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 shutdown_connections 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8110106ba0 0x7f811019cca0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8110100a70 0x7f8110198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f80f80a32d0 0x7f80f80a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 --2- 172.21.15.66:0/173214407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81101000d0 0x7f81101983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 >> 172.21.15.66:0/173214407 conn(0x7f8110077210 msgr2=0x7f8110104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 shutdown_connections 2024-09-15T22:44:25.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.223+0000 7f8118761640 1 -- 172.21.15.66:0/173214407 wait complete. 2024-09-15T22:44:25.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 -- 172.21.15.66:0/3914890503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101200 msgr2=0x7f6da8101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 --2- 172.21.15.66:0/3914890503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101200 0x7f6da8101660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009900 tx=0x7f6d9802a410 comp rx=0 tx=0).stop 2024-09-15T22:44:25.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 -- 172.21.15.66:0/3914890503 shutdown_connections 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 --2- 172.21.15.66:0/3914890503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101ba0 0x7f6da810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 --2- 172.21.15.66:0/3914890503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101200 0x7f6da8101660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 --2- 172.21.15.66:0/3914890503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 0x7f6da8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 -- 172.21.15.66:0/3914890503 >> 172.21.15.66:0/3914890503 conn(0x7f6da8077210 msgr2=0x7f6da80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 -- 172.21.15.66:0/3914890503 shutdown_connections 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.256+0000 7f6db02e0640 1 -- 172.21.15.66:0/3914890503 wait complete. 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 Processor -- start 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 -- start start 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101200 0x7f6da8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 0x7f6da81a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8110f00 con 0x7f6da8101ba0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.257+0000 7f6db02e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8110d80 con 0x7f6da8105ad0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6db02e0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8111080 con 0x7f6da8101200 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38420/0 (socket says 172.21.15.66:38420) 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 -- 172.21.15.66:0/1263479391 learned_addr learned my addr 172.21.15.66:0/1263479391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dae07c640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101200 0x7f6da8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dae87d640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 0x7f6da81a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 -- 172.21.15.66:0/1263479391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101200 msgr2=0x7f6da8199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101200 0x7f6da8199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 -- 172.21.15.66:0/1263479391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 msgr2=0x7f6da81a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 0x7f6da81a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 -- 172.21.15.66:0/1263479391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81a4810 con 0x7f6da8101ba0 2024-09-15T22:44:25.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.258+0000 7f6dad87b640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d9802aa00 tx=0x7f6d98003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.263+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9803f070 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.263+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d98031c20 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.263+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a49e0 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.263+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98035030 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.263+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a4e90 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.264+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da8101660 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.265+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6d98042070 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.266+0000 7f6d9f7fe640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 0x7f6d940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.266+0000 7f6dae07c640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 0x7f6d940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.266+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6d980f0480 con 0x7f6da8101ba0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.266+0000 7f6dae07c640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 0x7f6d940a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6da400bb60 tx=0x7f6da400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:25.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.270+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d980bc6b0 con 0x7f6da8101ba0 2024-09-15T22:44:25.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.451+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6da81a50c0 con 0x7f6da8101ba0 2024-09-15T22:44:25.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.451+0000 7f6d9f7fe640 1 -- 172.21.15.66:0/1263479391 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d980c09b0 con 0x7f6da8101ba0 2024-09-15T22:44:25.453 INFO:teuthology.orchestra.run.smithi066.stdout:77309411405 2024-09-15T22:44:25.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 msgr2=0x7f6d940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 0x7f6d940a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6da400bb60 tx=0x7f6da400b390 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 msgr2=0x7f6da8199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d9802aa00 tx=0x7f6d98003b60 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 shutdown_connections 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6d940a3350 0x7f6d940a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6da8105ad0 0x7f6da81a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8101ba0 0x7f6da8199790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 --2- 172.21.15.66:0/1263479391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6da8101200 0x7f6da8199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 >> 172.21.15.66:0/1263479391 conn(0x7f6da8077210 msgr2=0x7f6da8103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 shutdown_connections 2024-09-15T22:44:25.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:25.453+0000 7f6db02e0640 1 -- 172.21.15.66:0/1263479391 wait complete. 2024-09-15T22:44:25.499 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:25 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/173214407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:44:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:25 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/173214407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:44:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:25 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/173214407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:44:26.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411402 got 77309411405 for osd.2 2024-09-15T22:44:26.122 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:26.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:26 smithi066 ceph-mon[31185]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:26.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:26 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1263479391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:44:26.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:26 smithi087 ceph-mon[35290]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:26.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:26 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1263479391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:44:26.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:26 smithi184 ceph-mon[35203]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:26.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:26 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1263479391' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:44:27.034 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841569 got 283467841571 for osd.10 2024-09-15T22:44:27.034 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:27.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 -- 172.21.15.66:0/1469136571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102ef0 msgr2=0x7f74e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/1469136571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102ef0 0x7f74e810da40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009900 tx=0x7f74e002a480 comp rx=0 tx=0).stop 2024-09-15T22:44:27.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 -- 172.21.15.66:0/1469136571 shutdown_connections 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/1469136571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102ef0 0x7f74e810da40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/1469136571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8102570 0x7f74e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/1469136571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8100e20 0x7f74e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 -- 172.21.15.66:0/1469136571 >> 172.21.15.66:0/1469136571 conn(0x7f74e80fc7d0 msgr2=0x7f74e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 -- 172.21.15.66:0/1469136571 shutdown_connections 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 -- 172.21.15.66:0/1469136571 wait complete. 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.648+0000 7f74ed1f5640 1 Processor -- start 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 -- start start 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 0x7f74e8197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8102ef0 0x7f74e8197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8110f80 con 0x7f74e8102570 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8110e00 con 0x7f74e8100e20 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74ed1f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8111100 con 0x7f74e8102ef0 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38448/0 (socket says 172.21.15.66:38448) 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e659c640 1 -- 172.21.15.66:0/694401707 learned_addr learned my addr 172.21.15.66:0/694401707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 0x7f74e8197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e759e640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8102ef0 0x7f74e8197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 -- 172.21.15.66:0/694401707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8102ef0 msgr2=0x7f74e8197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8102ef0 0x7f74e8197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 -- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 msgr2=0x7f74e81976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e6d9d640 1 -- 172.21.15.66:0/694401707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e81a69d0 con 0x7f74e8100e20 2024-09-15T22:44:27.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.649+0000 7f74e659c640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74e6d9d640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 0x7f74e8197160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fd0 tx=0x7f74d000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0004b20 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d0004cc0 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e81a6cc0 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d00107b0 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.650+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e81a71b0 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.651+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e8101200 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.652+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f74d0005020 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.653+0000 7f74dffff640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 0x7f74d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.653+0000 7f74e659c640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 0x7f74d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.653+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f74d00d04c0 con 0x7f74e8100e20 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.654+0000 7f74e659c640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 0x7f74d40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74e81992c0 tx=0x7f74d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.656+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74d009cd40 con 0x7f74e8100e20 2024-09-15T22:44:27.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.838+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f74e81a7470 con 0x7f74e8100e20 2024-09-15T22:44:27.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.838+0000 7f74dffff640 1 -- 172.21.15.66:0/694401707 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74d0098020 con 0x7f74e8100e20 2024-09-15T22:44:27.841 INFO:teuthology.orchestra.run.smithi066.stdout:34359738455 2024-09-15T22:44:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 msgr2=0x7f74d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 0x7f74d40a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74e81992c0 tx=0x7f74d8005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 msgr2=0x7f74e8197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 0x7f74e8197160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009fd0 tx=0x7f74d000ef90 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 shutdown_connections 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74e8102ef0 0x7f74e8197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74e8102570 0x7f74e81976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f74d40a32d0 0x7f74d40a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 --2- 172.21.15.66:0/694401707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74e8100e20 0x7f74e8197160 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 >> 172.21.15.66:0/694401707 conn(0x7f74e80fc7d0 msgr2=0x7f74e8106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 shutdown_connections 2024-09-15T22:44:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.841+0000 7f74ed1f5640 1 -- 172.21.15.66:0/694401707 wait complete. 2024-09-15T22:44:27.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 -- 172.21.15.66:0/4062953281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8102570 msgr2=0x7f87c81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 --2- 172.21.15.66:0/4062953281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8102570 0x7f87c81029b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009900 tx=0x7f87bc02a480 comp rx=0 tx=0).stop 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 -- 172.21.15.66:0/4062953281 shutdown_connections 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 --2- 172.21.15.66:0/4062953281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102ef0 0x7f87c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 --2- 172.21.15.66:0/4062953281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8102570 0x7f87c81029b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 --2- 172.21.15.66:0/4062953281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8100e20 0x7f87c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 -- 172.21.15.66:0/4062953281 >> 172.21.15.66:0/4062953281 conn(0x7f87c80fc7d0 msgr2=0x7f87c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.756+0000 7f87ce146640 1 -- 172.21.15.66:0/4062953281 shutdown_connections 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.757+0000 7f87ce146640 1 -- 172.21.15.66:0/4062953281 wait complete. 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.757+0000 7f87ce146640 1 Processor -- start 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.757+0000 7f87ce146640 1 -- start start 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.757+0000 7f87ce146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.757+0000 7f87ce146640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102570 0x7f87c8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87ce146640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 0x7f87c819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87ce146640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8110fa0 con 0x7f87c8100e20 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87ce146640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8110e20 con 0x7f87c8102ef0 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87ce146640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8111120 con 0x7f87c8102570 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38470/0 (socket says 172.21.15.66:38470) 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 -- 172.21.15.66:0/1846561145 learned_addr learned my addr 172.21.15.66:0/1846561145 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c7fff640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 0x7f87c819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c6ffd640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102570 0x7f87c8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 -- 172.21.15.66:0/1846561145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102570 msgr2=0x7f87c8198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102570 0x7f87c8198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 -- 172.21.15.66:0/1846561145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 msgr2=0x7f87c819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 0x7f87c819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 -- 172.21.15.66:0/1846561145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c819d4d0 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c7fff640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 0x7f87c819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c77fe640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c890 tx=0x7f87b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.758+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004220 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.759+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c819d7c0 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.759+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b80043c0 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.759+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004a00 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.759+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81a50a0 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.760+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c8101200 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.761+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f87b80079b0 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.762+0000 7f87c4ff9640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 0x7f87b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.762+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f87b80cf840 con 0x7f87c8100e20 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.762+0000 7f87c6ffd640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 0x7f87b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.762+0000 7f87c6ffd640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 0x7f87b00a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87c80ff060 tx=0x7f87bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:27.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.766+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87b8014030 con 0x7f87c8100e20 2024-09-15T22:44:27.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.948+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f87c810a0a0 con 0x7f87c8100e20 2024-09-15T22:44:27.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.949+0000 7f87c4ff9640 1 -- 172.21.15.66:0/1846561145 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f87b809c0c0 con 0x7f87c8100e20 2024-09-15T22:44:27.951 INFO:teuthology.orchestra.run.smithi066.stdout:103079215176 2024-09-15T22:44:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 msgr2=0x7f87b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 0x7f87b00a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f87c80ff060 tx=0x7f87bc005a20 comp rx=0 tx=0).stop 2024-09-15T22:44:27.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 msgr2=0x7f87c8198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c890 tx=0x7f87b800cd50 comp rx=0 tx=0).stop 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 shutdown_connections 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f87b00a32d0 0x7f87b00a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c8102ef0 0x7f87c819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c8102570 0x7f87c8198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 --2- 172.21.15.66:0/1846561145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87c8100e20 0x7f87c8198520 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 >> 172.21.15.66:0/1846561145 conn(0x7f87c80fc7d0 msgr2=0x7f87c806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 shutdown_connections 2024-09-15T22:44:27.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:27.951+0000 7f87ce146640 1 -- 172.21.15.66:0/1846561145 wait complete. 2024-09-15T22:44:28.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:28 smithi087 ceph-mon[35290]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:28.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/694401707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:44:28.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1846561145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:44:28.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:28 smithi184 ceph-mon[35203]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:28.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/694401707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:44:28.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1846561145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:44:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:28 smithi066 ceph-mon[31185]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/694401707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:44:28.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1846561145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:44:28.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738455 for osd.0 2024-09-15T22:44:28.811 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:29.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626489 for osd.6 2024-09-15T22:44:29.410 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:29.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215173 got 103079215176 for osd.3 2024-09-15T22:44:29.884 DEBUG:teuthology.parallel:result is None 2024-09-15T22:44:29.884 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:44:29.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:44:30.153 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:30.584 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:30 smithi066 ceph-mon[31185]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:30.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:30 smithi087 ceph-mon[35290]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:30.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:30 smithi184 ceph-mon[35203]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 -- 172.21.15.66:0/1600884641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628102790 msgr2=0x7fc6281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 --2- 172.21.15.66:0/1600884641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628102790 0x7fc6281067e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009900 tx=0x7fc61c02a410 comp rx=0 tx=0).stop 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 -- 172.21.15.66:0/1600884641 shutdown_connections 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 --2- 172.21.15.66:0/1600884641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628106f10 0x7fc62810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 --2- 172.21.15.66:0/1600884641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628102790 0x7fc6281067e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 --2- 172.21.15.66:0/1600884641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 0x7fc6281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.665+0000 7fc62db72640 1 -- 172.21.15.66:0/1600884641 >> 172.21.15.66:0/1600884641 conn(0x7fc6280fd8c0 msgr2=0x7fc6280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.666+0000 7fc62db72640 1 -- 172.21.15.66:0/1600884641 shutdown_connections 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.666+0000 7fc62db72640 1 -- 172.21.15.66:0/1600884641 wait complete. 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.666+0000 7fc62db72640 1 Processor -- start 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.666+0000 7fc62db72640 1 -- start start 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 0x7fc6280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628102790 0x7fc628074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc628111f90 con 0x7fc628106f10 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc628111e10 con 0x7fc628101de0 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc628112110 con 0x7fc628102790 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38494/0 (socket says 172.21.15.66:38494) 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 -- 172.21.15.66:0/2538021793 learned_addr learned my addr 172.21.15.66:0/2538021793 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc626ffd640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628102790 0x7fc628074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc6277fe640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 0x7fc6280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 -- 172.21.15.66:0/2538021793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628102790 msgr2=0x7fc628074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628102790 0x7fc628074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 -- 172.21.15.66:0/2538021793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 msgr2=0x7fc6280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 0x7fc6280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 -- 172.21.15.66:0/2538021793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6281a6930 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc627fff640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc62000b970 tx=0x7fc62000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620019070 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62000cb40 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6281a6c20 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.667+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007650 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.668+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6281a7130 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.669+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6281021c0 con 0x7fc628106f10 2024-09-15T22:44:30.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.670+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc62001c070 con 0x7fc628106f10 2024-09-15T22:44:30.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.670+0000 7fc624ff9640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 0x7fc6100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:30.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.671+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fc6200cf720 con 0x7fc628106f10 2024-09-15T22:44:30.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.671+0000 7fc6277fe640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 0x7fc6100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:30.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.671+0000 7fc6277fe640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 0x7fc6100a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6180058c0 tx=0x7fc61800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:30.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.674+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc62009ba60 con 0x7fc628106f10 2024-09-15T22:44:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.847+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc628062630 con 0x7fc6100a32d0 2024-09-15T22:44:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.858+0000 7fc624ff9640 1 -- 172.21.15.66:0/2538021793 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340404 (secure 0 0 0) 0x7fc628062630 con 0x7fc6100a32d0 2024-09-15T22:44:30.862 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:30.864 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 msgr2=0x7fc6100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 0x7fc6100a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6180058c0 tx=0x7fc61800a2d0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 msgr2=0x7fc628074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc62000b970 tx=0x7fc62000be30 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 shutdown_connections 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc628106f10 0x7fc628074f70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc628102790 0x7fc628074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fc6100a32d0 0x7fc6100a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 --2- 172.21.15.66:0/2538021793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc628101de0 0x7fc6280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 >> 172.21.15.66:0/2538021793 conn(0x7fc6280fd8c0 msgr2=0x7fc6280fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 shutdown_connections 2024-09-15T22:44:30.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:30.861+0000 7fc62db72640 1 -- 172.21.15.66:0/2538021793 wait complete. 2024-09-15T22:44:31.743 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-15T22:44:30.386246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659493,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":664,"num_read_kb":460,"num_write":430,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180804,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383968,"kb_used_data":13844,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557856,"statfs":{"total":1151940427776,"available":1151547244544,"internally_reserved":0,"allocated":14176256,"data_stored":7853909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003587"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:25.867728+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:44:25.867728+0000","last_peered":"2024-09-15T22:44:25.867728+0000","last_clean":"2024-09-15T22:44:25.867728+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:44:25.867728+0000","last_undegraded":"2024-09-15T22:44:25.867728+0000","last_fullsized":"2024-09-15T22:44:25.867728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107681+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:44:02.107681+0000","last_peered":"2024-09-15T22:44:02.107681+0000","last_clean":"2024-09-15T22:44:02.107681+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:44:02.107681+0000","last_undegraded":"2024-09-15T22:44:02.107681+0000","last_fullsized":"2024-09-15T22:44:02.107681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105444+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:44:02.105444+0000","last_peered":"2024-09-15T22:44:02.105444+0000","last_clean":"2024-09-15T22:44:02.105444+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:44:02.105444+0000","last_undegraded":"2024-09-15T22:44:02.105444+0000","last_fullsized":"2024-09-15T22:44:02.105444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107972+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:44:02.107972+0000","last_peered":"2024-09-15T22:44:02.107972+0000","last_clean":"2024-09-15T22:44:02.107972+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:44:02.107972+0000","last_undegraded":"2024-09-15T22:44:02.107972+0000","last_fullsized":"2024-09-15T22:44:02.107972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108402+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:44:02.108402+0000","last_peered":"2024-09-15T22:44:02.108402+0000","last_clean":"2024-09-15T22:44:02.108402+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:44:02.108402+0000","last_undegraded":"2024-09-15T22:44:02.108402+0000","last_fullsized":"2024-09-15T22:44:02.108402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.303926+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:44:02.303926+0000","last_peered":"2024-09-15T22:44:02.303926+0000","last_clean":"2024-09-15T22:44:02.303926+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:44:02.303926+0000","last_undegraded":"2024-09-15T22:44:02.303926+0000","last_fullsized":"2024-09-15T22:44:02.303926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101815+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:44:02.101815+0000","last_peered":"2024-09-15T22:44:02.101815+0000","last_clean":"2024-09-15T22:44:02.101815+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:44:02.101815+0000","last_undegraded":"2024-09-15T22:44:02.101815+0000","last_fullsized":"2024-09-15T22:44:02.101815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107204+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:44:02.107204+0000","last_peered":"2024-09-15T22:44:02.107204+0000","last_clean":"2024-09-15T22:44:02.107204+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:44:02.107204+0000","last_undegraded":"2024-09-15T22:44:02.107204+0000","last_fullsized":"2024-09-15T22:44:02.107204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304299+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:44:02.304299+0000","last_peered":"2024-09-15T22:44:02.304299+0000","last_clean":"2024-09-15T22:44:02.304299+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:44:02.304299+0000","last_undegraded":"2024-09-15T22:44:02.304299+0000","last_fullsized":"2024-09-15T22:44:02.304299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101687+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:44:02.101687+0000","last_peered":"2024-09-15T22:44:02.101687+0000","last_clean":"2024-09-15T22:44:02.101687+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:44:02.101687+0000","last_undegraded":"2024-09-15T22:44:02.101687+0000","last_fullsized":"2024-09-15T22:44:02.101687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230423+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:44:02.230423+0000","last_peered":"2024-09-15T22:44:02.230423+0000","last_clean":"2024-09-15T22:44:02.230423+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:44:02.230423+0000","last_undegraded":"2024-09-15T22:44:02.230423+0000","last_fullsized":"2024-09-15T22:44:02.230423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304388+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:44:02.304388+0000","last_peered":"2024-09-15T22:44:02.304388+0000","last_clean":"2024-09-15T22:44:02.304388+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:44:02.304388+0000","last_undegraded":"2024-09-15T22:44:02.304388+0000","last_fullsized":"2024-09-15T22:44:02.304388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104484+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:44:02.104484+0000","last_peered":"2024-09-15T22:44:02.104484+0000","last_clean":"2024-09-15T22:44:02.104484+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:44:02.104484+0000","last_undegraded":"2024-09-15T22:44:02.104484+0000","last_fullsized":"2024-09-15T22:44:02.104484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.118198+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:44:02.118198+0000","last_peered":"2024-09-15T22:44:02.118198+0000","last_clean":"2024-09-15T22:44:02.118198+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:44:02.118198+0000","last_undegraded":"2024-09-15T22:44:02.118198+0000","last_fullsized":"2024-09-15T22:44:02.118198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304653+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:44:02.304653+0000","last_peered":"2024-09-15T22:44:02.304653+0000","last_clean":"2024-09-15T22:44:02.304653+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:44:02.304653+0000","last_undegraded":"2024-09-15T22:44:02.304653+0000","last_fullsized":"2024-09-15T22:44:02.304653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106892+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:44:02.106892+0000","last_peered":"2024-09-15T22:44:02.106892+0000","last_clean":"2024-09-15T22:44:02.106892+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:44:02.106892+0000","last_undegraded":"2024-09-15T22:44:02.106892+0000","last_fullsized":"2024-09-15T22:44:02.106892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105536+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:44:02.105536+0000","last_peered":"2024-09-15T22:44:02.105536+0000","last_clean":"2024-09-15T22:44:02.105536+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:44:02.105536+0000","last_undegraded":"2024-09-15T22:44:02.105536+0000","last_fullsized":"2024-09-15T22:44:02.105536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304537+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:44:02.304537+0000","last_peered":"2024-09-15T22:44:02.304537+0000","last_clean":"2024-09-15T22:44:02.304537+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:44:02.304537+0000","last_undegraded":"2024-09-15T22:44:02.304537+0000","last_fullsized":"2024-09-15T22:44:02.304537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103065+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:44:02.103065+0000","last_peered":"2024-09-15T22:44:02.103065+0000","last_clean":"2024-09-15T22:44:02.103065+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:44:02.103065+0000","last_undegraded":"2024-09-15T22:44:02.103065+0000","last_fullsized":"2024-09-15T22:44:02.103065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109657+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:44:02.109657+0000","last_peered":"2024-09-15T22:44:02.109657+0000","last_clean":"2024-09-15T22:44:02.109657+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:44:02.109657+0000","last_undegraded":"2024-09-15T22:44:02.109657+0000","last_fullsized":"2024-09-15T22:44:02.109657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364662+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:44:02.364662+0000","last_peered":"2024-09-15T22:44:02.364662+0000","last_clean":"2024-09-15T22:44:02.364662+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:44:02.364662+0000","last_undegraded":"2024-09-15T22:44:02.364662+0000","last_fullsized":"2024-09-15T22:44:02.364662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101006+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:44:02.101006+0000","last_peered":"2024-09-15T22:44:02.101006+0000","last_clean":"2024-09-15T22:44:02.101006+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:44:02.101006+0000","last_undegraded":"2024-09-15T22:44:02.101006+0000","last_fullsized":"2024-09-15T22:44:02.101006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106605+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:44:02.106605+0000","last_peered":"2024-09-15T22:44:02.106605+0000","last_clean":"2024-09-15T22:44:02.106605+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:44:02.106605+0000","last_undegraded":"2024-09-15T22:44:02.106605+0000","last_fullsized":"2024-09-15T22:44:02.106605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304668+0000","last_change":"2024-09-15T22:43:00.825184+0000","last_active":"2024-09-15T22:44:02.304668+0000","last_peered":"2024-09-15T22:44:02.304668+0000","last_clean":"2024-09-15T22:44:02.304668+0000","last_became_active":"2024-09-15T22:43:00.824758+0000","last_became_peered":"2024-09-15T22:43:00.824758+0000","last_unstale":"2024-09-15T22:44:02.304668+0000","last_undegraded":"2024-09-15T22:44:02.304668+0000","last_fullsized":"2024-09-15T22:44:02.304668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.116330+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:44:02.116330+0000","last_peered":"2024-09-15T22:44:02.116330+0000","last_clean":"2024-09-15T22:44:02.116330+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:44:02.116330+0000","last_undegraded":"2024-09-15T22:44:02.116330+0000","last_fullsized":"2024-09-15T22:44:02.116330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304860+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:44:02.304860+0000","last_peered":"2024-09-15T22:44:02.304860+0000","last_clean":"2024-09-15T22:44:02.304860+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:44:02.304860+0000","last_undegraded":"2024-09-15T22:44:02.304860+0000","last_fullsized":"2024-09-15T22:44:02.304860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105446+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:44:02.105446+0000","last_peered":"2024-09-15T22:44:02.105446+0000","last_clean":"2024-09-15T22:44:02.105446+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:44:02.105446+0000","last_undegraded":"2024-09-15T22:44:02.105446+0000","last_fullsized":"2024-09-15T22:44:02.105446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108299+0000","last_change":"2024-09-15T22:42:53.544658+0000","last_active":"2024-09-15T22:44:02.108299+0000","last_peered":"2024-09-15T22:44:02.108299+0000","last_clean":"2024-09-15T22:44:02.108299+0000","last_became_active":"2024-09-15T22:42:53.544382+0000","last_became_peered":"2024-09-15T22:42:53.544382+0000","last_unstale":"2024-09-15T22:44:02.108299+0000","last_undegraded":"2024-09-15T22:44:02.108299+0000","last_fullsized":"2024-09-15T22:44:02.108299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:13.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'15","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365300+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:44:02.365300+0000","last_peered":"2024-09-15T22:44:02.365300+0000","last_clean":"2024-09-15T22:44:02.365300+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:44:02.365300+0000","last_undegraded":"2024-09-15T22:44:02.365300+0000","last_fullsized":"2024-09-15T22:44:02.365300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106052+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:44:02.106052+0000","last_peered":"2024-09-15T22:44:02.106052+0000","last_clean":"2024-09-15T22:44:02.106052+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:44:02.106052+0000","last_undegraded":"2024-09-15T22:44:02.106052+0000","last_fullsized":"2024-09-15T22:44:02.106052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107296+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:44:02.107296+0000","last_peered":"2024-09-15T22:44:02.107296+0000","last_clean":"2024-09-15T22:44:02.107296+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:44:02.107296+0000","last_undegraded":"2024-09-15T22:44:02.107296+0000","last_fullsized":"2024-09-15T22:44:02.107296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101755+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:44:02.101755+0000","last_peered":"2024-09-15T22:44:02.101755+0000","last_clean":"2024-09-15T22:44:02.101755+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:44:02.101755+0000","last_undegraded":"2024-09-15T22:44:02.101755+0000","last_fullsized":"2024-09-15T22:44:02.101755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103994+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:44:02.103994+0000","last_peered":"2024-09-15T22:44:02.103994+0000","last_clean":"2024-09-15T22:44:02.103994+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:44:02.103994+0000","last_undegraded":"2024-09-15T22:44:02.103994+0000","last_fullsized":"2024-09-15T22:44:02.103994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103569+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:44:02.103569+0000","last_peered":"2024-09-15T22:44:02.103569+0000","last_clean":"2024-09-15T22:44:02.103569+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:44:02.103569+0000","last_undegraded":"2024-09-15T22:44:02.103569+0000","last_fullsized":"2024-09-15T22:44:02.103569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365001+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:44:02.365001+0000","last_peered":"2024-09-15T22:44:02.365001+0000","last_clean":"2024-09-15T22:44:02.365001+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:44:02.365001+0000","last_undegraded":"2024-09-15T22:44:02.365001+0000","last_fullsized":"2024-09-15T22:44:02.365001+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101148+0000","last_change":"2024-09-15T22:43:00.823437+0000","last_active":"2024-09-15T22:44:02.101148+0000","last_peered":"2024-09-15T22:44:02.101148+0000","last_clean":"2024-09-15T22:44:02.101148+0000","last_became_active":"2024-09-15T22:43:00.822815+0000","last_became_peered":"2024-09-15T22:43:00.822815+0000","last_unstale":"2024-09-15T22:44:02.101148+0000","last_undegraded":"2024-09-15T22:44:02.101148+0000","last_fullsized":"2024-09-15T22:44:02.101148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:22.880248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104936+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:44:02.104936+0000","last_peered":"2024-09-15T22:44:02.104936+0000","last_clean":"2024-09-15T22:44:02.104936+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:44:02.104936+0000","last_undegraded":"2024-09-15T22:44:02.104936+0000","last_fullsized":"2024-09-15T22:44:02.104936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:24.867042+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:44:24.867042+0000","last_peered":"2024-09-15T22:44:24.867042+0000","last_clean":"2024-09-15T22:44:24.867042+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:44:24.867042+0000","last_undegraded":"2024-09-15T22:44:24.867042+0000","last_fullsized":"2024-09-15T22:44:24.867042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106917+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:44:02.106917+0000","last_peered":"2024-09-15T22:44:02.106917+0000","last_clean":"2024-09-15T22:44:02.106917+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:44:02.106917+0000","last_undegraded":"2024-09-15T22:44:02.106917+0000","last_fullsized":"2024-09-15T22:44:02.106917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229872+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:44:02.229872+0000","last_peered":"2024-09-15T22:44:02.229872+0000","last_clean":"2024-09-15T22:44:02.229872+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:44:02.229872+0000","last_undegraded":"2024-09-15T22:44:02.229872+0000","last_fullsized":"2024-09-15T22:44:02.229872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":88,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:24.877305+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:44:24.877305+0000","last_peered":"2024-09-15T22:44:24.877305+0000","last_clean":"2024-09-15T22:44:24.877305+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:44:24.877305+0000","last_undegraded":"2024-09-15T22:44:24.877305+0000","last_fullsized":"2024-09-15T22:44:24.877305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108702+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:44:02.108702+0000","last_peered":"2024-09-15T22:44:02.108702+0000","last_clean":"2024-09-15T22:44:02.108702+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:44:02.108702+0000","last_undegraded":"2024-09-15T22:44:02.108702+0000","last_fullsized":"2024-09-15T22:44:02.108702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105942+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:44:02.105942+0000","last_peered":"2024-09-15T22:44:02.105942+0000","last_clean":"2024-09-15T22:44:02.105942+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:44:02.105942+0000","last_undegraded":"2024-09-15T22:44:02.105942+0000","last_fullsized":"2024-09-15T22:44:02.105942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103824+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:44:02.103824+0000","last_peered":"2024-09-15T22:44:02.103824+0000","last_clean":"2024-09-15T22:44:02.103824+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:44:02.103824+0000","last_undegraded":"2024-09-15T22:44:02.103824+0000","last_fullsized":"2024-09-15T22:44:02.103824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230312+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:44:02.230312+0000","last_peered":"2024-09-15T22:44:02.230312+0000","last_clean":"2024-09-15T22:44:02.230312+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:44:02.230312+0000","last_undegraded":"2024-09-15T22:44:02.230312+0000","last_fullsized":"2024-09-15T22:44:02.230312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106622+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:44:02.106622+0000","last_peered":"2024-09-15T22:44:02.106622+0000","last_clean":"2024-09-15T22:44:02.106622+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:44:02.106622+0000","last_undegraded":"2024-09-15T22:44:02.106622+0000","last_fullsized":"2024-09-15T22:44:02.106622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304615+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:44:02.304615+0000","last_peered":"2024-09-15T22:44:02.304615+0000","last_clean":"2024-09-15T22:44:02.304615+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:44:02.304615+0000","last_undegraded":"2024-09-15T22:44:02.304615+0000","last_fullsized":"2024-09-15T22:44:02.304615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103978+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:44:02.103978+0000","last_peered":"2024-09-15T22:44:02.103978+0000","last_clean":"2024-09-15T22:44:02.103978+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:44:02.103978+0000","last_undegraded":"2024-09-15T22:44:02.103978+0000","last_fullsized":"2024-09-15T22:44:02.103978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104594+0000","last_change":"2024-09-15T22:43:00.818418+0000","last_active":"2024-09-15T22:44:02.104594+0000","last_peered":"2024-09-15T22:44:02.104594+0000","last_clean":"2024-09-15T22:44:02.104594+0000","last_became_active":"2024-09-15T22:43:00.818013+0000","last_became_peered":"2024-09-15T22:43:00.818013+0000","last_unstale":"2024-09-15T22:44:02.104594+0000","last_undegraded":"2024-09-15T22:44:02.104594+0000","last_fullsized":"2024-09-15T22:44:02.104594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:32.460336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105290+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:44:02.105290+0000","last_peered":"2024-09-15T22:44:02.105290+0000","last_clean":"2024-09-15T22:44:02.105290+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:44:02.105290+0000","last_undegraded":"2024-09-15T22:44:02.105290+0000","last_fullsized":"2024-09-15T22:44:02.105290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:24.920974+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:44:24.920974+0000","last_peered":"2024-09-15T22:44:24.920974+0000","last_clean":"2024-09-15T22:44:24.920974+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:44:24.920974+0000","last_undegraded":"2024-09-15T22:44:24.920974+0000","last_fullsized":"2024-09-15T22:44:24.920974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106488+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:44:02.106488+0000","last_peered":"2024-09-15T22:44:02.106488+0000","last_clean":"2024-09-15T22:44:02.106488+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:44:02.106488+0000","last_undegraded":"2024-09-15T22:44:02.106488+0000","last_fullsized":"2024-09-15T22:44:02.106488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.367278+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:44:02.367278+0000","last_peered":"2024-09-15T22:44:02.367278+0000","last_clean":"2024-09-15T22:44:02.367278+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:44:02.367278+0000","last_undegraded":"2024-09-15T22:44:02.367278+0000","last_fullsized":"2024-09-15T22:44:02.367278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230665+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:44:02.230665+0000","last_peered":"2024-09-15T22:44:02.230665+0000","last_clean":"2024-09-15T22:44:02.230665+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:44:02.230665+0000","last_undegraded":"2024-09-15T22:44:02.230665+0000","last_fullsized":"2024-09-15T22:44:02.230665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107378+0000","last_change":"2024-09-15T22:43:00.815559+0000","last_active":"2024-09-15T22:44:02.107378+0000","last_peered":"2024-09-15T22:44:02.107378+0000","last_clean":"2024-09-15T22:44:02.107378+0000","last_became_active":"2024-09-15T22:43:00.815204+0000","last_became_peered":"2024-09-15T22:43:00.815204+0000","last_unstale":"2024-09-15T22:44:02.107378+0000","last_undegraded":"2024-09-15T22:44:02.107378+0000","last_fullsized":"2024-09-15T22:44:02.107378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:30.736201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105305+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:44:02.105305+0000","last_peered":"2024-09-15T22:44:02.105305+0000","last_clean":"2024-09-15T22:44:02.105305+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:44:02.105305+0000","last_undegraded":"2024-09-15T22:44:02.105305+0000","last_fullsized":"2024-09-15T22:44:02.105305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107825+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:44:02.107825+0000","last_peered":"2024-09-15T22:44:02.107825+0000","last_clean":"2024-09-15T22:44:02.107825+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:44:02.107825+0000","last_undegraded":"2024-09-15T22:44:02.107825+0000","last_fullsized":"2024-09-15T22:44:02.107825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229685+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:44:02.229685+0000","last_peered":"2024-09-15T22:44:02.229685+0000","last_clean":"2024-09-15T22:44:02.229685+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:44:02.229685+0000","last_undegraded":"2024-09-15T22:44:02.229685+0000","last_fullsized":"2024-09-15T22:44:02.229685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103524+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:44:02.103524+0000","last_peered":"2024-09-15T22:44:02.103524+0000","last_clean":"2024-09-15T22:44:02.103524+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:44:02.103524+0000","last_undegraded":"2024-09-15T22:44:02.103524+0000","last_fullsized":"2024-09-15T22:44:02.103524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101615+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:44:02.101615+0000","last_peered":"2024-09-15T22:44:02.101615+0000","last_clean":"2024-09-15T22:44:02.101615+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:44:02.101615+0000","last_undegraded":"2024-09-15T22:44:02.101615+0000","last_fullsized":"2024-09-15T22:44:02.101615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229922+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:44:02.229922+0000","last_peered":"2024-09-15T22:44:02.229922+0000","last_clean":"2024-09-15T22:44:02.229922+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:44:02.229922+0000","last_undegraded":"2024-09-15T22:44:02.229922+0000","last_fullsized":"2024-09-15T22:44:02.229922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230093+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:44:02.230093+0000","last_peered":"2024-09-15T22:44:02.230093+0000","last_clean":"2024-09-15T22:44:02.230093+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:44:02.230093+0000","last_undegraded":"2024-09-15T22:44:02.230093+0000","last_fullsized":"2024-09-15T22:44:02.230093+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101006+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:44:02.101006+0000","last_peered":"2024-09-15T22:44:02.101006+0000","last_clean":"2024-09-15T22:44:02.101006+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:44:02.101006+0000","last_undegraded":"2024-09-15T22:44:02.101006+0000","last_fullsized":"2024-09-15T22:44:02.101006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107713+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:44:02.107713+0000","last_peered":"2024-09-15T22:44:02.107713+0000","last_clean":"2024-09-15T22:44:02.107713+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:44:02.107713+0000","last_undegraded":"2024-09-15T22:44:02.107713+0000","last_fullsized":"2024-09-15T22:44:02.107713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103717+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:44:02.103717+0000","last_peered":"2024-09-15T22:44:02.103717+0000","last_clean":"2024-09-15T22:44:02.103717+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:44:02.103717+0000","last_undegraded":"2024-09-15T22:44:02.103717+0000","last_fullsized":"2024-09-15T22:44:02.103717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:25.879925+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:44:25.879925+0000","last_peered":"2024-09-15T22:44:25.879925+0000","last_clean":"2024-09-15T22:44:25.879925+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:44:25.879925+0000","last_undegraded":"2024-09-15T22:44:25.879925+0000","last_fullsized":"2024-09-15T22:44:25.879925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364818+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:44:02.364818+0000","last_peered":"2024-09-15T22:44:02.364818+0000","last_clean":"2024-09-15T22:44:02.364818+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:44:02.364818+0000","last_undegraded":"2024-09-15T22:44:02.364818+0000","last_fullsized":"2024-09-15T22:44:02.364818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104410+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:44:02.104410+0000","last_peered":"2024-09-15T22:44:02.104410+0000","last_clean":"2024-09-15T22:44:02.104410+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:44:02.104410+0000","last_undegraded":"2024-09-15T22:44:02.104410+0000","last_fullsized":"2024-09-15T22:44:02.104410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230361+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:44:02.230361+0000","last_peered":"2024-09-15T22:44:02.230361+0000","last_clean":"2024-09-15T22:44:02.230361+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:44:02.230361+0000","last_undegraded":"2024-09-15T22:44:02.230361+0000","last_fullsized":"2024-09-15T22:44:02.230361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103220+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:44:02.103220+0000","last_peered":"2024-09-15T22:44:02.103220+0000","last_clean":"2024-09-15T22:44:02.103220+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:44:02.103220+0000","last_undegraded":"2024-09-15T22:44:02.103220+0000","last_fullsized":"2024-09-15T22:44:02.103220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108505+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:44:02.108505+0000","last_peered":"2024-09-15T22:44:02.108505+0000","last_clean":"2024-09-15T22:44:02.108505+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:44:02.108505+0000","last_undegraded":"2024-09-15T22:44:02.108505+0000","last_fullsized":"2024-09-15T22:44:02.108505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.126923+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:44:02.126923+0000","last_peered":"2024-09-15T22:44:02.126923+0000","last_clean":"2024-09-15T22:44:02.126923+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:44:02.126923+0000","last_undegraded":"2024-09-15T22:44:02.126923+0000","last_fullsized":"2024-09-15T22:44:02.126923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230323+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:44:02.230323+0000","last_peered":"2024-09-15T22:44:02.230323+0000","last_clean":"2024-09-15T22:44:02.230323+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:44:02.230323+0000","last_undegraded":"2024-09-15T22:44:02.230323+0000","last_fullsized":"2024-09-15T22:44:02.230323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101523+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:44:02.101523+0000","last_peered":"2024-09-15T22:44:02.101523+0000","last_clean":"2024-09-15T22:44:02.101523+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:44:02.101523+0000","last_undegraded":"2024-09-15T22:44:02.101523+0000","last_fullsized":"2024-09-15T22:44:02.101523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":177,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:27.859322+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:44:27.859322+0000","last_peered":"2024-09-15T22:44:27.859322+0000","last_clean":"2024-09-15T22:44:27.859322+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:44:27.859322+0000","last_undegraded":"2024-09-15T22:44:27.859322+0000","last_fullsized":"2024-09-15T22:44:27.859322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364131+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:44:02.364131+0000","last_peered":"2024-09-15T22:44:02.364131+0000","last_clean":"2024-09-15T22:44:02.364131+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:44:02.364131+0000","last_undegraded":"2024-09-15T22:44:02.364131+0000","last_fullsized":"2024-09-15T22:44:02.364131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108255+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:44:02.108255+0000","last_peered":"2024-09-15T22:44:02.108255+0000","last_clean":"2024-09-15T22:44:02.108255+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:44:02.108255+0000","last_undegraded":"2024-09-15T22:44:02.108255+0000","last_fullsized":"2024-09-15T22:44:02.108255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230604+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:44:02.230604+0000","last_peered":"2024-09-15T22:44:02.230604+0000","last_clean":"2024-09-15T22:44:02.230604+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:44:02.230604+0000","last_undegraded":"2024-09-15T22:44:02.230604+0000","last_fullsized":"2024-09-15T22:44:02.230604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304497+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:44:02.304497+0000","last_peered":"2024-09-15T22:44:02.304497+0000","last_clean":"2024-09-15T22:44:02.304497+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:44:02.304497+0000","last_undegraded":"2024-09-15T22:44:02.304497+0000","last_fullsized":"2024-09-15T22:44:02.304497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108496+0000","last_change":"2024-09-15T22:42:53.548636+0000","last_active":"2024-09-15T22:44:02.108496+0000","last_peered":"2024-09-15T22:44:02.108496+0000","last_clean":"2024-09-15T22:44:02.108496+0000","last_became_active":"2024-09-15T22:42:53.548229+0000","last_became_peered":"2024-09-15T22:42:53.548229+0000","last_unstale":"2024-09-15T22:44:02.108496+0000","last_undegraded":"2024-09-15T22:44:02.108496+0000","last_fullsized":"2024-09-15T22:44:02.108496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105220+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:44:02.105220+0000","last_peered":"2024-09-15T22:44:02.105220+0000","last_clean":"2024-09-15T22:44:02.105220+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:44:02.105220+0000","last_undegraded":"2024-09-15T22:44:02.105220+0000","last_fullsized":"2024-09-15T22:44:02.105220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.363398+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:44:02.363398+0000","last_peered":"2024-09-15T22:44:02.363398+0000","last_clean":"2024-09-15T22:44:02.363398+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:44:02.363398+0000","last_undegraded":"2024-09-15T22:44:02.363398+0000","last_fullsized":"2024-09-15T22:44:02.363398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107204+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:44:02.107204+0000","last_peered":"2024-09-15T22:44:02.107204+0000","last_clean":"2024-09-15T22:44:02.107204+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:44:02.107204+0000","last_undegraded":"2024-09-15T22:44:02.107204+0000","last_fullsized":"2024-09-15T22:44:02.107204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:27.859295+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:44:27.859295+0000","last_peered":"2024-09-15T22:44:27.859295+0000","last_clean":"2024-09-15T22:44:27.859295+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:44:27.859295+0000","last_undegraded":"2024-09-15T22:44:27.859295+0000","last_fullsized":"2024-09-15T22:44:27.859295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108686+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:44:02.108686+0000","last_peered":"2024-09-15T22:44:02.108686+0000","last_clean":"2024-09-15T22:44:02.108686+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:44:02.108686+0000","last_undegraded":"2024-09-15T22:44:02.108686+0000","last_fullsized":"2024-09-15T22:44:02.108686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109515+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:44:02.109515+0000","last_peered":"2024-09-15T22:44:02.109515+0000","last_clean":"2024-09-15T22:44:02.109515+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:44:02.109515+0000","last_undegraded":"2024-09-15T22:44:02.109515+0000","last_fullsized":"2024-09-15T22:44:02.109515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.363767+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:44:02.363767+0000","last_peered":"2024-09-15T22:44:02.363767+0000","last_clean":"2024-09-15T22:44:02.363767+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:44:02.363767+0000","last_undegraded":"2024-09-15T22:44:02.363767+0000","last_fullsized":"2024-09-15T22:44:02.363767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230154+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:44:02.230154+0000","last_peered":"2024-09-15T22:44:02.230154+0000","last_clean":"2024-09-15T22:44:02.230154+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:44:02.230154+0000","last_undegraded":"2024-09-15T22:44:02.230154+0000","last_fullsized":"2024-09-15T22:44:02.230154+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103280+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:44:02.103280+0000","last_peered":"2024-09-15T22:44:02.103280+0000","last_clean":"2024-09-15T22:44:02.103280+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:44:02.103280+0000","last_undegraded":"2024-09-15T22:44:02.103280+0000","last_fullsized":"2024-09-15T22:44:02.103280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106302+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:44:02.106302+0000","last_peered":"2024-09-15T22:44:02.106302+0000","last_clean":"2024-09-15T22:44:02.106302+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:44:02.106302+0000","last_undegraded":"2024-09-15T22:44:02.106302+0000","last_fullsized":"2024-09-15T22:44:02.106302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106057+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:44:02.106057+0000","last_peered":"2024-09-15T22:44:02.106057+0000","last_clean":"2024-09-15T22:44:02.106057+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:44:02.106057+0000","last_undegraded":"2024-09-15T22:44:02.106057+0000","last_fullsized":"2024-09-15T22:44:02.106057+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.310276+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:44:02.310276+0000","last_peered":"2024-09-15T22:44:02.310276+0000","last_clean":"2024-09-15T22:44:02.310276+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:44:02.310276+0000","last_undegraded":"2024-09-15T22:44:02.310276+0000","last_fullsized":"2024-09-15T22:44:02.310276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230347+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:44:02.230347+0000","last_peered":"2024-09-15T22:44:02.230347+0000","last_clean":"2024-09-15T22:44:02.230347+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:44:02.230347+0000","last_undegraded":"2024-09-15T22:44:02.230347+0000","last_fullsized":"2024-09-15T22:44:02.230347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106324+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:44:02.106324+0000","last_peered":"2024-09-15T22:44:02.106324+0000","last_clean":"2024-09-15T22:44:02.106324+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:44:02.106324+0000","last_undegraded":"2024-09-15T22:44:02.106324+0000","last_fullsized":"2024-09-15T22:44:02.106324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:24.855679+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:44:24.855679+0000","last_peered":"2024-09-15T22:44:24.855679+0000","last_clean":"2024-09-15T22:44:24.855679+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:44:24.855679+0000","last_undegraded":"2024-09-15T22:44:24.855679+0000","last_fullsized":"2024-09-15T22:44:24.855679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101123+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:44:02.101123+0000","last_peered":"2024-09-15T22:44:02.101123+0000","last_clean":"2024-09-15T22:44:02.101123+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:44:02.101123+0000","last_undegraded":"2024-09-15T22:44:02.101123+0000","last_fullsized":"2024-09-15T22:44:02.101123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105635+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:44:02.105635+0000","last_peered":"2024-09-15T22:44:02.105635+0000","last_clean":"2024-09-15T22:44:02.105635+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:44:02.105635+0000","last_undegraded":"2024-09-15T22:44:02.105635+0000","last_fullsized":"2024-09-15T22:44:02.105635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103002+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:44:02.103002+0000","last_peered":"2024-09-15T22:44:02.103002+0000","last_clean":"2024-09-15T22:44:02.103002+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:44:02.103002+0000","last_undegraded":"2024-09-15T22:44:02.103002+0000","last_fullsized":"2024-09-15T22:44:02.103002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105801+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:44:02.105801+0000","last_peered":"2024-09-15T22:44:02.105801+0000","last_clean":"2024-09-15T22:44:02.105801+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:44:02.105801+0000","last_undegraded":"2024-09-15T22:44:02.105801+0000","last_fullsized":"2024-09-15T22:44:02.105801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105413+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:44:02.105413+0000","last_peered":"2024-09-15T22:44:02.105413+0000","last_clean":"2024-09-15T22:44:02.105413+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:44:02.105413+0000","last_undegraded":"2024-09-15T22:44:02.105413+0000","last_fullsized":"2024-09-15T22:44:02.105413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107475+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:44:02.107475+0000","last_peered":"2024-09-15T22:44:02.107475+0000","last_clean":"2024-09-15T22:44:02.107475+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:44:02.107475+0000","last_undegraded":"2024-09-15T22:44:02.107475+0000","last_fullsized":"2024-09-15T22:44:02.107475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107203+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:44:02.107203+0000","last_peered":"2024-09-15T22:44:02.107203+0000","last_clean":"2024-09-15T22:44:02.107203+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:44:02.107203+0000","last_undegraded":"2024-09-15T22:44:02.107203+0000","last_fullsized":"2024-09-15T22:44:02.107203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103399+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:44:02.103399+0000","last_peered":"2024-09-15T22:44:02.103399+0000","last_clean":"2024-09-15T22:44:02.103399+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:44:02.103399+0000","last_undegraded":"2024-09-15T22:44:02.103399+0000","last_fullsized":"2024-09-15T22:44:02.103399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106122+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:44:02.106122+0000","last_peered":"2024-09-15T22:44:02.106122+0000","last_clean":"2024-09-15T22:44:02.106122+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:44:02.106122+0000","last_undegraded":"2024-09-15T22:44:02.106122+0000","last_fullsized":"2024-09-15T22:44:02.106122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108209+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:44:02.108209+0000","last_peered":"2024-09-15T22:44:02.108209+0000","last_clean":"2024-09-15T22:44:02.108209+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:44:02.108209+0000","last_undegraded":"2024-09-15T22:44:02.108209+0000","last_fullsized":"2024-09-15T22:44:02.108209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229870+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:44:02.229870+0000","last_peered":"2024-09-15T22:44:02.229870+0000","last_clean":"2024-09-15T22:44:02.229870+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:44:02.229870+0000","last_undegraded":"2024-09-15T22:44:02.229870+0000","last_fullsized":"2024-09-15T22:44:02.229870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109493+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:44:02.109493+0000","last_peered":"2024-09-15T22:44:02.109493+0000","last_clean":"2024-09-15T22:44:02.109493+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:44:02.109493+0000","last_undegraded":"2024-09-15T22:44:02.109493+0000","last_fullsized":"2024-09-15T22:44:02.109493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106652+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:44:02.106652+0000","last_peered":"2024-09-15T22:44:02.106652+0000","last_clean":"2024-09-15T22:44:02.106652+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:44:02.106652+0000","last_undegraded":"2024-09-15T22:44:02.106652+0000","last_fullsized":"2024-09-15T22:44:02.106652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.110034+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:44:02.110034+0000","last_peered":"2024-09-15T22:44:02.110034+0000","last_clean":"2024-09-15T22:44:02.110034+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:44:02.110034+0000","last_undegraded":"2024-09-15T22:44:02.110034+0000","last_fullsized":"2024-09-15T22:44:02.110034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103349+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:44:02.103349+0000","last_peered":"2024-09-15T22:44:02.103349+0000","last_clean":"2024-09-15T22:44:02.103349+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:44:02.103349+0000","last_undegraded":"2024-09-15T22:44:02.103349+0000","last_fullsized":"2024-09-15T22:44:02.103349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105842+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:44:02.105842+0000","last_peered":"2024-09-15T22:44:02.105842+0000","last_clean":"2024-09-15T22:44:02.105842+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:44:02.105842+0000","last_undegraded":"2024-09-15T22:44:02.105842+0000","last_fullsized":"2024-09-15T22:44:02.105842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365216+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:44:02.365216+0000","last_peered":"2024-09-15T22:44:02.365216+0000","last_clean":"2024-09-15T22:44:02.365216+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:44:02.365216+0000","last_undegraded":"2024-09-15T22:44:02.365216+0000","last_fullsized":"2024-09-15T22:44:02.365216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103684+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:44:02.103684+0000","last_peered":"2024-09-15T22:44:02.103684+0000","last_clean":"2024-09-15T22:44:02.103684+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:44:02.103684+0000","last_undegraded":"2024-09-15T22:44:02.103684+0000","last_fullsized":"2024-09-15T22:44:02.103684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106475+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:44:02.106475+0000","last_peered":"2024-09-15T22:44:02.106475+0000","last_clean":"2024-09-15T22:44:02.106475+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:44:02.106475+0000","last_undegraded":"2024-09-15T22:44:02.106475+0000","last_fullsized":"2024-09-15T22:44:02.106475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.115253+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:44:02.115253+0000","last_peered":"2024-09-15T22:44:02.115253+0000","last_clean":"2024-09-15T22:44:02.115253+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:44:02.115253+0000","last_undegraded":"2024-09-15T22:44:02.115253+0000","last_fullsized":"2024-09-15T22:44:02.115253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107084+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:44:02.107084+0000","last_peered":"2024-09-15T22:44:02.107084+0000","last_clean":"2024-09-15T22:44:02.107084+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:44:02.107084+0000","last_undegraded":"2024-09-15T22:44:02.107084+0000","last_fullsized":"2024-09-15T22:44:02.107084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.367418+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:44:02.367418+0000","last_peered":"2024-09-15T22:44:02.367418+0000","last_clean":"2024-09-15T22:44:02.367418+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:44:02.367418+0000","last_undegraded":"2024-09-15T22:44:02.367418+0000","last_fullsized":"2024-09-15T22:44:02.367418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304890+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:44:02.304890+0000","last_peered":"2024-09-15T22:44:02.304890+0000","last_clean":"2024-09-15T22:44:02.304890+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:44:02.304890+0000","last_undegraded":"2024-09-15T22:44:02.304890+0000","last_fullsized":"2024-09-15T22:44:02.304890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105178+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:44:02.105178+0000","last_peered":"2024-09-15T22:44:02.105178+0000","last_clean":"2024-09-15T22:44:02.105178+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:44:02.105178+0000","last_undegraded":"2024-09-15T22:44:02.105178+0000","last_fullsized":"2024-09-15T22:44:02.105178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104559+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:44:02.104559+0000","last_peered":"2024-09-15T22:44:02.104559+0000","last_clean":"2024-09-15T22:44:02.104559+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:44:02.104559+0000","last_undegraded":"2024-09-15T22:44:02.104559+0000","last_fullsized":"2024-09-15T22:44:02.104559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108335+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:44:02.108335+0000","last_peered":"2024-09-15T22:44:02.108335+0000","last_clean":"2024-09-15T22:44:02.108335+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:44:02.108335+0000","last_undegraded":"2024-09-15T22:44:02.108335+0000","last_fullsized":"2024-09-15T22:44:02.108335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106211+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:44:02.106211+0000","last_peered":"2024-09-15T22:44:02.106211+0000","last_clean":"2024-09-15T22:44:02.106211+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:44:02.106211+0000","last_undegraded":"2024-09-15T22:44:02.106211+0000","last_fullsized":"2024-09-15T22:44:02.106211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104081+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:44:02.104081+0000","last_peered":"2024-09-15T22:44:02.104081+0000","last_clean":"2024-09-15T22:44:02.104081+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:44:02.104081+0000","last_undegraded":"2024-09-15T22:44:02.104081+0000","last_fullsized":"2024-09-15T22:44:02.104081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103708+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:44:02.103708+0000","last_peered":"2024-09-15T22:44:02.103708+0000","last_clean":"2024-09-15T22:44:02.103708+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:44:02.103708+0000","last_undegraded":"2024-09-15T22:44:02.103708+0000","last_fullsized":"2024-09-15T22:44:02.103708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101156+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:44:02.101156+0000","last_peered":"2024-09-15T22:44:02.101156+0000","last_clean":"2024-09-15T22:44:02.101156+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:44:02.101156+0000","last_undegraded":"2024-09-15T22:44:02.101156+0000","last_fullsized":"2024-09-15T22:44:02.101156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304853+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:44:02.304853+0000","last_peered":"2024-09-15T22:44:02.304853+0000","last_clean":"2024-09-15T22:44:02.304853+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:44:02.304853+0000","last_undegraded":"2024-09-15T22:44:02.304853+0000","last_fullsized":"2024-09-15T22:44:02.304853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107854+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:44:02.107854+0000","last_peered":"2024-09-15T22:44:02.107854+0000","last_clean":"2024-09-15T22:44:02.107854+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:44:02.107854+0000","last_undegraded":"2024-09-15T22:44:02.107854+0000","last_fullsized":"2024-09-15T22:44:02.107854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109617+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:44:02.109617+0000","last_peered":"2024-09-15T22:44:02.109617+0000","last_clean":"2024-09-15T22:44:02.109617+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:44:02.109617+0000","last_undegraded":"2024-09-15T22:44:02.109617+0000","last_fullsized":"2024-09-15T22:44:02.109617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103571+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:44:02.103571+0000","last_peered":"2024-09-15T22:44:02.103571+0000","last_clean":"2024-09-15T22:44:02.103571+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:44:02.103571+0000","last_undegraded":"2024-09-15T22:44:02.103571+0000","last_fullsized":"2024-09-15T22:44:02.103571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68891,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":528,"num_read_kb":341,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":492303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1691648,"data_stored":1141127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":496261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":492543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1617920,"data_stored":1089042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":488062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1626112,"data_stored":1084231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":491743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":487377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1077248,"data_stored":550927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1064960,"data_stored":551168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":489125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:31.749 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:44:32.016 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:32.390 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:32 smithi066 ceph-mon[31185]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:32.390 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:32 smithi066 ceph-mon[31185]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 -- 172.21.15.66:0/3892665208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 msgr2=0x7f4b7010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3892665208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b7010bb50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009900 tx=0x7f4b6402a480 comp rx=0 tx=0).stop 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 -- 172.21.15.66:0/3892665208 shutdown_connections 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3892665208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b7010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3892665208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b7010bb50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3892665208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b70103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 -- 172.21.15.66:0/3892665208 >> 172.21.15.66:0/3892665208 conn(0x7f4b700fc7a0 msgr2=0x7f4b700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 -- 172.21.15.66:0/3892665208 shutdown_connections 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.468+0000 7f4b769d2640 1 -- 172.21.15.66:0/3892665208 wait complete. 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 Processor -- start 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 -- start start 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b701009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b70101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70111fb0 con 0x7f4b70103660 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70111e30 con 0x7f4b7010c170 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b769d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70112130 con 0x7f4b70102d40 2024-09-15T22:44:32.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b6f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b6f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39054/0 (socket says 172.21.15.66:39054) 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b6f7fe640 1 -- 172.21.15.66:0/3529160584 learned_addr learned my addr 172.21.15.66:0/3529160584 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.469+0000 7f4b6ffff640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b701009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b74f6f640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b70101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 -- 172.21.15.66:0/3529160584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 msgr2=0x7f4b701009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b701009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 -- 172.21.15.66:0/3529160584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 msgr2=0x7f4b70101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b70101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 -- 172.21.15.66:0/3529160584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b701a6a30 con 0x7f4b70103660 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6ffff640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b701009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b74f6f640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b70101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6f7fe640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005ab0 tx=0x7f4b640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:32.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6403f030 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b701a6cc0 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b64003ce0 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64035070 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.470+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b701a71a0 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.471+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b70103120 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.472+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b64042030 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.473+0000 7f4b6d7fa640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 0x7f4b580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.473+0000 7f4b6ffff640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 0x7f4b580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.473+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f4b640f06e0 con 0x7f4b70103660 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.473+0000 7f4b6ffff640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 0x7f4b580a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009930 tx=0x7f4b60008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:32.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.477+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b640bcf60 con 0x7f4b70103660 2024-09-15T22:44:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:32 smithi087 ceph-mon[35290]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:32 smithi087 ceph-mon[35290]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:32.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.649+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b70107250 con 0x7f4b580a32d0 2024-09-15T22:44:32.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.657+0000 7f4b6d7fa640 1 -- 172.21.15.66:0/3529160584 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340405 (secure 0 0 0) 0x7f4b60009140 con 0x7f4b580a32d0 2024-09-15T22:44:32.662 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:32.663 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 msgr2=0x7f4b580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 0x7f4b580a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009930 tx=0x7f4b60008040 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 msgr2=0x7f4b70100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005ab0 tx=0x7f4b640042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 shutdown_connections 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b580a32d0 0x7f4b580a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7010c170 0x7f4b70101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b70103660 0x7f4b70100ee0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 --2- 172.21.15.66:0/3529160584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b70102d40 0x7f4b701009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 >> 172.21.15.66:0/3529160584 conn(0x7f4b700fc7a0 msgr2=0x7f4b700fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 shutdown_connections 2024-09-15T22:44:32.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:32.662+0000 7f4b769d2640 1 -- 172.21.15.66:0/3529160584 wait complete. 2024-09-15T22:44:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:32 smithi184 ceph-mon[35203]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:32 smithi184 ceph-mon[35203]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:33.435 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-15T22:44:32.386644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659493,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":689,"num_read_kb":465,"num_write":430,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180804,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383968,"kb_used_data":13844,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557856,"statfs":{"total":1151940427776,"available":1151547244544,"internally_reserved":0,"allocated":14176256,"data_stored":7853909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:25.867728+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:44:25.867728+0000","last_peered":"2024-09-15T22:44:25.867728+0000","last_clean":"2024-09-15T22:44:25.867728+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:44:25.867728+0000","last_undegraded":"2024-09-15T22:44:25.867728+0000","last_fullsized":"2024-09-15T22:44:25.867728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107681+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:44:02.107681+0000","last_peered":"2024-09-15T22:44:02.107681+0000","last_clean":"2024-09-15T22:44:02.107681+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:44:02.107681+0000","last_undegraded":"2024-09-15T22:44:02.107681+0000","last_fullsized":"2024-09-15T22:44:02.107681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105444+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:44:02.105444+0000","last_peered":"2024-09-15T22:44:02.105444+0000","last_clean":"2024-09-15T22:44:02.105444+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:44:02.105444+0000","last_undegraded":"2024-09-15T22:44:02.105444+0000","last_fullsized":"2024-09-15T22:44:02.105444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107972+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:44:02.107972+0000","last_peered":"2024-09-15T22:44:02.107972+0000","last_clean":"2024-09-15T22:44:02.107972+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:44:02.107972+0000","last_undegraded":"2024-09-15T22:44:02.107972+0000","last_fullsized":"2024-09-15T22:44:02.107972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108402+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:44:02.108402+0000","last_peered":"2024-09-15T22:44:02.108402+0000","last_clean":"2024-09-15T22:44:02.108402+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:44:02.108402+0000","last_undegraded":"2024-09-15T22:44:02.108402+0000","last_fullsized":"2024-09-15T22:44:02.108402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.303926+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:44:02.303926+0000","last_peered":"2024-09-15T22:44:02.303926+0000","last_clean":"2024-09-15T22:44:02.303926+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:44:02.303926+0000","last_undegraded":"2024-09-15T22:44:02.303926+0000","last_fullsized":"2024-09-15T22:44:02.303926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101815+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:44:02.101815+0000","last_peered":"2024-09-15T22:44:02.101815+0000","last_clean":"2024-09-15T22:44:02.101815+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:44:02.101815+0000","last_undegraded":"2024-09-15T22:44:02.101815+0000","last_fullsized":"2024-09-15T22:44:02.101815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107204+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:44:02.107204+0000","last_peered":"2024-09-15T22:44:02.107204+0000","last_clean":"2024-09-15T22:44:02.107204+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:44:02.107204+0000","last_undegraded":"2024-09-15T22:44:02.107204+0000","last_fullsized":"2024-09-15T22:44:02.107204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304299+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:44:02.304299+0000","last_peered":"2024-09-15T22:44:02.304299+0000","last_clean":"2024-09-15T22:44:02.304299+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:44:02.304299+0000","last_undegraded":"2024-09-15T22:44:02.304299+0000","last_fullsized":"2024-09-15T22:44:02.304299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101687+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:44:02.101687+0000","last_peered":"2024-09-15T22:44:02.101687+0000","last_clean":"2024-09-15T22:44:02.101687+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:44:02.101687+0000","last_undegraded":"2024-09-15T22:44:02.101687+0000","last_fullsized":"2024-09-15T22:44:02.101687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230423+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:44:02.230423+0000","last_peered":"2024-09-15T22:44:02.230423+0000","last_clean":"2024-09-15T22:44:02.230423+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:44:02.230423+0000","last_undegraded":"2024-09-15T22:44:02.230423+0000","last_fullsized":"2024-09-15T22:44:02.230423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304388+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:44:02.304388+0000","last_peered":"2024-09-15T22:44:02.304388+0000","last_clean":"2024-09-15T22:44:02.304388+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:44:02.304388+0000","last_undegraded":"2024-09-15T22:44:02.304388+0000","last_fullsized":"2024-09-15T22:44:02.304388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104484+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:44:02.104484+0000","last_peered":"2024-09-15T22:44:02.104484+0000","last_clean":"2024-09-15T22:44:02.104484+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:44:02.104484+0000","last_undegraded":"2024-09-15T22:44:02.104484+0000","last_fullsized":"2024-09-15T22:44:02.104484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.118198+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:44:02.118198+0000","last_peered":"2024-09-15T22:44:02.118198+0000","last_clean":"2024-09-15T22:44:02.118198+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:44:02.118198+0000","last_undegraded":"2024-09-15T22:44:02.118198+0000","last_fullsized":"2024-09-15T22:44:02.118198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304653+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:44:02.304653+0000","last_peered":"2024-09-15T22:44:02.304653+0000","last_clean":"2024-09-15T22:44:02.304653+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:44:02.304653+0000","last_undegraded":"2024-09-15T22:44:02.304653+0000","last_fullsized":"2024-09-15T22:44:02.304653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106892+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:44:02.106892+0000","last_peered":"2024-09-15T22:44:02.106892+0000","last_clean":"2024-09-15T22:44:02.106892+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:44:02.106892+0000","last_undegraded":"2024-09-15T22:44:02.106892+0000","last_fullsized":"2024-09-15T22:44:02.106892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105536+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:44:02.105536+0000","last_peered":"2024-09-15T22:44:02.105536+0000","last_clean":"2024-09-15T22:44:02.105536+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:44:02.105536+0000","last_undegraded":"2024-09-15T22:44:02.105536+0000","last_fullsized":"2024-09-15T22:44:02.105536+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304537+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:44:02.304537+0000","last_peered":"2024-09-15T22:44:02.304537+0000","last_clean":"2024-09-15T22:44:02.304537+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:44:02.304537+0000","last_undegraded":"2024-09-15T22:44:02.304537+0000","last_fullsized":"2024-09-15T22:44:02.304537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103065+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:44:02.103065+0000","last_peered":"2024-09-15T22:44:02.103065+0000","last_clean":"2024-09-15T22:44:02.103065+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:44:02.103065+0000","last_undegraded":"2024-09-15T22:44:02.103065+0000","last_fullsized":"2024-09-15T22:44:02.103065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109657+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:44:02.109657+0000","last_peered":"2024-09-15T22:44:02.109657+0000","last_clean":"2024-09-15T22:44:02.109657+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:44:02.109657+0000","last_undegraded":"2024-09-15T22:44:02.109657+0000","last_fullsized":"2024-09-15T22:44:02.109657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364662+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:44:02.364662+0000","last_peered":"2024-09-15T22:44:02.364662+0000","last_clean":"2024-09-15T22:44:02.364662+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:44:02.364662+0000","last_undegraded":"2024-09-15T22:44:02.364662+0000","last_fullsized":"2024-09-15T22:44:02.364662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101006+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:44:02.101006+0000","last_peered":"2024-09-15T22:44:02.101006+0000","last_clean":"2024-09-15T22:44:02.101006+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:44:02.101006+0000","last_undegraded":"2024-09-15T22:44:02.101006+0000","last_fullsized":"2024-09-15T22:44:02.101006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106605+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:44:02.106605+0000","last_peered":"2024-09-15T22:44:02.106605+0000","last_clean":"2024-09-15T22:44:02.106605+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:44:02.106605+0000","last_undegraded":"2024-09-15T22:44:02.106605+0000","last_fullsized":"2024-09-15T22:44:02.106605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304668+0000","last_change":"2024-09-15T22:43:00.825184+0000","last_active":"2024-09-15T22:44:02.304668+0000","last_peered":"2024-09-15T22:44:02.304668+0000","last_clean":"2024-09-15T22:44:02.304668+0000","last_became_active":"2024-09-15T22:43:00.824758+0000","last_became_peered":"2024-09-15T22:43:00.824758+0000","last_unstale":"2024-09-15T22:44:02.304668+0000","last_undegraded":"2024-09-15T22:44:02.304668+0000","last_fullsized":"2024-09-15T22:44:02.304668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.116330+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:44:02.116330+0000","last_peered":"2024-09-15T22:44:02.116330+0000","last_clean":"2024-09-15T22:44:02.116330+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:44:02.116330+0000","last_undegraded":"2024-09-15T22:44:02.116330+0000","last_fullsized":"2024-09-15T22:44:02.116330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304860+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:44:02.304860+0000","last_peered":"2024-09-15T22:44:02.304860+0000","last_clean":"2024-09-15T22:44:02.304860+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:44:02.304860+0000","last_undegraded":"2024-09-15T22:44:02.304860+0000","last_fullsized":"2024-09-15T22:44:02.304860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105446+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:44:02.105446+0000","last_peered":"2024-09-15T22:44:02.105446+0000","last_clean":"2024-09-15T22:44:02.105446+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:44:02.105446+0000","last_undegraded":"2024-09-15T22:44:02.105446+0000","last_fullsized":"2024-09-15T22:44:02.105446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108299+0000","last_change":"2024-09-15T22:42:53.544658+0000","last_active":"2024-09-15T22:44:02.108299+0000","last_peered":"2024-09-15T22:44:02.108299+0000","last_clean":"2024-09-15T22:44:02.108299+0000","last_became_active":"2024-09-15T22:42:53.544382+0000","last_became_peered":"2024-09-15T22:42:53.544382+0000","last_unstale":"2024-09-15T22:44:02.108299+0000","last_undegraded":"2024-09-15T22:44:02.108299+0000","last_fullsized":"2024-09-15T22:44:02.108299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:13.154016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'15","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365300+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:44:02.365300+0000","last_peered":"2024-09-15T22:44:02.365300+0000","last_clean":"2024-09-15T22:44:02.365300+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:44:02.365300+0000","last_undegraded":"2024-09-15T22:44:02.365300+0000","last_fullsized":"2024-09-15T22:44:02.365300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106052+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:44:02.106052+0000","last_peered":"2024-09-15T22:44:02.106052+0000","last_clean":"2024-09-15T22:44:02.106052+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:44:02.106052+0000","last_undegraded":"2024-09-15T22:44:02.106052+0000","last_fullsized":"2024-09-15T22:44:02.106052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107296+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:44:02.107296+0000","last_peered":"2024-09-15T22:44:02.107296+0000","last_clean":"2024-09-15T22:44:02.107296+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:44:02.107296+0000","last_undegraded":"2024-09-15T22:44:02.107296+0000","last_fullsized":"2024-09-15T22:44:02.107296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101755+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:44:02.101755+0000","last_peered":"2024-09-15T22:44:02.101755+0000","last_clean":"2024-09-15T22:44:02.101755+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:44:02.101755+0000","last_undegraded":"2024-09-15T22:44:02.101755+0000","last_fullsized":"2024-09-15T22:44:02.101755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103994+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:44:02.103994+0000","last_peered":"2024-09-15T22:44:02.103994+0000","last_clean":"2024-09-15T22:44:02.103994+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:44:02.103994+0000","last_undegraded":"2024-09-15T22:44:02.103994+0000","last_fullsized":"2024-09-15T22:44:02.103994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103569+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:44:02.103569+0000","last_peered":"2024-09-15T22:44:02.103569+0000","last_clean":"2024-09-15T22:44:02.103569+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:44:02.103569+0000","last_undegraded":"2024-09-15T22:44:02.103569+0000","last_fullsized":"2024-09-15T22:44:02.103569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365001+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:44:02.365001+0000","last_peered":"2024-09-15T22:44:02.365001+0000","last_clean":"2024-09-15T22:44:02.365001+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:44:02.365001+0000","last_undegraded":"2024-09-15T22:44:02.365001+0000","last_fullsized":"2024-09-15T22:44:02.365001+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101148+0000","last_change":"2024-09-15T22:43:00.823437+0000","last_active":"2024-09-15T22:44:02.101148+0000","last_peered":"2024-09-15T22:44:02.101148+0000","last_clean":"2024-09-15T22:44:02.101148+0000","last_became_active":"2024-09-15T22:43:00.822815+0000","last_became_peered":"2024-09-15T22:43:00.822815+0000","last_unstale":"2024-09-15T22:44:02.101148+0000","last_undegraded":"2024-09-15T22:44:02.101148+0000","last_fullsized":"2024-09-15T22:44:02.101148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:22.880248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104936+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:44:02.104936+0000","last_peered":"2024-09-15T22:44:02.104936+0000","last_clean":"2024-09-15T22:44:02.104936+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:44:02.104936+0000","last_undegraded":"2024-09-15T22:44:02.104936+0000","last_fullsized":"2024-09-15T22:44:02.104936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:29.874217+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:44:29.874217+0000","last_peered":"2024-09-15T22:44:29.874217+0000","last_clean":"2024-09-15T22:44:29.874217+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:44:29.874217+0000","last_undegraded":"2024-09-15T22:44:29.874217+0000","last_fullsized":"2024-09-15T22:44:29.874217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106917+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:44:02.106917+0000","last_peered":"2024-09-15T22:44:02.106917+0000","last_clean":"2024-09-15T22:44:02.106917+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:44:02.106917+0000","last_undegraded":"2024-09-15T22:44:02.106917+0000","last_fullsized":"2024-09-15T22:44:02.106917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229872+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:44:02.229872+0000","last_peered":"2024-09-15T22:44:02.229872+0000","last_clean":"2024-09-15T22:44:02.229872+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:44:02.229872+0000","last_undegraded":"2024-09-15T22:44:02.229872+0000","last_fullsized":"2024-09-15T22:44:02.229872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:29.886904+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:44:29.886904+0000","last_peered":"2024-09-15T22:44:29.886904+0000","last_clean":"2024-09-15T22:44:29.886904+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:44:29.886904+0000","last_undegraded":"2024-09-15T22:44:29.886904+0000","last_fullsized":"2024-09-15T22:44:29.886904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108702+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:44:02.108702+0000","last_peered":"2024-09-15T22:44:02.108702+0000","last_clean":"2024-09-15T22:44:02.108702+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:44:02.108702+0000","last_undegraded":"2024-09-15T22:44:02.108702+0000","last_fullsized":"2024-09-15T22:44:02.108702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105942+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:44:02.105942+0000","last_peered":"2024-09-15T22:44:02.105942+0000","last_clean":"2024-09-15T22:44:02.105942+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:44:02.105942+0000","last_undegraded":"2024-09-15T22:44:02.105942+0000","last_fullsized":"2024-09-15T22:44:02.105942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103824+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:44:02.103824+0000","last_peered":"2024-09-15T22:44:02.103824+0000","last_clean":"2024-09-15T22:44:02.103824+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:44:02.103824+0000","last_undegraded":"2024-09-15T22:44:02.103824+0000","last_fullsized":"2024-09-15T22:44:02.103824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230312+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:44:02.230312+0000","last_peered":"2024-09-15T22:44:02.230312+0000","last_clean":"2024-09-15T22:44:02.230312+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:44:02.230312+0000","last_undegraded":"2024-09-15T22:44:02.230312+0000","last_fullsized":"2024-09-15T22:44:02.230312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106622+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:44:02.106622+0000","last_peered":"2024-09-15T22:44:02.106622+0000","last_clean":"2024-09-15T22:44:02.106622+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:44:02.106622+0000","last_undegraded":"2024-09-15T22:44:02.106622+0000","last_fullsized":"2024-09-15T22:44:02.106622+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304615+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:44:02.304615+0000","last_peered":"2024-09-15T22:44:02.304615+0000","last_clean":"2024-09-15T22:44:02.304615+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:44:02.304615+0000","last_undegraded":"2024-09-15T22:44:02.304615+0000","last_fullsized":"2024-09-15T22:44:02.304615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103978+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:44:02.103978+0000","last_peered":"2024-09-15T22:44:02.103978+0000","last_clean":"2024-09-15T22:44:02.103978+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:44:02.103978+0000","last_undegraded":"2024-09-15T22:44:02.103978+0000","last_fullsized":"2024-09-15T22:44:02.103978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104594+0000","last_change":"2024-09-15T22:43:00.818418+0000","last_active":"2024-09-15T22:44:02.104594+0000","last_peered":"2024-09-15T22:44:02.104594+0000","last_clean":"2024-09-15T22:44:02.104594+0000","last_became_active":"2024-09-15T22:43:00.818013+0000","last_became_peered":"2024-09-15T22:43:00.818013+0000","last_unstale":"2024-09-15T22:44:02.104594+0000","last_undegraded":"2024-09-15T22:44:02.104594+0000","last_fullsized":"2024-09-15T22:44:02.104594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:32.460336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105290+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:44:02.105290+0000","last_peered":"2024-09-15T22:44:02.105290+0000","last_clean":"2024-09-15T22:44:02.105290+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:44:02.105290+0000","last_undegraded":"2024-09-15T22:44:02.105290+0000","last_fullsized":"2024-09-15T22:44:02.105290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":94,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:29.930997+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:44:29.930997+0000","last_peered":"2024-09-15T22:44:29.930997+0000","last_clean":"2024-09-15T22:44:29.930997+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:44:29.930997+0000","last_undegraded":"2024-09-15T22:44:29.930997+0000","last_fullsized":"2024-09-15T22:44:29.930997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106488+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:44:02.106488+0000","last_peered":"2024-09-15T22:44:02.106488+0000","last_clean":"2024-09-15T22:44:02.106488+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:44:02.106488+0000","last_undegraded":"2024-09-15T22:44:02.106488+0000","last_fullsized":"2024-09-15T22:44:02.106488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.367278+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:44:02.367278+0000","last_peered":"2024-09-15T22:44:02.367278+0000","last_clean":"2024-09-15T22:44:02.367278+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:44:02.367278+0000","last_undegraded":"2024-09-15T22:44:02.367278+0000","last_fullsized":"2024-09-15T22:44:02.367278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230665+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:44:02.230665+0000","last_peered":"2024-09-15T22:44:02.230665+0000","last_clean":"2024-09-15T22:44:02.230665+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:44:02.230665+0000","last_undegraded":"2024-09-15T22:44:02.230665+0000","last_fullsized":"2024-09-15T22:44:02.230665+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107378+0000","last_change":"2024-09-15T22:43:00.815559+0000","last_active":"2024-09-15T22:44:02.107378+0000","last_peered":"2024-09-15T22:44:02.107378+0000","last_clean":"2024-09-15T22:44:02.107378+0000","last_became_active":"2024-09-15T22:43:00.815204+0000","last_became_peered":"2024-09-15T22:43:00.815204+0000","last_unstale":"2024-09-15T22:44:02.107378+0000","last_undegraded":"2024-09-15T22:44:02.107378+0000","last_fullsized":"2024-09-15T22:44:02.107378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:30.736201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105305+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:44:02.105305+0000","last_peered":"2024-09-15T22:44:02.105305+0000","last_clean":"2024-09-15T22:44:02.105305+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:44:02.105305+0000","last_undegraded":"2024-09-15T22:44:02.105305+0000","last_fullsized":"2024-09-15T22:44:02.105305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107825+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:44:02.107825+0000","last_peered":"2024-09-15T22:44:02.107825+0000","last_clean":"2024-09-15T22:44:02.107825+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:44:02.107825+0000","last_undegraded":"2024-09-15T22:44:02.107825+0000","last_fullsized":"2024-09-15T22:44:02.107825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229685+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:44:02.229685+0000","last_peered":"2024-09-15T22:44:02.229685+0000","last_clean":"2024-09-15T22:44:02.229685+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:44:02.229685+0000","last_undegraded":"2024-09-15T22:44:02.229685+0000","last_fullsized":"2024-09-15T22:44:02.229685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103524+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:44:02.103524+0000","last_peered":"2024-09-15T22:44:02.103524+0000","last_clean":"2024-09-15T22:44:02.103524+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:44:02.103524+0000","last_undegraded":"2024-09-15T22:44:02.103524+0000","last_fullsized":"2024-09-15T22:44:02.103524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101615+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:44:02.101615+0000","last_peered":"2024-09-15T22:44:02.101615+0000","last_clean":"2024-09-15T22:44:02.101615+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:44:02.101615+0000","last_undegraded":"2024-09-15T22:44:02.101615+0000","last_fullsized":"2024-09-15T22:44:02.101615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229922+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:44:02.229922+0000","last_peered":"2024-09-15T22:44:02.229922+0000","last_clean":"2024-09-15T22:44:02.229922+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:44:02.229922+0000","last_undegraded":"2024-09-15T22:44:02.229922+0000","last_fullsized":"2024-09-15T22:44:02.229922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230093+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:44:02.230093+0000","last_peered":"2024-09-15T22:44:02.230093+0000","last_clean":"2024-09-15T22:44:02.230093+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:44:02.230093+0000","last_undegraded":"2024-09-15T22:44:02.230093+0000","last_fullsized":"2024-09-15T22:44:02.230093+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101006+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:44:02.101006+0000","last_peered":"2024-09-15T22:44:02.101006+0000","last_clean":"2024-09-15T22:44:02.101006+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:44:02.101006+0000","last_undegraded":"2024-09-15T22:44:02.101006+0000","last_fullsized":"2024-09-15T22:44:02.101006+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107713+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:44:02.107713+0000","last_peered":"2024-09-15T22:44:02.107713+0000","last_clean":"2024-09-15T22:44:02.107713+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:44:02.107713+0000","last_undegraded":"2024-09-15T22:44:02.107713+0000","last_fullsized":"2024-09-15T22:44:02.107713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103717+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:44:02.103717+0000","last_peered":"2024-09-15T22:44:02.103717+0000","last_clean":"2024-09-15T22:44:02.103717+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:44:02.103717+0000","last_undegraded":"2024-09-15T22:44:02.103717+0000","last_fullsized":"2024-09-15T22:44:02.103717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:30.889277+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:44:30.889277+0000","last_peered":"2024-09-15T22:44:30.889277+0000","last_clean":"2024-09-15T22:44:30.889277+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:44:30.889277+0000","last_undegraded":"2024-09-15T22:44:30.889277+0000","last_fullsized":"2024-09-15T22:44:30.889277+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364818+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:44:02.364818+0000","last_peered":"2024-09-15T22:44:02.364818+0000","last_clean":"2024-09-15T22:44:02.364818+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:44:02.364818+0000","last_undegraded":"2024-09-15T22:44:02.364818+0000","last_fullsized":"2024-09-15T22:44:02.364818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104410+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:44:02.104410+0000","last_peered":"2024-09-15T22:44:02.104410+0000","last_clean":"2024-09-15T22:44:02.104410+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:44:02.104410+0000","last_undegraded":"2024-09-15T22:44:02.104410+0000","last_fullsized":"2024-09-15T22:44:02.104410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230361+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:44:02.230361+0000","last_peered":"2024-09-15T22:44:02.230361+0000","last_clean":"2024-09-15T22:44:02.230361+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:44:02.230361+0000","last_undegraded":"2024-09-15T22:44:02.230361+0000","last_fullsized":"2024-09-15T22:44:02.230361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103220+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:44:02.103220+0000","last_peered":"2024-09-15T22:44:02.103220+0000","last_clean":"2024-09-15T22:44:02.103220+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:44:02.103220+0000","last_undegraded":"2024-09-15T22:44:02.103220+0000","last_fullsized":"2024-09-15T22:44:02.103220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108505+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:44:02.108505+0000","last_peered":"2024-09-15T22:44:02.108505+0000","last_clean":"2024-09-15T22:44:02.108505+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:44:02.108505+0000","last_undegraded":"2024-09-15T22:44:02.108505+0000","last_fullsized":"2024-09-15T22:44:02.108505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.126923+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:44:02.126923+0000","last_peered":"2024-09-15T22:44:02.126923+0000","last_clean":"2024-09-15T22:44:02.126923+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:44:02.126923+0000","last_undegraded":"2024-09-15T22:44:02.126923+0000","last_fullsized":"2024-09-15T22:44:02.126923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230323+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:44:02.230323+0000","last_peered":"2024-09-15T22:44:02.230323+0000","last_clean":"2024-09-15T22:44:02.230323+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:44:02.230323+0000","last_undegraded":"2024-09-15T22:44:02.230323+0000","last_fullsized":"2024-09-15T22:44:02.230323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101523+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:44:02.101523+0000","last_peered":"2024-09-15T22:44:02.101523+0000","last_clean":"2024-09-15T22:44:02.101523+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:44:02.101523+0000","last_undegraded":"2024-09-15T22:44:02.101523+0000","last_fullsized":"2024-09-15T22:44:02.101523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'34","reported_seq":177,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:27.859322+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:44:27.859322+0000","last_peered":"2024-09-15T22:44:27.859322+0000","last_clean":"2024-09-15T22:44:27.859322+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:44:27.859322+0000","last_undegraded":"2024-09-15T22:44:27.859322+0000","last_fullsized":"2024-09-15T22:44:27.859322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.364131+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:44:02.364131+0000","last_peered":"2024-09-15T22:44:02.364131+0000","last_clean":"2024-09-15T22:44:02.364131+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:44:02.364131+0000","last_undegraded":"2024-09-15T22:44:02.364131+0000","last_fullsized":"2024-09-15T22:44:02.364131+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108255+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:44:02.108255+0000","last_peered":"2024-09-15T22:44:02.108255+0000","last_clean":"2024-09-15T22:44:02.108255+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:44:02.108255+0000","last_undegraded":"2024-09-15T22:44:02.108255+0000","last_fullsized":"2024-09-15T22:44:02.108255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230604+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:44:02.230604+0000","last_peered":"2024-09-15T22:44:02.230604+0000","last_clean":"2024-09-15T22:44:02.230604+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:44:02.230604+0000","last_undegraded":"2024-09-15T22:44:02.230604+0000","last_fullsized":"2024-09-15T22:44:02.230604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304497+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:44:02.304497+0000","last_peered":"2024-09-15T22:44:02.304497+0000","last_clean":"2024-09-15T22:44:02.304497+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:44:02.304497+0000","last_undegraded":"2024-09-15T22:44:02.304497+0000","last_fullsized":"2024-09-15T22:44:02.304497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108496+0000","last_change":"2024-09-15T22:42:53.548636+0000","last_active":"2024-09-15T22:44:02.108496+0000","last_peered":"2024-09-15T22:44:02.108496+0000","last_clean":"2024-09-15T22:44:02.108496+0000","last_became_active":"2024-09-15T22:42:53.548229+0000","last_became_peered":"2024-09-15T22:42:53.548229+0000","last_unstale":"2024-09-15T22:44:02.108496+0000","last_undegraded":"2024-09-15T22:44:02.108496+0000","last_fullsized":"2024-09-15T22:44:02.108496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105220+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:44:02.105220+0000","last_peered":"2024-09-15T22:44:02.105220+0000","last_clean":"2024-09-15T22:44:02.105220+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:44:02.105220+0000","last_undegraded":"2024-09-15T22:44:02.105220+0000","last_fullsized":"2024-09-15T22:44:02.105220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.363398+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:44:02.363398+0000","last_peered":"2024-09-15T22:44:02.363398+0000","last_clean":"2024-09-15T22:44:02.363398+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:44:02.363398+0000","last_undegraded":"2024-09-15T22:44:02.363398+0000","last_fullsized":"2024-09-15T22:44:02.363398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107204+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:44:02.107204+0000","last_peered":"2024-09-15T22:44:02.107204+0000","last_clean":"2024-09-15T22:44:02.107204+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:44:02.107204+0000","last_undegraded":"2024-09-15T22:44:02.107204+0000","last_fullsized":"2024-09-15T22:44:02.107204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:27.859295+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:44:27.859295+0000","last_peered":"2024-09-15T22:44:27.859295+0000","last_clean":"2024-09-15T22:44:27.859295+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:44:27.859295+0000","last_undegraded":"2024-09-15T22:44:27.859295+0000","last_fullsized":"2024-09-15T22:44:27.859295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108686+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:44:02.108686+0000","last_peered":"2024-09-15T22:44:02.108686+0000","last_clean":"2024-09-15T22:44:02.108686+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:44:02.108686+0000","last_undegraded":"2024-09-15T22:44:02.108686+0000","last_fullsized":"2024-09-15T22:44:02.108686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109515+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:44:02.109515+0000","last_peered":"2024-09-15T22:44:02.109515+0000","last_clean":"2024-09-15T22:44:02.109515+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:44:02.109515+0000","last_undegraded":"2024-09-15T22:44:02.109515+0000","last_fullsized":"2024-09-15T22:44:02.109515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.363767+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:44:02.363767+0000","last_peered":"2024-09-15T22:44:02.363767+0000","last_clean":"2024-09-15T22:44:02.363767+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:44:02.363767+0000","last_undegraded":"2024-09-15T22:44:02.363767+0000","last_fullsized":"2024-09-15T22:44:02.363767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230154+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:44:02.230154+0000","last_peered":"2024-09-15T22:44:02.230154+0000","last_clean":"2024-09-15T22:44:02.230154+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:44:02.230154+0000","last_undegraded":"2024-09-15T22:44:02.230154+0000","last_fullsized":"2024-09-15T22:44:02.230154+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103280+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:44:02.103280+0000","last_peered":"2024-09-15T22:44:02.103280+0000","last_clean":"2024-09-15T22:44:02.103280+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:44:02.103280+0000","last_undegraded":"2024-09-15T22:44:02.103280+0000","last_fullsized":"2024-09-15T22:44:02.103280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106302+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:44:02.106302+0000","last_peered":"2024-09-15T22:44:02.106302+0000","last_clean":"2024-09-15T22:44:02.106302+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:44:02.106302+0000","last_undegraded":"2024-09-15T22:44:02.106302+0000","last_fullsized":"2024-09-15T22:44:02.106302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106057+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:44:02.106057+0000","last_peered":"2024-09-15T22:44:02.106057+0000","last_clean":"2024-09-15T22:44:02.106057+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:44:02.106057+0000","last_undegraded":"2024-09-15T22:44:02.106057+0000","last_fullsized":"2024-09-15T22:44:02.106057+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.310276+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:44:02.310276+0000","last_peered":"2024-09-15T22:44:02.310276+0000","last_clean":"2024-09-15T22:44:02.310276+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:44:02.310276+0000","last_undegraded":"2024-09-15T22:44:02.310276+0000","last_fullsized":"2024-09-15T22:44:02.310276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.230347+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:44:02.230347+0000","last_peered":"2024-09-15T22:44:02.230347+0000","last_clean":"2024-09-15T22:44:02.230347+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:44:02.230347+0000","last_undegraded":"2024-09-15T22:44:02.230347+0000","last_fullsized":"2024-09-15T22:44:02.230347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106324+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:44:02.106324+0000","last_peered":"2024-09-15T22:44:02.106324+0000","last_clean":"2024-09-15T22:44:02.106324+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:44:02.106324+0000","last_undegraded":"2024-09-15T22:44:02.106324+0000","last_fullsized":"2024-09-15T22:44:02.106324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":94,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:29.862591+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:44:29.862591+0000","last_peered":"2024-09-15T22:44:29.862591+0000","last_clean":"2024-09-15T22:44:29.862591+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:44:29.862591+0000","last_undegraded":"2024-09-15T22:44:29.862591+0000","last_fullsized":"2024-09-15T22:44:29.862591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101123+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:44:02.101123+0000","last_peered":"2024-09-15T22:44:02.101123+0000","last_clean":"2024-09-15T22:44:02.101123+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:44:02.101123+0000","last_undegraded":"2024-09-15T22:44:02.101123+0000","last_fullsized":"2024-09-15T22:44:02.101123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105635+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:44:02.105635+0000","last_peered":"2024-09-15T22:44:02.105635+0000","last_clean":"2024-09-15T22:44:02.105635+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:44:02.105635+0000","last_undegraded":"2024-09-15T22:44:02.105635+0000","last_fullsized":"2024-09-15T22:44:02.105635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103002+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:44:02.103002+0000","last_peered":"2024-09-15T22:44:02.103002+0000","last_clean":"2024-09-15T22:44:02.103002+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:44:02.103002+0000","last_undegraded":"2024-09-15T22:44:02.103002+0000","last_fullsized":"2024-09-15T22:44:02.103002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105801+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:44:02.105801+0000","last_peered":"2024-09-15T22:44:02.105801+0000","last_clean":"2024-09-15T22:44:02.105801+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:44:02.105801+0000","last_undegraded":"2024-09-15T22:44:02.105801+0000","last_fullsized":"2024-09-15T22:44:02.105801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105413+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:44:02.105413+0000","last_peered":"2024-09-15T22:44:02.105413+0000","last_clean":"2024-09-15T22:44:02.105413+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:44:02.105413+0000","last_undegraded":"2024-09-15T22:44:02.105413+0000","last_fullsized":"2024-09-15T22:44:02.105413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107475+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:44:02.107475+0000","last_peered":"2024-09-15T22:44:02.107475+0000","last_clean":"2024-09-15T22:44:02.107475+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:44:02.107475+0000","last_undegraded":"2024-09-15T22:44:02.107475+0000","last_fullsized":"2024-09-15T22:44:02.107475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107203+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:44:02.107203+0000","last_peered":"2024-09-15T22:44:02.107203+0000","last_clean":"2024-09-15T22:44:02.107203+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:44:02.107203+0000","last_undegraded":"2024-09-15T22:44:02.107203+0000","last_fullsized":"2024-09-15T22:44:02.107203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103399+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:44:02.103399+0000","last_peered":"2024-09-15T22:44:02.103399+0000","last_clean":"2024-09-15T22:44:02.103399+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:44:02.103399+0000","last_undegraded":"2024-09-15T22:44:02.103399+0000","last_fullsized":"2024-09-15T22:44:02.103399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106122+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:44:02.106122+0000","last_peered":"2024-09-15T22:44:02.106122+0000","last_clean":"2024-09-15T22:44:02.106122+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:44:02.106122+0000","last_undegraded":"2024-09-15T22:44:02.106122+0000","last_fullsized":"2024-09-15T22:44:02.106122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108209+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:44:02.108209+0000","last_peered":"2024-09-15T22:44:02.108209+0000","last_clean":"2024-09-15T22:44:02.108209+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:44:02.108209+0000","last_undegraded":"2024-09-15T22:44:02.108209+0000","last_fullsized":"2024-09-15T22:44:02.108209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.229870+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:44:02.229870+0000","last_peered":"2024-09-15T22:44:02.229870+0000","last_clean":"2024-09-15T22:44:02.229870+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:44:02.229870+0000","last_undegraded":"2024-09-15T22:44:02.229870+0000","last_fullsized":"2024-09-15T22:44:02.229870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109493+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:44:02.109493+0000","last_peered":"2024-09-15T22:44:02.109493+0000","last_clean":"2024-09-15T22:44:02.109493+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:44:02.109493+0000","last_undegraded":"2024-09-15T22:44:02.109493+0000","last_fullsized":"2024-09-15T22:44:02.109493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106652+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:44:02.106652+0000","last_peered":"2024-09-15T22:44:02.106652+0000","last_clean":"2024-09-15T22:44:02.106652+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:44:02.106652+0000","last_undegraded":"2024-09-15T22:44:02.106652+0000","last_fullsized":"2024-09-15T22:44:02.106652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.110034+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:44:02.110034+0000","last_peered":"2024-09-15T22:44:02.110034+0000","last_clean":"2024-09-15T22:44:02.110034+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:44:02.110034+0000","last_undegraded":"2024-09-15T22:44:02.110034+0000","last_fullsized":"2024-09-15T22:44:02.110034+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103349+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:44:02.103349+0000","last_peered":"2024-09-15T22:44:02.103349+0000","last_clean":"2024-09-15T22:44:02.103349+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:44:02.103349+0000","last_undegraded":"2024-09-15T22:44:02.103349+0000","last_fullsized":"2024-09-15T22:44:02.103349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105842+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:44:02.105842+0000","last_peered":"2024-09-15T22:44:02.105842+0000","last_clean":"2024-09-15T22:44:02.105842+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:44:02.105842+0000","last_undegraded":"2024-09-15T22:44:02.105842+0000","last_fullsized":"2024-09-15T22:44:02.105842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.365216+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:44:02.365216+0000","last_peered":"2024-09-15T22:44:02.365216+0000","last_clean":"2024-09-15T22:44:02.365216+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:44:02.365216+0000","last_undegraded":"2024-09-15T22:44:02.365216+0000","last_fullsized":"2024-09-15T22:44:02.365216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103684+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:44:02.103684+0000","last_peered":"2024-09-15T22:44:02.103684+0000","last_clean":"2024-09-15T22:44:02.103684+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:44:02.103684+0000","last_undegraded":"2024-09-15T22:44:02.103684+0000","last_fullsized":"2024-09-15T22:44:02.103684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106475+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:44:02.106475+0000","last_peered":"2024-09-15T22:44:02.106475+0000","last_clean":"2024-09-15T22:44:02.106475+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:44:02.106475+0000","last_undegraded":"2024-09-15T22:44:02.106475+0000","last_fullsized":"2024-09-15T22:44:02.106475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.115253+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:44:02.115253+0000","last_peered":"2024-09-15T22:44:02.115253+0000","last_clean":"2024-09-15T22:44:02.115253+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:44:02.115253+0000","last_undegraded":"2024-09-15T22:44:02.115253+0000","last_fullsized":"2024-09-15T22:44:02.115253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107084+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:44:02.107084+0000","last_peered":"2024-09-15T22:44:02.107084+0000","last_clean":"2024-09-15T22:44:02.107084+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:44:02.107084+0000","last_undegraded":"2024-09-15T22:44:02.107084+0000","last_fullsized":"2024-09-15T22:44:02.107084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.367418+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:44:02.367418+0000","last_peered":"2024-09-15T22:44:02.367418+0000","last_clean":"2024-09-15T22:44:02.367418+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:44:02.367418+0000","last_undegraded":"2024-09-15T22:44:02.367418+0000","last_fullsized":"2024-09-15T22:44:02.367418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304890+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:44:02.304890+0000","last_peered":"2024-09-15T22:44:02.304890+0000","last_clean":"2024-09-15T22:44:02.304890+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:44:02.304890+0000","last_undegraded":"2024-09-15T22:44:02.304890+0000","last_fullsized":"2024-09-15T22:44:02.304890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.105178+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:44:02.105178+0000","last_peered":"2024-09-15T22:44:02.105178+0000","last_clean":"2024-09-15T22:44:02.105178+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:44:02.105178+0000","last_undegraded":"2024-09-15T22:44:02.105178+0000","last_fullsized":"2024-09-15T22:44:02.105178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104559+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:44:02.104559+0000","last_peered":"2024-09-15T22:44:02.104559+0000","last_clean":"2024-09-15T22:44:02.104559+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:44:02.104559+0000","last_undegraded":"2024-09-15T22:44:02.104559+0000","last_fullsized":"2024-09-15T22:44:02.104559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.108335+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:44:02.108335+0000","last_peered":"2024-09-15T22:44:02.108335+0000","last_clean":"2024-09-15T22:44:02.108335+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:44:02.108335+0000","last_undegraded":"2024-09-15T22:44:02.108335+0000","last_fullsized":"2024-09-15T22:44:02.108335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.106211+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:44:02.106211+0000","last_peered":"2024-09-15T22:44:02.106211+0000","last_clean":"2024-09-15T22:44:02.106211+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:44:02.106211+0000","last_undegraded":"2024-09-15T22:44:02.106211+0000","last_fullsized":"2024-09-15T22:44:02.106211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.104081+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:44:02.104081+0000","last_peered":"2024-09-15T22:44:02.104081+0000","last_clean":"2024-09-15T22:44:02.104081+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:44:02.104081+0000","last_undegraded":"2024-09-15T22:44:02.104081+0000","last_fullsized":"2024-09-15T22:44:02.104081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103708+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:44:02.103708+0000","last_peered":"2024-09-15T22:44:02.103708+0000","last_clean":"2024-09-15T22:44:02.103708+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:44:02.103708+0000","last_undegraded":"2024-09-15T22:44:02.103708+0000","last_fullsized":"2024-09-15T22:44:02.103708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.101156+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:44:02.101156+0000","last_peered":"2024-09-15T22:44:02.101156+0000","last_clean":"2024-09-15T22:44:02.101156+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:44:02.101156+0000","last_undegraded":"2024-09-15T22:44:02.101156+0000","last_fullsized":"2024-09-15T22:44:02.101156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.304853+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:44:02.304853+0000","last_peered":"2024-09-15T22:44:02.304853+0000","last_clean":"2024-09-15T22:44:02.304853+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:44:02.304853+0000","last_undegraded":"2024-09-15T22:44:02.304853+0000","last_fullsized":"2024-09-15T22:44:02.304853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.107854+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:44:02.107854+0000","last_peered":"2024-09-15T22:44:02.107854+0000","last_clean":"2024-09-15T22:44:02.107854+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:44:02.107854+0000","last_undegraded":"2024-09-15T22:44:02.107854+0000","last_fullsized":"2024-09-15T22:44:02.107854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.109617+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:44:02.109617+0000","last_peered":"2024-09-15T22:44:02.109617+0000","last_clean":"2024-09-15T22:44:02.109617+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:44:02.109617+0000","last_undegraded":"2024-09-15T22:44:02.109617+0000","last_fullsized":"2024-09-15T22:44:02.109617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:44:02.103571+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:44:02.103571+0000","last_peered":"2024-09-15T22:44:02.103571+0000","last_clean":"2024-09-15T22:44:02.103571+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:44:02.103571+0000","last_undegraded":"2024-09-15T22:44:02.103571+0000","last_fullsized":"2024-09-15T22:44:02.103571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68891,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":553,"num_read_kb":346,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":492303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841573,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1691648,"data_stored":1141127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":496261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":492543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1617920,"data_stored":1089042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":488062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1626112,"data_stored":1084231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":491743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":487377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1077248,"data_stored":550927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1064960,"data_stored":551168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":489125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:44:33.440 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:44:33.440 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:44:33.440 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:44:33.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T22:44:33.700 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 -- 172.21.15.66:0/1690275087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 msgr2=0x7f39641021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 --2- 172.21.15.66:0/1690275087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f39641021d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3954009900 tx=0x7f395402a3f0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 -- 172.21.15.66:0/1690275087 shutdown_connections 2024-09-15T22:44:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 --2- 172.21.15.66:0/1690275087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 --2- 172.21.15.66:0/1690275087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 0x7f39641067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 --2- 172.21.15.66:0/1690275087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f39641021d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 -- 172.21.15.66:0/1690275087 >> 172.21.15.66:0/1690275087 conn(0x7f39640fd8f0 msgr2=0x7f39640ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:34.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 -- 172.21.15.66:0/1690275087 shutdown_connections 2024-09-15T22:44:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.201+0000 7f396940b640 1 -- 172.21.15.66:0/1690275087 wait complete. 2024-09-15T22:44:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 Processor -- start 2024-09-15T22:44:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 -- start start 2024-09-15T22:44:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 0x7f3964198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3964111f40 con 0x7f3964101df0 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3964111dc0 con 0x7f3964106f20 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f396940b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39641120c0 con 0x7f39641027a0 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f3962ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f3962ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39076/0 (socket says 172.21.15.66:39076) 2024-09-15T22:44:34.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f3962ffd640 1 -- 172.21.15.66:0/857306128 learned_addr learned my addr 172.21.15.66:0/857306128 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f39637fe640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.202+0000 7f395bfff640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 0x7f3964198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 -- 172.21.15.66:0/857306128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 msgr2=0x7f3964198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 0x7f3964198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 -- 172.21.15.66:0/857306128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 msgr2=0x7f396419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 -- 172.21.15.66:0/857306128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396419d2b0 con 0x7f3964101df0 2024-09-15T22:44:34.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f39637fe640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3962ffd640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3954005ab0 tx=0x7f39540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395403f030 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3954003ce0 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396419d540 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954035070 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.203+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641a4e80 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.204+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39641032d0 con 0x7f3964101df0 2024-09-15T22:44:34.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.205+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3954042030 con 0x7f3964101df0 2024-09-15T22:44:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.206+0000 7f3960ff9640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.206+0000 7f395bfff640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.206+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f39540f07a0 con 0x7f3964101df0 2024-09-15T22:44:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.207+0000 7f395bfff640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39641083b0 tx=0x7f394c005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.211+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39540bd020 con 0x7f3964101df0 2024-09-15T22:44:34.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.425+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f396410a150 con 0x7f3964101df0 2024-09-15T22:44:34.427 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:34 smithi066 ceph-mon[31185]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:34.427 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:34 smithi066 ceph-mon[31185]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:34.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.426+0000 7f3960ff9640 1 -- 172.21.15.66:0/857306128 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f396410a150 con 0x7f3964101df0 2024-09-15T22:44:34.428 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:34.428 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:44:34.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 msgr2=0x7f39500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39641083b0 tx=0x7f394c005cc0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 msgr2=0x7f3964198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3954005ab0 tx=0x7f39540042f0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 shutdown_connections 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f39500a32d0 0x7f39500a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3964106f20 0x7f396419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39641027a0 0x7f3964198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 --2- 172.21.15.66:0/857306128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3964101df0 0x7f3964198300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 >> 172.21.15.66:0/857306128 conn(0x7f39640fd8f0 msgr2=0x7f39640feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:34.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 shutdown_connections 2024-09-15T22:44:34.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:34.428+0000 7f396940b640 1 -- 172.21.15.66:0/857306128 wait complete. 2024-09-15T22:44:34.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:34 smithi087 ceph-mon[35290]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:34.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:34 smithi087 ceph-mon[35290]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:34.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:34 smithi184 ceph-mon[35203]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:34.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:34 smithi184 ceph-mon[35203]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:44:35.106 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:44:35.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:44:35.367 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:35 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/857306128' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:44:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:35 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/857306128' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:44:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:35 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/857306128' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- 172.21.15.66:0/3483496239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 msgr2=0x7f7de810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 --2- 172.21.15.66:0/3483496239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de810da40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009ca0 tx=0x7f7de002a950 comp rx=0 tx=0).stop 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- 172.21.15.66:0/3483496239 shutdown_connections 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 --2- 172.21.15.66:0/3483496239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de810da40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 --2- 172.21.15.66:0/3483496239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 0x7f7de81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 --2- 172.21.15.66:0/3483496239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- 172.21.15.66:0/3483496239 >> 172.21.15.66:0/3483496239 conn(0x7f7de80fc7d0 msgr2=0x7f7de80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- 172.21.15.66:0/3483496239 shutdown_connections 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- 172.21.15.66:0/3483496239 wait complete. 2024-09-15T22:44:35.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 Processor -- start 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.814+0000 7f7def10e640 1 -- start start 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 0x7f7de8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8110f80 con 0x7f7de8102ef0 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8110e00 con 0x7f7de8100e20 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7def10e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8111100 con 0x7f7de8102570 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39088/0 (socket says 172.21.15.66:39088) 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 -- 172.21.15.66:0/3857316601 learned_addr learned my addr 172.21.15.66:0/3857316601 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7deceaa640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7de7fff640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 0x7f7de8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 -- 172.21.15.66:0/3857316601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 msgr2=0x7f7de8199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 0x7f7de8199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 -- 172.21.15.66:0/3857316601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 msgr2=0x7f7de8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:35.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 -- 172.21.15.66:0/3857316601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de81a48f0 con 0x7f7de8102ef0 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7deceaa640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7ded6ab640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7de0004af0 tx=0x7f7de002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.815+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0034040 con 0x7f7de8102ef0 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.816+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de0030920 con 0x7f7de8102ef0 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.816+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de81a4ac0 con 0x7f7de8102ef0 2024-09-15T22:44:35.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.816+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0004820 con 0x7f7de8102ef0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.816+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de81a4fa0 con 0x7f7de8102ef0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.817+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de8101200 con 0x7f7de8102ef0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.818+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7de0037020 con 0x7f7de8102ef0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.819+0000 7f7de5ffb640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 0x7f7dd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.819+0000 7f7deceaa640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 0x7f7dd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.819+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7de00f0bd0 con 0x7f7de8102ef0 2024-09-15T22:44:35.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.820+0000 7f7deceaa640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 0x7f7dd80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0058c0 tx=0x7f7ddc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:35.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:35.822+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7de00443e0 con 0x7f7de8102ef0 2024-09-15T22:44:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.037+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7de81a5170 con 0x7f7de8102ef0 2024-09-15T22:44:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.037+0000 7f7de5ffb640 1 -- 172.21.15.66:0/3857316601 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7f7de00bd560 con 0x7f7de8102ef0 2024-09-15T22:44:36.039 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:36.039 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:44:36.039 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 msgr2=0x7f7dd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 0x7f7dd80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0058c0 tx=0x7f7ddc005850 comp rx=0 tx=0).stop 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 msgr2=0x7f7de81a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7de0004af0 tx=0x7f7de002f5b0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 shutdown_connections 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7de8102ef0 0x7f7de81a43b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de8102570 0x7f7de8199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7dd80a3350 0x7f7dd80a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 --2- 172.21.15.66:0/3857316601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de8100e20 0x7f7de8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:36.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 >> 172.21.15.66:0/3857316601 conn(0x7f7de80fc7d0 msgr2=0x7f7de8106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:36.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 shutdown_connections 2024-09-15T22:44:36.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:36.040+0000 7f7def10e640 1 -- 172.21.15.66:0/3857316601 wait complete. 2024-09-15T22:44:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:36 smithi087 ceph-mon[35290]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:36 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3857316601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:36.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:36 smithi184 ceph-mon[35203]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:36.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:36 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3857316601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:36.696 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:36 smithi066 ceph-mon[31185]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:36.696 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:36 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3857316601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:36.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:44:36.989 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:37.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 -- 172.21.15.66:0/1611835586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138106ba0 msgr2=0x7f5138106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:37.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 --2- 172.21.15.66:0/1611835586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138106ba0 0x7f5138106f80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5120009900 tx=0x7f512002a410 comp rx=0 tx=0).stop 2024-09-15T22:44:37.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 -- 172.21.15.66:0/1611835586 shutdown_connections 2024-09-15T22:44:37.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 --2- 172.21.15.66:0/1611835586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5138100a70 0x7f513810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 --2- 172.21.15.66:0/1611835586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51381000d0 0x7f5138100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 --2- 172.21.15.66:0/1611835586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138106ba0 0x7f5138106f80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 -- 172.21.15.66:0/1611835586 >> 172.21.15.66:0/1611835586 conn(0x7f5138077210 msgr2=0x7f51380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:37.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 -- 172.21.15.66:0/1611835586 shutdown_connections 2024-09-15T22:44:37.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.405+0000 7f513d418640 1 -- 172.21.15.66:0/1611835586 wait complete. 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 Processor -- start 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 -- start start 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51381000d0 0x7f51381012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 0x7f5138101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5138112090 con 0x7f5138100a70 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5138111f10 con 0x7f51381000d0 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f513d418640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5138112210 con 0x7f5138106ba0 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f51367fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f51367fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39102/0 (socket says 172.21.15.66:39102) 2024-09-15T22:44:37.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f51367fc640 1 -- 172.21.15.66:0/2122084344 learned_addr learned my addr 172.21.15.66:0/2122084344 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f5136ffd640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51381000d0 0x7f51381012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.406+0000 7f51377fe640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 0x7f5138101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 -- 172.21.15.66:0/2122084344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 msgr2=0x7f5138101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 0x7f5138101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 -- 172.21.15.66:0/2122084344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51381000d0 msgr2=0x7f51381012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51381000d0 0x7f51381012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 -- 172.21.15.66:0/2122084344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51381a6a70 con 0x7f5138100a70 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51377fe640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 0x7f5138101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f51367fc640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f512800d770 tx=0x7f512800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128017070 con 0x7f5138100a70 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51381a6d60 con 0x7f5138100a70 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5128005500 con 0x7f5138100a70 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128004e00 con 0x7f5138100a70 2024-09-15T22:44:37.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.407+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381a7240 con 0x7f5138100a70 2024-09-15T22:44:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.408+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5138100530 con 0x7f5138100a70 2024-09-15T22:44:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.409+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5128004fa0 con 0x7f5138100a70 2024-09-15T22:44:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.410+0000 7f512ffff640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 0x7f51240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.410+0000 7f5136ffd640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 0x7f51240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:37.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.410+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f51280cf7a0 con 0x7f5138100a70 2024-09-15T22:44:37.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.410+0000 7f5136ffd640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 0x7f51240a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5120009230 tx=0x7f51200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:37.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.414+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f512809c020 con 0x7f5138100a70 2024-09-15T22:44:37.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.629+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f513810a090 con 0x7f5138100a70 2024-09-15T22:44:37.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.630+0000 7f512ffff640 1 -- 172.21.15.66:0/2122084344 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7f512809b920 con 0x7f5138100a70 2024-09-15T22:44:37.632 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:37.632 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:44:37.632 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:44:37.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 msgr2=0x7f51240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:37.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 0x7f51240a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5120009230 tx=0x7f51200058d0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 msgr2=0x7f51381017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f512800d770 tx=0x7f512800dc30 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 shutdown_connections 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5138106ba0 0x7f5138101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5138100a70 0x7f51381017f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f51240a3350 0x7f51240a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 --2- 172.21.15.66:0/2122084344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51381000d0 0x7f51381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 >> 172.21.15.66:0/2122084344 conn(0x7f5138077210 msgr2=0x7f5138104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 shutdown_connections 2024-09-15T22:44:37.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:37.632+0000 7f513d418640 1 -- 172.21.15.66:0/2122084344 wait complete. 2024-09-15T22:44:38.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:44:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:38 smithi087 ceph-mon[35290]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2122084344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:38 smithi184 ceph-mon[35203]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2122084344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:38.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:38 smithi066 ceph-mon[31185]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:38.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2122084344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:38.742 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:39.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 -- 172.21.15.66:0/945797874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8101e10 msgr2=0x7f9fb81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:39.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/945797874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8101e10 0x7f9fb81021f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009ca0 tx=0x7f9fa802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 -- 172.21.15.66:0/945797874 shutdown_connections 2024-09-15T22:44:39.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/945797874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8106f40 0x7f9fb810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/945797874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 0x7f9fb8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/945797874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8101e10 0x7f9fb81021f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 -- 172.21.15.66:0/945797874 >> 172.21.15.66:0/945797874 conn(0x7f9fb80fd8d0 msgr2=0x7f9fb80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 -- 172.21.15.66:0/945797874 shutdown_connections 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.215+0000 7f9fbd43b640 1 -- 172.21.15.66:0/945797874 wait complete. 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 Processor -- start 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 -- start start 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8101e10 0x7f9fb8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 0x7f9fb81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:39.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8111fa0 con 0x7f9fb8106f40 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8111e20 con 0x7f9fb8101e10 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fbd43b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8112120 con 0x7f9fb81027c0 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39120/0 (socket says 172.21.15.66:39120) 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 -- 172.21.15.66:0/103791049 learned_addr learned my addr 172.21.15.66:0/103791049 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb67fc640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 0x7f9fb81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb6ffd640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8101e10 0x7f9fb8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 -- 172.21.15.66:0/103791049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 msgr2=0x7f9fb81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 0x7f9fb81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 -- 172.21.15.66:0/103791049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8101e10 msgr2=0x7f9fb8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8101e10 0x7f9fb8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.216+0000 7f9fb77fe640 1 -- 172.21.15.66:0/103791049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb819d410 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9fb77fe640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d750 tx=0x7f9fb000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0017070 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fb0005500 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb819d700 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0004d90 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.217+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb81a4fe0 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.218+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb81021f0 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.219+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9fb0004f30 con 0x7f9fb8106f40 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.220+0000 7f9faffff640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 0x7f9fa40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.220+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f9fb00cfa70 con 0x7f9fb8106f40 2024-09-15T22:44:39.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.220+0000 7f9fb6ffd640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 0x7f9fa40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:39.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.220+0000 7f9fb6ffd640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 0x7f9fa40a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006010 tx=0x7f9fa8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:39.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.223+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fb009bca0 con 0x7f9fb8106f40 2024-09-15T22:44:39.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.402+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fb81997c0 con 0x7f9fb8106f40 2024-09-15T22:44:39.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.404+0000 7f9faffff640 1 -- 172.21.15.66:0/103791049 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24664 (secure 0 0 0) 0x7f9fb81997c0 con 0x7f9fb8106f40 2024-09-15T22:44:39.405 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:39.406 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":87,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:44:02.096597+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:44:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 msgr2=0x7f9fa40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 0x7f9fa40a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006010 tx=0x7f9fa8009360 comp rx=0 tx=0).stop 2024-09-15T22:44:39.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 msgr2=0x7f9fb819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d750 tx=0x7f9fb000dc10 comp rx=0 tx=0).stop 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 shutdown_connections 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fb8106f40 0x7f9fb819cd30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fb81027c0 0x7f9fb81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9fa40a32d0 0x7f9fa40a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 --2- 172.21.15.66:0/103791049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb8101e10 0x7f9fb8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 >> 172.21.15.66:0/103791049 conn(0x7f9fb80fd8d0 msgr2=0x7f9fb80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 shutdown_connections 2024-09-15T22:44:39.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:39.407+0000 7f9fbd43b640 1 -- 172.21.15.66:0/103791049 wait complete. 2024-09-15T22:44:40.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:44:40.500 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:40.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:40 smithi087 ceph-mon[35290]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:40.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:40 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/103791049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:40.621 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:40 smithi066 ceph-mon[31185]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:40.621 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:40 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/103791049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:40 smithi184 ceph-mon[35203]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-15T22:44:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:40 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/103791049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:44:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 -- 172.21.15.66:0/1798381286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50101de0 msgr2=0x7fbe501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 --2- 172.21.15.66:0/1798381286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50101de0 0x7fbe501021c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009900 tx=0x7fbe4c02a410 comp rx=0 tx=0).stop 2024-09-15T22:44:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 -- 172.21.15.66:0/1798381286 shutdown_connections 2024-09-15T22:44:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 --2- 172.21.15.66:0/1798381286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50106f10 0x7fbe5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 --2- 172.21.15.66:0/1798381286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50102790 0x7fbe501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 --2- 172.21.15.66:0/1798381286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50101de0 0x7fbe501021c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 -- 172.21.15.66:0/1798381286 >> 172.21.15.66:0/1798381286 conn(0x7fbe500fd8c0 msgr2=0x7fbe500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 -- 172.21.15.66:0/1798381286 shutdown_connections 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.000+0000 7fbe57c63640 1 -- 172.21.15.66:0/1798381286 wait complete. 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.001+0000 7fbe57c63640 1 Processor -- start 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.001+0000 7fbe57c63640 1 -- start start 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50101de0 0x7fbe50198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 0x7fbe5019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50111f30 con 0x7fbe50102790 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50111db0 con 0x7fbe50101de0 2024-09-15T22:44:41.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe57c63640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501120b0 con 0x7fbe50106f10 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39148/0 (socket says 172.21.15.66:39148) 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 -- 172.21.15.66:0/605467725 learned_addr learned my addr 172.21.15.66:0/605467725 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe56200640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 0x7fbe5019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe559ff640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50101de0 0x7fbe50198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 -- 172.21.15.66:0/605467725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 msgr2=0x7fbe5019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 0x7fbe5019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 -- 172.21.15.66:0/605467725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50101de0 msgr2=0x7fbe50198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50101de0 0x7fbe50198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 -- 172.21.15.66:0/605467725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5019d3f0 con 0x7fbe50102790 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe56200640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 0x7fbe5019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:41.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe551fe640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d950 tx=0x7fbe4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.002+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40017030 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.003+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe40004020 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.003+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5019d6e0 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.003+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe400047a0 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.003+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501a4fc0 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.004+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe501021c0 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.005+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbe400041d0 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.006+0000 7fbe46ffd640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 0x7fbe3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.006+0000 7fbe559ff640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 0x7fbe3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.006+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fbe400cff20 con 0x7fbe50102790 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.006+0000 7fbe559ff640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 0x7fbe3c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c005ab0 tx=0x7fbe4c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:41.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.009+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe4009c7a0 con 0x7fbe50102790 2024-09-15T22:44:41.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.221+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe501997a0 con 0x7fbe50102790 2024-09-15T22:44:41.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.222+0000 7fbe46ffd640 1 -- 172.21.15.66:0/605467725 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fbe501997a0 con 0x7fbe50102790 2024-09-15T22:44:41.223 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:44:41.223 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:44:41.224 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:44:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 msgr2=0x7fbe3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 0x7fbe3c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c005ab0 tx=0x7fbe4c005a20 comp rx=0 tx=0).stop 2024-09-15T22:44:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 msgr2=0x7fbe50198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d950 tx=0x7fbe4000de10 comp rx=0 tx=0).stop 2024-09-15T22:44:41.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 shutdown_connections 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe50106f10 0x7fbe5019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe50102790 0x7fbe50198980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fbe3c0a32d0 0x7fbe3c0a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 --2- 172.21.15.66:0/605467725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe50101de0 0x7fbe50198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 >> 172.21.15.66:0/605467725 conn(0x7fbe500fd8c0 msgr2=0x7fbe500fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 shutdown_connections 2024-09-15T22:44:41.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:41.224+0000 7fbe57c63640 1 -- 172.21.15.66:0/605467725 wait complete. 2024-09-15T22:44:41.565 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:41 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/605467725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:41 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/605467725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:41 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/605467725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:44:41.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:42:54.256195+0000', 'modified': '2024-09-15T22:43:38.783615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24461, 'mds_1': 24442, 'mds_2': 24437, 'mds_3': 24427, 'mds_4': 24421}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6839/2023001898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2023001898}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2023001898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6841/3123963280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6840', 'nonce': 3123963280}, {'type': 'v1', 'addr': '172.21.15.66:6841', 'nonce': 3123963280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/1400845283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1400845283}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 1400845283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24395': {'gid': 24395, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6833/3190263553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6832', 'nonce': 3190263553}, {'type': 'v1', 'addr': '172.21.15.87:6833', 'nonce': 3190263553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6835/1324797641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 1324797641}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 1324797641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.184:6835/253738152', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 253738152}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 253738152}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.184:6837/2237794156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 2237794156}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2237794156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.87:6837/2256594812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 2256594812}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 2256594812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.184:6839/2085772810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 2085772810}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 2085772810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.87:6839/426418588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 426418588}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 426418588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24461, 'qdb_cluster': [24421, 24427, 24437, 24442, 24461]} 2024-09-15T22:44:41.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-15T22:44:41.999 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-15T22:44:42.258 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:42.562 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:42 smithi066 ceph-mon[31185]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:42.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:42 smithi087 ceph-mon[35290]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:42.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:42 smithi184 ceph-mon[35203]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-15T22:44:42.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/446165017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0102790 msgr2=0x7f6dc01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/446165017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0102790 0x7f6dc01067e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009900 tx=0x7f6db002a410 comp rx=0 tx=0).stop 2024-09-15T22:44:42.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/446165017 shutdown_connections 2024-09-15T22:44:42.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/446165017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0106f10 0x7f6dc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/446165017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0102790 0x7f6dc01067e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/446165017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 0x7f6dc01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/446165017 >> 172.21.15.66:0/446165017 conn(0x7f6dc00fd8c0 msgr2=0x7f6dc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/446165017 shutdown_connections 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.754+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/446165017 wait complete. 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 Processor -- start 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 -- start start 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 0x7f6dc019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0102790 0x7f6dc019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0111f80 con 0x7f6dc0106f10 2024-09-15T22:44:42.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0111e00 con 0x7f6dc0102790 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc7e1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0112100 con 0x7f6dc0101de0 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc63bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc63bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40284/0 (socket says 172.21.15.66:40284) 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc63bb640 1 -- 172.21.15.66:0/3483196101 learned_addr learned my addr 172.21.15.66:0/3483196101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.755+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 0x7f6dc019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0102790 0x7f6dc019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 -- 172.21.15.66:0/3483196101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 msgr2=0x7f6dc019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 0x7f6dc019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 -- 172.21.15.66:0/3483196101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0102790 msgr2=0x7f6dc019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0102790 0x7f6dc019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 -- 172.21.15.66:0/3483196101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc019f600 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc63bb640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6db800eaa0 tx=0x7f6db800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6db6ffd640 1 -- 172.21.15.66:0/3483196101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8004d20 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6db6ffd640 1 -- 172.21.15.66:0/3483196101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db8005020 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc019f8f0 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6db6ffd640 1 -- 172.21.15.66:0/3483196101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80116d0 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.756+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01a71d0 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.758+0000 7f6db6ffd640 1 -- 172.21.15.66:0/3483196101 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6db80051d0 con 0x7f6dc0106f10 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 Processor -- start 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 -- start start 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f570db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f57b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f57dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558e5f4d7090 con 0x558e5f57bbb0 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558e5f47ea70 con 0x558e5f5712f0 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558e5f4d3050 con 0x558e5f5709d0 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f57dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f57dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40292/0 (socket says 172.21.15.66:40292) 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dc5bba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f57b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6dc53b9640 1 -- 172.21.15.66:0/3544507708 learned_addr learned my addr 172.21.15.66:0/3544507708 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.759+0000 7f6db6ffd640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 0x7f6dac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f570db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc63bb640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 0x7f6dac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 -- 172.21.15.66:0/3544507708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 msgr2=0x558e5f570db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f570db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 -- 172.21.15.66:0/3544507708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 msgr2=0x558e5f57dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f57dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 -- 172.21.15.66:0/3544507708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5f48b130 con 0x558e5f5712f0 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6db6ffd640 1 -- 172.21.15.66:0/3483196101 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6db80cffd0 con 0x7f6dc0106f10 2024-09-15T22:44:42.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f570db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f57b670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00abf0 tx=0x7f6dbc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8ae83f2b000f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dc63bb640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 0x7f6dac0a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6db80a4830 tx=0x7f6db806ef70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dabfff640 1 -- 172.21.15.66:0/3544507708 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005220 con 0x558e5f5712f0 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dabfff640 1 -- 172.21.15.66:0/3544507708 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dbc004c80 con 0x558e5f5712f0 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.760+0000 7f6dabfff640 1 -- 172.21.15.66:0/3544507708 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc018820 con 0x558e5f5712f0 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- 172.21.15.66:0/3544507708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 msgr2=0x558e5f57b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f57b670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00abf0 tx=0x7f6dbc00f790 comp rx=0 tx=0).stop 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- 172.21.15.66:0/3544507708 shutdown_connections 2024-09-15T22:44:42.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f57dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f57b670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/3544507708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f570db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- 172.21.15.66:0/3544507708 >> 172.21.15.66:0/3544507708 conn(0x558e5f56cf60 msgr2=0x558e5f56d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- 172.21.15.66:0/3544507708 shutdown_connections 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- 172.21.15.66:0/3544507708 wait complete. 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.761+0000 7f6dca1f7740 1 -- start start 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 Processor -- start 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f57b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f57bbb0 0x558e5f578bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558e5f57e780 con 0x558e5f5712f0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558e5f491f20 con 0x558e5f5709d0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558e5f57e900 con 0x558e5f57bbb0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dca1f7740 10 client.0 _ll_register_callbacks cb 0x558e5f45b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dc5bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dc5bba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40306/0 (socket says 172.21.15.66:40306) 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dc5bba640 1 -- 172.21.15.66:0/1414880110 learned_addr learned my addr 172.21.15.66:0/1414880110 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f57b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.762+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f57bbb0 0x558e5f578bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 -- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f57bbb0 msgr2=0x558e5f578bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f57bbb0 0x558e5f578bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 -- 172.21.15.66:0/1414880110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 msgr2=0x558e5f57b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f57b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 -- 172.21.15.66:0/1414880110 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5f2482b0 con 0x558e5f5712f0 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f57b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc01a040 tx=0x7f6dbc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cbed719d75775b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6da97fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc027070 con 0x558e5f5712f0 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dbc004c80 con 0x558e5f5712f0 2024-09-15T22:44:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6dbc018730 con 0x558e5f5712f0 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dbc033050 con 0x558e5f5712f0 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dca1f7740 10 client.15060 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e5f589f60 con 0x558e5f5712f0 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.763+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dbc004c80 con 0x558e5f5712f0 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f6dbc023430 con 0x558e5f5712f0 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 10 client.15060 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 10 client.15060 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 20 client.15060 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f58c1f0 0x558e5f58d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 4 client.15060 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5f4e4600 con 0x558e5f58c1f0 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f58c1f0 0x558e5f58d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f58c1f0 0x558e5f58d660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8357cadde4324ecb server_cookie=cd900e5c23009df0 in_seq=0 out_seq=0 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.764+0000 7f6da97fa640 10 client.15060 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6da97fa640 1 -- 172.21.15.66:0/1414880110 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5f4e4600 con 0x558e5f58c1f0 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6da97fa640 10 client.15060 handle_command_reply: tid=0 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 client.15060 shutdown 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 msgr2=0x558e5f578680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc01a040 tx=0x7f6dbc0048f0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 shutdown_connections 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f58c1f0 0x558e5f58d660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f57bbb0 0x558e5f578bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f5712f0 0x558e5f578680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6da97fa640 0 client.15060 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.765+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/1414880110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f57b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.766+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 >> 172.21.15.66:0/1414880110 conn(0x558e5f56cf60 msgr2=0x558e5f572c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.766+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 shutdown_connections 2024-09-15T22:44:42.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.766+0000 7f6dca1f7740 1 -- 172.21.15.66:0/1414880110 wait complete. 2024-09-15T22:44:42.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.766+0000 7f6dca1f7740 20 client.15060 trim_cache size 0 max 16384 2024-09-15T22:44:42.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 Processor -- start 2024-09-15T22:44:42.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 -- start start 2024-09-15T22:44:42.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f58d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5712f0 0x558e5f5758e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58b9a0 con 0x558e5f57bbb0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58c070 con 0x558e5f5709d0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58c740 con 0x558e5f5712f0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40322/0 (socket says 172.21.15.66:40322) 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dc53b9640 1 -- 172.21.15.66:0/106975236 learned_addr learned my addr 172.21.15.66:0/106975236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5712f0 0x558e5f5758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.784+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f58d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 -- 172.21.15.66:0/106975236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5712f0 msgr2=0x558e5f5758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5712f0 0x558e5f5758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 -- 172.21.15.66:0/106975236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 msgr2=0x558e5f58d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f58d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 -- 172.21.15.66:0/106975236 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5f57e890 con 0x558e5f57bbb0 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004650 tx=0x7f6db0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596256c2a8d43fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dab7fe640 1 -- 172.21.15.66:0/106975236 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0051070 con 0x558e5f57bbb0 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dab7fe640 1 -- 172.21.15.66:0/106975236 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db0003d60 con 0x558e5f57bbb0 2024-09-15T22:44:42.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.785+0000 7f6dab7fe640 1 -- 172.21.15.66:0/106975236 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0035040 con 0x558e5f57bbb0 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- 172.21.15.66:0/106975236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 msgr2=0x558e5f575e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6db0004650 tx=0x7f6db0009260 comp rx=0 tx=0).stop 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- 172.21.15.66:0/106975236 shutdown_connections 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f575e20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5712f0 0x558e5f5758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/106975236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5709d0 0x558e5f58d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- 172.21.15.66:0/106975236 >> 172.21.15.66:0/106975236 conn(0x558e5f56cf60 msgr2=0x558e5f567ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- 172.21.15.66:0/106975236 shutdown_connections 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- 172.21.15.66:0/106975236 wait complete. 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 -- start start 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.786+0000 7f6dca1f7740 1 Processor -- start 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f5961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f58f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58d4e0 con 0x558e5f57bbb0 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58ce10 con 0x558e5f5712f0 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558e5f58dbb0 con 0x558e5f5709d0 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dca1f7740 10 client.0 _ll_register_callbacks cb 0x7f6db0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc53b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40336/0 (socket says 172.21.15.66:40336) 2024-09-15T22:44:42.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc53b9640 1 -- 172.21.15.66:0/2905569375 learned_addr learned my addr 172.21.15.66:0/2905569375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f58f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f5961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 -- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 msgr2=0x558e5f5961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f5961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 -- 172.21.15.66:0/2905569375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 msgr2=0x558e5f58fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 -- 172.21.15.66:0/2905569375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5f593d10 con 0x558e5f5712f0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6dc5bba640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f58f520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0237d0 tx=0x7f6dbc00af80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d48c0f1d1ce4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6da97fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.787+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc027040 con 0x558e5f5712f0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db0003d60 con 0x558e5f5712f0 2024-09-15T22:44:42.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f6dbc023c40 con 0x558e5f5712f0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dbc045050 con 0x558e5f5712f0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 10 client.24773 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e5f5f6ae0 con 0x558e5f5712f0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db0003d60 con 0x558e5f5712f0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f6dbc018730 con 0x558e5f5712f0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 10 client.24773 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 10 client.24773 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 20 client.24773 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f5fb610 0x558e5f5fa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 4 client.24773 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "status"}) -- 0x558e5f4deb10 con 0x558e5f5fb610 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.788+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f5fb610 0x558e5f5fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:42.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dc53b9640 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f5fb610 0x558e5f5fa320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7ae7d842aab092af server_cookie=4b6f608b4c9a5d27 in_seq=0 out_seq=0 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6da97fa640 10 client.24773 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6da97fa640 1 -- 172.21.15.66:0/2905569375 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558e5f4deb10 con 0x558e5f5fb610 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6da97fa640 10 client.24773 handle_command_reply: tid=0 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 client.24773 shutdown 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 msgr2=0x558e5f58f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f58f520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0237d0 tx=0x7f6dbc00af80 comp rx=0 tx=0).stop 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 shutdown_connections 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x558e5f5fb610 0x558e5f5fa320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558e5f57bbb0 0x558e5f58fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558e5f5712f0 0x558e5f58f520 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6da97fa640 0 client.24773 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 --2- 172.21.15.66:0/2905569375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558e5f5709d0 0x558e5f5961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 >> 172.21.15.66:0/2905569375 conn(0x558e5f56cf60 msgr2=0x558e5f579cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 shutdown_connections 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.789+0000 7f6dca1f7740 1 -- 172.21.15.66:0/2905569375 wait complete. 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dca1f7740 20 client.24773 trim_cache size 0 max 16384 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 4, 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24421, 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:44:42.797 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 64.828122092000001, 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 87, 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 135.39084050599999 2024-09-15T22:44:42.798 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 msgr2=0x7f6dac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 0x7f6dac0a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6db80a4830 tx=0x7f6db806ef70 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 msgr2=0x7f6dc019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6db800eaa0 tx=0x7f6db800eea0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 shutdown_connections 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc0106f10 0x7f6dc019ef20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f6dac0a3350 0x7f6dac0a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0102790 0x7f6dc019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 --2- 172.21.15.66:0/3483196101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc0101de0 0x7f6dc019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:42.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 >> 172.21.15.66:0/3483196101 conn(0x7f6dc00fd8c0 msgr2=0x7f6dc00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:42.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 shutdown_connections 2024-09-15T22:44:42.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:42.790+0000 7f6dc7e1e640 1 -- 172.21.15.66:0/3483196101 wait complete. 2024-09-15T22:44:43.567 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:44:43.829 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:44.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 -- 172.21.15.66:0/3914078437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 msgr2=0x7f2c4010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 --2- 172.21.15.66:0/3914078437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c4010e610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009ca0 tx=0x7f2c3802a950 comp rx=0 tx=0).stop 2024-09-15T22:44:44.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 -- 172.21.15.66:0/3914078437 shutdown_connections 2024-09-15T22:44:44.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 --2- 172.21.15.66:0/3914078437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c4010e610 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 --2- 172.21.15.66:0/3914078437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 --2- 172.21.15.66:0/3914078437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 -- 172.21.15.66:0/3914078437 >> 172.21.15.66:0/3914078437 conn(0x7f2c400fc7a0 msgr2=0x7f2c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 -- 172.21.15.66:0/3914078437 shutdown_connections 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.339+0000 7f2c449d2640 1 -- 172.21.15.66:0/3914078437 wait complete. 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.340+0000 7f2c449d2640 1 Processor -- start 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.340+0000 7f2c449d2640 1 -- start start 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.340+0000 7f2c449d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c401009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.340+0000 7f2c449d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c40100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.340+0000 7f2c449d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c449d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40111fc0 con 0x7f2c4010c170 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c449d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40111e40 con 0x7f2c40102d40 2024-09-15T22:44:44.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c449d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40112140 con 0x7f2c40103660 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40348/0 (socket says 172.21.15.66:40348) 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/2521915729 learned_addr learned my addr 172.21.15.66:0/2521915729 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c401009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c40100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/2521915729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 msgr2=0x7f2c40100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c40100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/2521915729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 msgr2=0x7f2c401009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c401009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/2521915729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c401a68c0 con 0x7f2c4010c170 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:44.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009dc0 tx=0x7f2c38003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c37fff640 1 -- 172.21.15.66:0/2521915729 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38034040 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c401a6b50 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c37fff640 1 -- 172.21.15.66:0/2521915729 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3802f940 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c401a7080 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.341+0000 7f2c37fff640 1 -- 172.21.15.66:0/2521915729 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380046a0 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.344+0000 7f2c37fff640 1 -- 172.21.15.66:0/2521915729 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2c38037020 con 0x7f2c4010c170 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.344+0000 7f2c46dab740 1 Processor -- start 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.344+0000 7f2c46dab740 1 -- start start 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.344+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.344+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d771fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c46dab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56360d6cb090 con 0x56360d7649d0 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c46dab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56360d672a70 con 0x56360d7652f0 2024-09-15T22:44:44.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c46dab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56360d6c7050 con 0x56360d76fbb0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40362/0 (socket says 172.21.15.66:40362) 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 -- 172.21.15.66:0/3271116527 learned_addr learned my addr 172.21.15.66:0/3271116527 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d771fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 -- 172.21.15.66:0/3271116527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 msgr2=0x56360d771fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d771fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 -- 172.21.15.66:0/3271116527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 msgr2=0x56360d76f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 -- 172.21.15.66:0/3271116527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360d67f130 con 0x56360d7649d0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c37fff640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 0x7f2c2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c28012390 tx=0x7f2c28009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ed26604f313716 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 0x7f2c2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c37fff640 1 -- 172.21.15.66:0/2521915729 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f2c380f0bb0 con 0x7f2c4010c170 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c34d99640 1 -- 172.21.15.66:0/3271116527 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2801a030 con 0x56360d7649d0 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c34d99640 1 -- 172.21.15.66:0/3271116527 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c28012070 con 0x56360d7649d0 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.345+0000 7f2c34d99640 1 -- 172.21.15.66:0/3271116527 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28003d00 con 0x56360d7649d0 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 0x7f2c2c0a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56360d761dc0 tx=0x7f2c30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 -- 172.21.15.66:0/3271116527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 msgr2=0x56360d764db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c28012390 tx=0x7f2c28009650 comp rx=0 tx=0).stop 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 -- 172.21.15.66:0/3271116527 shutdown_connections 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d771fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3271116527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d764db0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 -- 172.21.15.66:0/3271116527 >> 172.21.15.66:0/3271116527 conn(0x56360d760f60 msgr2=0x56360d761340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 -- 172.21.15.66:0/3271116527 shutdown_connections 2024-09-15T22:44:44.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.346+0000 7f2c46dab740 1 -- 172.21.15.66:0/3271116527 wait complete. 2024-09-15T22:44:44.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 -- start start 2024-09-15T22:44:44.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 Processor -- start 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d76cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56360d772780 con 0x56360d7649d0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56360d685f20 con 0x56360d7652f0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56360d772900 con 0x56360d76fbb0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.347+0000 7f2c46dab740 10 client.0 _ll_register_callbacks cb 0x56360d64f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40370/0 (socket says 172.21.15.66:40370) 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 -- 172.21.15.66:0/68925326 learned_addr learned my addr 172.21.15.66:0/68925326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d76cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 -- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 msgr2=0x56360d76cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d76cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 -- 172.21.15.66:0/68925326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 msgr2=0x56360d76c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 -- 172.21.15.66:0/68925326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56360d43c2b0 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d76cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005940 tx=0x7f2c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80e6dd896655aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30020620 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f2c300207c0 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.348+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c28012070 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c300209c0 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 10 client.15078 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56360d786940 con 0x56360d7649d0 2024-09-15T22:44:44.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c28012070 con 0x56360d7649d0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f2c3000f040 con 0x56360d7649d0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 10 client.15078 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 10 client.15078 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 20 client.15078 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d78a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 4 client.15078 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56360d6d8600 con 0x56360d788fe0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.349+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d78a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.350+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d78a450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8b4effb9b1b5bc8 server_cookie=bdea85c6e8425085 in_seq=0 out_seq=0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.350+0000 7f2c25ffb640 10 client.15078 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c25ffb640 1 -- 172.21.15.66:0/68925326 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56360d6d8600 con 0x56360d788fe0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c25ffb640 10 client.15078 handle_command_reply: tid=0 2024-09-15T22:44:44.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 client.15078 shutdown 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 msgr2=0x56360d76f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005940 tx=0x7f2c300046c0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 shutdown_connections 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d78a450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c25ffb640 0 client.15078 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d76fbb0 0x56360d76cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d76c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 --2- 172.21.15.66:0/68925326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d76f410 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 >> 172.21.15.66:0/68925326 conn(0x56360d760f60 msgr2=0x56360d766c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 shutdown_connections 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 1 -- 172.21.15.66:0/68925326 wait complete. 2024-09-15T22:44:44.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.351+0000 7f2c46dab740 20 client.15078 trim_cache size 0 max 16384 2024-09-15T22:44:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 Processor -- start 2024-09-15T22:44:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 -- start start 2024-09-15T22:44:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 0x56360d792730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 0x56360d792c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56360d788790 con 0x56360d7649d0 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56360d788e60 con 0x56360d76fbb0 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c46dab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56360d789530 con 0x56360d7652f0 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40374/0 (socket says 172.21.15.66:40374) 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c3e59c640 1 -- 172.21.15.66:0/3443649973 learned_addr learned my addr 172.21.15.66:0/3443649973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.369+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 0x56360d792730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 0x56360d792c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 -- 172.21.15.66:0/3443649973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 msgr2=0x56360d792730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 0x56360d792730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 -- 172.21.15.66:0/3443649973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 msgr2=0x56360d792c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 0x56360d792c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 -- 172.21.15.66:0/3443649973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360d765120 con 0x56360d7649d0 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 0x56360d792730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 0x56360d792c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:44.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2c30000c00 tx=0x7f2c30005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265952214ad94b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c27fff640 1 -- 172.21.15.66:0/3443649973 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3003b020 con 0x56360d7649d0 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c27fff640 1 -- 172.21.15.66:0/3443649973 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3001e720 con 0x56360d7649d0 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.370+0000 7f2c27fff640 1 -- 172.21.15.66:0/3443649973 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3001ed70 con 0x56360d7649d0 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- 172.21.15.66:0/3443649973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 msgr2=0x56360d78a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2c30000c00 tx=0x7f2c30005c70 comp rx=0 tx=0).stop 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- 172.21.15.66:0/3443649973 shutdown_connections 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d76fbb0 0x56360d792c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7652f0 0x56360d792730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- 172.21.15.66:0/3443649973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d7649d0 0x56360d78a450 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- 172.21.15.66:0/3443649973 >> 172.21.15.66:0/3443649973 conn(0x56360d760f60 msgr2=0x56360d76b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- 172.21.15.66:0/3443649973 shutdown_connections 2024-09-15T22:44:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- 172.21.15.66:0/3443649973 wait complete. 2024-09-15T22:44:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 -- start start 2024-09-15T22:44:44.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 Processor -- start 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7649d0 0x56360d78d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.371+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d78dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56360d78a2d0 con 0x56360d76fbb0 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56360d789c00 con 0x56360d7652f0 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56360d78a9a0 con 0x56360d7649d0 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40376/0 (socket says 172.21.15.66:40376) 2024-09-15T22:44:44.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/233574297 learned_addr learned my addr 172.21.15.66:0/233574297 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 10 client.0 _ll_register_callbacks cb 0x7f2c30009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7649d0 0x56360d78d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c35d9b640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d78dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7649d0 msgr2=0x56360d78d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7649d0 0x56360d78d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/233574297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 msgr2=0x56360d78dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d78dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 -- 172.21.15.66:0/233574297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56360d7f16e0 con 0x56360d76fbb0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c3ed9d640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c380bcb40 tx=0x7f2c38009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6360de934c0f808 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380bf030 con 0x56360d76fbb0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f2c380ee470 con 0x56360d76fbb0 2024-09-15T22:44:44.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.372+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c3001e720 con 0x56360d76fbb0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c3802c040 con 0x56360d76fbb0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 10 client.15084 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56360d7f2900 con 0x56360d76fbb0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3001e720 con 0x56360d76fbb0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f2c380bd0a0 con 0x56360d76fbb0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 10 client.15084 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 20 client.15084 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d7f6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 4 client.15084 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "status"}) -- 0x56360d6d2b10 con 0x56360d788fe0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.373+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d7f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:44.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c25ffb640 10 client.15084 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c3e59c640 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d7f6260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f2eab63bd31d2ca7 server_cookie=214d372ba38dda88 in_seq=0 out_seq=0 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c25ffb640 1 -- 172.21.15.66:0/233574297 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56360d6d2b10 con 0x56360d788fe0 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c25ffb640 10 client.15084 handle_command_reply: tid=0 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 client.15084 shutdown 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 msgr2=0x56360d78e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c380bcb40 tx=0x7f2c38009990 comp rx=0 tx=0).stop 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 shutdown_connections 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56360d788fe0 0x56360d7f6260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56360d76fbb0 0x56360d78e0e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56360d7652f0 0x56360d78dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c25ffb640 0 client.15084 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 --2- 172.21.15.66:0/233574297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56360d7649d0 0x56360d78d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 >> 172.21.15.66:0/233574297 conn(0x56360d760f60 msgr2=0x56360d760000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 shutdown_connections 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 1 -- 172.21.15.66:0/233574297 wait complete. 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.374+0000 7f2c46dab740 20 client.15084 trim_cache size 0 max 16384 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 3, 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24427, 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:44:44.383 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 67.420911842999999, 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 87, 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 134.44503462399999 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:44:44.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 msgr2=0x7f2c2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 0x7f2c2c0a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56360d761dc0 tx=0x7f2c30005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 msgr2=0x7f2c40101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009dc0 tx=0x7f2c38003c10 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 shutdown_connections 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c4010c170 0x7f2c40101420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c40103660 0x7f2c40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f2c2c0a32d0 0x7f2c2c0a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 --2- 172.21.15.66:0/2521915729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c40102d40 0x7f2c401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 >> 172.21.15.66:0/2521915729 conn(0x7f2c400fc7a0 msgr2=0x7f2c400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 shutdown_connections 2024-09-15T22:44:44.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:44.375+0000 7f2c449d2640 1 -- 172.21.15.66:0/2521915729 wait complete. 2024-09-15T22:44:44.529 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:44 smithi066 ceph-mon[31185]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:44 smithi087 ceph-mon[35290]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:44.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:44 smithi184 ceph-mon[35203]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-15T22:44:45.040 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-15T22:44:45.297 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:45.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 -- 172.21.15.66:0/4071224272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd41002f0 msgr2=0x7febd41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 --2- 172.21.15.66:0/4071224272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd41002f0 0x7febd41006d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febc4009930 tx=0x7febc402a420 comp rx=0 tx=0).stop 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 -- 172.21.15.66:0/4071224272 shutdown_connections 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 --2- 172.21.15.66:0/4071224272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4106f50 0x7febd410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 --2- 172.21.15.66:0/4071224272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd4100ca0 0x7febd4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 --2- 172.21.15.66:0/4071224272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd41002f0 0x7febd41006d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 -- 172.21.15.66:0/4071224272 >> 172.21.15.66:0/4071224272 conn(0x7febd4077210 msgr2=0x7febd40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 -- 172.21.15.66:0/4071224272 shutdown_connections 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.781+0000 7febd9d39640 1 -- 172.21.15.66:0/4071224272 wait complete. 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 Processor -- start 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 -- start start 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd41002f0 0x7febd4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 0x7febd41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7febd4112000 con 0x7febd4106f50 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7febd4111e80 con 0x7febd41002f0 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd9d39640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7febd4112180 con 0x7febd4100ca0 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40402/0 (socket says 172.21.15.66:40402) 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd3fff640 1 -- 172.21.15.66:0/1515126443 learned_addr learned my addr 172.21.15.66:0/1515126443 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.782+0000 7febd37fe640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd41002f0 0x7febd4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd2ffd640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 0x7febd41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 -- 172.21.15.66:0/1515126443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 msgr2=0x7febd41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 0x7febd41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 -- 172.21.15.66:0/1515126443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd41002f0 msgr2=0x7febd4101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd41002f0 0x7febd4101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 -- 172.21.15.66:0/1515126443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd41a6920 con 0x7febd4106f50 2024-09-15T22:44:45.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd2ffd640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 0x7febd41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd3fff640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b970 tx=0x7febcc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd0ff9640 1 -- 172.21.15.66:0/1515126443 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc019070 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd0ff9640 1 -- 172.21.15.66:0/1515126443 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febcc00cb40 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd41a6c10 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd0ff9640 1 -- 172.21.15.66:0/1515126443 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc007650 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.783+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd41a7150 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.785+0000 7febd0ff9640 1 -- 172.21.15.66:0/1515126443 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7febcc01c070 con 0x7febd4106f50 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 Processor -- start 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 -- start start 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febd0ff9640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 0x7febbc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 0x55cd747c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747ccbb0 0x55cd747cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cd74728090 con 0x55cd747c22f0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cd746cfa70 con 0x55cd747c19d0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febdc112740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cd74724050 con 0x55cd747ccbb0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febd2ffd640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 0x7febbc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febd0ff9640 1 -- 172.21.15.66:0/1515126443 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7febcc0cf220 con 0x7febd4106f50 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.786+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40418/0 (socket says 172.21.15.66:40418) 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd2ffd640 1 -- 172.21.15.66:0/3216782549 learned_addr learned my addr 172.21.15.66:0/3216782549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 0x55cd747c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd3fff640 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747ccbb0 0x55cd747cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 -- 172.21.15.66:0/3216782549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747ccbb0 msgr2=0x55cd747cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747ccbb0 0x55cd747cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 -- 172.21.15.66:0/3216782549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 msgr2=0x55cd747cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 -- 172.21.15.66:0/3216782549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd746dc130 con 0x55cd747c19d0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd2ffd640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 0x7febbc0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7febc8012830 tx=0x7febc800aa80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febd37fe640 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 0x55cd747c1db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febc4005940 tx=0x7febc40316e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237827d03d1b99ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febb9ffb640 1 -- 172.21.15.66:0/3216782549 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4040070 con 0x55cd747c19d0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febb9ffb640 1 -- 172.21.15.66:0/3216782549 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febc4005020 con 0x55cd747c19d0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.787+0000 7febb9ffb640 1 -- 172.21.15.66:0/3216782549 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4035040 con 0x55cd747c19d0 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- 172.21.15.66:0/3216782549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 msgr2=0x55cd747c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 0x55cd747c1db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febc4005940 tx=0x7febc40316e0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- 172.21.15.66:0/3216782549 shutdown_connections 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747ccbb0 0x55cd747cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 --2- 172.21.15.66:0/3216782549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747c19d0 0x55cd747c1db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- 172.21.15.66:0/3216782549 >> 172.21.15.66:0/3216782549 conn(0x55cd747bdf60 msgr2=0x55cd747be340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- 172.21.15.66:0/3216782549 shutdown_connections 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- 172.21.15.66:0/3216782549 wait complete. 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.788+0000 7febdc112740 1 -- start start 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 Processor -- start 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c19d0 0x55cd747cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cd747cf780 con 0x55cd747c22f0 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cd746e2f20 con 0x55cd747ccbb0 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cd747cf900 con 0x55cd747c19d0 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febdc112740 10 client.0 _ll_register_callbacks cb 0x55cd746ac030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:45.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febd2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40430/0 (socket says 172.21.15.66:40430) 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febd2ffd640 1 -- 172.21.15.66:0/2221411691 learned_addr learned my addr 172.21.15.66:0/2221411691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febd37fe640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c19d0 0x55cd747cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.789+0000 7febd3fff640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 -- 172.21.15.66:0/2221411691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c19d0 msgr2=0x55cd747cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c19d0 0x55cd747cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 -- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 msgr2=0x55cd747c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 -- 172.21.15.66:0/2221411691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd744992b0 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febd2ffd640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febc800a660 tx=0x7febc8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6394e0b5faa65c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8010d90 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7febc801e3f0 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc4005020 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febc801e5f0 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febdc112740 10 client.15096 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd747daf90 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.790+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febc4005020 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7febc80286d0 con 0x55cd747c22f0 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 10 client.15096 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:45.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 10 client.15096 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 20 client.15096 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd747dd640 0x55cd747deab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 4 client.15096 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd74735600 con 0x55cd747dd640 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febd37fe640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd747dd640 0x55cd747deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febb2ffd640 10 client.15096 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:44:45.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.791+0000 7febd37fe640 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd747dd640 0x55cd747deab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16a70cda07dd9de7 server_cookie=4884a3abd619630e in_seq=0 out_seq=0 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.792+0000 7febb2ffd640 1 -- 172.21.15.66:0/2221411691 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd74735600 con 0x55cd747dd640 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.792+0000 7febb2ffd640 10 client.15096 handle_command_reply: tid=0 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.792+0000 7febdc112740 1 client.15096 shutdown 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 msgr2=0x55cd747c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febc800a660 tx=0x7febc8005be0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 shutdown_connections 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd747dd640 0x55cd747deab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c22f0 0x55cd747c96a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 --2- 172.21.15.66:0/2221411691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c19d0 0x55cd747cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 >> 172.21.15.66:0/2221411691 conn(0x55cd747bdf60 msgr2=0x55cd747c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febb2ffd640 0 client.15096 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 shutdown_connections 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 1 -- 172.21.15.66:0/2221411691 wait complete. 2024-09-15T22:44:45.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.793+0000 7febdc112740 20 client.15096 trim_cache size 0 max 16384 2024-09-15T22:44:45.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 Processor -- start 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 -- start start 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cd747dcdf0 con 0x55cd747c19d0 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cd747dd4c0 con 0x55cd747ccbb0 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febdc112740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cd747ddb90 con 0x55cd747c22f0 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40440/0 (socket says 172.21.15.66:40440) 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 -- 172.21.15.66:0/513361619 learned_addr learned my addr 172.21.15.66:0/513361619 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd3fff640 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 -- 172.21.15.66:0/513361619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 msgr2=0x55cd747de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd2ffd640 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747de3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 -- 172.21.15.66:0/513361619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 msgr2=0x55cd747c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.811+0000 7febd37fe640 1 -- 172.21.15.66:0/513361619 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd747ca6e0 con 0x55cd747c19d0 2024-09-15T22:44:45.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febd37fe640 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7febc402a940 tx=0x7febc40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf07b488c99faf74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febb97fa640 1 -- 172.21.15.66:0/513361619 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4040050 con 0x55cd747c19d0 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febb97fa640 1 -- 172.21.15.66:0/513361619 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febc4004230 con 0x55cd747c19d0 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febb97fa640 1 -- 172.21.15.66:0/513361619 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4035040 con 0x55cd747c19d0 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 -- 172.21.15.66:0/513361619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 msgr2=0x55cd747dcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7febc402a940 tx=0x7febc40058d0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 -- 172.21.15.66:0/513361619 shutdown_connections 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.812+0000 7febdc112740 1 --2- 172.21.15.66:0/513361619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747dcf70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 -- 172.21.15.66:0/513361619 >> 172.21.15.66:0/513361619 conn(0x55cd747bdf60 msgr2=0x55cd747b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 -- 172.21.15.66:0/513361619 shutdown_connections 2024-09-15T22:44:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 -- 172.21.15.66:0/513361619 wait complete. 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 -- start start 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 Processor -- start 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.813+0000 7febdc112740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febdc112740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cd747de930 con 0x55cd747c19d0 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febdc112740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cd747de260 con 0x55cd747ccbb0 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febdc112740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cd747df000 con 0x55cd747c22f0 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febdc112740 10 client.0 _ll_register_callbacks cb 0x7febc800ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40450/0 (socket says 172.21.15.66:40450) 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 -- 172.21.15.66:0/3659719529 learned_addr learned my addr 172.21.15.66:0/3659719529 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:45.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd2ffd640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd3fff640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 -- 172.21.15.66:0/3659719529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 msgr2=0x55cd747dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747dfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 -- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 msgr2=0x55cd747e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 -- 172.21.15.66:0/3659719529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd747e0a20 con 0x55cd747c19d0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febd37fe640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7febc4052040 tx=0x7febc402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6ec0a4b899e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc405e060 con 0x55cd747c19d0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7febc4005460 con 0x55cd747c19d0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.814+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc4004230 con 0x55cd747c19d0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febc4040020 con 0x55cd747c19d0 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 10 client.15102 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd74846d70 con 0x55cd747c19d0 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febc4004230 con 0x55cd747c19d0 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7febc40037b0 con 0x55cd747c19d0 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 10 client.15102 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 10 client.15102 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 20 client.15102 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd7484b230 0x55cd74849f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 4 client.15102 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "status"}) -- 0x55cd7472fb10 con 0x55cd7484b230 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.815+0000 7febd2ffd640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd7484b230 0x55cd74849f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febb2ffd640 10 client.15102 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febd2ffd640 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd7484b230 0x55cd74849f40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76896bcf15e5d8ab server_cookie=1e395a6215d4e8a1 in_seq=0 out_seq=0 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febb2ffd640 1 -- 172.21.15.66:0/3659719529 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cd7472fb10 con 0x55cd7484b230 2024-09-15T22:44:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febb2ffd640 10 client.15102 handle_command_reply: tid=0 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 client.15102 shutdown 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 msgr2=0x55cd747e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7febc4052040 tx=0x7febc402a420 comp rx=0 tx=0).stop 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 shutdown_connections 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55cd7484b230 0x55cd74849f40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cd747ccbb0 0x55cd747e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd747c22f0 0x55cd747dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 --2- 172.21.15.66:0/3659719529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cd747c19d0 0x55cd747e7590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 >> 172.21.15.66:0/3659719529 conn(0x55cd747bdf60 msgr2=0x55cd747dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.816+0000 7febb2ffd640 0 client.15102 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 shutdown_connections 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febdc112740 1 -- 172.21.15.66:0/3659719529 wait complete. 2024-09-15T22:44:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febdc112740 20 client.15102 trim_cache size 0 max 16384 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 2, 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24437, 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 69.877722601000002, 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 87, 2024-09-15T22:44:45.823 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 133.20166904300001 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 msgr2=0x7febbc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 0x7febbc0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7febc8012830 tx=0x7febc800aa80 comp rx=0 tx=0).stop 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 msgr2=0x7febd4101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7febcc00b970 tx=0x7febcc00be30 comp rx=0 tx=0).stop 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 shutdown_connections 2024-09-15T22:44:45.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7febd4106f50 0x7febd4101cf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd4100ca0 0x7febd41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7febbc0a3350 0x7febbc0a5810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 --2- 172.21.15.66:0/1515126443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febd41002f0 0x7febd4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 >> 172.21.15.66:0/1515126443 conn(0x7febd4077210 msgr2=0x7febd41057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.817+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 shutdown_connections 2024-09-15T22:44:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:45.818+0000 7febd9d39640 1 -- 172.21.15.66:0/1515126443 wait complete. 2024-09-15T22:44:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:46 smithi087 ceph-mon[35290]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:46.631 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:46 smithi066 ceph-mon[31185]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:46.660 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:44:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:46 smithi184 ceph-mon[35203]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-15T22:44:46.917 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 -- 172.21.15.66:0/3557864237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50102790 msgr2=0x7fee501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 --2- 172.21.15.66:0/3557864237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50102790 0x7fee501067e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fee44009900 tx=0x7fee4402a410 comp rx=0 tx=0).stop 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 -- 172.21.15.66:0/3557864237 shutdown_connections 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 --2- 172.21.15.66:0/3557864237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 0x7fee5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 --2- 172.21.15.66:0/3557864237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50102790 0x7fee501067e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 --2- 172.21.15.66:0/3557864237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50101de0 0x7fee501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 -- 172.21.15.66:0/3557864237 >> 172.21.15.66:0/3557864237 conn(0x7fee500fd8c0 msgr2=0x7fee500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 -- 172.21.15.66:0/3557864237 shutdown_connections 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.342+0000 7fee557f3640 1 -- 172.21.15.66:0/3557864237 wait complete. 2024-09-15T22:44:47.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 Processor -- start 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 -- start start 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50102790 0x7fee5019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 0x7fee5019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fee50111f70 con 0x7fee50101de0 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fee50111df0 con 0x7fee50102790 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee557f3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fee501120f0 con 0x7fee50106f10 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40470/0 (socket says 172.21.15.66:40470) 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.343+0000 7fee4effd640 1 -- 172.21.15.66:0/3893199984 learned_addr learned my addr 172.21.15.66:0/3893199984 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 0x7fee5019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50102790 0x7fee5019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 -- 172.21.15.66:0/3893199984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 msgr2=0x7fee5019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 0x7fee5019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 -- 172.21.15.66:0/3893199984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50102790 msgr2=0x7fee5019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50102790 0x7fee5019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 -- 172.21.15.66:0/3893199984 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5019f5e0 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee4effd640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee4000d950 tx=0x7fee4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee37fff640 1 -- 172.21.15.66:0/3893199984 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40017070 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5019f8d0 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee37fff640 1 -- 172.21.15.66:0/3893199984 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee40009c30 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee37fff640 1 -- 172.21.15.66:0/3893199984 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4000f6b0 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.344+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee501a71b0 con 0x7fee50101de0 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 Processor -- start 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 -- start start 2024-09-15T22:44:47.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee37fff640 1 -- 172.21.15.66:0/3893199984 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fee400109d0 con 0x7fee50101de0 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x565029645090 con 0x5650296df2f0 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5650295eca70 con 0x5650296de9d0 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.347+0000 7fee57bcc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565029641050 con 0x5650296e9bb0 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40474/0 (socket says 172.21.15.66:40474) 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 -- 172.21.15.66:0/2883463608 learned_addr learned my addr 172.21.15.66:0/2883463608 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:47.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 -- 172.21.15.66:0/2883463608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 msgr2=0x5650296ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 -- 172.21.15.66:0/2883463608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 msgr2=0x5650296dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296dedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 -- 172.21.15.66:0/2883463608 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650295f9130 con 0x5650296df2f0 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee37fff640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 0x7fee380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4effd640 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee400cd0b0 tx=0x7fee400d8660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d822a274b3284303 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 0x7fee380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.348+0000 7fee37fff640 1 -- 172.21.15.66:0/3893199984 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fee400cfb00 con 0x7fee50101de0 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee357fa640 1 -- 172.21.15.66:0/2883463608 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40097f20 con 0x5650296df2f0 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee357fa640 1 -- 172.21.15.66:0/2883463608 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee400d4040 con 0x5650296df2f0 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee357fa640 1 -- 172.21.15.66:0/2883463608 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4009b5e0 con 0x5650296df2f0 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 -- 172.21.15.66:0/2883463608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 msgr2=0x5650296e9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee400cd0b0 tx=0x7fee400d8660 comp rx=0 tx=0).stop 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 0x7fee380a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee48007e50 tx=0x7fee48007600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 -- 172.21.15.66:0/2883463608 shutdown_connections 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296df2f0 0x5650296e9670 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2883463608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 -- 172.21.15.66:0/2883463608 >> 172.21.15.66:0/2883463608 conn(0x5650296daf60 msgr2=0x5650296db340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 -- 172.21.15.66:0/2883463608 shutdown_connections 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.349+0000 7fee57bcc740 1 -- 172.21.15.66:0/2883463608 wait complete. 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 -- start start 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 Processor -- start 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 0x5650296e6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5650296ec780 con 0x5650296de9d0 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5650295fff20 con 0x5650296df2f0 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5650296ec900 con 0x5650296e9bb0 2024-09-15T22:44:47.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee57bcc740 10 client.0 _ll_register_callbacks cb 0x5650295c9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40490/0 (socket says 172.21.15.66:40490) 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee4effd640 1 -- 172.21.15.66:0/2108868626 learned_addr learned my addr 172.21.15.66:0/2108868626 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.350+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 0x5650296e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 -- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 msgr2=0x5650296e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 -- 172.21.15.66:0/2108868626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 msgr2=0x5650296e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 0x5650296e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 -- 172.21.15.66:0/2108868626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650293b62b0 con 0x5650296de9d0 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:47.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 0x5650296e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee4effd640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee400a43c0 tx=0x7fee40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fef8308ab4b9924 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40020070 con 0x5650296de9d0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fee400d8d70 con 0x5650296de9d0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee400d4040 con 0x5650296de9d0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee4009b7c0 con 0x5650296de9d0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee57bcc740 10 client.15114 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5650296f8100 con 0x5650296de9d0 2024-09-15T22:44:47.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee400d4040 con 0x5650296de9d0 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fee400982f0 con 0x5650296de9d0 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee57bcc740 10 client.15114 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.351+0000 7fee57bcc740 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee57bcc740 20 client.15114 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5650296fa040 0x5650296fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee57bcc740 4 client.15114 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565029652600 con 0x5650296fa040 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5650296fa040 0x5650296fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5650296fa040 0x5650296fb4b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e0220db836f9b72 server_cookie=d0dac809539e15f8 in_seq=0 out_seq=0 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.352+0000 7fee32ff5640 10 client.15114 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:44:47.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee32ff5640 1 -- 172.21.15.66:0/2108868626 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565029652600 con 0x5650296fa040 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee32ff5640 10 client.15114 handle_command_reply: tid=0 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 client.15114 shutdown 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 msgr2=0x5650296e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fee400a43c0 tx=0x7fee40005880 comp rx=0 tx=0).stop 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 shutdown_connections 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5650296fa040 0x5650296fb4b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296e9bb0 0x5650296e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296df2f0 0x5650296e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 --2- 172.21.15.66:0/2108868626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296e94c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 >> 172.21.15.66:0/2108868626 conn(0x5650296daf60 msgr2=0x5650296e0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee32ff5640 0 client.15114 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:44:47.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 shutdown_connections 2024-09-15T22:44:47.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.353+0000 7fee57bcc740 1 -- 172.21.15.66:0/2108868626 wait complete. 2024-09-15T22:44:47.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.354+0000 7fee57bcc740 20 client.15114 trim_cache size 0 max 16384 2024-09-15T22:44:47.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.371+0000 7fee57bcc740 1 Processor -- start 2024-09-15T22:44:47.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.371+0000 7fee57bcc740 1 -- start start 2024-09-15T22:44:47.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 0x5650296e8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5650296f97f0 con 0x5650296de9d0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5650296f9ec0 con 0x5650296e9bb0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee57bcc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5650296fa590 con 0x5650296df2f0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40498/0 (socket says 172.21.15.66:40498) 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 -- 172.21.15.66:0/749280808 learned_addr learned my addr 172.21.15.66:0/749280808 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 0x5650296e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 -- 172.21.15.66:0/749280808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 msgr2=0x5650296fade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 -- 172.21.15.66:0/749280808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 msgr2=0x5650296e8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 0x5650296e8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 -- 172.21.15.66:0/749280808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650296df120 con 0x5650296de9d0 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 0x5650296e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.372+0000 7fee4effd640 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fee400d8b60 tx=0x7fee4000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa82b344ab869b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee34ff9640 1 -- 172.21.15.66:0/749280808 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40020070 con 0x5650296de9d0 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee34ff9640 1 -- 172.21.15.66:0/749280808 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee400d8d70 con 0x5650296de9d0 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee34ff9640 1 -- 172.21.15.66:0/749280808 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4009ba50 con 0x5650296de9d0 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 -- 172.21.15.66:0/749280808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 msgr2=0x5650296f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fee400d8b60 tx=0x7fee4000bf60 comp rx=0 tx=0).stop 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 -- 172.21.15.66:0/749280808 shutdown_connections 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296e9bb0 0x5650296e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 --2- 172.21.15.66:0/749280808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296de9d0 0x5650296f9970 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.373+0000 7fee57bcc740 1 -- 172.21.15.66:0/749280808 >> 172.21.15.66:0/749280808 conn(0x5650296daf60 msgr2=0x5650296e7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- 172.21.15.66:0/749280808 shutdown_connections 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- 172.21.15.66:0/749280808 wait complete. 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- start start 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 Processor -- start 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5650296fb330 con 0x5650296e9bb0 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5650296fac60 con 0x5650296de9d0 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5650296fba00 con 0x5650296df2f0 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee57bcc740 10 client.0 _ll_register_callbacks cb 0x7fee480074a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:47.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40514/0 (socket says 172.21.15.66:40514) 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.374+0000 7fee4f7fe640 1 -- 172.21.15.66:0/3790137535 learned_addr learned my addr 172.21.15.66:0/3790137535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4effd640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 -- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 msgr2=0x5650296fea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 -- 172.21.15.66:0/3790137535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 msgr2=0x5650296fe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296fe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 -- 172.21.15.66:0/3790137535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565029762740 con 0x5650296e9bb0 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4e7fc640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee4f7fe640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fee4801ed90 tx=0x7fee48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da9b5f54b2c8fba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:47.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4801cb90 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee400d8d70 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7fee4801cd30 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee48032050 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee57bcc740 10 client.15120 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.375+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565029763a40 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee400d8d70 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fee48026070 con 0x5650296e9bb0 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 10 client.15120 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 10 client.15120 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 20 client.15120 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x565029768630 0x565029767340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:47.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 4 client.15120 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "status"}) -- 0x56502964cb10 con 0x565029768630 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.376+0000 7fee4effd640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x565029768630 0x565029767340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee32ff5640 10 client.15120 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee4effd640 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x565029768630 0x565029767340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9d086670b10ee46 server_cookie=d80a9b21e076abec in_seq=0 out_seq=0 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee32ff5640 1 -- 172.21.15.66:0/3790137535 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56502964cb10 con 0x565029768630 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee32ff5640 10 client.15120 handle_command_reply: tid=0 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 client.15120 shutdown 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 msgr2=0x5650296fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fee4801ed90 tx=0x7fee48004a40 comp rx=0 tx=0).stop 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 shutdown_connections 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x565029768630 0x565029767340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5650296e9bb0 0x5650296fef70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650296df2f0 0x5650296fea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 --2- 172.21.15.66:0/3790137535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650296de9d0 0x5650296fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 >> 172.21.15.66:0/3790137535 conn(0x5650296daf60 msgr2=0x5650296d9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.377+0000 7fee32ff5640 0 client.15120 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 shutdown_connections 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee57bcc740 1 -- 172.21.15.66:0/3790137535 wait complete. 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee57bcc740 20 client.15120 trim_cache size 0 max 16384 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 1, 2024-09-15T22:44:47.393 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24442, 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 72.444168241, 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 87, 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 132.25962286000001 2024-09-15T22:44:47.394 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 msgr2=0x7fee380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 0x7fee380a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee48007e50 tx=0x7fee48007600 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 msgr2=0x7fee5019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee4000d950 tx=0x7fee4000de10 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 shutdown_connections 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50106f10 0x7fee5019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fee380a32d0 0x7fee380a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee50102790 0x7fee5019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 --2- 172.21.15.66:0/3893199984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee50101de0 0x7fee5019a630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:47.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.378+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 >> 172.21.15.66:0/3893199984 conn(0x7fee500fd8c0 msgr2=0x7fee500feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:47.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.379+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 shutdown_connections 2024-09-15T22:44:47.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:47.379+0000 7fee557f3640 1 -- 172.21.15.66:0/3893199984 wait complete. 2024-09-15T22:44:48.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:44:48.437 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:48.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:48 smithi066 ceph-mon[31185]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:48.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:48 smithi087 ceph-mon[35290]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:48 smithi184 ceph-mon[35203]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:48.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 -- 172.21.15.66:0/544849607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0102790 msgr2=0x7f0af01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 --2- 172.21.15.66:0/544849607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0102790 0x7f0af01067e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009ca0 tx=0x7f0ae002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 -- 172.21.15.66:0/544849607 shutdown_connections 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 --2- 172.21.15.66:0/544849607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0106f10 0x7f0af010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 --2- 172.21.15.66:0/544849607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0102790 0x7f0af01067e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 --2- 172.21.15.66:0/544849607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0101de0 0x7f0af01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 -- 172.21.15.66:0/544849607 >> 172.21.15.66:0/544849607 conn(0x7f0af00fd8c0 msgr2=0x7f0af00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 -- 172.21.15.66:0/544849607 shutdown_connections 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.911+0000 7f0af6e05640 1 -- 172.21.15.66:0/544849607 wait complete. 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.912+0000 7f0af6e05640 1 Processor -- start 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.912+0000 7f0af6e05640 1 -- start start 2024-09-15T22:44:48.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.912+0000 7f0af6e05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0102790 0x7f0af0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0106f10 0x7f0af019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0111fc0 con 0x7f0af0101de0 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0111e40 con 0x7f0af0106f10 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0112140 con 0x7f0af0102790 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40536/0 (socket says 172.21.15.66:40536) 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1097347825 learned_addr learned my addr 172.21.15.66:0/1097347825 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0aeffff640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0102790 0x7f0af0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af53a2640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0106f10 0x7f0af019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1097347825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0102790 msgr2=0x7f0af0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0102790 0x7f0af0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1097347825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0106f10 msgr2=0x7f0af019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0106f10 0x7f0af019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1097347825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af019d3d0 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9f0 tx=0x7f0ad800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0aedffb640 1 -- 172.21.15.66:0/1097347825 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800cd80 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0aedffb640 1 -- 172.21.15.66:0/1097347825 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ad8010910 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af019d6c0 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.913+0000 7f0aedffb640 1 -- 172.21.15.66:0/1097347825 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8018990 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.914+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af01a4fa0 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0aedffb640 1 -- 172.21.15.66:0/1097347825 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0ad8010ac0 con 0x7f0af0101de0 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 Processor -- start 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 -- start start 2024-09-15T22:44:48.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ee8b0 0x55dd452eec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452ef1d0 0x55dd452fda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd45255090 con 0x55dd452fdfc0 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd451fca70 con 0x55dd452ef1d0 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af91de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd45251050 con 0x55dd452ee8b0 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40540/0 (socket says 172.21.15.66:40540) 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0aeffff640 1 -- 172.21.15.66:0/2462779195 learned_addr learned my addr 172.21.15.66:0/2462779195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af53a2640 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ee8b0 0x55dd452eec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.917+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452ef1d0 0x55dd452fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 -- 172.21.15.66:0/2462779195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ee8b0 msgr2=0x55dd452eec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ee8b0 0x55dd452eec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 -- 172.21.15.66:0/2462779195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452ef1d0 msgr2=0x55dd452fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452ef1d0 0x55dd452fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 -- 172.21.15.66:0/2462779195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd45209130 con 0x55dd452fdfc0 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aedffb640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 0x7f0adc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.991 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24461, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 114.163398032, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 87, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 125.015080524 2024-09-15T22:44:48.992 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aeffff640 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ae002ade0 tx=0x7f0ae0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fd2f1e224f5025 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0af53a2640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 0x7f0adc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0aedffb640 1 -- 172.21.15.66:0/1097347825 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f0ad80d0050 con 0x7f0af0101de0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0ae6ffd640 1 -- 172.21.15.66:0/2462779195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0031db0 con 0x55dd452fdfc0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0ae6ffd640 1 -- 172.21.15.66:0/2462779195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae0036030 con 0x55dd452fdfc0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.918+0000 7f0ae6ffd640 1 -- 172.21.15.66:0/2462779195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00043c0 con 0x55dd452fdfc0 2024-09-15T22:44:48.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- 172.21.15.66:0/2462779195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 msgr2=0x55dd453003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af53a2640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 0x7f0adc0a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800b6c0 tx=0x7f0ae800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0ae002ade0 tx=0x7f0ae0005fa0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- 172.21.15.66:0/2462779195 shutdown_connections 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452fdfc0 0x55dd453003b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452ef1d0 0x55dd452fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 --2- 172.21.15.66:0/2462779195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ee8b0 0x55dd452eec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- 172.21.15.66:0/2462779195 >> 172.21.15.66:0/2462779195 conn(0x55dd452eaf60 msgr2=0x55dd452eb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- 172.21.15.66:0/2462779195 shutdown_connections 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- 172.21.15.66:0/2462779195 wait complete. 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.919+0000 7f0af91de740 1 -- start start 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 Processor -- start 2024-09-15T22:44:48.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd452fab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd452fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd45300a10 con 0x55dd452ee8b0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd4520ff20 con 0x55dd452fdfc0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd45300b90 con 0x55dd452ef1d0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af91de740 10 client.0 _ll_register_callbacks cb 0x55dd451d9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40552/0 (socket says 172.21.15.66:40552) 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1287561685 learned_addr learned my addr 172.21.15.66:0/1287561685 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0aeffff640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd452fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af53a2640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd452fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1287561685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 msgr2=0x55dd452fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd452fab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 msgr2=0x55dd452fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd452fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af4ba1640 1 -- 172.21.15.66:0/1287561685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd44fc62b0 con 0x55dd452ee8b0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0aeffff640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd452fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.920+0000 7f0af53a2640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd452fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9c0 tx=0x7f0ad80985e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473fc25a38e38bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad809c280 con 0x55dd452ee8b0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f0ad80d3d10 con 0x55dd452ee8b0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ae0036030 con 0x55dd452ee8b0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ad80a0580 con 0x55dd452ee8b0 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 10 client.15132 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:48.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dd4530c390 con 0x55dd452ee8b0 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae0036030 con 0x55dd452ee8b0 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0ad80d20d0 con 0x55dd452ee8b0 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 10 client.15132 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 20 client.15132 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4530e990 0x55dd4530fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 4 client.15132 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.921+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd45262600 con 0x55dd4530e990 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.922+0000 7f0aeffff640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4530e990 0x55dd4530fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.922+0000 7f0aeffff640 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4530e990 0x55dd4530fe00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efe1b9ed59680f59 server_cookie=9f210d13694130e8 in_seq=0 out_seq=0 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.922+0000 7f0acffff640 10 client.15132 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:44:48.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0acffff640 1 -- 172.21.15.66:0/1287561685 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd45262600 con 0x55dd4530e990 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0acffff640 10 client.15132 handle_command_reply: tid=0 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 client.15132 shutdown 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 msgr2=0x55dd452fd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9c0 tx=0x7f0ad80985e0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 shutdown_connections 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4530e990 0x55dd4530fe00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd452fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd452fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0acffff640 0 client.15132 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 --2- 172.21.15.66:0/1287561685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd452fd830 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 >> 172.21.15.66:0/1287561685 conn(0x55dd452eaf60 msgr2=0x55dd452f0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 shutdown_connections 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 1 -- 172.21.15.66:0/1287561685 wait complete. 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.923+0000 7f0af91de740 20 client.15132 trim_cache size 0 max 16384 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 Processor -- start 2024-09-15T22:44:48.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 -- start start 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45318620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd4530e140 con 0x55dd452ee8b0 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd4530e810 con 0x55dd452fdfc0 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af91de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd4530eee0 con 0x55dd452ef1d0 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40558/0 (socket says 172.21.15.66:40558) 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.941+0000 7f0af4ba1640 1 -- 172.21.15.66:0/706939253 learned_addr learned my addr 172.21.15.66:0/706939253 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0aeffff640 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 -- 172.21.15.66:0/706939253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 msgr2=0x55dd453180e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453180e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 -- 172.21.15.66:0/706939253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 msgr2=0x55dd45318620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45318620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 -- 172.21.15.66:0/706939253 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd452ef000 con 0x55dd452ee8b0 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0ad809c210 tx=0x7f0ad809a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2313f328593268d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0ae67fc640 1 -- 172.21.15.66:0/706939253 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad809bdc0 con 0x55dd452ee8b0 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0ae67fc640 1 -- 172.21.15.66:0/706939253 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ad80a4e40 con 0x55dd452ee8b0 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.942+0000 7f0ae67fc640 1 -- 172.21.15.66:0/706939253 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad809b6d0 con 0x55dd452ee8b0 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- 172.21.15.66:0/706939253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 msgr2=0x55dd4530fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0ad809c210 tx=0x7f0ad809a790 comp rx=0 tx=0).stop 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- 172.21.15.66:0/706939253 shutdown_connections 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45318620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453180e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- 172.21.15.66:0/706939253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd4530fe00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- 172.21.15.66:0/706939253 >> 172.21.15.66:0/706939253 conn(0x55dd452eaf60 msgr2=0x55dd452f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- 172.21.15.66:0/706939253 shutdown_connections 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- 172.21.15.66:0/706939253 wait complete. 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- start start 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 Processor -- start 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453125a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45312ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd4530fc80 con 0x55dd452ee8b0 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd4530f5b0 con 0x55dd452fdfc0 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.943+0000 7f0af91de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd45310350 con 0x55dd452ef1d0 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af91de740 10 client.0 _ll_register_callbacks cb 0x7f0ad80d3890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40570/0 (socket says 172.21.15.66:40570) 2024-09-15T22:44:49.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 -- 172.21.15.66:0/981199451 learned_addr learned my addr 172.21.15.66:0/981199451 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0aeffff640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 -- 172.21.15.66:0/981199451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 msgr2=0x55dd453125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af53a2640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45312ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 -- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 msgr2=0x55dd45312ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45312ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 -- 172.21.15.66:0/981199451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd45316af0 con 0x55dd452ee8b0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0aeffff640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af4ba1640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80a4910 tx=0x7f0ad809bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4b201a55263b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0acffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80bc2c0 con 0x55dd452ee8b0 2024-09-15T22:44:49.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f0ad80b5170 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ad80a4e40 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ad809b6d0 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af91de740 10 client.15138 fetch_fsmap learned FSMap version 27 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.944+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dd453795b0 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ad80a4e40 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0ad80ab080 con 0x55dd452ee8b0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 10 client.15138 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 10 client.15138 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 20 client.15138 populate_metadata read hostname 'smithi066' 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4537dae0 0x55dd4537c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 4 client.15138 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "status"}) -- 0x55dd4525cb10 con 0x55dd4537dae0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0aeffff640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4537dae0 0x55dd4537c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:49.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0acffff640 10 client.15138 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.945+0000 7f0aeffff640 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4537dae0 0x55dd4537c7f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fdd397cca5ff43f server_cookie=b7dae73a299d553 in_seq=0 out_seq=0 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0acffff640 1 -- 172.21.15.66:0/981199451 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55dd4525cb10 con 0x55dd4537dae0 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0acffff640 10 client.15138 handle_command_reply: tid=0 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 client.15138 shutdown 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 msgr2=0x55dd45312060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80a4910 tx=0x7f0ad809bdc0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 shutdown_connections 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55dd4537dae0 0x55dd4537c7f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd452fdfc0 0x55dd45312ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd452ef1d0 0x55dd453125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 --2- 172.21.15.66:0/981199451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd452ee8b0 0x55dd45312060 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0acffff640 0 client.15138 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 >> 172.21.15.66:0/981199451 conn(0x55dd452eaf60 msgr2=0x55dd452f5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:49.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 shutdown_connections 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 1 -- 172.21.15.66:0/981199451 wait complete. 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.946+0000 7f0af91de740 20 client.15138 trim_cache size 0 max 16384 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 msgr2=0x7f0adc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 0x7f0adc0a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800b6c0 tx=0x7f0ae800b2e0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 msgr2=0x7f0af0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9f0 tx=0x7f0ad800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 shutdown_connections 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0adc0a3350 0x7f0adc0a5810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0af0106f10 0x7f0af019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0102790 0x7f0af0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 --2- 172.21.15.66:0/1097347825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0af0101de0 0x7f0af0198420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:49.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 >> 172.21.15.66:0/1097347825 conn(0x7f0af00fd8c0 msgr2=0x7f0af00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 shutdown_connections 2024-09-15T22:44:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:48.947+0000 7f0af6e05640 1 -- 172.21.15.66:0/1097347825 wait complete. 2024-09-15T22:44:49.656 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T22:44:49.656 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:44:49.669 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:44:49.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T22:44:49.933 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- 172.21.15.66:0/2400532606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318100ad0 msgr2=0x7f2318100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 --2- 172.21.15.66:0/2400532606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318100ad0 0x7f2318100ed0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2314009900 tx=0x7f231402a410 comp rx=0 tx=0).stop 2024-09-15T22:44:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- 172.21.15.66:0/2400532606 shutdown_connections 2024-09-15T22:44:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 --2- 172.21.15.66:0/2400532606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f2318108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 --2- 172.21.15.66:0/2400532606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318101cd0 0x7f2318102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 --2- 172.21.15.66:0/2400532606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318100ad0 0x7f2318100ed0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- 172.21.15.66:0/2400532606 >> 172.21.15.66:0/2400532606 conn(0x7f23180fc280 msgr2=0x7f23180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- 172.21.15.66:0/2400532606 shutdown_connections 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- 172.21.15.66:0/2400532606 wait complete. 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 Processor -- start 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.410+0000 7f231fb35640 1 -- start start 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318100ad0 0x7f231806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f231819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f231810c7b0 con 0x7f2318101cd0 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f231810c630 con 0x7f2318102690 2024-09-15T22:44:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f231810c930 con 0x7f2318100ad0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40590/0 (socket says 172.21.15.66:40590) 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 -- 172.21.15.66:0/1851631111 learned_addr learned my addr 172.21.15.66:0/1851631111 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d8d1640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318100ad0 0x7f231806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231e0d2640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f231819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 -- 172.21.15.66:0/1851631111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318100ad0 msgr2=0x7f231806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318100ad0 0x7f231806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 -- 172.21.15.66:0/1851631111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 msgr2=0x7f231819f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f231819f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 -- 172.21.15.66:0/1851631111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231819fb80 con 0x7f2318101cd0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231e0d2640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f231819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231d0d0640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f230800b4a0 tx=0x7f230800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308014070 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2308010af0 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231819fe10 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.411+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308017d10 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.412+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181a0340 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.413+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318107e70 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.414+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2308017070 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.415+0000 7f230effd640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 0x7f23040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.415+0000 7f231d8d1640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 0x7f23040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.415+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f23080cf0e0 con 0x7f2318101cd0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.415+0000 7f231d8d1640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 0x7f23040a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f2314000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.419+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f230809ba70 con 0x7f2318101cd0 2024-09-15T22:44:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:50 smithi087 ceph-mon[35290]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:44:50.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.614+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2318062630 con 0x7f23040a32d0 2024-09-15T22:44:50.615 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:50 smithi066 ceph-mon[31185]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:44:50.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.615+0000 7f230effd640 1 -- 172.21.15.66:0/1851631111 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2318062630 con 0x7f23040a32d0 2024-09-15T22:44:50.616 INFO:teuthology.orchestra.run.smithi066.stdout:Backend: cephadm 2024-09-15T22:44:50.616 INFO:teuthology.orchestra.run.smithi066.stdout:Available: Yes 2024-09-15T22:44:50.616 INFO:teuthology.orchestra.run.smithi066.stdout:Paused: No 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.617+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 msgr2=0x7f23040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.617+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 0x7f23040a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f2314000bc0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.617+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 msgr2=0x7f231819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.617+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f230800b4a0 tx=0x7f230800b960 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 shutdown_connections 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f23040a32d0 0x7f23040a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2318102690 0x7f231819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2318101cd0 0x7f231819cc50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 --2- 172.21.15.66:0/1851631111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2318100ad0 0x7f231806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 >> 172.21.15.66:0/1851631111 conn(0x7f23180fc280 msgr2=0x7f2318105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 shutdown_connections 2024-09-15T22:44:50.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:50.618+0000 7f231fb35640 1 -- 172.21.15.66:0/1851631111 wait complete. 2024-09-15T22:44:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:50 smithi184 ceph-mon[35203]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:44:51.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T22:44:51.686 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:52.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- 172.21.15.66:0/3756671162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1014d0 msgr2=0x7f5adc101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/3756671162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1014d0 0x7f5adc101950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400aa10 tx=0x7f5ac402b720 comp rx=0 tx=0).stop 2024-09-15T22:44:52.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- 172.21.15.66:0/3756671162 shutdown_connections 2024-09-15T22:44:52.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/3756671162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc101e90 0x7f5adc108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/3756671162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1014d0 0x7f5adc101950 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/3756671162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc1002d0 0x7f5adc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- 172.21.15.66:0/3756671162 >> 172.21.15.66:0/3756671162 conn(0x7f5adc0fba80 msgr2=0x7f5adc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- 172.21.15.66:0/3756671162 shutdown_connections 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- 172.21.15.66:0/3756671162 wait complete. 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 Processor -- start 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.153+0000 7f5ae13b9640 1 -- start start 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 0x7f5adc196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc101e90 0x7f5adc19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc10b680 con 0x7f5adc1002d0 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc10b500 con 0x7f5adc1014d0 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ae13b9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc10b800 con 0x7f5adc101e90 2024-09-15T22:44:52.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40610/0 (socket says 172.21.15.66:40610) 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 -- 172.21.15.66:0/247675641 learned_addr learned my addr 172.21.15.66:0/247675641 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ad3fff640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 0x7f5adc196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adb7fe640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc101e90 0x7f5adc19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 -- 172.21.15.66:0/247675641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc101e90 msgr2=0x7f5adc19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc101e90 0x7f5adc19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 -- 172.21.15.66:0/247675641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 msgr2=0x7f5adc196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 0x7f5adc196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 -- 172.21.15.66:0/247675641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc19d930 con 0x7f5adc1002d0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ad3fff640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 0x7f5adc196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5adaffd640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5acc007920 tx=0x7f5acc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.154+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc019070 con 0x7f5adc1002d0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.155+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc19dc20 con 0x7f5adc1002d0 2024-09-15T22:44:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.155+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc005020 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.155+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc004ad0 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.155+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc19e110 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.156+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc107720 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.157+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5acc01c070 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.158+0000 7f5ad8ff9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 0x7f5ac80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.158+0000 7f5ad3fff640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 0x7f5ac80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.158+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f5acc0d0da0 con 0x7f5adc1002d0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.158+0000 7f5ad3fff640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 0x7f5ac80a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac400a700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.162+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5acc09d620 con 0x7f5adc1002d0 2024-09-15T22:44:52.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.347+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5adc062630 con 0x7f5ac80a32d0 2024-09-15T22:44:52.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.359+0000 7f5ad8ff9640 1 -- 172.21.15.66:0/247675641 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f5adc062630 con 0x7f5ac80a32d0 2024-09-15T22:44:52.360 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.a smithi066 running (2m) 60s ago 2m 15.4M - 19.1.1-326-g8921c8ef f1455bd0219c 5d5fb2ff6a51 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.b smithi087 running (2m) 61s ago 2m 25.7M - 19.1.1-326-g8921c8ef f1455bd0219c 23a24a60cb3a 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.c smithi184 running (2m) 61s ago 2m 16.4M - 19.1.1-326-g8921c8ef f1455bd0219c 1cc1dcd43311 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.d smithi066 running (2m) 60s ago 2m 17.9M - 19.1.1-326-g8921c8ef f1455bd0219c 774c9c33b538 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.e smithi087 running (2m) 61s ago 2m 15.3M - 19.1.1-326-g8921c8ef f1455bd0219c 15f3b72c3975 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.f smithi184 running (2m) 61s ago 2m 19.7M - 19.1.1-326-g8921c8ef f1455bd0219c f28044854e41 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.g smithi066 running (2m) 60s ago 2m 17.0M - 19.1.1-326-g8921c8ef f1455bd0219c 1a9688d4680f 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.h smithi087 running (2m) 61s ago 2m 19.5M - 19.1.1-326-g8921c8ef f1455bd0219c 64396dc5cdff 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.i smithi184 running (2m) 61s ago 2m 17.5M - 19.1.1-326-g8921c8ef f1455bd0219c ffdae38b5d48 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.j smithi066 running (2m) 60s ago 2m 14.5M - 19.1.1-326-g8921c8ef f1455bd0219c 7c36941ba55c 2024-09-15T22:44:52.361 INFO:teuthology.orchestra.run.smithi066.stdout:mds.k smithi087 running (2m) 61s ago 2m 17.8M - 19.1.1-326-g8921c8ef f1455bd0219c ea727a24ee26 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mds.l smithi184 running (2m) 61s ago 2m 14.5M - 19.1.1-326-g8921c8ef f1455bd0219c 175baf212957 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.x smithi066 *:9283,8765 running (9m) 60s ago 9m 510M - 19.1.1-326-g8921c8ef f1455bd0219c fba3a00f4f89 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.y smithi087 *:8443,8765 running (7m) 61s ago 7m 445M - 19.1.1-326-g8921c8ef f1455bd0219c 7690ab5b97f0 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.z smithi184 *:8443,8765 running (7m) 61s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 7114bdee623f 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mon.a smithi066 running (9m) 60s ago 9m 51.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 9bfafe6850e3 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mon.b smithi087 running (8m) 61s ago 8m 42.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2f36e97dac4a 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:mon.c smithi184 running (8m) 61s ago 8m 41.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c c05aed957d18 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (7m) 60s ago 7m 56.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 4982a4fdf14f 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi087 running (7m) 61s ago 7m 53.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 11b09f58c7dc 2024-09-15T22:44:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi184 running (6m) 61s ago 6m 47.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 4de269d65f15 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi066 running (6m) 60s ago 6m 52.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 07e8f4530060 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi087 running (5m) 61s ago 5m 51.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 978d2646da41 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi184 running (5m) 61s ago 5m 51.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 4615904c0808 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.6 smithi066 running (5m) 60s ago 5m 51.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 92419b690c7d 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.7 smithi087 running (4m) 61s ago 4m 46.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6a9931035a7a 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.8 smithi184 running (4m) 61s ago 4m 42.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 9fd3d32560b3 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.9 smithi066 running (3m) 60s ago 3m 41.7M 4272M 19.1.1-326-g8921c8ef f1455bd0219c ee529a740ccd 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.10 smithi087 running (3m) 61s ago 3m 46.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c ce1d0b904256 2024-09-15T22:44:52.363 INFO:teuthology.orchestra.run.smithi066.stdout:osd.11 smithi184 running (2m) 61s ago 2m 41.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c e0145b02754d 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 msgr2=0x7f5ac80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 0x7f5ac80a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac400a700 comp rx=0 tx=0).stop 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 msgr2=0x7f5adc195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5acc007920 tx=0x7f5acc007de0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 shutdown_connections 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5adc101e90 0x7f5adc19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f5ac80a32d0 0x7f5ac80a5790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1014d0 0x7f5adc196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 --2- 172.21.15.66:0/247675641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5adc1002d0 0x7f5adc195d10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:52.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 >> 172.21.15.66:0/247675641 conn(0x7f5adc0fba80 msgr2=0x7f5adc1048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:52.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 shutdown_connections 2024-09-15T22:44:52.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:52.361+0000 7f5ae13b9640 1 -- 172.21.15.66:0/247675641 wait complete. 2024-09-15T22:44:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:52 smithi087 ceph-mon[35290]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:52 smithi087 ceph-mon[35290]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:52 smithi184 ceph-mon[35203]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:52 smithi184 ceph-mon[35203]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:52.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:52 smithi066 ceph-mon[31185]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:52.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:52 smithi066 ceph-mon[31185]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:53.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T22:44:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:53 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:53.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:53 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:53 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:44:54.127 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:54.522 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:54.522 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-15T22:44:54.523 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.523 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.523 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.523 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:54 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-15T22:44:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:54 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 -- 172.21.15.66:0/254588619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c101d10 msgr2=0x7f545c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 --2- 172.21.15.66:0/254588619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c101d10 0x7f545c102190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f544c009900 tx=0x7f544c02a410 comp rx=0 tx=0).stop 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 -- 172.21.15.66:0/254588619 shutdown_connections 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 --2- 172.21.15.66:0/254588619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c1026d0 0x7f545c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 --2- 172.21.15.66:0/254588619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c101d10 0x7f545c102190 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 --2- 172.21.15.66:0/254588619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 -- 172.21.15.66:0/254588619 >> 172.21.15.66:0/254588619 conn(0x7f545c0fc2a0 msgr2=0x7f545c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 -- 172.21.15.66:0/254588619 shutdown_connections 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.605+0000 7f5461e42640 1 -- 172.21.15.66:0/254588619 wait complete. 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 Processor -- start 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 -- start start 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c101d10 0x7f545c1030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10c770 con 0x7f545c1026d0 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10c5f0 con 0x7f545c100b10 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f5461e42640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10c8f0 con 0x7f545c101d10 2024-09-15T22:44:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55226/0 (socket says 172.21.15.66:55226) 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 -- 172.21.15.66:0/4242295784 learned_addr learned my addr 172.21.15.66:0/4242295784 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545affd640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c101d10 0x7f545c1030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545b7fe640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 -- 172.21.15.66:0/4242295784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c101d10 msgr2=0x7f545c1030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c101d10 0x7f545c1030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 -- 172.21.15.66:0/4242295784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 msgr2=0x7f545c104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545bfff640 1 -- 172.21.15.66:0/4242295784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c103ef0 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.606+0000 7f545b7fe640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f545bfff640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5454009fd0 tx=0x7f545400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454017070 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5454003e50 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c1a20d0 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54540106c0 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.607+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c1a2590 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.608+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c1a27c0 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.609+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5454003970 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.610+0000 7f5458ff9640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 0x7f54480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.610+0000 7f545b7fe640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 0x7f54480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.611+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f54540cfad0 con 0x7f545c1026d0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.611+0000 7f545b7fe640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 0x7f54480a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f545c101b70 tx=0x7f5444005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.615+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f545409bd00 con 0x7f545c1026d0 2024-09-15T22:44:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-15T22:44:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:54 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:54.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.814+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f545c06af10 con 0x7f54480a32d0 2024-09-15T22:44:54.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.820+0000 7f5458ff9640 1 -- 172.21.15.66:0/4242295784 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f545c06af10 con 0x7f54480a32d0 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi066.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi066.stdout:mds.all 12/12 62s ago 2m smithi066=a;smithi066=d;smithi066=g;smithi066=j;smithi087=b;smithi087=e;smithi087=h;smithi087=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi066.stdout:mgr 3/3 62s ago 8m smithi066=x;smithi087=y;smithi184=z;count:3 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi066.stdout:mon 3/3 62s ago 8m smithi066:172.21.15.66=a;smithi087:172.21.15.87=b;smithi184:172.21.15.184=c;count:3 2024-09-15T22:44:54.822 INFO:teuthology.orchestra.run.smithi066.stdout:osd 12 62s ago - 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.822+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 msgr2=0x7f54480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.822+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 0x7f54480a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f545c101b70 tx=0x7f5444005f90 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.822+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 msgr2=0x7f545c103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.822+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5454009fd0 tx=0x7f545400b260 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 shutdown_connections 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f545c1026d0 0x7f545c103630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f545c101d10 0x7f545c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f54480a32d0 0x7f54480a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 --2- 172.21.15.66:0/4242295784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f545c100b10 0x7f545c104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:54.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 >> 172.21.15.66:0/4242295784 conn(0x7f545c0fc2a0 msgr2=0x7f545c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:54.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 shutdown_connections 2024-09-15T22:44:54.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:54.823+0000 7f5461e42640 1 -- 172.21.15.66:0/4242295784 wait complete. 2024-09-15T22:44:55.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:55 smithi066 ceph-mon[31185]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:44:55.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:55 smithi066 ceph-mon[31185]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:55 smithi087 ceph-mon[35290]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:44:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:55 smithi087 ceph-mon[35290]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:55 smithi184 ceph-mon[35203]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-15T22:44:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:55 smithi184 ceph-mon[35203]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:55.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T22:44:55.974 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:56.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- 172.21.15.66:0/686070299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c107940 msgr2=0x7f961c109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 --2- 172.21.15.66:0/686070299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c107940 0x7f961c109d30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9614009ca0 tx=0x7f961402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- 172.21.15.66:0/686070299 shutdown_connections 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 --2- 172.21.15.66:0/686070299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c107940 0x7f961c109d30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 --2- 172.21.15.66:0/686070299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 0x7f961c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 --2- 172.21.15.66:0/686070299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c1026e0 0x7f961c104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- 172.21.15.66:0/686070299 >> 172.21.15.66:0/686070299 conn(0x7f961c0fc280 msgr2=0x7f961c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- 172.21.15.66:0/686070299 shutdown_connections 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- 172.21.15.66:0/686070299 wait complete. 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 Processor -- start 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.500+0000 7f9623a30640 1 -- start start 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 0x7f961c100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c107940 0x7f961c100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10d880 con 0x7f961c1026e0 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10d700 con 0x7f961c105010 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9623a30640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10da00 con 0x7f961c107940 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55248/0 (socket says 172.21.15.66:55248) 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 -- 172.21.15.66:0/4031390232 learned_addr learned my addr 172.21.15.66:0/4031390232 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9620fcb640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 0x7f961c100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f9621fcd640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c107940 0x7f961c100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 -- 172.21.15.66:0/4031390232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c107940 msgr2=0x7f961c100bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c107940 0x7f961c100bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 -- 172.21.15.66:0/4031390232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 msgr2=0x7f961c100690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 0x7f961c100690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 -- 172.21.15.66:0/4031390232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c101490 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f96217cc640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f961000d770 tx=0x7f961000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.501+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610017070 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.502+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c1a2060 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.502+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9610005500 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.502+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610004e00 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.502+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c1a2520 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.503+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c0fdd70 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.504+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9610004fa0 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.505+0000 7f960e7fc640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 0x7f96080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.505+0000 7f9620fcb640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 0x7f96080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.505+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f96100cfb10 con 0x7f961c1026e0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.505+0000 7f9620fcb640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 0x7f96080a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f961c101dc0 tx=0x7f961800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:56.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.512+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f961009bd40 con 0x7f961c1026e0 2024-09-15T22:44:56.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.695+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f961c062630 con 0x7f96080a32d0 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.697+0000 7f960e7fc640 1 -- 172.21.15.66:0/4031390232 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f961c062630 con 0x7f96080a32d0 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stdout:HOST ADDR LABELS STATUS 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066 172.21.15.66 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stdout:smithi087 172.21.15.87 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stdout:smithi184 172.21.15.184 2024-09-15T22:44:56.698 INFO:teuthology.orchestra.run.smithi066.stdout:3 hosts in cluster 2024-09-15T22:44:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 msgr2=0x7f96080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 0x7f96080a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f961c101dc0 tx=0x7f961800b390 comp rx=0 tx=0).stop 2024-09-15T22:44:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 msgr2=0x7f961c102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f961000d770 tx=0x7f961000dc30 comp rx=0 tx=0).stop 2024-09-15T22:44:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 shutdown_connections 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f961c107940 0x7f961c100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f96080a32d0 0x7f96080a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f961c105010 0x7f961c100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 --2- 172.21.15.66:0/4031390232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f961c1026e0 0x7f961c102040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 >> 172.21.15.66:0/4031390232 conn(0x7f961c0fc280 msgr2=0x7f961c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 shutdown_connections 2024-09-15T22:44:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:56.700+0000 7f9623a30640 1 -- 172.21.15.66:0/4031390232 wait complete. 2024-09-15T22:44:56.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:56.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:56.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:56.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:56.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:56 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:56 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:44:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:44:57.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:56 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' 2024-09-15T22:44:57.390 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T22:44:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 -- 172.21.15.66:0/2832274144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a41026a0 msgr2=0x7f55a4104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 --2- 172.21.15.66:0/2832274144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a41026a0 0x7f55a4104a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009900 tx=0x7f55a002a410 comp rx=0 tx=0).stop 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 -- 172.21.15.66:0/2832274144 shutdown_connections 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 --2- 172.21.15.66:0/2832274144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4107900 0x7f55a4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 --2- 172.21.15.66:0/2832274144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4104fd0 0x7f55a41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 --2- 172.21.15.66:0/2832274144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a41026a0 0x7f55a4104a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 -- 172.21.15.66:0/2832274144 >> 172.21.15.66:0/2832274144 conn(0x7f55a40fc2a0 msgr2=0x7f55a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:58.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 -- 172.21.15.66:0/2832274144 shutdown_connections 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.147+0000 7f55abd75640 1 -- 172.21.15.66:0/2832274144 wait complete. 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 Processor -- start 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 -- start start 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 0x7f55a4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4104fd0 0x7f55a41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410d8d0 con 0x7f55a4107900 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410d750 con 0x7f55a4104fd0 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55abd75640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410da50 con 0x7f55a41026a0 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55aa312640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55aa312640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55264/0 (socket says 172.21.15.66:55264) 2024-09-15T22:44:58.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55aa312640 1 -- 172.21.15.66:0/1263042523 learned_addr learned my addr 172.21.15.66:0/1263042523 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.148+0000 7f55a9b11640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 0x7f55a4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 -- 172.21.15.66:0/1263042523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 msgr2=0x7f55a4197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 0x7f55a4197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 -- 172.21.15.66:0/1263042523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4104fd0 msgr2=0x7f55a41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4104fd0 0x7f55a41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 -- 172.21.15.66:0/1263042523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a419fbc0 con 0x7f55a4107900 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55a9b11640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 0x7f55a4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55aa312640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cad0 tx=0x7f559c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00ae20 con 0x7f55a4107900 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f559c005020 con 0x7f55a4107900 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00f6f0 con 0x7f55a4107900 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a419feb0 con 0x7f55a4107900 2024-09-15T22:44:58.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.149+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41a03c0 con 0x7f55a4107900 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.150+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a41053e0 con 0x7f55a4107900 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.151+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f559c0051d0 con 0x7f55a4107900 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.152+0000 7f559affd640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 0x7f55900a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.152+0000 7f55a9b11640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 0x7f55900a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.152+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f559c0d01c0 con 0x7f55a4107900 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.153+0000 7f55a9b11640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 0x7f55900a5840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f55a0000c00 tx=0x7f55a00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:58.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.155+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55a41053e0 con 0x7f55a4107900 2024-09-15T22:44:58.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.340+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 --> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f55a4062630 con 0x7f55900a3380 2024-09-15T22:44:58.341 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:58 smithi066 ceph-mon[31185]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:58.342 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:44:58 smithi066 ceph-mon[31185]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:58.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.342+0000 7f559affd640 1 -- 172.21.15.66:0/1263042523 <== mgr.14150 v2:172.21.15.66:6800/1080608797 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f55a4062630 con 0x7f55900a3380 2024-09-15T22:44:58.343 INFO:teuthology.orchestra.run.smithi066.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T22:44:58.343 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:44:58.344 INFO:teuthology.orchestra.run.smithi066.stdout:smithi087 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:44:58.344 INFO:teuthology.orchestra.run.smithi066.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T22:44:58.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 msgr2=0x7f55900a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 0x7f55900a5840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f55a0000c00 tx=0x7f55a00095f0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 msgr2=0x7f55a419f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:58.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cad0 tx=0x7f559c00cf90 comp rx=0 tx=0).stop 2024-09-15T22:44:58.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 shutdown_connections 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4107900 0x7f55a419f550 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f55900a3380 0x7f55900a5840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4104fd0 0x7f55a41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 --2- 172.21.15.66:0/1263042523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a41026a0 0x7f55a4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 >> 172.21.15.66:0/1263042523 conn(0x7f55a40fc2a0 msgr2=0x7f55a4103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 shutdown_connections 2024-09-15T22:44:58.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:58.344+0000 7f55abd75640 1 -- 172.21.15.66:0/1263042523 wait complete. 2024-09-15T22:44:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:58 smithi184 ceph-mon[35203]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:44:58 smithi184 ceph-mon[35203]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:58 smithi087 ceph-mon[35290]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:44:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:44:58 smithi087 ceph-mon[35290]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:44:59.098 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:44:59.108 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:44:59.108 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T22:44:59.368 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:44:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 -- 172.21.15.66:0/679123703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8107960 msgr2=0x7f7cb8109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/679123703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8107960 0x7f7cb8109d50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009ca0 tx=0x7f7cb002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 -- 172.21.15.66:0/679123703 shutdown_connections 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/679123703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8107960 0x7f7cb8109d50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/679123703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 0x7f7cb8107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/679123703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8102700 0x7f7cb8104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 -- 172.21.15.66:0/679123703 >> 172.21.15.66:0/679123703 conn(0x7f7cb80fc2a0 msgr2=0x7f7cb80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 -- 172.21.15.66:0/679123703 shutdown_connections 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.870+0000 7f7cbdb27640 1 -- 172.21.15.66:0/679123703 wait complete. 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 Processor -- start 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 -- start start 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 0x7f7cb81006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8107960 0x7f7cb8100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810d8c0 con 0x7f7cb8102700 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810d740 con 0x7f7cb8105030 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cbdb27640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810da40 con 0x7f7cb8107960 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.871+0000 7f7cb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55292/0 (socket says 172.21.15.66:55292) 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 -- 172.21.15.66:0/3993344280 learned_addr learned my addr 172.21.15.66:0/3993344280 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb7fff640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8107960 0x7f7cb8100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb6ffd640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 0x7f7cb81006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 -- 172.21.15.66:0/3993344280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8107960 msgr2=0x7f7cb8100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8107960 0x7f7cb8100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 -- 172.21.15.66:0/3993344280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 msgr2=0x7f7cb81006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 0x7f7cb81006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 -- 172.21.15.66:0/3993344280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb81014b0 con 0x7f7cb8102700 2024-09-15T22:44:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb77fe640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c970 tx=0x7f7ca800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8007bb0 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8007d50 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb81a1fe0 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800f450 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.872+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81a2440 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.873+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb80fdd90 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.874+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7ca8005020 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.875+0000 7f7cb4ff9640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 0x7f7ca00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.875+0000 7f7cb6ffd640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 0x7f7ca00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.875+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9071+0+0 (secure 0 0 0) 0x7f7ca80cfbd0 con 0x7f7cb8102700 2024-09-15T22:44:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.876+0000 7f7cb6ffd640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 0x7f7ca00a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8101de0 tx=0x7f7cac005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:44:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:44:59.879+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ca8014030 con 0x7f7cb8102700 2024-09-15T22:45:00.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.091+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7cb8062df0 con 0x7f7cb8102700 2024-09-15T22:45:00.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.091+0000 7f7cb4ff9640 1 -- 172.21.15.66:0/3993344280 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3130 (secure 0 0 0) 0x7f7ca809c450 con 0x7f7cb8102700 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:e27 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:btime 2024-09-15T22:43:38:783620+0000 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-15T22:45:00.093 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 27 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-15T22:42:54.256195+0000 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-15T22:43:38.783615+0000 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 300 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 0 2024-09-15T22:45:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 5 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:in 0,1,2,3,4 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=24461,1=24442,2=24437,3=24427,4=24421} 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3,4] 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 0 2024-09-15T22:45:00.095 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 24461 members: 24421,24427,24437,24442,24461 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b{0:24461} state up:active seq 4 addr [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.e{0:24416} state up:standby-replay seq 1 addr [v2:172.21.15.87:6834/1324797641,v1:172.21.15.87:6835/1324797641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.i{1:24442} state up:active seq 16 addr [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.k{1:24395} state up:standby-replay seq 1 addr [v2:172.21.15.87:6832/3190263553,v1:172.21.15.87:6833/3190263553] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.h{2:24437} state up:active seq 17 addr [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.l{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.184:6832/1400845283,v1:172.21.15.184:6833/1400845283] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c{3:24427} state up:active seq 18 addr [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a{3:14610} state up:standby-replay seq 1 addr [v2:172.21.15.66:6840/3123963280,v1:172.21.15.66:6841/3123963280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.f{4:24421} state up:active seq 19 addr [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.g{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.66:6838/2023001898,v1:172.21.15.66:6839/2023001898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-15T22:45:00.096 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:00.097 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.66:6834/2455952425,v1:172.21.15.66:6835/2455952425] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.097 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.66:6836/3213913697,v1:172.21.15.66:6837/3213913697] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.093+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 msgr2=0x7f7ca00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.093+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 0x7f7ca00a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8101de0 tx=0x7f7cac005cc0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.093+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 msgr2=0x7f7cb8102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.093+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c970 tx=0x7f7ca800ce30 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 shutdown_connections 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cb8107960 0x7f7cb8100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f7ca00a32d0 0x7f7ca00a5790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cb8105030 0x7f7cb81006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 --2- 172.21.15.66:0/3993344280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cb8102700 0x7f7cb8102060 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 >> 172.21.15.66:0/3993344280 conn(0x7f7cb80fc2a0 msgr2=0x7f7cb8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 shutdown_connections 2024-09-15T22:45:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:00.094+0000 7f7cbdb27640 1 -- 172.21.15.66:0/3993344280 wait complete. 2024-09-15T22:45:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:00 smithi184 ceph-mon[35203]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:00 smithi184 ceph-mon[35203]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:45:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:00 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3993344280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:45:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:00 smithi066 ceph-mon[31185]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:00 smithi066 ceph-mon[31185]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:45:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:00 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3993344280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:45:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:00 smithi087 ceph-mon[35290]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:00.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:00 smithi087 ceph-mon[35290]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:45:00.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:00 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3993344280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:45:00.796 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T22:45:01.059 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:45:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T22:45:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T22:45:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-09-15T22:45:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-15T22:45:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:01 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-15T22:45:01.430 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:01 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-09-15T22:45:01.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- 172.21.15.66:0/3507925674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4105030 msgr2=0x7f9cf4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/3507925674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4105030 0x7f9cf4107420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009900 tx=0x7f9ce802a410 comp rx=0 tx=0).stop 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- 172.21.15.66:0/3507925674 shutdown_connections 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/3507925674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4107960 0x7f9cf4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/3507925674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4105030 0x7f9cf4107420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/3507925674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 0x7f9cf4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- 172.21.15.66:0/3507925674 >> 172.21.15.66:0/3507925674 conn(0x7f9cf40fc280 msgr2=0x7f9cf40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- 172.21.15.66:0/3507925674 shutdown_connections 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- 172.21.15.66:0/3507925674 wait complete. 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 Processor -- start 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.511+0000 7f9cfb26b640 1 -- start start 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 0x7f9cf4102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 0x7f9cf41006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf410d850 con 0x7f9cf4107960 2024-09-15T22:45:01.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf410d6d0 con 0x7f9cf4102700 2024-09-15T22:45:01.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cfb26b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf410d9d0 con 0x7f9cf4105030 2024-09-15T22:45:01.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55298/0 (socket says 172.21.15.66:55298) 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 -- 172.21.15.66:0/154050228 learned_addr learned my addr 172.21.15.66:0/154050228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9007640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 0x7f9cf4102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf8806640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 0x7f9cf41006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 -- 172.21.15.66:0/154050228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 msgr2=0x7f9cf41006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 0x7f9cf41006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 -- 172.21.15.66:0/154050228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 msgr2=0x7f9cf4102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 0x7f9cf4102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 -- 172.21.15.66:0/154050228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf41014b0 con 0x7f9cf4107960 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf8806640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 0x7f9cf41006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.512+0000 7f9cf9808640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400eaa0 tx=0x7f9ce400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.513+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400cdb0 con 0x7f9cf4107960 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.513+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ce4005020 con 0x7f9cf4107960 2024-09-15T22:45:01.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.513+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf41a2090 con 0x7f9cf4107960 2024-09-15T22:45:01.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.513+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40116b0 con 0x7f9cf4107960 2024-09-15T22:45:01.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.513+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf41a25a0 con 0x7f9cf4107960 2024-09-15T22:45:01.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.514+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf40fdd70 con 0x7f9cf4107960 2024-09-15T22:45:01.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.515+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9ce4005560 con 0x7f9cf4107960 2024-09-15T22:45:01.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.516+0000 7f9cf27fc640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 0x7f9cdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:01.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.516+0000 7f9cf9007640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 0x7f9cdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:01.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.516+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9245+0+0 (secure 0 0 0) 0x7f9ce40cff50 con 0x7f9cf4107960 2024-09-15T22:45:01.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.516+0000 7f9cf9007640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 0x7f9cdc0a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00bbe0 tx=0x7f9cec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:01.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.520+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ce4016030 con 0x7f9cf4107960 2024-09-15T22:45:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-09-15T22:45:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T22:45:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T22:45:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-09-15T22:45:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-09-15T22:45:01.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:01 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-09-15T22:45:01.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.699+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9cf402d7c0 con 0x7f9cf4107960 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.700+0000 7f9cf27fc640 1 -- 172.21.15.66:0/154050228 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5714 (secure 0 0 0) 0x7f9ce409c880 con 0x7f9cf4107960 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 88 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-15T22:35:13.922077+0000 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-15T22:45:01.136765+0000 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T22:45:01.701 INFO:teuthology.orchestra.run.smithi066.stdout:crush_version 27 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:full_ratio 0.95 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:backfillfull_ratio 0.9 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:nearfull_ratio 0.85 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:require_min_compat_client luminous 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:min_compat_client luminous 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:require_osd_release squid 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:stretch_mode_enabled false 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:max_osd 12 2024-09-15T22:45:01.702 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6802/1159962456,v1:172.21.15.66:6803/1159962456] [v2:172.21.15.66:6804/1159962456,v1:172.21.15.66:6805/1159962456] exists,up ceadf938-3e92-4e02-bf52-56073010f453 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/2341073129,v1:172.21.15.87:6801/2341073129] [v2:172.21.15.87:6802/2341073129,v1:172.21.15.87:6803/2341073129] exists,up c0556bc3-9d56-4289-b5c7-e121a7c3bcc2 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/3684058507,v1:172.21.15.184:6801/3684058507] [v2:172.21.15.184:6802/3684058507,v1:172.21.15.184:6803/3684058507] exists,up 30d6d931-c774-4f28-b5d8-a727dff41a5c 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 up in weight 1 up_from 24 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6810/2160125809,v1:172.21.15.66:6811/2160125809] [v2:172.21.15.66:6812/2160125809,v1:172.21.15.66:6813/2160125809] exists,up 859cfec4-c8ab-405c-85a5-27dd929dfed7 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 up in weight 1 up_from 31 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6808/58379283,v1:172.21.15.87:6809/58379283] [v2:172.21.15.87:6810/58379283,v1:172.21.15.87:6811/58379283] exists,up ac9282dd-6aa5-4a6f-923c-0d33cd51247b 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 up in weight 1 up_from 35 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/1677940591,v1:172.21.15.184:6809/1677940591] [v2:172.21.15.184:6810/1677940591,v1:172.21.15.184:6811/1677940591] exists,up d89019ce-9967-40f3-9e23-c8f6a843d797 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.6 up in weight 1 up_from 42 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6818/1408845651,v1:172.21.15.66:6819/1408845651] [v2:172.21.15.66:6820/1408845651,v1:172.21.15.66:6821/1408845651] exists,up acfbea05-26e8-46d7-a898-765aac29e742 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.7 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6816/1077446470,v1:172.21.15.87:6817/1077446470] [v2:172.21.15.87:6818/1077446470,v1:172.21.15.87:6819/1077446470] exists,up 2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.8 up in weight 1 up_from 54 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/2711654009,v1:172.21.15.184:6817/2711654009] [v2:172.21.15.184:6818/2711654009,v1:172.21.15.184:6819/2711654009] exists,up bff2b15f-7378-4a0e-9c97-83b9d367c938 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.9 up in weight 1 up_from 61 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6826/655656094,v1:172.21.15.66:6827/655656094] [v2:172.21.15.66:6828/655656094,v1:172.21.15.66:6829/655656094] exists,up 1fae9263-8048-49be-aabd-a20fe2ff7153 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.10 up in weight 1 up_from 66 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6824/1638725655,v1:172.21.15.87:6825/1638725655] [v2:172.21.15.87:6826/1638725655,v1:172.21.15.87:6827/1638725655] exists,up bf14352c-0b93-4188-af44-8ad4335c4e3c 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:osd.11 up in weight 1 up_from 73 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/848932004,v1:172.21.15.184:6825/848932004] [v2:172.21.15.184:6826/848932004,v1:172.21.15.184:6827/848932004] exists,up dac66f9a-0a5d-40ca-85e7-f48d9aaee71a 2024-09-15T22:45:01.703 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 2.b [2,1,8,11] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 2.13 [2,11] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 2.1a [8,4] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.6 [4,6] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.7 [3,9] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.c [3,9] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.14 [4,7] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.17 [4,6] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.31 [4,8] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.33 [5,9] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 3.37 [5,8] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 4.2 [9,1] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 4.5 [5,8] 2024-09-15T22:45:01.704 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 4.b [9,8] 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:pg_upmap_items 4.e [9,11] 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/4222885037 expires 2024-09-16T22:36:00.281528+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/1307325821 expires 2024-09-16T22:36:00.281528+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:6801/1250063396 expires 2024-09-16T22:36:00.281528+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:6800/1250063396 expires 2024-09-16T22:36:00.281528+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/3360541639 expires 2024-09-16T22:35:35.887512+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/3357213114 expires 2024-09-16T22:35:35.887512+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/1680944887 expires 2024-09-16T22:36:00.281528+0000 2024-09-15T22:45:01.705 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:0/2189919935 expires 2024-09-16T22:35:35.887512+0000 2024-09-15T22:45:01.706 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:6801/4191727117 expires 2024-09-16T22:35:35.887512+0000 2024-09-15T22:45:01.706 INFO:teuthology.orchestra.run.smithi066.stdout:blocklist 172.21.15.66:6800/4191727117 expires 2024-09-16T22:35:35.887512+0000 2024-09-15T22:45:01.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 msgr2=0x7f9cdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 0x7f9cdc0a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00bbe0 tx=0x7f9cec00b390 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 msgr2=0x7f9cf4100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400eaa0 tx=0x7f9ce400ef60 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 shutdown_connections 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf4107960 0x7f9cf4100bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf4105030 0x7f9cf41006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f9cdc0a3240 0x7f9cdc0a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 --2- 172.21.15.66:0/154050228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf4102700 0x7f9cf4102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 >> 172.21.15.66:0/154050228 conn(0x7f9cf40fc280 msgr2=0x7f9cf41030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 shutdown_connections 2024-09-15T22:45:01.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:01.703+0000 7f9cfb26b640 1 -- 172.21.15.66:0/154050228 wait complete. 2024-09-15T22:45:02.344 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:02.344 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:45:02.345 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:02 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/154050228' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:45:02.374 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T22:45:02.385 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:45:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:02 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/154050228' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:45:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-15T22:45:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T22:45:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T22:45:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-15T22:45:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-15T22:45:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='mgr.14150 172.21.15.66:0/980064377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-09-15T22:45:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T22:45:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:45:02.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:02 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/154050228' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:45:02.644 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 -- 172.21.15.66:0/1286484981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101200 msgr2=0x7fef14101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/1286484981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101200 0x7fef14101660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fef04009900 tx=0x7fef0402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 -- 172.21.15.66:0/1286484981 shutdown_connections 2024-09-15T22:45:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/1286484981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101ba0 0x7fef1410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/1286484981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101200 0x7fef14101660 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/1286484981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 0x7fef14105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 -- 172.21.15.66:0/1286484981 >> 172.21.15.66:0/1286484981 conn(0x7fef14077210 msgr2=0x7fef140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 -- 172.21.15.66:0/1286484981 shutdown_connections 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.113+0000 7fef1bb2c640 1 -- 172.21.15.66:0/1286484981 wait complete. 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 Processor -- start 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 -- start start 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 0x7fef140fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 0x7fef140fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef14110f40 con 0x7fef14101ba0 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef14110dc0 con 0x7fef14105ad0 2024-09-15T22:45:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1bb2c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef141110c0 con 0x7fef14101200 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef190c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef190c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42000/0 (socket says 172.21.15.66:42000) 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef190c7640 1 -- 172.21.15.66:0/121044122 learned_addr learned my addr 172.21.15.66:0/121044122 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.114+0000 7fef1a0c9640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 0x7fef140fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef198c8640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 0x7fef140fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 -- 172.21.15.66:0/121044122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 msgr2=0x7fef140fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 0x7fef140fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 -- 172.21.15.66:0/121044122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 msgr2=0x7fef140fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 0x7fef140fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 -- 172.21.15.66:0/121044122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef141a6930 con 0x7fef14101ba0 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef198c8640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 0x7fef140fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef190c7640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef0402aa00 tx=0x7fef04003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0403f070 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef141a6bc0 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef04031c20 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04035030 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.115+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef141a70a0 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.116+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14101660 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.117+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef04042070 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.118+0000 7fef0affd640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 0x7fef000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.118+0000 7fef198c8640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 0x7fef000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.118+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fef040f04d0 con 0x7fef14101ba0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.118+0000 7fef198c8640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 0x7fef000a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef100058c0 tx=0x7fef10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.122+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef04031dd0 con 0x7fef14101ba0 2024-09-15T22:45:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.338+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef141a7270 con 0x7fef14101ba0 2024-09-15T22:45:03.340 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:03 smithi066 ceph-mon[31185]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:45:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.339+0000 7fef0affd640 1 -- 172.21.15.66:0/121044122 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fef040bce00 con 0x7fef14101ba0 2024-09-15T22:45:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:03.341 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:45:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:45:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 msgr2=0x7fef000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 0x7fef000a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef100058c0 tx=0x7fef10005850 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 msgr2=0x7fef140fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef0402aa00 tx=0x7fef04003b60 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 shutdown_connections 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fef000a3240 0x7fef000a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef14105ad0 0x7fef140fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef14101ba0 0x7fef140fcbd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 --2- 172.21.15.66:0/121044122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef14101200 0x7fef140fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 >> 172.21.15.66:0/121044122 conn(0x7fef14077210 msgr2=0x7fef140fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 shutdown_connections 2024-09-15T22:45:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:03.341+0000 7fef1bb2c640 1 -- 172.21.15.66:0/121044122 wait complete. 2024-09-15T22:45:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:03 smithi184 ceph-mon[35203]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:45:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:03 smithi087 ceph-mon[35290]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:45:04.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:04.325 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:04 smithi184 ceph-mon[35203]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2024-09-15T22:45:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:04 smithi184 ceph-mon[35203]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T22:45:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:04 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/121044122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:04.446 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:04 smithi066 ceph-mon[31185]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2024-09-15T22:45:04.446 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:04 smithi066 ceph-mon[31185]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T22:45:04.446 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:04 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/121044122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:04 smithi087 ceph-mon[35290]: pgmap v350: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 9 op/s 2024-09-15T22:45:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:04 smithi087 ceph-mon[35290]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T22:45:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:04 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/121044122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:04.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 -- 172.21.15.66:0/4109601940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 msgr2=0x7f61fc105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 --2- 172.21.15.66:0/4109601940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc105e70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009900 tx=0x7f61e402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 -- 172.21.15.66:0/4109601940 shutdown_connections 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 --2- 172.21.15.66:0/4109601940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 0x7f61fc10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 --2- 172.21.15.66:0/4109601940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 0x7f61fc101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 --2- 172.21.15.66:0/4109601940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc105e70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 -- 172.21.15.66:0/4109601940 >> 172.21.15.66:0/4109601940 conn(0x7f61fc077210 msgr2=0x7f61fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 -- 172.21.15.66:0/4109601940 shutdown_connections 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 -- 172.21.15.66:0/4109601940 wait complete. 2024-09-15T22:45:04.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.811+0000 7f62030ca640 1 Processor -- start 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 -- start start 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 0x7f61fc199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 0x7f61fc1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc110fb0 con 0x7f61fc105a90 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc110e30 con 0x7f61fc101240 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f62030ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc111130 con 0x7f61fc101bc0 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42022/0 (socket says 172.21.15.66:42022) 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 -- 172.21.15.66:0/3506741541 learned_addr learned my addr 172.21.15.66:0/3506741541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:04.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6200e66640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 0x7f61fc199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f61fbfff640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 0x7f61fc1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 -- 172.21.15.66:0/3506741541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 msgr2=0x7f61fc1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 0x7f61fc1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 -- 172.21.15.66:0/3506741541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 msgr2=0x7f61fc199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 0x7f61fc199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 -- 172.21.15.66:0/3506741541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc1a4940 con 0x7f61fc105a90 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.812+0000 7f6201667640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009fd0 tx=0x7f61f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.813+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4011830 con 0x7f61fc105a90 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.813+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc1a4b10 con 0x7f61fc105a90 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.813+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f4016070 con 0x7f61fc105a90 2024-09-15T22:45:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.813+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f400f2e0 con 0x7f61fc105a90 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.813+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1a5050 con 0x7f61fc105a90 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.814+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc101680 con 0x7f61fc105a90 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.815+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f61f40119d0 con 0x7f61fc105a90 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.816+0000 7f61f9ffb640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 0x7f61e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.816+0000 7f6200e66640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 0x7f61e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.816+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f61f40cf280 con 0x7f61fc105a90 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.817+0000 7f6200e66640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 0x7f61e80a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61e4000c00 tx=0x7f61e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:04.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:04.820+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61f409bbb0 con 0x7f61fc105a90 2024-09-15T22:45:05.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.031+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61fc1a5280 con 0x7f61fc105a90 2024-09-15T22:45:05.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.031+0000 7f61f9ffb640 1 -- 172.21.15.66:0/3506741541 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7f61f409b4b0 con 0x7f61fc105a90 2024-09-15T22:45:05.033 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:05.033 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-15T22:43:38:783620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:43:38.783615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:45:05.034 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-15T22:45:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 msgr2=0x7f61e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 0x7f61e80a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61e4000c00 tx=0x7f61e40058d0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 msgr2=0x7f61fc1a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009fd0 tx=0x7f61f400b8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 shutdown_connections 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61fc105a90 0x7f61fc1a4400 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61fc101bc0 0x7f61fc1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f61e80a3240 0x7f61e80a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 --2- 172.21.15.66:0/3506741541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61fc101240 0x7f61fc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 >> 172.21.15.66:0/3506741541 conn(0x7f61fc077210 msgr2=0x7f61fc103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 shutdown_connections 2024-09-15T22:45:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:05.035+0000 7f62030ca640 1 -- 172.21.15.66:0/3506741541 wait complete. 2024-09-15T22:45:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:05 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3506741541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:05 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3506741541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:05 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3506741541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:05.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:45:05.980 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:06.372 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:06 smithi066 ceph-mon[31185]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:45:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:06 smithi184 ceph-mon[35203]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:45:06.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 -- 172.21.15.66:0/3254628218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 msgr2=0x7f85201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 --2- 172.21.15.66:0/3254628218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f85201021c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f851c009900 tx=0x7f851c02a410 comp rx=0 tx=0).stop 2024-09-15T22:45:06.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 -- 172.21.15.66:0/3254628218 shutdown_connections 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 --2- 172.21.15.66:0/3254628218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520106f10 0x7f852010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 --2- 172.21.15.66:0/3254628218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520102790 0x7f85201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 --2- 172.21.15.66:0/3254628218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f85201021c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 -- 172.21.15.66:0/3254628218 >> 172.21.15.66:0/3254628218 conn(0x7f85200fd8c0 msgr2=0x7f85200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 -- 172.21.15.66:0/3254628218 shutdown_connections 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 -- 172.21.15.66:0/3254628218 wait complete. 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.454+0000 7f85281fa640 1 Processor -- start 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 -- start start 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520102790 0x7f852019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520106f10 0x7f852019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8520111f70 con 0x7f8520101de0 2024-09-15T22:45:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8520111df0 con 0x7f8520106f10 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f85281fa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f85201120f0 con 0x7f8520102790 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42046/0 (socket says 172.21.15.66:42046) 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 -- 172.21.15.66:0/4193728500 learned_addr learned my addr 172.21.15.66:0/4193728500 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525795640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520102790 0x7f852019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8526797640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520106f10 0x7f852019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 -- 172.21.15.66:0/4193728500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520102790 msgr2=0x7f852019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520102790 0x7f852019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 -- 172.21.15.66:0/4193728500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520106f10 msgr2=0x7f852019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520106f10 0x7f852019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 -- 172.21.15.66:0/4193728500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852019f5f0 con 0x7f8520101de0 2024-09-15T22:45:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.455+0000 7f8525f96640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f851c006010 tx=0x7f851c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.456+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c03f030 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.456+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f851c003ce0 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.456+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852019f880 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.456+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c035070 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.456+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852019fd10 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.457+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85201021c0 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.458+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f851c042030 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.459+0000 7f8516ffd640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.459+0000 7f8525795640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.459+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f851c0f0210 con 0x7f8520101de0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.459+0000 7f8525795640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 0x7f850c0a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85200ff750 tx=0x7f851000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.463+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f851c0bcc00 con 0x7f8520101de0 2024-09-15T22:45:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:06 smithi087 ceph-mon[35290]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2024-09-15T22:45:06.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.641+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85201a72f0 con 0x7f8520101de0 2024-09-15T22:45:06.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.642+0000 7f8516ffd640 1 -- 172.21.15.66:0/4193728500 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24942 (secure 0 0 0) 0x7f851c0bc500 con 0x7f8520101de0 2024-09-15T22:45:06.644 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:06.644 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":89,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:45:02.141763+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.644+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 msgr2=0x7f850c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.644+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 0x7f850c0a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85200ff750 tx=0x7f851000b390 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.644+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 msgr2=0x7f852019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.644+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f851c006010 tx=0x7f851c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 shutdown_connections 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f850c0a3240 0x7f850c0a5700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8520106f10 0x7f852019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8520102790 0x7f852019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 --2- 172.21.15.66:0/4193728500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8520101de0 0x7f852019a640 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:06.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 >> 172.21.15.66:0/4193728500 conn(0x7f85200fd8c0 msgr2=0x7f85200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:06.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 shutdown_connections 2024-09-15T22:45:06.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:06.645+0000 7f85281fa640 1 -- 172.21.15.66:0/4193728500 wait complete. 2024-09-15T22:45:07.305 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:07 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4193728500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:07.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:42:54.256195+0000', 'modified': '2024-09-15T22:43:38.783615+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24461, 'mds_1': 24442, 'mds_2': 24437, 'mds_3': 24427, 'mds_4': 24421}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6839/2023001898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2023001898}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2023001898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6841/3123963280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6840', 'nonce': 3123963280}, {'type': 'v1', 'addr': '172.21.15.66:6841', 'nonce': 3123963280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/1400845283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1400845283}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 1400845283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24395': {'gid': 24395, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6833/3190263553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6832', 'nonce': 3190263553}, {'type': 'v1', 'addr': '172.21.15.87:6833', 'nonce': 3190263553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6835/1324797641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 1324797641}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 1324797641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.184:6835/253738152', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 253738152}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 253738152}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.184:6837/2237794156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 2237794156}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2237794156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.87:6837/2256594812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 2256594812}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 2256594812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.184:6839/2085772810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 2085772810}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 2085772810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.87:6839/426418588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 426418588}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 426418588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24461, 'qdb_cluster': [24421, 24427, 24437, 24442, 24461]} 2024-09-15T22:45:07.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-15T22:45:07.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-15T22:45:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:07 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4193728500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:07.592 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:07 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4193728500' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.048+0000 7f4b87fd7640 1 -- 172.21.15.66:0/2020781975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 msgr2=0x7f4b8010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.048+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/2020781975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b8010e610 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009ca0 tx=0x7f4b7002a950 comp rx=0 tx=0).stop 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- 172.21.15.66:0/2020781975 shutdown_connections 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/2020781975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b8010e610 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/2020781975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80103660 0x7f4b8010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/2020781975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80102d40 0x7f4b80103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- 172.21.15.66:0/2020781975 >> 172.21.15.66:0/2020781975 conn(0x7f4b800fc7a0 msgr2=0x7f4b800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- 172.21.15.66:0/2020781975 shutdown_connections 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- 172.21.15.66:0/2020781975 wait complete. 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 Processor -- start 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- start start 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 0x7f4b801009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80103660 0x7f4b80100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80111f70 con 0x7f4b8010c170 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80111df0 con 0x7f4b80102d40 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.049+0000 7f4b87fd7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801120f0 con 0x7f4b80103660 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42076/0 (socket says 172.21.15.66:42076) 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 -- 172.21.15.66:0/83697350 learned_addr learned my addr 172.21.15.66:0/83697350 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b85572640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80103660 0x7f4b80100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b85d73640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 0x7f4b801009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 -- 172.21.15.66:0/83697350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80103660 msgr2=0x7f4b80100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80103660 0x7f4b80100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 -- 172.21.15.66:0/83697350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 msgr2=0x7f4b801009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 0x7f4b801009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 -- 172.21.15.66:0/83697350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b801a68b0 con 0x7f4b8010c170 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b85d73640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 0x7f4b801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b86574640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4b70006010 tx=0x7f4b7002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b7effd640 1 -- 172.21.15.66:0/83697350 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70034040 con 0x7f4b8010c170 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b801a6b40 con 0x7f4b8010c170 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b7effd640 1 -- 172.21.15.66:0/83697350 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b70003e00 con 0x7f4b8010c170 2024-09-15T22:45:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b7effd640 1 -- 172.21.15.66:0/83697350 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b700456e0 con 0x7f4b8010c170 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.050+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a7020 con 0x7f4b8010c170 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b7effd640 1 -- 172.21.15.66:0/83697350 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4b70037020 con 0x7f4b8010c170 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 Processor -- start 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 -- start start 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b7effd640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 0x7f4b680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a490202670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 0x55a490204fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a49015e090 con 0x55a4901f79d0 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a490105a70 con 0x55a4901f82f0 2024-09-15T22:45:08.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.053+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a49015a050 con 0x55a490202bb0 2024-09-15T22:45:08.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b7effd640 1 -- 172.21.15.66:0/83697350 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f4b700f0e50 con 0x7f4b8010c170 2024-09-15T22:45:08.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42086/0 (socket says 172.21.15.66:42086) 2024-09-15T22:45:08.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 -- 172.21.15.66:0/2056444279 learned_addr learned my addr 172.21.15.66:0/2056444279 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:08.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85572640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 0x7f4b680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85572640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a490202670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b86574640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 0x55a490204fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 -- 172.21.15.66:0/2056444279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 msgr2=0x55a490204fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 0x55a490204fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 -- 172.21.15.66:0/2056444279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 msgr2=0x55a490202670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a490202670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 -- 172.21.15.66:0/2056444279 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a490112130 con 0x55a4901f79d0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b86574640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 0x55a490204fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85572640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 0x7f4b680a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400a500 tx=0x7f4b74013880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b85d73640 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800cca0 tx=0x7f4b7800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e511a2723d5e1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b67fff640 1 -- 172.21.15.66:0/2056444279 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78005220 con 0x55a4901f79d0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b67fff640 1 -- 172.21.15.66:0/2056444279 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b78004c80 con 0x55a4901f79d0 2024-09-15T22:45:08.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.054+0000 7f4b67fff640 1 -- 172.21.15.66:0/2056444279 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780107e0 con 0x55a4901f79d0 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/2056444279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 msgr2=0x55a4901f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800cca0 tx=0x7f4b7800e720 comp rx=0 tx=0).stop 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/2056444279 shutdown_connections 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a490202bb0 0x55a490204fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a490202670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/2056444279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a4901f7db0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/2056444279 >> 172.21.15.66:0/2056444279 conn(0x55a4901f3f60 msgr2=0x55a4901f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/2056444279 shutdown_connections 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.055+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/2056444279 wait complete. 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 -- start start 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 Processor -- start 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 0x55a490202330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901ff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a490205780 con 0x55a490202bb0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a490118f20 con 0x55a4901f79d0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a490205900 con 0x55a4901f82f0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b8a3b0740 10 client.0 _ll_register_callbacks cb 0x55a4900e2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42096/0 (socket says 172.21.15.66:42096) 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b86574640 1 -- 172.21.15.66:0/3074022542 learned_addr learned my addr 172.21.15.66:0/3074022542 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.056+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 0x55a490202330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b85572640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 -- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 msgr2=0x55a4901ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 -- 172.21.15.66:0/3074022542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 msgr2=0x55a490202330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 0x55a490202330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 -- 172.21.15.66:0/3074022542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48fecf2b0 con 0x55a490202bb0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b85572640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 0x55a490202330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b86574640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4b700b99f0 tx=0x7f4b700bceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c042a7d1af28d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7002c040 con 0x55a490202bb0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f4b700ee610 con 0x55a490202bb0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b78004c80 con 0x55a490202bb0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4b700bd720 con 0x55a490202bb0 2024-09-15T22:45:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b8a3b0740 10 client.15210 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a490210f00 con 0x55a490202bb0 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b78004c80 con 0x55a490202bb0 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.057+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f4b700d9080 con 0x55a490202bb0 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 10 client.15210 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 10 client.15210 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 20 client.15210 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490213560 0x55a4902149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 4 client.15210 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a49016b600 con 0x55a490213560 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490213560 0x55a4902149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490213560 0x55a4902149d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=16d8880fe837ddb6 server_cookie=5b00334b684fda44 in_seq=0 out_seq=0 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.058+0000 7f4b657fa640 10 client.15210 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b657fa640 1 -- 172.21.15.66:0/3074022542 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a49016b600 con 0x55a490213560 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b657fa640 10 client.15210 handle_command_reply: tid=0 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 client.15210 shutdown 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 msgr2=0x55a4901ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4b700b99f0 tx=0x7f4b700bceb0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 shutdown_connections 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490213560 0x55a4902149d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a4901ffbc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3074022542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f79d0 0x55a490202330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b657fa640 0 client.15210 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.059+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 >> 172.21.15.66:0/3074022542 conn(0x55a4901f3f60 msgr2=0x55a4901f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.060+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 shutdown_connections 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.060+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3074022542 wait complete. 2024-09-15T22:45:08.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.060+0000 7f4b8a3b0740 20 client.15210 trim_cache size 0 max 16384 2024-09-15T22:45:08.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 Processor -- start 2024-09-15T22:45:08.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 -- start start 2024-09-15T22:45:08.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 0x55a4901fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a490212d10 con 0x55a4901f79d0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a4902133e0 con 0x55a490202bb0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a490213ab0 con 0x55a4901f82f0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42104/0 (socket says 172.21.15.66:42104) 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 -- 172.21.15.66:0/3682297242 learned_addr learned my addr 172.21.15.66:0/3682297242 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85572640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b86574640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 0x55a4901fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 -- 172.21.15.66:0/3682297242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 msgr2=0x55a4901f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 -- 172.21.15.66:0/3682297242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 msgr2=0x55a4901fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 0x55a4901fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b85d73640 1 -- 172.21.15.66:0/3682297242 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4901f3d90 con 0x55a4901f79d0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.078+0000 7f4b86574640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 0x55a4901fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b85d73640 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ec20 tx=0x7f4b7800c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806bf0d65b736f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b677fe640 1 -- 172.21.15.66:0/3682297242 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7802e070 con 0x55a4901f79d0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b677fe640 1 -- 172.21.15.66:0/3682297242 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b78004af0 con 0x55a4901f79d0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b677fe640 1 -- 172.21.15.66:0/3682297242 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78010820 con 0x55a4901f79d0 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3682297242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 msgr2=0x55a490213c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ec20 tx=0x7f4b7800c590 comp rx=0 tx=0).stop 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3682297242 shutdown_connections 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a490202bb0 0x55a4901fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f82f0 0x55a4901f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/3682297242 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a4901f79d0 0x55a490213c30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3682297242 >> 172.21.15.66:0/3682297242 conn(0x55a4901f3f60 msgr2=0x55a4901fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.079+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3682297242 shutdown_connections 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/3682297242 wait complete. 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 -- start start 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 Processor -- start 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 0x55a4901fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a4901fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a490214850 con 0x55a490202bb0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a490214180 con 0x55a4901f82f0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a490214f20 con 0x55a4901f79d0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b8a3b0740 10 client.0 _ll_register_callbacks cb 0x7f4b70004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.080+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42114/0 (socket says 172.21.15.66:42114) 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 -- 172.21.15.66:0/4014950646 learned_addr learned my addr 172.21.15.66:0/4014950646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b85572640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a4901fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b85d73640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 0x55a4901fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 -- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 msgr2=0x55a4901fbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 0x55a4901fbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 -- 172.21.15.66:0/4014950646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 msgr2=0x55a4901fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a4901fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 -- 172.21.15.66:0/4014950646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4901fca80 con 0x55a490202bb0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b85d73640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 0x55a4901fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b86574640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b700b9480 tx=0x7f4b70004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b029f104628e0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7002c040 con 0x55a490202bb0 2024-09-15T22:45:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f4b70004b40 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b78004af0 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4b700bc980 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b8a3b0740 10 client.15216 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.081+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a49021d200 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b78004af0 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f4b7004d030 con 0x55a490202bb0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 10 client.15216 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 10 client.15216 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 20 client.15216 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490281ca0 0x55a4902809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 4 client.15216 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "status"}) -- 0x55a490165b10 con 0x55a490281ca0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.082+0000 7f4b85d73640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490281ca0 0x55a4902809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b85d73640 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490281ca0 0x55a4902809b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7dd506bae2076c5f server_cookie=f317679f3ece5e18 in_seq=0 out_seq=0 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b657fa640 10 client.15216 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b657fa640 1 -- 172.21.15.66:0/4014950646 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a490165b10 con 0x55a490281ca0 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b657fa640 10 client.15216 handle_command_reply: tid=0 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 client.15216 shutdown 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 msgr2=0x55a49021bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b700b9480 tx=0x7f4b70004530 comp rx=0 tx=0).stop 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 shutdown_connections 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a490281ca0 0x55a4902809b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a490202bb0 0x55a49021bc20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a4901f82f0 0x55a4901fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b657fa640 0 client.15216 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 --2- 172.21.15.66:0/4014950646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4901f79d0 0x55a4901fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 >> 172.21.15.66:0/4014950646 conn(0x55a4901f3f60 msgr2=0x55a4901fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 shutdown_connections 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 1 -- 172.21.15.66:0/4014950646 wait complete. 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.083+0000 7f4b8a3b0740 20 client.15216 trim_cache size 0 max 16384 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 4, 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24421, 2024-09-15T22:45:08.096 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 90.121827984000006, 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 160.68455518799999 2024-09-15T22:45:08.097 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 msgr2=0x7f4b680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 0x7f4b680a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400a500 tx=0x7f4b74013880 comp rx=0 tx=0).stop 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 msgr2=0x7f4b80101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:08.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4b70006010 tx=0x7f4b7002f710 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 shutdown_connections 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b8010c170 0x7f4b80101420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b80103660 0x7f4b80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f4b680a3240 0x7f4b680a5700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 --2- 172.21.15.66:0/83697350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b80102d40 0x7f4b801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 >> 172.21.15.66:0/83697350 conn(0x7f4b800fc7a0 msgr2=0x7f4b800fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 shutdown_connections 2024-09-15T22:45:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:08.084+0000 7f4b87fd7640 1 -- 172.21.15.66:0/83697350 wait complete. 2024-09-15T22:45:08.395 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:08 smithi066 ceph-mon[31185]: pgmap v352: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:08.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:08 smithi184 ceph-mon[35203]: pgmap v352: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:08.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:08 smithi087 ceph-mon[35290]: pgmap v352: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:08.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:45:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:09 smithi066 ceph-mon[31185]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T22:45:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:09 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T22:45:09.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 -- 172.21.15.66:0/3929323186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748102d90 msgr2=0x7ff748103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 --2- 172.21.15.66:0/3929323186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748102d90 0x7ff748103170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff738009930 tx=0x7ff73802a420 comp rx=0 tx=0).stop 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 -- 172.21.15.66:0/3929323186 shutdown_connections 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 --2- 172.21.15.66:0/3929323186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748108290 0x7ff74810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 --2- 172.21.15.66:0/3929323186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748103740 0x7ff748107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 --2- 172.21.15.66:0/3929323186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748102d90 0x7ff748103170 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 -- 172.21.15.66:0/3929323186 >> 172.21.15.66:0/3929323186 conn(0x7ff7480fc7d0 msgr2=0x7ff7480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 -- 172.21.15.66:0/3929323186 shutdown_connections 2024-09-15T22:45:09.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.556+0000 7ff74c95c640 1 -- 172.21.15.66:0/3929323186 wait complete. 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 Processor -- start 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 -- start start 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748103740 0x7ff748100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff748112090 con 0x7ff748108290 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff748111f10 con 0x7ff748102d90 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff74c95c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff748112210 con 0x7ff748103740 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.557+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff74659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42132/0 (socket says 172.21.15.66:42132) 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff74659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39212/0 (socket says 172.21.15.66:39212) 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 -- 172.21.15.66:0/1501367046 learned_addr learned my addr 172.21.15.66:0/1501367046 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748103740 0x7ff748100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 -- 172.21.15.66:0/1501367046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748103740 msgr2=0x7ff748100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748103740 0x7ff748100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 -- 172.21.15.66:0/1501367046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 msgr2=0x7ff7481009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 -- 172.21.15.66:0/1501367046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7481a6ab0 con 0x7ff748108290 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff74659c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff746d9d640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eb10 tx=0x7ff74000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff73f7fe640 1 -- 172.21.15.66:0/1501367046 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740004b20 con 0x7ff748108290 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7481a6da0 con 0x7ff748108290 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff73f7fe640 1 -- 172.21.15.66:0/1501367046 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff740004cc0 con 0x7ff748108290 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff73f7fe640 1 -- 172.21.15.66:0/1501367046 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740010760 con 0x7ff748108290 2024-09-15T22:45:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.558+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481a7300 con 0x7ff748108290 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff73f7fe640 1 -- 172.21.15.66:0/1501367046 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff740005020 con 0x7ff748108290 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 Processor -- start 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 -- start start 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a68db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5599089cf090 con 0x559908a692f0 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559908976a70 con 0x559908a689d0 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74ed35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5599089cb050 con 0x559908a73bb0 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42140/0 (socket says 172.21.15.66:42140) 2024-09-15T22:45:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.561+0000 7ff74659c640 1 -- 172.21.15.66:0/1051098223 learned_addr learned my addr 172.21.15.66:0/1051098223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a68db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73f7fe640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 0x7ff7340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 -- 172.21.15.66:0/1051098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 msgr2=0x559908a75fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a75fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 -- 172.21.15.66:0/1051098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 msgr2=0x559908a68db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a68db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 -- 172.21.15.66:0/1051098223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559908983130 con 0x559908a692f0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff746d9d640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 0x7ff7340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff74659c640 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff738000c00 tx=0x7ff738005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b87abcae228991 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73f7fe640 1 -- 172.21.15.66:0/1501367046 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7ff7400d0340 con 0x7ff748108290 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73cff9640 1 -- 172.21.15.66:0/1051098223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035040 con 0x559908a692f0 2024-09-15T22:45:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73cff9640 1 -- 172.21.15.66:0/1051098223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff738031830 con 0x559908a692f0 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.562+0000 7ff73cff9640 1 -- 172.21.15.66:0/1051098223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738003e00 con 0x559908a692f0 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 -- 172.21.15.66:0/1051098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 msgr2=0x559908a73670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff746d9d640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 0x7ff7340a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7400989d0 tx=0x7ff7400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff738000c00 tx=0x7ff738005d50 comp rx=0 tx=0).stop 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 -- 172.21.15.66:0/1051098223 shutdown_connections 2024-09-15T22:45:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a75fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a73670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1051098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 -- 172.21.15.66:0/1051098223 >> 172.21.15.66:0/1051098223 conn(0x559908a64f60 msgr2=0x559908a65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 -- 172.21.15.66:0/1051098223 shutdown_connections 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.563+0000 7ff74ed35740 1 -- 172.21.15.66:0/1051098223 wait complete. 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 -- start start 2024-09-15T22:45:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 Processor -- start 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a73380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a692f0 0x559908a706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559908a76780 con 0x559908a73bb0 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559908989f20 con 0x559908a689d0 2024-09-15T22:45:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559908a76900 con 0x559908a692f0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74ed35740 10 client.0 _ll_register_callbacks cb 0x559908953030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42154/0 (socket says 172.21.15.66:42154) 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff73ffff640 1 -- 172.21.15.66:0/4064088458 learned_addr learned my addr 172.21.15.66:0/4064088458 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff73ffff640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a73380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.564+0000 7ff74659c640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a692f0 0x559908a706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 -- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a692f0 msgr2=0x559908a706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a692f0 0x559908a706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 -- 172.21.15.66:0/4064088458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 msgr2=0x559908a73380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a73380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 -- 172.21.15.66:0/4064088458 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599087402b0 con 0x559908a73bb0 2024-09-15T22:45:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff73ffff640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff730010f90 tx=0x7ff730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eb536139b269b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff72dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73001a040 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7ff730004040 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff738031830 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff730029050 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff74ed35740 10 client.15228 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559908a82070 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.565+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff738031830 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff730021430 con 0x559908a73bb0 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 10 client.15228 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 20 client.15228 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908a84670 0x559908a85ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 4 client.15228 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599089dc600 con 0x559908a84670 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74659c640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908a84670 0x559908a85ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff74659c640 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908a84670 0x559908a85ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=369b383236a0d169 server_cookie=157edd76a1ffff74 in_seq=0 out_seq=0 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.566+0000 7ff72dffb640 10 client.15228 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff72dffb640 1 -- 172.21.15.66:0/4064088458 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599089dc600 con 0x559908a84670 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff72dffb640 10 client.15228 handle_command_reply: tid=0 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 client.15228 shutdown 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 msgr2=0x559908a70c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff730010f90 tx=0x7ff730004730 comp rx=0 tx=0).stop 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 shutdown_connections 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908a84670 0x559908a85ae0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a73bb0 0x559908a70c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a692f0 0x559908a706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 --2- 172.21.15.66:0/4064088458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a73380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 >> 172.21.15.66:0/4064088458 conn(0x559908a64f60 msgr2=0x559908a6ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.567+0000 7ff72dffb640 0 client.15228 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.568+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 shutdown_connections 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.568+0000 7ff74ed35740 1 -- 172.21.15.66:0/4064088458 wait complete. 2024-09-15T22:45:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.568+0000 7ff74ed35740 20 client.15228 trim_cache size 0 max 16384 2024-09-15T22:45:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.585+0000 7ff74ed35740 1 Processor -- start 2024-09-15T22:45:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.585+0000 7ff74ed35740 1 -- start start 2024-09-15T22:45:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a692f0 0x559908a5fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559908a83e20 con 0x559908a689d0 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559908a844f0 con 0x559908a692f0 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff74ed35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559908a84bc0 con 0x559908a73bb0 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42162/0 (socket says 172.21.15.66:42162) 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 -- 172.21.15.66:0/1008006927 learned_addr learned my addr 172.21.15.66:0/1008006927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 -- 172.21.15.66:0/1008006927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 msgr2=0x559908a6fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 -- 172.21.15.66:0/1008006927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a692f0 msgr2=0x559908a5fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a692f0 0x559908a5fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 -- 172.21.15.66:0/1008006927 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559908a6ec40 con 0x559908a689d0 2024-09-15T22:45:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff73ffff640 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff7300097c0 tx=0x7ff730005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e60ee304213d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff72ffff640 1 -- 172.21.15.66:0/1008006927 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730021630 con 0x559908a689d0 2024-09-15T22:45:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff72ffff640 1 -- 172.21.15.66:0/1008006927 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730004550 con 0x559908a689d0 2024-09-15T22:45:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.586+0000 7ff72ffff640 1 -- 172.21.15.66:0/1008006927 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300038e0 con 0x559908a689d0 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- 172.21.15.66:0/1008006927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 msgr2=0x559908a84d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff7300097c0 tx=0x7ff730005fd0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- 172.21.15.66:0/1008006927 shutdown_connections 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a692f0 0x559908a5fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 --2- 172.21.15.66:0/1008006927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a689d0 0x559908a84d40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- 172.21.15.66:0/1008006927 >> 172.21.15.66:0/1008006927 conn(0x559908a64f60 msgr2=0x559908a65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- 172.21.15.66:0/1008006927 shutdown_connections 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- 172.21.15.66:0/1008006927 wait complete. 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 -- start start 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.587+0000 7ff74ed35740 1 Processor -- start 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a6c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559908a85960 con 0x559908a692f0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559908a85290 con 0x559908a689d0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559908a86030 con 0x559908a73bb0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74ed35740 10 client.0 _ll_register_callbacks cb 0x7ff730009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42168/0 (socket says 172.21.15.66:42168) 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 -- 172.21.15.66:0/2859114227 learned_addr learned my addr 172.21.15.66:0/2859114227 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff73ffff640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a6c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff73ffff640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 -- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 msgr2=0x559908a6d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 -- 172.21.15.66:0/2859114227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 msgr2=0x559908a6c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a6c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 -- 172.21.15.66:0/2859114227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559908a8ccc0 con 0x559908a692f0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff73ffff640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff74659c640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff738005ec0 tx=0x7ff7380315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e18fc6fbc6811f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff72dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.588+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035040 con 0x559908a692f0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7ff738004240 con 0x559908a692f0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff730004550 con 0x559908a692f0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff738060050 con 0x559908a692f0 2024-09-15T22:45:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 10 client.15234 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559908a8df60 con 0x559908a692f0 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730004550 con 0x559908a692f0 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff73803c440 con 0x559908a692f0 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 10 client.15234 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 10 client.15234 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 20 client.15234 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908af2830 0x559908af1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 4 client.15234 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "status"}) -- 0x5599089d6b10 con 0x559908af2830 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.589+0000 7ff73ffff640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908af2830 0x559908af1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff73ffff640 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908af2830 0x559908af1540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f8d6f626ee1ceda8 server_cookie=75a4ac5c45cee928 in_seq=0 out_seq=0 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff72dffb640 10 client.15234 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff72dffb640 1 -- 172.21.15.66:0/2859114227 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5599089d6b10 con 0x559908af2830 2024-09-15T22:45:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff72dffb640 10 client.15234 handle_command_reply: tid=0 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 client.15234 shutdown 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 msgr2=0x559908a6cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff738005ec0 tx=0x7ff7380315b0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 shutdown_connections 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x559908af2830 0x559908af1540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559908a73bb0 0x559908a6d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559908a692f0 0x559908a6cea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 --2- 172.21.15.66:0/2859114227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559908a689d0 0x559908a6c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 >> 172.21.15.66:0/2859114227 conn(0x559908a64f60 msgr2=0x559908a6b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff72dffb640 0 client.15234 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 shutdown_connections 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.590+0000 7ff74ed35740 1 -- 172.21.15.66:0/2859114227 wait complete. 2024-09-15T22:45:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74ed35740 20 client.15234 trim_cache size 0 max 16384 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 3, 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24427, 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 92.637170929999996, 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:45:09.598 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-09-15T22:45:09.599 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:45:09.599 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 159.66129312199999 2024-09-15T22:45:09.599 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 msgr2=0x7ff7340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 0x7ff7340a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7400989d0 tx=0x7ff7400058d0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 msgr2=0x7ff748101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eb10 tx=0x7ff74000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 shutdown_connections 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff748108290 0x7ff748101470 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff748103740 0x7ff748100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7ff7340a3240 0x7ff7340a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 --2- 172.21.15.66:0/1501367046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff748102d90 0x7ff7481009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 >> 172.21.15.66:0/1501367046 conn(0x7ff7480fc7d0 msgr2=0x7ff748106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 shutdown_connections 2024-09-15T22:45:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:09.591+0000 7ff74c95c640 1 -- 172.21.15.66:0/1501367046 wait complete. 2024-09-15T22:45:09.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:09 smithi087 ceph-mon[35290]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T22:45:09.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:09 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T22:45:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:09 smithi184 ceph-mon[35203]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T22:45:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:09 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T22:45:10.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-15T22:45:10.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:10 smithi066 ceph-mon[31185]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:10.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:10 smithi184 ceph-mon[35203]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:10 smithi087 ceph-mon[35290]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 13 op/s; 14 B/s, 0 objects/s recovering 2024-09-15T22:45:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 -- 172.21.15.66:0/4119025164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0102790 msgr2=0x7fa4c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/4119025164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0102790 0x7fa4c01067e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009900 tx=0x7fa4b402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 -- 172.21.15.66:0/4119025164 shutdown_connections 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/4119025164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0106f10 0x7fa4c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/4119025164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0102790 0x7fa4c01067e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/4119025164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 0x7fa4c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 -- 172.21.15.66:0/4119025164 >> 172.21.15.66:0/4119025164 conn(0x7fa4c00fd8c0 msgr2=0x7fa4c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 -- 172.21.15.66:0/4119025164 shutdown_connections 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.084+0000 7fa4c67c0640 1 -- 172.21.15.66:0/4119025164 wait complete. 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 Processor -- start 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 -- start start 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 0x7fa4c0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0102790 0x7fa4c0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0111f30 con 0x7fa4c0106f10 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0111db0 con 0x7fa4c0102790 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c67c0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01120b0 con 0x7fa4c0101de0 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c4d5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c4d5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42192/0 (socket says 172.21.15.66:42192) 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.085+0000 7fa4c4d5d640 1 -- 172.21.15.66:0/1840791955 learned_addr learned my addr 172.21.15.66:0/1840791955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4bffff640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 0x7fa4c0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0102790 0x7fa4c0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 -- 172.21.15.66:0/1840791955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 msgr2=0x7fa4c0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 0x7fa4c0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 -- 172.21.15.66:0/1840791955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0102790 msgr2=0x7fa4c0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0102790 0x7fa4c0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 -- 172.21.15.66:0/1840791955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c019d3e0 con 0x7fa4c0106f10 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c4d5d640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800eb10 tx=0x7fa4b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4bd7fa640 1 -- 172.21.15.66:0/1840791955 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8004b20 con 0x7fa4c0106f10 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4bd7fa640 1 -- 172.21.15.66:0/1840791955 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b8004cc0 con 0x7fa4c0106f10 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c019d6d0 con 0x7fa4c0106f10 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4bd7fa640 1 -- 172.21.15.66:0/1840791955 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8010760 con 0x7fa4c0106f10 2024-09-15T22:45:11.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.086+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c01a4fb0 con 0x7fa4c0106f10 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.089+0000 7fa4bd7fa640 1 -- 172.21.15.66:0/1840791955 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa4b8005020 con 0x7fa4c0106f10 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.089+0000 7fa4c8b99740 1 Processor -- start 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.089+0000 7fa4c8b99740 1 -- start start 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffd99cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffda8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575ffd00090 con 0x5575ffda8fc0 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575ffca7a70 con 0x5575ffd998d0 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575ffcfc050 con 0x5575ffd9a1f0 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42204/0 (socket says 172.21.15.66:42204) 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3733667840 learned_addr learned my addr 172.21.15.66:0/3733667840 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:11.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffd99cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bd7fa640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 0x7fa4a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bffff640 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffda8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4c4d5d640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 0x7fa4a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3733667840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 msgr2=0x5575ffda8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffda8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3733667840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 msgr2=0x5575ffd99cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffd99cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3733667840 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ffcb4130 con 0x5575ffda8fc0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bd7fa640 1 -- 172.21.15.66:0/1840791955 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fa4b80d02a0 con 0x7fa4c0106f10 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.090+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40096c0 tx=0x7fa4b4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e10ef231b450dba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c4d5d640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 0x7fa4a80a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8098930 tx=0x7fa4b8066e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4a67fc640 1 -- 172.21.15.66:0/3733667840 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4035070 con 0x5575ffda8fc0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4a67fc640 1 -- 172.21.15.66:0/3733667840 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b40035f0 con 0x5575ffda8fc0 2024-09-15T22:45:11.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4a67fc640 1 -- 172.21.15.66:0/3733667840 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b403d6e0 con 0x5575ffda8fc0 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3733667840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 msgr2=0x5575ffdab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40096c0 tx=0x7fa4b4005b50 comp rx=0 tx=0).stop 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3733667840 shutdown_connections 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdab3b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffda8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3733667840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffd99cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3733667840 >> 172.21.15.66:0/3733667840 conn(0x5575ffd95f60 msgr2=0x5575ffd96340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.091+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3733667840 shutdown_connections 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3733667840 wait complete. 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 -- start start 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 Processor -- start 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd998d0 0x5575ffda88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffda5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdabb90 con 0x5575ffda8fc0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575ffcbaf20 con 0x5575ffd9a1f0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdabd10 con 0x5575ffd998d0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4c8b99740 10 client.0 _ll_register_callbacks cb 0x5575ffc84030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.092+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42220/0 (socket says 172.21.15.66:42220) 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3307022781 learned_addr learned my addr 172.21.15.66:0/3307022781 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd998d0 0x5575ffda88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bffff640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffda5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3307022781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd998d0 msgr2=0x5575ffda88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd998d0 0x5575ffda88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 msgr2=0x5575ffda5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffda5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/3307022781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ffa712b0 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4b402a930 tx=0x7fa4b4003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497c1a1cbf3d73b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa49f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4035070 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fa4b4004190 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b40035f0 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4b4004390 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4c8b99740 10 client.15246 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.093+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5575ffdb7540 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b40035f0 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa4b4005390 con 0x5575ffda8fc0 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 10 client.15246 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:11.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 10 client.15246 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 20 client.15246 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffdb8890 0x5575ffdbaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 4 client.15246 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575ffd0d600 con 0x5575ffdb8890 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.094+0000 7fa4bffff640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffdb8890 0x5575ffdbaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.095+0000 7fa4bffff640 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffdb8890 0x5575ffdbaa90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c856c0e3cdcb8a3f server_cookie=1c9e093d246a89f in_seq=0 out_seq=0 2024-09-15T22:45:11.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.095+0000 7fa49f7fe640 10 client.15246 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.095+0000 7fa49f7fe640 1 -- 172.21.15.66:0/3307022781 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575ffd0d600 con 0x5575ffdb8890 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.095+0000 7fa49f7fe640 10 client.15246 handle_command_reply: tid=0 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.095+0000 7fa4c8b99740 1 client.15246 shutdown 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 msgr2=0x5575ffda6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4b402a930 tx=0x7fa4b4003ef0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 shutdown_connections 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffdb8890 0x5575ffdbaa90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffda6140 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffda5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa49f7fe640 0 client.15246 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/3307022781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd998d0 0x5575ffda88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 >> 172.21.15.66:0/3307022781 conn(0x5575ffd95f60 msgr2=0x5575ffd9bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 shutdown_connections 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 1 -- 172.21.15.66:0/3307022781 wait complete. 2024-09-15T22:45:11.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.096+0000 7fa4c8b99740 20 client.15246 trim_cache size 0 max 16384 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 Processor -- start 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 -- start start 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffd96340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffda8fc0 0x5575ffda1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdb8dd0 con 0x5575ffd998d0 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdb94a0 con 0x5575ffd9a1f0 2024-09-15T22:45:11.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdb9b70 con 0x5575ffda8fc0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42222/0 (socket says 172.21.15.66:42222) 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/4078022562 learned_addr learned my addr 172.21.15.66:0/4078022562 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bffff640 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffd96340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/4078022562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffda8fc0 msgr2=0x5575ffda1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffda8fc0 0x5575ffda1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/4078022562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 msgr2=0x5575ffd96340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffd96340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.114+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/4078022562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ffdabd00 con 0x5575ffd998d0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4000c00 tx=0x7fa4b4009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0075f5407f15ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4a5ffb640 1 -- 172.21.15.66:0/4078022562 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4035040 con 0x5575ffd998d0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4a5ffb640 1 -- 172.21.15.66:0/4078022562 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b4003ad0 con 0x5575ffd998d0 2024-09-15T22:45:11.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4a5ffb640 1 -- 172.21.15.66:0/4078022562 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40041c0 con 0x5575ffd998d0 2024-09-15T22:45:11.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 -- 172.21.15.66:0/4078022562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 msgr2=0x5575ffdb9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4000c00 tx=0x7fa4b4009520 comp rx=0 tx=0).stop 2024-09-15T22:45:11.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 -- 172.21.15.66:0/4078022562 shutdown_connections 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffda8fc0 0x5575ffda1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd9a1f0 0x5575ffd96340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.115+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/4078022562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffd998d0 0x5575ffdb9620 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- 172.21.15.66:0/4078022562 >> 172.21.15.66:0/4078022562 conn(0x5575ffd95f60 msgr2=0x5575ffd90dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- 172.21.15.66:0/4078022562 shutdown_connections 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- 172.21.15.66:0/4078022562 wait complete. 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- start start 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 Processor -- start 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffdc2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffdc3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdba910 con 0x5575ffda8fc0 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdba240 con 0x5575ffd998d0 2024-09-15T22:45:11.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575ffdbafe0 con 0x5575ffd9a1f0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.116+0000 7fa4c8b99740 10 client.0 _ll_register_callbacks cb 0x7fa4b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42228/0 (socket says 172.21.15.66:42228) 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/1169401565 learned_addr learned my addr 172.21.15.66:0/1169401565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffdc2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bffff640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffdc3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/1169401565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 msgr2=0x5575ffdc3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffdc3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 msgr2=0x5575ffdc2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffdc2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 -- 172.21.15.66:0/1169401565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ffd96880 con 0x5575ffda8fc0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4bf7fe640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40059d0 tx=0x7fa4b4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26452273709dba71 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:11.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa49f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4035070 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fa4b4003e80 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b4003ad0 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4b4004080 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4c8b99740 10 client.15252 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.117+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5575ffd96880 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4b4003ad0 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa4b405b070 con 0x5575ffda8fc0 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 10 client.15252 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 10 client.15252 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 20 client.15252 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffe279f0 0x5575ffe26700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 4 client.15252 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:11.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "status"}) -- 0x5575ffd07b10 con 0x5575ffe279f0 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.118+0000 7fa4bffff640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffe279f0 0x5575ffe26700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4bffff640 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffe279f0 0x5575ffe26700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=435d6752c4e0610b server_cookie=f228c6e4dd9477ba in_seq=0 out_seq=0 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa49f7fe640 10 client.15252 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa49f7fe640 1 -- 172.21.15.66:0/1169401565 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5575ffd07b10 con 0x5575ffe279f0 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa49f7fe640 10 client.15252 handle_command_reply: tid=0 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 client.15252 shutdown 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 msgr2=0x5575ffdbc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40059d0 tx=0x7fa4b4031400 comp rx=0 tx=0).stop 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 shutdown_connections 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5575ffe279f0 0x5575ffe26700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575ffda8fc0 0x5575ffdbc2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575ffd9a1f0 0x5575ffdc3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 --2- 172.21.15.66:0/1169401565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575ffd998d0 0x5575ffdc2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 >> 172.21.15.66:0/1169401565 conn(0x5575ffd95f60 msgr2=0x5575ffda1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa49f7fe640 0 client.15252 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 shutdown_connections 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 1 -- 172.21.15.66:0/1169401565 wait complete. 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.119+0000 7fa4c8b99740 20 client.15252 trim_cache size 0 max 16384 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 2, 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24437, 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:11.126 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 95.180550366999995, 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 158.50449422 2024-09-15T22:45:11.127 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 msgr2=0x7fa4a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 0x7fa4a80a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8098930 tx=0x7fa4b8066e60 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 msgr2=0x7fa4c019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800eb10 tx=0x7fa4b800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 shutdown_connections 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4c0106f10 0x7fa4c019cd00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fa4a80a3240 0x7fa4a80a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4c0102790 0x7fa4c0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 --2- 172.21.15.66:0/1840791955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c0101de0 0x7fa4c0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 >> 172.21.15.66:0/1840791955 conn(0x7fa4c00fd8c0 msgr2=0x7fa4c00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 shutdown_connections 2024-09-15T22:45:11.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:11.120+0000 7fa4c67c0640 1 -- 172.21.15.66:0/1840791955 wait complete. 2024-09-15T22:45:11.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:45:12.121 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:12.497 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:12 smithi066 ceph-mon[31185]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 442 B/s wr, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-15T22:45:12.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:12 smithi087 ceph-mon[35290]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 442 B/s wr, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-15T22:45:12.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- 172.21.15.66:0/1565681844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102ef0 msgr2=0x7f695c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 --2- 172.21.15.66:0/1565681844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102ef0 0x7f695c10da40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6954009ca0 tx=0x7f695402a950 comp rx=0 tx=0).stop 2024-09-15T22:45:12.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- 172.21.15.66:0/1565681844 shutdown_connections 2024-09-15T22:45:12.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 --2- 172.21.15.66:0/1565681844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102ef0 0x7f695c10da40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 --2- 172.21.15.66:0/1565681844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c102570 0x7f695c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 --2- 172.21.15.66:0/1565681844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c100e20 0x7f695c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- 172.21.15.66:0/1565681844 >> 172.21.15.66:0/1565681844 conn(0x7f695c0fc7d0 msgr2=0x7f695c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- 172.21.15.66:0/1565681844 shutdown_connections 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- 172.21.15.66:0/1565681844 wait complete. 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 Processor -- start 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.579+0000 7f69620ab640 1 -- start start 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 0x7f695c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102ef0 0x7f695c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f695c111020 con 0x7f695c102570 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f695c110ea0 con 0x7f695c100e20 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f69620ab640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f695c1111a0 con 0x7f695c102ef0 2024-09-15T22:45:12.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39292/0 (socket says 172.21.15.66:39292) 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 -- 172.21.15.66:0/2985186637 learned_addr learned my addr 172.21.15.66:0/2985186637 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695bfff640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102ef0 0x7f695c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695b7fe640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 0x7f695c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 -- 172.21.15.66:0/2985186637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102ef0 msgr2=0x7f695c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102ef0 0x7f695c19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 -- 172.21.15.66:0/2985186637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 msgr2=0x7f695c1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 0x7f695c1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 -- 172.21.15.66:0/2985186637 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c19d590 con 0x7f695c102570 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695b7fe640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 0x7f695c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.580+0000 7f695affd640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f695000b4a0 tx=0x7f695000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.581+0000 7f6958ff9640 1 -- 172.21.15.66:0/2985186637 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950014070 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.581+0000 7f6958ff9640 1 -- 172.21.15.66:0/2985186637 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6950010af0 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.581+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c19d880 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.581+0000 7f6958ff9640 1 -- 172.21.15.66:0/2985186637 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950017d10 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.581+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c1a5160 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.583+0000 7f6958ff9640 1 -- 172.21.15.66:0/2985186637 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6950017070 con 0x7f695c102570 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.583+0000 7f6964484740 1 Processor -- start 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.583+0000 7f6964484740 1 -- start start 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56772c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56781a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ca566d9090 con 0x55ca56781fc0 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ca56680a70 con 0x55ca567731b0 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6964484740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ca566d5050 con 0x55ca56772890 2024-09-15T22:45:12.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39296/0 (socket says 172.21.15.66:39296) 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 -- 172.21.15.66:0/3619186144 learned_addr learned my addr 172.21.15.66:0/3619186144 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695bfff640 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56772c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695b7fe640 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56781a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6958ff9640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 0x7f69440a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 -- 172.21.15.66:0/3619186144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 msgr2=0x55ca56772c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56772c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 -- 172.21.15.66:0/3619186144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 msgr2=0x55ca56781a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56781a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 -- 172.21.15.66:0/3619186144 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca5668d130 con 0x55ca56781fc0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695bfff640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 0x7f69440a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f695affd640 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f69500b50d0 tx=0x7f69500af380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edbff4e9f3eb226 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.584+0000 7f6958ff9640 1 -- 172.21.15.66:0/2985186637 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f69500cf050 con 0x7f695c102570 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6941ffb640 1 -- 172.21.15.66:0/3619186144 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695001e030 con 0x55ca56781fc0 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6941ffb640 1 -- 172.21.15.66:0/3619186144 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69500b8010 con 0x55ca56781fc0 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6941ffb640 1 -- 172.21.15.66:0/3619186144 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69500b9e60 con 0x55ca56781fc0 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 -- 172.21.15.66:0/3619186144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 msgr2=0x55ca567843b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f695bfff640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 0x7f69440a5800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6954009a60 tx=0x7f69540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f69500b50d0 tx=0x7f69500af380 comp rx=0 tx=0).stop 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 -- 172.21.15.66:0/3619186144 shutdown_connections 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca567843b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56781a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 --2- 172.21.15.66:0/3619186144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56772c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.585+0000 7f6964484740 1 -- 172.21.15.66:0/3619186144 >> 172.21.15.66:0/3619186144 conn(0x55ca5676ef60 msgr2=0x55ca5676f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- 172.21.15.66:0/3619186144 shutdown_connections 2024-09-15T22:45:12.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- 172.21.15.66:0/3619186144 wait complete. 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- start start 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 Processor -- start 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca567817f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5677f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ca56784b90 con 0x55ca567731b0 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ca56693f20 con 0x55ca56781fc0 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ca56784d10 con 0x55ca56772890 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f6964484740 10 client.0 _ll_register_callbacks cb 0x55ca5665d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f695affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39308/0 (socket says 172.21.15.66:39308) 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.586+0000 7f695affd640 1 -- 172.21.15.66:0/2858804906 learned_addr learned my addr 172.21.15.66:0/2858804906 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695b7fe640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca567817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695bfff640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5677f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 -- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 msgr2=0x55ca567817f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca567817f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 -- 172.21.15.66:0/2858804906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 msgr2=0x55ca5677f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5677f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 -- 172.21.15.66:0/2858804906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5644a2b0 con 0x55ca567731b0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f695affd640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6950017770 tx=0x7f69500d2860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37680e6e43af195 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f693affd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695001e070 con 0x55ca567731b0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f6950017360 con 0x55ca567731b0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca566e6600 con 0x55ca567731b0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f69500b9e60 con 0x55ca567731b0 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f6964484740 10 client.15264 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:12.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca56790480 con 0x55ca567731b0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.587+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ca566e6600 con 0x55ca567731b0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f69500a09a0 con 0x55ca567731b0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 20 client.15264 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca567917d0 0x55ca567939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 4 client.15264 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca566e0b10 con 0x55ca567917d0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f695b7fe640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca567917d0 0x55ca567939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f693affd640 10 client.15264 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.588+0000 7f695b7fe640 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca567917d0 0x55ca567939c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e981bd00e35d7ef server_cookie=2d5aaf5283ee972b in_seq=0 out_seq=0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f693affd640 1 -- 172.21.15.66:0/2858804906 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca566e0b10 con 0x55ca567917d0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f693affd640 10 client.15264 handle_command_reply: tid=0 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 client.15264 shutdown 2024-09-15T22:45:12.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 msgr2=0x55ca5677eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6950017770 tx=0x7f69500d2860 comp rx=0 tx=0).stop 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 shutdown_connections 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca567917d0 0x55ca567939c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5677f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca567731b0 0x55ca5677eb40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 --2- 172.21.15.66:0/2858804906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca567817f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f693affd640 0 client.15264 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 >> 172.21.15.66:0/2858804906 conn(0x55ca5676ef60 msgr2=0x55ca56774cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 shutdown_connections 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.589+0000 7f6964484740 1 -- 172.21.15.66:0/2858804906 wait complete. 2024-09-15T22:45:12.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.590+0000 7f6964484740 20 client.15264 trim_cache size 0 max 16384 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 Processor -- start 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 -- start start 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 0x55ca5679bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5679c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ca56791d00 con 0x55ca56772890 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ca567923d0 con 0x55ca56781fc0 2024-09-15T22:45:12.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f6964484740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ca56792aa0 con 0x55ca567731b0 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f695b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f695b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39322/0 (socket says 172.21.15.66:39322) 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f695b7fe640 1 -- 172.21.15.66:0/1625198127 learned_addr learned my addr 172.21.15.66:0/1625198127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f695bfff640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5679c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.608+0000 7f695affd640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 0x55ca5679bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 -- 172.21.15.66:0/1625198127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 msgr2=0x55ca5679bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 0x55ca5679bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 -- 172.21.15.66:0/1625198127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 msgr2=0x55ca5679c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5679c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 -- 172.21.15.66:0/1625198127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca56781b60 con 0x55ca56772890 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695affd640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 0x55ca5679bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f694c00ba60 tx=0x7f694c00b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b5c12712643700 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f69417fa640 1 -- 172.21.15.66:0/1625198127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c016a60 con 0x55ca56772890 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f69417fa640 1 -- 172.21.15.66:0/1625198127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f694c016c00 con 0x55ca56772890 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.609+0000 7f69417fa640 1 -- 172.21.15.66:0/1625198127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c014610 con 0x55ca56772890 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- 172.21.15.66:0/1625198127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 msgr2=0x55ca567939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f694c00ba60 tx=0x7f694c00b320 comp rx=0 tx=0).stop 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- 172.21.15.66:0/1625198127 shutdown_connections 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca56781fc0 0x55ca5679c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca567731b0 0x55ca5679bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 --2- 172.21.15.66:0/1625198127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56772890 0x55ca567939c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- 172.21.15.66:0/1625198127 >> 172.21.15.66:0/1625198127 conn(0x55ca5676ef60 msgr2=0x55ca56769ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- 172.21.15.66:0/1625198127 shutdown_connections 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- 172.21.15.66:0/1625198127 wait complete. 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 -- start start 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.610+0000 7f6964484740 1 Processor -- start 2024-09-15T22:45:12.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56794bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56795100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ca56793840 con 0x55ca56781fc0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ca56793170 con 0x55ca567731b0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ca56793f10 con 0x55ca56772890 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f6964484740 10 client.0 _ll_register_callbacks cb 0x7f69500d2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39338/0 (socket says 172.21.15.66:39338) 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 -- 172.21.15.66:0/1726845334 learned_addr learned my addr 172.21.15.66:0/1726845334 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695affd640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56795100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56794bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 -- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 msgr2=0x55ca56794bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56794bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 -- 172.21.15.66:0/1726845334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 msgr2=0x55ca56795100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56795100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 -- 172.21.15.66:0/1726845334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca567faea0 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695affd640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56795100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f695bfff640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6954009ca0 tx=0x7f695402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac04bc4d25bc92e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.611+0000 7f693affd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954034040 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f6954003970 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f694c016c00 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f695405e050 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 10 client.15270 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca567fc180 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f694c016c00 con 0x55ca56781fc0 2024-09-15T22:45:12.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f6954030440 con 0x55ca56781fc0 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 10 client.15270 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 10 client.15270 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 20 client.15270 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca56800e70 0x55ca567ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 4 client.15270 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.612+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "status"}) -- 0x55ca5665d0e0 con 0x55ca56800e70 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca56800e70 0x55ca567ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f695b7fe640 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca56800e70 0x55ca567ffb80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=968ab8f400c0b87e server_cookie=26a0502ab35d96b4 in_seq=0 out_seq=0 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f693affd640 10 client.15270 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f693affd640 1 -- 172.21.15.66:0/1726845334 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ca5665d0e0 con 0x55ca56800e70 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f693affd640 10 client.15270 handle_command_reply: tid=0 2024-09-15T22:45:12.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.613+0000 7f6964484740 1 client.15270 shutdown 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 msgr2=0x55ca56795640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6954009ca0 tx=0x7f695402a950 comp rx=0 tx=0).stop 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 shutdown_connections 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ca56800e70 0x55ca567ffb80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ca56781fc0 0x55ca56795640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca567731b0 0x55ca56795100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 --2- 172.21.15.66:0/1726845334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ca56772890 0x55ca56794bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f693affd640 0 client.15270 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 >> 172.21.15.66:0/1726845334 conn(0x55ca5676ef60 msgr2=0x55ca56779a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 shutdown_connections 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 1 -- 172.21.15.66:0/1726845334 wait complete. 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f6964484740 20 client.15270 trim_cache size 0 max 16384 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 1, 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24442, 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 97.680388171999994, 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 157.495841756 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:12.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 msgr2=0x7f69440a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 0x7f69440a5800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6954009a60 tx=0x7f69540095c0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 msgr2=0x7f695c198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.614+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f695000b4a0 tx=0x7f695000b960 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 shutdown_connections 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c102ef0 0x7f695c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695c102570 0x7f695c198b20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f69440a3340 0x7f69440a5800 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 --2- 172.21.15.66:0/2985186637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f695c100e20 0x7f695c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 >> 172.21.15.66:0/2985186637 conn(0x7f695c0fc7d0 msgr2=0x7f695c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 shutdown_connections 2024-09-15T22:45:12.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:12.615+0000 7f69620ab640 1 -- 172.21.15.66:0/2985186637 wait complete. 2024-09-15T22:45:12.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:12 smithi184 ceph-mon[35203]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 442 B/s wr, 10 op/s; 12 B/s, 0 objects/s recovering 2024-09-15T22:45:13.366 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:45:13.622 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:14.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 -- 172.21.15.66:0/2195604164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 msgr2=0x7f0d4c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 --2- 172.21.15.66:0/2195604164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c107b80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009930 tx=0x7f0d3c02a420 comp rx=0 tx=0).stop 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 -- 172.21.15.66:0/2195604164 shutdown_connections 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 --2- 172.21.15.66:0/2195604164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c108290 0x7f0d4c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 --2- 172.21.15.66:0/2195604164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c107b80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 --2- 172.21.15.66:0/2195604164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c102d90 0x7f0d4c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 -- 172.21.15.66:0/2195604164 >> 172.21.15.66:0/2195604164 conn(0x7f0d4c0fc7d0 msgr2=0x7f0d4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 -- 172.21.15.66:0/2195604164 shutdown_connections 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.114+0000 7f0d547e8640 1 -- 172.21.15.66:0/2195604164 wait complete. 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 Processor -- start 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 -- start start 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 0x7f0d4c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 0x7f0d4c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c112090 con 0x7f0d4c103740 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c111f10 con 0x7f0d4c108290 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d547e8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c112210 con 0x7f0d4c102d90 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d51d83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d51d83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39364/0 (socket says 172.21.15.66:39364) 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d51d83640 1 -- 172.21.15.66:0/993725129 learned_addr learned my addr 172.21.15.66:0/993725129 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d52584640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 0x7f0d4c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.115+0000 7f0d52d85640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 0x7f0d4c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 -- 172.21.15.66:0/993725129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 msgr2=0x7f0d4c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 0x7f0d4c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 -- 172.21.15.66:0/993725129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 msgr2=0x7f0d4c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 0x7f0d4c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 -- 172.21.15.66:0/993725129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c19d4a0 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d52584640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 0x7f0d4c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d52d85640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 0x7f0d4c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d51d83640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c005940 tx=0x7f0d3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d437fe640 1 -- 172.21.15.66:0/993725129 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c03f030 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d437fe640 1 -- 172.21.15.66:0/993725129 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3c003ce0 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d437fe640 1 -- 172.21.15.66:0/993725129 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c035070 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4c19d730 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.116+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4c19db30 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d437fe640 1 -- 172.21.15.66:0/993725129 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0d3c042030 con 0x7f0d4c103740 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 Processor -- start 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 -- start start 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde4771670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde4771bb0 0x55fde4773fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde46cd090 con 0x55fde47669d0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fde4674a70 con 0x55fde4771bb0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.119+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fde46c9050 con 0x55fde47672f0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d437fe640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 0x7f0d380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39376/0 (socket says 172.21.15.66:39376) 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 -- 172.21.15.66:0/3872741702 learned_addr learned my addr 172.21.15.66:0/3872741702 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde4771670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 0x7f0d380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d437fe640 1 -- 172.21.15.66:0/993725129 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f0d3c0f0280 con 0x7f0d4c103740 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d51d83640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde4771bb0 0x55fde4773fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 -- 172.21.15.66:0/3872741702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde4771bb0 msgr2=0x55fde4773fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde4771bb0 0x55fde4773fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 -- 172.21.15.66:0/3872741702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 msgr2=0x55fde4766db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 -- 172.21.15.66:0/3872741702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fde4681130 con 0x55fde47672f0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52d85640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 0x7f0d380a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009fd0 tx=0x7f0d44009200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.120+0000 7f0d52584640 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde4771670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800bb30 tx=0x7f0d4800d340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60adb196d44cdea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d40ff9640 1 -- 172.21.15.66:0/3872741702 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48017420 con 0x55fde47672f0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d40ff9640 1 -- 172.21.15.66:0/3872741702 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d48017aa0 con 0x55fde47672f0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d40ff9640 1 -- 172.21.15.66:0/3872741702 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800fbd0 con 0x55fde47672f0 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 -- 172.21.15.66:0/3872741702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 msgr2=0x55fde4771670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde4771670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800bb30 tx=0x7f0d4800d340 comp rx=0 tx=0).stop 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 -- 172.21.15.66:0/3872741702 shutdown_connections 2024-09-15T22:45:14.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde4771bb0 0x55fde4773fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde4771670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/3872741702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde47669d0 0x55fde4766db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 -- 172.21.15.66:0/3872741702 >> 172.21.15.66:0/3872741702 conn(0x55fde4762f60 msgr2=0x55fde4763340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.121+0000 7f0d56bc1740 1 -- 172.21.15.66:0/3872741702 shutdown_connections 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 -- 172.21.15.66:0/3872741702 wait complete. 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 -- start start 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 Processor -- start 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47669d0 0x55fde47713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 0x55fde476e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde4774780 con 0x55fde4771bb0 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fde4687f20 con 0x55fde47672f0 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fde4774900 con 0x55fde47669d0 2024-09-15T22:45:14.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d56bc1740 10 client.0 _ll_register_callbacks cb 0x55fde4651030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39392/0 (socket says 172.21.15.66:39392) 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.122+0000 7f0d52d85640 1 -- 172.21.15.66:0/490945053 learned_addr learned my addr 172.21.15.66:0/490945053 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d51d83640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 0x55fde476e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52584640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47669d0 0x55fde47713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 -- 172.21.15.66:0/490945053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47669d0 msgr2=0x55fde47713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47669d0 0x55fde47713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 -- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 msgr2=0x55fde476e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 0x55fde476e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 -- 172.21.15.66:0/490945053 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fde443e2b0 con 0x55fde4771bb0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d51d83640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 0x55fde476e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d52d85640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0d44014570 tx=0x7f0d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c88567b83ac9e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44026070 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d48017aa0 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f0d44004b20 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d44031050 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d56bc1740 10 client.15282 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fde4780080 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.123+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d48017aa0 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0d44020450 con 0x55fde4771bb0 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 20 client.15282 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde4782660 0x55fde4783ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 4 client.15282 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fde46da600 con 0x55fde4782660 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d52584640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde4782660 0x55fde4783ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d35ffb640 10 client.15282 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.124+0000 7f0d52584640 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde4782660 0x55fde4783ad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef503bbf3bf08ff server_cookie=dc4fb4f778a86884 in_seq=0 out_seq=0 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d35ffb640 1 -- 172.21.15.66:0/490945053 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fde46da600 con 0x55fde4782660 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d35ffb640 10 client.15282 handle_command_reply: tid=0 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 client.15282 shutdown 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 msgr2=0x55fde476ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0d44014570 tx=0x7f0d44004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 shutdown_connections 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476ec60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde4782660 0x55fde4783ad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47672f0 0x55fde476e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/490945053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47669d0 0x55fde47713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d35ffb640 0 client.15282 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 >> 172.21.15.66:0/490945053 conn(0x55fde4762f60 msgr2=0x55fde4768c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 shutdown_connections 2024-09-15T22:45:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.125+0000 7f0d56bc1740 1 -- 172.21.15.66:0/490945053 wait complete. 2024-09-15T22:45:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.126+0000 7f0d56bc1740 20 client.15282 trim_cache size 0 max 16384 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 Processor -- start 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 -- start start 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde476e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde476ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde4781e10 con 0x55fde4771bb0 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fde47824e0 con 0x55fde47669d0 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fde4782bb0 con 0x55fde47672f0 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39398/0 (socket says 172.21.15.66:39398) 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 -- 172.21.15.66:0/2427385359 learned_addr learned my addr 172.21.15.66:0/2427385359 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d51d83640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde476ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52584640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde476e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 -- 172.21.15.66:0/2427385359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 msgr2=0x55fde476ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde476ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 -- 172.21.15.66:0/2427385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 msgr2=0x55fde476e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde476e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 -- 172.21.15.66:0/2427385359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fde4762d90 con 0x55fde4771bb0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52584640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde476e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.144+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d440092f0 tx=0x7f0d4400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716bee1184078225 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d37fff640 1 -- 172.21.15.66:0/2427385359 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44039030 con 0x55fde4771bb0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d37fff640 1 -- 172.21.15.66:0/2427385359 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d44020450 con 0x55fde4771bb0 2024-09-15T22:45:14.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d37fff640 1 -- 172.21.15.66:0/2427385359 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44026040 con 0x55fde4771bb0 2024-09-15T22:45:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2427385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 msgr2=0x55fde476cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d440092f0 tx=0x7f0d4400ff70 comp rx=0 tx=0).stop 2024-09-15T22:45:14.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2427385359 shutdown_connections 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde476cff0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde476ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2427385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde476e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2427385359 >> 172.21.15.66:0/2427385359 conn(0x55fde4762f60 msgr2=0x55fde4763340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2427385359 shutdown_connections 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.145+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2427385359 wait complete. 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 -- start start 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 Processor -- start 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde478c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde47854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fde4783950 con 0x55fde4771bb0 2024-09-15T22:45:14.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fde4783280 con 0x55fde47669d0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fde4784020 con 0x55fde47672f0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d56bc1740 10 client.0 _ll_register_callbacks cb 0x7f0d44009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39400/0 (socket says 172.21.15.66:39400) 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 -- 172.21.15.66:0/2124858081 learned_addr learned my addr 172.21.15.66:0/2124858081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d51d83640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde47854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52584640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde478c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 -- 172.21.15.66:0/2124858081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 msgr2=0x55fde47854c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde47854c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 -- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 msgr2=0x55fde478c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde478c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.146+0000 7f0d52d85640 1 -- 172.21.15.66:0/2124858081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fde4785f40 con 0x55fde4771bb0 2024-09-15T22:45:14.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d52d85640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d44020a60 tx=0x7f0d44009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25cb69be0410f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44043060 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f0d44004bc0 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d44020450 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d4404a050 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d56bc1740 10 client.15288 fetch_fsmap learned FSMap version 27 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fde478a9e0 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d44020450 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f0d44035430 con 0x55fde4771bb0 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d56bc1740 10 client.15288 fetch_fsmap finished waiting for FSMap version 27 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.147+0000 7f0d56bc1740 10 client.15288 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 20 client.15288 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde47f1180 0x55fde47efe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 4 client.15288 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "status"}) -- 0x55fde46d4b10 con 0x55fde47f1180 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d52584640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde47f1180 0x55fde47efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d52584640 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde47f1180 0x55fde47efe90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea7ff17541c382c server_cookie=84217b3853bd9943 in_seq=0 out_seq=0 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d35ffb640 10 client.15288 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d35ffb640 1 -- 172.21.15.66:0/2124858081 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55fde46d4b10 con 0x55fde47f1180 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d35ffb640 10 client.15288 handle_command_reply: tid=0 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 1 client.15288 shutdown 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.148+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 msgr2=0x55fde4785a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d44020a60 tx=0x7f0d44009bc0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 shutdown_connections 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fde4771bb0 0x55fde4785a00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fde47672f0 0x55fde47854c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fde47f1180 0x55fde47efe90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 --2- 172.21.15.66:0/2124858081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fde47669d0 0x55fde478c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 >> 172.21.15.66:0/2124858081 conn(0x55fde4762f60 msgr2=0x55fde476e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d35ffb640 0 client.15288 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 shutdown_connections 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 1 -- 172.21.15.66:0/2124858081 wait complete. 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d56bc1740 20 client.15288 trim_cache size 0 max 16384 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24461, 2024-09-15T22:45:14.156 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 139.36624956, 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 27, 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 89, 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 85, 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 150.21793041800001 2024-09-15T22:45:14.157 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 msgr2=0x7f0d380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 0x7f0d380a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009fd0 tx=0x7f0d44009200 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 msgr2=0x7f0d4c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c005940 tx=0x7f0d3c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 shutdown_connections 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f0d380a32c0 0x7f0d380a5780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c108290 0x7f0d4c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d4c103740 0x7f0d4c198a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 --2- 172.21.15.66:0/993725129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d4c102d90 0x7f0d4c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 >> 172.21.15.66:0/993725129 conn(0x7f0d4c0fc7d0 msgr2=0x7f0d4c105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.149+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 shutdown_connections 2024-09-15T22:45:14.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.150+0000 7f0d547e8640 1 -- 172.21.15.66:0/993725129 wait complete. 2024-09-15T22:45:14.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:14 smithi066 ceph-mon[31185]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 399 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:45:14.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:14 smithi087 ceph-mon[35290]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 399 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:45:14.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:14 smithi184 ceph-mon[35203]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 399 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-15T22:45:14.868 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:45:14.878 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:45:14.878 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:45:14.878 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:45:14.878 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-15T22:45:14.879 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:45:14.879 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:45:14.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-15T22:45:14.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 -- 172.21.15.66:0/234762684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 msgr2=0x7fe664108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/234762684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe664108e90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009ca0 tx=0x7fe65c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 -- 172.21.15.66:0/234762684 shutdown_connections 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/234762684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe664108e90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/234762684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664101c40 0x7fe6641020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/234762684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664100a50 0x7fe664100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 -- 172.21.15.66:0/234762684 >> 172.21.15.66:0/234762684 conn(0x7fe6640fc1b0 msgr2=0x7fe6640fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 -- 172.21.15.66:0/234762684 shutdown_connections 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.984+0000 7fe66bf2a640 1 -- 172.21.15.66:0/234762684 wait complete. 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 Processor -- start 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 -- start start 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664100a50 0x7fe66406ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 0x7fe66419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c720 con 0x7fe664102600 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c5a0 con 0x7fe664101c40 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66bf2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c8a0 con 0x7fe664100a50 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39414/0 (socket says 172.21.15.66:39414) 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 -- 172.21.15.66:0/3709961509 learned_addr learned my addr 172.21.15.66:0/3709961509 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe669cc6640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664100a50 0x7fe66406ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe6694c5640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 0x7fe66419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 -- 172.21.15.66:0/3709961509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664100a50 msgr2=0x7fe66406ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664100a50 0x7fe66406ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 -- 172.21.15.66:0/3709961509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 msgr2=0x7fe66419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 0x7fe66419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe66a4c7640 1 -- 172.21.15.66:0/3709961509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66419fa00 con 0x7fe664102600 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.985+0000 7fe6694c5640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 0x7fe66419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe66a4c7640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0319f0 tx=0x7fe65c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c003c70 con 0x7fe664102600 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c003e10 con 0x7fe664102600 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66419fc30 con 0x7fe664102600 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c02fd30 con 0x7fe664102600 2024-09-15T22:45:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.986+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6641a01d0 con 0x7fe664102600 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.987+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664107d10 con 0x7fe664102600 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.988+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe65c004040 con 0x7fe664102600 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.989+0000 7fe65affd640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 0x7fe6500a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.989+0000 7fe669cc6640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 0x7fe6500a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.989+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fe65c0f12f0 con 0x7fe664102600 2024-09-15T22:45:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.989+0000 7fe669cc6640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 0x7fe6500a5830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe660005d00 tx=0x7fe660005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:14.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:14.993+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe65c0bdd40 con 0x7fe664102600 2024-09-15T22:45:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:15.239+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fe664062e90 con 0x7fe664102600 2024-09-15T22:45:16.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.241+0000 7fe65affd640 1 -- 172.21.15.66:0/3709961509 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fe65c0b9030 con 0x7fe664102600 2024-09-15T22:45:16.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 msgr2=0x7fe6500a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 0x7fe6500a5830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe660005d00 tx=0x7fe660005c50 comp rx=0 tx=0).stop 2024-09-15T22:45:16.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 msgr2=0x7fe66419f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:16.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0319f0 tx=0x7fe65c02f450 comp rx=0 tx=0).stop 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 shutdown_connections 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe664102600 0x7fe66419f0f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe6500a3370 0x7fe6500a5830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe664101c40 0x7fe66419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 --2- 172.21.15.66:0/3709961509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe664100a50 0x7fe66406ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 >> 172.21.15.66:0/3709961509 conn(0x7fe6640fc1b0 msgr2=0x7fe664104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 shutdown_connections 2024-09-15T22:45:16.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:16.244+0000 7fe66bf2a640 1 -- 172.21.15.66:0/3709961509 wait complete. 2024-09-15T22:45:16.265 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:45:16.278 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:45:16.279 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T22:45:16.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:16.279 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-15T22:45:16.296 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T22:45:16.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:16.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:45:16.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:16.364 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-15T22:45:16.473 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-15T22:45:16.473 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:45:16.473 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:16.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:45:16.498 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-mon[31185]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:45:16.499 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:45:16.499 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setuser ceph since I am not root 2024-09-15T22:45:16.499 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ignoring --setgroup ceph since I am not root 2024-09-15T22:45:16.499 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:16.407+0000 7f85d4731040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:45:16.499 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:16.468+0000 7f85d4731040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-mon[35203]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: ignoring --setuser ceph since I am not root 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: ignoring --setgroup ceph since I am not root 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-mgr[36926]: -- 172.21.15.184:0/1164153192 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb8b4190e0 con 0x55eb8b3f6800 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.391+0000 7f1b09a4d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:45:16.596 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.447+0000 7f1b09a4d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:16.597 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.594+0000 7f1b09a4d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:45:16.598 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-mon[35290]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 10 op/s; 9 B/s, 0 objects/s recovering 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: ignoring --setuser ceph since I am not root 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: ignoring --setgroup ceph since I am not root 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-mgr[36654]: -- 172.21.15.87:0/2070380350 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569783490e0 con 0x556978326800 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.392+0000 7f4909f23040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.450+0000 7f4909f23040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:16.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.597+0000 7f4909f23040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:45:16.738 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:16.849 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.664+0000 7f4909f23040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:45:16.849 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.810+0000 7f4909f23040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:16.861 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:16.628+0000 7f85d4731040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:45:16.861 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:16.705+0000 7f85d4731040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:45:16.922 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.660+0000 7f1b09a4d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:45:16.922 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.804+0000 7f1b09a4d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:17.154 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:16.872+0000 7f85d4731040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:17.154 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:17.025+0000 7f85d4731040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:45:17.244 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:16.948+0000 7f1b09a4d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:45:17.244 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:16.954+0000 7f4909f23040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:45:17.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 -- 172.21.15.66:0/3299570856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4100e20 msgr2=0x7f8de4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 --2- 172.21.15.66:0/3299570856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4100e20 0x7f8de4101200 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009860 tx=0x7f8ddc02a3d0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 -- 172.21.15.66:0/3299570856 shutdown_connections 2024-09-15T22:45:17.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 --2- 172.21.15.66:0/3299570856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 --2- 172.21.15.66:0/3299570856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4102570 0x7f8de41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 --2- 172.21.15.66:0/3299570856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4100e20 0x7f8de4101200 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 -- 172.21.15.66:0/3299570856 >> 172.21.15.66:0/3299570856 conn(0x7f8de40fc7d0 msgr2=0x7f8de40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 -- 172.21.15.66:0/3299570856 shutdown_connections 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.238+0000 7f8deb391640 1 -- 172.21.15.66:0/3299570856 wait complete. 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 Processor -- start 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 -- start start 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4100e20 0x7f8de419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4110f80 con 0x7f8de4102570 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4110e00 con 0x7f8de4102ef0 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8deb391640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4111100 con 0x7f8de4100e20 2024-09-15T22:45:17.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8de892c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8de892c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39458/0 (socket says 172.21.15.66:39458) 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8de892c640 1 -- 172.21.15.66:0/1424933646 learned_addr learned my addr 172.21.15.66:0/1424933646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8de912d640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4100e20 0x7f8de419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.239+0000 7f8de992e640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4100e20 msgr2=0x7f8de419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4100e20 0x7f8de419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 msgr2=0x7f8de419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 -- 172.21.15.66:0/1424933646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de419f6b0 con 0x7f8de4102570 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de992e640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de892c640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e9f0 tx=0x7f8dd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800cd80 con 0x7f8de4102570 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd8010910 con 0x7f8de4102570 2024-09-15T22:45:17.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de419f9a0 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8018990 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.240+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41a7280 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.241+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4101200 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.243+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f8dd8010ac0 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.243+0000 7f8de27fc640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 0x7f8dcc0a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.243+0000 7f8de912d640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 msgr2=0x7f8dcc0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.243+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f8dd80d0070 con 0x7f8de4102570 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.244+0000 7f8de912d640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 0x7f8dcc0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:17.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.250+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8dd809c350 con 0x7f8de4102570 2024-09-15T22:45:17.428 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:17.362+0000 7f85d4731040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:45:17.428 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:45:17.428 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-mon[31185]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:45:17.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.445+0000 7f8de912d640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 msgr2=0x7f8dcc0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:17.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.445+0000 7f8de912d640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 0x7f8dcc0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.465+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8de41a7480 con 0x7f8de4102570 2024-09-15T22:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.465+0000 7f8de27fc640 1 -- 172.21.15.66:0/1424933646 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f8dd80a0650 con 0x7f8de4102570 2024-09-15T22:45:17.466 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:45:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 msgr2=0x7f8dcc0a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:17.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 0x7f8dcc0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 msgr2=0x7f8de419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e9f0 tx=0x7f8dd800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 shutdown_connections 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f8dcc0a3290 0x7f8dcc0a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8de4102ef0 0x7f8de419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8de4102570 0x7f8de419ac40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 --2- 172.21.15.66:0/1424933646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8de4100e20 0x7f8de419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 >> 172.21.15.66:0/1424933646 conn(0x7f8de40fc7d0 msgr2=0x7f8de410c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 shutdown_connections 2024-09-15T22:45:17.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:17.467+0000 7f8deb391640 1 -- 172.21.15.66:0/1424933646 wait complete. 2024-09-15T22:45:17.503 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:17 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:45:17.567 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:17 smithi184 ceph-mon[35203]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:45:17.568 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:17.259+0000 7f1b09a4d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:45:17.568 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:17.318+0000 7f1b09a4d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:45:17.568 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:17.502+0000 7f1b09a4d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:45:17.568 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:17 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3709961509' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:45:17.568 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:17 smithi087 ceph-mon[35290]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:45:17.569 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:17.267+0000 7f4909f23040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:45:17.569 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:17.326+0000 7f4909f23040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:45:17.698 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:17.426+0000 7f85d4731040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:45:17.699 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:17.629+0000 7f85d4731040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:45:17.849 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:17.510+0000 7f4909f23040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:45:18.147 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:18.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:18.148 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-09-15T22:45:18.204 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:45:18.204 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:45:18.204 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:45:18.205 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:45:18.206 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T22:45:18.206 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42129sec preferred_lft 42129sec 2024-09-15T22:45:18.206 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-15T22:45:18.206 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:45:18.206 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:45:18.206 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:18.206 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:45:18.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:45:18.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-09-15T22:45:18.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-09-15T22:45:18.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:45:18.207 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:45:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:18.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:18.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:18.352 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:45:18.376 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1424933646' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:45:18.379 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-09-15T22:45:18.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:18.381 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-09-15T22:45:18.439 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-09-15T22:45:18.439 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:45:18.439 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:45:18.439 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:45:18.439 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:45:18.440 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:45:18.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:18.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:18.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:18.572 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-15T22:45:18.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:18.589 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-09-15T22:45:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1424933646' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:45:18.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:18.392+0000 7f4909f23040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:45:18.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:18.459+0000 7f4909f23040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:45:18.646 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:18.646 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:45:18.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:45:18.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:45:18.646 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:45:18.662 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:18.587+0000 7f85d4731040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:45:18.662 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:18.660+0000 7f85d4731040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:45:18.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1424933646' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:45:18.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:18.386+0000 7f1b09a4d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:45:18.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:18.453+0000 7f1b09a4d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:45:18.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:18.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:18.743 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:45:18.743 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:18.743 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:45:18.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:45:18.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:45:18.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:45:18.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:45:18.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:45:18.744 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:45:18.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:18.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:18.866 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:45:18.866 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-15T22:45:18.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-09-15T22:45:18.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:45:18.866 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-15T22:45:18.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:18.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:18.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:18.948 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:18.964 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:45:18.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:45:18.964 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:19.020 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T22:45:19.020 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T22:45:19.020 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1 2024-09-15T22:45:19.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:19.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-15T22:45:19.105 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-15T22:45:19.105 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-15T22:45:19.105 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-09-15T22:45:19.245 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-15T22:45:19.245 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-15T22:45:19.245 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-09-15T22:45:19.245 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.87:3300,172.21.15.184:3300" 2024-09-15T22:45:19.246 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:3300,172.21.15.87:3300,172.21.15.184:3300:/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1 2024-09-15T22:45:19.246 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=7d1c9c1c-73b2-11ef-bceb-c7b262605968" will pass to kernel 2024-09-15T22:45:19.246 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:45:19.247 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:45:19.247 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:45:19.247 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:45:19.247 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:45:19.249 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:45:19.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:45:19.249 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:19.277 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:19.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:19.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:19.375 INFO:teuthology.orchestra.run.smithi066.stdout:client24970 2024-09-15T22:45:19.376 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:45:19.376 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:45:19.393 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:19.418 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.159+0000 7f1b09a4d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:45:19.418 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.275+0000 7f1b09a4d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:45:19.426 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.165+0000 7f4909f23040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:45:19.427 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.282+0000 7f4909f23040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:45:19.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:19.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:19.491 INFO:teuthology.orchestra.run.smithi066.stdout:client24970 2024-09-15T22:45:19.492 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:45:19.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:45:19.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:19.550 INFO:teuthology.orchestra.run.smithi066.stdout:client24970 2024-09-15T22:45:19.550 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968.client24970/status') 2024-09-15T22:45:19.585 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:19.458+0000 7f85d4731040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:45:19.585 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:19.583+0000 7f85d4731040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:45:19.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:45:19.611 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.24970 (3)172.21.15.66:0/226604094 2024-09-15T22:45:19.612 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2024-09-15T22:45:19.612 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2024-09-15T22:45:19.612 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2024-09-15T22:45:19.612 INFO:teuthology.orchestra.run.smithi066.stderr:70 bytes copied, 2.915e-05 s, 2.4 MB/s 2024-09-15T22:45:19.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:45:19.619 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:45:19.629 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:45:19.629 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:45:19.629 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-15T22:45:19.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.416+0000 7f1b09a4d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:19.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.477+0000 7f1b09a4d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:45:19.672 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.624+0000 7f1b09a4d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:45:19.704 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.425+0000 7f4909f23040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:19.704 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.486+0000 7f4909f23040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:45:19.704 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.634+0000 7f4909f23040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:45:19.704 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.703+0000 7f4909f23040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:45:19.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 -- 172.21.15.66:0/2648199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c1025d0 msgr2=0x7f385c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 --2- 172.21.15.66:0/2648199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c1025d0 0x7f385c1049c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3858009900 tx=0x7f385802a410 comp rx=0 tx=0).stop 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 -- 172.21.15.66:0/2648199 shutdown_connections 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 --2- 172.21.15.66:0/2648199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c107830 0x7f385c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 --2- 172.21.15.66:0/2648199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c104f00 0x7f385c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 --2- 172.21.15.66:0/2648199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c1025d0 0x7f385c1049c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 -- 172.21.15.66:0/2648199 >> 172.21.15.66:0/2648199 conn(0x7f385c0fc1b0 msgr2=0x7f385c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 -- 172.21.15.66:0/2648199 shutdown_connections 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.764+0000 7f38644f1640 1 -- 172.21.15.66:0/2648199 wait complete. 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 Processor -- start 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 -- start start 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c1025d0 0x7f385c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c107830 0x7f385c19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10d840 con 0x7f385c104f00 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10d6c0 con 0x7f385c107830 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f38644f1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10d9c0 con 0x7f385c1025d0 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f3861a8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f3861a8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39478/0 (socket says 172.21.15.66:39478) 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f3861a8c640 1 -- 172.21.15.66:0/983941942 learned_addr learned my addr 172.21.15.66:0/983941942 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f386228d640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c1025d0 0x7f385c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.765+0000 7f3862a8e640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c107830 0x7f385c19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c1025d0 msgr2=0x7f385c197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c1025d0 0x7f385c197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c107830 msgr2=0x7f385c19f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c107830 0x7f385c19f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:19.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 -- 172.21.15.66:0/983941942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c19fa60 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f3861a8c640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f384c00e9c0 tx=0x7f384c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c00cd80 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f384c005500 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c19fd50 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c010690 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.766+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c1a0240 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.767+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c0fdca0 con 0x7f385c104f00 2024-09-15T22:45:19.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.769+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f384c0046c0 con 0x7f385c104f00 2024-09-15T22:45:19.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.770+0000 7f38537fe640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 0x7f38480a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:19.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.770+0000 7f386228d640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 msgr2=0x7f38480a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:19.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.770+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f384c0d02f0 con 0x7f385c104f00 2024-09-15T22:45:19.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.770+0000 7f386228d640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 0x7f38480a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:19.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.773+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f384c0541b0 con 0x7f385c104f00 2024-09-15T22:45:19.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:19.736+0000 7f85d4731040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:45:19.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:19.803+0000 7f85d4731040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:45:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.971+0000 7f386228d640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 msgr2=0x7f38480a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:19.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.971+0000 7f386228d640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 0x7f38480a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:45:19.977 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.693+0000 7f1b09a4d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:45:19.977 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.751+0000 7f1b09a4d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:45:19.977 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.909+0000 7f1b09a4d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:45:19.977 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:19.975+0000 7f1b09a4d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:45:19.988 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.762+0000 7f4909f23040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:45:19.988 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.920+0000 7f4909f23040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:45:19.988 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:19.986+0000 7f4909f23040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:45:19.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:19.988+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f385c02d7c0 con 0x7f385c104f00 2024-09-15T22:45:20.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.040+0000 7f38537fe640 1 -- 172.21.15.66:0/983941942 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f384c09cc20 con 0x7f385c104f00 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 msgr2=0x7f38480a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 0x7f38480a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 msgr2=0x7f385c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f384c00e9c0 tx=0x7f384c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 shutdown_connections 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f38480a3340 0x7f38480a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c107830 0x7f385c19f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f385c104f00 0x7f385c198380 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 --2- 172.21.15.66:0/983941942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f385c1025d0 0x7f385c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 >> 172.21.15.66:0/983941942 conn(0x7f385c0fc1b0 msgr2=0x7f385c102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.043+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 shutdown_connections 2024-09-15T22:45:20.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.044+0000 7f38644f1640 1 -- 172.21.15.66:0/983941942 wait complete. 2024-09-15T22:45:20.057 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T22:45:20.068 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-15T22:45:20.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 -- 172.21.15.66:0/716995627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c1025c0 msgr2=0x7f861c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 --2- 172.21.15.66:0/716995627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c1025c0 0x7f861c108e50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8614009ca0 tx=0x7f861402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 -- 172.21.15.66:0/716995627 shutdown_connections 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 --2- 172.21.15.66:0/716995627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c1025c0 0x7f861c108e50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 --2- 172.21.15.66:0/716995627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c101c00 0x7f861c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 --2- 172.21.15.66:0/716995627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c100a10 0x7f861c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 -- 172.21.15.66:0/716995627 >> 172.21.15.66:0/716995627 conn(0x7f861c0fc170 msgr2=0x7f861c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 -- 172.21.15.66:0/716995627 shutdown_connections 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.208+0000 7f8623766640 1 -- 172.21.15.66:0/716995627 wait complete. 2024-09-15T22:45:20.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 Processor -- start 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 -- start start 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c100a10 0x7f861c10b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c1025c0 0x7f861c109f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f861c10d840 con 0x7f861c101c00 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f861c10d6c0 con 0x7f861c100a10 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8623766640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f861c10d9c0 con 0x7f861c1025c0 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8620d01640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8620d01640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39492/0 (socket says 172.21.15.66:39492) 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8620d01640 1 -- 172.21.15.66:0/1755379229 learned_addr learned my addr 172.21.15.66:0/1755379229 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8621d03640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c1025c0 0x7f861c109f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.209+0000 7f8621502640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c100a10 0x7f861c10b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 -- 172.21.15.66:0/1755379229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c1025c0 msgr2=0x7f861c109f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c1025c0 0x7f861c109f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 -- 172.21.15.66:0/1755379229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c100a10 msgr2=0x7f861c10b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c100a10 0x7f861c10b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 -- 172.21.15.66:0/1755379229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c10a7a0 con 0x7f861c101c00 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8620d01640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9f0 tx=0x7f860c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c00cd80 con 0x7f861c101c00 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f860c010910 con 0x7f861c101c00 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c1a1f00 con 0x7f861c101c00 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c018990 con 0x7f861c101c00 2024-09-15T22:45:20.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.210+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c1a2370 con 0x7f861c101c00 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.211+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861c107d30 con 0x7f861c101c00 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.213+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f860c010ac0 con 0x7f861c101c00 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.214+0000 7f86127fc640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 0x7f86080a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.214+0000 7f8621502640 1 -- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 msgr2=0x7f86080a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.214+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f860c0d0350 con 0x7f861c101c00 2024-09-15T22:45:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.214+0000 7f8621502640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 0x7f86080a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:20.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.217+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f860c09c630 con 0x7f861c101c00 2024-09-15T22:45:20.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:20 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:45:20.245 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:20.043+0000 7f1b09a4d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:45:20.245 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:20.125+0000 7f1b09a4d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:20.245 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:20.183+0000 7f1b09a4d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:45:20.245 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:20.242+0000 7f1b09a4d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:45:20.259 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:20 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:45:20.260 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:20.056+0000 7f4909f23040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:45:20.260 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:20.139+0000 7f4909f23040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:20.260 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:20.198+0000 7f4909f23040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:45:20.260 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:20.258+0000 7f4909f23040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:45:20.271 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-15T22:45:20.272 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:19.962+0000 7f85d4731040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:45:20.272 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.034+0000 7f85d4731040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:45:20.272 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.099+0000 7f85d4731040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:45:20.272 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.270+0000 7f85d4731040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:45:20.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.397+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f861c02da10 con 0x7f861c101c00 2024-09-15T22:45:20.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.399+0000 7f86127fc640 1 -- 172.21.15.66:0/1755379229 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24942 (secure 0 0 0) 0x7f860c0a0930 con 0x7f861c101c00 2024-09-15T22:45:20.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:20.401 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":89,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:45:02.141763+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 msgr2=0x7f86080a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 0x7f86080a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 msgr2=0x7f861c1099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f860c00e9f0 tx=0x7f860c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 shutdown_connections 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861c1025c0 0x7f861c109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f861c101c00 0x7f861c1099d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f86080a3320 0x7f86080a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 --2- 172.21.15.66:0/1755379229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f861c100a10 0x7f861c10b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 >> 172.21.15.66:0/1755379229 conn(0x7f861c0fc170 msgr2=0x7f861c104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 shutdown_connections 2024-09-15T22:45:20.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.401+0000 7f8623766640 1 -- 172.21.15.66:0/1755379229 wait complete. 2024-09-15T22:45:20.414 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:38:16.784964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:42:50.396560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:42:52.518865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T22:42:59.227216+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T22:45:20.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.521+0000 7f896628b640 1 -- 172.21.15.66:0/3235928344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960107860 msgr2=0x7f8960109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.521+0000 7f896628b640 1 --2- 172.21.15.66:0/3235928344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960107860 0x7f8960109c50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8958009ca0 tx=0x7f895802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- 172.21.15.66:0/3235928344 shutdown_connections 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- 172.21.15.66:0/3235928344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960107860 0x7f8960109c50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- 172.21.15.66:0/3235928344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960104f30 0x7f8960107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- 172.21.15.66:0/3235928344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f89601049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- 172.21.15.66:0/3235928344 >> 172.21.15.66:0/3235928344 conn(0x7f89600fc140 msgr2=0x7f89600fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- 172.21.15.66:0/3235928344 shutdown_connections 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- 172.21.15.66:0/3235928344 wait complete. 2024-09-15T22:45:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 Processor -- start 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- start start 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f8960197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960107860 0x7f896019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f896010d7a0 con 0x7f8960104f30 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f896010d620 con 0x7f8960102600 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f896628b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f896010d920 con 0x7f8960107860 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.522+0000 7f8957fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39510/0 (socket says 172.21.15.66:39510) 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 -- 172.21.15.66:0/3557310480 learned_addr learned my addr 172.21.15.66:0/3557310480 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f895ffff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f8960197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8964828640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960107860 0x7f896019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 -- 172.21.15.66:0/3557310480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960107860 msgr2=0x7f896019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960107860 0x7f896019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 -- 172.21.15.66:0/3557310480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 msgr2=0x7f8960197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f8960197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 -- 172.21.15.66:0/3557310480 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896019faa0 con 0x7f8960104f30 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f895ffff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f8960197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f8957fff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f894800e9a0 tx=0x7f894800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894800cd80 con 0x7f8960104f30 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89480035f0 con 0x7f8960104f30 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896019fd90 con 0x7f8960104f30 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948010670 con 0x7f8960104f30 2024-09-15T22:45:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.523+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89601a0280 con 0x7f8960104f30 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.524+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89600fdc30 con 0x7f8960104f30 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.526+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f89480037a0 con 0x7f8960104f30 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.526+0000 7f895dffb640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 0x7f894c0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.526+0000 7f895ffff640 1 -- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 msgr2=0x7f894c0a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.526+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f89480d0070 con 0x7f8960104f30 2024-09-15T22:45:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.526+0000 7f895ffff640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 0x7f894c0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:20.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.533+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f894809c9a0 con 0x7f8960104f30 2024-09-15T22:45:20.569 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.340+0000 7f85d4731040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:45:20.570 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.410+0000 7f85d4731040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:45:20.570 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.500+0000 7f85d4731040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:45:20.570 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.568+0000 7f85d4731040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:45:20.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.710+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f896002da10 con 0x7f8960104f30 2024-09-15T22:45:20.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.711+0000 7f895dffb640 1 -- 172.21.15.66:0/3557310480 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f894809c2a0 con 0x7f8960104f30 2024-09-15T22:45:20.712 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-09-15T22:45:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 msgr2=0x7f894c0a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 0x7f894c0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 msgr2=0x7f89601983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f894800e9a0 tx=0x7f894800ee60 comp rx=0 tx=0).stop 2024-09-15T22:45:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 shutdown_connections 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8960107860 0x7f896019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8960104f30 0x7f89601983c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f894c0a32a0 0x7f894c0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 --2- 172.21.15.66:0/3557310480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8960102600 0x7f8960197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.713+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 >> 172.21.15.66:0/3557310480 conn(0x7f89600fc140 msgr2=0x7f8960102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.714+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 shutdown_connections 2024-09-15T22:45:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.714+0000 7f896628b640 1 -- 172.21.15.66:0/3557310480 wait complete. 2024-09-15T22:45:20.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 -- 172.21.15.66:0/1203179309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 msgr2=0x7f3f6c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 --2- 172.21.15.66:0/1203179309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c107300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009900 tx=0x7f3f5c02a410 comp rx=0 tx=0).stop 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 -- 172.21.15.66:0/1203179309 shutdown_connections 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 --2- 172.21.15.66:0/1203179309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c107840 0x7f3f6c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 --2- 172.21.15.66:0/1203179309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c107300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 --2- 172.21.15.66:0/1203179309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 -- 172.21.15.66:0/1203179309 >> 172.21.15.66:0/1203179309 conn(0x7f3f6c0fc140 msgr2=0x7f3f6c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 -- 172.21.15.66:0/1203179309 shutdown_connections 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.834+0000 7f3f73786640 1 -- 172.21.15.66:0/1203179309 wait complete. 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 Processor -- start 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 -- start start 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 0x7f3f6c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c10d7a0 con 0x7f3f6c104f10 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c10d620 con 0x7f3f6c107840 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f73786640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c10d920 con 0x7f3f6c1025e0 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f71522640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39528/0 (socket says 172.21.15.66:39528) 2024-09-15T22:45:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 -- 172.21.15.66:0/1315276302 learned_addr learned my addr 172.21.15.66:0/1315276302 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f71d23640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 0x7f3f6c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 -- 172.21.15.66:0/1315276302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 msgr2=0x7f3f6c197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 -- 172.21.15.66:0/1315276302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 msgr2=0x7f3f6c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 0x7f3f6c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f70d21640 1 -- 172.21.15.66:0/1315276302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c19fb30 con 0x7f3f6c104f10 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f71522640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.835+0000 7f3f71d23640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 0x7f3f6c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f70d21640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c031610 tx=0x7f3f5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c03f030 con 0x7f3f6c104f10 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c19fdc0 con 0x7f3f6c104f10 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f5c003ad0 con 0x7f3f6c104f10 2024-09-15T22:45:20.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c035070 con 0x7f3f6c104f10 2024-09-15T22:45:20.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.836+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c1a0220 con 0x7f3f6c104f10 2024-09-15T22:45:20.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.837+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c0fdc30 con 0x7f3f6c104f10 2024-09-15T22:45:20.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.838+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f3f5c042030 con 0x7f3f6c104f10 2024-09-15T22:45:20.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.839+0000 7f3f627fc640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 0x7f3f580a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:20.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.839+0000 7f3f71522640 1 -- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 msgr2=0x7f3f580a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:20.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.839+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f3f5c0f0310 con 0x7f3f6c104f10 2024-09-15T22:45:20.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.839+0000 7f3f71522640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 0x7f3f580a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:20.847+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f5c0bc5f0 con 0x7f3f6c104f10 2024-09-15T22:45:20.948 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:20.631+0000 7f85d4731040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:45:21.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.024+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3f6c062ef0 con 0x7f3f6c104f10 2024-09-15T22:45:21.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.025+0000 7f3f627fc640 1 -- 172.21.15.66:0/1315276302 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f3f5c0c08f0 con 0x7f3f6c104f10 2024-09-15T22:45:21.026 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-09-15T22:45:21.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 msgr2=0x7f3f580a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:21.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 0x7f3f580a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 msgr2=0x7f3f6c198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c031610 tx=0x7f3f5c004270 comp rx=0 tx=0).stop 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 shutdown_connections 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f3f580a32a0 0x7f3f580a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f6c107840 0x7f3f6c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f6c104f10 0x7f3f6c198450 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 --2- 172.21.15.66:0/1315276302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f6c1025e0 0x7f3f6c197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 >> 172.21.15.66:0/1315276302 conn(0x7f3f6c0fc140 msgr2=0x7f3f6c102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 shutdown_connections 2024-09-15T22:45:21.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.027+0000 7f3f73786640 1 -- 172.21.15.66:0/1315276302 wait complete. 2024-09-15T22:45:21.039 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:45:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- 172.21.15.66:0/2796660415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc101c20 msgr2=0x7fe8fc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 --2- 172.21.15.66:0/2796660415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc101c20 0x7fe8fc1020a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009900 tx=0x7fe8e802a410 comp rx=0 tx=0).stop 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- 172.21.15.66:0/2796660415 shutdown_connections 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 --2- 172.21.15.66:0/2796660415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc1025e0 0x7fe8fc108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 --2- 172.21.15.66:0/2796660415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc101c20 0x7fe8fc1020a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 --2- 172.21.15.66:0/2796660415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc100a30 0x7fe8fc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- 172.21.15.66:0/2796660415 >> 172.21.15.66:0/2796660415 conn(0x7fe8fc0fc1b0 msgr2=0x7fe8fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- 172.21.15.66:0/2796660415 shutdown_connections 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- 172.21.15.66:0/2796660415 wait complete. 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 Processor -- start 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.152+0000 7fe902f2c640 1 -- start start 2024-09-15T22:45:21.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc101c20 0x7fe8fc19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc1025e0 0x7fe8fc19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c690 con 0x7fe8fc100a30 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c510 con 0x7fe8fc1025e0 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc10c810 con 0x7fe8fc101c20 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39548/0 (socket says 172.21.15.66:39548) 2024-09-15T22:45:21.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 -- 172.21.15.66:0/885919488 learned_addr learned my addr 172.21.15.66:0/885919488 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe9014c9640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc1025e0 0x7fe8fc19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe8fbfff640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc101c20 0x7fe8fc19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 -- 172.21.15.66:0/885919488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc101c20 msgr2=0x7fe8fc19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc101c20 0x7fe8fc19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 -- 172.21.15.66:0/885919488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc1025e0 msgr2=0x7fe8fc19f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc1025e0 0x7fe8fc19f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 -- 172.21.15.66:0/885919488 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc19fa60 con 0x7fe8fc100a30 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe900cc8640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000e9c0 tx=0x7fe8f000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000cd80 con 0x7fe8fc100a30 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f00035f0 con 0x7fe8fc100a30 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0010690 con 0x7fe8fc100a30 2024-09-15T22:45:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.153+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc19fd50 con 0x7fe8fc100a30 2024-09-15T22:45:21.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.154+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc1a01c0 con 0x7fe8fc100a30 2024-09-15T22:45:21.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.155+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc107ec0 con 0x7fe8fc100a30 2024-09-15T22:45:21.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.156+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 138372+0+0 (secure 0 0 0) 0x7fe8f00037a0 con 0x7fe8fc100a30 2024-09-15T22:45:21.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.157+0000 7fe8f9ffb640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 0x7fe8ec0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.157+0000 7fe8fbfff640 1 -- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 msgr2=0x7fe8ec0a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:21.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.157+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7fe8f00d01f0 con 0x7fe8fc100a30 2024-09-15T22:45:21.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.157+0000 7fe8fbfff640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 0x7fe8ec0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:21.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.161+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8f009cb20 con 0x7fe8fc100a30 2024-09-15T22:45:21.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.337+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8fc062e90 con 0x7fe8fc100a30 2024-09-15T22:45:21.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.337+0000 7fe8f9ffb640 1 -- 172.21.15.66:0/885919488 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fe8f009c420 con 0x7fe8fc100a30 2024-09-15T22:45:21.339 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 64 2024-09-15T22:45:21.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 msgr2=0x7fe8ec0a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 0x7fe8ec0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 msgr2=0x7fe8fc06aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000e9c0 tx=0x7fe8f000ee80 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 shutdown_connections 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7fe8ec0a32a0 0x7fe8ec0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8fc1025e0 0x7fe8fc19f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8fc101c20 0x7fe8fc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 --2- 172.21.15.66:0/885919488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8fc100a30 0x7fe8fc06aa90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.341+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 >> 172.21.15.66:0/885919488 conn(0x7fe8fc0fc1b0 msgr2=0x7fe8fc105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.342+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 shutdown_connections 2024-09-15T22:45:21.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.342+0000 7fe902f2c640 1 -- 172.21.15.66:0/885919488 wait complete. 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y[36650]: 2024-09-15T22:45:21.045+0000 7f4909f23040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1755379229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3557310480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1315276302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: Standby manager daemon z restarted 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: Standby manager daemon z started 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:45:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:21 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1755379229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3557310480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1315276302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: Standby manager daemon z restarted 2024-09-15T22:45:21.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: Standby manager daemon z started 2024-09-15T22:45:21.358 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:45:21.358 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:21.358 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:45:21.358 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:21.359 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T22:45:21.422 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z[36878]: 2024-09-15T22:45:21.032+0000 7f1b09a4d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:45:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/983941942' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-15T22:45:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:45:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1755379229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3557310480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1315276302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: Standby manager daemon z restarted 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: Standby manager daemon z started 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:45:21.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:21 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.184:0/3929455263' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:21.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 -- 172.21.15.66:0/4188745863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0101c20 msgr2=0x7f58d01020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 --2- 172.21.15.66:0/4188745863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0101c20 0x7f58d01020a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009900 tx=0x7f58c002a410 comp rx=0 tx=0).stop 2024-09-15T22:45:21.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 -- 172.21.15.66:0/4188745863 shutdown_connections 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 --2- 172.21.15.66:0/4188745863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 0x7f58d0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 --2- 172.21.15.66:0/4188745863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0101c20 0x7f58d01020a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 --2- 172.21.15.66:0/4188745863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0100a30 0x7f58d0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 -- 172.21.15.66:0/4188745863 >> 172.21.15.66:0/4188745863 conn(0x7f58d00fc1b0 msgr2=0x7f58d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 -- 172.21.15.66:0/4188745863 shutdown_connections 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.466+0000 7f58d7e94640 1 -- 172.21.15.66:0/4188745863 wait complete. 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 Processor -- start 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 -- start start 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 0x7f58d01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 0x7f58d019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58d010c700 con 0x7f58d0100a30 2024-09-15T22:45:21.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58d010c580 con 0x7f58d0101c20 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d7e94640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58d010c880 con 0x7f58d01025e0 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d5c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d5c30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39570/0 (socket says 172.21.15.66:39570) 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.467+0000 7f58d5c30640 1 -- 172.21.15.66:0/2703587002 learned_addr learned my addr 172.21.15.66:0/2703587002 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d542f640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 0x7f58d01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d6431640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 0x7f58d019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 -- 172.21.15.66:0/2703587002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 msgr2=0x7f58d019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 0x7f58d019f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 -- 172.21.15.66:0/2703587002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 msgr2=0x7f58d01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 0x7f58d01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 -- 172.21.15.66:0/2703587002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d019fa80 con 0x7f58d0100a30 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d542f640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 0x7f58d01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d5c30640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00d770 tx=0x7f58cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:21.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc017070 con 0x7f58d0100a30 2024-09-15T22:45:21.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d019fd70 con 0x7f58d0100a30 2024-09-15T22:45:21.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58cc009c30 con 0x7f58d0100a30 2024-09-15T22:45:21.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc003dd0 con 0x7f58d0100a30 2024-09-15T22:45:21.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.468+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d01a0220 con 0x7f58d0100a30 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.469+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d01a0450 con 0x7f58d0100a30 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.470+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 138372+0+0 (secure 0 0 0) 0x7f58cc004000 con 0x7f58d0100a30 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.471+0000 7f58c6ffd640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 0x7f58bc0a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.471+0000 7f58d542f640 1 -- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 msgr2=0x7f58bc0a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/1080608797 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.471+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9245+0+0 (secure 0 0 0) 0x7f58cc0cf780 con 0x7f58d0100a30 2024-09-15T22:45:21.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.471+0000 7f58d542f640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 0x7f58bc0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:45:21.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.475+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58cc09c0b0 con 0x7f58d0100a30 2024-09-15T22:45:21.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.520+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f58cc098020 con 0x7f58d0100a30 2024-09-15T22:45:21.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.520+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 msgr2=0x7f58bc0a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:45:21.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.520+0000 7f58c6ffd640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 0x7f58bc0a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.698 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.505+0000 7f85d4731040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:45:21.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.722+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f58d01a06c0 con 0x7f58d0100a30 2024-09-15T22:45:21.724 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-09-15T22:45:21.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.723+0000 7f58c6ffd640 1 -- 172.21.15.66:0/2703587002 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f58cc009de0 con 0x7f58d0100a30 2024-09-15T22:45:21.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 msgr2=0x7f58d0197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:21.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00d770 tx=0x7f58cc00dc30 comp rx=0 tx=0).stop 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 shutdown_connections 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58d01025e0 0x7f58d019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:6800/1080608797,v1:172.21.15.66:6801/1080608797] conn(0x7f58bc0a32a0 0x7f58bc0a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58d0101c20 0x7f58d01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 --2- 172.21.15.66:0/2703587002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58d0100a30 0x7f58d0197e60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.726+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 >> 172.21.15.66:0/2703587002 conn(0x7f58d00fc1b0 msgr2=0x7f58d0069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.727+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 shutdown_connections 2024-09-15T22:45:21.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:21.727+0000 7f58d7e94640 1 -- 172.21.15.66:0/2703587002 wait complete. 2024-09-15T22:45:21.744 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-15T22:45:21.745 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:22.026 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:22.054 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: Standby manager daemon y restarted 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: Standby manager daemon y started 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/885919488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: Active manager daemon x restarted 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: Activating manager daemon x 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: mgrmap e21: x(active, starting, since 0.014157s), standbys: y, z 2024-09-15T22:45:22.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:45:22.056 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:45:22.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: Manager daemon x is now available 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.058 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:22 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2703587002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.770+0000 7f853ef49640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.770+0000 7f853ef49640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.770+0000 7f853ef49640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.770+0000 7f853ef49640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.770+0000 7f853ef49640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.771+0000 7f853bf43640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.771+0000 7f853bf43640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.771+0000 7f853bf43640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.771+0000 7f853bf43640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.059 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:21.771+0000 7f853bf43640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:45:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:45:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: Standby manager daemon y restarted 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: Standby manager daemon y started 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/885919488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: Active manager daemon x restarted 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: Activating manager daemon x 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: mgrmap e21: x(active, starting, since 0.014157s), standbys: y, z 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:45:22.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:45:22.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:45:22.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: Manager daemon x is now available 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:22 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2703587002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.? 172.21.15.87:0/2349209316' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: Standby manager daemon y restarted 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: Standby manager daemon y started 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/885919488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: Active manager daemon x restarted 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: Activating manager daemon x 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:45:22.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: mgrmap e21: x(active, starting, since 0.014157s), standbys: y, z 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:45:22.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:45:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: Manager daemon x is now available 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:22.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:45:22.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:45:22.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:22 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2703587002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:45:22.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 -- 172.21.15.66:0/3565160155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc103740 msgr2=0x7f64cc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 --2- 172.21.15.66:0/3565160155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc103740 0x7f64cc107b80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009930 tx=0x7f64c002a440 comp rx=0 tx=0).stop 2024-09-15T22:45:22.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 -- 172.21.15.66:0/3565160155 shutdown_connections 2024-09-15T22:45:22.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 --2- 172.21.15.66:0/3565160155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc108290 0x7f64cc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 --2- 172.21.15.66:0/3565160155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc103740 0x7f64cc107b80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 --2- 172.21.15.66:0/3565160155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc102d90 0x7f64cc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 -- 172.21.15.66:0/3565160155 >> 172.21.15.66:0/3565160155 conn(0x7f64cc0fc7d0 msgr2=0x7f64cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 -- 172.21.15.66:0/3565160155 shutdown_connections 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.567+0000 7f64d27cb640 1 -- 172.21.15.66:0/3565160155 wait complete. 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 Processor -- start 2024-09-15T22:45:22.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 -- start start 2024-09-15T22:45:22.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 0x7f64cc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 0x7f64cc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 0x7f64cc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.568+0000 7f64d27cb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc112090 con 0x7f64cc102d90 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64d27cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc111f10 con 0x7f64cc103740 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64d27cb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc112210 con 0x7f64cc108290 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 0x7f64cc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 0x7f64cc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 0x7f64cc1009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56798/0 (socket says 172.21.15.66:56798) 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cbfff640 1 -- 172.21.15.66:0/1231041381 learned_addr learned my addr 172.21.15.66:0/1231041381 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64d0d68640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 0x7f64cc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 -- 172.21.15.66:0/1231041381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 msgr2=0x7f64cc101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 0x7f64cc101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 -- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 msgr2=0x7f64cc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 0x7f64cc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 -- 172.21.15.66:0/1231041381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc1a6b10 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64d0d68640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 0x7f64cc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64cb7fe640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 0x7f64cc100f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009230 tx=0x7f64c00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.569+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c003f070 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.570+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64c00044c0 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.570+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64cc1a6da0 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.570+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0035070 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.570+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64cc1a71f0 con 0x7f64cc103740 2024-09-15T22:45:22.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.571+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64cc103170 con 0x7f64cc103740 2024-09-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.572+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f64c003b460 con 0x7f64cc103740 2024-09-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.572+0000 7f64c97fa640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 0x7f64b40a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.572+0000 7f64cbfff640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 0x7f64b40a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.572+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f64c00eff70 con 0x7f64cc103740 2024-09-15T22:45:22.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.573+0000 7f64cbfff640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 0x7f64b40a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc00b480 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:22.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.577+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64c00bca50 con 0x7f64cc103740 2024-09-15T22:45:22.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.814+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64cc10a2a0 con 0x7f64cc103740 2024-09-15T22:45:22.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.815+0000 7f64c97fa640 1 -- 172.21.15.66:0/1231041381 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f64c00bc350 con 0x7f64cc103740 2024-09-15T22:45:22.817 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:22.817 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:45:22.817 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 msgr2=0x7f64b40a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 0x7f64b40a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc00b480 comp rx=0 tx=0).stop 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 msgr2=0x7f64cc100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 0x7f64cc100f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009230 tx=0x7f64c00040c0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 shutdown_connections 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f64b40a3030 0x7f64b40a54f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64cc108290 0x7f64cc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64cc103740 0x7f64cc100f30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 --2- 172.21.15.66:0/1231041381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64cc102d90 0x7f64cc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:22.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 >> 172.21.15.66:0/1231041381 conn(0x7f64cc0fc7d0 msgr2=0x7f64cc105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:22.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 shutdown_connections 2024-09-15T22:45:22.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:22.818+0000 7f64d27cb640 1 -- 172.21.15.66:0/1231041381 wait complete. 2024-09-15T22:45:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-mon[31185]: mgrmap e22: x(active, since 1.01964s), standbys: y, z 2024-09-15T22:45:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-mon[31185]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1231041381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:23.837 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-15T22:45:23.837 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-15T22:45:23.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:23.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:23 smithi087 ceph-mon[35290]: mgrmap e22: x(active, since 1.01964s), standbys: y, z 2024-09-15T22:45:23.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:23 smithi087 ceph-mon[35290]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:23.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:23 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1231041381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:23 smithi184 ceph-mon[35203]: mgrmap e22: x(active, since 1.01964s), standbys: y, z 2024-09-15T22:45:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:23 smithi184 ceph-mon[35203]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:23.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:23 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1231041381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 -- 172.21.15.66:0/1367170567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 msgr2=0x7efc241001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 --2- 172.21.15.66:0/1367170567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc241001f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc14009900 tx=0x7efc1402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 -- 172.21.15.66:0/1367170567 shutdown_connections 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 --2- 172.21.15.66:0/1367170567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24103780 0x7efc2410a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 --2- 172.21.15.66:0/1367170567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24102dc0 0x7efc24103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 --2- 172.21.15.66:0/1367170567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc241001f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.950+0000 7efc29b4b640 1 -- 172.21.15.66:0/1367170567 >> 172.21.15.66:0/1367170567 conn(0x7efc240fb950 msgr2=0x7efc240fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- 172.21.15.66:0/1367170567 shutdown_connections 2024-09-15T22:45:23.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- 172.21.15.66:0/1367170567 wait complete. 2024-09-15T22:45:23.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 Processor -- start 2024-09-15T22:45:23.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- start start 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc24197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 0x7efc2419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efc2410d7c0 con 0x7efc24102dc0 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efc2410d640 con 0x7efc240ffdf0 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.951+0000 7efc29b4b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efc2410d940 con 0x7efc24103780 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc237fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc24197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56848/0 (socket says 172.21.15.66:56848) 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 -- 172.21.15.66:0/2276999356 learned_addr learned my addr 172.21.15.66:0/2276999356 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc23fff640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 0x7efc2419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 -- 172.21.15.66:0/2276999356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 msgr2=0x7efc2419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 0x7efc2419f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 -- 172.21.15.66:0/2276999356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 msgr2=0x7efc24197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc24197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 -- 172.21.15.66:0/2276999356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2419fac0 con 0x7efc24102dc0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc23fff640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 0x7efc2419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc237fe640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc24197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc22ffd640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d770 tx=0x7efc1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18017070 con 0x7efc24102dc0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2419fdb0 con 0x7efc24102dc0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc18005500 con 0x7efc24102dc0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18004e00 con 0x7efc24102dc0 2024-09-15T22:45:23.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.952+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc241a0270 con 0x7efc24102dc0 2024-09-15T22:45:23.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.953+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc24109060 con 0x7efc24102dc0 2024-09-15T22:45:23.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.955+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7efc18004fa0 con 0x7efc24102dc0 2024-09-15T22:45:23.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.955+0000 7efc20ff9640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 0x7efc0c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:23.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.956+0000 7efc237fe640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 0x7efc0c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:23.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.956+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efc180cff10 con 0x7efc24102dc0 2024-09-15T22:45:23.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.956+0000 7efc237fe640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 0x7efc0c0a5880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ab0 tx=0x7efc14000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:23.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:23.959+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc1809c520 con 0x7efc24102dc0 2024-09-15T22:45:24.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.150+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc24062630 con 0x7efc0c0a33c0 2024-09-15T22:45:24.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.160+0000 7efc20ff9640 1 -- 172.21.15.66:0/2276999356 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339432 (secure 0 0 0) 0x7efc24062630 con 0x7efc0c0a33c0 2024-09-15T22:45:24.165 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:24.167 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:24.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 msgr2=0x7efc0c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 0x7efc0c0a5880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc14005ab0 tx=0x7efc14000bc0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 msgr2=0x7efc241983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d770 tx=0x7efc1800dc30 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 shutdown_connections 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efc0c0a33c0 0x7efc0c0a5880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc24103780 0x7efc2419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc24102dc0 0x7efc241983e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 --2- 172.21.15.66:0/2276999356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc240ffdf0 0x7efc24197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.163+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 >> 172.21.15.66:0/2276999356 conn(0x7efc240fb950 msgr2=0x7efc24106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.164+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 shutdown_connections 2024-09-15T22:45:24.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.164+0000 7efc29b4b640 1 -- 172.21.15.66:0/2276999356 wait complete. 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:23.880+0000 7f851e709640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:45:23] ENGINE Error in HTTPServer.serve 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Traceback (most recent call last): 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._connections.run(self.expiration_interval) 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._run(expiration_interval) 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: s = self.context.wrap_socket( 2024-09-15T22:45:24.176 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: return self.sslsocket_class._create( 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.do_handshake() 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self._sslobj.do_handshake() 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:45:24.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:45:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:45:24.178 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T22:45:23.527331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192653,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1313,"num_read_kb":825,"num_write":559,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390032,"kb_used_data":15784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124551792,"statfs":{"total":1151940427776,"available":1151541035008,"internally_reserved":0,"allocated":16162816,"data_stored":9610676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991107"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615855+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:21.615855+0000","last_peered":"2024-09-15T22:45:21.615855+0000","last_clean":"2024-09-15T22:45:21.615855+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:21.615855+0000","last_undegraded":"2024-09-15T22:45:21.615855+0000","last_fullsized":"2024-09-15T22:45:21.615855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798711+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798711+0000","last_peered":"2024-09-15T22:45:21.798711+0000","last_clean":"2024-09-15T22:45:21.798711+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798711+0000","last_undegraded":"2024-09-15T22:45:21.798711+0000","last_fullsized":"2024-09-15T22:45:21.798711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894238+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894238+0000","last_peered":"2024-09-15T22:45:21.894238+0000","last_clean":"2024-09-15T22:45:21.894238+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894238+0000","last_undegraded":"2024-09-15T22:45:21.894238+0000","last_fullsized":"2024-09-15T22:45:21.894238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515077+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515077+0000","last_peered":"2024-09-15T22:45:21.515077+0000","last_clean":"2024-09-15T22:45:21.515077+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515077+0000","last_undegraded":"2024-09-15T22:45:21.515077+0000","last_fullsized":"2024-09-15T22:45:21.515077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894468+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894468+0000","last_peered":"2024-09-15T22:45:21.894468+0000","last_clean":"2024-09-15T22:45:21.894468+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894468+0000","last_undegraded":"2024-09-15T22:45:21.894468+0000","last_fullsized":"2024-09-15T22:45:21.894468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515331+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515331+0000","last_peered":"2024-09-15T22:45:21.515331+0000","last_clean":"2024-09-15T22:45:21.515331+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515331+0000","last_undegraded":"2024-09-15T22:45:21.515331+0000","last_fullsized":"2024-09-15T22:45:21.515331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894320+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894320+0000","last_peered":"2024-09-15T22:45:21.894320+0000","last_clean":"2024-09-15T22:45:21.894320+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894320+0000","last_undegraded":"2024-09-15T22:45:21.894320+0000","last_fullsized":"2024-09-15T22:45:21.894320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'51","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.743562+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:21.743562+0000","last_peered":"2024-09-15T22:45:21.743562+0000","last_clean":"2024-09-15T22:45:21.743562+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:21.743562+0000","last_undegraded":"2024-09-15T22:45:21.743562+0000","last_fullsized":"2024-09-15T22:45:21.743562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.966904+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:21.966904+0000","last_peered":"2024-09-15T22:45:21.966904+0000","last_clean":"2024-09-15T22:45:21.966904+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:21.966904+0000","last_undegraded":"2024-09-15T22:45:21.966904+0000","last_fullsized":"2024-09-15T22:45:21.966904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514189+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:21.514189+0000","last_peered":"2024-09-15T22:45:21.514189+0000","last_clean":"2024-09-15T22:45:21.514189+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:21.514189+0000","last_undegraded":"2024-09-15T22:45:21.514189+0000","last_fullsized":"2024-09-15T22:45:21.514189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799041+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:21.799041+0000","last_peered":"2024-09-15T22:45:21.799041+0000","last_clean":"2024-09-15T22:45:21.799041+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:21.799041+0000","last_undegraded":"2024-09-15T22:45:21.799041+0000","last_fullsized":"2024-09-15T22:45:21.799041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.010119+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:22.010119+0000","last_peered":"2024-09-15T22:45:22.010119+0000","last_clean":"2024-09-15T22:45:22.010119+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:22.010119+0000","last_undegraded":"2024-09-15T22:45:22.010119+0000","last_fullsized":"2024-09-15T22:45:22.010119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'41","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.740843+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:21.740843+0000","last_peered":"2024-09-15T22:45:21.740843+0000","last_clean":"2024-09-15T22:45:21.740843+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:21.740843+0000","last_undegraded":"2024-09-15T22:45:21.740843+0000","last_fullsized":"2024-09-15T22:45:21.740843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514674+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514674+0000","last_peered":"2024-09-15T22:45:21.514674+0000","last_clean":"2024-09-15T22:45:21.514674+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514674+0000","last_undegraded":"2024-09-15T22:45:21.514674+0000","last_fullsized":"2024-09-15T22:45:21.514674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894484+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:21.894484+0000","last_peered":"2024-09-15T22:45:21.894484+0000","last_clean":"2024-09-15T22:45:21.894484+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:21.894484+0000","last_undegraded":"2024-09-15T22:45:21.894484+0000","last_fullsized":"2024-09-15T22:45:21.894484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615640+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615640+0000","last_peered":"2024-09-15T22:45:21.615640+0000","last_clean":"2024-09-15T22:45:21.615640+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615640+0000","last_undegraded":"2024-09-15T22:45:21.615640+0000","last_fullsized":"2024-09-15T22:45:21.615640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800520+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800520+0000","last_peered":"2024-09-15T22:45:21.800520+0000","last_clean":"2024-09-15T22:45:21.800520+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800520+0000","last_undegraded":"2024-09-15T22:45:21.800520+0000","last_fullsized":"2024-09-15T22:45:21.800520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515302+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515302+0000","last_peered":"2024-09-15T22:45:21.515302+0000","last_clean":"2024-09-15T22:45:21.515302+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515302+0000","last_undegraded":"2024-09-15T22:45:21.515302+0000","last_fullsized":"2024-09-15T22:45:21.515302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937060+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:21.937060+0000","last_peered":"2024-09-15T22:45:21.937060+0000","last_clean":"2024-09-15T22:45:21.937060+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:21.937060+0000","last_undegraded":"2024-09-15T22:45:21.937060+0000","last_fullsized":"2024-09-15T22:45:21.937060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":178,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":254,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.009144+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:22.009144+0000","last_peered":"2024-09-15T22:45:22.009144+0000","last_clean":"2024-09-15T22:45:22.009144+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:22.009144+0000","last_undegraded":"2024-09-15T22:45:22.009144+0000","last_fullsized":"2024-09-15T22:45:22.009144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515208+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515208+0000","last_peered":"2024-09-15T22:45:21.515208+0000","last_clean":"2024-09-15T22:45:21.515208+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515208+0000","last_undegraded":"2024-09-15T22:45:21.515208+0000","last_fullsized":"2024-09-15T22:45:21.515208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798938+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798938+0000","last_peered":"2024-09-15T22:45:21.798938+0000","last_clean":"2024-09-15T22:45:21.798938+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798938+0000","last_undegraded":"2024-09-15T22:45:21.798938+0000","last_fullsized":"2024-09-15T22:45:21.798938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937102+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:21.937102+0000","last_peered":"2024-09-15T22:45:21.937102+0000","last_clean":"2024-09-15T22:45:21.937102+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:21.937102+0000","last_undegraded":"2024-09-15T22:45:21.937102+0000","last_fullsized":"2024-09-15T22:45:21.937102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616822+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616822+0000","last_peered":"2024-09-15T22:45:21.616822+0000","last_clean":"2024-09-15T22:45:21.616822+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616822+0000","last_undegraded":"2024-09-15T22:45:21.616822+0000","last_fullsized":"2024-09-15T22:45:21.616822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798890+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798890+0000","last_peered":"2024-09-15T22:45:21.798890+0000","last_clean":"2024-09-15T22:45:21.798890+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798890+0000","last_undegraded":"2024-09-15T22:45:21.798890+0000","last_fullsized":"2024-09-15T22:45:21.798890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798871+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798871+0000","last_peered":"2024-09-15T22:45:21.798871+0000","last_clean":"2024-09-15T22:45:21.798871+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798871+0000","last_undegraded":"2024-09-15T22:45:21.798871+0000","last_fullsized":"2024-09-15T22:45:21.798871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616829+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616829+0000","last_peered":"2024-09-15T22:45:21.616829+0000","last_clean":"2024-09-15T22:45:21.616829+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616829+0000","last_undegraded":"2024-09-15T22:45:21.616829+0000","last_fullsized":"2024-09-15T22:45:21.616829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602051,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1177,"num_read_kb":706,"num_write":376,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1806153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612651,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1160788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005109,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234042,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37108,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708044,"statfs":{"total":95995035648,"available":95957037056,"internally_reserved":0,"allocated":1806336,"data_stored":1240800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986254,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1040384,"data_stored":510847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1041258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":570588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1118208,"data_stored":581239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":508229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":202128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:24.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 -- 172.21.15.66:0/3945999633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 msgr2=0x7f0ec8100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 --2- 172.21.15.66:0/3945999633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8100e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009900 tx=0x7f0eb802a410 comp rx=0 tx=0).stop 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 -- 172.21.15.66:0/3945999633 shutdown_connections 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 --2- 172.21.15.66:0/3945999633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec81025c0 0x7f0ec8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 --2- 172.21.15.66:0/3945999633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8101c00 0x7f0ec8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 --2- 172.21.15.66:0/3945999633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8100e10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.333+0000 7f0ece496640 1 -- 172.21.15.66:0/3945999633 >> 172.21.15.66:0/3945999633 conn(0x7f0ec80fc170 msgr2=0x7f0ec80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.334+0000 7f0ece496640 1 -- 172.21.15.66:0/3945999633 shutdown_connections 2024-09-15T22:45:24.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.334+0000 7f0ece496640 1 -- 172.21.15.66:0/3945999633 wait complete. 2024-09-15T22:45:24.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.334+0000 7f0ece496640 1 Processor -- start 2024-09-15T22:45:24.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.334+0000 7f0ece496640 1 -- start start 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 0x7f0ec819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec81025c0 0x7f0ec819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c6e0 con 0x7f0ec8100a10 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c560 con 0x7f0ec81025c0 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ece496640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c860 con 0x7f0ec8101c00 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56856/0 (socket says 172.21.15.66:56856) 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec7fff640 1 -- 172.21.15.66:0/3308877040 learned_addr learned my addr 172.21.15.66:0/3308877040 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 0x7f0ec819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ecca33640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec81025c0 0x7f0ec819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 -- 172.21.15.66:0/3308877040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec81025c0 msgr2=0x7f0ec819f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec81025c0 0x7f0ec819f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 -- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 msgr2=0x7f0ec8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 -- 172.21.15.66:0/3308877040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec819fae0 con 0x7f0ec8101c00 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec77fe640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 0x7f0ec819cbb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00d6d0 tx=0x7f0ebc00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.335+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x7f0ec8101c00 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.336+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ebc009820 con 0x7f0ec8101c00 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.336+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc004d00 con 0x7f0ec8101c00 2024-09-15T22:45:24.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.336+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec819fd70 con 0x7f0ec8101c00 2024-09-15T22:45:24.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.336+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec81a0280 con 0x7f0ec8101c00 2024-09-15T22:45:24.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.337+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec8107dd0 con 0x7f0ec8101c00 2024-09-15T22:45:24.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.338+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f0ebc0099d0 con 0x7f0ec8101c00 2024-09-15T22:45:24.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.339+0000 7f0ec57fa640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 0x7f0eb00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.339+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0ebc0cfb30 con 0x7f0ec8101c00 2024-09-15T22:45:24.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.339+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 0x7f0eb00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.339+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 0x7f0eb00a5900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000c00 tx=0x7f0eb80315b0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.343+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ebc09baf0 con 0x7f0ec8101c00 2024-09-15T22:45:24.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.526+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ec8062630 con 0x7f0eb00a3440 2024-09-15T22:45:24.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.535+0000 7f0ec57fa640 1 -- 172.21.15.66:0/3308877040 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339432 (secure 0 0 0) 0x7f0ec8062630 con 0x7f0eb00a3440 2024-09-15T22:45:24.539 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:24.541 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 msgr2=0x7f0eb00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 0x7f0eb00a5900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8000c00 tx=0x7f0eb80315b0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 msgr2=0x7f0ec819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 0x7f0ec819cbb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00d6d0 tx=0x7f0ebc00db90 comp rx=0 tx=0).stop 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 shutdown_connections 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb00a3440 0x7f0eb00a5900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec81025c0 0x7f0ec819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101c00 0x7f0ec819cbb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 --2- 172.21.15.66:0/3308877040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a10 0x7f0ec8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.538+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 >> 172.21.15.66:0/3308877040 conn(0x7f0ec80fc170 msgr2=0x7f0ec8104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.539+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 shutdown_connections 2024-09-15T22:45:24.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.539+0000 7f0ece496640 1 -- 172.21.15.66:0/3308877040 wait complete. 2024-09-15T22:45:24.551 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T22:45:23.527331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192653,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1313,"num_read_kb":825,"num_write":559,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390032,"kb_used_data":15784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124551792,"statfs":{"total":1151940427776,"available":1151541035008,"internally_reserved":0,"allocated":16162816,"data_stored":9610676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991107"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615855+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:21.615855+0000","last_peered":"2024-09-15T22:45:21.615855+0000","last_clean":"2024-09-15T22:45:21.615855+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:21.615855+0000","last_undegraded":"2024-09-15T22:45:21.615855+0000","last_fullsized":"2024-09-15T22:45:21.615855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798711+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798711+0000","last_peered":"2024-09-15T22:45:21.798711+0000","last_clean":"2024-09-15T22:45:21.798711+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798711+0000","last_undegraded":"2024-09-15T22:45:21.798711+0000","last_fullsized":"2024-09-15T22:45:21.798711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894238+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894238+0000","last_peered":"2024-09-15T22:45:21.894238+0000","last_clean":"2024-09-15T22:45:21.894238+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894238+0000","last_undegraded":"2024-09-15T22:45:21.894238+0000","last_fullsized":"2024-09-15T22:45:21.894238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515077+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515077+0000","last_peered":"2024-09-15T22:45:21.515077+0000","last_clean":"2024-09-15T22:45:21.515077+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515077+0000","last_undegraded":"2024-09-15T22:45:21.515077+0000","last_fullsized":"2024-09-15T22:45:21.515077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894468+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894468+0000","last_peered":"2024-09-15T22:45:21.894468+0000","last_clean":"2024-09-15T22:45:21.894468+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894468+0000","last_undegraded":"2024-09-15T22:45:21.894468+0000","last_fullsized":"2024-09-15T22:45:21.894468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515331+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515331+0000","last_peered":"2024-09-15T22:45:21.515331+0000","last_clean":"2024-09-15T22:45:21.515331+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515331+0000","last_undegraded":"2024-09-15T22:45:21.515331+0000","last_fullsized":"2024-09-15T22:45:21.515331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894320+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894320+0000","last_peered":"2024-09-15T22:45:21.894320+0000","last_clean":"2024-09-15T22:45:21.894320+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894320+0000","last_undegraded":"2024-09-15T22:45:21.894320+0000","last_fullsized":"2024-09-15T22:45:21.894320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'51","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.743562+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:21.743562+0000","last_peered":"2024-09-15T22:45:21.743562+0000","last_clean":"2024-09-15T22:45:21.743562+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:21.743562+0000","last_undegraded":"2024-09-15T22:45:21.743562+0000","last_fullsized":"2024-09-15T22:45:21.743562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.966904+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:21.966904+0000","last_peered":"2024-09-15T22:45:21.966904+0000","last_clean":"2024-09-15T22:45:21.966904+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:21.966904+0000","last_undegraded":"2024-09-15T22:45:21.966904+0000","last_fullsized":"2024-09-15T22:45:21.966904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514189+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:21.514189+0000","last_peered":"2024-09-15T22:45:21.514189+0000","last_clean":"2024-09-15T22:45:21.514189+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:21.514189+0000","last_undegraded":"2024-09-15T22:45:21.514189+0000","last_fullsized":"2024-09-15T22:45:21.514189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799041+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:21.799041+0000","last_peered":"2024-09-15T22:45:21.799041+0000","last_clean":"2024-09-15T22:45:21.799041+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:21.799041+0000","last_undegraded":"2024-09-15T22:45:21.799041+0000","last_fullsized":"2024-09-15T22:45:21.799041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.010119+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:22.010119+0000","last_peered":"2024-09-15T22:45:22.010119+0000","last_clean":"2024-09-15T22:45:22.010119+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:22.010119+0000","last_undegraded":"2024-09-15T22:45:22.010119+0000","last_fullsized":"2024-09-15T22:45:22.010119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'41","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.740843+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:21.740843+0000","last_peered":"2024-09-15T22:45:21.740843+0000","last_clean":"2024-09-15T22:45:21.740843+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:21.740843+0000","last_undegraded":"2024-09-15T22:45:21.740843+0000","last_fullsized":"2024-09-15T22:45:21.740843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514674+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514674+0000","last_peered":"2024-09-15T22:45:21.514674+0000","last_clean":"2024-09-15T22:45:21.514674+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514674+0000","last_undegraded":"2024-09-15T22:45:21.514674+0000","last_fullsized":"2024-09-15T22:45:21.514674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894484+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:21.894484+0000","last_peered":"2024-09-15T22:45:21.894484+0000","last_clean":"2024-09-15T22:45:21.894484+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:21.894484+0000","last_undegraded":"2024-09-15T22:45:21.894484+0000","last_fullsized":"2024-09-15T22:45:21.894484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615640+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615640+0000","last_peered":"2024-09-15T22:45:21.615640+0000","last_clean":"2024-09-15T22:45:21.615640+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615640+0000","last_undegraded":"2024-09-15T22:45:21.615640+0000","last_fullsized":"2024-09-15T22:45:21.615640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800520+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800520+0000","last_peered":"2024-09-15T22:45:21.800520+0000","last_clean":"2024-09-15T22:45:21.800520+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800520+0000","last_undegraded":"2024-09-15T22:45:21.800520+0000","last_fullsized":"2024-09-15T22:45:21.800520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515302+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515302+0000","last_peered":"2024-09-15T22:45:21.515302+0000","last_clean":"2024-09-15T22:45:21.515302+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515302+0000","last_undegraded":"2024-09-15T22:45:21.515302+0000","last_fullsized":"2024-09-15T22:45:21.515302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937060+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:21.937060+0000","last_peered":"2024-09-15T22:45:21.937060+0000","last_clean":"2024-09-15T22:45:21.937060+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:21.937060+0000","last_undegraded":"2024-09-15T22:45:21.937060+0000","last_fullsized":"2024-09-15T22:45:21.937060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":178,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":254,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.009144+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:22.009144+0000","last_peered":"2024-09-15T22:45:22.009144+0000","last_clean":"2024-09-15T22:45:22.009144+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:22.009144+0000","last_undegraded":"2024-09-15T22:45:22.009144+0000","last_fullsized":"2024-09-15T22:45:22.009144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515208+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515208+0000","last_peered":"2024-09-15T22:45:21.515208+0000","last_clean":"2024-09-15T22:45:21.515208+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515208+0000","last_undegraded":"2024-09-15T22:45:21.515208+0000","last_fullsized":"2024-09-15T22:45:21.515208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798938+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798938+0000","last_peered":"2024-09-15T22:45:21.798938+0000","last_clean":"2024-09-15T22:45:21.798938+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798938+0000","last_undegraded":"2024-09-15T22:45:21.798938+0000","last_fullsized":"2024-09-15T22:45:21.798938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937102+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:21.937102+0000","last_peered":"2024-09-15T22:45:21.937102+0000","last_clean":"2024-09-15T22:45:21.937102+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:21.937102+0000","last_undegraded":"2024-09-15T22:45:21.937102+0000","last_fullsized":"2024-09-15T22:45:21.937102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616822+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616822+0000","last_peered":"2024-09-15T22:45:21.616822+0000","last_clean":"2024-09-15T22:45:21.616822+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616822+0000","last_undegraded":"2024-09-15T22:45:21.616822+0000","last_fullsized":"2024-09-15T22:45:21.616822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798890+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798890+0000","last_peered":"2024-09-15T22:45:21.798890+0000","last_clean":"2024-09-15T22:45:21.798890+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798890+0000","last_undegraded":"2024-09-15T22:45:21.798890+0000","last_fullsized":"2024-09-15T22:45:21.798890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798871+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798871+0000","last_peered":"2024-09-15T22:45:21.798871+0000","last_clean":"2024-09-15T22:45:21.798871+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798871+0000","last_undegraded":"2024-09-15T22:45:21.798871+0000","last_fullsized":"2024-09-15T22:45:21.798871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616829+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616829+0000","last_peered":"2024-09-15T22:45:21.616829+0000","last_clean":"2024-09-15T22:45:21.616829+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616829+0000","last_undegraded":"2024-09-15T22:45:21.616829+0000","last_fullsized":"2024-09-15T22:45:21.616829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602051,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1177,"num_read_kb":706,"num_write":376,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1806153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612651,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1160788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005109,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234042,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37108,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708044,"statfs":{"total":95995035648,"available":95957037056,"internally_reserved":0,"allocated":1806336,"data_stored":1240800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986254,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1040384,"data_stored":510847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1041258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":570588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1118208,"data_stored":581239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":508229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":202128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:24.557 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-15T22:45:24.557 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 -- 172.21.15.66:0/4095835394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694101c00 msgr2=0x7f0694102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 --2- 172.21.15.66:0/4095835394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694101c00 0x7f0694102080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0684009900 tx=0x7f068402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 -- 172.21.15.66:0/4095835394 shutdown_connections 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 --2- 172.21.15.66:0/4095835394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 --2- 172.21.15.66:0/4095835394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694101c00 0x7f0694102080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 --2- 172.21.15.66:0/4095835394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694100a10 0x7f0694100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 -- 172.21.15.66:0/4095835394 >> 172.21.15.66:0/4095835394 conn(0x7f06940fc170 msgr2=0x7f06940fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 -- 172.21.15.66:0/4095835394 shutdown_connections 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.697+0000 7f069c065640 1 -- 172.21.15.66:0/4095835394 wait complete. 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 Processor -- start 2024-09-15T22:45:24.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 -- start start 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694100a10 0x7f06941049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f069410c6e0 con 0x7f0694101c00 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f069410c560 con 0x7f06941025c0 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069c065640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f069410c860 con 0x7f0694100a10 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f0699600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f0699600640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56876/0 (socket says 172.21.15.66:56876) 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f0699600640 1 -- 172.21.15.66:0/2249069778 learned_addr learned my addr 172.21.15.66:0/2249069778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.698+0000 7f069a602640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699e01640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694100a10 0x7f06941049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 -- 172.21.15.66:0/2249069778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694100a10 msgr2=0x7f06941049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694100a10 0x7f06941049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 -- 172.21.15.66:0/2249069778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 msgr2=0x7f0694103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 -- 172.21.15.66:0/2249069778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694103db0 con 0x7f0694101c00 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f069a602640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f0699600640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0684031440 tx=0x7f0684032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068403f030 con 0x7f0694101c00 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06941a1f30 con 0x7f0694101c00 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0684003ce0 con 0x7f0694101c00 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684035070 con 0x7f0694101c00 2024-09-15T22:45:24.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.699+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941a2390 con 0x7f0694101c00 2024-09-15T22:45:24.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.700+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06941a2620 con 0x7f0694101c00 2024-09-15T22:45:24.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.702+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7f0684042030 con 0x7f0694101c00 2024-09-15T22:45:24.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.702+0000 7f068affd640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 0x7f06800a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:24.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.702+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f06840f0aa0 con 0x7f0694101c00 2024-09-15T22:45:24.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.702+0000 7f0699e01640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 0x7f06800a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:24.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.703+0000 7f0699e01640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 0x7f06800a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0694101a60 tx=0x7f0690005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:24.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.705+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06840bd0b0 con 0x7f0694101c00 2024-09-15T22:45:24.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: [15/Sep/2024:22:45:23] ENGINE Bus STARTING 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: [15/Sep/2024:22:45:23] ENGINE Serving on http://172.21.15.66:8765 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: [15/Sep/2024:22:45:23] ENGINE Serving on https://172.21.15.66:7150 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: [15/Sep/2024:22:45:23] ENGINE Bus STARTED 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: [15/Sep/2024:22:45:23] ENGINE Error in HTTPServer.serve 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout: Traceback (most recent call last): 2024-09-15T22:45:24.850 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: self._run(expiration_interval) 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: s = self.context.wrap_socket( 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: return self.sslsocket_class._create( 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: self.do_handshake() 2024-09-15T22:45:24.851 INFO:journalctl@ceph.mon.b.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout: self._sslobj.do_handshake() 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.852 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.853 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:24 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.882+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06940fe3b0 con 0x7f06800a33c0 2024-09-15T22:45:24.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.891+0000 7f068affd640 1 -- 172.21.15.66:0/2249069778 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339432 (secure 0 0 0) 0x7f06940fe3b0 con 0x7f06800a33c0 2024-09-15T22:45:24.895 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:24.897 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 msgr2=0x7f06800a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 0x7f06800a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0694101a60 tx=0x7f0690005f90 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 msgr2=0x7f0694102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0684031440 tx=0x7f0684032ce0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 shutdown_connections 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f06800a33c0 0x7f06800a5880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06941025c0 0x7f0694103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0694101c00 0x7f0694102fe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 --2- 172.21.15.66:0/2249069778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0694100a10 0x7f06941049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:24.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 >> 172.21.15.66:0/2249069778 conn(0x7f06940fc170 msgr2=0x7f06940fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:24.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 shutdown_connections 2024-09-15T22:45:24.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:24.895+0000 7f069c065640 1 -- 172.21.15.66:0/2249069778 wait complete. 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: [15/Sep/2024:22:45:23] ENGINE Bus STARTING 2024-09-15T22:45:24.907 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: [15/Sep/2024:22:45:23] ENGINE Serving on http://172.21.15.66:8765 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: [15/Sep/2024:22:45:23] ENGINE Serving on https://172.21.15.66:7150 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: [15/Sep/2024:22:45:23] ENGINE Bus STARTED 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: [15/Sep/2024:22:45:23] ENGINE Error in HTTPServer.serve 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: Traceback (most recent call last): 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._run(expiration_interval) 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:45:24.908 INFO:journalctl@ceph.mon.a.smithi066.stdout: s = self.context.wrap_socket( 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: return self.sslsocket_class._create( 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: self.do_handshake() 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: self._sslobj.do_handshake() 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.909 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.910 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.911 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:24 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.911 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T22:45:23.527331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192653,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1313,"num_read_kb":825,"num_write":559,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390032,"kb_used_data":15784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124551792,"statfs":{"total":1151940427776,"available":1151541035008,"internally_reserved":0,"allocated":16162816,"data_stored":9610676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.991107"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615855+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:21.615855+0000","last_peered":"2024-09-15T22:45:21.615855+0000","last_clean":"2024-09-15T22:45:21.615855+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:21.615855+0000","last_undegraded":"2024-09-15T22:45:21.615855+0000","last_fullsized":"2024-09-15T22:45:21.615855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798711+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798711+0000","last_peered":"2024-09-15T22:45:21.798711+0000","last_clean":"2024-09-15T22:45:21.798711+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798711+0000","last_undegraded":"2024-09-15T22:45:21.798711+0000","last_fullsized":"2024-09-15T22:45:21.798711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894238+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894238+0000","last_peered":"2024-09-15T22:45:21.894238+0000","last_clean":"2024-09-15T22:45:21.894238+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894238+0000","last_undegraded":"2024-09-15T22:45:21.894238+0000","last_fullsized":"2024-09-15T22:45:21.894238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515077+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515077+0000","last_peered":"2024-09-15T22:45:21.515077+0000","last_clean":"2024-09-15T22:45:21.515077+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515077+0000","last_undegraded":"2024-09-15T22:45:21.515077+0000","last_fullsized":"2024-09-15T22:45:21.515077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894468+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894468+0000","last_peered":"2024-09-15T22:45:21.894468+0000","last_clean":"2024-09-15T22:45:21.894468+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894468+0000","last_undegraded":"2024-09-15T22:45:21.894468+0000","last_fullsized":"2024-09-15T22:45:21.894468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515331+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515331+0000","last_peered":"2024-09-15T22:45:21.515331+0000","last_clean":"2024-09-15T22:45:21.515331+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515331+0000","last_undegraded":"2024-09-15T22:45:21.515331+0000","last_fullsized":"2024-09-15T22:45:21.515331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894320+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894320+0000","last_peered":"2024-09-15T22:45:21.894320+0000","last_clean":"2024-09-15T22:45:21.894320+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894320+0000","last_undegraded":"2024-09-15T22:45:21.894320+0000","last_fullsized":"2024-09-15T22:45:21.894320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'51","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.743562+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:21.743562+0000","last_peered":"2024-09-15T22:45:21.743562+0000","last_clean":"2024-09-15T22:45:21.743562+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:21.743562+0000","last_undegraded":"2024-09-15T22:45:21.743562+0000","last_fullsized":"2024-09-15T22:45:21.743562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.966904+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:21.966904+0000","last_peered":"2024-09-15T22:45:21.966904+0000","last_clean":"2024-09-15T22:45:21.966904+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:21.966904+0000","last_undegraded":"2024-09-15T22:45:21.966904+0000","last_fullsized":"2024-09-15T22:45:21.966904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514189+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:21.514189+0000","last_peered":"2024-09-15T22:45:21.514189+0000","last_clean":"2024-09-15T22:45:21.514189+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:21.514189+0000","last_undegraded":"2024-09-15T22:45:21.514189+0000","last_fullsized":"2024-09-15T22:45:21.514189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799041+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:21.799041+0000","last_peered":"2024-09-15T22:45:21.799041+0000","last_clean":"2024-09-15T22:45:21.799041+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:21.799041+0000","last_undegraded":"2024-09-15T22:45:21.799041+0000","last_fullsized":"2024-09-15T22:45:21.799041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.010119+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:22.010119+0000","last_peered":"2024-09-15T22:45:22.010119+0000","last_clean":"2024-09-15T22:45:22.010119+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:22.010119+0000","last_undegraded":"2024-09-15T22:45:22.010119+0000","last_fullsized":"2024-09-15T22:45:22.010119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'41","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.740843+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:21.740843+0000","last_peered":"2024-09-15T22:45:21.740843+0000","last_clean":"2024-09-15T22:45:21.740843+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:21.740843+0000","last_undegraded":"2024-09-15T22:45:21.740843+0000","last_fullsized":"2024-09-15T22:45:21.740843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514674+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514674+0000","last_peered":"2024-09-15T22:45:21.514674+0000","last_clean":"2024-09-15T22:45:21.514674+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514674+0000","last_undegraded":"2024-09-15T22:45:21.514674+0000","last_fullsized":"2024-09-15T22:45:21.514674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894484+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:21.894484+0000","last_peered":"2024-09-15T22:45:21.894484+0000","last_clean":"2024-09-15T22:45:21.894484+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:21.894484+0000","last_undegraded":"2024-09-15T22:45:21.894484+0000","last_fullsized":"2024-09-15T22:45:21.894484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615640+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615640+0000","last_peered":"2024-09-15T22:45:21.615640+0000","last_clean":"2024-09-15T22:45:21.615640+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615640+0000","last_undegraded":"2024-09-15T22:45:21.615640+0000","last_fullsized":"2024-09-15T22:45:21.615640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800520+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800520+0000","last_peered":"2024-09-15T22:45:21.800520+0000","last_clean":"2024-09-15T22:45:21.800520+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800520+0000","last_undegraded":"2024-09-15T22:45:21.800520+0000","last_fullsized":"2024-09-15T22:45:21.800520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515302+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515302+0000","last_peered":"2024-09-15T22:45:21.515302+0000","last_clean":"2024-09-15T22:45:21.515302+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515302+0000","last_undegraded":"2024-09-15T22:45:21.515302+0000","last_fullsized":"2024-09-15T22:45:21.515302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937060+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:21.937060+0000","last_peered":"2024-09-15T22:45:21.937060+0000","last_clean":"2024-09-15T22:45:21.937060+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:21.937060+0000","last_undegraded":"2024-09-15T22:45:21.937060+0000","last_fullsized":"2024-09-15T22:45:21.937060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":178,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":254,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:22.009144+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:22.009144+0000","last_peered":"2024-09-15T22:45:22.009144+0000","last_clean":"2024-09-15T22:45:22.009144+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:22.009144+0000","last_undegraded":"2024-09-15T22:45:22.009144+0000","last_fullsized":"2024-09-15T22:45:22.009144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515208+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515208+0000","last_peered":"2024-09-15T22:45:21.515208+0000","last_clean":"2024-09-15T22:45:21.515208+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515208+0000","last_undegraded":"2024-09-15T22:45:21.515208+0000","last_fullsized":"2024-09-15T22:45:21.515208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798938+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798938+0000","last_peered":"2024-09-15T22:45:21.798938+0000","last_clean":"2024-09-15T22:45:21.798938+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798938+0000","last_undegraded":"2024-09-15T22:45:21.798938+0000","last_fullsized":"2024-09-15T22:45:21.798938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.937102+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:21.937102+0000","last_peered":"2024-09-15T22:45:21.937102+0000","last_clean":"2024-09-15T22:45:21.937102+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:21.937102+0000","last_undegraded":"2024-09-15T22:45:21.937102+0000","last_fullsized":"2024-09-15T22:45:21.937102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616822+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616822+0000","last_peered":"2024-09-15T22:45:21.616822+0000","last_clean":"2024-09-15T22:45:21.616822+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616822+0000","last_undegraded":"2024-09-15T22:45:21.616822+0000","last_fullsized":"2024-09-15T22:45:21.616822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798890+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798890+0000","last_peered":"2024-09-15T22:45:21.798890+0000","last_clean":"2024-09-15T22:45:21.798890+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798890+0000","last_undegraded":"2024-09-15T22:45:21.798890+0000","last_fullsized":"2024-09-15T22:45:21.798890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798871+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798871+0000","last_peered":"2024-09-15T22:45:21.798871+0000","last_clean":"2024-09-15T22:45:21.798871+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798871+0000","last_undegraded":"2024-09-15T22:45:21.798871+0000","last_fullsized":"2024-09-15T22:45:21.798871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616829+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616829+0000","last_peered":"2024-09-15T22:45:21.616829+0000","last_clean":"2024-09-15T22:45:21.616829+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616829+0000","last_undegraded":"2024-09-15T22:45:21.616829+0000","last_fullsized":"2024-09-15T22:45:21.616829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602051,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1177,"num_read_kb":706,"num_write":376,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1806153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612651,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841583,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1160788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005109,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234042,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855433,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37108,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708044,"statfs":{"total":95995035648,"available":95957037056,"internally_reserved":0,"allocated":1806336,"data_stored":1240800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986254,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1040384,"data_stored":510847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1041258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":570588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1118208,"data_stored":581239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1056768,"data_stored":508229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":202128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:24.916 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:24.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-15T22:45:24.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: [15/Sep/2024:22:45:23] ENGINE Bus STARTING 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: [15/Sep/2024:22:45:23] ENGINE Serving on http://172.21.15.66:8765 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: [15/Sep/2024:22:45:23] ENGINE Serving on https://172.21.15.66:7150 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: [15/Sep/2024:22:45:23] ENGINE Bus STARTED 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: [15/Sep/2024:22:45:23] ENGINE Error in HTTPServer.serve 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: Traceback (most recent call last): 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._run(expiration_interval) 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:45:24.923 INFO:journalctl@ceph.mon.c.smithi184.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: s = self.context.wrap_socket( 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: return self.sslsocket_class._create( 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: self.do_handshake() 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: self._sslobj.do_handshake() 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:24.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:24 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.214 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:25.610 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.611 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-15T22:45:25.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:25 smithi066 ceph-mon[31185]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:45:25.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 -- 172.21.15.66:0/2568104001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc102790 msgr2=0x7fcafc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 --2- 172.21.15.66:0/2568104001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc102790 0x7fcafc1067e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009900 tx=0x7fcaec02a410 comp rx=0 tx=0).stop 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 -- 172.21.15.66:0/2568104001 shutdown_connections 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 --2- 172.21.15.66:0/2568104001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc106f10 0x7fcafc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 --2- 172.21.15.66:0/2568104001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc102790 0x7fcafc1067e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 --2- 172.21.15.66:0/2568104001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 -- 172.21.15.66:0/2568104001 >> 172.21.15.66:0/2568104001 conn(0x7fcafc0fd8c0 msgr2=0x7fcafc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 -- 172.21.15.66:0/2568104001 shutdown_connections 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.695+0000 7fcb03af3640 1 -- 172.21.15.66:0/2568104001 wait complete. 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 Processor -- start 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 -- start start 2024-09-15T22:45:25.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 0x7fcafc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc111f70 con 0x7fcafc106f10 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc111df0 con 0x7fcafc102790 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb03af3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1120f0 con 0x7fcafc101de0 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.696+0000 7fcb0188f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb0188f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:42554/0 (socket says 172.21.15.66:42554) 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb0188f640 1 -- 172.21.15.66:0/3872568522 learned_addr learned my addr 172.21.15.66:0/3872568522 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56894/0 (socket says 172.21.15.66:56894) 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb0108e640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 0x7fcafc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 -- 172.21.15.66:0/3872568522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 msgr2=0x7fcafc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 -- 172.21.15.66:0/3872568522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 msgr2=0x7fcafc1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 0x7fcafc1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 -- 172.21.15.66:0/3872568522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc19d440 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb0108e640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 0x7fcafc1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb0188f640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb02090640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400ec50 tx=0x7fcaf400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4003b70 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf4003d10 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc19d730 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.697+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4010890 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.698+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc1a5010 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.699+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc1032c0 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.700+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 23) ==== 138475+0+0 (secure 0 0 0) 0x7fcaf4003fc0 con 0x7fcafc106f10 2024-09-15T22:45:25.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.701+0000 7fcaf2ffd640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 0x7fcae80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:25.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.701+0000 7fcb0188f640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 0x7fcae80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:25.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.701+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fcaf40d0610 con 0x7fcafc106f10 2024-09-15T22:45:25.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.702+0000 7fcb0188f640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 0x7fcae80a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005fd0 tx=0x7fcaf800b4a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:25.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.706+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcaf409cc00 con 0x7fcafc106f10 2024-09-15T22:45:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:45:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:45:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-15T22:45:25.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:25 smithi087 ceph-mon[35290]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:45:25.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:45:25.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:45:25.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-15T22:45:25.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:25 smithi184 ceph-mon[35203]: Updating smithi184:/etc/ceph/ceph.conf 2024-09-15T22:45:25.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.923+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcafc1021c0 con 0x7fcafc106f10 2024-09-15T22:45:25.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.924+0000 7fcaf2ffd640 1 -- 172.21.15.66:0/3872568522 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fcafc1021c0 con 0x7fcafc106f10 2024-09-15T22:45:25.926 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:25.926 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:45:25.926 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:45:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 msgr2=0x7fcae80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 0x7fcae80a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005fd0 tx=0x7fcaf800b4a0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 msgr2=0x7fcafc19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400ec50 tx=0x7fcaf400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 shutdown_connections 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae80a3430 0x7fcae80a58f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcafc106f10 0x7fcafc19cd60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc102790 0x7fcafc1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 --2- 172.21.15.66:0/3872568522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcafc101de0 0x7fcafc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 >> 172.21.15.66:0/3872568522 conn(0x7fcafc0fd8c0 msgr2=0x7fcafc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 shutdown_connections 2024-09-15T22:45:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:25.927+0000 7fcb03af3640 1 -- 172.21.15.66:0/3872568522 wait complete. 2024-09-15T22:45:26.671 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:45:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3872568522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:26.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:26 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3872568522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:26.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:26 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.927 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3872568522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: Updating smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:45:26.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:26.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:26 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- 172.21.15.66:0/2694602321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238102ef0 msgr2=0x7fa23810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 --2- 172.21.15.66:0/2694602321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238102ef0 0x7fa23810da40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa230009be0 tx=0x7fa23002a750 comp rx=0 tx=0).stop 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- 172.21.15.66:0/2694602321 shutdown_connections 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 --2- 172.21.15.66:0/2694602321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238102ef0 0x7fa23810da40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 --2- 172.21.15.66:0/2694602321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102570 0x7fa2381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 --2- 172.21.15.66:0/2694602321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238100e20 0x7fa238101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- 172.21.15.66:0/2694602321 >> 172.21.15.66:0/2694602321 conn(0x7fa2380fc7d0 msgr2=0x7fa2380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- 172.21.15.66:0/2694602321 shutdown_connections 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- 172.21.15.66:0/2694602321 wait complete. 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 Processor -- start 2024-09-15T22:45:27.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.382+0000 7fa23f28f640 1 -- start start 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238102570 0x7fa238199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102ef0 0x7fa2381a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa238110f30 con 0x7fa238100e20 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa238110db0 con 0x7fa238102570 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2381110b0 con 0x7fa238102ef0 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56918/0 (socket says 172.21.15.66:56918) 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 -- 172.21.15.66:0/3082667058 learned_addr learned my addr 172.21.15.66:0/3082667058 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23c82a640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238102570 0x7fa238199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d82c640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102ef0 0x7fa2381a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 -- 172.21.15.66:0/3082667058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102ef0 msgr2=0x7fa2381a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102ef0 0x7fa2381a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 -- 172.21.15.66:0/3082667058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238102570 msgr2=0x7fa238199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238102570 0x7fa238199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 -- 172.21.15.66:0/3082667058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2381a48c0 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23d02b640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e9c0 tx=0x7fa23400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400ccc0 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.383+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2381a4a90 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.384+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa234005500 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.384+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234010430 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.384+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2381a4fd0 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.385+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa238101200 con 0x7fa238100e20 2024-09-15T22:45:27.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.386+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fa2340046c0 con 0x7fa238100e20 2024-09-15T22:45:27.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.387+0000 7fa22e7fc640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 0x7fa2240a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:27.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.387+0000 7fa23c82a640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 0x7fa2240a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:27.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.387+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa2340d04f0 con 0x7fa238100e20 2024-09-15T22:45:27.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.387+0000 7fa23c82a640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 0x7fa2240a5980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa23806aac0 tx=0x7fa228005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:27.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.391+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa23409c990 con 0x7fa238100e20 2024-09-15T22:45:27.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.572+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa238109090 con 0x7fa238100e20 2024-09-15T22:45:27.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.574+0000 7fa22e7fc640 1 -- 172.21.15.66:0/3082667058 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25320 (secure 0 0 0) 0x7fa23409c290 con 0x7fa238100e20 2024-09-15T22:45:27.576 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:27.576 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":90,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:45:21.507926+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3471066820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2430511108":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3162528820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1080608797":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3964165811":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1080608797":"2024-09-16T22:45:21.507897+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:27.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 msgr2=0x7fa2240a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 0x7fa2240a5980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa23806aac0 tx=0x7fa228005f90 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 msgr2=0x7fa238199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e9c0 tx=0x7fa23400ee80 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 shutdown_connections 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2240a34c0 0x7fa2240a5980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa238102ef0 0x7fa2381a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa238102570 0x7fa238199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 --2- 172.21.15.66:0/3082667058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238100e20 0x7fa238199300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 >> 172.21.15.66:0/3082667058 conn(0x7fa2380fc7d0 msgr2=0x7fa2381068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 shutdown_connections 2024-09-15T22:45:27.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:27.577+0000 7fa23f28f640 1 -- 172.21.15.66:0/3082667058 wait complete. 2024-09-15T22:45:28.191 DEBUG:tasks.fwd_scrub:Yielding 2024-09-15T22:45:28.191 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:45:28.201 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:45:28.202 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T22:45:28.202 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-15T22:45:28.203 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-15T22:45:28.203 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:45:28.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 -- 172.21.15.66:0/1974017402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 msgr2=0x7fc77c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 --2- 172.21.15.66:0/1974017402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c10bb40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009900 tx=0x7fc76c02a480 comp rx=0 tx=0).stop 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 -- 172.21.15.66:0/1974017402 shutdown_connections 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 --2- 172.21.15.66:0/1974017402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c10c110 0x7fc77c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 --2- 172.21.15.66:0/1974017402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c10bb40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 --2- 172.21.15.66:0/1974017402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c102d40 0x7fc77c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 -- 172.21.15.66:0/1974017402 >> 172.21.15.66:0/1974017402 conn(0x7fc77c077990 msgr2=0x7fc77c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 -- 172.21.15.66:0/1974017402 shutdown_connections 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.312+0000 7fc7835e8640 1 -- 172.21.15.66:0/1974017402 wait complete. 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 Processor -- start 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 -- start start 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c102d40 0x7fc77c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 0x7fc77c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c111f00 con 0x7fc77c103660 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c111d80 con 0x7fc77c102d40 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc7835e8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c112080 con 0x7fc77c10c110 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc780b83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc780b83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56940/0 (socket says 172.21.15.66:56940) 2024-09-15T22:45:28.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.313+0000 7fc780b83640 1 -- 172.21.15.66:0/3843988146 learned_addr learned my addr 172.21.15.66:0/3843988146 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc781384640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c102d40 0x7fc77c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc781b85640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 0x7fc77c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 -- 172.21.15.66:0/3843988146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 msgr2=0x7fc77c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 0x7fc77c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 -- 172.21.15.66:0/3843988146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c102d40 msgr2=0x7fc77c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c102d40 0x7fc77c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 -- 172.21.15.66:0/3843988146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c1a6830 con 0x7fc77c103660 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc781b85640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 0x7fc77c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc780b83640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc76c004770 tx=0x7fc76c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c03f070 con 0x7fc77c103660 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c1a6ac0 con 0x7fc77c103660 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc76c031ca0 con 0x7fc77c103660 2024-09-15T22:45:28.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c035030 con 0x7fc77c103660 2024-09-15T22:45:28.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.314+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c1a6fb0 con 0x7fc77c103660 2024-09-15T22:45:28.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.315+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c103120 con 0x7fc77c103660 2024-09-15T22:45:28.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.317+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fc76c042070 con 0x7fc77c103660 2024-09-15T22:45:28.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.318+0000 7fc7727fc640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 0x7fc7680a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.318+0000 7fc781384640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 0x7fc7680a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.318+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc76c0f1060 con 0x7fc77c103660 2024-09-15T22:45:28.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.318+0000 7fc781384640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 0x7fc7680a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc778005fd0 tx=0x7fc778005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.324+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc76c0bd500 con 0x7fc77c103660 2024-09-15T22:45:28.477 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:28.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.528+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fc77c1a7250 con 0x7fc77c103660 2024-09-15T22:45:28.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.532+0000 7fc7727fc640 1 -- 172.21.15.66:0/3843988146 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7fc76c0bce00 con 0x7fc77c103660 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 msgr2=0x7fc7680a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 0x7fc7680a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc778005fd0 tx=0x7fc778005850 comp rx=0 tx=0).stop 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 msgr2=0x7fc77c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc76c004770 tx=0x7fc76c003c10 comp rx=0 tx=0).stop 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 shutdown_connections 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.534+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc7680a3500 0x7fc7680a59c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc77c10c110 0x7fc77c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc77c103660 0x7fc77c100ed0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 --2- 172.21.15.66:0/3843988146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc77c102d40 0x7fc77c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 >> 172.21.15.66:0/3843988146 conn(0x7fc77c077990 msgr2=0x7fc77c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 shutdown_connections 2024-09-15T22:45:28.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.535+0000 7fc7835e8640 1 -- 172.21.15.66:0/3843988146 wait complete. 2024-09-15T22:45:28.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-15T22:45:28.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- 172.21.15.66:0/2386377618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01009b0 msgr2=0x7f8bf0100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/2386377618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01009b0 0x7f8bf0100e10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009930 tx=0x7f8be402a420 comp rx=0 tx=0).stop 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- 172.21.15.66:0/2386377618 shutdown_connections 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/2386377618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf0101350 0x7f8bf010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/2386377618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01009b0 0x7f8bf0100e10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/2386377618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf01069c0 0x7f8bf0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- 172.21.15.66:0/2386377618 >> 172.21.15.66:0/2386377618 conn(0x7f8bf0077990 msgr2=0x7f8bf00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- 172.21.15.66:0/2386377618 shutdown_connections 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- 172.21.15.66:0/2386377618 wait complete. 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 Processor -- start 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.657+0000 7f8bf80ba640 1 -- start start 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf01009b0 0x7f8bf010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf0101350 0x7f8bf010e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111eb0 con 0x7f8bf01069c0 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111d30 con 0x7f8bf0101350 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf80ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0112030 con 0x7f8bf01009b0 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56954/0 (socket says 172.21.15.66:56954) 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 -- 172.21.15.66:0/1419679879 learned_addr learned my addr 172.21.15.66:0/1419679879 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf5655640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf0101350 0x7f8bf010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf5e56640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf01009b0 0x7f8bf010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 -- 172.21.15.66:0/1419679879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf01009b0 msgr2=0x7f8bf010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf01009b0 0x7f8bf010e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 -- 172.21.15.66:0/1419679879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf0101350 msgr2=0x7f8bf010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf0101350 0x7f8bf010e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 -- 172.21.15.66:0/1419679879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a6880 con 0x7f8bf01069c0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.658+0000 7f8bf6657640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d950 tx=0x7f8be800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.659+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8017030 con 0x7f8bf01069c0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.659+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be8004020 con 0x7f8bf01069c0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.659+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8003c00 con 0x7f8bf01069c0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.659+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a6b70 con 0x7f8bf01069c0 2024-09-15T22:45:28.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.659+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a7040 con 0x7f8bf01069c0 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.660+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0100e10 con 0x7f8bf01069c0 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.661+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f8be801a070 con 0x7f8bf01069c0 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.662+0000 7f8beeffd640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 0x7f8bd80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.662+0000 7f8bf5e56640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 0x7f8bd80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.662+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f8be80cfab0 con 0x7f8bf01069c0 2024-09-15T22:45:28.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.662+0000 7f8bf5e56640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 0x7f8bd80a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8be0005fd0 tx=0x7f8be0009680 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.666+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8be8021070 con 0x7f8bf01069c0 2024-09-15T22:45:28.752 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-15T22:45:28.752 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3082667058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.752 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3843988146' entity='client.admin' 2024-09-15T22:45:28.752 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.752 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:28.753 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:28.753 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:28 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:28.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.844+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f8bf01a7330 con 0x7f8bf01069c0 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3082667058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3843988146' entity='client.admin' 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:28 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:28.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.848+0000 7f8beeffd640 1 -- 172.21.15.66:0/1419679879 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f8be809bf50 con 0x7f8bf01069c0 2024-09-15T22:45:28.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 msgr2=0x7f8bd80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 0x7f8bd80a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8be0005fd0 tx=0x7f8be0009680 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 msgr2=0x7f8bf010ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d950 tx=0x7f8be800de10 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 shutdown_connections 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8bd80a3500 0x7f8bd80a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bf01069c0 0x7f8bf010ed90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8bf0101350 0x7f8bf010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 --2- 172.21.15.66:0/1419679879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf01009b0 0x7f8bf010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 >> 172.21.15.66:0/1419679879 conn(0x7f8bf0077990 msgr2=0x7f8bf0103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 shutdown_connections 2024-09-15T22:45:28.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.851+0000 7f8bf80ba640 1 -- 172.21.15.66:0/1419679879 wait complete. 2024-09-15T22:45:28.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-15T22:45:28.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3082667058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3843988146' entity='client.admin' 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:28 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:28.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 -- 172.21.15.66:0/2469368403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1069e0 msgr2=0x7f60ac106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/2469368403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1069e0 0x7f60ac106dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009930 tx=0x7f60a002a420 comp rx=0 tx=0).stop 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 -- 172.21.15.66:0/2469368403 shutdown_connections 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/2469368403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac101370 0x7f60ac10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/2469368403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac1009d0 0x7f60ac100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/2469368403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1069e0 0x7f60ac106dc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 -- 172.21.15.66:0/2469368403 >> 172.21.15.66:0/2469368403 conn(0x7f60ac0fc6b0 msgr2=0x7f60ac0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 -- 172.21.15.66:0/2469368403 shutdown_connections 2024-09-15T22:45:28.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.985+0000 7f60b2d8d640 1 -- 172.21.15.66:0/2469368403 wait complete. 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 Processor -- start 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 -- start start 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac101370 0x7f60ac1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 0x7f60ac19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac110e20 con 0x7f60ac1009d0 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac110ca0 con 0x7f60ac101370 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b2d8d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac110fa0 con 0x7f60ac1069e0 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b0b29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b0b29640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57002/0 (socket says 172.21.15.66:57002) 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b0b29640 1 -- 172.21.15.66:0/453111399 learned_addr learned my addr 172.21.15.66:0/453111399 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.986+0000 7f60b132a640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 0x7f60ac19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60abfff640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac101370 0x7f60ac1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 -- 172.21.15.66:0/453111399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 msgr2=0x7f60ac19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 0x7f60ac19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 -- 172.21.15.66:0/453111399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac101370 msgr2=0x7f60ac1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac101370 0x7f60ac1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 -- 172.21.15.66:0/453111399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac19d350 con 0x7f60ac1009d0 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b132a640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 0x7f60ac19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b0b29640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009230 tx=0x7f60a0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a003f030 con 0x7f60ac1009d0 2024-09-15T22:45:28.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60a0004440 con 0x7f60ac1009d0 2024-09-15T22:45:28.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac19d5e0 con 0x7f60ac1009d0 2024-09-15T22:45:28.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0035070 con 0x7f60ac1009d0 2024-09-15T22:45:28.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.987+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac1a4ed0 con 0x7f60ac1009d0 2024-09-15T22:45:28.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.988+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac100e30 con 0x7f60ac1009d0 2024-09-15T22:45:28.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.990+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f60a0042030 con 0x7f60ac1009d0 2024-09-15T22:45:28.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.991+0000 7f60a9ffb640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 0x7f609c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:28.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.991+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f60a00f0950 con 0x7f60ac1009d0 2024-09-15T22:45:28.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.991+0000 7f60abfff640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 0x7f609c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:28.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.992+0000 7f60abfff640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 0x7f609c0a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60ac105090 tx=0x7f6098005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:28.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.998+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60a00bc7a0 con 0x7f60ac1009d0 2024-09-15T22:45:29.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 -- 172.21.15.66:0/221793603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c103740 msgr2=0x7f1a3c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 --2- 172.21.15.66:0/221793603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c103740 0x7f1a3c107b80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009890 tx=0x7f1a3802a380 comp rx=0 tx=0).stop 2024-09-15T22:45:29.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 -- 172.21.15.66:0/221793603 shutdown_connections 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 --2- 172.21.15.66:0/221793603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 0x7f1a3c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 --2- 172.21.15.66:0/221793603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c103740 0x7f1a3c107b80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 --2- 172.21.15.66:0/221793603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c102d90 0x7f1a3c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 -- 172.21.15.66:0/221793603 >> 172.21.15.66:0/221793603 conn(0x7f1a3c0fc7d0 msgr2=0x7f1a3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 -- 172.21.15.66:0/221793603 shutdown_connections 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.964+0000 7f1a434d2640 1 -- 172.21.15.66:0/221793603 wait complete. 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.965+0000 7f1a434d2640 1 Processor -- start 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.965+0000 7f1a434d2640 1 -- start start 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c103740 0x7f1a3c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 0x7f1a3c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c112090 con 0x7f1a3c102d90 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c111f10 con 0x7f1a3c103740 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a434d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c112210 con 0x7f1a3c108290 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56964/0 (socket says 172.21.15.66:56964) 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 -- 172.21.15.66:0/595148856 learned_addr learned my addr 172.21.15.66:0/595148856 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c103740 0x7f1a3c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 0x7f1a3c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 -- 172.21.15.66:0/595148856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 msgr2=0x7f1a3c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 0x7f1a3c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 -- 172.21.15.66:0/595148856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c103740 msgr2=0x7f1a3c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c103740 0x7f1a3c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 -- 172.21.15.66:0/595148856 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c19d530 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a4126e640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000ea60 tx=0x7f1a3000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.966+0000 7f1a2e7fc640 1 -- 172.21.15.66:0/595148856 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000cde0 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.967+0000 7f1a2e7fc640 1 -- 172.21.15.66:0/595148856 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a300035f0 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.967+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c19d820 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.967+0000 7f1a2e7fc640 1 -- 172.21.15.66:0/595148856 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30010670 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.967+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c1a5100 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.969+0000 7f1a2e7fc640 1 -- 172.21.15.66:0/595148856 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f1a300037a0 con 0x7f1a3c102d90 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 Processor -- start 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 -- start start 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90ea40 0x55e9fe90ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90f360 0x55e9fe91dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe874280 con 0x55e9fe91e150 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe81bb10 con 0x55e9fe90f360 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a458ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe870240 con 0x55e9fe90ea40 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56978/0 (socket says 172.21.15.66:56978) 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a40a6d640 1 -- 172.21.15.66:0/3500627597 learned_addr learned my addr 172.21.15.66:0/3500627597 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a4126e640 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90f360 0x55e9fe91dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.970+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90ea40 0x55e9fe90ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a2e7fc640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 0x7f1a280a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 -- 172.21.15.66:0/3500627597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90ea40 msgr2=0x55e9fe90ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90ea40 0x55e9fe90ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 -- 172.21.15.66:0/3500627597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90f360 msgr2=0x55e9fe91dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90f360 0x55e9fe91dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 -- 172.21.15.66:0/3500627597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fe8281f0 con 0x55e9fe91e150 2024-09-15T22:45:29.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 0x7f1a280a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009860 tx=0x7f1a38009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cc96cd2c4f2333 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a2e7fc640 1 -- 172.21.15.66:0/595148856 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f1a300d05c0 con 0x7f1a3c102d90 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a277fe640 1 -- 172.21.15.66:0/3500627597 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38037040 con 0x55e9fe91e150 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a277fe640 1 -- 172.21.15.66:0/3500627597 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38030e50 con 0x55e9fe91e150 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.971+0000 7f1a277fe640 1 -- 172.21.15.66:0/3500627597 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380039e0 con 0x55e9fe91e150 2024-09-15T22:45:29.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 -- 172.21.15.66:0/3500627597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 msgr2=0x55e9fe920540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 0x7f1a280a5980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009590 tx=0x7f1a34004a40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009860 tx=0x7f1a38009510 comp rx=0 tx=0).stop 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 -- 172.21.15.66:0/3500627597 shutdown_connections 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe920540 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90f360 0x55e9fe91dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3500627597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90ea40 0x55e9fe90ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 -- 172.21.15.66:0/3500627597 >> 172.21.15.66:0/3500627597 conn(0x55e9fe90b0f0 msgr2=0x55e9fe90b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 -- 172.21.15.66:0/3500627597 shutdown_connections 2024-09-15T22:45:29.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.972+0000 7f1a458ab740 1 -- 172.21.15.66:0/3500627597 wait complete. 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.973+0000 7f1a458ab740 1 -- start start 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.973+0000 7f1a458ab740 1 Processor -- start 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.973+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe91b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.973+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90f360 0x55e9fe91b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a458ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe920d20 con 0x55e9fe91e150 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a458ab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe82ef10 con 0x55e9fe90ea40 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a458ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e9fe920ea0 con 0x55e9fe90f360 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56982/0 (socket says 172.21.15.66:56982) 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90f360 0x55e9fe91b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 -- 172.21.15.66:0/3875776970 learned_addr learned my addr 172.21.15.66:0/3875776970 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a4126e640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe91b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a458ab740 10 client.0 _ll_register_callbacks cb 0x55e9fe7f7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 -- 172.21.15.66:0/3875776970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90f360 msgr2=0x55e9fe91b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90f360 0x55e9fe91b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 -- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 msgr2=0x55e9fe91b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe91b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 -- 172.21.15.66:0/3875776970 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9fe5e56a0 con 0x55e9fe91e150 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a34004610 tx=0x7f1a34010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bd43a4645426ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.974+0000 7f1a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004640 con 0x55e9fe91e150 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f1a340047e0 con 0x55e9fe91e150 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a38030e50 con 0x55e9fe91e150 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a340193f0 con 0x55e9fe91e150 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 10 client.15456 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:29.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9fe92ca40 con 0x55e9fe91e150 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38030e50 con 0x55e9fe91e150 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1a3400b040 con 0x55e9fe91e150 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 10 client.15456 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.975+0000 7f1a458ab740 20 client.15456 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe9303a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a458ab740 4 client.15456 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9fe8817f0 con 0x55e9fe92df00 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a4126e640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe9303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a24ff9640 10 client.15456 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.976+0000 7f1a4126e640 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe9303a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08b6c14209ee02f server_cookie=c9fb2e4aeb4f225a in_seq=0 out_seq=0 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a24ff9640 1 -- 172.21.15.66:0/3875776970 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9fe8817f0 con 0x55e9fe92df00 2024-09-15T22:45:29.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a24ff9640 10 client.15456 handle_command_reply: tid=0 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 client.15456 shutdown 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 msgr2=0x55e9fe91bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a34004610 tx=0x7f1a34010040 comp rx=0 tx=0).stop 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 shutdown_connections 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe91e150 0x55e9fe91bb20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe90f360 0x55e9fe91b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe9303a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a24ff9640 0 client.15456 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 --2- 172.21.15.66:0/3875776970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe91b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 >> 172.21.15.66:0/3875776970 conn(0x55e9fe90b0f0 msgr2=0x55e9fe910e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 shutdown_connections 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 1 -- 172.21.15.66:0/3875776970 wait complete. 2024-09-15T22:45:29.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:28.977+0000 7f1a458ab740 20 client.15456 trim_cache size 0 max 16384 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 Processor -- start 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 -- start start 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe935cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe918300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1acff0 con 0x55e9fe90f360 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1aeb30 con 0x55e9fe90ea40 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a458ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1ad6c0 con 0x55e9fe91e150 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.001+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57014/0 (socket says 172.21.15.66:57014) 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 -- 172.21.15.66:0/1801437707 learned_addr learned my addr 172.21.15.66:0/1801437707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a4126e640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe935cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe918300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 -- 172.21.15.66:0/1801437707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 msgr2=0x55e9fe918300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe918300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 -- 172.21.15.66:0/1801437707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 msgr2=0x55e9fe935cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe935cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 -- 172.21.15.66:0/1801437707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fe90f190 con 0x55e9fe90f360 2024-09-15T22:45:29.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a4126e640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe935cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005d90 tx=0x7f1a38000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50d0fb844d55fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a26ffd640 1 -- 172.21.15.66:0/1801437707 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38037030 con 0x55e9fe90f360 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a26ffd640 1 -- 172.21.15.66:0/1801437707 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38030e50 con 0x55e9fe90f360 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.002+0000 7f1a26ffd640 1 -- 172.21.15.66:0/1801437707 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380053f0 con 0x55e9fe90f360 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 -- 172.21.15.66:0/1801437707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 msgr2=0x55e9fe936200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005d90 tx=0x7f1a38000bc0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 -- 172.21.15.66:0/1801437707 shutdown_connections 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe918300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe936200 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 --2- 172.21.15.66:0/1801437707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe935cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 -- 172.21.15.66:0/1801437707 >> 172.21.15.66:0/1801437707 conn(0x55e9fe90b0f0 msgr2=0x55e9fe91d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 -- 172.21.15.66:0/1801437707 shutdown_connections 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.003+0000 7f1a458ab740 1 -- 172.21.15.66:0/1801437707 wait complete. 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 -- start start 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 Processor -- start 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe922730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe991cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1ae460 con 0x55e9fe90f360 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1add90 con 0x55e9fe90ea40 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1aafd0 con 0x55e9fe91e150 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a458ab740 10 client.0 _ll_register_callbacks cb 0x7f1a34003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a40a6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57028/0 (socket says 172.21.15.66:57028) 2024-09-15T22:45:29.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a40a6d640 1 -- 172.21.15.66:0/2578763565 learned_addr learned my addr 172.21.15.66:0/2578763565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.004+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe991cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a4126e640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe922730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 -- 172.21.15.66:0/2578763565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 msgr2=0x55e9fe991cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe991cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 -- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 msgr2=0x55e9fe922730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe922730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 -- 172.21.15.66:0/2578763565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9fe992340 con 0x55e9fe90f360 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a4126e640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe922730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a41a6f640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe991cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a40a6d640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1a3802a8a0 tx=0x7f1a380308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b2ef3eb427c6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38037040 con 0x55e9fe90f360 2024-09-15T22:45:29.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a38030e50 con 0x55e9fe90f360 2024-09-15T22:45:29.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f1a38004260 con 0x55e9fe90f360 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a3805b050 con 0x55e9fe90f360 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a458ab740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.005+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9fe9996e0 con 0x55e9fe90f360 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38030e50 con 0x55e9fe90f360 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1a38004bf0 con 0x55e9fe90f360 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:45:29.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 20 client.15468 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe99b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 4 client.15468 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e9fe87bd00 con 0x55e9fe92df00 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.006+0000 7f1a4126e640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe99b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.007+0000 7f1a4126e640 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe99b970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593968272ae5b40a server_cookie=acd63a6415d0cb62 in_seq=0 out_seq=0 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.007+0000 7f1a24ff9640 10 client.15468 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.007+0000 7f1a24ff9640 1 -- 172.21.15.66:0/2578763565 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e9fe87bd00 con 0x55e9fe92df00 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.007+0000 7f1a24ff9640 10 client.15468 handle_command_reply: tid=0 2024-09-15T22:45:29.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.007+0000 7f1a458ab740 1 client.15468 shutdown 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 msgr2=0x55e9fe922c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1a3802a8a0 tx=0x7f1a380308e0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 shutdown_connections 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fe91e150 0x55e9fe991cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fe90f360 0x55e9fe922c70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e9fe92df00 0x55e9fe99b970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 --2- 172.21.15.66:0/2578763565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fe90ea40 0x55e9fe922730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a24ff9640 0 client.15468 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 >> 172.21.15.66:0/2578763565 conn(0x55e9fe90b0f0 msgr2=0x55e9fe91b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 shutdown_connections 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 1 -- 172.21.15.66:0/2578763565 wait complete. 2024-09-15T22:45:29.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.008+0000 7f1a458ab740 20 client.15468 trim_cache size 0 max 16384 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "c90a966e-a2e6-4633-8a67-67b44a49dfa8", 2024-09-15T22:45:29.027 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 msgr2=0x7f1a280a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 0x7f1a280a5980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009590 tx=0x7f1a34004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 msgr2=0x7f1a3c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000ea60 tx=0x7f1a3000ef20 comp rx=0 tx=0).stop 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 shutdown_connections 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1a280a34c0 0x7f1a280a5980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a3c108290 0x7f1a3c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3c103740 0x7f1a3c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 --2- 172.21.15.66:0/595148856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a3c102d90 0x7f1a3c198580 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 >> 172.21.15.66:0/595148856 conn(0x7f1a3c0fc7d0 msgr2=0x7f1a3c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 shutdown_connections 2024-09-15T22:45:29.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.009+0000 7f1a434d2640 1 -- 172.21.15.66:0/595148856 wait complete. 2024-09-15T22:45:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.180+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f60ac109f50 con 0x7f60ac1009d0 2024-09-15T22:45:29.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.184+0000 7f60a9ffb640 1 -- 172.21.15.66:0/453111399 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f60a00c0aa0 con 0x7f60ac1009d0 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 msgr2=0x7f609c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 0x7f609c0a59c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60ac105090 tx=0x7f6098005f90 comp rx=0 tx=0).stop 2024-09-15T22:45:29.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 msgr2=0x7f60ac198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009230 tx=0x7f60a0004040 comp rx=0 tx=0).stop 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 shutdown_connections 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f609c0a3500 0x7f609c0a59c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60ac1069e0 0x7f60ac19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac101370 0x7f60ac1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 --2- 172.21.15.66:0/453111399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ac1009d0 0x7f60ac198360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 >> 172.21.15.66:0/453111399 conn(0x7f60ac0fc6b0 msgr2=0x7f60ac06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 shutdown_connections 2024-09-15T22:45:29.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.186+0000 7f60b2d8d640 1 -- 172.21.15.66:0/453111399 wait complete. 2024-09-15T22:45:29.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 -- 172.21.15.66:0/1423045596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41067e0 msgr2=0x7f00f4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1423045596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41067e0 0x7f00f4106bc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009cd0 tx=0x7f00e402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 -- 172.21.15.66:0/1423045596 shutdown_connections 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1423045596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1423045596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41007d0 0x7f00f4100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1423045596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41067e0 0x7f00f4106bc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 -- 172.21.15.66:0/1423045596 >> 172.21.15.66:0/1423045596 conn(0x7f00f40777c0 msgr2=0x7f00f40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 -- 172.21.15.66:0/1423045596 shutdown_connections 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.307+0000 7f00fb19d640 1 -- 172.21.15.66:0/1423045596 wait complete. 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 Processor -- start 2024-09-15T22:45:29.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 -- start start 2024-09-15T22:45:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f4197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 0x7f00f419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4110c20 con 0x7f00f41007d0 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4110aa0 con 0x7f00f4101170 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fb19d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4110da0 con 0x7f00f41067e0 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57046/0 (socket says 172.21.15.66:57046) 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 -- 172.21.15.66:0/1138533890 learned_addr learned my addr 172.21.15.66:0/1138533890 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa99c640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 0x7f00f419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00f999a640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f4197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 -- 172.21.15.66:0/1138533890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 msgr2=0x7f00f419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 0x7f00f419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 -- 172.21.15.66:0/1138533890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 msgr2=0x7f00f4197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f4197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa19b640 1 -- 172.21.15.66:0/1138533890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f419c0e0 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00f999a640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f4197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.308+0000 7f00fa99c640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 0x7f00f419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00fa19b640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f00e402ae00 tx=0x7f00e4031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4003e00 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00e4004520 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f419c370 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4030de0 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.309+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f41a3c60 con 0x7f00f41007d0 2024-09-15T22:45:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.310+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f4100c30 con 0x7f00f41007d0 2024-09-15T22:45:29.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.311+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f00e40046d0 con 0x7f00f41007d0 2024-09-15T22:45:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.312+0000 7f00f37fe640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 0x7f00dc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.312+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f00e402e030 con 0x7f00f41007d0 2024-09-15T22:45:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.312+0000 7f00f999a640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 0x7f00dc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.312+0000 7f00f999a640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 0x7f00dc0a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00f4105820 tx=0x7f00e8005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.315+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00e404b060 con 0x7f00f41007d0 2024-09-15T22:45:29.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.513+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f00f4062630 con 0x7f00dc0a3440 2024-09-15T22:45:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.581+0000 7f00f37fe640 1 -- 172.21.15.66:0/1138533890 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f00f4062630 con 0x7f00dc0a3440 2024-09-15T22:45:29.583 INFO:teuthology.orchestra.run.smithi066.stdout:Schedule set for path / 2024-09-15T22:45:29.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 msgr2=0x7f00dc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 0x7f00dc0a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00f4105820 tx=0x7f00e8005f90 comp rx=0 tx=0).stop 2024-09-15T22:45:29.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 msgr2=0x7f00f41970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f00e402ae00 tx=0x7f00e4031e60 comp rx=0 tx=0).stop 2024-09-15T22:45:29.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 shutdown_connections 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00dc0a3440 0x7f00dc0a5900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f41067e0 0x7f00f419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00f4101170 0x7f00f4197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 --2- 172.21.15.66:0/1138533890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f41007d0 0x7f00f41970f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 >> 172.21.15.66:0/1138533890 conn(0x7f00f40777c0 msgr2=0x7f00f40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 shutdown_connections 2024-09-15T22:45:29.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.584+0000 7f00fb19d640 1 -- 172.21.15.66:0/1138533890 wait complete. 2024-09-15T22:45:29.596 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-15T22:45:29.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 -- 172.21.15.66:0/1711525966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608102cc0 msgr2=0x7fb6081030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 --2- 172.21.15.66:0/1711525966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608102cc0 0x7fb6081030a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009900 tx=0x7fb5f802a480 comp rx=0 tx=0).stop 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 -- 172.21.15.66:0/1711525966 shutdown_connections 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 --2- 172.21.15.66:0/1711525966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60810c110 0x7fb60810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 --2- 172.21.15.66:0/1711525966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb60810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 --2- 172.21.15.66:0/1711525966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608102cc0 0x7fb6081030a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 -- 172.21.15.66:0/1711525966 >> 172.21.15.66:0/1711525966 conn(0x7fb6080fc6b0 msgr2=0x7fb6080fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 -- 172.21.15.66:0/1711525966 shutdown_connections 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.704+0000 7fb60d759640 1 -- 172.21.15.66:0/1711525966 wait complete. 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 Processor -- start 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 -- start start 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 0x7fb608198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb608198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb608111ef0 con 0x7fb60810c110 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb608111d70 con 0x7fb6081035e0 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb60d759640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb608112070 con 0x7fb608102cc0 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57064/0 (socket says 172.21.15.66:57064) 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb6077fe640 1 -- 172.21.15.66:0/1005904635 learned_addr learned my addr 172.21.15.66:0/1005904635 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb606ffd640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 0x7fb608198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.705+0000 7fb6067fc640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb608198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 -- 172.21.15.66:0/1005904635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 msgr2=0x7fb608198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 0x7fb608198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 -- 172.21.15.66:0/1005904635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 msgr2=0x7fb608198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb608198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 -- 172.21.15.66:0/1005904635 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60819d340 con 0x7fb60810c110 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6067fc640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb608198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb606ffd640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 0x7fb608198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb6077fe640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb60000eaa0 tx=0x7fb60000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60000cdb0 con 0x7fb60810c110 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60819d630 con 0x7fb60810c110 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb600005020 con 0x7fb60810c110 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6000116d0 con 0x7fb60810c110 2024-09-15T22:45:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.706+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a4ec0 con 0x7fb60810c110 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.707+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6081030a0 con 0x7fb60810c110 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.708+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fb6000054d0 con 0x7fb60810c110 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.709+0000 7fb5effff640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 0x7fb5f00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.709+0000 7fb606ffd640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 0x7fb5f00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.709+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb6000d0850 con 0x7fb60810c110 2024-09-15T22:45:29.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.710+0000 7fb606ffd640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 0x7fb5f00a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000c00 tx=0x7fb5f8032c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:29.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.712+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb600016030 con 0x7fb60810c110 2024-09-15T22:45:29.833 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:45:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.912+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fb6080fe440 con 0x7fb5f00a3500 2024-09-15T22:45:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.973+0000 7fb5effff640 1 -- 172.21.15.66:0/1005904635 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fb6080fe440 con 0x7fb5f00a3500 2024-09-15T22:45:29.975 INFO:teuthology.orchestra.run.smithi066.stdout:Retention added to path / 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 msgr2=0x7fb5f00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 0x7fb5f00a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000c00 tx=0x7fb5f8032c70 comp rx=0 tx=0).stop 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 msgr2=0x7fb60819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb60000eaa0 tx=0x7fb60000ef60 comp rx=0 tx=0).stop 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 shutdown_connections 2024-09-15T22:45:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5f00a3500 0x7fb5f00a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb60810c110 0x7fb60819cc10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6081035e0 0x7fb608198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 --2- 172.21.15.66:0/1005904635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb608102cc0 0x7fb608198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 >> 172.21.15.66:0/1005904635 conn(0x7fb6080fc6b0 msgr2=0x7fb6080fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 shutdown_connections 2024-09-15T22:45:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:29.976+0000 7fb60d759640 1 -- 172.21.15.66:0/1005904635 wait complete. 2024-09-15T22:45:29.988 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 -- 172.21.15.66:0/2692265284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9934102ca0 msgr2=0x7f9934103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2692265284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9934102ca0 0x7f9934103080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9924009900 tx=0x7f992402a410 comp rx=0 tx=0).stop 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 -- 172.21.15.66:0/2692265284 shutdown_connections 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2692265284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 0x7f993410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2692265284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99341035c0 0x7f993410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2692265284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9934102ca0 0x7f9934103080 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 -- 172.21.15.66:0/2692265284 >> 172.21.15.66:0/2692265284 conn(0x7f99340fc6b0 msgr2=0x7f99340fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 -- 172.21.15.66:0/2692265284 shutdown_connections 2024-09-15T22:45:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.098+0000 7f993a4b7640 1 -- 172.21.15.66:0/2692265284 wait complete. 2024-09-15T22:45:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.099+0000 7f993a4b7640 1 Processor -- start 2024-09-15T22:45:30.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.099+0000 7f993a4b7640 1 -- start start 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9934102ca0 0x7f9934198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 0x7f993419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9934111ed0 con 0x7f99341035c0 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9934111d50 con 0x7f993410c0d0 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f993a4b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9934112050 con 0x7f9934102ca0 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57078/0 (socket says 172.21.15.66:57078) 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 -- 172.21.15.66:0/2280810998 learned_addr learned my addr 172.21.15.66:0/2280810998 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f9933fff640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9934102ca0 0x7f9934198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f9938a54640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 0x7f993419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 -- 172.21.15.66:0/2280810998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9934102ca0 msgr2=0x7f9934198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9934102ca0 0x7f9934198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 -- 172.21.15.66:0/2280810998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 msgr2=0x7f993419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 0x7f993419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 -- 172.21.15.66:0/2280810998 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993419d320 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.100+0000 7f99337fe640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f992800e9c0 tx=0x7f992800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.101+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992800cd80 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.101+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993419d610 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.101+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99280035f0 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.101+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928010690 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.101+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341a4ea0 con 0x7f99341035c0 2024-09-15T22:45:30.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.102+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9934103080 con 0x7f99341035c0 2024-09-15T22:45:30.105 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.103+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f99280037a0 con 0x7f99341035c0 2024-09-15T22:45:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.104+0000 7f99317fa640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 0x7f991c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.104+0000 7f9933fff640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 0x7f991c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.104+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f99280d0640 con 0x7f99341035c0 2024-09-15T22:45:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.105+0000 7f9933fff640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 0x7f991c0a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9924009230 tx=0x7f99240058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.108+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f992809ca80 con 0x7f99341035c0 2024-09-15T22:45:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1419679879' entity='client.admin' 2024-09-15T22:45:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/453111399' entity='client.admin' 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1419679879' entity='client.admin' 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/453111399' entity='client.admin' 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.308+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9934062630 con 0x7f991c0a3500 2024-09-15T22:45:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.316+0000 7f99317fa640 1 -- 172.21.15.66:0/2280810998 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f9934062630 con 0x7f991c0a3500 2024-09-15T22:45:30.317 INFO:teuthology.orchestra.run.smithi066.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T22:45:29", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-15T22:45:30.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 msgr2=0x7f991c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 0x7f991c0a59c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9924009230 tx=0x7f99240058d0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 msgr2=0x7f9934198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f992800e9c0 tx=0x7f992800ee80 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 shutdown_connections 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f991c0a3500 0x7f991c0a59c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f993410c0d0 0x7f993419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99341035c0 0x7f9934198870 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 --2- 172.21.15.66:0/2280810998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9934102ca0 0x7f9934198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.318+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 >> 172.21.15.66:0/2280810998 conn(0x7f99340fc6b0 msgr2=0x7f99340fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.319+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 shutdown_connections 2024-09-15T22:45:30.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.319+0000 7f993a4b7640 1 -- 172.21.15.66:0/2280810998 wait complete. 2024-09-15T22:45:30.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1419679879' entity='client.admin' 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/453111399' entity='client.admin' 2024-09-15T22:45:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:45:30.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:45:30.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:45:30.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 -- 172.21.15.66:0/961767438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde2010c0d0 msgr2=0x7fde2010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 --2- 172.21.15.66:0/961767438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde2010c0d0 0x7fde2010e570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fde18009ca0 tx=0x7fde1802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 -- 172.21.15.66:0/961767438 shutdown_connections 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 --2- 172.21.15.66:0/961767438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde2010c0d0 0x7fde2010e570 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 --2- 172.21.15.66:0/961767438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde201035c0 0x7fde2010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 --2- 172.21.15.66:0/961767438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102ca0 0x7fde20103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 -- 172.21.15.66:0/961767438 >> 172.21.15.66:0/961767438 conn(0x7fde200fc6b0 msgr2=0x7fde200fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 -- 172.21.15.66:0/961767438 shutdown_connections 2024-09-15T22:45:30.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.440+0000 7fde258f1640 1 -- 172.21.15.66:0/961767438 wait complete. 2024-09-15T22:45:30.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 Processor -- start 2024-09-15T22:45:30.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 -- start start 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102ca0 0x7fde2019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2010c0d0 0x7fde2019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde20111e90 con 0x7fde201035c0 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde20111d10 con 0x7fde2010c0d0 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde258f1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde20112010 con 0x7fde20102ca0 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde1e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde1e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57098/0 (socket says 172.21.15.66:57098) 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde1e7fc640 1 -- 172.21.15.66:0/190385245 learned_addr learned my addr 172.21.15.66:0/190385245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.441+0000 7fde1f7fe640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2010c0d0 0x7fde2019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 -- 172.21.15.66:0/190385245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102ca0 msgr2=0x7fde2019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102ca0 0x7fde2019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 -- 172.21.15.66:0/190385245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2010c0d0 msgr2=0x7fde2019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2010c0d0 0x7fde2019edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 -- 172.21.15.66:0/190385245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2019f500 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde1e7fc640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e9c0 tx=0x7fde1400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400cd80 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde140035f0 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2019f7f0 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14010690 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.442+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201a7080 con 0x7fde201035c0 2024-09-15T22:45:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.443+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde20103080 con 0x7fde201035c0 2024-09-15T22:45:30.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.444+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fde140037a0 con 0x7fde201035c0 2024-09-15T22:45:30.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.445+0000 7fde248ef640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 0x7fde080a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.445+0000 7fde1effd640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 0x7fde080a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.445+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fde140d0690 con 0x7fde201035c0 2024-09-15T22:45:30.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.446+0000 7fde1effd640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 0x7fde080a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fde100058c0 tx=0x7fde10005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.450+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde1409cb30 con 0x7fde201035c0 2024-09-15T22:45:30.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- 172.21.15.66:0/3165935432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102ef0 msgr2=0x7f476010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 --2- 172.21.15.66:0/3165935432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102ef0 0x7f476010da40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4758009ca0 tx=0x7f475802a950 comp rx=0 tx=0).stop 2024-09-15T22:45:30.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- 172.21.15.66:0/3165935432 shutdown_connections 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 --2- 172.21.15.66:0/3165935432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102ef0 0x7f476010da40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 --2- 172.21.15.66:0/3165935432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102570 0x7f47601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 --2- 172.21.15.66:0/3165935432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 0x7f4760101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- 172.21.15.66:0/3165935432 >> 172.21.15.66:0/3165935432 conn(0x7f47600fc7d0 msgr2=0x7f47600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- 172.21.15.66:0/3165935432 shutdown_connections 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- 172.21.15.66:0/3165935432 wait complete. 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 Processor -- start 2024-09-15T22:45:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.536+0000 7f4766293640 1 -- start start 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 0x7f4760198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102ef0 0x7f476019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4760110f80 con 0x7f4760102570 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4760110e00 con 0x7f4760102ef0 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4766293640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4760111100 con 0x7f4760100e20 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57116/0 (socket says 172.21.15.66:57116) 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 -- 172.21.15.66:0/118855828 learned_addr learned my addr 172.21.15.66:0/118855828 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475ffff640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 0x7f4760198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f4764830640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102ef0 0x7f476019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 -- 172.21.15.66:0/118855828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 msgr2=0x7f4760198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 0x7f4760198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 -- 172.21.15.66:0/118855828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102ef0 msgr2=0x7f476019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102ef0 0x7f476019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.537+0000 7f475f7fe640 1 -- 172.21.15.66:0/118855828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476019d4b0 con 0x7f4760102570 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f475f7fe640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f475400e9f0 tx=0x7f475400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f475d7fa640 1 -- 172.21.15.66:0/118855828 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475400cd80 con 0x7f4760102570 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f475d7fa640 1 -- 172.21.15.66:0/118855828 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4754010910 con 0x7f4760102570 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f475d7fa640 1 -- 172.21.15.66:0/118855828 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754018990 con 0x7f4760102570 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476019d7a0 con 0x7f4760102570 2024-09-15T22:45:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.538+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601a5080 con 0x7f4760102570 2024-09-15T22:45:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f475d7fa640 1 -- 172.21.15.66:0/118855828 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f4754010ac0 con 0x7f4760102570 2024-09-15T22:45:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 Processor -- start 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 -- start start 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72759140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7275ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a726b42e0 con 0x559a7274e4a0 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559a7265bce0 con 0x559a7274edc0 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f476866c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a726b02a0 con 0x559a72759680 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f4764830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f4764830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57122/0 (socket says 172.21.15.66:57122) 2024-09-15T22:45:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.541+0000 7f4764830640 1 -- 172.21.15.66:0/2907014317 learned_addr learned my addr 172.21.15.66:0/2907014317 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f475ffff640 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72759140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f475f7fe640 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7275ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 -- 172.21.15.66:0/2907014317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 msgr2=0x559a7275ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7275ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 -- 172.21.15.66:0/2907014317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 msgr2=0x559a72759140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72759140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 -- 172.21.15.66:0/2907014317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a72640440 con 0x559a7274e4a0 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f475d7fa640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 0x7f47480a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f4764830640 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4758035000 tx=0x7f4758005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ab70a70c345806 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f475ffff640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 0x7f47480a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f475d7fa640 1 -- 172.21.15.66:0/118855828 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f47540d05a0 con 0x7f4760102570 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.542+0000 7f47467fc640 1 -- 172.21.15.66:0/2907014317 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758048070 con 0x559a7274e4a0 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f47467fc640 1 -- 172.21.15.66:0/2907014317 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475802f930 con 0x559a7274e4a0 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f47467fc640 1 -- 172.21.15.66:0/2907014317 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758034040 con 0x559a7274e4a0 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 -- 172.21.15.66:0/2907014317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 msgr2=0x559a7274e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4758035000 tx=0x7f4758005fa0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f475ffff640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 0x7f47480a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x559a7274b890 tx=0x7f475000b390 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 -- 172.21.15.66:0/2907014317 shutdown_connections 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7275ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72759140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 --2- 172.21.15.66:0/2907014317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7274e880 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 -- 172.21.15.66:0/2907014317 >> 172.21.15.66:0/2907014317 conn(0x559a7274aa30 msgr2=0x559a7274ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.543+0000 7f476866c740 1 -- 172.21.15.66:0/2907014317 shutdown_connections 2024-09-15T22:45:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 -- 172.21.15.66:0/2907014317 wait complete. 2024-09-15T22:45:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 -- start start 2024-09-15T22:45:30.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 Processor -- start 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274e4a0 0x559a72759090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72756340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.544+0000 7f476866c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f476866c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a7275c250 con 0x559a72759680 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f476866c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559a7266f050 con 0x559a7274edc0 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f476866c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a7275c3d0 con 0x559a7274e4a0 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f476866c740 10 client.0 _ll_register_callbacks cb 0x559a726af160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f475ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274e4a0 0x559a72759090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57138/0 (socket says 172.21.15.66:57138) 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 -- 172.21.15.66:0/1987011531 learned_addr learned my addr 172.21.15.66:0/1987011531 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f475f7fe640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72756340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 -- 172.21.15.66:0/1987011531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274e4a0 msgr2=0x559a72759090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274e4a0 0x559a72759090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 -- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 msgr2=0x559a72756340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72756340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 -- 172.21.15.66:0/1987011531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a724253c0 con 0x559a72759680 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f4764830640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f475802a990 tx=0x7f475802fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd720b021e9c45bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f473f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.545+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758048030 con 0x559a72759680 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4758040050 con 0x559a72759680 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475802f930 con 0x559a72759680 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4758034040 con 0x559a72759680 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a72767ce0 con 0x559a72759680 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475802f930 con 0x559a72759680 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f475804e460 con 0x559a72759680 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 20 client.15504 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a72769030 0x559a7276b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 4 client.15504 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.546+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a726c1850 con 0x559a72769030 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.547+0000 7f475ffff640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a72769030 0x559a7276b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.547+0000 7f473f7fe640 10 client.15504 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.547+0000 7f475ffff640 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a72769030 0x559a7276b420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e83573ee79dcc58 server_cookie=f3c6119bd247b748 in_seq=0 out_seq=0 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f473f7fe640 1 -- 172.21.15.66:0/1987011531 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a726c1850 con 0x559a72769030 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f473f7fe640 10 client.15504 handle_command_reply: tid=0 2024-09-15T22:45:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 client.15504 shutdown 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 msgr2=0x559a72756950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f475802a990 tx=0x7f475802fd10 comp rx=0 tx=0).stop 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 shutdown_connections 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a72759680 0x559a72756950 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a72769030 0x559a7276b420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a72756340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 --2- 172.21.15.66:0/1987011531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274e4a0 0x559a72759090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 >> 172.21.15.66:0/1987011531 conn(0x559a7274aa30 msgr2=0x559a72749b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f473f7fe640 0 client.15504 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 shutdown_connections 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.548+0000 7f476866c740 1 -- 172.21.15.66:0/1987011531 wait complete. 2024-09-15T22:45:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.549+0000 7f476866c740 20 client.15504 trim_cache size 0 max 16384 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.565+0000 7f476866c740 1 Processor -- start 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 -- start start 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 0x559a72754c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 0x559a7276e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47601af0b0 con 0x559a7274e4a0 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47601b0bf0 con 0x559a72759680 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f476866c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47601af780 con 0x559a7274edc0 2024-09-15T22:45:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57146/0 (socket says 172.21.15.66:57146) 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 0x559a7276e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475ffff640 1 -- 172.21.15.66:0/1663962062 learned_addr learned my addr 172.21.15.66:0/1663962062 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475f7fe640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 0x559a72754c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 -- 172.21.15.66:0/1663962062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 msgr2=0x559a72754c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 0x559a72754c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 -- 172.21.15.66:0/1663962062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 msgr2=0x559a72765630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f4764830640 1 -- 172.21.15.66:0/1663962062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7275c130 con 0x559a72759680 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475f7fe640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 0x559a72754c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.566+0000 7f475ffff640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f4764830640 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 0x559a7276e440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4758030040 tx=0x7f4758005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6472dbf9d236b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f4745ffb640 1 -- 172.21.15.66:0/1663962062 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758048070 con 0x559a72759680 2024-09-15T22:45:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f4745ffb640 1 -- 172.21.15.66:0/1663962062 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475804ee50 con 0x559a72759680 2024-09-15T22:45:30.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f4745ffb640 1 -- 172.21.15.66:0/1663962062 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475804eaa0 con 0x559a72759680 2024-09-15T22:45:30.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f476866c740 1 -- 172.21.15.66:0/1663962062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 msgr2=0x559a7276e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.567+0000 7f476866c740 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 0x559a7276e440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4758030040 tx=0x7f4758005bd0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- 172.21.15.66:0/1663962062 shutdown_connections 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a72759680 0x559a7276e440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a7274edc0 0x559a72754c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- 172.21.15.66:0/1663962062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a72765630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- 172.21.15.66:0/1663962062 >> 172.21.15.66:0/1663962062 conn(0x559a7274aa30 msgr2=0x559a72751900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- 172.21.15.66:0/1663962062 shutdown_connections 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- 172.21.15.66:0/1663962062 wait complete. 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- start start 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 Processor -- start 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a7276c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7276cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47601b0520 con 0x559a7274e4a0 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47601afe50 con 0x559a7274edc0 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.568+0000 7f476866c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47601ad090 con 0x559a72759680 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f476866c740 10 client.0 _ll_register_callbacks cb 0x7f4758046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57148/0 (socket says 172.21.15.66:57148) 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 -- 172.21.15.66:0/3529909120 learned_addr learned my addr 172.21.15.66:0/3529909120 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475f7fe640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a7276c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 -- 172.21.15.66:0/3529909120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 msgr2=0x559a7276cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7276cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 -- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 msgr2=0x559a7276c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a7276c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 -- 172.21.15.66:0/3529909120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a7274e2d0 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f475ffff640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4750003f50 tx=0x7f4750016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687c8a27eeb41afc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f473f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475001e9e0 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f475001eb80 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.569+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475804ee50 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f475001ed80 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a727d3d60 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475804ee50 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4750033620 con 0x559a7274e4a0 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 20 client.15510 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a727d44e0 0x559a727d6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 4 client.15510 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a726bbd60 con 0x559a727d44e0 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.570+0000 7f475f7fe640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a727d44e0 0x559a727d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f475f7fe640 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a727d44e0 0x559a727d6980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66bb94072efa10a5 server_cookie=59624f79a517c98d in_seq=0 out_seq=0 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f473f7fe640 10 client.15510 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f473f7fe640 1 -- 172.21.15.66:0/3529909120 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559a726bbd60 con 0x559a727d44e0 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f473f7fe640 10 client.15510 handle_command_reply: tid=0 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 client.15510 shutdown 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 msgr2=0x559a7276c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4750003f50 tx=0x7f4750016000 comp rx=0 tx=0).stop 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 shutdown_connections 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a72759680 0x559a7276cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a727d44e0 0x559a727d6980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a7274edc0 0x559a7276c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 --2- 172.21.15.66:0/3529909120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a7274e4a0 0x559a7276c440 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 >> 172.21.15.66:0/3529909120 conn(0x559a7274aa30 msgr2=0x559a72749350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f473f7fe640 0 client.15510 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 shutdown_connections 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 1 -- 172.21.15.66:0/3529909120 wait complete. 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.571+0000 7f476866c740 20 client.15510 trim_cache size 0 max 16384 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:45:30.577 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: "c90a966e-a2e6-4633-8a67-67b44a49dfa8": { 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "c90a966e-a2e6-4633-8a67-67b44a49dfa8", 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:45:30.578 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 msgr2=0x7f47480a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 0x7f47480a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x559a7274b890 tx=0x7f475000b390 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 msgr2=0x7f4760198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f475400e9f0 tx=0x7f475400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 shutdown_connections 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47480a3440 0x7f47480a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4760102ef0 0x7f476019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4760102570 0x7f4760198a40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 --2- 172.21.15.66:0/118855828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4760100e20 0x7f4760198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 >> 172.21.15.66:0/118855828 conn(0x7f47600fc7d0 msgr2=0x7f476006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 shutdown_connections 2024-09-15T22:45:30.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.572+0000 7f4766293640 1 -- 172.21.15.66:0/118855828 wait complete. 2024-09-15T22:45:30.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.683+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fde200fe9d0 con 0x7fde080a3580 2024-09-15T22:45:30.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.690+0000 7fde248ef640 1 -- 172.21.15.66:0/190385245 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fde200fe9d0 con 0x7fde080a3580 2024-09-15T22:45:30.691 INFO:teuthology.orchestra.run.smithi066.stdout:/ 1m 6m3h 2024-09-15T22:45:30.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 msgr2=0x7fde080a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 0x7fde080a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fde100058c0 tx=0x7fde10005850 comp rx=0 tx=0).stop 2024-09-15T22:45:30.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 msgr2=0x7fde2019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:30.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e9c0 tx=0x7fde1400ee80 comp rx=0 tx=0).stop 2024-09-15T22:45:30.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 shutdown_connections 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde080a3580 0x7fde080a5a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2010c0d0 0x7fde2019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde201035c0 0x7fde2019aa50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 --2- 172.21.15.66:0/190385245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde20102ca0 0x7fde2019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 >> 172.21.15.66:0/190385245 conn(0x7fde200fc6b0 msgr2=0x7fde200fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 shutdown_connections 2024-09-15T22:45:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:30.692+0000 7fde258f1640 1 -- 172.21.15.66:0/190385245 wait complete. 2024-09-15T22:45:30.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-15T22:45:30.733 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-15T22:45:30.746 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-15T22:45:30.770 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:45:30.771 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:45:31.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:45:31.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:45:31.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-15T22:45:31.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:30 smithi184 ceph-mon[35203]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-15T22:45:31.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:30 smithi066 ceph-mon[31185]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.253 INFO:tasks.cephfs.filesystem:scrub status for tag:c90a966e-a2e6-4633-8a67-67b44a49dfa8 - {'path': '/', 'tag': 'c90a966e-a2e6-4633-8a67-67b44a49dfa8', 'options': 'recursive,force'} 2024-09-15T22:45:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:45:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:45:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:45:31.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-15T22:45:31.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:30 smithi087 ceph-mon[35290]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:31.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 -- 172.21.15.66:0/731418980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c101420 msgr2=0x7f3e4c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 --2- 172.21.15.66:0/731418980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c101420 0x7f3e4c10d950 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009cd0 tx=0x7f3e4402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 -- 172.21.15.66:0/731418980 shutdown_connections 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 --2- 172.21.15.66:0/731418980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c101420 0x7f3e4c10d950 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 --2- 172.21.15.66:0/731418980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 0x7f3e4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 --2- 172.21.15.66:0/731418980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c106a80 0x7f3e4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 -- 172.21.15.66:0/731418980 >> 172.21.15.66:0/731418980 conn(0x7f3e4c0fc7a0 msgr2=0x7f3e4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 -- 172.21.15.66:0/731418980 shutdown_connections 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.842+0000 7f3e51079640 1 -- 172.21.15.66:0/731418980 wait complete. 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.843+0000 7f3e51079640 1 Processor -- start 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.843+0000 7f3e51079640 1 -- start start 2024-09-15T22:45:31.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 0x7f3e4c1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c101420 0x7f3e4c102f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c110e80 con 0x7f3e4c106a80 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c110d00 con 0x7f3e4c101420 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e51079640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c111000 con 0x7f3e4c100a80 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57170/0 (socket says 172.21.15.66:57170) 2024-09-15T22:45:31.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 -- 172.21.15.66:0/2791497195 learned_addr learned my addr 172.21.15.66:0/2791497195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4ad9d640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 0x7f3e4c1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4a59c640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c101420 0x7f3e4c102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 -- 172.21.15.66:0/2791497195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 msgr2=0x7f3e4c1029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 0x7f3e4c1029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 -- 172.21.15.66:0/2791497195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c101420 msgr2=0x7f3e4c102f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c101420 0x7f3e4c102f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 -- 172.21.15.66:0/2791497195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c1a6930 con 0x7f3e4c106a80 2024-09-15T22:45:31.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.844+0000 7f3e4b59e640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005cc0 tx=0x7f3e44003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.845+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44004040 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.845+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e440046c0 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.845+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c1a6bc0 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.845+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44046480 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.845+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c1a7150 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.846+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c100ee0 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.847+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f3e440305a0 con 0x7f3e4c106a80 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.847+0000 7f3e33fff640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 0x7f3e340a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.848+0000 7f3e4ad9d640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 0x7f3e340a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:31.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.848+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3e4402e030 con 0x7f3e4c106a80 2024-09-15T22:45:31.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.848+0000 7f3e4ad9d640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 0x7f3e340a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00bb60 tx=0x7f3e3c00b390 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:31.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:31.852+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e4404b060 con 0x7f3e4c106a80 2024-09-15T22:45:32.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.029+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e4c06a790 con 0x7f3e340a34c0 2024-09-15T22:45:32.030 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:31 smithi066 ceph-mon[31185]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.030 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:31 smithi066 ceph-mon[31185]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.038+0000 7f3e33fff640 1 -- 172.21.15.66:0/2791497195 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339438 (secure 0 0 0) 0x7f3e4c06a790 con 0x7f3e340a34c0 2024-09-15T22:45:32.042 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:32.043 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:32.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 msgr2=0x7f3e340a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 0x7f3e340a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00bb60 tx=0x7f3e3c00b390 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 msgr2=0x7f3e4c103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005cc0 tx=0x7f3e44003970 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 shutdown_connections 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e340a34c0 0x7f3e340a5980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e4c106a80 0x7f3e4c103440 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c101420 0x7f3e4c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 --2- 172.21.15.66:0/2791497195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e4c100a80 0x7f3e4c1029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 >> 172.21.15.66:0/2791497195 conn(0x7f3e4c0fc7a0 msgr2=0x7f3e4c104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 shutdown_connections 2024-09-15T22:45:32.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:32.041+0000 7f3e51079640 1 -- 172.21.15.66:0/2791497195 wait complete. 2024-09-15T22:45:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:31 smithi184 ceph-mon[35203]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:31 smithi184 ceph-mon[35203]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:31 smithi087 ceph-mon[35290]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:31 smithi087 ceph-mon[35290]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:45:32.775 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-15T22:45:31.528971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192653,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1464,"num_read_kb":1061,"num_write":579,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":952,"ondisk_log_size":952,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390232,"kb_used_data":15992,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124551592,"statfs":{"total":1151940427776,"available":1151540830208,"internally_reserved":0,"allocated":16375808,"data_stored":9802169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":236,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.992746"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.971367+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:25.971367+0000","last_peered":"2024-09-15T22:45:25.971367+0000","last_clean":"2024-09-15T22:45:25.971367+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:25.971367+0000","last_undegraded":"2024-09-15T22:45:25.971367+0000","last_fullsized":"2024-09-15T22:45:25.971367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798762+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798762+0000","last_peered":"2024-09-15T22:45:21.798762+0000","last_clean":"2024-09-15T22:45:21.798762+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798762+0000","last_undegraded":"2024-09-15T22:45:21.798762+0000","last_fullsized":"2024-09-15T22:45:21.798762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894294+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894294+0000","last_peered":"2024-09-15T22:45:21.894294+0000","last_clean":"2024-09-15T22:45:21.894294+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894294+0000","last_undegraded":"2024-09-15T22:45:21.894294+0000","last_fullsized":"2024-09-15T22:45:21.894294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515131+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515131+0000","last_peered":"2024-09-15T22:45:21.515131+0000","last_clean":"2024-09-15T22:45:21.515131+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515131+0000","last_undegraded":"2024-09-15T22:45:21.515131+0000","last_fullsized":"2024-09-15T22:45:21.515131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894468+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894468+0000","last_peered":"2024-09-15T22:45:21.894468+0000","last_clean":"2024-09-15T22:45:21.894468+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894468+0000","last_undegraded":"2024-09-15T22:45:21.894468+0000","last_fullsized":"2024-09-15T22:45:21.894468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515373+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515373+0000","last_peered":"2024-09-15T22:45:21.515373+0000","last_clean":"2024-09-15T22:45:21.515373+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515373+0000","last_undegraded":"2024-09-15T22:45:21.515373+0000","last_fullsized":"2024-09-15T22:45:21.515373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894320+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894320+0000","last_peered":"2024-09-15T22:45:21.894320+0000","last_clean":"2024-09-15T22:45:21.894320+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894320+0000","last_undegraded":"2024-09-15T22:45:21.894320+0000","last_fullsized":"2024-09-15T22:45:21.894320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'51","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.743562+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:21.743562+0000","last_peered":"2024-09-15T22:45:21.743562+0000","last_clean":"2024-09-15T22:45:21.743562+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:21.743562+0000","last_undegraded":"2024-09-15T22:45:21.743562+0000","last_fullsized":"2024-09-15T22:45:21.743562+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.971794+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:25.971794+0000","last_peered":"2024-09-15T22:45:25.971794+0000","last_clean":"2024-09-15T22:45:25.971794+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:25.971794+0000","last_undegraded":"2024-09-15T22:45:25.971794+0000","last_fullsized":"2024-09-15T22:45:25.971794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.977499+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:25.977499+0000","last_peered":"2024-09-15T22:45:25.977499+0000","last_clean":"2024-09-15T22:45:25.977499+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:25.977499+0000","last_undegraded":"2024-09-15T22:45:25.977499+0000","last_fullsized":"2024-09-15T22:45:25.977499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":405,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:23.625355+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:23.625355+0000","last_peered":"2024-09-15T22:45:23.625355+0000","last_clean":"2024-09-15T22:45:23.625355+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:23.625355+0000","last_undegraded":"2024-09-15T22:45:23.625355+0000","last_fullsized":"2024-09-15T22:45:23.625355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:26.015875+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:26.015875+0000","last_peered":"2024-09-15T22:45:26.015875+0000","last_clean":"2024-09-15T22:45:26.015875+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:26.015875+0000","last_undegraded":"2024-09-15T22:45:26.015875+0000","last_fullsized":"2024-09-15T22:45:26.015875+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'41","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.740843+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:21.740843+0000","last_peered":"2024-09-15T22:45:21.740843+0000","last_clean":"2024-09-15T22:45:21.740843+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:21.740843+0000","last_undegraded":"2024-09-15T22:45:21.740843+0000","last_fullsized":"2024-09-15T22:45:21.740843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514715+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514715+0000","last_peered":"2024-09-15T22:45:21.514715+0000","last_clean":"2024-09-15T22:45:21.514715+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514715+0000","last_undegraded":"2024-09-15T22:45:21.514715+0000","last_fullsized":"2024-09-15T22:45:21.514715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.978009+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:25.978009+0000","last_peered":"2024-09-15T22:45:25.978009+0000","last_clean":"2024-09-15T22:45:25.978009+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:25.978009+0000","last_undegraded":"2024-09-15T22:45:25.978009+0000","last_fullsized":"2024-09-15T22:45:25.978009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615687+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615687+0000","last_peered":"2024-09-15T22:45:21.615687+0000","last_clean":"2024-09-15T22:45:21.615687+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615687+0000","last_undegraded":"2024-09-15T22:45:21.615687+0000","last_fullsized":"2024-09-15T22:45:21.615687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800568+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800568+0000","last_peered":"2024-09-15T22:45:21.800568+0000","last_clean":"2024-09-15T22:45:21.800568+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800568+0000","last_undegraded":"2024-09-15T22:45:21.800568+0000","last_fullsized":"2024-09-15T22:45:21.800568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515351+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515351+0000","last_peered":"2024-09-15T22:45:21.515351+0000","last_clean":"2024-09-15T22:45:21.515351+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515351+0000","last_undegraded":"2024-09-15T22:45:21.515351+0000","last_fullsized":"2024-09-15T22:45:21.515351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:26.942821+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:26.942821+0000","last_peered":"2024-09-15T22:45:26.942821+0000","last_clean":"2024-09-15T22:45:26.942821+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:26.942821+0000","last_undegraded":"2024-09-15T22:45:26.942821+0000","last_fullsized":"2024-09-15T22:45:26.942821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":183,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":264,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:26.942777+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:26.942777+0000","last_peered":"2024-09-15T22:45:26.942777+0000","last_clean":"2024-09-15T22:45:26.942777+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:26.942777+0000","last_undegraded":"2024-09-15T22:45:26.942777+0000","last_fullsized":"2024-09-15T22:45:26.942777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":218,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515254+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515254+0000","last_peered":"2024-09-15T22:45:21.515254+0000","last_clean":"2024-09-15T22:45:21.515254+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515254+0000","last_undegraded":"2024-09-15T22:45:21.515254+0000","last_fullsized":"2024-09-15T22:45:21.515254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798938+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798938+0000","last_peered":"2024-09-15T22:45:21.798938+0000","last_clean":"2024-09-15T22:45:21.798938+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798938+0000","last_undegraded":"2024-09-15T22:45:21.798938+0000","last_fullsized":"2024-09-15T22:45:21.798938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:25.942237+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:25.942237+0000","last_peered":"2024-09-15T22:45:25.942237+0000","last_clean":"2024-09-15T22:45:25.942237+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:25.942237+0000","last_undegraded":"2024-09-15T22:45:25.942237+0000","last_fullsized":"2024-09-15T22:45:25.942237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616875+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616875+0000","last_peered":"2024-09-15T22:45:21.616875+0000","last_clean":"2024-09-15T22:45:21.616875+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616875+0000","last_undegraded":"2024-09-15T22:45:21.616875+0000","last_fullsized":"2024-09-15T22:45:21.616875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798890+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798890+0000","last_peered":"2024-09-15T22:45:21.798890+0000","last_clean":"2024-09-15T22:45:21.798890+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798890+0000","last_undegraded":"2024-09-15T22:45:21.798890+0000","last_fullsized":"2024-09-15T22:45:21.798890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798920+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798920+0000","last_peered":"2024-09-15T22:45:21.798920+0000","last_clean":"2024-09-15T22:45:21.798920+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798920+0000","last_undegraded":"2024-09-15T22:45:21.798920+0000","last_fullsized":"2024-09-15T22:45:21.798920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616951+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616951+0000","last_peered":"2024-09-15T22:45:21.616951+0000","last_clean":"2024-09-15T22:45:21.616951+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616951+0000","last_undegraded":"2024-09-15T22:45:21.616951+0000","last_fullsized":"2024-09-15T22:45:21.616951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602051,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1227,"num_read_kb":731,"num_write":376,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1806153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841584,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28864,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716288,"statfs":{"total":95995035648,"available":95965478912,"internally_reserved":0,"allocated":1884160,"data_stored":1308508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855434,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37108,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708044,"statfs":{"total":95995035648,"available":95957037056,"internally_reserved":0,"allocated":1806336,"data_stored":1240800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1056768,"data_stored":520808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215188,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1041258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1134592,"data_stored":587101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1122304,"data_stored":588184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1073152,"data_stored":518583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":202128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:32.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:45:33.044 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:33.166 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:32 smithi066 ceph-mon[31185]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-15T22:45:33.166 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:32 smithi066 ceph-mon[31185]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:32 smithi184 ceph-mon[35203]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-15T22:45:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:32 smithi184 ceph-mon[35203]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:32 smithi087 ceph-mon[35290]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-15T22:45:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:32 smithi087 ceph-mon[35290]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 -- 172.21.15.66:0/3707105030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 msgr2=0x7f045c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 --2- 172.21.15.66:0/3707105030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c10da40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0454009ca0 tx=0x7f045402a950 comp rx=0 tx=0).stop 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 -- 172.21.15.66:0/3707105030 shutdown_connections 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 --2- 172.21.15.66:0/3707105030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c10da40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 --2- 172.21.15.66:0/3707105030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 --2- 172.21.15.66:0/3707105030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 -- 172.21.15.66:0/3707105030 >> 172.21.15.66:0/3707105030 conn(0x7f045c0fc7d0 msgr2=0x7f045c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 -- 172.21.15.66:0/3707105030 shutdown_connections 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.528+0000 7f04632f8640 1 -- 172.21.15.66:0/3707105030 wait complete. 2024-09-15T22:45:33.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 Processor -- start 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 -- start start 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f045c110f80 con 0x7f045c100e20 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f045c110e00 con 0x7f045c102ef0 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.529+0000 7f04632f8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f045c111100 con 0x7f045c102570 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44084/0 (socket says 172.21.15.66:44084) 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 -- 172.21.15.66:0/2250402020 learned_addr learned my addr 172.21.15.66:0/2250402020 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0460893640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461895640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 -- 172.21.15.66:0/2250402020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 msgr2=0x7f045c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 -- 172.21.15.66:0/2250402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 msgr2=0x7f045c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 -- 172.21.15.66:0/2250402020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c1a6950 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461895640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f0461094640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f045800e9f0 tx=0x7f045800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045800cd80 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0458010910 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c1a6c40 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458018990 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.530+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c1a7180 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.531+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c101200 con 0x7f045c100e20 2024-09-15T22:45:33.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.533+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f0458010ac0 con 0x7f045c100e20 2024-09-15T22:45:33.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.534+0000 7f04527fc640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 0x7f04480a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:33.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.534+0000 7f0460893640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 0x7f04480a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:33.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.534+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04580d09a0 con 0x7f045c100e20 2024-09-15T22:45:33.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.534+0000 7f0460893640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 0x7f04480a5980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f045c0fe710 tx=0x7f044c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:33.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.537+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f045809ce40 con 0x7f045c100e20 2024-09-15T22:45:33.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.714+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f045c062630 con 0x7f04480a34c0 2024-09-15T22:45:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.723+0000 7f04527fc640 1 -- 172.21.15.66:0/2250402020 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339458 (secure 0 0 0) 0x7f045c062630 con 0x7f04480a34c0 2024-09-15T22:45:33.727 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:33.728 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.725+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 msgr2=0x7f04480a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.725+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 0x7f04480a5980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f045c0fe710 tx=0x7f044c005f90 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.725+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 msgr2=0x7f045c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.725+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f045800e9f0 tx=0x7f045800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 shutdown_connections 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04480a34c0 0x7f04480a5980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 --2- 172.21.15.66:0/2250402020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 >> 172.21.15.66:0/2250402020 conn(0x7f045c0fc7d0 msgr2=0x7f045c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 shutdown_connections 2024-09-15T22:45:33.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:33.726+0000 7f04632f8640 1 -- 172.21.15.66:0/2250402020 wait complete. 2024-09-15T22:45:34.442 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-15T22:45:33.529312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389285,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1769,"num_read_kb":1318,"num_write":705,"num_write_kb":5322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1031,"ondisk_log_size":1031,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391160,"kb_used_data":16568,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124550664,"statfs":{"total":1151940427776,"available":1151539879936,"internally_reserved":0,"allocated":16965632,"data_stored":10392065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":493,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.993088"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.977313+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:30.977313+0000","last_peered":"2024-09-15T22:45:30.977313+0000","last_clean":"2024-09-15T22:45:30.977313+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:30.977313+0000","last_undegraded":"2024-09-15T22:45:30.977313+0000","last_fullsized":"2024-09-15T22:45:30.977313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798762+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798762+0000","last_peered":"2024-09-15T22:45:21.798762+0000","last_clean":"2024-09-15T22:45:21.798762+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798762+0000","last_undegraded":"2024-09-15T22:45:21.798762+0000","last_fullsized":"2024-09-15T22:45:21.798762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894294+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894294+0000","last_peered":"2024-09-15T22:45:21.894294+0000","last_clean":"2024-09-15T22:45:21.894294+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894294+0000","last_undegraded":"2024-09-15T22:45:21.894294+0000","last_fullsized":"2024-09-15T22:45:21.894294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515131+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515131+0000","last_peered":"2024-09-15T22:45:21.515131+0000","last_clean":"2024-09-15T22:45:21.515131+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515131+0000","last_undegraded":"2024-09-15T22:45:21.515131+0000","last_fullsized":"2024-09-15T22:45:21.515131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894512+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894512+0000","last_peered":"2024-09-15T22:45:21.894512+0000","last_clean":"2024-09-15T22:45:21.894512+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894512+0000","last_undegraded":"2024-09-15T22:45:21.894512+0000","last_fullsized":"2024-09-15T22:45:21.894512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515373+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515373+0000","last_peered":"2024-09-15T22:45:21.515373+0000","last_clean":"2024-09-15T22:45:21.515373+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515373+0000","last_undegraded":"2024-09-15T22:45:21.515373+0000","last_fullsized":"2024-09-15T22:45:21.515373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894366+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894366+0000","last_peered":"2024-09-15T22:45:21.894366+0000","last_clean":"2024-09-15T22:45:21.894366+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894366+0000","last_undegraded":"2024-09-15T22:45:21.894366+0000","last_fullsized":"2024-09-15T22:45:21.894366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'104","reported_seq":237,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.688884+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:30.688884+0000","last_peered":"2024-09-15T22:45:30.688884+0000","last_clean":"2024-09-15T22:45:30.688884+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:30.688884+0000","last_undegraded":"2024-09-15T22:45:30.688884+0000","last_fullsized":"2024-09-15T22:45:30.688884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":190,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.978053+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:30.978053+0000","last_peered":"2024-09-15T22:45:30.978053+0000","last_clean":"2024-09-15T22:45:30.978053+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:30.978053+0000","last_undegraded":"2024-09-15T22:45:30.978053+0000","last_fullsized":"2024-09-15T22:45:30.978053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.984849+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:30.984849+0000","last_peered":"2024-09-15T22:45:30.984849+0000","last_clean":"2024-09-15T22:45:30.984849+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:30.984849+0000","last_undegraded":"2024-09-15T22:45:30.984849+0000","last_fullsized":"2024-09-15T22:45:30.984849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":405,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:23.625355+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:23.625355+0000","last_peered":"2024-09-15T22:45:23.625355+0000","last_clean":"2024-09-15T22:45:23.625355+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:23.625355+0000","last_undegraded":"2024-09-15T22:45:23.625355+0000","last_fullsized":"2024-09-15T22:45:23.625355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.023507+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:31.023507+0000","last_peered":"2024-09-15T22:45:31.023507+0000","last_clean":"2024-09-15T22:45:31.023507+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:31.023507+0000","last_undegraded":"2024-09-15T22:45:31.023507+0000","last_fullsized":"2024-09-15T22:45:31.023507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'67","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.314127+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:30.314127+0000","last_peered":"2024-09-15T22:45:30.314127+0000","last_clean":"2024-09-15T22:45:30.314127+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:30.314127+0000","last_undegraded":"2024-09-15T22:45:30.314127+0000","last_fullsized":"2024-09-15T22:45:30.314127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514715+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514715+0000","last_peered":"2024-09-15T22:45:21.514715+0000","last_clean":"2024-09-15T22:45:21.514715+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514715+0000","last_undegraded":"2024-09-15T22:45:21.514715+0000","last_fullsized":"2024-09-15T22:45:21.514715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.985569+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:30.985569+0000","last_peered":"2024-09-15T22:45:30.985569+0000","last_clean":"2024-09-15T22:45:30.985569+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:30.985569+0000","last_undegraded":"2024-09-15T22:45:30.985569+0000","last_fullsized":"2024-09-15T22:45:30.985569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615687+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615687+0000","last_peered":"2024-09-15T22:45:21.615687+0000","last_clean":"2024-09-15T22:45:21.615687+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615687+0000","last_undegraded":"2024-09-15T22:45:21.615687+0000","last_fullsized":"2024-09-15T22:45:21.615687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800568+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800568+0000","last_peered":"2024-09-15T22:45:21.800568+0000","last_clean":"2024-09-15T22:45:21.800568+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800568+0000","last_undegraded":"2024-09-15T22:45:21.800568+0000","last_fullsized":"2024-09-15T22:45:21.800568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515351+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515351+0000","last_peered":"2024-09-15T22:45:21.515351+0000","last_clean":"2024-09-15T22:45:21.515351+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515351+0000","last_undegraded":"2024-09-15T22:45:21.515351+0000","last_fullsized":"2024-09-15T22:45:21.515351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":323,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.949590+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:31.949590+0000","last_peered":"2024-09-15T22:45:31.949590+0000","last_clean":"2024-09-15T22:45:31.949590+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:31.949590+0000","last_undegraded":"2024-09-15T22:45:31.949590+0000","last_fullsized":"2024-09-15T22:45:31.949590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":189,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.949622+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:31.949622+0000","last_peered":"2024-09-15T22:45:31.949622+0000","last_clean":"2024-09-15T22:45:31.949622+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:31.949622+0000","last_undegraded":"2024-09-15T22:45:31.949622+0000","last_fullsized":"2024-09-15T22:45:31.949622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515254+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515254+0000","last_peered":"2024-09-15T22:45:21.515254+0000","last_clean":"2024-09-15T22:45:21.515254+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515254+0000","last_undegraded":"2024-09-15T22:45:21.515254+0000","last_fullsized":"2024-09-15T22:45:21.515254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798990+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798990+0000","last_peered":"2024-09-15T22:45:21.798990+0000","last_clean":"2024-09-15T22:45:21.798990+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798990+0000","last_undegraded":"2024-09-15T22:45:21.798990+0000","last_fullsized":"2024-09-15T22:45:21.798990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.948743+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:30.948743+0000","last_peered":"2024-09-15T22:45:30.948743+0000","last_clean":"2024-09-15T22:45:30.948743+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:30.948743+0000","last_undegraded":"2024-09-15T22:45:30.948743+0000","last_fullsized":"2024-09-15T22:45:30.948743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616875+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616875+0000","last_peered":"2024-09-15T22:45:21.616875+0000","last_clean":"2024-09-15T22:45:21.616875+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616875+0000","last_undegraded":"2024-09-15T22:45:21.616875+0000","last_fullsized":"2024-09-15T22:45:21.616875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798944+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798944+0000","last_peered":"2024-09-15T22:45:21.798944+0000","last_clean":"2024-09-15T22:45:21.798944+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798944+0000","last_undegraded":"2024-09-15T22:45:21.798944+0000","last_fullsized":"2024-09-15T22:45:21.798944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798920+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798920+0000","last_peered":"2024-09-15T22:45:21.798920+0000","last_clean":"2024-09-15T22:45:21.798920+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798920+0000","last_undegraded":"2024-09-15T22:45:21.798920+0000","last_fullsized":"2024-09-15T22:45:21.798920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616951+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616951+0000","last_peered":"2024-09-15T22:45:21.616951+0000","last_clean":"2024-09-15T22:45:21.616951+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616951+0000","last_undegraded":"2024-09-15T22:45:21.616951+0000","last_fullsized":"2024-09-15T22:45:21.616951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798683,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1532,"num_read_kb":988,"num_write":502,"num_write_kb":2382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2396049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612653,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841585,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29176,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93715976,"statfs":{"total":95995035648,"available":95965159424,"internally_reserved":0,"allocated":2080768,"data_stored":1505140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37420,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707732,"statfs":{"total":95995035648,"available":95956717568,"internally_reserved":0,"allocated":2002944,"data_stored":1437432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1056768,"data_stored":520808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215189,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37208,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707944,"statfs":{"total":95995035648,"available":95956934656,"internally_reserved":0,"allocated":1785856,"data_stored":1237890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411418,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1134592,"data_stored":587101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1122304,"data_stored":588184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1073152,"data_stored":518583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":331052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":398760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:34.447 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:45:34.447 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:45:34.705 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:35.124 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:34 smithi066 ceph-mon[31185]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-15T22:45:35.124 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:34 smithi066 ceph-mon[31185]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:35.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:34 smithi184 ceph-mon[35203]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-15T22:45:35.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:34 smithi184 ceph-mon[35203]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:35.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- 172.21.15.66:0/2949617460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8102790 msgr2=0x7f2af81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:35.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/2949617460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8102790 0x7f2af81067e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009900 tx=0x7f2aec02a410 comp rx=0 tx=0).stop 2024-09-15T22:45:35.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- 172.21.15.66:0/2949617460 shutdown_connections 2024-09-15T22:45:35.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/2949617460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8106f10 0x7f2af810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/2949617460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8102790 0x7f2af81067e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/2949617460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8101de0 0x7f2af81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- 172.21.15.66:0/2949617460 >> 172.21.15.66:0/2949617460 conn(0x7f2af80fd8c0 msgr2=0x7f2af80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- 172.21.15.66:0/2949617460 shutdown_connections 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- 172.21.15.66:0/2949617460 wait complete. 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 Processor -- start 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 -- start start 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.206+0000 7f2aff0f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8102790 0x7f2af8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 0x7f2af819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2af8111f70 con 0x7f2af8101de0 2024-09-15T22:45:35.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2af8111df0 con 0x7f2af8106f10 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2af81120f0 con 0x7f2af8102790 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44102/0 (socket says 172.21.15.66:44102) 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 -- 172.21.15.66:0/3659709186 learned_addr learned my addr 172.21.15.66:0/3659709186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afd695640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 0x7f2af819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2af7fff640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8102790 0x7f2af8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 -- 172.21.15.66:0/3659709186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8102790 msgr2=0x7f2af8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8102790 0x7f2af8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 -- 172.21.15.66:0/3659709186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 msgr2=0x7f2af819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 0x7f2af819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 -- 172.21.15.66:0/3659709186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af819d400 con 0x7f2af8101de0 2024-09-15T22:45:35.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afd695640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 0x7f2af819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2afce94640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c920 tx=0x7f2ae800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8007c70 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae8007e10 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af819d6f0 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.207+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8018890 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.208+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81a4fd0 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.208+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af81021c0 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.210+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2ae8018a70 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.210+0000 7f2af5ffb640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 0x7f2ae00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.210+0000 7f2af7fff640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 0x7f2ae00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.210+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2ae80d03f0 con 0x7f2af8101de0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.211+0000 7f2af7fff640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 0x7f2ae00a5980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2af81087d0 tx=0x7f2aec031490 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:35.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.215+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ae8014030 con 0x7f2af8101de0 2024-09-15T22:45:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:34 smithi087 ceph-mon[35290]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-15T22:45:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:34 smithi087 ceph-mon[35290]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.386+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2af810a160 con 0x7f2ae00a34c0 2024-09-15T22:45:35.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.396+0000 7f2af5ffb640 1 -- 172.21.15.66:0/3659709186 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339458 (secure 0 0 0) 0x7f2aec031860 con 0x7f2ae00a34c0 2024-09-15T22:45:35.401 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:35.403 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 msgr2=0x7f2ae00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 0x7f2ae00a5980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2af81087d0 tx=0x7f2aec031490 comp rx=0 tx=0).stop 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 msgr2=0x7f2af8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c920 tx=0x7f2ae800cde0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 shutdown_connections 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2ae00a34c0 0x7f2ae00a5980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2af8106f10 0x7f2af819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af8102790 0x7f2af8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 --2- 172.21.15.66:0/3659709186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2af8101de0 0x7f2af8198450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:35.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.399+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 >> 172.21.15.66:0/3659709186 conn(0x7f2af80fd8c0 msgr2=0x7f2af80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:35.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.400+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 shutdown_connections 2024-09-15T22:45:35.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:35.400+0000 7f2aff0f8640 1 -- 172.21.15.66:0/3659709186 wait complete. 2024-09-15T22:45:36.076 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-15T22:45:33.529312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1389285,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1769,"num_read_kb":1318,"num_write":705,"num_write_kb":5322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1180921,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1031,"ondisk_log_size":1031,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391160,"kb_used_data":16568,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124550664,"statfs":{"total":1151940427776,"available":1151539879936,"internally_reserved":0,"allocated":16965632,"data_stored":10392065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":493,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.993088"},"pg_stats":[{"pgid":"2.1f","version":"89'15","reported_seq":172,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.977313+0000","last_change":"2024-09-15T22:42:51.464031+0000","last_active":"2024-09-15T22:45:30.977313+0000","last_peered":"2024-09-15T22:45:30.977313+0000","last_clean":"2024-09-15T22:45:30.977313+0000","last_became_active":"2024-09-15T22:42:51.463562+0000","last_became_peered":"2024-09-15T22:42:51.463562+0000","last_unstale":"2024-09-15T22:45:30.977313+0000","last_undegraded":"2024-09-15T22:45:30.977313+0000","last_fullsized":"2024-09-15T22:45:30.977313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:27.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617966+0000","last_change":"2024-09-15T22:42:53.553109+0000","last_active":"2024-09-15T22:45:21.617966+0000","last_peered":"2024-09-15T22:45:21.617966+0000","last_clean":"2024-09-15T22:45:21.617966+0000","last_became_active":"2024-09-15T22:42:53.552810+0000","last_became_peered":"2024-09-15T22:42:53.552810+0000","last_unstale":"2024-09-15T22:45:21.617966+0000","last_undegraded":"2024-09-15T22:45:21.617966+0000","last_fullsized":"2024-09-15T22:45:21.617966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:33.782119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798762+0000","last_change":"2024-09-15T22:43:00.808500+0000","last_active":"2024-09-15T22:45:21.798762+0000","last_peered":"2024-09-15T22:45:21.798762+0000","last_clean":"2024-09-15T22:45:21.798762+0000","last_became_active":"2024-09-15T22:43:00.808049+0000","last_became_peered":"2024-09-15T22:43:00.808049+0000","last_unstale":"2024-09-15T22:45:21.798762+0000","last_undegraded":"2024-09-15T22:45:21.798762+0000","last_fullsized":"2024-09-15T22:45:21.798762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.917675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.618198+0000","last_change":"2024-09-15T22:42:51.520103+0000","last_active":"2024-09-15T22:45:21.618198+0000","last_peered":"2024-09-15T22:45:21.618198+0000","last_clean":"2024-09-15T22:45:21.618198+0000","last_became_active":"2024-09-15T22:42:51.519764+0000","last_became_peered":"2024-09-15T22:42:51.519764+0000","last_unstale":"2024-09-15T22:45:21.618198+0000","last_undegraded":"2024-09-15T22:45:21.618198+0000","last_fullsized":"2024-09-15T22:45:21.618198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:08.827607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802414+0000","last_change":"2024-09-15T22:42:53.549176+0000","last_active":"2024-09-15T22:45:21.802414+0000","last_peered":"2024-09-15T22:45:21.802414+0000","last_clean":"2024-09-15T22:45:21.802414+0000","last_became_active":"2024-09-15T22:42:53.548273+0000","last_became_peered":"2024-09-15T22:42:53.548273+0000","last_unstale":"2024-09-15T22:45:21.802414+0000","last_undegraded":"2024-09-15T22:45:21.802414+0000","last_fullsized":"2024-09-15T22:45:21.802414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:04.258655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894294+0000","last_change":"2024-09-15T22:43:00.814845+0000","last_active":"2024-09-15T22:45:21.894294+0000","last_peered":"2024-09-15T22:45:21.894294+0000","last_clean":"2024-09-15T22:45:21.894294+0000","last_became_active":"2024-09-15T22:43:00.814307+0000","last_became_peered":"2024-09-15T22:43:00.814307+0000","last_unstale":"2024-09-15T22:45:21.894294+0000","last_undegraded":"2024-09-15T22:45:21.894294+0000","last_fullsized":"2024-09-15T22:45:21.894294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:41:51.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.980361+0000","last_change":"2024-09-15T22:42:51.463999+0000","last_active":"2024-09-15T22:45:21.980361+0000","last_peered":"2024-09-15T22:45:21.980361+0000","last_clean":"2024-09-15T22:45:21.980361+0000","last_became_active":"2024-09-15T22:42:51.463673+0000","last_became_peered":"2024-09-15T22:42:51.463673+0000","last_unstale":"2024-09-15T22:45:21.980361+0000","last_undegraded":"2024-09-15T22:45:21.980361+0000","last_fullsized":"2024-09-15T22:45:21.980361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:30.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515131+0000","last_change":"2024-09-15T22:42:53.546605+0000","last_active":"2024-09-15T22:45:21.515131+0000","last_peered":"2024-09-15T22:45:21.515131+0000","last_clean":"2024-09-15T22:45:21.515131+0000","last_became_active":"2024-09-15T22:42:53.546295+0000","last_became_peered":"2024-09-15T22:42:53.546295+0000","last_unstale":"2024-09-15T22:45:21.515131+0000","last_undegraded":"2024-09-15T22:45:21.515131+0000","last_fullsized":"2024-09-15T22:45:21.515131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:47.544208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894512+0000","last_change":"2024-09-15T22:43:00.820528+0000","last_active":"2024-09-15T22:45:21.894512+0000","last_peered":"2024-09-15T22:45:21.894512+0000","last_clean":"2024-09-15T22:45:21.894512+0000","last_became_active":"2024-09-15T22:43:00.820260+0000","last_became_peered":"2024-09-15T22:43:00.820260+0000","last_unstale":"2024-09-15T22:45:21.894512+0000","last_undegraded":"2024-09-15T22:45:21.894512+0000","last_fullsized":"2024-09-15T22:45:21.894512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.172905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617144+0000","last_change":"2024-09-15T22:42:51.460990+0000","last_active":"2024-09-15T22:45:21.617144+0000","last_peered":"2024-09-15T22:45:21.617144+0000","last_clean":"2024-09-15T22:45:21.617144+0000","last_became_active":"2024-09-15T22:42:51.460630+0000","last_became_peered":"2024-09-15T22:42:51.460630+0000","last_unstale":"2024-09-15T22:45:21.617144+0000","last_undegraded":"2024-09-15T22:45:21.617144+0000","last_fullsized":"2024-09-15T22:45:21.617144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:55.147478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515373+0000","last_change":"2024-09-15T22:42:53.550617+0000","last_active":"2024-09-15T22:45:21.515373+0000","last_peered":"2024-09-15T22:45:21.515373+0000","last_clean":"2024-09-15T22:45:21.515373+0000","last_became_active":"2024-09-15T22:42:53.548779+0000","last_became_peered":"2024-09-15T22:42:53.548779+0000","last_unstale":"2024-09-15T22:45:21.515373+0000","last_undegraded":"2024-09-15T22:45:21.515373+0000","last_fullsized":"2024-09-15T22:45:21.515373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894366+0000","last_change":"2024-09-15T22:43:00.814573+0000","last_active":"2024-09-15T22:45:21.894366+0000","last_peered":"2024-09-15T22:45:21.894366+0000","last_clean":"2024-09-15T22:45:21.894366+0000","last_became_active":"2024-09-15T22:43:00.813915+0000","last_became_peered":"2024-09-15T22:43:00.813915+0000","last_unstale":"2024-09-15T22:45:21.894366+0000","last_undegraded":"2024-09-15T22:45:21.894366+0000","last_fullsized":"2024-09-15T22:45:21.894366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:50.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798951+0000","last_change":"2024-09-15T22:42:53.554674+0000","last_active":"2024-09-15T22:45:21.798951+0000","last_peered":"2024-09-15T22:45:21.798951+0000","last_clean":"2024-09-15T22:45:21.798951+0000","last_became_active":"2024-09-15T22:42:53.554229+0000","last_became_peered":"2024-09-15T22:42:53.554229+0000","last_unstale":"2024-09-15T22:45:21.798951+0000","last_undegraded":"2024-09-15T22:45:21.798951+0000","last_fullsized":"2024-09-15T22:45:21.798951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.962037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800383+0000","last_change":"2024-09-15T22:44:02.117734+0000","last_active":"2024-09-15T22:45:21.800383+0000","last_peered":"2024-09-15T22:45:21.800383+0000","last_clean":"2024-09-15T22:45:21.800383+0000","last_became_active":"2024-09-15T22:44:02.107889+0000","last_became_peered":"2024-09-15T22:44:02.107889+0000","last_unstale":"2024-09-15T22:45:21.800383+0000","last_undegraded":"2024-09-15T22:45:21.800383+0000","last_fullsized":"2024-09-15T22:45:21.800383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:36.020758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894641+0000","last_change":"2024-09-15T22:43:00.823814+0000","last_active":"2024-09-15T22:45:21.894641+0000","last_peered":"2024-09-15T22:45:21.894641+0000","last_clean":"2024-09-15T22:45:21.894641+0000","last_became_active":"2024-09-15T22:43:00.823358+0000","last_became_peered":"2024-09-15T22:43:00.823358+0000","last_unstale":"2024-09-15T22:45:21.894641+0000","last_undegraded":"2024-09-15T22:45:21.894641+0000","last_fullsized":"2024-09-15T22:45:21.894641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:53.553566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617530+0000","last_change":"2024-09-15T22:42:53.549855+0000","last_active":"2024-09-15T22:45:21.617530+0000","last_peered":"2024-09-15T22:45:21.617530+0000","last_clean":"2024-09-15T22:45:21.617530+0000","last_became_active":"2024-09-15T22:42:53.548680+0000","last_became_peered":"2024-09-15T22:42:53.548680+0000","last_unstale":"2024-09-15T22:45:21.617530+0000","last_undegraded":"2024-09-15T22:45:21.617530+0000","last_fullsized":"2024-09-15T22:45:21.617530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:59.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798793+0000","last_change":"2024-09-15T22:42:51.460885+0000","last_active":"2024-09-15T22:45:21.798793+0000","last_peered":"2024-09-15T22:45:21.798793+0000","last_clean":"2024-09-15T22:45:21.798793+0000","last_became_active":"2024-09-15T22:42:51.460302+0000","last_became_peered":"2024-09-15T22:42:51.460302+0000","last_unstale":"2024-09-15T22:45:21.798793+0000","last_undegraded":"2024-09-15T22:45:21.798793+0000","last_fullsized":"2024-09-15T22:45:21.798793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:38.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894657+0000","last_change":"2024-09-15T22:43:00.816662+0000","last_active":"2024-09-15T22:45:21.894657+0000","last_peered":"2024-09-15T22:45:21.894657+0000","last_clean":"2024-09-15T22:45:21.894657+0000","last_became_active":"2024-09-15T22:43:00.816009+0000","last_became_peered":"2024-09-15T22:43:00.816009+0000","last_unstale":"2024-09-15T22:45:21.894657+0000","last_undegraded":"2024-09-15T22:45:21.894657+0000","last_fullsized":"2024-09-15T22:45:21.894657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:34.913007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800424+0000","last_change":"2024-09-15T22:42:53.547550+0000","last_active":"2024-09-15T22:45:21.800424+0000","last_peered":"2024-09-15T22:45:21.800424+0000","last_clean":"2024-09-15T22:45:21.800424+0000","last_became_active":"2024-09-15T22:42:53.547221+0000","last_became_peered":"2024-09-15T22:42:53.547221+0000","last_unstale":"2024-09-15T22:45:21.800424+0000","last_undegraded":"2024-09-15T22:45:21.800424+0000","last_fullsized":"2024-09-15T22:45:21.800424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:56.743473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617370+0000","last_change":"2024-09-15T22:42:51.463530+0000","last_active":"2024-09-15T22:45:21.617370+0000","last_peered":"2024-09-15T22:45:21.617370+0000","last_clean":"2024-09-15T22:45:21.617370+0000","last_became_active":"2024-09-15T22:42:51.463109+0000","last_became_peered":"2024-09-15T22:42:51.463109+0000","last_unstale":"2024-09-15T22:45:21.617370+0000","last_undegraded":"2024-09-15T22:45:21.617370+0000","last_fullsized":"2024-09-15T22:45:21.617370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:32.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615669+0000","last_change":"2024-09-15T22:43:00.809954+0000","last_active":"2024-09-15T22:45:21.615669+0000","last_peered":"2024-09-15T22:45:21.615669+0000","last_clean":"2024-09-15T22:45:21.615669+0000","last_became_active":"2024-09-15T22:43:00.808689+0000","last_became_peered":"2024-09-15T22:43:00.808689+0000","last_unstale":"2024-09-15T22:45:21.615669+0000","last_undegraded":"2024-09-15T22:45:21.615669+0000","last_fullsized":"2024-09-15T22:45:21.615669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:35.951443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616724+0000","last_change":"2024-09-15T22:42:53.542133+0000","last_active":"2024-09-15T22:45:21.616724+0000","last_peered":"2024-09-15T22:45:21.616724+0000","last_clean":"2024-09-15T22:45:21.616724+0000","last_became_active":"2024-09-15T22:42:53.541728+0000","last_became_peered":"2024-09-15T22:42:53.541728+0000","last_unstale":"2024-09-15T22:45:21.616724+0000","last_undegraded":"2024-09-15T22:45:21.616724+0000","last_fullsized":"2024-09-15T22:45:21.616724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:43.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514988+0000","last_change":"2024-09-15T22:42:51.520306+0000","last_active":"2024-09-15T22:45:21.514988+0000","last_peered":"2024-09-15T22:45:21.514988+0000","last_clean":"2024-09-15T22:45:21.514988+0000","last_became_active":"2024-09-15T22:42:51.520003+0000","last_became_peered":"2024-09-15T22:42:51.520003+0000","last_unstale":"2024-09-15T22:45:21.514988+0000","last_undegraded":"2024-09-15T22:45:21.514988+0000","last_fullsized":"2024-09-15T22:45:21.514988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:15.025819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894639+0000","last_change":"2024-09-15T22:45:02.170247+0000","last_active":"2024-09-15T22:45:21.894639+0000","last_peered":"2024-09-15T22:45:21.894639+0000","last_clean":"2024-09-15T22:45:21.894639+0000","last_became_active":"2024-09-15T22:45:02.169665+0000","last_became_peered":"2024-09-15T22:45:02.169665+0000","last_unstale":"2024-09-15T22:45:21.894639+0000","last_undegraded":"2024-09-15T22:45:21.894639+0000","last_fullsized":"2024-09-15T22:45:21.894639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.520268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802178+0000","last_change":"2024-09-15T22:44:02.116330+0000","last_active":"2024-09-15T22:45:21.802178+0000","last_peered":"2024-09-15T22:45:21.802178+0000","last_clean":"2024-09-15T22:45:21.802178+0000","last_became_active":"2024-09-15T22:44:02.116000+0000","last_became_peered":"2024-09-15T22:44:02.116000+0000","last_unstale":"2024-09-15T22:45:21.802178+0000","last_undegraded":"2024-09-15T22:45:21.802178+0000","last_fullsized":"2024-09-15T22:45:21.802178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:53.830242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894864+0000","last_change":"2024-09-15T22:42:51.458291+0000","last_active":"2024-09-15T22:45:21.894864+0000","last_peered":"2024-09-15T22:45:21.894864+0000","last_clean":"2024-09-15T22:45:21.894864+0000","last_became_active":"2024-09-15T22:42:51.457884+0000","last_became_peered":"2024-09-15T22:42:51.457884+0000","last_unstale":"2024-09-15T22:45:21.894864+0000","last_undegraded":"2024-09-15T22:45:21.894864+0000","last_fullsized":"2024-09-15T22:45:21.894864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:56.245550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798724+0000","last_change":"2024-09-15T22:43:00.814892+0000","last_active":"2024-09-15T22:45:21.798724+0000","last_peered":"2024-09-15T22:45:21.798724+0000","last_clean":"2024-09-15T22:45:21.798724+0000","last_became_active":"2024-09-15T22:43:00.814528+0000","last_became_peered":"2024-09-15T22:43:00.814528+0000","last_unstale":"2024-09-15T22:45:21.798724+0000","last_undegraded":"2024-09-15T22:45:21.798724+0000","last_fullsized":"2024-09-15T22:45:21.798724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:35.145257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614399+0000","last_change":"2024-09-15T22:45:02.151397+0000","last_active":"2024-09-15T22:45:21.614399+0000","last_peered":"2024-09-15T22:45:21.614399+0000","last_clean":"2024-09-15T22:45:21.614399+0000","last_became_active":"2024-09-15T22:45:02.151098+0000","last_became_peered":"2024-09-15T22:45:02.151098+0000","last_unstale":"2024-09-15T22:45:21.614399+0000","last_undegraded":"2024-09-15T22:45:21.614399+0000","last_fullsized":"2024-09-15T22:45:21.614399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:12.316374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"90'104","reported_seq":237,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.688884+0000","last_change":"2024-09-15T22:42:51.459941+0000","last_active":"2024-09-15T22:45:30.688884+0000","last_peered":"2024-09-15T22:45:30.688884+0000","last_clean":"2024-09-15T22:45:30.688884+0000","last_became_active":"2024-09-15T22:42:51.459617+0000","last_became_peered":"2024-09-15T22:42:51.459617+0000","last_unstale":"2024-09-15T22:45:30.688884+0000","last_undegraded":"2024-09-15T22:45:30.688884+0000","last_fullsized":"2024-09-15T22:45:30.688884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.652560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":190,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616935+0000","last_change":"2024-09-15T22:43:00.823456+0000","last_active":"2024-09-15T22:45:21.616935+0000","last_peered":"2024-09-15T22:45:21.616935+0000","last_clean":"2024-09-15T22:45:21.616935+0000","last_became_active":"2024-09-15T22:43:00.823075+0000","last_became_peered":"2024-09-15T22:43:00.823075+0000","last_unstale":"2024-09-15T22:45:21.616935+0000","last_undegraded":"2024-09-15T22:45:21.616935+0000","last_fullsized":"2024-09-15T22:45:21.616935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.386038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514685+0000","last_change":"2024-09-15T22:42:53.550373+0000","last_active":"2024-09-15T22:45:21.514685+0000","last_peered":"2024-09-15T22:45:21.514685+0000","last_clean":"2024-09-15T22:45:21.514685+0000","last_became_active":"2024-09-15T22:42:53.550061+0000","last_became_peered":"2024-09-15T22:42:53.550061+0000","last_unstale":"2024-09-15T22:45:21.514685+0000","last_undegraded":"2024-09-15T22:45:21.514685+0000","last_fullsized":"2024-09-15T22:45:21.514685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:12.509072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617202+0000","last_change":"2024-09-15T22:42:51.521868+0000","last_active":"2024-09-15T22:45:21.617202+0000","last_peered":"2024-09-15T22:45:21.617202+0000","last_clean":"2024-09-15T22:45:21.617202+0000","last_became_active":"2024-09-15T22:42:51.521220+0000","last_became_peered":"2024-09-15T22:42:51.521220+0000","last_unstale":"2024-09-15T22:45:21.617202+0000","last_undegraded":"2024-09-15T22:45:21.617202+0000","last_fullsized":"2024-09-15T22:45:21.617202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:42.008527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800647+0000","last_change":"2024-09-15T22:43:00.814032+0000","last_active":"2024-09-15T22:45:21.800647+0000","last_peered":"2024-09-15T22:45:21.800647+0000","last_clean":"2024-09-15T22:45:21.800647+0000","last_became_active":"2024-09-15T22:43:00.813622+0000","last_became_peered":"2024-09-15T22:43:00.813622+0000","last_unstale":"2024-09-15T22:45:21.800647+0000","last_undegraded":"2024-09-15T22:45:21.800647+0000","last_fullsized":"2024-09-15T22:45:21.800647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:16.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626585+0000","last_change":"2024-09-15T22:42:53.551410+0000","last_active":"2024-09-15T22:45:21.626585+0000","last_peered":"2024-09-15T22:45:21.626585+0000","last_clean":"2024-09-15T22:45:21.626585+0000","last_became_active":"2024-09-15T22:42:53.551044+0000","last_became_peered":"2024-09-15T22:42:53.551044+0000","last_unstale":"2024-09-15T22:45:21.626585+0000","last_undegraded":"2024-09-15T22:45:21.626585+0000","last_fullsized":"2024-09-15T22:45:21.626585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.419687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614138+0000","last_change":"2024-09-15T22:42:51.520997+0000","last_active":"2024-09-15T22:45:21.614138+0000","last_peered":"2024-09-15T22:45:21.614138+0000","last_clean":"2024-09-15T22:45:21.614138+0000","last_became_active":"2024-09-15T22:42:51.520615+0000","last_became_peered":"2024-09-15T22:42:51.520615+0000","last_unstale":"2024-09-15T22:45:21.614138+0000","last_undegraded":"2024-09-15T22:45:21.614138+0000","last_fullsized":"2024-09-15T22:45:21.614138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:47.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616727+0000","last_change":"2024-09-15T22:45:02.170466+0000","last_active":"2024-09-15T22:45:21.616727+0000","last_peered":"2024-09-15T22:45:21.616727+0000","last_clean":"2024-09-15T22:45:21.616727+0000","last_became_active":"2024-09-15T22:45:02.170019+0000","last_became_peered":"2024-09-15T22:45:02.170019+0000","last_unstale":"2024-09-15T22:45:21.616727+0000","last_undegraded":"2024-09-15T22:45:21.616727+0000","last_fullsized":"2024-09-15T22:45:21.616727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:25.992944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626480+0000","last_change":"2024-09-15T22:42:53.548115+0000","last_active":"2024-09-15T22:45:21.626480+0000","last_peered":"2024-09-15T22:45:21.626480+0000","last_clean":"2024-09-15T22:45:21.626480+0000","last_became_active":"2024-09-15T22:42:53.547737+0000","last_became_peered":"2024-09-15T22:42:53.547737+0000","last_unstale":"2024-09-15T22:45:21.626480+0000","last_undegraded":"2024-09-15T22:45:21.626480+0000","last_fullsized":"2024-09-15T22:45:21.626480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:11.951950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'10","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.978053+0000","last_change":"2024-09-15T22:42:51.463905+0000","last_active":"2024-09-15T22:45:30.978053+0000","last_peered":"2024-09-15T22:45:30.978053+0000","last_clean":"2024-09-15T22:45:30.978053+0000","last_became_active":"2024-09-15T22:42:51.463550+0000","last_became_peered":"2024-09-15T22:42:51.463550+0000","last_unstale":"2024-09-15T22:45:30.978053+0000","last_undegraded":"2024-09-15T22:45:30.978053+0000","last_fullsized":"2024-09-15T22:45:30.978053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:17.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514292+0000","last_change":"2024-09-15T22:43:00.812017+0000","last_active":"2024-09-15T22:45:21.514292+0000","last_peered":"2024-09-15T22:45:21.514292+0000","last_clean":"2024-09-15T22:45:21.514292+0000","last_became_active":"2024-09-15T22:43:00.811619+0000","last_became_peered":"2024-09-15T22:43:00.811619+0000","last_unstale":"2024-09-15T22:45:21.514292+0000","last_undegraded":"2024-09-15T22:45:21.514292+0000","last_fullsized":"2024-09-15T22:45:21.514292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:15.552219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514885+0000","last_change":"2024-09-15T22:42:53.551805+0000","last_active":"2024-09-15T22:45:21.514885+0000","last_peered":"2024-09-15T22:45:21.514885+0000","last_clean":"2024-09-15T22:45:21.514885+0000","last_became_active":"2024-09-15T22:42:53.551447+0000","last_became_peered":"2024-09-15T22:42:53.551447+0000","last_unstale":"2024-09-15T22:45:21.514885+0000","last_undegraded":"2024-09-15T22:45:21.514885+0000","last_fullsized":"2024-09-15T22:45:21.514885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.984849+0000","last_change":"2024-09-15T22:42:51.520095+0000","last_active":"2024-09-15T22:45:30.984849+0000","last_peered":"2024-09-15T22:45:30.984849+0000","last_clean":"2024-09-15T22:45:30.984849+0000","last_became_active":"2024-09-15T22:42:51.519749+0000","last_became_peered":"2024-09-15T22:42:51.519749+0000","last_unstale":"2024-09-15T22:45:30.984849+0000","last_undegraded":"2024-09-15T22:45:30.984849+0000","last_fullsized":"2024-09-15T22:45:30.984849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:01.724844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514471+0000","last_change":"2024-09-15T22:43:00.823744+0000","last_active":"2024-09-15T22:45:21.514471+0000","last_peered":"2024-09-15T22:45:21.514471+0000","last_clean":"2024-09-15T22:45:21.514471+0000","last_became_active":"2024-09-15T22:43:00.822905+0000","last_became_peered":"2024-09-15T22:43:00.822905+0000","last_unstale":"2024-09-15T22:45:21.514471+0000","last_undegraded":"2024-09-15T22:45:21.514471+0000","last_fullsized":"2024-09-15T22:45:21.514471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:35.282687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514839+0000","last_change":"2024-09-15T22:42:53.551666+0000","last_active":"2024-09-15T22:45:21.514839+0000","last_peered":"2024-09-15T22:45:21.514839+0000","last_clean":"2024-09-15T22:45:21.514839+0000","last_became_active":"2024-09-15T22:42:53.551297+0000","last_became_peered":"2024-09-15T22:42:53.551297+0000","last_unstale":"2024-09-15T22:45:21.514839+0000","last_undegraded":"2024-09-15T22:45:21.514839+0000","last_fullsized":"2024-09-15T22:45:21.514839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:16.801156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798926+0000","last_change":"2024-09-15T22:42:51.465573+0000","last_active":"2024-09-15T22:45:21.798926+0000","last_peered":"2024-09-15T22:45:21.798926+0000","last_clean":"2024-09-15T22:45:21.798926+0000","last_became_active":"2024-09-15T22:42:51.465256+0000","last_became_peered":"2024-09-15T22:42:51.465256+0000","last_unstale":"2024-09-15T22:45:21.798926+0000","last_undegraded":"2024-09-15T22:45:21.798926+0000","last_fullsized":"2024-09-15T22:45:21.798926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:48.587384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515353+0000","last_change":"2024-09-15T22:43:00.824927+0000","last_active":"2024-09-15T22:45:21.515353+0000","last_peered":"2024-09-15T22:45:21.515353+0000","last_clean":"2024-09-15T22:45:21.515353+0000","last_became_active":"2024-09-15T22:43:00.824488+0000","last_became_peered":"2024-09-15T22:43:00.824488+0000","last_unstale":"2024-09-15T22:45:21.515353+0000","last_undegraded":"2024-09-15T22:45:21.515353+0000","last_fullsized":"2024-09-15T22:45:21.515353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.632637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617489+0000","last_change":"2024-09-15T22:42:53.547424+0000","last_active":"2024-09-15T22:45:21.617489+0000","last_peered":"2024-09-15T22:45:21.617489+0000","last_clean":"2024-09-15T22:45:21.617489+0000","last_became_active":"2024-09-15T22:42:53.547120+0000","last_became_peered":"2024-09-15T22:42:53.547120+0000","last_unstale":"2024-09-15T22:45:21.617489+0000","last_undegraded":"2024-09-15T22:45:21.617489+0000","last_fullsized":"2024-09-15T22:45:21.617489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:08.605260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894720+0000","last_change":"2024-09-15T22:42:51.464076+0000","last_active":"2024-09-15T22:45:21.894720+0000","last_peered":"2024-09-15T22:45:21.894720+0000","last_clean":"2024-09-15T22:45:21.894720+0000","last_became_active":"2024-09-15T22:42:51.463640+0000","last_became_peered":"2024-09-15T22:42:51.463640+0000","last_unstale":"2024-09-15T22:45:21.894720+0000","last_undegraded":"2024-09-15T22:45:21.894720+0000","last_fullsized":"2024-09-15T22:45:21.894720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:47.928970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":405,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:23.625355+0000","last_change":"2024-09-15T22:41:41.933378+0000","last_active":"2024-09-15T22:45:23.625355+0000","last_peered":"2024-09-15T22:45:23.625355+0000","last_clean":"2024-09-15T22:45:23.625355+0000","last_became_active":"2024-09-15T22:41:41.932881+0000","last_became_peered":"2024-09-15T22:41:41.932881+0000","last_unstale":"2024-09-15T22:45:23.625355+0000","last_undegraded":"2024-09-15T22:45:23.625355+0000","last_fullsized":"2024-09-15T22:45:23.625355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:38:16.785472+0000","last_clean_scrub_stamp":"2024-09-15T22:38:16.785472+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:10.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799201+0000","last_change":"2024-09-15T22:45:02.156184+0000","last_active":"2024-09-15T22:45:21.799201+0000","last_peered":"2024-09-15T22:45:21.799201+0000","last_clean":"2024-09-15T22:45:21.799201+0000","last_became_active":"2024-09-15T22:45:02.151774+0000","last_became_peered":"2024-09-15T22:45:02.151774+0000","last_unstale":"2024-09-15T22:45:21.799201+0000","last_undegraded":"2024-09-15T22:45:21.799201+0000","last_fullsized":"2024-09-15T22:45:21.799201+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:13.325100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799326+0000","last_change":"2024-09-15T22:42:53.555002+0000","last_active":"2024-09-15T22:45:21.799326+0000","last_peered":"2024-09-15T22:45:21.799326+0000","last_clean":"2024-09-15T22:45:21.799326+0000","last_became_active":"2024-09-15T22:42:53.554281+0000","last_became_peered":"2024-09-15T22:42:53.554281+0000","last_unstale":"2024-09-15T22:45:21.799326+0000","last_undegraded":"2024-09-15T22:45:21.799326+0000","last_fullsized":"2024-09-15T22:45:21.799326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:20.516743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.023507+0000","last_change":"2024-09-15T22:42:51.521661+0000","last_active":"2024-09-15T22:45:31.023507+0000","last_peered":"2024-09-15T22:45:31.023507+0000","last_clean":"2024-09-15T22:45:31.023507+0000","last_became_active":"2024-09-15T22:42:51.520732+0000","last_became_peered":"2024-09-15T22:42:51.520732+0000","last_unstale":"2024-09-15T22:45:31.023507+0000","last_undegraded":"2024-09-15T22:45:31.023507+0000","last_fullsized":"2024-09-15T22:45:31.023507+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:25.765330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514925+0000","last_change":"2024-09-15T22:43:00.810515+0000","last_active":"2024-09-15T22:45:21.514925+0000","last_peered":"2024-09-15T22:45:21.514925+0000","last_clean":"2024-09-15T22:45:21.514925+0000","last_became_active":"2024-09-15T22:43:00.810071+0000","last_became_peered":"2024-09-15T22:43:00.810071+0000","last_unstale":"2024-09-15T22:45:21.514925+0000","last_undegraded":"2024-09-15T22:45:21.514925+0000","last_fullsized":"2024-09-15T22:45:21.514925+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:17.724979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799230+0000","last_change":"2024-09-15T22:44:02.367278+0000","last_active":"2024-09-15T22:45:21.799230+0000","last_peered":"2024-09-15T22:45:21.799230+0000","last_clean":"2024-09-15T22:45:21.799230+0000","last_became_active":"2024-09-15T22:44:02.366925+0000","last_became_peered":"2024-09-15T22:44:02.366925+0000","last_unstale":"2024-09-15T22:45:21.799230+0000","last_undegraded":"2024-09-15T22:45:21.799230+0000","last_fullsized":"2024-09-15T22:45:21.799230+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:04.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'67","reported_seq":139,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.314127+0000","last_change":"2024-09-15T22:42:51.464210+0000","last_active":"2024-09-15T22:45:30.314127+0000","last_peered":"2024-09-15T22:45:30.314127+0000","last_clean":"2024-09-15T22:45:30.314127+0000","last_became_active":"2024-09-15T22:42:51.462657+0000","last_became_peered":"2024-09-15T22:42:51.462657+0000","last_unstale":"2024-09-15T22:45:30.314127+0000","last_undegraded":"2024-09-15T22:45:30.314127+0000","last_fullsized":"2024-09-15T22:45:30.314127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:08.776474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801620+0000","last_change":"2024-09-15T22:45:02.170363+0000","last_active":"2024-09-15T22:45:21.801620+0000","last_peered":"2024-09-15T22:45:21.801620+0000","last_clean":"2024-09-15T22:45:21.801620+0000","last_became_active":"2024-09-15T22:45:02.170061+0000","last_became_peered":"2024-09-15T22:45:02.170061+0000","last_unstale":"2024-09-15T22:45:21.801620+0000","last_undegraded":"2024-09-15T22:45:21.801620+0000","last_fullsized":"2024-09-15T22:45:21.801620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:46.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799433+0000","last_change":"2024-09-15T22:42:53.553456+0000","last_active":"2024-09-15T22:45:21.799433+0000","last_peered":"2024-09-15T22:45:21.799433+0000","last_clean":"2024-09-15T22:45:21.799433+0000","last_became_active":"2024-09-15T22:42:53.553130+0000","last_became_peered":"2024-09-15T22:42:53.553130+0000","last_unstale":"2024-09-15T22:45:21.799433+0000","last_undegraded":"2024-09-15T22:45:21.799433+0000","last_fullsized":"2024-09-15T22:45:21.799433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:16.719034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514770+0000","last_change":"2024-09-15T22:42:51.461088+0000","last_active":"2024-09-15T22:45:21.514770+0000","last_peered":"2024-09-15T22:45:21.514770+0000","last_clean":"2024-09-15T22:45:21.514770+0000","last_became_active":"2024-09-15T22:42:51.460687+0000","last_became_peered":"2024-09-15T22:42:51.460687+0000","last_unstale":"2024-09-15T22:45:21.514770+0000","last_undegraded":"2024-09-15T22:45:21.514770+0000","last_fullsized":"2024-09-15T22:45:21.514770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.641551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514694+0000","last_change":"2024-09-15T22:43:00.811821+0000","last_active":"2024-09-15T22:45:21.514694+0000","last_peered":"2024-09-15T22:45:21.514694+0000","last_clean":"2024-09-15T22:45:21.514694+0000","last_became_active":"2024-09-15T22:43:00.811419+0000","last_became_peered":"2024-09-15T22:43:00.811419+0000","last_unstale":"2024-09-15T22:45:21.514694+0000","last_undegraded":"2024-09-15T22:45:21.514694+0000","last_fullsized":"2024-09-15T22:45:21.514694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:05.590395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800734+0000","last_change":"2024-09-15T22:42:53.546158+0000","last_active":"2024-09-15T22:45:21.800734+0000","last_peered":"2024-09-15T22:45:21.800734+0000","last_clean":"2024-09-15T22:45:21.800734+0000","last_became_active":"2024-09-15T22:42:53.545841+0000","last_became_peered":"2024-09-15T22:42:53.545841+0000","last_unstale":"2024-09-15T22:45:21.800734+0000","last_undegraded":"2024-09-15T22:45:21.800734+0000","last_fullsized":"2024-09-15T22:45:21.800734+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:07.703132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617206+0000","last_change":"2024-09-15T22:42:51.461761+0000","last_active":"2024-09-15T22:45:21.617206+0000","last_peered":"2024-09-15T22:45:21.617206+0000","last_clean":"2024-09-15T22:45:21.617206+0000","last_became_active":"2024-09-15T22:42:51.461177+0000","last_became_peered":"2024-09-15T22:42:51.461177+0000","last_unstale":"2024-09-15T22:45:21.617206+0000","last_undegraded":"2024-09-15T22:45:21.617206+0000","last_fullsized":"2024-09-15T22:45:21.617206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:31.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514853+0000","last_change":"2024-09-15T22:43:00.812040+0000","last_active":"2024-09-15T22:45:21.514853+0000","last_peered":"2024-09-15T22:45:21.514853+0000","last_clean":"2024-09-15T22:45:21.514853+0000","last_became_active":"2024-09-15T22:43:00.811497+0000","last_became_peered":"2024-09-15T22:43:00.811497+0000","last_unstale":"2024-09-15T22:45:21.514853+0000","last_undegraded":"2024-09-15T22:45:21.514853+0000","last_fullsized":"2024-09-15T22:45:21.514853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:45.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515008+0000","last_change":"2024-09-15T22:42:53.550347+0000","last_active":"2024-09-15T22:45:21.515008+0000","last_peered":"2024-09-15T22:45:21.515008+0000","last_clean":"2024-09-15T22:45:21.515008+0000","last_became_active":"2024-09-15T22:42:53.550027+0000","last_became_peered":"2024-09-15T22:42:53.550027+0000","last_unstale":"2024-09-15T22:45:21.515008+0000","last_undegraded":"2024-09-15T22:45:21.515008+0000","last_fullsized":"2024-09-15T22:45:21.515008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.316370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616733+0000","last_change":"2024-09-15T22:42:51.520684+0000","last_active":"2024-09-15T22:45:21.616733+0000","last_peered":"2024-09-15T22:45:21.616733+0000","last_clean":"2024-09-15T22:45:21.616733+0000","last_became_active":"2024-09-15T22:42:51.520157+0000","last_became_peered":"2024-09-15T22:42:51.520157+0000","last_unstale":"2024-09-15T22:45:21.616733+0000","last_undegraded":"2024-09-15T22:45:21.616733+0000","last_fullsized":"2024-09-15T22:45:21.616733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:51:10.865493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514715+0000","last_change":"2024-09-15T22:43:00.815878+0000","last_active":"2024-09-15T22:45:21.514715+0000","last_peered":"2024-09-15T22:45:21.514715+0000","last_clean":"2024-09-15T22:45:21.514715+0000","last_became_active":"2024-09-15T22:43:00.815490+0000","last_became_peered":"2024-09-15T22:43:00.815490+0000","last_unstale":"2024-09-15T22:45:21.514715+0000","last_undegraded":"2024-09-15T22:45:21.514715+0000","last_fullsized":"2024-09-15T22:45:21.514715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:51.835673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798820+0000","last_change":"2024-09-15T22:42:53.546563+0000","last_active":"2024-09-15T22:45:21.798820+0000","last_peered":"2024-09-15T22:45:21.798820+0000","last_clean":"2024-09-15T22:45:21.798820+0000","last_became_active":"2024-09-15T22:42:53.546230+0000","last_became_peered":"2024-09-15T22:42:53.546230+0000","last_unstale":"2024-09-15T22:45:21.798820+0000","last_undegraded":"2024-09-15T22:45:21.798820+0000","last_fullsized":"2024-09-15T22:45:21.798820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:20.925274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.985569+0000","last_change":"2024-09-15T22:42:51.465480+0000","last_active":"2024-09-15T22:45:30.985569+0000","last_peered":"2024-09-15T22:45:30.985569+0000","last_clean":"2024-09-15T22:45:30.985569+0000","last_became_active":"2024-09-15T22:42:51.465093+0000","last_became_peered":"2024-09-15T22:42:51.465093+0000","last_unstale":"2024-09-15T22:45:30.985569+0000","last_undegraded":"2024-09-15T22:45:30.985569+0000","last_fullsized":"2024-09-15T22:45:30.985569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:00.969155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.615687+0000","last_change":"2024-09-15T22:43:00.811755+0000","last_active":"2024-09-15T22:45:21.615687+0000","last_peered":"2024-09-15T22:45:21.615687+0000","last_clean":"2024-09-15T22:45:21.615687+0000","last_became_active":"2024-09-15T22:43:00.811371+0000","last_became_peered":"2024-09-15T22:43:00.811371+0000","last_unstale":"2024-09-15T22:45:21.615687+0000","last_undegraded":"2024-09-15T22:45:21.615687+0000","last_fullsized":"2024-09-15T22:45:21.615687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:09:31.429501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799035+0000","last_change":"2024-09-15T22:42:53.550586+0000","last_active":"2024-09-15T22:45:21.799035+0000","last_peered":"2024-09-15T22:45:21.799035+0000","last_clean":"2024-09-15T22:45:21.799035+0000","last_became_active":"2024-09-15T22:42:53.550223+0000","last_became_peered":"2024-09-15T22:42:53.550223+0000","last_unstale":"2024-09-15T22:45:21.799035+0000","last_undegraded":"2024-09-15T22:45:21.799035+0000","last_fullsized":"2024-09-15T22:45:21.799035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:44.733593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515033+0000","last_change":"2024-09-15T22:42:51.463904+0000","last_active":"2024-09-15T22:45:21.515033+0000","last_peered":"2024-09-15T22:45:21.515033+0000","last_clean":"2024-09-15T22:45:21.515033+0000","last_became_active":"2024-09-15T22:42:51.463560+0000","last_became_peered":"2024-09-15T22:42:51.463560+0000","last_unstale":"2024-09-15T22:45:21.515033+0000","last_undegraded":"2024-09-15T22:45:21.515033+0000","last_fullsized":"2024-09-15T22:45:21.515033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:19.554682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800568+0000","last_change":"2024-09-15T22:43:00.815060+0000","last_active":"2024-09-15T22:45:21.800568+0000","last_peered":"2024-09-15T22:45:21.800568+0000","last_clean":"2024-09-15T22:45:21.800568+0000","last_became_active":"2024-09-15T22:43:00.814643+0000","last_became_peered":"2024-09-15T22:43:00.814643+0000","last_unstale":"2024-09-15T22:45:21.800568+0000","last_undegraded":"2024-09-15T22:45:21.800568+0000","last_fullsized":"2024-09-15T22:45:21.800568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:34.424371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514197+0000","last_change":"2024-09-15T22:42:53.544807+0000","last_active":"2024-09-15T22:45:21.514197+0000","last_peered":"2024-09-15T22:45:21.514197+0000","last_clean":"2024-09-15T22:45:21.514197+0000","last_became_active":"2024-09-15T22:42:53.544480+0000","last_became_peered":"2024-09-15T22:42:53.544480+0000","last_unstale":"2024-09-15T22:45:21.514197+0000","last_undegraded":"2024-09-15T22:45:21.514197+0000","last_fullsized":"2024-09-15T22:45:21.514197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:08.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800490+0000","last_change":"2024-09-15T22:44:02.126528+0000","last_active":"2024-09-15T22:45:21.800490+0000","last_peered":"2024-09-15T22:45:21.800490+0000","last_clean":"2024-09-15T22:45:21.800490+0000","last_became_active":"2024-09-15T22:44:02.110845+0000","last_became_peered":"2024-09-15T22:44:02.110845+0000","last_unstale":"2024-09-15T22:45:21.800490+0000","last_undegraded":"2024-09-15T22:45:21.800490+0000","last_fullsized":"2024-09-15T22:45:21.800490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:57.026306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515351+0000","last_change":"2024-09-15T22:43:00.812903+0000","last_active":"2024-09-15T22:45:21.515351+0000","last_peered":"2024-09-15T22:45:21.515351+0000","last_clean":"2024-09-15T22:45:21.515351+0000","last_became_active":"2024-09-15T22:43:00.812511+0000","last_became_peered":"2024-09-15T22:43:00.812511+0000","last_unstale":"2024-09-15T22:45:21.515351+0000","last_undegraded":"2024-09-15T22:45:21.515351+0000","last_fullsized":"2024-09-15T22:45:21.515351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:03.953719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617109+0000","last_change":"2024-09-15T22:42:53.546521+0000","last_active":"2024-09-15T22:45:21.617109+0000","last_peered":"2024-09-15T22:45:21.617109+0000","last_clean":"2024-09-15T22:45:21.617109+0000","last_became_active":"2024-09-15T22:42:53.546181+0000","last_became_peered":"2024-09-15T22:42:53.546181+0000","last_unstale":"2024-09-15T22:45:21.617109+0000","last_undegraded":"2024-09-15T22:45:21.617109+0000","last_fullsized":"2024-09-15T22:45:21.617109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:34.457111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":323,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.949590+0000","last_change":"2024-09-15T22:42:51.465177+0000","last_active":"2024-09-15T22:45:31.949590+0000","last_peered":"2024-09-15T22:45:31.949590+0000","last_clean":"2024-09-15T22:45:31.949590+0000","last_became_active":"2024-09-15T22:42:51.464854+0000","last_became_peered":"2024-09-15T22:42:51.464854+0000","last_unstale":"2024-09-15T22:45:31.949590+0000","last_undegraded":"2024-09-15T22:45:31.949590+0000","last_fullsized":"2024-09-15T22:45:31.949590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:00.847850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68792,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":189,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613706+0000","last_change":"2024-09-15T22:43:00.817112+0000","last_active":"2024-09-15T22:45:21.613706+0000","last_peered":"2024-09-15T22:45:21.613706+0000","last_clean":"2024-09-15T22:45:21.613706+0000","last_became_active":"2024-09-15T22:43:00.816727+0000","last_became_peered":"2024-09-15T22:43:00.816727+0000","last_unstale":"2024-09-15T22:45:21.613706+0000","last_undegraded":"2024-09-15T22:45:21.613706+0000","last_fullsized":"2024-09-15T22:45:21.613706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:03.155518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515386+0000","last_change":"2024-09-15T22:44:02.108255+0000","last_active":"2024-09-15T22:45:21.515386+0000","last_peered":"2024-09-15T22:45:21.515386+0000","last_clean":"2024-09-15T22:45:21.515386+0000","last_became_active":"2024-09-15T22:44:02.107818+0000","last_became_peered":"2024-09-15T22:44:02.107818+0000","last_unstale":"2024-09-15T22:45:21.515386+0000","last_undegraded":"2024-09-15T22:45:21.515386+0000","last_fullsized":"2024-09-15T22:45:21.515386+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:50.034902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515736+0000","last_change":"2024-09-15T22:42:51.522182+0000","last_active":"2024-09-15T22:45:21.515736+0000","last_peered":"2024-09-15T22:45:21.515736+0000","last_clean":"2024-09-15T22:45:21.515736+0000","last_became_active":"2024-09-15T22:42:51.521779+0000","last_became_peered":"2024-09-15T22:42:51.521779+0000","last_unstale":"2024-09-15T22:45:21.515736+0000","last_undegraded":"2024-09-15T22:45:21.515736+0000","last_fullsized":"2024-09-15T22:45:21.515736+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:45:30.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894673+0000","last_change":"2024-09-15T22:43:00.819506+0000","last_active":"2024-09-15T22:45:21.894673+0000","last_peered":"2024-09-15T22:45:21.894673+0000","last_clean":"2024-09-15T22:45:21.894673+0000","last_became_active":"2024-09-15T22:43:00.819116+0000","last_became_peered":"2024-09-15T22:43:00.819116+0000","last_unstale":"2024-09-15T22:45:21.894673+0000","last_undegraded":"2024-09-15T22:45:21.894673+0000","last_fullsized":"2024-09-15T22:45:21.894673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:15.277162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802484+0000","last_change":"2024-09-15T22:45:02.168969+0000","last_active":"2024-09-15T22:45:21.802484+0000","last_peered":"2024-09-15T22:45:21.802484+0000","last_clean":"2024-09-15T22:45:21.802484+0000","last_became_active":"2024-09-15T22:45:02.168661+0000","last_became_peered":"2024-09-15T22:45:02.168661+0000","last_unstale":"2024-09-15T22:45:21.802484+0000","last_undegraded":"2024-09-15T22:45:21.802484+0000","last_fullsized":"2024-09-15T22:45:21.802484+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:59.881598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799318+0000","last_change":"2024-09-15T22:42:51.467043+0000","last_active":"2024-09-15T22:45:21.799318+0000","last_peered":"2024-09-15T22:45:21.799318+0000","last_clean":"2024-09-15T22:45:21.799318+0000","last_became_active":"2024-09-15T22:42:51.466725+0000","last_became_peered":"2024-09-15T22:42:51.466725+0000","last_unstale":"2024-09-15T22:45:21.799318+0000","last_undegraded":"2024-09-15T22:45:21.799318+0000","last_fullsized":"2024-09-15T22:45:21.799318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:51.316242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613609+0000","last_change":"2024-09-15T22:43:00.818408+0000","last_active":"2024-09-15T22:45:21.613609+0000","last_peered":"2024-09-15T22:45:21.613609+0000","last_clean":"2024-09-15T22:45:21.613609+0000","last_became_active":"2024-09-15T22:43:00.817580+0000","last_became_peered":"2024-09-15T22:43:00.817580+0000","last_unstale":"2024-09-15T22:45:21.613609+0000","last_undegraded":"2024-09-15T22:45:21.613609+0000","last_fullsized":"2024-09-15T22:45:21.613609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:54.353639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515720+0000","last_change":"2024-09-15T22:42:53.549746+0000","last_active":"2024-09-15T22:45:21.515720+0000","last_peered":"2024-09-15T22:45:21.515720+0000","last_clean":"2024-09-15T22:45:21.515720+0000","last_became_active":"2024-09-15T22:42:53.549025+0000","last_became_peered":"2024-09-15T22:42:53.549025+0000","last_unstale":"2024-09-15T22:45:21.515720+0000","last_undegraded":"2024-09-15T22:45:21.515720+0000","last_fullsized":"2024-09-15T22:45:21.515720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:51.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:31.949622+0000","last_change":"2024-09-15T22:42:51.468863+0000","last_active":"2024-09-15T22:45:31.949622+0000","last_peered":"2024-09-15T22:45:31.949622+0000","last_clean":"2024-09-15T22:45:31.949622+0000","last_became_active":"2024-09-15T22:42:51.468520+0000","last_became_peered":"2024-09-15T22:42:51.468520+0000","last_unstale":"2024-09-15T22:45:31.949622+0000","last_undegraded":"2024-09-15T22:45:31.949622+0000","last_fullsized":"2024-09-15T22:45:31.949622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:24.909554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617173+0000","last_change":"2024-09-15T22:43:00.810984+0000","last_active":"2024-09-15T22:45:21.617173+0000","last_peered":"2024-09-15T22:45:21.617173+0000","last_clean":"2024-09-15T22:45:21.617173+0000","last_became_active":"2024-09-15T22:43:00.810435+0000","last_became_peered":"2024-09-15T22:43:00.810435+0000","last_unstale":"2024-09-15T22:45:21.617173+0000","last_undegraded":"2024-09-15T22:45:21.617173+0000","last_fullsized":"2024-09-15T22:45:21.617173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:28.445051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802053+0000","last_change":"2024-09-15T22:43:00.811009+0000","last_active":"2024-09-15T22:45:21.802053+0000","last_peered":"2024-09-15T22:45:21.802053+0000","last_clean":"2024-09-15T22:45:21.802053+0000","last_became_active":"2024-09-15T22:43:00.810588+0000","last_became_peered":"2024-09-15T22:43:00.810588+0000","last_unstale":"2024-09-15T22:45:21.802053+0000","last_undegraded":"2024-09-15T22:45:21.802053+0000","last_fullsized":"2024-09-15T22:45:21.802053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:56.945732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.613306+0000","last_change":"2024-09-15T22:42:53.541946+0000","last_active":"2024-09-15T22:45:21.613306+0000","last_peered":"2024-09-15T22:45:21.613306+0000","last_clean":"2024-09-15T22:45:21.613306+0000","last_became_active":"2024-09-15T22:42:53.541614+0000","last_became_peered":"2024-09-15T22:42:53.541614+0000","last_unstale":"2024-09-15T22:45:21.613306+0000","last_undegraded":"2024-09-15T22:45:21.613306+0000","last_fullsized":"2024-09-15T22:45:21.613306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:22.151569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515184+0000","last_change":"2024-09-15T22:42:51.463969+0000","last_active":"2024-09-15T22:45:21.515184+0000","last_peered":"2024-09-15T22:45:21.515184+0000","last_clean":"2024-09-15T22:45:21.515184+0000","last_became_active":"2024-09-15T22:42:51.463606+0000","last_became_peered":"2024-09-15T22:42:51.463606+0000","last_unstale":"2024-09-15T22:45:21.515184+0000","last_undegraded":"2024-09-15T22:45:21.515184+0000","last_fullsized":"2024-09-15T22:45:21.515184+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.638457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800528+0000","last_change":"2024-09-15T22:43:00.816036+0000","last_active":"2024-09-15T22:45:21.800528+0000","last_peered":"2024-09-15T22:45:21.800528+0000","last_clean":"2024-09-15T22:45:21.800528+0000","last_became_active":"2024-09-15T22:43:00.815615+0000","last_became_peered":"2024-09-15T22:43:00.815615+0000","last_unstale":"2024-09-15T22:45:21.800528+0000","last_undegraded":"2024-09-15T22:45:21.800528+0000","last_fullsized":"2024-09-15T22:45:21.800528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:34.406778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617245+0000","last_change":"2024-09-15T22:42:53.541228+0000","last_active":"2024-09-15T22:45:21.617245+0000","last_peered":"2024-09-15T22:45:21.617245+0000","last_clean":"2024-09-15T22:45:21.617245+0000","last_became_active":"2024-09-15T22:42:53.540922+0000","last_became_peered":"2024-09-15T22:42:53.540922+0000","last_unstale":"2024-09-15T22:45:21.617245+0000","last_undegraded":"2024-09-15T22:45:21.617245+0000","last_fullsized":"2024-09-15T22:45:21.617245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:12.833942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514068+0000","last_change":"2024-09-15T22:42:51.458698+0000","last_active":"2024-09-15T22:45:21.514068+0000","last_peered":"2024-09-15T22:45:21.514068+0000","last_clean":"2024-09-15T22:45:21.514068+0000","last_became_active":"2024-09-15T22:42:51.458346+0000","last_became_peered":"2024-09-15T22:42:51.458346+0000","last_unstale":"2024-09-15T22:45:21.514068+0000","last_undegraded":"2024-09-15T22:45:21.514068+0000","last_fullsized":"2024-09-15T22:45:21.514068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:03.084239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626497+0000","last_change":"2024-09-15T22:44:02.310276+0000","last_active":"2024-09-15T22:45:21.626497+0000","last_peered":"2024-09-15T22:45:21.626497+0000","last_clean":"2024-09-15T22:45:21.626497+0000","last_became_active":"2024-09-15T22:44:02.305420+0000","last_became_peered":"2024-09-15T22:44:02.305420+0000","last_unstale":"2024-09-15T22:45:21.626497+0000","last_undegraded":"2024-09-15T22:45:21.626497+0000","last_fullsized":"2024-09-15T22:45:21.626497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.009927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515254+0000","last_change":"2024-09-15T22:42:53.549704+0000","last_active":"2024-09-15T22:45:21.515254+0000","last_peered":"2024-09-15T22:45:21.515254+0000","last_clean":"2024-09-15T22:45:21.515254+0000","last_became_active":"2024-09-15T22:42:53.548854+0000","last_became_peered":"2024-09-15T22:42:53.548854+0000","last_unstale":"2024-09-15T22:45:21.515254+0000","last_undegraded":"2024-09-15T22:45:21.515254+0000","last_fullsized":"2024-09-15T22:45:21.515254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.405293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798990+0000","last_change":"2024-09-15T22:43:00.808353+0000","last_active":"2024-09-15T22:45:21.798990+0000","last_peered":"2024-09-15T22:45:21.798990+0000","last_clean":"2024-09-15T22:45:21.798990+0000","last_became_active":"2024-09-15T22:43:00.807906+0000","last_became_peered":"2024-09-15T22:43:00.807906+0000","last_unstale":"2024-09-15T22:45:21.798990+0000","last_undegraded":"2024-09-15T22:45:21.798990+0000","last_fullsized":"2024-09-15T22:45:21.798990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:50.114654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:30.948743+0000","last_change":"2024-09-15T22:42:51.464121+0000","last_active":"2024-09-15T22:45:30.948743+0000","last_peered":"2024-09-15T22:45:30.948743+0000","last_clean":"2024-09-15T22:45:30.948743+0000","last_became_active":"2024-09-15T22:42:51.463725+0000","last_became_peered":"2024-09-15T22:42:51.463725+0000","last_unstale":"2024-09-15T22:45:30.948743+0000","last_undegraded":"2024-09-15T22:45:30.948743+0000","last_fullsized":"2024-09-15T22:45:30.948743+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:50.446767+0000","last_clean_scrub_stamp":"2024-09-15T22:42:50.446767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.418757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616875+0000","last_change":"2024-09-15T22:42:53.540612+0000","last_active":"2024-09-15T22:45:21.616875+0000","last_peered":"2024-09-15T22:45:21.616875+0000","last_clean":"2024-09-15T22:45:21.616875+0000","last_became_active":"2024-09-15T22:42:53.540304+0000","last_became_peered":"2024-09-15T22:42:53.540304+0000","last_unstale":"2024-09-15T22:45:21.616875+0000","last_undegraded":"2024-09-15T22:45:21.616875+0000","last_fullsized":"2024-09-15T22:45:21.616875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:27.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798944+0000","last_change":"2024-09-15T22:43:00.815790+0000","last_active":"2024-09-15T22:45:21.798944+0000","last_peered":"2024-09-15T22:45:21.798944+0000","last_clean":"2024-09-15T22:45:21.798944+0000","last_became_active":"2024-09-15T22:43:00.815384+0000","last_became_peered":"2024-09-15T22:43:00.815384+0000","last_unstale":"2024-09-15T22:45:21.798944+0000","last_undegraded":"2024-09-15T22:45:21.798944+0000","last_fullsized":"2024-09-15T22:45:21.798944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:59.792952+0000","last_clean_scrub_stamp":"2024-09-15T22:42:59.792952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.984548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800348+0000","last_change":"2024-09-15T22:42:53.548542+0000","last_active":"2024-09-15T22:45:21.800348+0000","last_peered":"2024-09-15T22:45:21.800348+0000","last_clean":"2024-09-15T22:45:21.800348+0000","last_became_active":"2024-09-15T22:42:53.548190+0000","last_became_peered":"2024-09-15T22:42:53.548190+0000","last_unstale":"2024-09-15T22:45:21.800348+0000","last_undegraded":"2024-09-15T22:45:21.800348+0000","last_fullsized":"2024-09-15T22:45:21.800348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:44.313986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799017+0000","last_change":"2024-09-15T22:42:53.546253+0000","last_active":"2024-09-15T22:45:21.799017+0000","last_peered":"2024-09-15T22:45:21.799017+0000","last_clean":"2024-09-15T22:45:21.799017+0000","last_became_active":"2024-09-15T22:42:53.545844+0000","last_became_peered":"2024-09-15T22:42:53.545844+0000","last_unstale":"2024-09-15T22:45:21.799017+0000","last_undegraded":"2024-09-15T22:45:21.799017+0000","last_fullsized":"2024-09-15T22:45:21.799017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:49.065459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798770+0000","last_change":"2024-09-15T22:42:53.550542+0000","last_active":"2024-09-15T22:45:21.798770+0000","last_peered":"2024-09-15T22:45:21.798770+0000","last_clean":"2024-09-15T22:45:21.798770+0000","last_became_active":"2024-09-15T22:42:53.550191+0000","last_became_peered":"2024-09-15T22:42:53.550191+0000","last_unstale":"2024-09-15T22:45:21.798770+0000","last_undegraded":"2024-09-15T22:45:21.798770+0000","last_fullsized":"2024-09-15T22:45:21.798770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:30.748809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801651+0000","last_change":"2024-09-15T22:42:53.548154+0000","last_active":"2024-09-15T22:45:21.801651+0000","last_peered":"2024-09-15T22:45:21.801651+0000","last_clean":"2024-09-15T22:45:21.801651+0000","last_became_active":"2024-09-15T22:42:53.547465+0000","last_became_peered":"2024-09-15T22:42:53.547465+0000","last_unstale":"2024-09-15T22:45:21.801651+0000","last_undegraded":"2024-09-15T22:45:21.801651+0000","last_fullsized":"2024-09-15T22:45:21.801651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:14.427156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514539+0000","last_change":"2024-09-15T22:42:53.544410+0000","last_active":"2024-09-15T22:45:21.514539+0000","last_peered":"2024-09-15T22:45:21.514539+0000","last_clean":"2024-09-15T22:45:21.514539+0000","last_became_active":"2024-09-15T22:42:53.544100+0000","last_became_peered":"2024-09-15T22:42:53.544100+0000","last_unstale":"2024-09-15T22:45:21.514539+0000","last_undegraded":"2024-09-15T22:45:21.514539+0000","last_fullsized":"2024-09-15T22:45:21.514539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:32.216157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800733+0000","last_change":"2024-09-15T22:42:53.547159+0000","last_active":"2024-09-15T22:45:21.800733+0000","last_peered":"2024-09-15T22:45:21.800733+0000","last_clean":"2024-09-15T22:45:21.800733+0000","last_became_active":"2024-09-15T22:42:53.546792+0000","last_became_peered":"2024-09-15T22:42:53.546792+0000","last_unstale":"2024-09-15T22:45:21.800733+0000","last_undegraded":"2024-09-15T22:45:21.800733+0000","last_fullsized":"2024-09-15T22:45:21.800733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:53.157637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799147+0000","last_change":"2024-09-15T22:42:53.547613+0000","last_active":"2024-09-15T22:45:21.799147+0000","last_peered":"2024-09-15T22:45:21.799147+0000","last_clean":"2024-09-15T22:45:21.799147+0000","last_became_active":"2024-09-15T22:42:53.546776+0000","last_became_peered":"2024-09-15T22:42:53.546776+0000","last_unstale":"2024-09-15T22:45:21.799147+0000","last_undegraded":"2024-09-15T22:45:21.799147+0000","last_fullsized":"2024-09-15T22:45:21.799147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:47.007926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617976+0000","last_change":"2024-09-15T22:42:53.551824+0000","last_active":"2024-09-15T22:45:21.617976+0000","last_peered":"2024-09-15T22:45:21.617976+0000","last_clean":"2024-09-15T22:45:21.617976+0000","last_became_active":"2024-09-15T22:42:53.551460+0000","last_became_peered":"2024-09-15T22:42:53.551460+0000","last_unstale":"2024-09-15T22:45:21.617976+0000","last_undegraded":"2024-09-15T22:45:21.617976+0000","last_fullsized":"2024-09-15T22:45:21.617976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:31.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514850+0000","last_change":"2024-09-15T22:42:53.546439+0000","last_active":"2024-09-15T22:45:21.514850+0000","last_peered":"2024-09-15T22:45:21.514850+0000","last_clean":"2024-09-15T22:45:21.514850+0000","last_became_active":"2024-09-15T22:42:53.546036+0000","last_became_peered":"2024-09-15T22:42:53.546036+0000","last_unstale":"2024-09-15T22:45:21.514850+0000","last_undegraded":"2024-09-15T22:45:21.514850+0000","last_fullsized":"2024-09-15T22:45:21.514850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.267043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617257+0000","last_change":"2024-09-15T22:42:53.553942+0000","last_active":"2024-09-15T22:45:21.617257+0000","last_peered":"2024-09-15T22:45:21.617257+0000","last_clean":"2024-09-15T22:45:21.617257+0000","last_became_active":"2024-09-15T22:42:53.553535+0000","last_became_peered":"2024-09-15T22:42:53.553535+0000","last_unstale":"2024-09-15T22:45:21.617257+0000","last_undegraded":"2024-09-15T22:45:21.617257+0000","last_fullsized":"2024-09-15T22:45:21.617257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:51.540900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515150+0000","last_change":"2024-09-15T22:42:53.552820+0000","last_active":"2024-09-15T22:45:21.515150+0000","last_peered":"2024-09-15T22:45:21.515150+0000","last_clean":"2024-09-15T22:45:21.515150+0000","last_became_active":"2024-09-15T22:42:53.549395+0000","last_became_peered":"2024-09-15T22:42:53.549395+0000","last_unstale":"2024-09-15T22:45:21.515150+0000","last_undegraded":"2024-09-15T22:45:21.515150+0000","last_fullsized":"2024-09-15T22:45:21.515150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:19.590216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514458+0000","last_change":"2024-09-15T22:42:53.544537+0000","last_active":"2024-09-15T22:45:21.514458+0000","last_peered":"2024-09-15T22:45:21.514458+0000","last_clean":"2024-09-15T22:45:21.514458+0000","last_became_active":"2024-09-15T22:42:53.544222+0000","last_became_peered":"2024-09-15T22:42:53.544222+0000","last_unstale":"2024-09-15T22:45:21.514458+0000","last_undegraded":"2024-09-15T22:45:21.514458+0000","last_fullsized":"2024-09-15T22:45:21.514458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:21.521822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800616+0000","last_change":"2024-09-15T22:42:53.544952+0000","last_active":"2024-09-15T22:45:21.800616+0000","last_peered":"2024-09-15T22:45:21.800616+0000","last_clean":"2024-09-15T22:45:21.800616+0000","last_became_active":"2024-09-15T22:42:53.544623+0000","last_became_peered":"2024-09-15T22:42:53.544623+0000","last_unstale":"2024-09-15T22:45:21.800616+0000","last_undegraded":"2024-09-15T22:45:21.800616+0000","last_fullsized":"2024-09-15T22:45:21.800616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:43.424489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799027+0000","last_change":"2024-09-15T22:42:53.550844+0000","last_active":"2024-09-15T22:45:21.799027+0000","last_peered":"2024-09-15T22:45:21.799027+0000","last_clean":"2024-09-15T22:45:21.799027+0000","last_became_active":"2024-09-15T22:42:53.549726+0000","last_became_peered":"2024-09-15T22:42:53.549726+0000","last_unstale":"2024-09-15T22:45:21.799027+0000","last_undegraded":"2024-09-15T22:45:21.799027+0000","last_fullsized":"2024-09-15T22:45:21.799027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:37.180198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.614623+0000","last_change":"2024-09-15T22:42:53.540259+0000","last_active":"2024-09-15T22:45:21.614623+0000","last_peered":"2024-09-15T22:45:21.614623+0000","last_clean":"2024-09-15T22:45:21.614623+0000","last_became_active":"2024-09-15T22:42:53.539941+0000","last_became_peered":"2024-09-15T22:42:53.539941+0000","last_unstale":"2024-09-15T22:45:21.614623+0000","last_undegraded":"2024-09-15T22:45:21.614623+0000","last_fullsized":"2024-09-15T22:45:21.614623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:55.795634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800825+0000","last_change":"2024-09-15T22:42:53.548102+0000","last_active":"2024-09-15T22:45:21.800825+0000","last_peered":"2024-09-15T22:45:21.800825+0000","last_clean":"2024-09-15T22:45:21.800825+0000","last_became_active":"2024-09-15T22:42:53.547467+0000","last_became_peered":"2024-09-15T22:42:53.547467+0000","last_unstale":"2024-09-15T22:45:21.800825+0000","last_undegraded":"2024-09-15T22:45:21.800825+0000","last_fullsized":"2024-09-15T22:45:21.800825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:08.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514887+0000","last_change":"2024-09-15T22:42:53.550115+0000","last_active":"2024-09-15T22:45:21.514887+0000","last_peered":"2024-09-15T22:45:21.514887+0000","last_clean":"2024-09-15T22:45:21.514887+0000","last_became_active":"2024-09-15T22:42:53.549516+0000","last_became_peered":"2024-09-15T22:42:53.549516+0000","last_unstale":"2024-09-15T22:45:21.514887+0000","last_undegraded":"2024-09-15T22:45:21.514887+0000","last_fullsized":"2024-09-15T22:45:21.514887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:21.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801264+0000","last_change":"2024-09-15T22:44:02.115253+0000","last_active":"2024-09-15T22:45:21.801264+0000","last_peered":"2024-09-15T22:45:21.801264+0000","last_clean":"2024-09-15T22:45:21.801264+0000","last_became_active":"2024-09-15T22:44:02.114898+0000","last_became_peered":"2024-09-15T22:44:02.114898+0000","last_unstale":"2024-09-15T22:45:21.801264+0000","last_undegraded":"2024-09-15T22:45:21.801264+0000","last_fullsized":"2024-09-15T22:45:21.801264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.632992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801329+0000","last_change":"2024-09-15T22:42:53.544732+0000","last_active":"2024-09-15T22:45:21.801329+0000","last_peered":"2024-09-15T22:45:21.801329+0000","last_clean":"2024-09-15T22:45:21.801329+0000","last_became_active":"2024-09-15T22:42:53.544414+0000","last_became_peered":"2024-09-15T22:42:53.544414+0000","last_unstale":"2024-09-15T22:45:21.801329+0000","last_undegraded":"2024-09-15T22:45:21.801329+0000","last_fullsized":"2024-09-15T22:45:21.801329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:18.948804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.514514+0000","last_change":"2024-09-15T22:44:02.367418+0000","last_active":"2024-09-15T22:45:21.514514+0000","last_peered":"2024-09-15T22:45:21.514514+0000","last_clean":"2024-09-15T22:45:21.514514+0000","last_became_active":"2024-09-15T22:44:02.367037+0000","last_became_peered":"2024-09-15T22:44:02.367037+0000","last_unstale":"2024-09-15T22:45:21.514514+0000","last_undegraded":"2024-09-15T22:45:21.514514+0000","last_fullsized":"2024-09-15T22:45:21.514514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:24.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894774+0000","last_change":"2024-09-15T22:42:53.545361+0000","last_active":"2024-09-15T22:45:21.894774+0000","last_peered":"2024-09-15T22:45:21.894774+0000","last_clean":"2024-09-15T22:45:21.894774+0000","last_became_active":"2024-09-15T22:42:53.545064+0000","last_became_peered":"2024-09-15T22:42:53.545064+0000","last_unstale":"2024-09-15T22:45:21.894774+0000","last_undegraded":"2024-09-15T22:45:21.894774+0000","last_fullsized":"2024-09-15T22:45:21.894774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:13.639351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.799350+0000","last_change":"2024-09-15T22:42:53.556077+0000","last_active":"2024-09-15T22:45:21.799350+0000","last_peered":"2024-09-15T22:45:21.799350+0000","last_clean":"2024-09-15T22:45:21.799350+0000","last_became_active":"2024-09-15T22:42:53.554688+0000","last_became_peered":"2024-09-15T22:42:53.554688+0000","last_unstale":"2024-09-15T22:45:21.799350+0000","last_undegraded":"2024-09-15T22:45:21.799350+0000","last_fullsized":"2024-09-15T22:45:21.799350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.589427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626889+0000","last_change":"2024-09-15T22:42:53.549005+0000","last_active":"2024-09-15T22:45:21.626889+0000","last_peered":"2024-09-15T22:45:21.626889+0000","last_clean":"2024-09-15T22:45:21.626889+0000","last_became_active":"2024-09-15T22:42:53.548690+0000","last_became_peered":"2024-09-15T22:42:53.548690+0000","last_unstale":"2024-09-15T22:45:21.626889+0000","last_undegraded":"2024-09-15T22:45:21.626889+0000","last_fullsized":"2024-09-15T22:45:21.626889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.702141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.515781+0000","last_change":"2024-09-15T22:44:02.108335+0000","last_active":"2024-09-15T22:45:21.515781+0000","last_peered":"2024-09-15T22:45:21.515781+0000","last_clean":"2024-09-15T22:45:21.515781+0000","last_became_active":"2024-09-15T22:44:02.107906+0000","last_became_peered":"2024-09-15T22:44:02.107906+0000","last_unstale":"2024-09-15T22:45:21.515781+0000","last_undegraded":"2024-09-15T22:45:21.515781+0000","last_fullsized":"2024-09-15T22:45:21.515781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:07.459792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.617145+0000","last_change":"2024-09-15T22:42:53.543815+0000","last_active":"2024-09-15T22:45:21.617145+0000","last_peered":"2024-09-15T22:45:21.617145+0000","last_clean":"2024-09-15T22:45:21.617145+0000","last_became_active":"2024-09-15T22:42:53.542635+0000","last_became_peered":"2024-09-15T22:42:53.542635+0000","last_unstale":"2024-09-15T22:45:21.617145+0000","last_undegraded":"2024-09-15T22:45:21.617145+0000","last_fullsized":"2024-09-15T22:45:21.617145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:22.289081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.798920+0000","last_change":"2024-09-15T22:42:53.547030+0000","last_active":"2024-09-15T22:45:21.798920+0000","last_peered":"2024-09-15T22:45:21.798920+0000","last_clean":"2024-09-15T22:45:21.798920+0000","last_became_active":"2024-09-15T22:42:53.546432+0000","last_became_peered":"2024-09-15T22:42:53.546432+0000","last_unstale":"2024-09-15T22:45:21.798920+0000","last_undegraded":"2024-09-15T22:45:21.798920+0000","last_fullsized":"2024-09-15T22:45:21.798920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:10:20.840045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.626500+0000","last_change":"2024-09-15T22:42:53.544693+0000","last_active":"2024-09-15T22:45:21.626500+0000","last_peered":"2024-09-15T22:45:21.626500+0000","last_clean":"2024-09-15T22:45:21.626500+0000","last_became_active":"2024-09-15T22:42:53.544341+0000","last_became_peered":"2024-09-15T22:42:53.544341+0000","last_unstale":"2024-09-15T22:45:21.626500+0000","last_undegraded":"2024-09-15T22:45:21.626500+0000","last_fullsized":"2024-09-15T22:45:21.626500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:55.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.616951+0000","last_change":"2024-09-15T22:42:53.542167+0000","last_active":"2024-09-15T22:45:21.616951+0000","last_peered":"2024-09-15T22:45:21.616951+0000","last_clean":"2024-09-15T22:45:21.616951+0000","last_became_active":"2024-09-15T22:42:53.541819+0000","last_became_peered":"2024-09-15T22:42:53.541819+0000","last_unstale":"2024-09-15T22:45:21.616951+0000","last_undegraded":"2024-09-15T22:45:21.616951+0000","last_fullsized":"2024-09-15T22:45:21.616951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:34.925450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.894632+0000","last_change":"2024-09-15T22:42:53.555692+0000","last_active":"2024-09-15T22:45:21.894632+0000","last_peered":"2024-09-15T22:45:21.894632+0000","last_clean":"2024-09-15T22:45:21.894632+0000","last_became_active":"2024-09-15T22:42:53.551508+0000","last_became_peered":"2024-09-15T22:42:53.551508+0000","last_unstale":"2024-09-15T22:45:21.894632+0000","last_undegraded":"2024-09-15T22:45:21.894632+0000","last_fullsized":"2024-09-15T22:45:21.894632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:01.245498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.801770+0000","last_change":"2024-09-15T22:42:53.551538+0000","last_active":"2024-09-15T22:45:21.801770+0000","last_peered":"2024-09-15T22:45:21.801770+0000","last_clean":"2024-09-15T22:45:21.801770+0000","last_became_active":"2024-09-15T22:42:53.551255+0000","last_became_peered":"2024-09-15T22:42:53.551255+0000","last_unstale":"2024-09-15T22:45:21.801770+0000","last_undegraded":"2024-09-15T22:45:21.801770+0000","last_fullsized":"2024-09-15T22:45:21.801770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:18.304139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.802172+0000","last_change":"2024-09-15T22:42:53.545685+0000","last_active":"2024-09-15T22:45:21.802172+0000","last_peered":"2024-09-15T22:45:21.802172+0000","last_clean":"2024-09-15T22:45:21.802172+0000","last_became_active":"2024-09-15T22:42:53.545376+0000","last_became_peered":"2024-09-15T22:42:53.545376+0000","last_unstale":"2024-09-15T22:45:21.802172+0000","last_undegraded":"2024-09-15T22:45:21.802172+0000","last_fullsized":"2024-09-15T22:45:21.802172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:24.799582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:45:21.800780+0000","last_change":"2024-09-15T22:42:53.547859+0000","last_active":"2024-09-15T22:45:21.800780+0000","last_peered":"2024-09-15T22:45:21.800780+0000","last_clean":"2024-09-15T22:45:21.800780+0000","last_became_active":"2024-09-15T22:42:53.547000+0000","last_became_peered":"2024-09-15T22:42:53.547000+0000","last_unstale":"2024-09-15T22:45:21.800780+0000","last_undegraded":"2024-09-15T22:45:21.800780+0000","last_fullsized":"2024-09-15T22:45:21.800780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:42:52.519212+0000","last_clean_scrub_stamp":"2024-09-15T22:42:52.519212+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:13.995806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798683,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1532,"num_read_kb":988,"num_write":502,"num_write_kb":2382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2396049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612653,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":521761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841585,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29176,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93715976,"statfs":{"total":95995035648,"available":95965159424,"internally_reserved":0,"allocated":2080768,"data_stored":1505140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":918542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":918920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1119342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1048576,"data_stored":518362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855435,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37420,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707732,"statfs":{"total":95995035648,"available":95956717568,"internally_reserved":0,"allocated":2002944,"data_stored":1437432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1056768,"data_stored":520808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215189,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37208,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707944,"statfs":{"total":95995035648,"available":95956934656,"internally_reserved":0,"allocated":1785856,"data_stored":1237890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411418,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1134592,"data_stored":587101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1122304,"data_stored":588184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1073152,"data_stored":518583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":331052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":398760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:45:36.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:36.341 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 -- 172.21.15.66:0/2854022972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4101df0 msgr2=0x7f77f41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 --2- 172.21.15.66:0/2854022972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4101df0 0x7f77f41021d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009ca0 tx=0x7f77e402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 -- 172.21.15.66:0/2854022972 shutdown_connections 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 --2- 172.21.15.66:0/2854022972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4106f20 0x7f77f410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 --2- 172.21.15.66:0/2854022972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 0x7f77f41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 --2- 172.21.15.66:0/2854022972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4101df0 0x7f77f41021d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 -- 172.21.15.66:0/2854022972 >> 172.21.15.66:0/2854022972 conn(0x7f77f40fd8b0 msgr2=0x7f77f40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 -- 172.21.15.66:0/2854022972 shutdown_connections 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.789+0000 7f77fb25c640 1 -- 172.21.15.66:0/2854022972 wait complete. 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 Processor -- start 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 -- start start 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4101df0 0x7f77f4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 0x7f77f41989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4111f40 con 0x7f77f4106f20 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4111dc0 con 0x7f77f41027a0 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77fb25c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41120c0 con 0x7f77f4101df0 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77f97f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77f97f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44128/0 (socket says 172.21.15.66:44128) 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.790+0000 7f77f97f9640 1 -- 172.21.15.66:0/1513991180 learned_addr learned my addr 172.21.15.66:0/1513991180 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f3fff640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 0x7f77f41989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f8ff8640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4101df0 0x7f77f4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 -- 172.21.15.66:0/1513991180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4101df0 msgr2=0x7f77f4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4101df0 0x7f77f4198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 -- 172.21.15.66:0/1513991180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 msgr2=0x7f77f41989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 0x7f77f41989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 -- 172.21.15.66:0/1513991180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f419d430 con 0x7f77f4106f20 2024-09-15T22:45:36.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f97f9640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c970 tx=0x7f77ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec007bb0 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f419d720 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec007d50 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00f450 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.791+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41a5000 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.792+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f41021d0 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.793+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f77ec004f60 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.794+0000 7f77f1ffb640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 0x7f77dc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.794+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f77ec0cfe90 con 0x7f77f4106f20 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.794+0000 7f77f8ff8640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 0x7f77dc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.795+0000 7f77f8ff8640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 0x7f77dc0a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006010 tx=0x7f77e4009360 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:36.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:36.798+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77ec014030 con 0x7f77f4106f20 2024-09-15T22:45:37.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.014+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77f410a160 con 0x7f77f4106f20 2024-09-15T22:45:37.015 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:36 smithi066 ceph-mon[31185]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:37.015 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:36 smithi066 ceph-mon[31185]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-15T22:45:37.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.014+0000 7f77f1ffb640 1 -- 172.21.15.66:0/1513991180 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f77ec09bce0 con 0x7f77f4106f20 2024-09-15T22:45:37.016 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:37.016 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:45:37.017 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 msgr2=0x7f77dc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 0x7f77dc0a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006010 tx=0x7f77e4009360 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 msgr2=0x7f77f419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c970 tx=0x7f77ec00ce30 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 shutdown_connections 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f77dc0a3440 0x7f77dc0a5900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77f4106f20 0x7f77f419cd50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f41027a0 0x7f77f41989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 --2- 172.21.15.66:0/1513991180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77f4101df0 0x7f77f4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 >> 172.21.15.66:0/1513991180 conn(0x7f77f40fd8b0 msgr2=0x7f77f40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 shutdown_connections 2024-09-15T22:45:37.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:37.017+0000 7f77fb25c640 1 -- 172.21.15.66:0/1513991180 wait complete. 2024-09-15T22:45:37.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:36 smithi184 ceph-mon[35203]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:37.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:36 smithi184 ceph-mon[35203]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-15T22:45:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:36 smithi087 ceph-mon[35290]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:45:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:36 smithi087 ceph-mon[35290]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-15T22:45:37.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:37.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:37 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1513991180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:37.968 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:38.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:37 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1513991180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:37 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1513991180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 -- 172.21.15.66:0/4161783402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102570 msgr2=0x7ffad41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 --2- 172.21.15.66:0/4161783402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102570 0x7ffad41029b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009900 tx=0x7ffac802a480 comp rx=0 tx=0).stop 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 -- 172.21.15.66:0/4161783402 shutdown_connections 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 --2- 172.21.15.66:0/4161783402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4102ef0 0x7ffad410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 --2- 172.21.15.66:0/4161783402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102570 0x7ffad41029b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 --2- 172.21.15.66:0/4161783402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4100e20 0x7ffad4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 -- 172.21.15.66:0/4161783402 >> 172.21.15.66:0/4161783402 conn(0x7ffad40fc7d0 msgr2=0x7ffad40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:38.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 -- 172.21.15.66:0/4161783402 shutdown_connections 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 -- 172.21.15.66:0/4161783402 wait complete. 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.451+0000 7ffada182640 1 Processor -- start 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 -- start start 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 0x7ffad4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4102570 0x7ffad4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4110f80 con 0x7ffad4102ef0 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4110e00 con 0x7ffad4100e20 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffada182640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4111100 con 0x7ffad4102570 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44146/0 (socket says 172.21.15.66:44146) 2024-09-15T22:45:38.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 -- 172.21.15.66:0/659036160 learned_addr learned my addr 172.21.15.66:0/659036160 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad2ffd640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4102570 0x7ffad4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad37fe640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 0x7ffad4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 -- 172.21.15.66:0/659036160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4102570 msgr2=0x7ffad4199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4102570 0x7ffad4199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 -- 172.21.15.66:0/659036160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 msgr2=0x7ffad4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 0x7ffad4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 -- 172.21.15.66:0/659036160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad41a48f0 con 0x7ffad4102ef0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad37fe640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 0x7ffad4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.452+0000 7ffad3fff640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00e970 tx=0x7ffacc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.453+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00ccc0 con 0x7ffad4102ef0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.453+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad41a4ac0 con 0x7ffad4102ef0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.453+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffacc00ce60 con 0x7ffad4102ef0 2024-09-15T22:45:38.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.453+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc010490 con 0x7ffad4102ef0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.453+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad41a4f80 con 0x7ffad4102ef0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.454+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4101200 con 0x7ffad4102ef0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.455+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7ffacc005020 con 0x7ffad4102ef0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.455+0000 7ffad0ff9640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 0x7ffabc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.456+0000 7ffad37fe640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 0x7ffabc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.456+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ffacc0d06f0 con 0x7ffad4102ef0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.456+0000 7ffad37fe640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 0x7ffabc0a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffac4005fd0 tx=0x7ffac4009520 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:38.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.459+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffacc09cb90 con 0x7ffad4102ef0 2024-09-15T22:45:38.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.669+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffad4109090 con 0x7ffad4102ef0 2024-09-15T22:45:38.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.670+0000 7ffad0ff9640 1 -- 172.21.15.66:0/659036160 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7ffacc09c490 con 0x7ffad4102ef0 2024-09-15T22:45:38.671 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:38.671 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:45:38.672 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 msgr2=0x7ffabc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 0x7ffabc0a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffac4005fd0 tx=0x7ffac4009520 comp rx=0 tx=0).stop 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 msgr2=0x7ffad41a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00e970 tx=0x7ffacc00ed70 comp rx=0 tx=0).stop 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 shutdown_connections 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffabc0a3440 0x7ffabc0a5900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffad4102ef0 0x7ffad41a43b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffad4102570 0x7ffad4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 --2- 172.21.15.66:0/659036160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad4100e20 0x7ffad4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.672+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 >> 172.21.15.66:0/659036160 conn(0x7ffad40fc7d0 msgr2=0x7ffad40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.673+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 shutdown_connections 2024-09-15T22:45:38.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:38.673+0000 7ffada182640 1 -- 172.21.15.66:0/659036160 wait complete. 2024-09-15T22:45:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:38 smithi066 ceph-mon[31185]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 51 op/s 2024-09-15T22:45:38.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/659036160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:39.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:38 smithi184 ceph-mon[35203]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 51 op/s 2024-09-15T22:45:39.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/659036160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:38 smithi087 ceph-mon[35290]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 51 op/s 2024-09-15T22:45:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/659036160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:39.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:45:39.629 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 -- 172.21.15.66:0/259990945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c106a80 msgr2=0x7f088c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 --2- 172.21.15.66:0/259990945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c106a80 0x7f088c106e60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0884009930 tx=0x7f088402a420 comp rx=0 tx=0).stop 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 -- 172.21.15.66:0/259990945 shutdown_connections 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 --2- 172.21.15.66:0/259990945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c101420 0x7f088c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 --2- 172.21.15.66:0/259990945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c100a80 0x7f088c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 --2- 172.21.15.66:0/259990945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c106a80 0x7f088c106e60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 -- 172.21.15.66:0/259990945 >> 172.21.15.66:0/259990945 conn(0x7f088c0fc7a0 msgr2=0x7f088c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.075+0000 7f0892af9640 1 -- 172.21.15.66:0/259990945 shutdown_connections 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.076+0000 7f0892af9640 1 -- 172.21.15.66:0/259990945 wait complete. 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.076+0000 7f0892af9640 1 Processor -- start 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 -- start start 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c101420 0x7f088c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c106a80 0x7f088c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f088c110e80 con 0x7f088c100a80 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f088c110d00 con 0x7f088c101420 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0892af9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f088c111000 con 0x7f088c106a80 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44154/0 (socket says 172.21.15.66:44154) 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 -- 172.21.15.66:0/1416028429 learned_addr learned my addr 172.21.15.66:0/1416028429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f088bfff640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c101420 0x7f088c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0891096640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c106a80 0x7f088c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 -- 172.21.15.66:0/1416028429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c106a80 msgr2=0x7f088c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c106a80 0x7f088c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 -- 172.21.15.66:0/1416028429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c101420 msgr2=0x7f088c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c101420 0x7f088c199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.077+0000 7f0890895640 1 -- 172.21.15.66:0/1416028429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c1a48b0 con 0x7f088c100a80 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0890895640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0884009230 tx=0x7f0884004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088403f030 con 0x7f088c100a80 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0884003ad0 con 0x7f088c100a80 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884035070 con 0x7f088c100a80 2024-09-15T22:45:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c1a4a80 con 0x7f088c100a80 2024-09-15T22:45:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.078+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c1a4f30 con 0x7f088c100a80 2024-09-15T22:45:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.079+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088c100ee0 con 0x7f088c100a80 2024-09-15T22:45:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.080+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f0884042030 con 0x7f088c100a80 2024-09-15T22:45:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.081+0000 7f0889ffb640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 0x7f08780a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.081+0000 7f088bfff640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 0x7f08780a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.081+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f08840f0a50 con 0x7f088c100a80 2024-09-15T22:45:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.082+0000 7f088bfff640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 0x7f08780a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f088c06b2e0 tx=0x7f087c009680 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:40.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.084+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08840bc8a0 con 0x7f088c100a80 2024-09-15T22:45:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.261+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f088c02d7c0 con 0x7f088c100a80 2024-09-15T22:45:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.262+0000 7f0889ffb640 1 -- 172.21.15.66:0/1416028429 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25320 (secure 0 0 0) 0x7f08840c0ba0 con 0x7f088c100a80 2024-09-15T22:45:40.264 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:40.264 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":90,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T22:45:21.507926+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3471066820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2430511108":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3162528820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1080608797":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3964165811":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1080608797":"2024-09-16T22:45:21.507897+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.264+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 msgr2=0x7f08780a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 0x7f08780a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f088c06b2e0 tx=0x7f087c009680 comp rx=0 tx=0).stop 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 msgr2=0x7f088c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0884009230 tx=0x7f0884004270 comp rx=0 tx=0).stop 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 shutdown_connections 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f08780a34c0 0x7f08780a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c106a80 0x7f088c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088c101420 0x7f088c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 --2- 172.21.15.66:0/1416028429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f088c100a80 0x7f088c1992f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 >> 172.21.15.66:0/1416028429 conn(0x7f088c0fc7a0 msgr2=0x7f088c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 shutdown_connections 2024-09-15T22:45:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:40.265+0000 7f0892af9640 1 -- 172.21.15.66:0/1416028429 wait complete. 2024-09-15T22:45:40.972 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-15T22:45:41.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:40 smithi184 ceph-mon[35203]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-15T22:45:41.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:40 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1416028429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:41.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:40 smithi066 ceph-mon[31185]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-15T22:45:41.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:40 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1416028429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:41.229 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:40 smithi087 ceph-mon[35290]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-15T22:45:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:40 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1416028429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:45:42.482 INFO:teuthology.orchestra.run.smithi066.stdout:{"run_dir":"/var/run/ceph"} 2024-09-15T22:45:42.482 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-15T22:45:42.483 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 3393 2024-09-15T22:45:42.483 DEBUG:tasks.quiescer:Yielding 2024-09-15T22:45:42.483 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:45:42.497 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:45:42.498 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:45:42.498 INFO:tasks.workunit:timeout=3h 2024-09-15T22:45:42.498 INFO:tasks.workunit:cleanup=True 2024-09-15T22:45:42.498 DEBUG:teuthology.orchestra.run.smithi066:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:42.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-15 22:43:45.589914567 +0000 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-15 22:43:45.589914567 +0000 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-15 22:45:19.273413811 +0000 2024-09-15T22:45:42.517 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-15 22:43:45.589914567 +0000 2024-09-15T22:45:42.518 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:45:42.518 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:45:42.592 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:45:42.649 INFO:tasks.workunit.client.0.smithi066.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:45:42.761 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:43.151 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:42 smithi087 ceph-mon[35290]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-15T22:45:43.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:42 smithi184 ceph-mon[35203]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-15T22:45:43.181 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:42 smithi066 ceph-mon[31185]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-15T22:45:43.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/184970163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 msgr2=0x7f2a6810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/184970163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6810ea90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009ca0 tx=0x7f2a6002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/184970163 shutdown_connections 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/184970163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6810ea90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/184970163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 0x7f2a681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/184970163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/184970163 >> 172.21.15.66:0/184970163 conn(0x7f2a680fd8c0 msgr2=0x7f2a680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/184970163 shutdown_connections 2024-09-15T22:45:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.263+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/184970163 wait complete. 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 Processor -- start 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 -- start start 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 0x7f2a68198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2a68111f70 con 0x7f2a68106f10 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2a68111df0 con 0x7f2a68101de0 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6e7a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2a681120f0 con 0x7f2a68102790 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6cd46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6cd46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49654/0 (socket says 172.21.15.66:49654) 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.264+0000 7f2a6cd46640 1 -- 172.21.15.66:0/116027675 learned_addr learned my addr 172.21.15.66:0/116027675 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a67fff640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a677fe640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 0x7f2a68198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 -- 172.21.15.66:0/116027675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 msgr2=0x7f2a68198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 0x7f2a68198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 -- 172.21.15.66:0/116027675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 msgr2=0x7f2a681983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 -- 172.21.15.66:0/116027675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6819d3a0 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a67fff640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6cd46640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a60031a20 tx=0x7f2a60031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60003c30 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a60003dd0 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6002fcf0 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6819d630 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.265+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a681a4f70 con 0x7f2a68106f10 2024-09-15T22:45:43.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.266+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a681021c0 con 0x7f2a68106f10 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.267+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f2a60004050 con 0x7f2a68106f10 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.268+0000 7f2a657fa640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 0x7f2a500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.268+0000 7f2a67fff640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 0x7f2a500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.269+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2a600f1590 con 0x7f2a68106f10 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.269+0000 7f2a67fff640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 0x7f2a500a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a580058c0 tx=0x7f2a58005d30 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.273+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a600bdbd0 con 0x7f2a68106f10 2024-09-15T22:45:43.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.487+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a68199750 con 0x7f2a68106f10 2024-09-15T22:45:43.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.488+0000 7f2a657fa640 1 -- 172.21.15.66:0/116027675 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f2a6002fe90 con 0x7f2a68106f10 2024-09-15T22:45:43.492 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:45:43.496 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:45:43.497 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 msgr2=0x7f2a500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 0x7f2a500a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a580058c0 tx=0x7f2a58005d30 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 msgr2=0x7f2a6819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a60031a20 tx=0x7f2a60031a50 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 shutdown_connections 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2a500a3440 0x7f2a500a5900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a68106f10 0x7f2a6819ccc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a68102790 0x7f2a68198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 --2- 172.21.15.66:0/116027675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a68101de0 0x7f2a681983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.490+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 >> 172.21.15.66:0/116027675 conn(0x7f2a680fd8c0 msgr2=0x7f2a680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.491+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 shutdown_connections 2024-09-15T22:45:43.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:43.491+0000 7f2a6e7a9640 1 -- 172.21.15.66:0/116027675 wait complete. 2024-09-15T22:45:44.112 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:43 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/116027675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:44.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:42:54.256195+0000', 'modified': '2024-09-15T22:45:19.989957+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24461, 'mds_1': 24442, 'mds_2': 24437, 'mds_3': 24427, 'mds_4': 24421}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6839/2023001898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2023001898}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2023001898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6841/3123963280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6840', 'nonce': 3123963280}, {'type': 'v1', 'addr': '172.21.15.66:6841', 'nonce': 3123963280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/1400845283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1400845283}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 1400845283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24395': {'gid': 24395, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6833/3190263553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6832', 'nonce': 3190263553}, {'type': 'v1', 'addr': '172.21.15.87:6833', 'nonce': 3190263553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.87:6835/1324797641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 1324797641}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 1324797641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.184:6835/253738152', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 253738152}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 253738152}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.184:6837/2237794156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 2237794156}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2237794156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.87:6837/2256594812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 2256594812}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 2256594812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.184:6839/2085772810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 2085772810}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 2085772810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.87:6839/426418588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6838', 'nonce': 426418588}, {'type': 'v1', 'addr': '172.21.15.87:6839', 'nonce': 426418588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24461, 'qdb_cluster': [24461, 24442, 24437, 24427, 24421]} 2024-09-15T22:45:44.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-15T22:45:44.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-15T22:45:44.167 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:43 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/116027675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:44.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:43 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/116027675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:45:44.479 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:44.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.975+0000 7fcd35b4b640 1 -- 172.21.15.66:0/450215127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd3010c170 msgr2=0x7fcd3010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.975+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/450215127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd3010c170 0x7fcd3010e610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009900 tx=0x7fcd2802a480 comp rx=0 tx=0).stop 2024-09-15T22:45:44.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 -- 172.21.15.66:0/450215127 shutdown_connections 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/450215127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd3010c170 0x7fcd3010e610 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/450215127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd30103660 0x7fcd3010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/450215127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30102d40 0x7fcd30103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 -- 172.21.15.66:0/450215127 >> 172.21.15.66:0/450215127 conn(0x7fcd300fc7a0 msgr2=0x7fcd300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 -- 172.21.15.66:0/450215127 shutdown_connections 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 -- 172.21.15.66:0/450215127 wait complete. 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 Processor -- start 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.976+0000 7fcd35b4b640 1 -- start start 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 0x7fcd3019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 0x7fcd3019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111fb0 con 0x7fcd30102d40 2024-09-15T22:45:44.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111e30 con 0x7fcd3010c170 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd35b4b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30112130 con 0x7fcd30103660 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49664/0 (socket says 172.21.15.66:49664) 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 0x7fcd3019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/3398827011 learned_addr learned my addr 172.21.15.66:0/3398827011 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2effd640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 0x7fcd3019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 -- 172.21.15.66:0/3398827011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 msgr2=0x7fcd3019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 0x7fcd3019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 -- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 msgr2=0x7fcd3019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 -- 172.21.15.66:0/3398827011 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3019f630 con 0x7fcd3010c170 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2effd640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 0x7fcd3019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:44.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 0x7fcd3019ef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009230 tx=0x7fcd28004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.977+0000 7fcd2cff9640 1 -- 172.21.15.66:0/3398827011 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2803f030 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.978+0000 7fcd2cff9640 1 -- 172.21.15.66:0/3398827011 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd28004440 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.978+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3019f8c0 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.978+0000 7fcd2cff9640 1 -- 172.21.15.66:0/3398827011 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28035070 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.978+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301a7200 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd2cff9640 1 -- 172.21.15.66:0/3398827011 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fcd28042030 con 0x7fcd3010c170 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 Processor -- start 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 -- start start 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66912f0 0x559fa669b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa669bbb0 0x559fa669dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fa65f7090 con 0x559fa66909d0 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559fa659ea70 con 0x559fa669bbb0 2024-09-15T22:45:44.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd37f24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559fa65f3050 con 0x559fa66912f0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49680/0 (socket says 172.21.15.66:49680) 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.980+0000 7fcd2effd640 1 -- 172.21.15.66:0/111187545 learned_addr learned my addr 172.21.15.66:0/111187545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa669bbb0 0x559fa669dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66912f0 0x559fa669b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 -- 172.21.15.66:0/111187545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66912f0 msgr2=0x559fa669b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66912f0 0x559fa669b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 -- 172.21.15.66:0/111187545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa669bbb0 msgr2=0x559fa669dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa669bbb0 0x559fa669dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 -- 172.21.15.66:0/111187545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa65ab130 con 0x559fa66909d0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2cff9640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 0x7fcd1c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 0x7fcd1c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2effd640 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcd180135e0 tx=0x7fcd180097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e0e70c1741a646 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd2cff9640 1 -- 172.21.15.66:0/3398827011 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fcd280f0630 con 0x7fcd3010c170 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd25ffb640 1 -- 172.21.15.66:0/111187545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18011470 con 0x559fa66909d0 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd25ffb640 1 -- 172.21.15.66:0/111187545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd1800f980 con 0x559fa66909d0 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.981+0000 7fcd25ffb640 1 -- 172.21.15.66:0/111187545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180107f0 con 0x559fa66909d0 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- 172.21.15.66:0/111187545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 msgr2=0x559fa6690db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 0x7fcd1c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559fa668ddc0 tx=0x7fcd2000b040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcd180135e0 tx=0x7fcd180097d0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- 172.21.15.66:0/111187545 shutdown_connections 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa669bbb0 0x559fa669dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66912f0 0x559fa669b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 --2- 172.21.15.66:0/111187545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa6690db0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- 172.21.15.66:0/111187545 >> 172.21.15.66:0/111187545 conn(0x559fa668cf60 msgr2=0x559fa668d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- 172.21.15.66:0/111187545 shutdown_connections 2024-09-15T22:45:44.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- 172.21.15.66:0/111187545 wait complete. 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.982+0000 7fcd37f24740 1 -- start start 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 Processor -- start 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa6698790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa6698cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fa669e780 con 0x559fa66909d0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559fa65b1f20 con 0x559fa66912f0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559fa669e900 con 0x559fa669bbb0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd37f24740 10 client.0 _ll_register_callbacks cb 0x559fa657b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49682/0 (socket says 172.21.15.66:49682) 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/17597422 learned_addr learned my addr 172.21.15.66:0/17597422 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2effd640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa6698790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa6698cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 msgr2=0x559fa6698cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.983+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa6698cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/17597422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 msgr2=0x559fa6698790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa6698790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/17597422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa63682b0 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd2effd640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa6698790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ed0 tx=0x7fcd20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562e43b2962c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd0effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20025020 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd1800f980 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fcd200174c0 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd20030050 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd37f24740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fa66aa140 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.984+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd1800f980 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcd20020030 con 0x559fa66909d0 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:44.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 10 client.15564 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 20 client.15564 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa66ac760 0x559fa66adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 4 client.15564 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fa6604600 con 0x559fa66ac760 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd2effd640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa66ac760 0x559fa66adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd2effd640 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa66ac760 0x559fa66adbd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7a1faa1e01364c2f server_cookie=ad2ffd4d1e805e18 in_seq=0 out_seq=0 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.985+0000 7fcd0effd640 10 client.15564 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd0effd640 1 -- 172.21.15.66:0/17597422 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fa6604600 con 0x559fa66ac760 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd0effd640 10 client.15564 handle_command_reply: tid=0 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd37f24740 1 client.15564 shutdown 2024-09-15T22:45:44.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 msgr2=0x559fa669b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ed0 tx=0x7fcd20004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.986+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 shutdown_connections 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa66ac760 0x559fa66adbd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa6698cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa6698790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 --2- 172.21.15.66:0/17597422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66909d0 0x559fa669b440 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 >> 172.21.15.66:0/17597422 conn(0x559fa668cf60 msgr2=0x559fa6692c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd0effd640 0 client.15564 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 shutdown_connections 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 1 -- 172.21.15.66:0/17597422 wait complete. 2024-09-15T22:45:44.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:44.987+0000 7fcd37f24740 20 client.15564 trim_cache size 0 max 16384 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.004+0000 7fcd37f24740 1 Processor -- start 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 -- start start 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 0x559fa66ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fa66abf10 con 0x559fa669bbb0 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559fa66ac5e0 con 0x559fa66912f0 2024-09-15T22:45:45.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd37f24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559fa66accb0 con 0x559fa66909d0 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60028/0 (socket says 172.21.15.66:60028) 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 -- 172.21.15.66:0/2499797121 learned_addr learned my addr 172.21.15.66:0/2499797121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49694/0 (socket says 172.21.15.66:49694) 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 0x559fa66ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 -- 172.21.15.66:0/2499797121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 msgr2=0x559fa66ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 0x559fa66ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 -- 172.21.15.66:0/2499797121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 msgr2=0x559fa66b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 -- 172.21.15.66:0/2499797121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa6691120 con 0x559fa66912f0 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 0x559fa66ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.005+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009ef0 tx=0x7fcd18009dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a69a9d99479073 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd257fa640 1 -- 172.21.15.66:0/2499797121 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800f8d0 con 0x559fa66912f0 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd257fa640 1 -- 172.21.15.66:0/2499797121 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd18005030 con 0x559fa66912f0 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd257fa640 1 -- 172.21.15.66:0/2499797121 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180039d0 con 0x559fa66912f0 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 -- 172.21.15.66:0/2499797121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 msgr2=0x559fa66ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009ef0 tx=0x7fcd18009dd0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 -- 172.21.15.66:0/2499797121 shutdown_connections 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa669bbb0 0x559fa66b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66912f0 0x559fa66ad500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2499797121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa66909d0 0x559fa66ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 -- 172.21.15.66:0/2499797121 >> 172.21.15.66:0/2499797121 conn(0x559fa668cf60 msgr2=0x559fa66970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 -- 172.21.15.66:0/2499797121 shutdown_connections 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.006+0000 7fcd37f24740 1 -- 172.21.15.66:0/2499797121 wait complete. 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 -- start start 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 Processor -- start 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 0x559fa66b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa66b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559fa66ada50 con 0x559fa66912f0 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559fa66ad380 con 0x559fa66909d0 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559fa66ae120 con 0x559fa669bbb0 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd37f24740 10 client.0 _ll_register_callbacks cb 0x7fcd20007570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:45.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd2effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 0x559fa66b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60032/0 (socket says 172.21.15.66:60032) 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/2175401317 learned_addr learned my addr 172.21.15.66:0/2175401317 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.007+0000 7fcd2ffff640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa66b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 msgr2=0x559fa66b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa66b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/2175401317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 msgr2=0x559fa66b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 0x559fa66b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 -- 172.21.15.66:0/2175401317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa6714e60 con 0x559fa66909d0 2024-09-15T22:45:45.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 0x559fa66b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd2f7fe640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd200070b0 tx=0x7fcd20022f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec64ebd4f9ddef30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd0effd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:45:45.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20039060 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd18005030 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fcd200215f0 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd20025040 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd37f24740 10 client.25187 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.008+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fa67160b0 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd18005030 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcd20020040 con 0x559fa66909d0 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 10 client.25187 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 10 client.25187 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 20 client.25187 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa671ad20 0x559fa6719a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 4 client.25187 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:45.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "status"}) -- 0x559fa65feb10 con 0x559fa671ad20 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.009+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa671ad20 0x559fa6719a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd2effd640 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa671ad20 0x559fa6719a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2a8c090375181474 server_cookie=43a3a81ecc57804b in_seq=0 out_seq=0 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd0effd640 10 client.25187 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd0effd640 1 -- 172.21.15.66:0/2175401317 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559fa65feb10 con 0x559fa671ad20 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd0effd640 10 client.25187 handle_command_reply: tid=0 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 client.25187 shutdown 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 msgr2=0x559fa66b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd200070b0 tx=0x7fcd20022f10 comp rx=0 tx=0).stop 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 shutdown_connections 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559fa671ad20 0x559fa6719a30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559fa669bbb0 0x559fa66b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559fa66912f0 0x559fa66b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 --2- 172.21.15.66:0/2175401317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa66909d0 0x559fa66b0e50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd0effd640 0 client.25187 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 >> 172.21.15.66:0/2175401317 conn(0x559fa668cf60 msgr2=0x559fa6699db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 shutdown_connections 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 1 -- 172.21.15.66:0/2175401317 wait complete. 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.010+0000 7fcd37f24740 20 client.25187 trim_cache size 0 max 16384 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 4, 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24421, 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:45.018 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 127.048852068, 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 28, 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 90, 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 197.611568917 2024-09-15T22:45:45.019 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 msgr2=0x7fcd1c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 0x7fcd1c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559fa668ddc0 tx=0x7fcd2000b040 comp rx=0 tx=0).stop 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 msgr2=0x7fcd3019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 0x7fcd3019ef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009230 tx=0x7fcd28004040 comp rx=0 tx=0).stop 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 shutdown_connections 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcd1c0a3440 0x7fcd1c0a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3010c170 0x7fcd3019ef50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd30103660 0x7fcd3019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 --2- 172.21.15.66:0/3398827011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd30102d40 0x7fcd3019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:45.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 >> 172.21.15.66:0/3398827011 conn(0x7fcd300fc7a0 msgr2=0x7fcd300fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:45.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 shutdown_connections 2024-09-15T22:45:45.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:45.011+0000 7fcd35b4b640 1 -- 172.21.15.66:0/3398827011 wait complete. 2024-09-15T22:45:45.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:44 smithi184 ceph-mon[35203]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:45:45.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:44 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:45:45.173 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:44 smithi066 ceph-mon[31185]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:45:45.173 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:44 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:45:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:44 smithi087 ceph-mon[35290]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:45:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:44 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:45:45.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-15T22:45:46.168 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 -- 172.21.15.66:0/2659761138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 msgr2=0x7fdde010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 --2- 172.21.15.66:0/2659761138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde010de80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009900 tx=0x7fddd402a480 comp rx=0 tx=0).stop 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 -- 172.21.15.66:0/2659761138 shutdown_connections 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 --2- 172.21.15.66:0/2659761138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde010e3c0 0x7fdde0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 --2- 172.21.15.66:0/2659761138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde010de80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 --2- 172.21.15.66:0/2659761138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde0074620 0x7fdde0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 -- 172.21.15.66:0/2659761138 >> 172.21.15.66:0/2659761138 conn(0x7fdde00fd8c0 msgr2=0x7fdde00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 -- 172.21.15.66:0/2659761138 shutdown_connections 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.659+0000 7fdde5a85640 1 -- 172.21.15.66:0/2659761138 wait complete. 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 Processor -- start 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 -- start start 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde0074620 0x7fdde019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde010e3c0 0x7fdde019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0114140 con 0x7fdde0074f40 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0113fc0 con 0x7fdde0074620 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdde5a85640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01142c0 con 0x7fdde010e3c0 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdddeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdddeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49726/0 (socket says 172.21.15.66:49726) 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.660+0000 7fdddeffd640 1 -- 172.21.15.66:0/657641968 learned_addr learned my addr 172.21.15.66:0/657641968 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde0074620 0x7fdde019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddffff640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde010e3c0 0x7fdde019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 -- 172.21.15.66:0/657641968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde010e3c0 msgr2=0x7fdde019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde010e3c0 0x7fdde019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 -- 172.21.15.66:0/657641968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde0074620 msgr2=0x7fdde019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde0074620 0x7fdde019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 -- 172.21.15.66:0/657641968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde019f610 con 0x7fdde0074f40 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddeffd640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006010 tx=0x7fddd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddcff9640 1 -- 172.21.15.66:0/657641968 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd403f030 con 0x7fdde0074f40 2024-09-15T22:45:46.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde019f8a0 con 0x7fdde0074f40 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddcff9640 1 -- 172.21.15.66:0/657641968 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd4003ce0 con 0x7fdde0074f40 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdddcff9640 1 -- 172.21.15.66:0/657641968 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4035070 con 0x7fdde0074f40 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.661+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a71e0 con 0x7fdde0074f40 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.663+0000 7fdddcff9640 1 -- 172.21.15.66:0/657641968 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fddd4042030 con 0x7fdde0074f40 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 Processor -- start 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 -- start start 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd4a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd4cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562eafca6090 con 0x562eafd3f9d0 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562eafc4da70 con 0x562eafd4abb0 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562eafca2050 con 0x562eafd402f0 2024-09-15T22:45:46.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49732/0 (socket says 172.21.15.66:49732) 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddffff640 1 -- 172.21.15.66:0/3012141969 learned_addr learned my addr 172.21.15.66:0/3012141969 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddcff9640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 0x7fddc80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd4cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.664+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd4a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 0x7fddc80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 -- 172.21.15.66:0/3012141969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 msgr2=0x562eafd4a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd4a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 -- 172.21.15.66:0/3012141969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 msgr2=0x562eafd4cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd4cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 -- 172.21.15.66:0/3012141969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eafc5a130 con 0x562eafd3f9d0 2024-09-15T22:45:46.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddcff9640 1 -- 172.21.15.66:0/657641968 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fddd40f04b0 con 0x7fdde0074f40 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fdddffff640 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fddd8014940 tx=0x7fddd8014e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf718df074d9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fddc5ffb640 1 -- 172.21.15.66:0/3012141969 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8014050 con 0x562eafd3f9d0 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fddc5ffb640 1 -- 172.21.15.66:0/3012141969 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd80141f0 con 0x562eafd3f9d0 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.665+0000 7fddc5ffb640 1 -- 172.21.15.66:0/3012141969 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8013660 con 0x562eafd3f9d0 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3012141969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 msgr2=0x562eafd3fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdddffff640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 0x7fddc80a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fddd8021000 tx=0x7fddd8020000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fddd8014940 tx=0x7fddd8014e00 comp rx=0 tx=0).stop 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3012141969 shutdown_connections 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd4cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd4a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3012141969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd3fdb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3012141969 >> 172.21.15.66:0/3012141969 conn(0x562eafd3bf60 msgr2=0x562eafd3c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3012141969 shutdown_connections 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3012141969 wait complete. 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.666+0000 7fdde7e5e740 1 -- start start 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 Processor -- start 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd47cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562eafd4d780 con 0x562eafd3f9d0 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562eafc60f20 con 0x562eafd4abb0 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562eafd4d900 con 0x562eafd402f0 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdde7e5e740 10 client.0 _ll_register_callbacks cb 0x562eafc2a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49738/0 (socket says 172.21.15.66:49738) 2024-09-15T22:45:46.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddf7fe640 1 -- 172.21.15.66:0/3017112041 learned_addr learned my addr 172.21.15.66:0/3017112041 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddffff640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd47cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddf7fe640 1 -- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 msgr2=0x562eafd477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.667+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdddf7fe640 1 -- 172.21.15.66:0/3017112041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 msgr2=0x562eafd47cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd47cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdddf7fe640 1 -- 172.21.15.66:0/3017112041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eafa172b0 con 0x562eafd3f9d0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fddd000bed0 tx=0x7fddd00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd428ca5c338694f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fddbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0004220 con 0x562eafd3f9d0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fddd00043c0 con 0x562eafd3f9d0 2024-09-15T22:45:46.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd80141f0 con 0x562eafd3f9d0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddd0024050 con 0x562eafd3f9d0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdde7e5e740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eafd59100 con 0x562eafd3f9d0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.668+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd80141f0 con 0x562eafd3f9d0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fddd001b8c0 con 0x562eafd3f9d0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 10 client.15582 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 20 client.15582 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafd5cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 4 client.15582 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eafcb3600 con 0x562eafd5b6f0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafd5cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fddbeffd640 10 client.15582 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.669+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafd5cb60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=103427a1df5bad1a server_cookie=cd58978e312cdc2b in_seq=0 out_seq=0 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fddbeffd640 1 -- 172.21.15.66:0/3017112041 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562eafcb3600 con 0x562eafd5b6f0 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fddbeffd640 10 client.15582 handle_command_reply: tid=0 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fdde7e5e740 1 client.15582 shutdown 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 msgr2=0x562eafd4a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fddd000bed0 tx=0x7fddd00117b0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 shutdown_connections 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.670+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafd5cb60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fddbeffd640 0 client.15582 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd4abb0 0x562eafd47cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3017112041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd3f9d0 0x562eafd4a460 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 >> 172.21.15.66:0/3017112041 conn(0x562eafd3bf60 msgr2=0x562eafd41c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 shutdown_connections 2024-09-15T22:45:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3017112041 wait complete. 2024-09-15T22:45:46.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.671+0000 7fdde7e5e740 20 client.15582 trim_cache size 0 max 16384 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.688+0000 7fdde7e5e740 1 Processor -- start 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 -- start start 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd5cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd3c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5aea0 con 0x562eafd4abb0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5b570 con 0x562eafd3f9d0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5bc40 con 0x562eafd402f0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49740/0 (socket says 172.21.15.66:49740) 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 -- 172.21.15.66:0/3374777725 learned_addr learned my addr 172.21.15.66:0/3374777725 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd5cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd3c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 -- 172.21.15.66:0/3374777725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 msgr2=0x562eafd3c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd3c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 -- 172.21.15.66:0/3374777725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 msgr2=0x562eafd5cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd5cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 -- 172.21.15.66:0/3374777725 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eafd4a080 con 0x562eafd4abb0 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddeffd640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd3c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.689+0000 7fdddffff640 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fddd8012fd0 tx=0x7fddd80128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b918c3892dee71 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fddc57fa640 1 -- 172.21.15.66:0/3374777725 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8005920 con 0x562eafd4abb0 2024-09-15T22:45:46.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fddc57fa640 1 -- 172.21.15.66:0/3374777725 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8005ac0 con 0x562eafd4abb0 2024-09-15T22:45:46.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fddc57fa640 1 -- 172.21.15.66:0/3374777725 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8013510 con 0x562eafd4abb0 2024-09-15T22:45:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3374777725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 msgr2=0x562eafd46080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fddd8012fd0 tx=0x7fddd80128a0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3374777725 shutdown_connections 2024-09-15T22:45:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd4abb0 0x562eafd46080 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd402f0 0x562eafd3c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/3374777725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd5cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3374777725 >> 172.21.15.66:0/3374777725 conn(0x562eafd3bf60 msgr2=0x562eafd47770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3374777725 shutdown_connections 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.690+0000 7fdde7e5e740 1 -- 172.21.15.66:0/3374777725 wait complete. 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 -- start start 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 Processor -- start 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd65060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 0x562eafd5e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5c9e0 con 0x562eafd402f0 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5c310 con 0x562eafd3f9d0 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562eafd5d0b0 con 0x562eafd4abb0 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdde7e5e740 10 client.0 _ll_register_callbacks cb 0x7fddd000b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdddeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdddeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49750/0 (socket says 172.21.15.66:49750) 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdddeffd640 1 -- 172.21.15.66:0/4082723783 learned_addr learned my addr 172.21.15.66:0/4082723783 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:46.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.691+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd65060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddffff640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 0x562eafd5e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 -- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 msgr2=0x562eafd5e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 0x562eafd5e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 -- 172.21.15.66:0/4082723783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 msgr2=0x562eafd65060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd65060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 -- 172.21.15.66:0/4082723783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eafd5eba0 con 0x562eafd402f0 2024-09-15T22:45:46.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd65060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddffff640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 0x562eafd5e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdddeffd640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b8cc0 tx=0x7fddd40b86c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da9ec3386ff920 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fddbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd40b6e60 con 0x562eafd402f0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fddd40f0150 con 0x562eafd402f0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd8005ac0 con 0x562eafd402f0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddd4049040 con 0x562eafd402f0 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdde7e5e740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:46.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eafd63680 con 0x562eafd402f0 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.692+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8005ac0 con 0x562eafd402f0 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fddd40edac0 con 0x562eafd402f0 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 10 client.15588 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 20 client.15588 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafdc91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 4 client.15588 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "status"}) -- 0x562eafcadb10 con 0x562eafd5b6f0 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafdc91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:46.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fddbeffd640 10 client.15588 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.693+0000 7fdddf7fe640 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafdc91f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d5335a2a67ff3af7 server_cookie=ab2d5b3930cd4640 in_seq=0 out_seq=0 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fddbeffd640 1 -- 172.21.15.66:0/4082723783 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x562eafcadb10 con 0x562eafd5b6f0 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fddbeffd640 10 client.15588 handle_command_reply: tid=0 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 client.15588 shutdown 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 msgr2=0x562eafd655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b8cc0 tx=0x7fddd40b86c0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 shutdown_connections 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x562eafd5b6f0 0x562eafdc91f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562eafd4abb0 0x562eafd5e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562eafd402f0 0x562eafd655a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 --2- 172.21.15.66:0/4082723783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562eafd3f9d0 0x562eafd65060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 >> 172.21.15.66:0/4082723783 conn(0x562eafd3bf60 msgr2=0x562eafd46000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fddbeffd640 0 client.15588 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:45:46.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 shutdown_connections 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 1 -- 172.21.15.66:0/4082723783 wait complete. 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.694+0000 7fdde7e5e740 20 client.15588 trim_cache size 0 max 16384 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 3, 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24427, 2024-09-15T22:45:46.706 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 129.740741214, 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 28, 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 90, 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 196.764862389 2024-09-15T22:45:46.707 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 msgr2=0x7fddc80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 0x7fddc80a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fddd8021000 tx=0x7fddd8020000 comp rx=0 tx=0).stop 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 msgr2=0x7fdde019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006010 tx=0x7fddd40042f0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 shutdown_connections 2024-09-15T22:45:46.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fddc80a3440 0x7fddc80a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdde010e3c0 0x7fdde019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdde0074f40 0x7fdde019aba0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 --2- 172.21.15.66:0/657641968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdde0074620 0x7fdde019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 >> 172.21.15.66:0/657641968 conn(0x7fdde00fd8c0 msgr2=0x7fdde00fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 shutdown_connections 2024-09-15T22:45:46.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:46.695+0000 7fdde5a85640 1 -- 172.21.15.66:0/657641968 wait complete. 2024-09-15T22:45:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:46 smithi184 ceph-mon[35203]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:47.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:46 smithi066 ceph-mon[31185]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:46 smithi087 ceph-mon[35290]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:45:47.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-15T22:45:47.677 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:48.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 -- 172.21.15.66:0/2378562344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 msgr2=0x7f9684100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 --2- 172.21.15.66:0/2378562344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f9684100ee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f966c009930 tx=0x7f966c02a420 comp rx=0 tx=0).stop 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 -- 172.21.15.66:0/2378562344 shutdown_connections 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 --2- 172.21.15.66:0/2378562344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684101420 0x7f968410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 --2- 172.21.15.66:0/2378562344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f9684100ee0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 --2- 172.21.15.66:0/2378562344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684106a80 0x7f9684106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 -- 172.21.15.66:0/2378562344 >> 172.21.15.66:0/2378562344 conn(0x7f96840fc7a0 msgr2=0x7f96840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 -- 172.21.15.66:0/2378562344 shutdown_connections 2024-09-15T22:45:48.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.178+0000 7f96896ad640 1 -- 172.21.15.66:0/2378562344 wait complete. 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 Processor -- start 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 -- start start 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684101420 0x7f968410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684106a80 0x7f968410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9684111fe0 con 0x7f9684100a80 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9684111e60 con 0x7f9684101420 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.179+0000 7f96896ad640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9684112160 con 0x7f9684106a80 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49776/0 (socket says 172.21.15.66:49776) 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 -- 172.21.15.66:0/2072350993 learned_addr learned my addr 172.21.15.66:0/2072350993 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f967bfff640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684101420 0x7f968410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f96837fe640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684106a80 0x7f968410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 -- 172.21.15.66:0/2072350993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684106a80 msgr2=0x7f968410ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684106a80 0x7f968410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 -- 172.21.15.66:0/2072350993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684101420 msgr2=0x7f968410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684101420 0x7f968410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 -- 172.21.15.66:0/2072350993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96841a68e0 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9682ffd640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f967400d950 tx=0x7f967400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9680ff9640 1 -- 172.21.15.66:0/2072350993 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674017030 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96841a6bd0 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9680ff9640 1 -- 172.21.15.66:0/2072350993 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9674004020 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f9680ff9640 1 -- 172.21.15.66:0/2072350993 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96740047a0 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.180+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841a7130 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f9680ff9640 1 -- 172.21.15.66:0/2072350993 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7f96740041d0 con 0x7f9684100a80 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f968ba86740 1 Processor -- start 2024-09-15T22:45:48.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f968ba86740 1 -- start start 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f968ba86740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f968ba86740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.183+0000 7f968ba86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f010fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f968ba86740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f42ef6a090 con 0x55f42f0042f0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f968ba86740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f42ef11a70 con 0x55f42f0039d0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f968ba86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f42ef66050 con 0x55f42f00ebb0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49780/0 (socket says 172.21.15.66:49780) 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f96837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 -- 172.21.15.66:0/1138360770 learned_addr learned my addr 172.21.15.66:0/1138360770 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9680ff9640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 0x7f96700a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f967bfff640 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f010fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f96837fe640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 0x7f96700a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9680ff9640 1 -- 172.21.15.66:0/2072350993 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f96740cfcc0 con 0x7f9684100a80 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 -- 172.21.15.66:0/1138360770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 msgr2=0x55f42f010fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f010fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 -- 172.21.15.66:0/1138360770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 msgr2=0x55f42f003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 -- 172.21.15.66:0/1138360770 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42ef1e130 con 0x55f42f0042f0 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f96837fe640 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:48.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f96740cd060 tx=0x7f96740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c5453b5b76406b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f96837fe640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 0x7f96700a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f967c0148e0 tx=0x7f967c004ab0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.184+0000 7f96797fa640 1 -- 172.21.15.66:0/1138360770 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96740d1070 con 0x55f42f0042f0 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f96797fa640 1 -- 172.21.15.66:0/1138360770 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f967409c160 con 0x55f42f0042f0 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f96797fa640 1 -- 172.21.15.66:0/1138360770 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96740a46d0 con 0x55f42f0042f0 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 -- 172.21.15.66:0/1138360770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 msgr2=0x55f42f00e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f96740cd060 tx=0x7f96740046c0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 -- 172.21.15.66:0/1138360770 shutdown_connections 2024-09-15T22:45:48.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f010fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00e670 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 --2- 172.21.15.66:0/1138360770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 -- 172.21.15.66:0/1138360770 >> 172.21.15.66:0/1138360770 conn(0x55f42effff60 msgr2=0x55f42f000340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 -- 172.21.15.66:0/1138360770 shutdown_connections 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.185+0000 7f968ba86740 1 -- 172.21.15.66:0/1138360770 wait complete. 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 -- start start 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 Processor -- start 2024-09-15T22:45:48.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f00bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f42f011780 con 0x55f42f0039d0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f42ef24f20 con 0x55f42f0042f0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f42f011900 con 0x55f42f00ebb0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f968ba86740 10 client.0 _ll_register_callbacks cb 0x55f42eeee030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49788/0 (socket says 172.21.15.66:49788) 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 -- 172.21.15.66:0/1887263332 learned_addr learned my addr 172.21.15.66:0/1887263332 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f96837fe640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f00bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f967bfff640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 -- 172.21.15.66:0/1887263332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 msgr2=0x55f42f00bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f00bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 -- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 msgr2=0x55f42f00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f9682ffd640 1 -- 172.21.15.66:0/1887263332 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42ecdb2b0 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.186+0000 7f967bfff640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f00b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96740a41a0 tx=0x7f96740d33c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910838cda173f436 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96740d1030 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f96740980d0 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f967409c160 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f967409b5a0 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 10 client.15600 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f42f01d0f0 con 0x55f42f0039d0 2024-09-15T22:45:48.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f967409c160 con 0x55f42f0039d0 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96740a4240 con 0x55f42f0039d0 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 10 client.15600 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 20 client.15600 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.187+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f01e440 0x55f42f020610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.188+0000 7f968ba86740 4 client.15600 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.188+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f42ef77600 con 0x55f42f01e440 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.188+0000 7f967bfff640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f01e440 0x55f42f020610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.188+0000 7f967bfff640 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f01e440 0x55f42f020610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16141994aae6fc5f server_cookie=56485070f21272c4 in_seq=0 out_seq=0 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.188+0000 7f966a7fc640 10 client.15600 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f966a7fc640 1 -- 172.21.15.66:0/1887263332 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f42ef77600 con 0x55f42f01e440 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f966a7fc640 10 client.15600 handle_command_reply: tid=0 2024-09-15T22:45:48.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 client.15600 shutdown 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 msgr2=0x55f42f00e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96740a41a0 tx=0x7f96740d33c0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 shutdown_connections 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f01e440 0x55f42f020610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f00bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f966a7fc640 0 client.15600 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f00b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 --2- 172.21.15.66:0/1887263332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0039d0 0x55f42f00e4a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.189+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 >> 172.21.15.66:0/1887263332 conn(0x55f42effff60 msgr2=0x55f42f005c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.190+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 shutdown_connections 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.190+0000 7f968ba86740 1 -- 172.21.15.66:0/1887263332 wait complete. 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.190+0000 7f968ba86740 20 client.15600 trim_cache size 0 max 16384 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.207+0000 7f968ba86740 1 Processor -- start 2024-09-15T22:45:48.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 -- start start 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f01f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f008a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f42f01e950 con 0x55f42f0042f0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f42f01f020 con 0x55f42f0039d0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f968ba86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f42f01f6f0 con 0x55f42f00ebb0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49794/0 (socket says 172.21.15.66:49794) 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 -- 172.21.15.66:0/2617891043 learned_addr learned my addr 172.21.15.66:0/2617891043 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f9682ffd640 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f01f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f96837fe640 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 -- 172.21.15.66:0/2617891043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 msgr2=0x55f42f008a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f008a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 -- 172.21.15.66:0/2617891043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 msgr2=0x55f42f01f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f01f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.208+0000 7f967bfff640 1 -- 172.21.15.66:0/2617891043 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42f003800 con 0x55f42f0042f0 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f967bfff640 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f966c02aa10 tx=0x7f966c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79026b3f3799571 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f9678ff9640 1 -- 172.21.15.66:0/2617891043 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c049070 con 0x55f42f0042f0 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f9678ff9640 1 -- 172.21.15.66:0/2617891043 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966c0055e0 con 0x55f42f0042f0 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f9678ff9640 1 -- 172.21.15.66:0/2617891043 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c035040 con 0x55f42f0042f0 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f968ba86740 1 -- 172.21.15.66:0/2617891043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 msgr2=0x55f42f00d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.209+0000 7f968ba86740 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f966c02aa10 tx=0x7f966c031400 comp rx=0 tx=0).stop 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- 172.21.15.66:0/2617891043 shutdown_connections 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f00ebb0 0x55f42f008a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f0042f0 0x55f42f00d650 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- 172.21.15.66:0/2617891043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0039d0 0x55f42f01f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- 172.21.15.66:0/2617891043 >> 172.21.15.66:0/2617891043 conn(0x55f42effff60 msgr2=0x55f42f00cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- 172.21.15.66:0/2617891043 shutdown_connections 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- 172.21.15.66:0/2617891043 wait complete. 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- start start 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 Processor -- start 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f0039d0 0x55f42f029050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f024420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f42f020490 con 0x55f42f00ebb0 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f42f01fdc0 con 0x55f42f0042f0 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f42f020b60 con 0x55f42f0039d0 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f968ba86740 10 client.0 _ll_register_callbacks cb 0x7f967c008530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f96837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f96837fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49796/0 (socket says 172.21.15.66:49796) 2024-09-15T22:45:48.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.210+0000 7f96837fe640 1 -- 172.21.15.66:0/1409956032 learned_addr learned my addr 172.21.15.66:0/1409956032 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f967bfff640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f0039d0 0x55f42f029050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 -- 172.21.15.66:0/1409956032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f0039d0 msgr2=0x55f42f029050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f0039d0 0x55f42f029050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 -- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 msgr2=0x55f42f024420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f024420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 -- 172.21.15.66:0/1409956032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42f025160 con 0x55f42f00ebb0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f967bfff640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f024420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f96837fe640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f967c011b30 tx=0x7f967c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52952d3ab5455db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f966a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c025070 con 0x55f42f00ebb0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f967c004b20 con 0x55f42f00ebb0 2024-09-15T22:45:48.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f966c0055e0 con 0x55f42f00ebb0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f967c030050 con 0x55f42f00ebb0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f968ba86740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.211+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f42f089940 con 0x55f42f00ebb0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966c0055e0 con 0x55f42f00ebb0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f967c021420 con 0x55f42f00ebb0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 10 client.15606 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 20 client.15606 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f08e5c0 0x55f42f08d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 4 client.15606 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "status"}) -- 0x55f42ef71b10 con 0x55f42f08e5c0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.212+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f08e5c0 0x55f42f08d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f9682ffd640 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f08e5c0 0x55f42f08d2d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2121dd5fe8128163 server_cookie=5cc081b55206c4b4 in_seq=0 out_seq=0 2024-09-15T22:45:48.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f966a7fc640 10 client.15606 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f966a7fc640 1 -- 172.21.15.66:0/1409956032 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f42ef71b10 con 0x55f42f08e5c0 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f966a7fc640 10 client.15606 handle_command_reply: tid=0 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 client.15606 shutdown 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 msgr2=0x55f42f024960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f967c011b30 tx=0x7f967c004a40 comp rx=0 tx=0).stop 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 shutdown_connections 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55f42f08e5c0 0x55f42f08d2d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f42f00ebb0 0x55f42f024960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f42f0042f0 0x55f42f024420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f966a7fc640 0 client.15606 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 --2- 172.21.15.66:0/1409956032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f42f0039d0 0x55f42f029050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 >> 172.21.15.66:0/1409956032 conn(0x55f42effff60 msgr2=0x55f42effede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 shutdown_connections 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 1 -- 172.21.15.66:0/1409956032 wait complete. 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.213+0000 7f968ba86740 20 client.15606 trim_cache size 0 max 16384 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 2, 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24437, 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:48.247 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 132.27468463700001, 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 28, 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 90, 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 195.59863089500001 2024-09-15T22:45:48.248 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 msgr2=0x7f96700a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 0x7f96700a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f967c0148e0 tx=0x7f967c004ab0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 msgr2=0x7f968410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f967400d950 tx=0x7f967400de10 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 shutdown_connections 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96700a3440 0x7f96700a5900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9684106a80 0x7f968410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9684101420 0x7f968410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 --2- 172.21.15.66:0/2072350993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684100a80 0x7f968410e3e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 >> 172.21.15.66:0/2072350993 conn(0x7f96840fc7a0 msgr2=0x7f96840fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 shutdown_connections 2024-09-15T22:45:48.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:48.214+0000 7f96896ad640 1 -- 172.21.15.66:0/2072350993 wait complete. 2024-09-15T22:45:48.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T22:45:49.165 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:48 smithi184 ceph-mon[35203]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-15T22:45:49.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:48 smithi066 ceph-mon[31185]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-15T22:45:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:48 smithi087 ceph-mon[35290]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 -- 172.21.15.66:0/837080753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 msgr2=0x7ff17c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 --2- 172.21.15.66:0/837080753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c106e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff170009cd0 tx=0x7ff17002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 -- 172.21.15.66:0/837080753 shutdown_connections 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 --2- 172.21.15.66:0/837080753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c101400 0x7ff17c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 --2- 172.21.15.66:0/837080753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c100a60 0x7ff17c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 --2- 172.21.15.66:0/837080753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c106e40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 -- 172.21.15.66:0/837080753 >> 172.21.15.66:0/837080753 conn(0x7ff17c0fc780 msgr2=0x7ff17c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 -- 172.21.15.66:0/837080753 shutdown_connections 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.671+0000 7ff183dd6640 1 -- 172.21.15.66:0/837080753 wait complete. 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 Processor -- start 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 -- start start 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c100a60 0x7ff17c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c101400 0x7ff17c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c110e60 con 0x7ff17c106a60 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c110ce0 con 0x7ff17c101400 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff183dd6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c110fe0 con 0x7ff17c100a60 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff182373640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff181b72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c100a60 0x7ff17c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff182373640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49818/0 (socket says 172.21.15.66:49818) 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff182373640 1 -- 172.21.15.66:0/538925707 learned_addr learned my addr 172.21.15.66:0/538925707 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.672+0000 7ff181371640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c101400 0x7ff17c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 -- 172.21.15.66:0/538925707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c100a60 msgr2=0x7ff17c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c100a60 0x7ff17c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 -- 172.21.15.66:0/538925707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c101400 msgr2=0x7ff17c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c101400 0x7ff17c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 -- 172.21.15.66:0/538925707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c19d460 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff182373640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c970 tx=0x7ff17400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff16effd640 1 -- 172.21.15.66:0/538925707 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174007bb0 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff16effd640 1 -- 172.21.15.66:0/538925707 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff174007d50 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17c19d750 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff16effd640 1 -- 172.21.15.66:0/538925707 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17400f450 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.673+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17c1a5030 con 0x7ff17c106a60 2024-09-15T22:45:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 Processor -- start 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff16effd640 1 -- 172.21.15.66:0/538925707 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7ff174004f00 con 0x7ff17c106a60 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 -- start start 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0304670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a0306fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0260090 con 0x55e5a02f99d0 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0207a70 con 0x55e5a02fa2f0 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff1861af740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5a025c050 con 0x55e5a0304bb0 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49830/0 (socket says 172.21.15.66:49830) 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff181371640 1 -- 172.21.15.66:0/3472579670 learned_addr learned my addr 172.21.15.66:0/3472579670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff181b72640 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0304670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.676+0000 7ff181371640 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a0306fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff16effd640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 0x7ff1680a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 -- 172.21.15.66:0/3472579670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 msgr2=0x55e5a0306fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a0306fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 -- 172.21.15.66:0/3472579670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 msgr2=0x55e5a0304670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0304670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 -- 172.21.15.66:0/3472579670 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a0214130 con 0x55e5a02f99d0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff182373640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 0x7ff1680a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff181371640 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1780058a0 tx=0x7ff17800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db74462def8cdc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff16effd640 1 -- 172.21.15.66:0/538925707 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff1740cfde0 con 0x7ff17c106a60 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff167fff640 1 -- 172.21.15.66:0/3472579670 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780120d0 con 0x55e5a02f99d0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff167fff640 1 -- 172.21.15.66:0/3472579670 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff178005020 con 0x55e5a02f99d0 2024-09-15T22:45:49.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.677+0000 7ff167fff640 1 -- 172.21.15.66:0/3472579670 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178004a00 con 0x55e5a02f99d0 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- 172.21.15.66:0/3472579670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 msgr2=0x55e5a02f9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1780058a0 tx=0x7ff17800b840 comp rx=0 tx=0).stop 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff182373640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 0x7ff1680a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1740cd100 tx=0x7ff17406b850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- 172.21.15.66:0/3472579670 shutdown_connections 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a0306fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0304670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 --2- 172.21.15.66:0/3472579670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a02f9db0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- 172.21.15.66:0/3472579670 >> 172.21.15.66:0/3472579670 conn(0x55e5a02f5f60 msgr2=0x55e5a02f6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- 172.21.15.66:0/3472579670 shutdown_connections 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- 172.21.15.66:0/3472579670 wait complete. 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 -- start start 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.678+0000 7ff1861af740 1 Processor -- start 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0301830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a0301d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0307780 con 0x55e5a0304bb0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5a021af20 con 0x55e5a02f99d0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0307900 con 0x55e5a02fa2f0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff1861af740 10 client.0 _ll_register_callbacks cb 0x55e5a01e4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a0301d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60196/0 (socket says 172.21.15.66:60196) 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 -- 172.21.15.66:0/137851985 learned_addr learned my addr 172.21.15.66:0/137851985 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181b72640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0301830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 -- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 msgr2=0x55e5a0301830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0301830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 -- 172.21.15.66:0/137851985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 msgr2=0x55e5a0301d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a0301d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.679+0000 7ff181371640 1 -- 172.21.15.66:0/137851985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e59ffd12b0 con 0x55e5a02f99d0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff181371640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1780059f0 tx=0x7ff17800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9827415d91ce2524 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff1657fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178026070 con 0x55e5a02f99d0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff17800e920 con 0x55e5a02f99d0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff178005020 con 0x55e5a02f99d0 2024-09-15T22:45:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.680+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff17800eb20 con 0x55e5a02f99d0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 10 client.25232 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e5a0313130 con 0x55e5a02f99d0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff178005020 con 0x55e5a02f99d0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff178010460 con 0x55e5a02f99d0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 10 client.25232 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 10 client.25232 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 20 client.25232 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0315360 0x55e5a03167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 4 client.25232 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5a026d600 con 0x55e5a0315360 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.681+0000 7ff181b72640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0315360 0x55e5a03167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.682+0000 7ff181b72640 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0315360 0x55e5a03167d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e892318809a0f8e server_cookie=dcfdd007c2d5ad7c in_seq=0 out_seq=0 2024-09-15T22:45:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.682+0000 7ff1657fa640 10 client.25232 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1657fa640 1 -- 172.21.15.66:0/137851985 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5a026d600 con 0x55e5a0315360 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1657fa640 10 client.25232 handle_command_reply: tid=0 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 client.25232 shutdown 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 msgr2=0x55e5a03044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1780059f0 tx=0x7ff17800b390 comp rx=0 tx=0).stop 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 shutdown_connections 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0315360 0x55e5a03167d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a0301d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0301830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 --2- 172.21.15.66:0/137851985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03044e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1657fa640 0 client.25232 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 >> 172.21.15.66:0/137851985 conn(0x55e5a02f5f60 msgr2=0x55e5a02fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 shutdown_connections 2024-09-15T22:45:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 1 -- 172.21.15.66:0/137851985 wait complete. 2024-09-15T22:45:49.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.683+0000 7ff1861af740 20 client.25232 trim_cache size 0 max 16384 2024-09-15T22:45:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 Processor -- start 2024-09-15T22:45:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 -- start start 2024-09-15T22:45:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0303690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0314b10 con 0x55e5a0304bb0 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5a03151e0 con 0x55e5a02f99d0 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff1861af740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5a03158b0 con 0x55e5a02fa2f0 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49854/0 (socket says 172.21.15.66:49854) 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff181371640 1 -- 172.21.15.66:0/631917903 learned_addr learned my addr 172.21.15.66:0/631917903 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff181371640 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.701+0000 7ff181b72640 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0303690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 -- 172.21.15.66:0/631917903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 msgr2=0x55e5a0303690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0303690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 -- 172.21.15.66:0/631917903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 msgr2=0x55e5a03167d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03167d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 -- 172.21.15.66:0/631917903 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a0307310 con 0x55e5a0304bb0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff181371640 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff178001eb0 tx=0x7ff17801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b55e028189d0af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff1677fe640 1 -- 172.21.15.66:0/631917903 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178026070 con 0x55e5a0304bb0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff1677fe640 1 -- 172.21.15.66:0/631917903 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff178027040 con 0x55e5a0304bb0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.702+0000 7ff1677fe640 1 -- 172.21.15.66:0/631917903 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178010460 con 0x55e5a0304bb0 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- 172.21.15.66:0/631917903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 msgr2=0x55e5a031eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff178001eb0 tx=0x7ff17801b040 comp rx=0 tx=0).stop 2024-09-15T22:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- 172.21.15.66:0/631917903 shutdown_connections 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a0304bb0 0x55e5a031eea0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a02fa2f0 0x55e5a0303690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 --2- 172.21.15.66:0/631917903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02f99d0 0x55e5a03167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- 172.21.15.66:0/631917903 >> 172.21.15.66:0/631917903 conn(0x55e5a02f5f60 msgr2=0x55e5a0302f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- 172.21.15.66:0/631917903 shutdown_connections 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- 172.21.15.66:0/631917903 wait complete. 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 -- start start 2024-09-15T22:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.703+0000 7ff1861af740 1 Processor -- start 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0318dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a037ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0316650 con 0x55e5a02f99d0 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0315f80 con 0x55e5a02fa2f0 2024-09-15T22:45:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5a0316d20 con 0x55e5a0304bb0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 10 client.0 _ll_register_callbacks cb 0x7ff170005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49860/0 (socket says 172.21.15.66:49860) 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 -- 172.21.15.66:0/4169381233 learned_addr learned my addr 172.21.15.66:0/4169381233 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181b72640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0318dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a037ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 -- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 msgr2=0x55e5a037ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a037ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 -- 172.21.15.66:0/4169381233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 msgr2=0x55e5a0318dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0318dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 -- 172.21.15.66:0/4169381233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a037b4f0 con 0x55e5a02f99d0 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181b72640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0318dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff181371640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1780109a0 tx=0x7ff17800b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3070a86fa728c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1657fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178026030 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff17800ecc0 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.704+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff178027040 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff178012080 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e5a0383a80 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff178027040 con 0x55e5a02f99d0 2024-09-15T22:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff178022920 con 0x55e5a02f99d0 2024-09-15T22:45:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 10 client.15624 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T22:45:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 20 client.15624 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0388330 0x55e5a0387040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 4 client.15624 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "status"}) -- 0x55e5a0267b10 con 0x55e5a0388330 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.705+0000 7ff181b72640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0388330 0x55e5a0387040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff181b72640 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0388330 0x55e5a0387040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7492fb66e94f773 server_cookie=9b34905643106740 in_seq=0 out_seq=0 2024-09-15T22:45:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1657fa640 10 client.15624 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:49.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1657fa640 1 -- 172.21.15.66:0/4169381233 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e5a0267b10 con 0x55e5a0388330 2024-09-15T22:45:49.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1657fa640 10 client.15624 handle_command_reply: tid=0 2024-09-15T22:45:49.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 client.15624 shutdown 2024-09-15T22:45:49.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 msgr2=0x55e5a0318890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1780109a0 tx=0x7ff17800b770 comp rx=0 tx=0).stop 2024-09-15T22:45:49.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 shutdown_connections 2024-09-15T22:45:49.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e5a0388330 0x55e5a0387040 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5a0304bb0 0x55e5a037ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5a02fa2f0 0x55e5a0318dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 --2- 172.21.15.66:0/4169381233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a02f99d0 0x55e5a0318890 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1657fa640 0 client.15624 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 >> 172.21.15.66:0/4169381233 conn(0x55e5a02f5f60 msgr2=0x55e5a0303630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 shutdown_connections 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 1 -- 172.21.15.66:0/4169381233 wait complete. 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.706+0000 7ff1861af740 20 client.15624 trim_cache size 0 max 16384 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:49.718 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 1, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24442, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 134.773047542, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 28, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 90, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 194.58850145599999 2024-09-15T22:45:49.719 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 msgr2=0x7ff1680a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 0x7ff1680a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1740cd100 tx=0x7ff17406b850 comp rx=0 tx=0).stop 2024-09-15T22:45:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 msgr2=0x7ff17c19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c970 tx=0x7ff17400ce30 comp rx=0 tx=0).stop 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 shutdown_connections 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff1680a3440 0x7ff1680a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff17c106a60 0x7ff17c19cd80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff17c101400 0x7ff17c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 --2- 172.21.15.66:0/538925707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff17c100a60 0x7ff17c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 >> 172.21.15.66:0/538925707 conn(0x7ff17c0fc780 msgr2=0x7ff17c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 shutdown_connections 2024-09-15T22:45:49.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:49.707+0000 7ff183dd6640 1 -- 172.21.15.66:0/538925707 wait complete. 2024-09-15T22:45:50.445 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:45:50.701 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:45:51.093 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:50 smithi066 ceph-mon[31185]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-15T22:45:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:50 smithi184 ceph-mon[35203]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-15T22:45:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- 172.21.15.66:0/402151038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c101420 msgr2=0x7fbf8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 --2- 172.21.15.66:0/402151038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c101420 0x7fbf8c10d950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009cd0 tx=0x7fbf8402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- 172.21.15.66:0/402151038 shutdown_connections 2024-09-15T22:45:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 --2- 172.21.15.66:0/402151038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c101420 0x7fbf8c10d950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 --2- 172.21.15.66:0/402151038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c100a80 0x7fbf8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 --2- 172.21.15.66:0/402151038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 0x7fbf8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- 172.21.15.66:0/402151038 >> 172.21.15.66:0/402151038 conn(0x7fbf8c0fc7a0 msgr2=0x7fbf8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- 172.21.15.66:0/402151038 shutdown_connections 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- 172.21.15.66:0/402151038 wait complete. 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 Processor -- start 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.174+0000 7fbf931c5640 1 -- start start 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c101420 0x7fbf8c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 0x7fbf8c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c110e80 con 0x7fbf8c100a80 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c110d00 con 0x7fbf8c106a80 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c111000 con 0x7fbf8c101420 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49882/0 (socket says 172.21.15.66:49882) 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 -- 172.21.15.66:0/654933602 learned_addr learned my addr 172.21.15.66:0/654933602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c101420 0x7fbf8c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf91762640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 0x7fbf8c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 -- 172.21.15.66:0/654933602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c101420 msgr2=0x7fbf8c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c101420 0x7fbf8c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 -- 172.21.15.66:0/654933602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 msgr2=0x7fbf8c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 0x7fbf8c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 -- 172.21.15.66:0/654933602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c19d420 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf90f61640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00d950 tx=0x7fbf7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf89ffb640 1 -- 172.21.15.66:0/654933602 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c017030 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf89ffb640 1 -- 172.21.15.66:0/654933602 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf7c004020 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8c19d710 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.175+0000 7fbf89ffb640 1 -- 172.21.15.66:0/654933602 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0047a0 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.176+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8c1a4ff0 con 0x7fbf8c100a80 2024-09-15T22:45:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf89ffb640 1 -- 172.21.15.66:0/654933602 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 24) ==== 138531+0+0 (secure 0 0 0) 0x7fbf7c0041d0 con 0x7fbf8c100a80 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 Processor -- start 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 -- start start 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf89ffb640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 0x7fbf740a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff12f0 0x5593ddffb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddffdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593ddf57090 con 0x5593ddffbbb0 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5593ddefea70 con 0x5593ddff09d0 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.178+0000 7fbf9559e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593ddf53050 con 0x5593ddff12f0 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf91762640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 0x7fbf740a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf89ffb640 1 -- 172.21.15.66:0/654933602 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf7c0cfbe0 con 0x7fbf8c100a80 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60238/0 (socket says 172.21.15.66:60238) 2024-09-15T22:45:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 -- 172.21.15.66:0/307215151 learned_addr learned my addr 172.21.15.66:0/307215151 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff12f0 0x5593ddffb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf91762640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddffdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 -- 172.21.15.66:0/307215151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff12f0 msgr2=0x5593ddffb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff12f0 0x5593ddffb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 -- 172.21.15.66:0/307215151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 msgr2=0x5593ddffdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddffdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 -- 172.21.15.66:0/307215151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ddf0b130 con 0x5593ddff09d0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf91762640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddffdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf91762640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 0x7fbf740a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009a60 tx=0x7fbf840316c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf90f61640 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c09b680 tx=0x7fbf7c09b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63edd73497e1c16c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf72ffd640 1 -- 172.21.15.66:0/307215151 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c086110 con 0x5593ddff09d0 2024-09-15T22:45:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf72ffd640 1 -- 172.21.15.66:0/307215151 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf7c09b980 con 0x5593ddff09d0 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.179+0000 7fbf72ffd640 1 -- 172.21.15.66:0/307215151 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0c4cd0 con 0x5593ddff09d0 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- 172.21.15.66:0/307215151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 msgr2=0x5593ddff0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c09b680 tx=0x7fbf7c09b810 comp rx=0 tx=0).stop 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- 172.21.15.66:0/307215151 shutdown_connections 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddffdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff12f0 0x5593ddffb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 --2- 172.21.15.66:0/307215151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593ddff0db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- 172.21.15.66:0/307215151 >> 172.21.15.66:0/307215151 conn(0x5593ddfecf60 msgr2=0x5593ddfed340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- 172.21.15.66:0/307215151 shutdown_connections 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- 172.21.15.66:0/307215151 wait complete. 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.180+0000 7fbf9559e740 1 -- start start 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 Processor -- start 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593ddffb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 0x5593ddff87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593ddffe780 con 0x5593ddffbbb0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5593ddf11f20 con 0x5593ddff12f0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593ddffe900 con 0x5593ddff09d0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf9559e740 10 client.0 _ll_register_callbacks cb 0x5593ddedb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf91762640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf91762640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49900/0 (socket says 172.21.15.66:49900) 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf91762640 1 -- 172.21.15.66:0/3529046088 learned_addr learned my addr 172.21.15.66:0/3529046088 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf90f61640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593ddffb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.181+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 0x5593ddff87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 -- 172.21.15.66:0/3529046088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 msgr2=0x5593ddffb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593ddffb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 -- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 msgr2=0x5593ddff87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 0x5593ddff87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 -- 172.21.15.66:0/3529046088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593ddcc82b0 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf90f61640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593ddffb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 0x5593ddff87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf91762640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbf84035000 tx=0x7fbf8402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d550a383eda1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84003e00 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf7c09b980 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf84004750 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf8405c050 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf9559e740 10 client.15636 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593de00a120 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf7c09b980 con 0x5593ddffbbb0 2024-09-15T22:45:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.182+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbf84030070 con 0x5593ddffbbb0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 10 client.15636 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 10 client.15636 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 20 client.15636 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de00c7d0 0x5593de00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 4 client.15636 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593ddf64600 con 0x5593de00c7d0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf90f61640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de00c7d0 0x5593de00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf90f61640 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de00c7d0 0x5593de00dc40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4059ff00a7c29f server_cookie=e6eaaef3d760ebe2 in_seq=0 out_seq=0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.183+0000 7fbf6bfff640 10 client.15636 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf6bfff640 1 -- 172.21.15.66:0/3529046088 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593ddf64600 con 0x5593de00c7d0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf6bfff640 10 client.15636 handle_command_reply: tid=0 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 client.15636 shutdown 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 msgr2=0x5593ddff8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbf84035000 tx=0x7fbf8402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 shutdown_connections 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddffbbb0 0x5593ddff8d10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de00c7d0 0x5593de00dc40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff12f0 0x5593ddff87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 --2- 172.21.15.66:0/3529046088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593ddffb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf6bfff640 0 client.15636 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 >> 172.21.15.66:0/3529046088 conn(0x5593ddfecf60 msgr2=0x5593ddff2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 shutdown_connections 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.184+0000 7fbf9559e740 1 -- 172.21.15.66:0/3529046088 wait complete. 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.185+0000 7fbf9559e740 20 client.15636 trim_cache size 0 max 16384 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 Processor -- start 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 -- start start 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593de00c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 0x5593ddff8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593de00bf80 con 0x5593ddff12f0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5593de00c650 con 0x5593ddffbbb0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf9559e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593de00cd20 con 0x5593ddff09d0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49916/0 (socket says 172.21.15.66:49916) 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf8bfff640 1 -- 172.21.15.66:0/113178921 learned_addr learned my addr 172.21.15.66:0/113178921 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf90f61640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593de00c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.203+0000 7fbf91762640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 0x5593ddff8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 -- 172.21.15.66:0/113178921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 msgr2=0x5593de00c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593de00c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 -- 172.21.15.66:0/113178921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 msgr2=0x5593ddff8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 0x5593ddff8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 -- 172.21.15.66:0/113178921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ddff1120 con 0x5593ddff12f0 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf91762640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 0x5593ddff8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005fd0 tx=0x7fbf8000bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee49ada3952aa252 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf727fc640 1 -- 172.21.15.66:0/113178921 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003ca0 con 0x5593ddff12f0 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf727fc640 1 -- 172.21.15.66:0/113178921 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf80003e40 con 0x5593ddff12f0 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.204+0000 7fbf727fc640 1 -- 172.21.15.66:0/113178921 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800116a0 con 0x5593ddff12f0 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- 172.21.15.66:0/113178921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 msgr2=0x5593de00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005fd0 tx=0x7fbf8000bc90 comp rx=0 tx=0).stop 2024-09-15T22:45:51.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- 172.21.15.66:0/113178921 shutdown_connections 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddffbbb0 0x5593ddff8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de00dc40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 --2- 172.21.15.66:0/113178921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddff09d0 0x5593de00c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- 172.21.15.66:0/113178921 >> 172.21.15.66:0/113178921 conn(0x5593ddfecf60 msgr2=0x5593ddff8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- 172.21.15.66:0/113178921 shutdown_connections 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- 172.21.15.66:0/113178921 wait complete. 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 -- start start 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.205+0000 7fbf9559e740 1 Processor -- start 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593de010e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddffbbb0 0x5593de0118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5593de00dac0 con 0x5593ddff12f0 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5593de00d3f0 con 0x5593ddff09d0 2024-09-15T22:45:51.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593de00e190 con 0x5593ddffbbb0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf9559e740 10 client.0 _ll_register_callbacks cb 0x7fbf84009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49924/0 (socket says 172.21.15.66:49924) 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 -- 172.21.15.66:0/4032666602 learned_addr learned my addr 172.21.15.66:0/4032666602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf90f61640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593de010e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf91762640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddffbbb0 0x5593de0118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 -- 172.21.15.66:0/4032666602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddffbbb0 msgr2=0x5593de0118d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddffbbb0 0x5593de0118d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 -- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 msgr2=0x5593de010e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593de010e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 -- 172.21.15.66:0/4032666602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593de0750d0 con 0x5593ddff12f0 2024-09-15T22:45:51.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf90f61640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593de010e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf8bfff640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001d040 tx=0x7fbf80004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699476bffdb0480b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.206+0000 7fbf6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003aa0 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf80003c40 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf80003e40 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf80034050 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 10 client.15642 fetch_fsmap learned FSMap version 28 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593de0763b0 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf80003e40 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbf8001a070 con 0x5593ddff12f0 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 10 client.15642 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 10 client.15642 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 20 client.15642 populate_metadata read hostname 'smithi066' 2024-09-15T22:45:51.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de07ac80 0x5593de079990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 4 client.15642 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.207+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "status"}) -- 0x5593ddf5eb10 con 0x5593de07ac80 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf90f61640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de07ac80 0x5593de079990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf90f61640 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de07ac80 0x5593de079990 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f32d18245e71b59 server_cookie=cf7fba5a574bd4b in_seq=0 out_seq=0 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf6bfff640 10 client.15642 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf6bfff640 1 -- 172.21.15.66:0/4032666602 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5593ddf5eb10 con 0x5593de07ac80 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf6bfff640 10 client.15642 handle_command_reply: tid=0 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 client.15642 shutdown 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 msgr2=0x5593de011390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001d040 tx=0x7fbf80004a80 comp rx=0 tx=0).stop 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 shutdown_connections 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ddffbbb0 0x5593de0118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5593ddff12f0 0x5593de011390 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5593de07ac80 0x5593de079990 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 --2- 172.21.15.66:0/4032666602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5593ddff09d0 0x5593de010e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf6bfff640 0 client.15642 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.208+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 >> 172.21.15.66:0/4032666602 conn(0x5593ddfecf60 msgr2=0x5593ddff8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 shutdown_connections 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf9559e740 1 -- 172.21.15.66:0/4032666602 wait complete. 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf9559e740 20 client.15642 trim_cache size 0 max 16384 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stdout: "cluster_fsid": "7d1c9c1c-73b2-11ef-bceb-c7b262605968", 2024-09-15T22:45:51.227 INFO:teuthology.orchestra.run.smithi066.stdout: "whoami": 0, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 24461, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "want_state": "up:active", 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "state": "up:active", 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs", 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "rank_uptime": 176.42608875499999, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "mdsmap_epoch": 28, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch": 90, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: "uptime": 187.277770248 2024-09-15T22:45:51.228 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 msgr2=0x7fbf740a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 0x7fbf740a5900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009a60 tx=0x7fbf840316c0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 msgr2=0x7fbf8c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00d950 tx=0x7fbf7c00de10 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 shutdown_connections 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf740a3440 0x7fbf740a5900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf8c106a80 0x7fbf8c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.209+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8c101420 0x7fbf8c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.210+0000 7fbf931c5640 1 --2- 172.21.15.66:0/654933602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf8c100a80 0x7fbf8c198470 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:45:51.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.210+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 >> 172.21.15.66:0/654933602 conn(0x7fbf8c0fc7a0 msgr2=0x7fbf8c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:45:51.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.210+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 shutdown_connections 2024-09-15T22:45:51.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:45:51.210+0000 7fbf931c5640 1 -- 172.21.15.66:0/654933602 wait complete. 2024-09-15T22:45:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:50 smithi087 ceph-mon[35290]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-15T22:45:51.888 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-15T22:45:53.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:52 smithi184 ceph-mon[35203]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:53.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:52 smithi066 ceph-mon[31185]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:52 smithi087 ceph-mon[35290]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:54 smithi184 ceph-mon[35203]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:45:55.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:54 smithi066 ceph-mon[31185]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:45:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:54 smithi087 ceph-mon[35290]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:45:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:56 smithi184 ceph-mon[35203]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:57.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:56 smithi066 ceph-mon[31185]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:56 smithi087 ceph-mon[35290]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-15T22:45:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:45:58 smithi184 ceph-mon[35203]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:45:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:45:58 smithi066 ceph-mon[31185]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:45:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:45:58 smithi087 ceph-mon[35290]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:46:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:00 smithi184 ceph-mon[35203]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:46:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-mon[31185]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:46:01.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:46:00.983+0000 7f85185fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:01.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:46:00.983+0000 7f85185fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:01.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:46:00.983+0000 7f85185fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:01.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:46:00.983+0000 7f85185fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:01.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:46:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:46:00.983+0000 7f85185fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:46:01.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:46:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:00 smithi087 ceph-mon[35290]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-15T22:46:01.519 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:02.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- 172.21.15.66:0/3307701160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8106f40 msgr2=0x7f04f810eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 --2- 172.21.15.66:0/3307701160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8106f40 0x7f04f810eac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009ca0 tx=0x7f04f002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- 172.21.15.66:0/3307701160 shutdown_connections 2024-09-15T22:46:02.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 --2- 172.21.15.66:0/3307701160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8106f40 0x7f04f810eac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 --2- 172.21.15.66:0/3307701160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f81027c0 0x7f04f8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 --2- 172.21.15.66:0/3307701160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f8101e10 0x7f04f81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- 172.21.15.66:0/3307701160 >> 172.21.15.66:0/3307701160 conn(0x7f04f80fd8d0 msgr2=0x7f04f80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- 172.21.15.66:0/3307701160 shutdown_connections 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- 172.21.15.66:0/3307701160 wait complete. 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 Processor -- start 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.038+0000 7f04fee84640 1 -- start start 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 0x7f04f8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 0x7f04f819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8111fa0 con 0x7f04f8101e10 2024-09-15T22:46:02.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8111e20 con 0x7f04f81027c0 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fee84640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8112120 con 0x7f04f8106f40 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fcc20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 0x7f04f8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fcc20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34916/0 (socket says 172.21.15.66:34916) 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fcc20640 1 -- 172.21.15.66:0/3038746502 learned_addr learned my addr 172.21.15.66:0/3038746502 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fd421640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 0x7f04f819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 -- 172.21.15.66:0/3038746502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 msgr2=0x7f04f819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 0x7f04f819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 -- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 msgr2=0x7f04f8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 -- 172.21.15.66:0/3038746502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f819d2f0 con 0x7f04f81027c0 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:02.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04fd421640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 0x7f04f819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.039+0000 7f04f7fff640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 0x7f04f8198880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c970 tx=0x7f04e400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.040+0000 7f04f5ffb640 1 -- 172.21.15.66:0/3038746502 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4007bb0 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.040+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f819d5e0 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.040+0000 7f04f5ffb640 1 -- 172.21.15.66:0/3038746502 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04e4007d50 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.040+0000 7f04f5ffb640 1 -- 172.21.15.66:0/3038746502 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004e60 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.040+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81a4ec0 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.042+0000 7f04f5ffb640 1 -- 172.21.15.66:0/3038746502 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f04e4005000 con 0x7f04f81027c0 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.042+0000 7f050125d740 1 Processor -- start 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.042+0000 7f050125d740 1 -- start start 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153cdbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562153c3d2e0 con 0x562153ce6a90 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562153be4ce0 con 0x562153cdc1d0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f050125d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562153c392a0 con 0x562153cdb8b0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04f5ffb640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 0x7f04e80a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46694/0 (socket says 172.21.15.66:46694) 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 -- 172.21.15.66:0/3704209011 learned_addr learned my addr 172.21.15.66:0/3704209011 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fd421640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 0x7f04e80a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04f5ffb640 1 -- 172.21.15.66:0/3038746502 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04e40d04f0 con 0x7f04f81027c0 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 -- 172.21.15.66:0/3704209011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 msgr2=0x562153cdbc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153cdbc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 -- 172.21.15.66:0/3704209011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 msgr2=0x562153ce8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 -- 172.21.15.66:0/3704209011 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562153bc9440 con 0x562153cdc1d0 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.043+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04ec011650 tx=0x7f04ec009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4532a2c3e9ee6496 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f04e2ffd640 1 -- 172.21.15.66:0/3704209011 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec01e070 con 0x562153cdc1d0 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f04e2ffd640 1 -- 172.21.15.66:0/3704209011 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04ec00fba0 con 0x562153cdc1d0 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f04e2ffd640 1 -- 172.21.15.66:0/3704209011 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec019cc0 con 0x562153cdc1d0 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 -- 172.21.15.66:0/3704209011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 msgr2=0x562153ce6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04ec011650 tx=0x7f04ec009f90 comp rx=0 tx=0).stop 2024-09-15T22:46:02.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f04fd421640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 0x7f04e80a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009430 tx=0x7f04f0005ef0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 -- 172.21.15.66:0/3704209011 shutdown_connections 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdc1d0 0x562153ce6550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 --2- 172.21.15.66:0/3704209011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153cdbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.044+0000 7f050125d740 1 -- 172.21.15.66:0/3704209011 >> 172.21.15.66:0/3704209011 conn(0x562153cd7e40 msgr2=0x562153cd8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- 172.21.15.66:0/3704209011 shutdown_connections 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- 172.21.15.66:0/3704209011 wait complete. 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- start start 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 Processor -- start 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153ce6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153ce6a90 0x562153ce3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562153ce9660 con 0x562153cdc1d0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562153bf8050 con 0x562153ce6a90 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562153ce97e0 con 0x562153cdb8b0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.045+0000 7f050125d740 10 client.0 _ll_register_callbacks cb 0x562153c38160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34928/0 (socket says 172.21.15.66:34928) 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 -- 172.21.15.66:0/2077871706 learned_addr learned my addr 172.21.15.66:0/2077871706 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04fcc20640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153ce6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04fd421640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153ce6a90 0x562153ce3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 -- 172.21.15.66:0/2077871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 msgr2=0x562153ce6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153ce6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 -- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153ce6a90 msgr2=0x562153ce3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153ce6a90 0x562153ce3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 -- 172.21.15.66:0/2077871706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621539ae3c0 con 0x562153cdc1d0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04f7fff640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f04e409be90 tx=0x7f04e4005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5d996ca493179 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e409c890 con 0x562153cdc1d0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04e40a00d0 con 0x562153cdc1d0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04ec00fba0 con 0x562153cdc1d0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.046+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04e409c190 con 0x562153cdc1d0 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:02.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562153cf50b0 con 0x562153cdc1d0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04ec00fba0 con 0x562153cdc1d0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f04e40a4970 con 0x562153cdc1d0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 20 client.15660 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153cf64c0 0x562153cf88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 4 client.15660 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562153c4a850 con 0x562153cf64c0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.047+0000 7f04fcc20640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153cf64c0 0x562153cf88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f04fcc20640 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153cf64c0 0x562153cf88d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f32189f67302c3 server_cookie=b5bb6fc0726096bf in_seq=0 out_seq=0 2024-09-15T22:46:02.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f04d7fff640 10 client.15660 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f04d7fff640 1 -- 172.21.15.66:0/2077871706 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562153c4a850 con 0x562153cf64c0 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f04d7fff640 10 client.15660 handle_command_reply: tid=0 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 client.15660 shutdown 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 msgr2=0x562153ce36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f04e409be90 tx=0x7f04e4005900 comp rx=0 tx=0).stop 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 shutdown_connections 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153cf64c0 0x562153cf88d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153ce6a90 0x562153ce3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153cdc1d0 0x562153ce36c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 --2- 172.21.15.66:0/2077871706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdb8b0 0x562153ce6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 >> 172.21.15.66:0/2077871706 conn(0x562153cd7e40 msgr2=0x562153cd2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.048+0000 7f04d7fff640 0 client.15660 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:02.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.049+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 shutdown_connections 2024-09-15T22:46:02.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.049+0000 7f050125d740 1 -- 172.21.15.66:0/2077871706 wait complete. 2024-09-15T22:46:02.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.049+0000 7f050125d740 20 client.15660 trim_cache size 0 max 16384 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.066+0000 7f050125d740 1 Processor -- start 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.066+0000 7f050125d740 1 -- start start 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.066+0000 7f050125d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153cf28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.066+0000 7f050125d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ce2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.066+0000 7f050125d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f050125d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81aceb0 con 0x562153ce6a90 2024-09-15T22:46:02.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f050125d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81ae9f0 con 0x562153cdb8b0 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f050125d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81ad580 con 0x562153cdc1d0 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34944/0 (socket says 172.21.15.66:34944) 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 -- 172.21.15.66:0/2965380105 learned_addr learned my addr 172.21.15.66:0/2965380105 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fcc20640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153cf28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04f7fff640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ce2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 -- 172.21.15.66:0/2965380105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 msgr2=0x562153ce2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ce2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 -- 172.21.15.66:0/2965380105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 msgr2=0x562153cf28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153cf28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 -- 172.21.15.66:0/2965380105 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562153ce2670 con 0x562153ce6a90 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04f7fff640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ce2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:02.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.067+0000 7f04fd421640 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f04f0035000 tx=0x7f04f003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a6a5b3a8fa7e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f04e27fc640 1 -- 172.21.15.66:0/2965380105 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f002f610 con 0x562153ce6a90 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f04e27fc640 1 -- 172.21.15.66:0/2965380105 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04f004d070 con 0x562153ce6a90 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f04e27fc640 1 -- 172.21.15.66:0/2965380105 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0030b20 con 0x562153ce6a90 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 -- 172.21.15.66:0/2965380105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 msgr2=0x562153ce5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f04f0035000 tx=0x7f04f003e000 comp rx=0 tx=0).stop 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 -- 172.21.15.66:0/2965380105 shutdown_connections 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153ce5630 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ce2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 --2- 172.21.15.66:0/2965380105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153cf28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 -- 172.21.15.66:0/2965380105 >> 172.21.15.66:0/2965380105 conn(0x562153cd7e40 msgr2=0x562153ce4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.068+0000 7f050125d740 1 -- 172.21.15.66:0/2965380105 shutdown_connections 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 -- 172.21.15.66:0/2965380105 wait complete. 2024-09-15T22:46:02.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 -- start start 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 Processor -- start 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153ceaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ceb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81ae320 con 0x562153ce6a90 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81adc50 con 0x562153cdb8b0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04f81aae90 con 0x562153cdc1d0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.069+0000 7f050125d740 10 client.0 _ll_register_callbacks cb 0x7f04e400c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34960/0 (socket says 172.21.15.66:34960) 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 -- 172.21.15.66:0/3440274392 learned_addr learned my addr 172.21.15.66:0/3440274392 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153ceaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04f7fff640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ceb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 -- 172.21.15.66:0/3440274392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 msgr2=0x562153ceb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ceb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 -- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 msgr2=0x562153ceaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153ceaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 -- 172.21.15.66:0/3440274392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562153ce3fb0 con 0x562153ce6a90 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04f7fff640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ceb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04fd421640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f04f0030f90 tx=0x7f04f0030fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63efc31c142768d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f002f610 con 0x562153ce6a90 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04f002f7b0 con 0x562153ce6a90 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.070+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f004d070 con 0x562153ce6a90 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04f0063050 con 0x562153ce6a90 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:02.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562153d617f0 con 0x562153ce6a90 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04f0036050 con 0x562153ce6a90 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f04f0052940 con 0x562153ce6a90 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 20 client.15666 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153d61e00 0x562153d641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 4 client.15666 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f04f004d070 con 0x562153d61e00 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.071+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153d61e00 0x562153d641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f04fcc20640 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153d61e00 0x562153d641f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c4ebbcd7915be9 server_cookie=99c29ec209819357 in_seq=0 out_seq=0 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f04d7fff640 10 client.15666 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f04d7fff640 1 -- 172.21.15.66:0/3440274392 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f04f004d070 con 0x562153d61e00 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f04d7fff640 10 client.15666 handle_command_reply: tid=0 2024-09-15T22:46:02.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 client.15666 shutdown 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 msgr2=0x562153d60170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f04f0030f90 tx=0x7f04f0030fc0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 shutdown_connections 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562153ce6a90 0x562153d60170 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562153cdc1d0 0x562153ceb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562153d61e00 0x562153d641f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f04d7fff640 0 client.15666 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 --2- 172.21.15.66:0/3440274392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562153cdb8b0 0x562153ceaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 >> 172.21.15.66:0/3440274392 conn(0x562153cd7e40 msgr2=0x562153cd2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 shutdown_connections 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 1 -- 172.21.15.66:0/3440274392 wait complete. 2024-09-15T22:46:02.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.072+0000 7f050125d740 20 client.15666 trim_cache size 0 max 16384 2024-09-15T22:46:02.085 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:02.085 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:46:02.085 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:46:02.085 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 msgr2=0x7f04e80a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 0x7f04e80a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009430 tx=0x7f04f0005ef0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 msgr2=0x7f04f8198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 0x7f04f8198880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c970 tx=0x7f04e400ce30 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 shutdown_connections 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04e80a3550 0x7f04e80a5a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04f8106f40 0x7f04f819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04f81027c0 0x7f04f8198880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 --2- 172.21.15.66:0/3038746502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04f8101e10 0x7f04f8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 >> 172.21.15.66:0/3038746502 conn(0x7f04f80fd8d0 msgr2=0x7f04f80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 shutdown_connections 2024-09-15T22:46:02.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:02.073+0000 7f04fee84640 1 -- 172.21.15.66:0/3038746502 wait complete. 2024-09-15T22:46:02.854 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:46:02.854 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:46:02.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:02 smithi066 ceph-mon[31185]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:02.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:02 smithi066 ceph-mon[31185]: mgrmap e25: x(active, since 40s), standbys: y, z 2024-09-15T22:46:03.129 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:02 smithi184 ceph-mon[35203]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:02 smithi184 ceph-mon[35203]: mgrmap e25: x(active, since 40s), standbys: y, z 2024-09-15T22:46:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:02 smithi087 ceph-mon[35290]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:02 smithi087 ceph-mon[35290]: mgrmap e25: x(active, since 40s), standbys: y, z 2024-09-15T22:46:03.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 -- 172.21.15.66:0/2889069240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401036e0 msgr2=0x7fc540107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 --2- 172.21.15.66:0/2889069240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401036e0 0x7fc540107b90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc530009930 tx=0x7fc53002a420 comp rx=0 tx=0).stop 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 -- 172.21.15.66:0/2889069240 shutdown_connections 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 --2- 172.21.15.66:0/2889069240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401082a0 0x7fc54010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 --2- 172.21.15.66:0/2889069240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401036e0 0x7fc540107b90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 --2- 172.21.15.66:0/2889069240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc540103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 -- 172.21.15.66:0/2889069240 >> 172.21.15.66:0/2889069240 conn(0x7fc5400fc7d0 msgr2=0x7fc5400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 -- 172.21.15.66:0/2889069240 shutdown_connections 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.621+0000 7fc547486640 1 -- 172.21.15.66:0/2889069240 wait complete. 2024-09-15T22:46:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 Processor -- start 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 -- start start 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc5401a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401036e0 0x7fc5401a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5401120a0 con 0x7fc5401082a0 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc540111f20 con 0x7fc5401036e0 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc547486640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc540112220 con 0x7fc540102d30 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc545a23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc545a23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47366/0 (socket says 172.21.15.66:47366) 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc545a23640 1 -- 172.21.15.66:0/3483865385 learned_addr learned my addr 172.21.15.66:0/3483865385 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc544a21640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401036e0 0x7fc5401a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.622+0000 7fc545222640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc5401a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 -- 172.21.15.66:0/3483865385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 msgr2=0x7fc5401a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc5401a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 -- 172.21.15.66:0/3483865385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401036e0 msgr2=0x7fc5401a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401036e0 0x7fc5401a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 -- 172.21.15.66:0/3483865385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54019ad40 con 0x7fc5401082a0 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545222640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc5401a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc545a23640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc538009fd0 tx=0x7fc53800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538017070 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc538003e50 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54019b030 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5380106c0 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.623+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401a7320 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.624+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54006a850 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.626+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fc538003970 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.626+0000 7fc5367fc640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 0x7fc52c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.626+0000 7fc545222640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 0x7fc52c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.627+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc5380d00b0 con 0x7fc5401082a0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.627+0000 7fc545222640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 0x7fc52c0a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005fd0 tx=0x7fc53c005ea0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.630+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc53809c470 con 0x7fc5401082a0 2024-09-15T22:46:03.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.848+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc540103110 con 0x7fc5401082a0 2024-09-15T22:46:03.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.849+0000 7fc5367fc640 1 -- 172.21.15.66:0/3483865385 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fc540103110 con 0x7fc5401082a0 2024-09-15T22:46:03.850 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:46:03.850 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:46:03.851 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.851+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 msgr2=0x7fc52c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.851+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 0x7fc52c0a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc53c005fd0 tx=0x7fc53c005ea0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.851+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 msgr2=0x7fc54019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.851+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc538009fd0 tx=0x7fc53800b260 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 shutdown_connections 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc52c0a34d0 0x7fc52c0a5990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5401082a0 0x7fc54019a610 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5401036e0 0x7fc5401a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 --2- 172.21.15.66:0/3483865385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc540102d30 0x7fc5401a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 >> 172.21.15.66:0/3483865385 conn(0x7fc5400fc7d0 msgr2=0x7fc540100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:03.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 shutdown_connections 2024-09-15T22:46:03.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:03.852+0000 7fc547486640 1 -- 172.21.15.66:0/3483865385 wait complete. 2024-09-15T22:46:04.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3483865385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3483865385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3483865385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:04.676 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:46:04.951 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:05.185 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:04 smithi066 ceph-mon[31185]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:46:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:04 smithi087 ceph-mon[35290]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:46:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:04 smithi184 ceph-mon[35203]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 -- 172.21.15.66:0/369423318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 msgr2=0x7f58301021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 --2- 172.21.15.66:0/369423318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58301021f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5820009ca0 tx=0x7f582002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 -- 172.21.15.66:0/369423318 shutdown_connections 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 --2- 172.21.15.66:0/369423318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5830106f40 0x7f583010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 --2- 172.21.15.66:0/369423318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58301027c0 0x7f5830106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 --2- 172.21.15.66:0/369423318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58301021f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.442+0000 7f58373aa640 1 -- 172.21.15.66:0/369423318 >> 172.21.15.66:0/369423318 conn(0x7f58300fd8d0 msgr2=0x7f58300ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.443+0000 7f58373aa640 1 -- 172.21.15.66:0/369423318 shutdown_connections 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.443+0000 7f58373aa640 1 -- 172.21.15.66:0/369423318 wait complete. 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.443+0000 7f58373aa640 1 Processor -- start 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.443+0000 7f58373aa640 1 -- start start 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58301027c0 0x7f5830074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 0x7f5830074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5830111f60 con 0x7f5830101e10 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5830111de0 con 0x7f58301027c0 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f58373aa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58301120e0 con 0x7f5830106f40 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47392/0 (socket says 172.21.15.66:47392) 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 -- 172.21.15.66:0/3152812867 learned_addr learned my addr 172.21.15.66:0/3152812867 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5834945640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58301027c0 0x7f5830074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835947640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 0x7f5830074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 -- 172.21.15.66:0/3152812867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 msgr2=0x7f5830074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 0x7f5830074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 -- 172.21.15.66:0/3152812867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58301027c0 msgr2=0x7f5830074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58301027c0 0x7f5830074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 -- 172.21.15.66:0/3152812867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58301a6920 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835947640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 0x7f5830074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.444+0000 7f5835146640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f582002ade0 tx=0x7f58200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.445+0000 7f582e7fc640 1 -- 172.21.15.66:0/3152812867 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582002fa20 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.445+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58301a6bb0 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.445+0000 7f582e7fc640 1 -- 172.21.15.66:0/3152812867 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f582002fbc0 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.445+0000 7f582e7fc640 1 -- 172.21.15.66:0/3152812867 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200467b0 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.445+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301a7140 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.447+0000 7f582e7fc640 1 -- 172.21.15.66:0/3152812867 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f5820046950 con 0x7f5830101e10 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 Processor -- start 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 -- start start 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03fa45d0 0x561b03fa4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03faf370 0x561b03fb1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b03f0a2f0 con 0x561b03fa5b40 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561b03eb1cf0 con 0x561b03faf370 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5839783740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561b03f062b0 con 0x561b03fa45d0 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f582e7fc640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 0x7f58180a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5835947640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5835947640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47396/0 (socket says 172.21.15.66:47396) 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.448+0000 7f5835947640 1 -- 172.21.15.66:0/3886069695 learned_addr learned my addr 172.21.15.66:0/3886069695 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 0x7f58180a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f582e7fc640 1 -- 172.21.15.66:0/3152812867 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f58200f17b0 con 0x7f5830101e10 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5834945640 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03faf370 0x561b03fb1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835146640 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03fa45d0 0x561b03fa4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 -- 172.21.15.66:0/3886069695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03fa45d0 msgr2=0x561b03fa4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03fa45d0 0x561b03fa4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 -- 172.21.15.66:0/3886069695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03faf370 msgr2=0x561b03fb1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03faf370 0x561b03fb1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 -- 172.21.15.66:0/3886069695 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b03e963a0 con 0x561b03fa5b40 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5828005fd0 tx=0x7f5828015b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471fc4d5d0e975c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f5835947640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 0x7f58180a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5828013770 tx=0x7f582801c000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f58177fe640 1 -- 172.21.15.66:0/3886069695 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828022070 con 0x561b03fa5b40 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f58177fe640 1 -- 172.21.15.66:0/3886069695 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5828015540 con 0x561b03fa5b40 2024-09-15T22:46:05.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.449+0000 7f58177fe640 1 -- 172.21.15.66:0/3886069695 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582801e430 con 0x561b03fa5b40 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 -- 172.21.15.66:0/3886069695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 msgr2=0x561b03fa4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5828005fd0 tx=0x7f5828015b20 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 -- 172.21.15.66:0/3886069695 shutdown_connections 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03faf370 0x561b03fb1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03fa45d0 0x561b03fa4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 --2- 172.21.15.66:0/3886069695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa5b40 0x561b03fa4090 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 -- 172.21.15.66:0/3886069695 >> 172.21.15.66:0/3886069695 conn(0x561b03f6d310 msgr2=0x561b03fa0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 -- 172.21.15.66:0/3886069695 shutdown_connections 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.450+0000 7f5839783740 1 -- 172.21.15.66:0/3886069695 wait complete. 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 -- start start 2024-09-15T22:46:05.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 Processor -- start 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b03fb2010 con 0x561b03fa45d0 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561b03ec5060 con 0x561b03fa5b40 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561b03fb2190 con 0x561b03faf370 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5839783740 10 client.0 _ll_register_callbacks cb 0x561b03c188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47400/0 (socket says 172.21.15.66:47400) 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5835146640 1 -- 172.21.15.66:0/1875063220 learned_addr learned my addr 172.21.15.66:0/1875063220 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.451+0000 7f5835947640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5834945640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 -- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 msgr2=0x561b03fac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 -- 172.21.15.66:0/1875063220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 msgr2=0x561b03fac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 -- 172.21.15.66:0/1875063220 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b03c7b3c0 con 0x561b03fa45d0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5834945640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5835146640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f58200b9a70 tx=0x7f58200bddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfbd3d05e32b0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5814ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200d6060 con 0x561b03fa45d0 2024-09-15T22:46:05.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f58200f1380 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5828015540 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5820046e40 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5839783740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.452+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b03fb2010 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5828015540 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f582004e030 con 0x561b03fa45d0 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 10 client.15684 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 20 client.15684 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:05.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b03fc1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 4 client.15684 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b03f17860 con 0x561b03fbf000 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.453+0000 7f5834945640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b03fc1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.454+0000 7f5814ff9640 10 client.15684 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.454+0000 7f5834945640 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b03fc1450 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1fec6f91b770589a server_cookie=9d06a6f14b5c42ec in_seq=0 out_seq=0 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.454+0000 7f5814ff9640 1 -- 172.21.15.66:0/1875063220 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b03f17860 con 0x561b03fbf000 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.454+0000 7f5814ff9640 10 client.15684 handle_command_reply: tid=0 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.454+0000 7f5839783740 1 client.15684 shutdown 2024-09-15T22:46:05.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 msgr2=0x561b03faee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f58200b9a70 tx=0x7f58200bddd0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 shutdown_connections 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b03fc1450 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5814ff9640 0 client.15684 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 --2- 172.21.15.66:0/1875063220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03faee00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 >> 172.21.15.66:0/1875063220 conn(0x561b03f6d310 msgr2=0x561b03fa6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 shutdown_connections 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 1 -- 172.21.15.66:0/1875063220 wait complete. 2024-09-15T22:46:05.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.455+0000 7f5839783740 20 client.15684 trim_cache size 0 max 16384 2024-09-15T22:46:05.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 Processor -- start 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 -- start start 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fc6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fc72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58301b11f0 con 0x561b03fa45d0 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58301b2d30 con 0x561b03fa5b40 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5839783740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58301b18c0 con 0x561b03faf370 2024-09-15T22:46:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47412/0 (socket says 172.21.15.66:47412) 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5835146640 1 -- 172.21.15.66:0/783604140 learned_addr learned my addr 172.21.15.66:0/783604140 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5835947640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fc72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.470+0000 7f5834945640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fc6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 -- 172.21.15.66:0/783604140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 msgr2=0x561b03fc72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fc72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 -- 172.21.15.66:0/783604140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 msgr2=0x561b03fc6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fc6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 -- 172.21.15.66:0/783604140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b03facbb0 con 0x561b03fa45d0 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5834945640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fc6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835947640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fc72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5835146640 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f58200bd5a0 tx=0x7f58200bde40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9df3ae375c8717 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5816ffd640 1 -- 172.21.15.66:0/783604140 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200c61f0 con 0x561b03fa45d0 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5816ffd640 1 -- 172.21.15.66:0/783604140 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5820036070 con 0x561b03fa45d0 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.471+0000 7f5816ffd640 1 -- 172.21.15.66:0/783604140 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200f1380 con 0x561b03fa45d0 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- 172.21.15.66:0/783604140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 msgr2=0x561b03fab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f58200bd5a0 tx=0x7f58200bde40 comp rx=0 tx=0).stop 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- 172.21.15.66:0/783604140 shutdown_connections 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fc72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fc6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 --2- 172.21.15.66:0/783604140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fab0b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- 172.21.15.66:0/783604140 >> 172.21.15.66:0/783604140 conn(0x561b03f6d310 msgr2=0x561b03faa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- 172.21.15.66:0/783604140 shutdown_connections 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- 172.21.15.66:0/783604140 wait complete. 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 -- start start 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.472+0000 7f5839783740 1 Processor -- start 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fb7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fa8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58301b2660 con 0x561b03fa45d0 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58301b1f90 con 0x561b03fa5b40 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58301af1d0 con 0x561b03faf370 2024-09-15T22:46:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5839783740 10 client.0 _ll_register_callbacks cb 0x7f58200bcf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47428/0 (socket says 172.21.15.66:47428) 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 -- 172.21.15.66:0/358310406 learned_addr learned my addr 172.21.15.66:0/358310406 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5834945640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fb7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835947640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fa8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 -- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 msgr2=0x561b03fa8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fa8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 -- 172.21.15.66:0/358310406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 msgr2=0x561b03fb7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fb7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.473+0000 7f5835146640 1 -- 172.21.15.66:0/358310406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b03fa9330 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5835146640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58200bd2c0 tx=0x7f582002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3027f19e5c57e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5814ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200eea00 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f58200f1380 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5820036070 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58200a6050 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5839783740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b03fa9330 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.474+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58200b9040 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f582009f060 con 0x561b03fa45d0 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 10 client.15690 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 20 client.15690 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b04034280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 4 client.15690 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5820036070 con 0x561b03fbf000 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5834945640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b04034280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5814ff9640 10 client.15690 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.475+0000 7f5834945640 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b04034280 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7226597e9ee35766 server_cookie=299727345ec328f in_seq=0 out_seq=0 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5814ff9640 1 -- 172.21.15.66:0/358310406 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5820036070 con 0x561b03fbf000 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5814ff9640 10 client.15690 handle_command_reply: tid=0 2024-09-15T22:46:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 client.15690 shutdown 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 msgr2=0x561b03fb7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58200bd2c0 tx=0x7f582002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 shutdown_connections 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x561b03fbf000 0x561b04034280 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5814ff9640 0 client.15690 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b03faf370 0x561b03fa8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b03fa5b40 0x561b03fb7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 --2- 172.21.15.66:0/358310406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b03fa45d0 0x561b03fb7730 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 >> 172.21.15.66:0/358310406 conn(0x561b03f6d310 msgr2=0x561b03fab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 shutdown_connections 2024-09-15T22:46:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 1 -- 172.21.15.66:0/358310406 wait complete. 2024-09-15T22:46:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.476+0000 7f5839783740 20 client.15690 trim_cache size 0 max 16384 2024-09-15T22:46:05.491 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 msgr2=0x7f58180a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 0x7f58180a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5828013770 tx=0x7f582801c000 comp rx=0 tx=0).stop 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 msgr2=0x7f58300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f582002ade0 tx=0x7f58200319f0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 shutdown_connections 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f58180a34d0 0x7f58180a5990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5830106f40 0x7f5830074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58301027c0 0x7f5830074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 --2- 172.21.15.66:0/3152812867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5830101e10 0x7f58300744f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 >> 172.21.15.66:0/3152812867 conn(0x7f58300fd8d0 msgr2=0x7f58300fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 shutdown_connections 2024-09-15T22:46:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:05.477+0000 7f58373aa640 1 -- 172.21.15.66:0/3152812867 wait complete. 2024-09-15T22:46:06.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:46:06.422 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.2 2024-09-15T22:46:06.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:46:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.936+0000 7fd818190640 1 -- 172.21.15.66:0/2316854615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8101036e0 msgr2=0x7fd810107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.936+0000 7fd818190640 1 --2- 172.21.15.66:0/2316854615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8101036e0 0x7fd810107b90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd800009930 tx=0x7fd80002a420 comp rx=0 tx=0).stop 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 -- 172.21.15.66:0/2316854615 shutdown_connections 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 --2- 172.21.15.66:0/2316854615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd81010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 --2- 172.21.15.66:0/2316854615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8101036e0 0x7fd810107b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 --2- 172.21.15.66:0/2316854615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 0x7fd810103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 -- 172.21.15.66:0/2316854615 >> 172.21.15.66:0/2316854615 conn(0x7fd8100fc7d0 msgr2=0x7fd8100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 -- 172.21.15.66:0/2316854615 shutdown_connections 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.937+0000 7fd818190640 1 -- 172.21.15.66:0/2316854615 wait complete. 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 Processor -- start 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 -- start start 2024-09-15T22:46:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 0x7fd810100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd810100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101120a0 con 0x7fd810101410 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd810111f20 con 0x7fd810102d30 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd818190640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd810112220 con 0x7fd8101082a0 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd81672d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd81672d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47442/0 (socket says 172.21.15.66:47442) 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd81672d640 1 -- 172.21.15.66:0/4273093587 learned_addr learned my addr 172.21.15.66:0/4273093587 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.938+0000 7fd815f2c640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 0x7fd810100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 -- 172.21.15.66:0/4273093587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 msgr2=0x7fd810100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81572b640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd810100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd810100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 -- 172.21.15.66:0/4273093587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 msgr2=0x7fd810100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 0x7fd810100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 -- 172.21.15.66:0/4273093587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101a7100 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81572b640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd810100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd81672d640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd80800eaa0 tx=0x7fd80800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd806ffd640 1 -- 172.21.15.66:0/4273093587 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80800cdb0 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8101a73f0 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd806ffd640 1 -- 172.21.15.66:0/4273093587 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd808005020 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd806ffd640 1 -- 172.21.15.66:0/4273093587 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8080116d0 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.939+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101a7900 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.942+0000 7fd81a569740 1 Processor -- start 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.942+0000 7fd806ffd640 1 -- 172.21.15.66:0/4273093587 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fd8080051d0 con 0x7fd810101410 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 -- start start 2024-09-15T22:46:06.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95ce4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ce4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95cf1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b95c4a2f0 con 0x564b95ce45d0 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564b95bf1cf0 con 0x564b95ce5b40 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564b95c462b0 con 0x564b95cef370 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81572b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95ce4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd815f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ce4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81572b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95ce4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39894/0 (socket says 172.21.15.66:39894) 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81572b640 1 -- 172.21.15.66:0/1448696361 learned_addr learned my addr 172.21.15.66:0/1448696361 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.943+0000 7fd81572b640 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95cf1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd806ffd640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 0x7fd7fc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 -- 172.21.15.66:0/1448696361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 msgr2=0x564b95cf1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95cf1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 -- 172.21.15.66:0/1448696361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 msgr2=0x564b95ce4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95ce4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 -- 172.21.15.66:0/1448696361 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95bd63a0 con 0x564b95ce45d0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd81672d640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 0x7fd7fc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd806ffd640 1 -- 172.21.15.66:0/4273093587 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd8080d04c0 con 0x7fd810101410 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd815f2c640 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ce4a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ab40 tx=0x7fd80c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2e2e3e4706cbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd7fbfff640 1 -- 172.21.15.66:0/1448696361 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c004020 con 0x564b95ce45d0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd7fbfff640 1 -- 172.21.15.66:0/1448696361 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c0041c0 con 0x564b95ce45d0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.944+0000 7fd7fbfff640 1 -- 172.21.15.66:0/1448696361 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c018810 con 0x564b95ce45d0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 -- 172.21.15.66:0/1448696361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 msgr2=0x564b95ce4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81672d640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 0x7fd7fc0a5990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cd7c0 tx=0x7fd808051510 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ce4a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ab40 tx=0x7fd80c00f3c0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 -- 172.21.15.66:0/1448696361 shutdown_connections 2024-09-15T22:46:06.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95cf1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ce4a10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 --2- 172.21.15.66:0/1448696361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95ce4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 -- 172.21.15.66:0/1448696361 >> 172.21.15.66:0/1448696361 conn(0x564b95cad310 msgr2=0x564b95ce0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 -- 172.21.15.66:0/1448696361 shutdown_connections 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.945+0000 7fd81a569740 1 -- 172.21.15.66:0/1448696361 wait complete. 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 -- start start 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 Processor -- start 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce5b40 0x564b95cebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564b95cf2070 con 0x564b95ce45d0 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564b95c05060 con 0x564b95cef370 2024-09-15T22:46:06.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.946+0000 7fd81a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564b95cf21f0 con 0x564b95ce5b40 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81a569740 10 client.0 _ll_register_callbacks cb 0x564b959588c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47464/0 (socket says 172.21.15.66:47464) 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 -- 172.21.15.66:0/2620957450 learned_addr learned my addr 172.21.15.66:0/2620957450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd815f2c640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce5b40 0x564b95cebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 -- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce5b40 msgr2=0x564b95cebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce5b40 0x564b95cebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 -- 172.21.15.66:0/2620957450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 msgr2=0x564b95cec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 -- 172.21.15.66:0/2620957450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b959bb3c0 con 0x564b95ce45d0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd81572b640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd800009930 tx=0x7fd80002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7feda11f97c5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd7f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.947+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800035040 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd8000035f0 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c0041c0 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd800051050 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b95cfda80 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c0041c0 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd80003a040 con 0x564b95ce45d0 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 10 client.15702 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 20 client.15702 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95cfee90 0x564b95d01310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 4 client.15702 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.948+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b95c57860 con 0x564b95cfee90 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.949+0000 7fd815f2c640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95cfee90 0x564b95d01310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.949+0000 7fd7f97fa640 10 client.15702 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.949+0000 7fd815f2c640 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95cfee90 0x564b95d01310 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0bf4cacbb8bd5f9 server_cookie=6cb1f91ffdef1afd in_seq=0 out_seq=0 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd7f97fa640 1 -- 172.21.15.66:0/2620957450 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b95c57860 con 0x564b95cfee90 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd7f97fa640 10 client.15702 handle_command_reply: tid=0 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 client.15702 shutdown 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 msgr2=0x564b95ceece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd800009930 tx=0x7fd80002a420 comp rx=0 tx=0).stop 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 shutdown_connections 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95cfee90 0x564b95d01310 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce5b40 0x564b95cebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 --2- 172.21.15.66:0/2620957450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95ceece0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 >> 172.21.15.66:0/2620957450 conn(0x564b95cad310 msgr2=0x564b95ce6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd7f97fa640 0 client.15702 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 shutdown_connections 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 1 -- 172.21.15.66:0/2620957450 wait complete. 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.950+0000 7fd81a569740 20 client.15702 trim_cache size 0 max 16384 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 Processor -- start 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 -- start start 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce45d0 0x564b95cfb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cf0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101b1a50 con 0x564b95ce5b40 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101b3590 con 0x564b95cef370 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101b2120 con 0x564b95ce45d0 2024-09-15T22:46:06.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47470/0 (socket says 172.21.15.66:47470) 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 -- 172.21.15.66:0/42595507 learned_addr learned my addr 172.21.15.66:0/42595507 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81572b640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cf0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd81572b640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce45d0 0x564b95cfb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 -- 172.21.15.66:0/42595507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce45d0 msgr2=0x564b95cfb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce45d0 0x564b95cfb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 -- 172.21.15.66:0/42595507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 msgr2=0x564b95cf0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.964+0000 7fd815f2c640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cf0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd815f2c640 1 -- 172.21.15.66:0/42595507 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95ce0510 con 0x564b95ce5b40 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd81572b640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cf0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd815f2c640 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ff60 tx=0x7fd80c018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a11835ddf504bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd7fb7fe640 1 -- 172.21.15.66:0/42595507 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00a2d0 con 0x564b95ce5b40 2024-09-15T22:46:06.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd7fb7fe640 1 -- 172.21.15.66:0/42595507 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c02f020 con 0x564b95ce5b40 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.965+0000 7fd7fb7fe640 1 -- 172.21.15.66:0/42595507 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c005660 con 0x564b95ce5b40 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- 172.21.15.66:0/42595507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 msgr2=0x564b95d00ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ff60 tx=0x7fd80c018440 comp rx=0 tx=0).stop 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- 172.21.15.66:0/42595507 shutdown_connections 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95cef370 0x564b95cf0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce5b40 0x564b95d00ea0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 --2- 172.21.15.66:0/42595507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95ce45d0 0x564b95cfb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- 172.21.15.66:0/42595507 >> 172.21.15.66:0/42595507 conn(0x564b95cad310 msgr2=0x564b95ce72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- 172.21.15.66:0/42595507 shutdown_connections 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- 172.21.15.66:0/42595507 wait complete. 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 -- start start 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.966+0000 7fd81a569740 1 Processor -- start 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95cf7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95ce9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101b2ec0 con 0x564b95ce45d0 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101b27f0 con 0x564b95ce5b40 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101afa30 con 0x564b95cef370 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47480/0 (socket says 172.21.15.66:47480) 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81572b640 1 -- 172.21.15.66:0/280443869 learned_addr learned my addr 172.21.15.66:0/280443869 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81a569740 10 client.0 _ll_register_callbacks cb 0x7fd800031a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd815f2c640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95cf7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.967+0000 7fd81572b640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95ce9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 -- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 msgr2=0x564b95ce9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95ce9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 -- 172.21.15.66:0/280443869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 msgr2=0x564b95cf7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95cf7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 -- 172.21.15.66:0/280443869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b95ce9aa0 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c02f020 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81572b640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd800005ec0 tx=0x7fd80002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1022845e552cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd7f97fa640 10 client.15708 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd7f97fa640 1 -- 172.21.15.66:0/280443869 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80005a060 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd7f97fa640 1 -- 172.21.15.66:0/280443869 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd80003cb20 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd7f97fa640 1 -- 172.21.15.66:0/280443869 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd800035040 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81a569740 10 client.15708 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.968+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564b95d06c80 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd7f97fa640 1 -- 172.21.15.66:0/280443869 <== mon.0 v2:172.21.15.66:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd80003a040 con 0x564b95ce45d0 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 10 client.15708 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 10 client.15708 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:46:06.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 20 client.15708 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95d69d60 0x564b95d6c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 4 client.15708 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b95c51d70 con 0x564b95d69d60 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.969+0000 7fd815f2c640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95d69d60 0x564b95d6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd815f2c640 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95d69d60 0x564b95d6c150 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fae5502ade5300ec server_cookie=900a504dea157fd7 in_seq=0 out_seq=0 2024-09-15T22:46:06.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd7f97fa640 10 client.15708 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd7f97fa640 1 -- 172.21.15.66:0/280443869 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b95c51d70 con 0x564b95d69d60 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd7f97fa640 10 client.15708 handle_command_reply: tid=0 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 client.15708 shutdown 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 msgr2=0x564b95cf7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd800005ec0 tx=0x7fd80002a420 comp rx=0 tx=0).stop 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 shutdown_connections 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x564b95d69d60 0x564b95d6c150 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564b95cef370 0x564b95ce9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b95ce5b40 0x564b95cf7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 --2- 172.21.15.66:0/280443869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564b95ce45d0 0x564b95cf7780 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 >> 172.21.15.66:0/280443869 conn(0x564b95cad310 msgr2=0x564b95cea7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd7f97fa640 0 client.15708 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 shutdown_connections 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.970+0000 7fd81a569740 1 -- 172.21.15.66:0/280443869 wait complete. 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd81a569740 20 client.15708 trim_cache size 0 max 16384 2024-09-15T22:46:06.987 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 msgr2=0x7fd7fc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 0x7fd7fc0a5990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cd7c0 tx=0x7fd808051510 comp rx=0 tx=0).stop 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 msgr2=0x7fd8101a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd80800eaa0 tx=0x7fd80800ef60 comp rx=0 tx=0).stop 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 shutdown_connections 2024-09-15T22:46:06.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd7fc0a34d0 0x7fd7fc0a5990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd810101410 0x7fd8101a6a30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8101082a0 0x7fd810100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 --2- 172.21.15.66:0/4273093587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810102d30 0x7fd810100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 >> 172.21.15.66:0/4273093587 conn(0x7fd8100fc7d0 msgr2=0x7fd8100fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 shutdown_connections 2024-09-15T22:46:06.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:06.971+0000 7fd818190640 1 -- 172.21.15.66:0/4273093587 wait complete. 2024-09-15T22:46:07.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:06 smithi066 ceph-mon[31185]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-15T22:46:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:06 smithi087 ceph-mon[35290]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-15T22:46:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:06 smithi184 ceph-mon[35203]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-15T22:46:07.807 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:46:07.814 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.286+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/330017428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8102ef0 msgr2=0x7fd0d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.286+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/330017428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8102ef0 0x7fd0d810da40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009ca0 tx=0x7fd0d002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/330017428 shutdown_connections 2024-09-15T22:46:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/330017428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8102ef0 0x7fd0d810da40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/330017428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102570 0x7fd0d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/330017428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8100e20 0x7fd0d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/330017428 >> 172.21.15.66:0/330017428 conn(0x7fd0d80fc7d0 msgr2=0x7fd0d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/330017428 shutdown_connections 2024-09-15T22:46:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/330017428 wait complete. 2024-09-15T22:46:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.287+0000 7fd0dfa6f640 1 Processor -- start 2024-09-15T22:46:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 -- start start 2024-09-15T22:46:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 0x7fd0d8197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102ef0 0x7fd0d819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d8110f80 con 0x7fd0d8100e20 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d8110e00 con 0x7fd0d8102ef0 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dfa6f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d8111100 con 0x7fd0d8102570 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dd80b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dd80b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47500/0 (socket says 172.21.15.66:47500) 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dd80b640 1 -- 172.21.15.66:0/3130736865 learned_addr learned my addr 172.21.15.66:0/3130736865 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0dd00a640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 0x7fd0d8197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.288+0000 7fd0de00c640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102ef0 0x7fd0d819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 -- 172.21.15.66:0/3130736865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102ef0 msgr2=0x7fd0d819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102ef0 0x7fd0d819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 -- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 msgr2=0x7fd0d8197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 -- 172.21.15.66:0/3130736865 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d819c2f0 con 0x7fd0d8102570 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd80b640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dd00a640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 0x7fd0d8197880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009e60 tx=0x7fd0c800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c801e070 con 0x7fd0d8102570 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d819c5e0 con 0x7fd0d8102570 2024-09-15T22:46:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.289+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d8069f70 con 0x7fd0d8102570 2024-09-15T22:46:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.290+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0c800ccc0 con 0x7fd0d8102570 2024-09-15T22:46:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.290+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8028060 con 0x7fd0d8102570 2024-09-15T22:46:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.291+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0bc005290 con 0x7fd0d8102570 2024-09-15T22:46:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.293+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fd0c8021070 con 0x7fd0d8102570 2024-09-15T22:46:08.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.294+0000 7fd0ceffd640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 0x7fd0c40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:08.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.294+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd0c80d2060 con 0x7fd0d8102570 2024-09-15T22:46:08.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.294+0000 7fd0dd80b640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 0x7fd0c40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.295+0000 7fd0dd80b640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 0x7fd0c40a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4005fd0 tx=0x7fd0d400b480 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:08.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.299+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0c809dee0 con 0x7fd0d8102570 2024-09-15T22:46:08.331 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:08.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.542+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0bc005850 con 0x7fd0d8102570 2024-09-15T22:46:08.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.543+0000 7fd0ceffd640 1 -- 172.21.15.66:0/3130736865 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fd0c80a21e0 con 0x7fd0d8102570 2024-09-15T22:46:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:46:08.545 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:46:08.545 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 msgr2=0x7fd0c40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 0x7fd0c40a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4005fd0 tx=0x7fd0d400b480 comp rx=0 tx=0).stop 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 msgr2=0x7fd0d8197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 0x7fd0d8197880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009e60 tx=0x7fd0c800edc0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 shutdown_connections 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0c40a34d0 0x7fd0c40a5990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d8102ef0 0x7fd0d819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d8102570 0x7fd0d8197880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 --2- 172.21.15.66:0/3130736865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0d8100e20 0x7fd0d8197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:08.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 >> 172.21.15.66:0/3130736865 conn(0x7fd0d80fc7d0 msgr2=0x7fd0d8106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:08.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 shutdown_connections 2024-09-15T22:46:08.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:08.546+0000 7fd0dfa6f640 1 -- 172.21.15.66:0/3130736865 wait complete. 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/73191121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9810c150 msgr2=0x7f2e9810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/73191121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9810c150 0x7f2e9810e5f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009ca0 tx=0x7f2e9002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/73191121 shutdown_connections 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/73191121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9810c150 0x7f2e9810e5f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/73191121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 0x7f2e9810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/73191121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e98102d20 0x7f2e98103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/73191121 >> 172.21.15.66:0/73191121 conn(0x7f2e980fc780 msgr2=0x7f2e980feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/73191121 shutdown_connections 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.072+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/73191121 wait complete. 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.073+0000 7f2e9cc9b640 1 Processor -- start 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.073+0000 7f2e9cc9b640 1 -- start start 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 0x7f2e981989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 0x7f2e9819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111fa0 con 0x7f2e98102d20 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98111e20 con 0x7f2e98103640 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98112120 con 0x7f2e9810c150 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47518/0 (socket says 172.21.15.66:47518) 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 -- 172.21.15.66:0/1307600953 learned_addr learned my addr 172.21.15.66:0/1307600953 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:09.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 0x7f2e981989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 0x7f2e9819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 -- 172.21.15.66:0/1307600953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 msgr2=0x7f2e9819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 0x7f2e9819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 -- 172.21.15.66:0/1307600953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 msgr2=0x7f2e981989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 0x7f2e981989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 -- 172.21.15.66:0/1307600953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9819d460 con 0x7f2e98102d20 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 0x7f2e9819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:09.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9659c640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800d770 tx=0x7f2e8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e877fe640 1 -- 172.21.15.66:0/1307600953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88017070 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e877fe640 1 -- 172.21.15.66:0/1307600953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e88005500 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.074+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9819d750 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.075+0000 7f2e877fe640 1 -- 172.21.15.66:0/1307600953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88004e00 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.075+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e981a5030 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.077+0000 7f2e9f074740 1 Processor -- start 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.077+0000 7f2e877fe640 1 -- 172.21.15.66:0/1307600953 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f2e88004fa0 con 0x7f2e98102d20 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.078+0000 7f2e9f074740 1 -- start start 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 0x556489542090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x556489542a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x556489560770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5564894a82f0 con 0x5564895425d0 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55648944fcf0 con 0x556489543b40 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9f074740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5564894a42b0 con 0x55648955e380 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x556489542a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 0x556489542090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x556489542a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47534/0 (socket says 172.21.15.66:47534) 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e9659c640 1 -- 172.21.15.66:0/218245478 learned_addr learned my addr 172.21.15.66:0/218245478 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x556489560770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e877fe640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 0x7f2e800a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 -- 172.21.15.66:0/218245478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 msgr2=0x556489560770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x556489560770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 -- 172.21.15.66:0/218245478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 msgr2=0x556489542a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x556489542a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.079+0000 7f2e96d9d640 1 -- 172.21.15.66:0/218245478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564894343a0 con 0x556489543b40 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e877fe640 1 -- 172.21.15.66:0/1307600953 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2e880cfdd0 con 0x7f2e98102d20 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 0x7f2e800a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 0x556489542090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e9002af40 tx=0x7f2e9002f6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c3526349a02831 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e84ff9640 1 -- 172.21.15.66:0/218245478 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90034040 con 0x556489543b40 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e84ff9640 1 -- 172.21.15.66:0/218245478 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e9002fe10 con 0x556489543b40 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.080+0000 7f2e84ff9640 1 -- 172.21.15.66:0/218245478 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90030800 con 0x556489543b40 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- 172.21.15.66:0/218245478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 msgr2=0x556489542090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 0x7f2e800a5a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e90049000 tx=0x7f2e9004a000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 0x556489542090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e9002af40 tx=0x7f2e9002f6f0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- 172.21.15.66:0/218245478 shutdown_connections 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x556489560770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x556489542a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 --2- 172.21.15.66:0/218245478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556489543b40 0x556489542090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- 172.21.15.66:0/218245478 >> 172.21.15.66:0/218245478 conn(0x55648950b310 msgr2=0x55648953ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- 172.21.15.66:0/218245478 shutdown_connections 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- 172.21.15.66:0/218245478 wait complete. 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 -- start start 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.081+0000 7f2e9f074740 1 Processor -- start 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 0x55648955dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x55648955b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556489565490 con 0x556489543b40 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556489463060 con 0x5564895425d0 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556489565610 con 0x55648955e380 2024-09-15T22:46:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9f074740 10 client.0 _ll_register_callbacks cb 0x5564891b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47538/0 (socket says 172.21.15.66:47538) 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 0x55648955dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 -- 172.21.15.66:0/404085778 learned_addr learned my addr 172.21.15.66:0/404085778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x55648955b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 -- 172.21.15.66:0/404085778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 msgr2=0x55648955b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x55648955b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 -- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 msgr2=0x55648955dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 0x55648955dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 -- 172.21.15.66:0/404085778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564892193c0 con 0x556489543b40 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e9659c640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 0x55648955dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f7f0 tx=0x7f2e8c00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1865dff9307ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.082+0000 7f2e7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:09.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c026060 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2e8c00eb20 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e9002fe10 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c00ed20 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e9f074740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556489560d60 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e9002fe10 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.083+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e8c020370 con 0x556489543b40 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 10 client.15726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 20 client.15726 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895625e0 0x556489564a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 4 client.15726 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564894b5860 con 0x5564895625e0 2024-09-15T22:46:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9659c640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895625e0 0x556489564a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e9659c640 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895625e0 0x556489564a60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23fe816ba3cc13cb server_cookie=8697384ac986baa2 in_seq=0 out_seq=0 2024-09-15T22:46:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.084+0000 7f2e7dffb640 10 client.15726 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e7dffb640 1 -- 172.21.15.66:0/404085778 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564894b5860 con 0x5564895625e0 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e7dffb640 10 client.15726 handle_command_reply: tid=0 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 client.15726 shutdown 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 msgr2=0x55648955aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f7f0 tx=0x7f2e8c00fbf0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 shutdown_connections 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895625e0 0x556489564a60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55648955e380 0x55648955b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x55648955aff0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 --2- 172.21.15.66:0/404085778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564895425d0 0x55648955dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 >> 172.21.15.66:0/404085778 conn(0x55648950b310 msgr2=0x556489544930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e7dffb640 0 client.15726 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:46:09.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 shutdown_connections 2024-09-15T22:46:09.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.085+0000 7f2e9f074740 1 -- 172.21.15.66:0/404085778 wait complete. 2024-09-15T22:46:09.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.086+0000 7f2e9f074740 20 client.15726 trim_cache size 0 max 16384 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.098+0000 7f2e9f074740 1 Processor -- start 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.098+0000 7f2e9f074740 1 -- start start 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 0x55648956e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x55648955a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e980738d0 con 0x5564895425d0 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981a6200 con 0x55648955e380 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9f074740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98073fa0 con 0x556489543b40 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47544/0 (socket says 172.21.15.66:47544) 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 -- 172.21.15.66:0/3343788021 learned_addr learned my addr 172.21.15.66:0/3343788021 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:09.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 0x55648956e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 -- 172.21.15.66:0/3343788021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 msgr2=0x55648956e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x55648955a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 0x55648956e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 -- 172.21.15.66:0/3343788021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 msgr2=0x55648955a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x55648955a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 -- 172.21.15.66:0/3343788021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556489559fa0 con 0x5564895425d0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 0x55648956e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x55648955a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.099+0000 7f2e9659c640 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e88098400 tx=0x7f2e880d8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87781b831ece535e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e7ffff640 1 -- 172.21.15.66:0/3343788021 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88020040 con 0x5564895425d0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e7ffff640 1 -- 172.21.15.66:0/3343788021 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e880046c0 con 0x5564895425d0 2024-09-15T22:46:09.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e7ffff640 1 -- 172.21.15.66:0/3343788021 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880a46a0 con 0x5564895425d0 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 -- 172.21.15.66:0/3343788021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 msgr2=0x55648953ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e88098400 tx=0x7f2e880d8040 comp rx=0 tx=0).stop 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 -- 172.21.15.66:0/3343788021 shutdown_connections 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x55648955a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556489543b40 0x55648956e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 --2- 172.21.15.66:0/3343788021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5564895425d0 0x55648953ee10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.100+0000 7f2e9f074740 1 -- 172.21.15.66:0/3343788021 >> 172.21.15.66:0/3343788021 conn(0x55648950b310 msgr2=0x55648953e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- 172.21.15.66:0/3343788021 shutdown_connections 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- 172.21.15.66:0/3343788021 wait complete. 2024-09-15T22:46:09.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- start start 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 Processor -- start 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 0x556489565fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x5564895d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981a5b30 con 0x556489543b40 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981a5460 con 0x55648955e380 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.101+0000 7f2e9f074740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e980718b0 con 0x5564895425d0 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e9f074740 10 client.0 _ll_register_callbacks cb 0x7f2e8c00a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47558/0 (socket says 172.21.15.66:47558) 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 -- 172.21.15.66:0/4111904965 learned_addr learned my addr 172.21.15.66:0/4111904965 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e9659c640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 0x556489565fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e96d9d640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x5564895d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 -- 172.21.15.66:0/4111904965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 msgr2=0x556489565fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 0x556489565fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 -- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 msgr2=0x5564895d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x5564895d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 -- 172.21.15.66:0/4111904965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564895d1780 con 0x556489543b40 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e9659c640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 0x556489565fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e95d9b640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55648955a880 tx=0x7f2e8c00ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458295c06a62190b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c030080 con 0x556489543b40 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2e8c00eb20 con 0x556489543b40 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.102+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564894afd70 con 0x556489543b40 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c026030 con 0x556489543b40 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:09.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5564895d8ad0 con 0x556489543b40 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5564894afd70 con 0x556489543b40 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e8c004780 con 0x556489543b40 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 10 client.15732 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 20 client.15732 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895d92b0 0x5564895db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 4 client.15732 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.103+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55648942c170 con 0x5564895d92b0 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9659c640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895d92b0 0x5564895db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9659c640 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895d92b0 0x5564895db6d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d960c9d75d4f016 server_cookie=b8acf658e4118b59 in_seq=0 out_seq=0 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e7dffb640 10 client.15732 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e7dffb640 1 -- 172.21.15.66:0/4111904965 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55648942c170 con 0x5564895d92b0 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e7dffb640 10 client.15732 handle_command_reply: tid=0 2024-09-15T22:46:09.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 client.15732 shutdown 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 msgr2=0x556489566520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55648955a880 tx=0x7f2e8c00ac90 comp rx=0 tx=0).stop 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 shutdown_connections 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5564895d92b0 0x5564895db6d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e7dffb640 0 client.15732 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55648955e380 0x5564895d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556489543b40 0x556489566520 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 --2- 172.21.15.66:0/4111904965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564895425d0 0x556489565fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.104+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 >> 172.21.15.66:0/4111904965 conn(0x55648950b310 msgr2=0x556489544110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 shutdown_connections 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9f074740 1 -- 172.21.15.66:0/4111904965 wait complete. 2024-09-15T22:46:09.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9f074740 20 client.15732 trim_cache size 0 max 16384 2024-09-15T22:46:09.111 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:09.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 msgr2=0x7f2e800a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 0x7f2e800a5a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e90049000 tx=0x7f2e9004a000 comp rx=0 tx=0).stop 2024-09-15T22:46:09.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 msgr2=0x7f2e981984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:09.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.105+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800d770 tx=0x7f2e8800dc30 comp rx=0 tx=0).stop 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 shutdown_connections 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e800a3550 0x7f2e800a5a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9810c150 0x7f2e9819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e98103640 0x7f2e981989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 --2- 172.21.15.66:0/1307600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e98102d20 0x7f2e981984b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 >> 172.21.15.66:0/1307600953 conn(0x7f2e980fc780 msgr2=0x7f2e980fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 shutdown_connections 2024-09-15T22:46:09.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:09.106+0000 7f2e9cc9b640 1 -- 172.21.15.66:0/1307600953 wait complete. 2024-09-15T22:46:09.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:08 smithi066 ceph-mon[31185]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-15T22:46:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:08 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3130736865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:08 smithi087 ceph-mon[35290]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-15T22:46:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:08 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3130736865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:08 smithi184 ceph-mon[35203]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-15T22:46:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:08 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3130736865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:09.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:46:10.444 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0' 2024-09-15T22:46:10.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0 2024-09-15T22:46:10.553 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:11.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:10 smithi066 ceph-mon[31185]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:11.224 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:10 smithi184 ceph-mon[35203]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:11.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 -- 172.21.15.66:0/3137597649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 msgr2=0x7f96c4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 --2- 172.21.15.66:0/3137597649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4107b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009930 tx=0x7f96b402a420 comp rx=0 tx=0).stop 2024-09-15T22:46:11.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 -- 172.21.15.66:0/3137597649 shutdown_connections 2024-09-15T22:46:11.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 --2- 172.21.15.66:0/3137597649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 0x7f96c410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 --2- 172.21.15.66:0/3137597649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4107b80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 --2- 172.21.15.66:0/3137597649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 -- 172.21.15.66:0/3137597649 >> 172.21.15.66:0/3137597649 conn(0x7f96c40fc7d0 msgr2=0x7f96c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 -- 172.21.15.66:0/3137597649 shutdown_connections 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.301+0000 7f96cbb72640 1 -- 172.21.15.66:0/3137597649 wait complete. 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 Processor -- start 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 -- start start 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 0x7f96c419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4112090 con 0x7f96c4103740 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4111f10 con 0x7f96c4102d90 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96cbb72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4112210 con 0x7f96c4108290 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47576/0 (socket says 172.21.15.66:47576) 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96c990e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96c910d640 1 -- 172.21.15.66:0/385183906 learned_addr learned my addr 172.21.15.66:0/385183906 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.302+0000 7f96ca10f640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 0x7f96c419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 -- 172.21.15.66:0/385183906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 msgr2=0x7f96c419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 0x7f96c419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 -- 172.21.15.66:0/385183906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 msgr2=0x7f96c4198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 -- 172.21.15.66:0/385183906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c419d5c0 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c990e640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96c910d640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96b4005940 tx=0x7f96b40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96baffd640 1 -- 172.21.15.66:0/385183906 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b403f030 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c419d850 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96baffd640 1 -- 172.21.15.66:0/385183906 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b40044c0 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96baffd640 1 -- 172.21.15.66:0/385183906 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4035070 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.303+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c41a5190 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96baffd640 1 -- 172.21.15.66:0/385183906 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f96b4042030 con 0x7f96c4103740 2024-09-15T22:46:11.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 Processor -- start 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 -- start start 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 0x55dd57536a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57543760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd5749c2f0 con 0x55dd575365d0 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd57443cf0 con 0x55dd57541370 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd574982b0 con 0x55dd57537b40 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.306+0000 7f96c990e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 0x55dd57536a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96c990e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 0x55dd57536a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47590/0 (socket says 172.21.15.66:47590) 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35414/0 (socket says 172.21.15.66:35414) 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96c990e640 1 -- 172.21.15.66:0/2573158040 learned_addr learned my addr 172.21.15.66:0/2573158040 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96c910d640 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57543760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96baffd640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 0x7f96b00a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 -- 172.21.15.66:0/2573158040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 msgr2=0x55dd57543760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57543760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 -- 172.21.15.66:0/2573158040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 msgr2=0x55dd57536a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 0x55dd57536a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 -- 172.21.15.66:0/2573158040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd574283a0 con 0x55dd57537b40 2024-09-15T22:46:11.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 0x7f96b00a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96baffd640 1 -- 172.21.15.66:0/385183906 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f96b40f0630 con 0x7f96c4103740 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.307+0000 7f96ca10f640 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009fa0 tx=0x7f96bc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf545e441aa370d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96affff640 1 -- 172.21.15.66:0/2573158040 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc017050 con 0x55dd57537b40 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96ca10f640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 0x7f96b00a9da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96bc022000 tx=0x7f96bc023000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96affff640 1 -- 172.21.15.66:0/2573158040 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96bc00fc80 con 0x55dd57537b40 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96affff640 1 -- 172.21.15.66:0/2573158040 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc01ba50 con 0x55dd57537b40 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2573158040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 msgr2=0x55dd57536090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009fa0 tx=0x7f96bc0118d0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2573158040 shutdown_connections 2024-09-15T22:46:11.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57543760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd575365d0 0x55dd57536a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2573158040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd57537b40 0x55dd57536090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.308+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2573158040 >> 172.21.15.66:0/2573158040 conn(0x55dd574ff310 msgr2=0x55dd57532c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.309+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2573158040 shutdown_connections 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.309+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2573158040 wait complete. 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.309+0000 7f96cdf4b740 1 -- start start 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.309+0000 7f96cdf4b740 1 Processor -- start 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57540da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57541370 0x55dd5753e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd57544070 con 0x55dd57541370 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dd57457060 con 0x55dd57537b40 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dd575441f0 con 0x55dd575365d0 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96cdf4b740 10 client.0 _ll_register_callbacks cb 0x55dd571aa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96ca10f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57541370 0x55dd5753e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40036/0 (socket says 172.21.15.66:40036) 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 -- 172.21.15.66:0/3578440841 learned_addr learned my addr 172.21.15.66:0/3578440841 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c990e640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57540da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 -- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 msgr2=0x55dd57540da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57540da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.310+0000 7f96c910d640 1 -- 172.21.15.66:0/3578440841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57541370 msgr2=0x55dd5753e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96c910d640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57541370 0x55dd5753e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96c910d640 1 -- 172.21.15.66:0/3578440841 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5720d3c0 con 0x55dd57537b40 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96c910d640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bc400 tx=0x7f96b4005b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11ee1c74079c12a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4049050 con 0x55dd57537b40 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f96b40f0240 con 0x55dd57537b40 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96bc00fc80 con 0x55dd57537b40 2024-09-15T22:46:11.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f96b40d5050 con 0x55dd57537b40 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96cdf4b740 10 client.25346 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd5754fb50 con 0x55dd57537b40 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.311+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96bc00fc80 con 0x55dd57537b40 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96b40d51f0 con 0x55dd57537b40 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 10 client.25346 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 10 client.25346 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 20 client.25346 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 4 client.25346 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd574a9860 con 0x55dd57550fb0 2024-09-15T22:46:11.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.312+0000 7f96c990e640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96c990e640 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575533f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19a97211205d5d6 server_cookie=49d467a1886eeb83 in_seq=0 out_seq=0 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96ad7fa640 10 client.25346 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96ad7fa640 1 -- 172.21.15.66:0/3578440841 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd574a9860 con 0x55dd57550fb0 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96ad7fa640 10 client.25346 handle_command_reply: tid=0 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96cdf4b740 1 client.25346 shutdown 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 msgr2=0x55dd5753e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.313+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bc400 tx=0x7f96b4005b70 comp rx=0 tx=0).stop 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 shutdown_connections 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575533f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57541370 0x55dd5753e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96ad7fa640 0 client.25346 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57537b40 0x55dd5753e050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3578440841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57540da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 >> 172.21.15.66:0/3578440841 conn(0x55dd574ff310 msgr2=0x55dd57538960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 shutdown_connections 2024-09-15T22:46:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3578440841 wait complete. 2024-09-15T22:46:11.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.314+0000 7f96cdf4b740 20 client.25346 trim_cache size 0 max 16384 2024-09-15T22:46:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 Processor -- start 2024-09-15T22:46:11.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 -- start start 2024-09-15T22:46:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57539120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57558cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41acf90 con 0x55dd57537b40 2024-09-15T22:46:11.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41aead0 con 0x55dd57541370 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41ad660 con 0x55dd575365d0 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47612/0 (socket says 172.21.15.66:47612) 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96c910d640 1 -- 172.21.15.66:0/3285618876 learned_addr learned my addr 172.21.15.66:0/3285618876 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96c990e640 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57539120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.327+0000 7f96ca10f640 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57558cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 -- 172.21.15.66:0/3285618876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 msgr2=0x55dd57539120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57539120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 -- 172.21.15.66:0/3285618876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 msgr2=0x55dd57558cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57558cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 -- 172.21.15.66:0/3285618876 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd57532510 con 0x55dd57537b40 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96c910d640 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f96b40ba720 tx=0x7f96b40ba980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f79aaae3b83b86a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96af7fe640 1 -- 172.21.15.66:0/3285618876 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4049070 con 0x55dd57537b40 2024-09-15T22:46:11.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96af7fe640 1 -- 172.21.15.66:0/3285618876 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b40bc470 con 0x55dd57537b40 2024-09-15T22:46:11.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.328+0000 7f96af7fe640 1 -- 172.21.15.66:0/3285618876 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b40b8ae0 con 0x55dd57537b40 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3285618876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 msgr2=0x55dd57539660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f96b40ba720 tx=0x7f96b40ba980 comp rx=0 tx=0).stop 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3285618876 shutdown_connections 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57558cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd57539660 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/3285618876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57539120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3285618876 >> 172.21.15.66:0/3285618876 conn(0x55dd574ff310 msgr2=0x55dd575400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3285618876 shutdown_connections 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- 172.21.15.66:0/3285618876 wait complete. 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.329+0000 7f96cdf4b740 1 -- start start 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 Processor -- start 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57549480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57546450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41ae400 con 0x55dd57537b40 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41add30 con 0x55dd57541370 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96c41aaf70 con 0x55dd575365d0 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96cdf4b740 10 client.0 _ll_register_callbacks cb 0x7f96b4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47626/0 (socket says 172.21.15.66:47626) 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 -- 172.21.15.66:0/2931788381 learned_addr learned my addr 172.21.15.66:0/2931788381 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96ca10f640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57546450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c990e640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57549480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 -- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 msgr2=0x55dd57549480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57549480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 -- 172.21.15.66:0/2931788381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 msgr2=0x55dd57546450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57546450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.330+0000 7f96c910d640 1 -- 172.21.15.66:0/2931788381 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd57546ac0 con 0x55dd57537b40 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ca10f640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57546450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96c910d640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bc400 tx=0x7f96b40d5400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ee185b794d366a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4049070 con 0x55dd57537b40 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f96b40c4db0 con 0x55dd57537b40 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b40bc470 con 0x55dd57537b40 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f96b40f0470 con 0x55dd57537b40 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96cdf4b740 10 client.15750 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:11.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd57546ac0 con 0x55dd57537b40 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.331+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b40bc470 con 0x55dd57537b40 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96b403bba0 con 0x55dd57537b40 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 10 client.15750 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 10 client.15750 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 20 client.15750 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 4 client.15750 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd574a3d70 con 0x55dd57550fb0 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96c990e640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96c990e640 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575be870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96feea2917851147 server_cookie=285772afe8f7e38e in_seq=0 out_seq=0 2024-09-15T22:46:11.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96ad7fa640 10 client.15750 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96ad7fa640 1 -- 172.21.15.66:0/2931788381 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd574a3d70 con 0x55dd57550fb0 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.332+0000 7f96ad7fa640 10 client.15750 handle_command_reply: tid=0 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 client.15750 shutdown 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 msgr2=0x55dd575499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bc400 tx=0x7f96b40d5400 comp rx=0 tx=0).stop 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 shutdown_connections 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55dd57550fb0 0x55dd575be870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dd57541370 0x55dd57546450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96ad7fa640 0 client.15750 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd57537b40 0x55dd575499c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 --2- 172.21.15.66:0/2931788381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dd575365d0 0x55dd57549480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 >> 172.21.15.66:0/2931788381 conn(0x55dd574ff310 msgr2=0x55dd575400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 shutdown_connections 2024-09-15T22:46:11.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 1 -- 172.21.15.66:0/2931788381 wait complete. 2024-09-15T22:46:11.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.333+0000 7f96cdf4b740 20 client.15750 trim_cache size 0 max 16384 2024-09-15T22:46:11.340 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 msgr2=0x7f96b00a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 0x7f96b00a9da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f96bc022000 tx=0x7f96bc023000 comp rx=0 tx=0).stop 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 msgr2=0x7f96c4198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f96b4005940 tx=0x7f96b40040c0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 shutdown_connections 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f96b00a78e0 0x7f96b00a9da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96c4108290 0x7f96c419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c4103740 0x7f96c4198b50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 --2- 172.21.15.66:0/385183906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c4102d90 0x7f96c4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:11.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 >> 172.21.15.66:0/385183906 conn(0x7f96c40fc7d0 msgr2=0x7f96c4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:11.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 shutdown_connections 2024-09-15T22:46:11.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:11.334+0000 7f96cbb72640 1 -- 172.21.15.66:0/385183906 wait complete. 2024-09-15T22:46:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:10 smithi087 ceph-mon[35290]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:12.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:46:12.137 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 -- 172.21.15.66:0/2002831423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 msgr2=0x7f742c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2002831423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c1031b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7428009930 tx=0x7f742802a420 comp rx=0 tx=0).stop 2024-09-15T22:46:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 -- 172.21.15.66:0/2002831423 shutdown_connections 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2002831423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c108300 0x7f742c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2002831423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c103780 0x7f742c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2002831423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c1031b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 -- 172.21.15.66:0/2002831423 >> 172.21.15.66:0/2002831423 conn(0x7f742c0fc7d0 msgr2=0x7f742c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 -- 172.21.15.66:0/2002831423 shutdown_connections 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.649+0000 7f7433e0b640 1 -- 172.21.15.66:0/2002831423 wait complete. 2024-09-15T22:46:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 Processor -- start 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 -- start start 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c103780 0x7f742c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 0x7f742c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112090 con 0x7f742c102dd0 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f742c111f10 con 0x7f742c103780 2024-09-15T22:46:12.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7433e0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f742c112210 con 0x7f742c108300 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60086/0 (socket says 172.21.15.66:60086) 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 -- 172.21.15.66:0/2886587497 learned_addr learned my addr 172.21.15.66:0/2886587497 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f74313a6640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c103780 0x7f742c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f74323a8640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 0x7f742c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 -- 172.21.15.66:0/2886587497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 msgr2=0x7f742c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 0x7f742c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.650+0000 7f7431ba7640 1 -- 172.21.15.66:0/2886587497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c103780 msgr2=0x7f742c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c103780 0x7f742c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7431ba7640 1 -- 172.21.15.66:0/2886587497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c19d600 con 0x7f742c102dd0 2024-09-15T22:46:12.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f74323a8640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 0x7f742c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7428009230 tx=0x7f7428004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7422ffd640 1 -- 172.21.15.66:0/2886587497 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742803f030 con 0x7f742c102dd0 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c19d890 con 0x7f742c102dd0 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7422ffd640 1 -- 172.21.15.66:0/2886587497 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7428004440 con 0x7f742c102dd0 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7422ffd640 1 -- 172.21.15.66:0/2886587497 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428035070 con 0x7f742c102dd0 2024-09-15T22:46:12.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.651+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c1a51d0 con 0x7f742c102dd0 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.654+0000 7f74361e4740 1 Processor -- start 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.654+0000 7f74361e4740 1 -- start start 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.654+0000 7f7422ffd640 1 -- 172.21.15.66:0/2886587497 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f7428042030 con 0x7f742c102dd0 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01cfea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d0d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ee01c642a0 con 0x55ee01d0dd50 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ee01c0bb10 con 0x55ee01cfe620 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74361e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ee01c60260 con 0x55ee01cfef40 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60094/0 (socket says 172.21.15.66:60094) 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 -- 172.21.15.66:0/375284892 learned_addr learned my addr 172.21.15.66:0/375284892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74323a8640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01cfea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f7431ba7640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d0d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 -- 172.21.15.66:0/375284892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 msgr2=0x55ee01d0d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d0d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 -- 172.21.15.66:0/375284892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 msgr2=0x55ee01cfea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01cfea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.655+0000 7f74313a6640 1 -- 172.21.15.66:0/375284892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee019d5b90 con 0x55ee01d0dd50 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7431ba7640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d0d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7422ffd640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 0x7f74180a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f74313a6640 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f741c009c20 tx=0x7f741c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a43e34b55162b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f74323a8640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 0x7f74180a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7422ffd640 1 -- 172.21.15.66:0/2886587497 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f74280f06a0 con 0x7f742c102dd0 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7417fff640 1 -- 172.21.15.66:0/375284892 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c004230 con 0x55ee01d0dd50 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7417fff640 1 -- 172.21.15.66:0/375284892 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f741c0043d0 con 0x55ee01d0dd50 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.656+0000 7f7417fff640 1 -- 172.21.15.66:0/375284892 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c004e00 con 0x55ee01d0dd50 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 -- 172.21.15.66:0/375284892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 msgr2=0x55ee01d10140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f741c009c20 tx=0x7f741c011810 comp rx=0 tx=0).stop 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74323a8640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 0x7f74180a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7424005fd0 tx=0x7f7424009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 -- 172.21.15.66:0/375284892 shutdown_connections 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01d0dd50 0x55ee01d10140 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d0d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 --2- 172.21.15.66:0/375284892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01cfea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 -- 172.21.15.66:0/375284892 >> 172.21.15.66:0/375284892 conn(0x55ee01cfacf0 msgr2=0x55ee01cfb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 -- 172.21.15.66:0/375284892 shutdown_connections 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.657+0000 7f74361e4740 1 -- 172.21.15.66:0/375284892 wait complete. 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 -- start start 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 Processor -- start 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfef40 0x55ee01d0b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d0b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ee01d10920 con 0x55ee01cfe620 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ee01bec6e0 con 0x55ee01cfef40 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ee01d10aa0 con 0x55ee01d0dd50 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74361e4740 10 client.0 _ll_register_callbacks cb 0x55ee01c10a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60098/0 (socket says 172.21.15.66:60098) 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f7431ba7640 1 -- 172.21.15.66:0/2102349826 learned_addr learned my addr 172.21.15.66:0/2102349826 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.658+0000 7f74313a6640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfef40 0x55ee01d0b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74323a8640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d0b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 -- 172.21.15.66:0/2102349826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 msgr2=0x55ee01d0b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d0b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 -- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfef40 msgr2=0x55ee01d0b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfef40 0x55ee01d0b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 -- 172.21.15.66:0/2102349826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee01d19e80 con 0x55ee01cfe620 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7428009a50 tx=0x7f74280bc200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3627a013ee5f3ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74157fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280ef070 con 0x55ee01cfe620 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f74280f02b0 con 0x55ee01cfe620 2024-09-15T22:46:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f741c0043d0 con 0x55ee01cfe620 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7428049070 con 0x55ee01cfe620 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74361e4740 10 client.15762 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.659+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee01d1c760 con 0x55ee01cfe620 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f741c0043d0 con 0x55ee01cfe620 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7428031bd0 con 0x55ee01cfe620 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 10 client.15762 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 10 client.15762 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 20 client.15762 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d1db00 0x55ee01d1ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 4 client.15762 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee01c719d0 con 0x55ee01d1db00 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.660+0000 7f74313a6640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d1db00 0x55ee01d1ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.661+0000 7f74313a6640 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d1db00 0x55ee01d1ff30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa3422a060ccdfac server_cookie=a00c6c109ee65fa1 in_seq=0 out_seq=0 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.661+0000 7f74157fa640 10 client.15762 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.661+0000 7f74157fa640 1 -- 172.21.15.66:0/2102349826 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee01c719d0 con 0x55ee01d1db00 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.661+0000 7f74157fa640 10 client.15762 handle_command_reply: tid=0 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.661+0000 7f74361e4740 1 client.15762 shutdown 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 msgr2=0x55ee01d0ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7428009a50 tx=0x7f74280bc200 comp rx=0 tx=0).stop 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 shutdown_connections 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d0b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d1db00 0x55ee01d1ff30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfef40 0x55ee01d0b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74157fa640 0 client.15762 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 --2- 172.21.15.66:0/2102349826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d0ac50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 >> 172.21.15.66:0/2102349826 conn(0x55ee01cfacf0 msgr2=0x55ee01d00a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 shutdown_connections 2024-09-15T22:46:12.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 1 -- 172.21.15.66:0/2102349826 wait complete. 2024-09-15T22:46:12.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.662+0000 7f74361e4740 20 client.15762 trim_cache size 0 max 16384 2024-09-15T22:46:12.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.681+0000 7f74361e4740 1 Processor -- start 2024-09-15T22:46:12.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.681+0000 7f74361e4740 1 -- start start 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01d25810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d07eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1ace30 con 0x55ee01cfef40 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1ae970 con 0x55ee01cfe620 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74361e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1ad500 con 0x55ee01d0dd50 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60112/0 (socket says 172.21.15.66:60112) 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 -- 172.21.15.66:0/2951901125 learned_addr learned my addr 172.21.15.66:0/2951901125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f7431ba7640 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01d25810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74323a8640 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d07eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 -- 172.21.15.66:0/2951901125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 msgr2=0x55ee01d07eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d07eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 -- 172.21.15.66:0/2951901125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 msgr2=0x55ee01d25810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01d25810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 -- 172.21.15.66:0/2951901125 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee01cfed70 con 0x55ee01cfef40 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.682+0000 7f74313a6640 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f741c009b40 tx=0x7f741c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915aaa6fe96ef504 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74177fe640 1 -- 172.21.15.66:0/2951901125 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c01e040 con 0x55ee01cfef40 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74177fe640 1 -- 172.21.15.66:0/2951901125 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f741c02a070 con 0x55ee01cfef40 2024-09-15T22:46:12.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74177fe640 1 -- 172.21.15.66:0/2951901125 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c003e20 con 0x55ee01cfef40 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 -- 172.21.15.66:0/2951901125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 msgr2=0x55ee01d25d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f741c009b40 tx=0x7f741c004a60 comp rx=0 tx=0).stop 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 -- 172.21.15.66:0/2951901125 shutdown_connections 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01d0dd50 0x55ee01d07eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfef40 0x55ee01d25d50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 --2- 172.21.15.66:0/2951901125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01cfe620 0x55ee01d25810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.683+0000 7f74361e4740 1 -- 172.21.15.66:0/2951901125 >> 172.21.15.66:0/2951901125 conn(0x55ee01cfacf0 msgr2=0x55ee01cf9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- 172.21.15.66:0/2951901125 shutdown_connections 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- 172.21.15.66:0/2951901125 wait complete. 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- start start 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 Processor -- start 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 0x55ee01d12850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1ae2a0 con 0x55ee01cfe620 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1adbd0 con 0x55ee01d0dd50 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1aae10 con 0x55ee01cfef40 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.684+0000 7f74361e4740 10 client.0 _ll_register_callbacks cb 0x7f74280b86d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:12.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60126/0 (socket says 172.21.15.66:60126) 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 -- 172.21.15.66:0/3481253024 learned_addr learned my addr 172.21.15.66:0/3481253024 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 -- 172.21.15.66:0/3481253024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 msgr2=0x55ee01d122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 -- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 msgr2=0x55ee01d12850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74323a8640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 0x55ee01d12850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 0x55ee01d12850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 -- 172.21.15.66:0/3481253024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee01d87ad0 con 0x55ee01cfe620 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74323a8640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 0x55ee01d12850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f7431ba7640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7428031f40 tx=0x7f7428009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197b4345710e5e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74157fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280ef070 con 0x55ee01cfe620 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f74280edd80 con 0x55ee01cfe620 2024-09-15T22:46:12.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.685+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f741c02a070 con 0x55ee01cfe620 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74280a3050 con 0x55ee01cfe620 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 10 client.15768 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee01d88db0 con 0x55ee01cfe620 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74280bcb30 con 0x55ee01cfe620 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f74280c6080 con 0x55ee01cfe620 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 10 client.15768 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 10 client.15768 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 20 client.15768 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d893e0 0x55ee01d8b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 4 client.15768 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}] 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}) -- 0x7f741c02a070 con 0x55ee01d893e0 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.686+0000 7f74313a6640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d893e0 0x55ee01d8b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:12.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.687+0000 7f74313a6640 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d893e0 0x55ee01d8b880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c5299f394e75de server_cookie=eebbde4c2512ecfc in_seq=0 out_seq=0 2024-09-15T22:46:12.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.687+0000 7f74157fa640 10 client.15768 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.698+0000 7f74157fa640 1 -- 172.21.15.66:0/3481253024 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f741c02a070 con 0x55ee01d893e0 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.698+0000 7f74157fa640 10 client.15768 handle_command_reply: tid=0 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.698+0000 7f74361e4740 1 client.15768 shutdown 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 msgr2=0x55ee01d11d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7428031f40 tx=0x7f7428009680 comp rx=0 tx=0).stop 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 shutdown_connections 2024-09-15T22:46:12.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ee01d893e0 0x55ee01d8b880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ee01d0dd50 0x55ee01d12850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74157fa640 0 client.15768 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ee01cfef40 0x55ee01d122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 --2- 172.21.15.66:0/3481253024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee01cfe620 0x55ee01d11d90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 >> 172.21.15.66:0/3481253024 conn(0x55ee01cfacf0 msgr2=0x55ee01d000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 shutdown_connections 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 1 -- 172.21.15.66:0/3481253024 wait complete. 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.699+0000 7f74361e4740 20 client.15768 trim_cache size 0 max 16384 2024-09-15T22:46:12.702 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 28, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 2, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "a21d292a": { 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 2, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:46:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 150.2, 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:12.704 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 msgr2=0x7f74180a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 0x7f74180a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7424005fd0 tx=0x7f7424009500 comp rx=0 tx=0).stop 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 msgr2=0x7f742c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7428009230 tx=0x7f7428004040 comp rx=0 tx=0).stop 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 shutdown_connections 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74180a34d0 0x7f74180a5990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f742c108300 0x7f742c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f742c103780 0x7f742c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 --2- 172.21.15.66:0/2886587497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f742c102dd0 0x7f742c198650 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:12.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 >> 172.21.15.66:0/2886587497 conn(0x7f742c0fc7d0 msgr2=0x7f742c105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:12.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 shutdown_connections 2024-09-15T22:46:12.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:12.700+0000 7f7433e0b640 1 -- 172.21.15.66:0/2886587497 wait complete. 2024-09-15T22:46:13.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:12 smithi066 ceph-mon[31185]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:12 smithi087 ceph-mon[35290]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:12 smithi184 ceph-mon[35203]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-15T22:46:13.450 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a21d292a', quiesce took 6.6 seconds. Will release after: 23.6 2024-09-15T22:46:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 -- 172.21.15.66:0/3293288724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638102ef0 msgr2=0x7ff63810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 --2- 172.21.15.66:0/3293288724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638102ef0 0x7ff63810da40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff630009ca0 tx=0x7ff63002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 -- 172.21.15.66:0/3293288724 shutdown_connections 2024-09-15T22:46:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 --2- 172.21.15.66:0/3293288724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638102ef0 0x7ff63810da40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 --2- 172.21.15.66:0/3293288724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102570 0x7ff6381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 --2- 172.21.15.66:0/3293288724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638100e20 0x7ff638101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 -- 172.21.15.66:0/3293288724 >> 172.21.15.66:0/3293288724 conn(0x7ff6380fc7d0 msgr2=0x7ff6380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 -- 172.21.15.66:0/3293288724 shutdown_connections 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.008+0000 7ff63f52c640 1 -- 172.21.15.66:0/3293288724 wait complete. 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 Processor -- start 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 -- start start 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638102570 0x7ff6381989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102ef0 0x7ff63819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff638110f80 con 0x7ff638100e20 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff638110e00 con 0x7ff638102ef0 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63f52c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff638111100 con 0x7ff638102570 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63d2c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63d2c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60132/0 (socket says 172.21.15.66:60132) 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63d2c8640 1 -- 172.21.15.66:0/2244571438 learned_addr learned my addr 172.21.15.66:0/2244571438 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102ef0 0x7ff63819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.009+0000 7ff63cac7640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638102570 0x7ff6381989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 -- 172.21.15.66:0/2244571438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638102570 msgr2=0x7ff6381989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638102570 0x7ff6381989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 -- 172.21.15.66:0/2244571438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102ef0 msgr2=0x7ff63819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102ef0 0x7ff63819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 -- 172.21.15.66:0/2244571438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63819d440 con 0x7ff638100e20 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff63400d770 tx=0x7ff63400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff62e7fc640 1 -- 172.21.15.66:0/2244571438 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634017070 con 0x7ff638100e20 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63819d730 con 0x7ff638100e20 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff62e7fc640 1 -- 172.21.15.66:0/2244571438 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff634005500 con 0x7ff638100e20 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff62e7fc640 1 -- 172.21.15.66:0/2244571438 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634004e00 con 0x7ff638100e20 2024-09-15T22:46:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.010+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6381a5010 con 0x7ff638100e20 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 Processor -- start 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 -- start start 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff62e7fc640 1 -- 172.21.15.66:0/2244571438 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7ff634004fa0 con 0x7ff638100e20 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56219894e2f0 con 0x5621989e9b40 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5621988f5cf0 con 0x5621989e85d0 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff641905740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56219894a2b0 con 0x5621989f7780 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff63dac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff63dac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60138/0 (socket says 172.21.15.66:60138) 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff63dac9640 1 -- 172.21.15.66:0/2011540380 learned_addr learned my addr 172.21.15.66:0/2011540380 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.013+0000 7ff63cac7640 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 -- 172.21.15.66:0/2011540380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 msgr2=0x5621989f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 -- 172.21.15.66:0/2011540380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 msgr2=0x5621989e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 -- 172.21.15.66:0/2011540380 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621988da3a0 con 0x5621989e9b40 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff630035000 tx=0x7ff630005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbdee9d1603ab44 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff62e7fc640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 0x7ff6240a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff6237fe640 1 -- 172.21.15.66:0/2011540380 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630048070 con 0x5621989e9b40 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 0x7ff6240a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff6237fe640 1 -- 172.21.15.66:0/2011540380 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff63002f930 con 0x5621989e9b40 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.014+0000 7ff6237fe640 1 -- 172.21.15.66:0/2011540380 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630034040 con 0x5621989e9b40 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff62e7fc640 1 -- 172.21.15.66:0/2244571438 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff6340cfd70 con 0x7ff638100e20 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 -- 172.21.15.66:0/2011540380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 msgr2=0x5621989e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff63d2c8640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 0x7ff6240a5990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6340ccfd0 tx=0x7ff6340d8040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff630035000 tx=0x7ff630005fa0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 -- 172.21.15.66:0/2011540380 shutdown_connections 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 --2- 172.21.15.66:0/2011540380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989e8090 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 -- 172.21.15.66:0/2011540380 >> 172.21.15.66:0/2011540380 conn(0x5621989b1310 msgr2=0x5621989e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 -- 172.21.15.66:0/2011540380 shutdown_connections 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.015+0000 7ff641905740 1 -- 172.21.15.66:0/2011540380 wait complete. 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 -- start start 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 Processor -- start 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5621989fa420 con 0x5621989e9b40 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.016+0000 7ff641905740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562198909060 con 0x5621989e85d0 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff641905740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5621989fa5a0 con 0x5621989f7780 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff641905740 10 client.0 _ll_register_callbacks cb 0x56219865c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60154/0 (socket says 172.21.15.66:60154) 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 -- 172.21.15.66:0/3589311920 learned_addr learned my addr 172.21.15.66:0/3589311920 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63dac9640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 -- 172.21.15.66:0/3589311920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 msgr2=0x5621989f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 -- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 msgr2=0x5621989f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 -- 172.21.15.66:0/3589311920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621986bf3c0 con 0x5621989e9b40 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63dac9640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff63cac7640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff628012720 tx=0x7ff628012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613d7f5913f306b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62800f920 con 0x5621989e9b40 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff62800fac0 con 0x5621989e9b40 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.017+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff63002f930 con 0x5621989e9b40 2024-09-15T22:46:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff62800fcc0 con 0x5621989e9b40 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562198a05f50 con 0x5621989e9b40 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff63002f930 con 0x5621989e9b40 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff62801c420 con 0x5621989e9b40 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 20 client.15780 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a074b0 0x562198a09910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 4 client.15780 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56219895b860 con 0x562198a074b0 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.018+0000 7ff63dac9640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a074b0 0x562198a09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff63dac9640 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a074b0 0x562198a09910 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6df3225532db2498 server_cookie=87442ec87da875c0 in_seq=0 out_seq=0 2024-09-15T22:46:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff620ff9640 10 client.15780 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff620ff9640 1 -- 172.21.15.66:0/3589311920 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56219895b860 con 0x562198a074b0 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff620ff9640 10 client.15780 handle_command_reply: tid=0 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 client.15780 shutdown 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 msgr2=0x5621989f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff628012720 tx=0x7ff628012be0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 shutdown_connections 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x5621989f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e9b40 0x5621989f4450 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.019+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a074b0 0x562198a09910 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff641905740 1 --2- 172.21.15.66:0/3589311920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e85d0 0x5621989f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 >> 172.21.15.66:0/3589311920 conn(0x5621989b1310 msgr2=0x5621989ea960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff620ff9640 0 client.15780 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 shutdown_connections 2024-09-15T22:46:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff641905740 1 -- 172.21.15.66:0/3589311920 wait complete. 2024-09-15T22:46:14.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.020+0000 7ff641905740 20 client.15780 trim_cache size 0 max 16384 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.033+0000 7ff641905740 1 Processor -- start 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.033+0000 7ff641905740 1 -- start start 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989f3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x562198a0f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381aced0 con 0x5621989e85d0 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381aea10 con 0x5621989e9b40 2024-09-15T22:46:14.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff641905740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381ad5a0 con 0x5621989f7780 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60160/0 (socket says 172.21.15.66:60160) 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 -- 172.21.15.66:0/2607088339 learned_addr learned my addr 172.21.15.66:0/2607088339 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63cac7640 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x562198a0f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 -- 172.21.15.66:0/2607088339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 msgr2=0x562198a0f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x562198a0f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 -- 172.21.15.66:0/2607088339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 msgr2=0x5621989f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 -- 172.21.15.66:0/2607088339 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621989eb120 con 0x5621989e85d0 2024-09-15T22:46:14.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff63dac9640 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff630005fe0 tx=0x7ff630005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9516a2b9ae0b489 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.034+0000 7ff622ffd640 1 -- 172.21.15.66:0/2607088339 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630048040 con 0x5621989e85d0 2024-09-15T22:46:14.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.035+0000 7ff622ffd640 1 -- 172.21.15.66:0/2607088339 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff630049040 con 0x5621989e85d0 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.035+0000 7ff622ffd640 1 -- 172.21.15.66:0/2607088339 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630004530 con 0x5621989e85d0 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.035+0000 7ff641905740 1 -- 172.21.15.66:0/2607088339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 msgr2=0x562198a036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.035+0000 7ff641905740 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff630005fe0 tx=0x7ff630005c50 comp rx=0 tx=0).stop 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 -- 172.21.15.66:0/2607088339 shutdown_connections 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989f7780 0x562198a0f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 --2- 172.21.15.66:0/2607088339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989e85d0 0x562198a036c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 -- 172.21.15.66:0/2607088339 >> 172.21.15.66:0/2607088339 conn(0x5621989b1310 msgr2=0x5621989f2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 -- 172.21.15.66:0/2607088339 shutdown_connections 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 -- 172.21.15.66:0/2607088339 wait complete. 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 -- start start 2024-09-15T22:46:14.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.036+0000 7ff641905740 1 Processor -- start 2024-09-15T22:46:14.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 0x5621989fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989f7780 0x5621989fb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381ae340 con 0x5621989f7780 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381adc70 con 0x5621989e9b40 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6381aaeb0 con 0x5621989e85d0 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff641905740 10 client.0 _ll_register_callbacks cb 0x7ff628009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54976/0 (socket says 172.21.15.66:54976) 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 -- 172.21.15.66:0/625613217 learned_addr learned my addr 172.21.15.66:0/625613217 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63dac9640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989f7780 0x5621989fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63dac9640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 0x5621989fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 -- 172.21.15.66:0/625613217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 msgr2=0x5621989fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 0x5621989fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 -- 172.21.15.66:0/625613217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989f7780 msgr2=0x5621989fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989f7780 0x5621989fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63cac7640 1 -- 172.21.15.66:0/625613217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621989fc030 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.037+0000 7ff63dac9640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 0x5621989fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff63cac7640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5621989f5a90 tx=0x7ff62801c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac9a78cef0b06ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628009370 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff62801cd10 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff630049040 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff628005110 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 10 client.25385 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562198a721e0 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6280035f0 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff628010430 con 0x5621989e9b40 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 10 client.25385 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 10 client.25385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:14.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 20 client.25385 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a728f0 0x562198a74d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 4 client.25385 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.038+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff630049040 con 0x562198a728f0 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff63dac9640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a728f0 0x562198a74d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff620ff9640 10 client.25385 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff63dac9640 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a728f0 0x562198a74d10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32aecca499400c56 server_cookie=db305a749a477625 in_seq=0 out_seq=0 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff620ff9640 1 -- 172.21.15.66:0/625613217 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff630049040 con 0x562198a728f0 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff620ff9640 10 client.25385 handle_command_reply: tid=0 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.039+0000 7ff641905740 1 client.25385 shutdown 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 msgr2=0x5621989fb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5621989f5a90 tx=0x7ff62801c6d0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 shutdown_connections 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5621989f7780 0x5621989fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562198a728f0 0x562198a74d10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5621989e9b40 0x5621989fb2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 --2- 172.21.15.66:0/625613217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5621989e85d0 0x5621989fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff620ff9640 0 client.25385 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 >> 172.21.15.66:0/625613217 conn(0x5621989b1310 msgr2=0x5621989f3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 shutdown_connections 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 1 -- 172.21.15.66:0/625613217 wait complete. 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.040+0000 7ff641905740 20 client.25385 trim_cache size 0 max 16384 2024-09-15T22:46:14.047 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 msgr2=0x7ff6240a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 0x7ff6240a5990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6340ccfd0 tx=0x7ff6340d8040 comp rx=0 tx=0).stop 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 msgr2=0x7ff638198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff63400d770 tx=0x7ff63400dc30 comp rx=0 tx=0).stop 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 shutdown_connections 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6240a34d0 0x7ff6240a5990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff638102ef0 0x7ff63819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff638102570 0x7ff6381989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 --2- 172.21.15.66:0/2244571438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff638100e20 0x7ff638198490 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff63400d770 tx=0x7ff63400dc30 comp rx=0 tx=0).stop 2024-09-15T22:46:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 >> 172.21.15.66:0/2244571438 conn(0x7ff6380fc7d0 msgr2=0x7ff63806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 shutdown_connections 2024-09-15T22:46:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:14.041+0000 7ff63f52c640 1 -- 172.21.15.66:0/2244571438 wait complete. 2024-09-15T22:46:15.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:14 smithi066 ceph-mon[31185]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-15T22:46:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:14 smithi087 ceph-mon[35290]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-15T22:46:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:14 smithi184 ceph-mon[35203]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-15T22:46:15.766 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:46:15.766 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:46:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:16 smithi066 ceph-mon[31185]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:46:17.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:16 smithi087 ceph-mon[35290]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:46:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:16 smithi184 ceph-mon[35203]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-15T22:46:19.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:18 smithi066 ceph-mon[31185]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-15T22:46:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:18 smithi087 ceph-mon[35290]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-15T22:46:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:18 smithi184 ceph-mon[35203]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-15T22:46:19.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 -- 172.21.15.66:0/103427279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 msgr2=0x7f31c8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 --2- 172.21.15.66:0/103427279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c8103110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009930 tx=0x7f31b802a420 comp rx=0 tx=0).stop 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 -- 172.21.15.66:0/103427279 shutdown_connections 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 --2- 172.21.15.66:0/103427279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81082a0 0x7f31c810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 --2- 172.21.15.66:0/103427279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81036e0 0x7f31c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 --2- 172.21.15.66:0/103427279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c8103110 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 -- 172.21.15.66:0/103427279 >> 172.21.15.66:0/103427279 conn(0x7f31c80fc7d0 msgr2=0x7f31c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 -- 172.21.15.66:0/103427279 shutdown_connections 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.080+0000 7f31cd68d640 1 -- 172.21.15.66:0/103427279 wait complete. 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.081+0000 7f31cd68d640 1 Processor -- start 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.081+0000 7f31cd68d640 1 -- start start 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c81a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81036e0 0x7f31c81a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 0x7f31c819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c81a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81120a0 con 0x7f31c8102d30 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111f20 con 0x7f31c81036e0 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31cd68d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8112220 con 0x7f31c81082a0 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c81a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60188/0 (socket says 172.21.15.66:60188) 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c6ffd640 1 -- 172.21.15.66:0/2064461823 learned_addr learned my addr 172.21.15.66:0/2064461823 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c67fc640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81036e0 0x7f31c81a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 0x7f31c819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 -- 172.21.15.66:0/2064461823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81036e0 msgr2=0x7f31c81a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81036e0 0x7f31c81a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 -- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 msgr2=0x7f31c81a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c81a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.082+0000 7f31c77fe640 1 -- 172.21.15.66:0/2064461823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c819ad40 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 0x7f31c819a610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31c000da10 tx=0x7f31c000ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31affff640 1 -- 172.21.15.66:0/2064461823 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c000bd70 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31affff640 1 -- 172.21.15.66:0/2064461823 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c0003e50 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31affff640 1 -- 172.21.15.66:0/2064461823 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00106a0 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c819b030 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.083+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a7320 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.086+0000 7f31cfa66740 1 Processor -- start 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31affff640 1 -- 172.21.15.66:0/2064461823 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f31c0003970 con 0x7f31c81082a0 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 -- start start 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1653800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31c67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31c67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60192/0 (socket says 172.21.15.66:60192) 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1656130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c3e15ae280 con 0x55c3e1648b60 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c3e1555b10 con 0x55c3e1653d40 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31cfa66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c3e15aa240 con 0x55c3e1649480 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.087+0000 7f31c67fc640 1 -- 172.21.15.66:0/3466928131 learned_addr learned my addr 172.21.15.66:0/3466928131 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31affff640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 0x7f31b00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 -- 172.21.15.66:0/3466928131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 msgr2=0x55c3e1653800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1653800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 -- 172.21.15.66:0/3466928131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 msgr2=0x55c3e1656130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:46:19.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1656130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 -- 172.21.15.66:0/3466928131 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e15621f0 con 0x55c3e1648b60 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31affff640 1 -- 172.21.15.66:0/2064461823 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31c00d06e0 con 0x7f31c81082a0 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c67fc640 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009bc0 tx=0x7f31bc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc10ced376e1709 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.088+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 0x7f31b00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.089+0000 7f31ad7fa640 1 -- 172.21.15.66:0/3466928131 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009d70 con 0x55c3e1648b60 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.089+0000 7f31ad7fa640 1 -- 172.21.15.66:0/3466928131 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31bc005020 con 0x55c3e1648b60 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.089+0000 7f31cfa66740 1 -- 172.21.15.66:0/3466928131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 msgr2=0x55c3e1648f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.089+0000 7f31cfa66740 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009bc0 tx=0x7f31bc011810 comp rx=0 tx=0).stop 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.089+0000 7f31c77fe640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 0x7f31b00a5990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31c00cd940 tx=0x7f31c000b7e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 -- 172.21.15.66:0/3466928131 shutdown_connections 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1656130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1653800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 --2- 172.21.15.66:0/3466928131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e1648f40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 -- 172.21.15.66:0/3466928131 >> 172.21.15.66:0/3466928131 conn(0x55c3e16450f0 msgr2=0x55c3e16454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 -- 172.21.15.66:0/3466928131 shutdown_connections 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 -- 172.21.15.66:0/3466928131 wait complete. 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.090+0000 7f31cfa66740 1 -- start start 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 Processor -- start 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e1650b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 0x55c3e16510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1653d40 0x55c3e16515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c3e16569b0 con 0x55c3e1653d40 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c3e1568f10 con 0x55c3e1649480 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c3e1656b30 con 0x55c3e1648b60 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31cfa66740 10 client.0 _ll_register_callbacks cb 0x55c3e1531a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:19.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31c67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1653d40 0x55c3e16515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 0x55c3e16510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 0x55c3e16510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55014/0 (socket says 172.21.15.66:55014) 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31c6ffd640 1 -- 172.21.15.66:0/2924001307 learned_addr learned my addr 172.21.15.66:0/2924001307 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "f7a02859-ab01-4c99-b100-d29054368f3b", 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:46:19.885 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.091+0000 7f31c67fc640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e1650b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 -- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 msgr2=0x55c3e16510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 0x55c3e16510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 -- 172.21.15.66:0/2924001307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1653d40 msgr2=0x55c3e16515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1653d40 0x55c3e16515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 -- 172.21.15.66:0/2924001307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e131f6a0 con 0x55c3e1648b60 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31c67fc640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e1650b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0056d0 tx=0x7f31bc0045b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d653db32dd6be22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.092+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc019850 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31bc016040 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31bc005020 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31bc0199f0 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31cfa66740 10 client.25351 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c3e166ad60 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.093+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31bc005020 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f31bc025040 con 0x55c3e1648b60 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 10 client.25351 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 10 client.25351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 20 client.25351 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:19.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e166c0b0 0x55c3e166e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 4 client.25351 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3e15bb7f0 con 0x55c3e166c0b0 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.094+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e166c0b0 0x55c3e166e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e166c0b0 0x55c3e166e4a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b0f81f681fe7b3a server_cookie=db9b745e077f2eec in_seq=0 out_seq=0 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31aaff5640 10 client.25351 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31aaff5640 1 -- 172.21.15.66:0/2924001307 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3e15bb7f0 con 0x55c3e166c0b0 2024-09-15T22:46:19.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31aaff5640 10 client.25351 handle_command_reply: tid=0 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31cfa66740 1 client.25351 shutdown 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.095+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 msgr2=0x55c3e1650b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e1650b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0056d0 tx=0x7f31bc0045b0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 shutdown_connections 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1653d40 0x55c3e16515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e166c0b0 0x55c3e166e4a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1649480 0x55c3e16510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 --2- 172.21.15.66:0/2924001307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e1650b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 >> 172.21.15.66:0/2924001307 conn(0x55c3e16450f0 msgr2=0x55c3e164add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31aaff5640 0 client.25351 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 shutdown_connections 2024-09-15T22:46:19.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 1 -- 172.21.15.66:0/2924001307 wait complete. 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.096+0000 7f31cfa66740 20 client.25351 trim_cache size 0 max 16384 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.113+0000 7f31cfa66740 1 Processor -- start 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.113+0000 7f31cfa66740 1 -- start start 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1644160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1673c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ad020 con 0x55c3e1648b60 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81aeb60 con 0x55c3e1653d40 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31cfa66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ad6f0 con 0x55c3e1649480 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60212/0 (socket says 172.21.15.66:60212) 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 -- 172.21.15.66:0/254219213 learned_addr learned my addr 172.21.15.66:0/254219213 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1644160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 -- 172.21.15.66:0/254219213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 msgr2=0x55c3e1644160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1644160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 -- 172.21.15.66:0/254219213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 msgr2=0x55c3e1673c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1673c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.114+0000 7f31c67fc640 1 -- 172.21.15.66:0/254219213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e1644f20 con 0x55c3e1648b60 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.115+0000 7f31c67fc640 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005560 tx=0x7f31bc005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c6ec592c75370f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.115+0000 7f31acff9640 1 -- 172.21.15.66:0/254219213 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc036030 con 0x55c3e1648b60 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.115+0000 7f31acff9640 1 -- 172.21.15.66:0/254219213 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31bc016070 con 0x55c3e1648b60 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.115+0000 7f31acff9640 1 -- 172.21.15.66:0/254219213 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc019df0 con 0x55c3e1648b60 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- 172.21.15.66:0/254219213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 msgr2=0x55c3e164b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005560 tx=0x7f31bc005d30 comp rx=0 tx=0).stop 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- 172.21.15.66:0/254219213 shutdown_connections 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e1673c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1649480 0x55c3e1644160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 --2- 172.21.15.66:0/254219213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1648b60 0x55c3e164b5c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- 172.21.15.66:0/254219213 >> 172.21.15.66:0/254219213 conn(0x55c3e16450f0 msgr2=0x55c3e1643a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- 172.21.15.66:0/254219213 shutdown_connections 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- 172.21.15.66:0/254219213 wait complete. 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 -- start start 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.116+0000 7f31cfa66740 1 Processor -- start 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e165c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e164dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ae490 con 0x55c3e1649480 2024-09-15T22:46:19.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81addc0 con 0x55c3e1653d40 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ab000 con 0x55c3e1648b60 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31cfa66740 10 client.0 _ll_register_callbacks cb 0x7f31bc009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60218/0 (socket says 172.21.15.66:60218) 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 -- 172.21.15.66:0/1746765026 learned_addr learned my addr 172.21.15.66:0/1746765026 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e165c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e164dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 -- 172.21.15.66:0/1746765026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 msgr2=0x55c3e165c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e165c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 -- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 msgr2=0x55c3e164dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e164dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 -- 172.21.15.66:0/1746765026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e164e2c0 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31c6ffd640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f31b8000c00 tx=0x7f31b8031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6def35ad2fc6004 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.117+0000 7f31aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8035040 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31b8004450 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31bc016070 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31b8055050 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31cfa66740 10 client.15804 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c3e16d6c30 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.118+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31bc016070 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f31b80035f0 con 0x55c3e1649480 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 10 client.15804 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:19.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 20 client.15804 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e16d72c0 0x55c3e16d96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 4 client.15804 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c3e15b5d00 con 0x55c3e16d72c0 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e16d72c0 0x55c3e16d96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31aaff5640 10 client.15804 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.119+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e16d72c0 0x55c3e16d96e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4f130ec39f00c3 server_cookie=51ace40194a8074f in_seq=0 out_seq=0 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.120+0000 7f31aaff5640 1 -- 172.21.15.66:0/1746765026 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c3e15b5d00 con 0x55c3e16d72c0 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.120+0000 7f31aaff5640 10 client.15804 handle_command_reply: tid=0 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.120+0000 7f31cfa66740 1 client.15804 shutdown 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 msgr2=0x55c3e164d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f31b8000c00 tx=0x7f31b8031900 comp rx=0 tx=0).stop 2024-09-15T22:46:19.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 shutdown_connections 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c3e16d72c0 0x55c3e16d96e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c3e1653d40 0x55c3e164dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c3e1649480 0x55c3e164d740 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 --2- 172.21.15.66:0/1746765026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3e1648b60 0x55c3e165c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 >> 172.21.15.66:0/1746765026 conn(0x55c3e16450f0 msgr2=0x55c3e1651320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31aaff5640 0 client.15804 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 shutdown_connections 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 1 -- 172.21.15.66:0/1746765026 wait complete. 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.121+0000 7f31cfa66740 20 client.15804 trim_cache size 0 max 16384 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 msgr2=0x7f31b00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 0x7f31b00a5990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31c00cd940 tx=0x7f31c000b7e0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 msgr2=0x7f31c819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 0x7f31c819a610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31c000da10 tx=0x7f31c000ded0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 shutdown_connections 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31b00a34d0 0x7f31b00a5990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c81082a0 0x7f31c819a610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c81036e0 0x7f31c81a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 --2- 172.21.15.66:0/2064461823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31c8102d30 0x7f31c81a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 >> 172.21.15.66:0/2064461823 conn(0x7f31c80fc7d0 msgr2=0x7f31c8100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 shutdown_connections 2024-09-15T22:46:19.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:19.122+0000 7f31cd68d640 1 -- 172.21.15.66:0/2064461823 wait complete. 2024-09-15T22:46:21.117 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:20 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:46:21.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:20 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:46:21.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.118 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:20 smithi066 ceph-mon[31185]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:21.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:46:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:20 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:46:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:20 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:46:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:20 smithi087 ceph-mon[35290]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:20 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:46:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:20 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:46:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:46:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:20 smithi184 ceph-mon[35203]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:21.565 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:22.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.072+0000 7f89020e6640 1 -- 172.21.15.66:0/2423377412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 msgr2=0x7f88fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 --2- 172.21.15.66:0/2423377412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc101200 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009900 tx=0x7f88ec02a480 comp rx=0 tx=0).stop 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 -- 172.21.15.66:0/2423377412 shutdown_connections 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 --2- 172.21.15.66:0/2423377412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102ef0 0x7f88fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 --2- 172.21.15.66:0/2423377412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102570 0x7f88fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 --2- 172.21.15.66:0/2423377412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc101200 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 -- 172.21.15.66:0/2423377412 >> 172.21.15.66:0/2423377412 conn(0x7f88fc0fc7d0 msgr2=0x7f88fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 -- 172.21.15.66:0/2423377412 shutdown_connections 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 -- 172.21.15.66:0/2423377412 wait complete. 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.073+0000 7f89020e6640 1 Processor -- start 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 -- start start 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 0x7f88fc199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc110f50 con 0x7f88fc100e20 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc110dd0 con 0x7f88fc102570 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f89020e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1110d0 con 0x7f88fc102ef0 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 0x7f88fc199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53290/0 (socket says 172.21.15.66:53290) 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88fbfff640 1 -- 172.21.15.66:0/3566527645 learned_addr learned my addr 172.21.15.66:0/3566527645 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.074+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60234/0 (socket says 172.21.15.66:60234) 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 -- 172.21.15.66:0/3566527645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 msgr2=0x7f88fc199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 0x7f88fc199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 -- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 msgr2=0x7f88fc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 -- 172.21.15.66:0/3566527645 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc1a4980 con 0x7f88fc102ef0 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88faffd640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 0x7f88fc199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88f400eb10 tx=0x7f88f400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88f8ff9640 1 -- 172.21.15.66:0/3566527645 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4004b20 con 0x7f88fc102ef0 2024-09-15T22:46:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88f8ff9640 1 -- 172.21.15.66:0/3566527645 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f4004cc0 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f88f8ff9640 1 -- 172.21.15.66:0/3566527645 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4010760 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.075+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1971b0 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.076+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1976a0 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.078+0000 7f88f8ff9640 1 -- 172.21.15.66:0/3566527645 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7f88f4005020 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f88f8ff9640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 0x7f88e40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f88f8ff9640 1 -- 172.21.15.66:0/3566527645 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f88f40d0890 con 0x7f88fc102ef0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 0x7f88e40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f89044bf740 1 Processor -- start 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f89044bf740 1 -- start start 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.079+0000 7f89044bf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f89044bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9effc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f89044bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9effea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f89044bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a9ef572e0 con 0x559a9effc680 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f89044bf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559a9eefece0 con 0x559a9eff14a0 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f89044bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a9ef532a0 con 0x559a9eff1dc0 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 0x7f88e40a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009230 tx=0x7f88ec0058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55058/0 (socket says 172.21.15.66:55058) 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 -- 172.21.15.66:0/3818590155 learned_addr learned my addr 172.21.15.66:0/3818590155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9effea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88faffd640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9effc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 -- 172.21.15.66:0/3818590155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 msgr2=0x559a9effc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9effc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 -- 172.21.15.66:0/3818590155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 msgr2=0x559a9effea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9effea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fb7fe640 1 -- 172.21.15.66:0/3818590155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9eee3440 con 0x559a9eff14a0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.080+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9effea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.081+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0096c0 tx=0x7f88ec042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b5484d9866b073d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.081+0000 7f88e1ffb640 1 -- 172.21.15.66:0/3818590155 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec056070 con 0x559a9eff14a0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.081+0000 7f88e1ffb640 1 -- 172.21.15.66:0/3818590155 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec03adc0 con 0x559a9eff14a0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.081+0000 7f88e1ffb640 1 -- 172.21.15.66:0/3818590155 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec031a70 con 0x559a9eff14a0 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- 172.21.15.66:0/3818590155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 msgr2=0x559a9eff1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0096c0 tx=0x7f88ec042000 comp rx=0 tx=0).stop 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- 172.21.15.66:0/3818590155 shutdown_connections 2024-09-15T22:46:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9effea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9effc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 --2- 172.21.15.66:0/3818590155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff14a0 0x559a9eff1880 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- 172.21.15.66:0/3818590155 >> 172.21.15.66:0/3818590155 conn(0x559a9efeda30 msgr2=0x559a9efede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- 172.21.15.66:0/3818590155 shutdown_connections 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- 172.21.15.66:0/3818590155 wait complete. 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.082+0000 7f89044bf740 1 -- start start 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 Processor -- start 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9eff9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9effc680 0x559a9eff99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a9efff250 con 0x559a9eff14a0 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559a9ef12050 con 0x559a9effc680 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60260/0 (socket says 172.21.15.66:60260) 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a9efff3d0 con 0x559a9eff1dc0 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 -- 172.21.15.66:0/285058924 learned_addr learned my addr 172.21.15.66:0/285058924 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88faffd640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9eff9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f89044bf740 10 client.0 _ll_register_callbacks cb 0x559a9ef52160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 -- 172.21.15.66:0/285058924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 msgr2=0x559a9eff9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9eff9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 -- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9effc680 msgr2=0x559a9eff99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9effc680 0x559a9eff99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.083+0000 7f88fb7fe640 1 -- 172.21.15.66:0/285058924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9ecc83c0 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02a9a0 tx=0x7f88ec031d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ce3c41d8743a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f88daffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec056040 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f88ec0035f0 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88ec03adc0 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88ec0037f0 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f89044bf740 10 client.15816 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.084+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a9efff250 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec051440 con 0x559a9eff14a0 2024-09-15T22:46:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f88ec064030 con 0x559a9eff14a0 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 20 client.15816 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f00be30 0x559a9f00e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 4 client.15816 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88ec03adc0 con 0x559a9f00be30 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.085+0000 7f88faffd640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f00be30 0x559a9f00e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.086+0000 7f88faffd640 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f00be30 0x559a9f00e220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=940dbbca53134b72 server_cookie=f0f6ff6c0c1de286 in_seq=0 out_seq=0 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.086+0000 7f88daffd640 10 client.15816 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.086+0000 7f88daffd640 1 -- 172.21.15.66:0/285058924 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f88ec03adc0 con 0x559a9f00be30 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.086+0000 7f88daffd640 10 client.15816 handle_command_reply: tid=0 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.086+0000 7f89044bf740 1 client.15816 shutdown 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 msgr2=0x559a9effc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f88ec02a9a0 tx=0x7f88ec031d70 comp rx=0 tx=0).stop 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 shutdown_connections 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f00be30 0x559a9f00e220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9effc680 0x559a9eff99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff1dc0 0x559a9eff9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 --2- 172.21.15.66:0/285058924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9eff14a0 0x559a9effc070 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 >> 172.21.15.66:0/285058924 conn(0x559a9efeda30 msgr2=0x559a9eff3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f88daffd640 0 client.15816 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 shutdown_connections 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 1 -- 172.21.15.66:0/285058924 wait complete. 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.087+0000 7f89044bf740 20 client.15816 trim_cache size 0 max 16384 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.104+0000 7f89044bf740 1 Processor -- start 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.104+0000 7f89044bf740 1 -- start start 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9eff39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f0084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1acf30 con 0x559a9effc680 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1aea70 con 0x559a9eff1dc0 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f89044bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1ad600 con 0x559a9eff14a0 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60268/0 (socket says 172.21.15.66:60268) 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 -- 172.21.15.66:0/3441082375 learned_addr learned my addr 172.21.15.66:0/3441082375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9eff39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88faffd640 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f0084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 -- 172.21.15.66:0/3441082375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 msgr2=0x559a9eff39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9eff39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 -- 172.21.15.66:0/3441082375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 msgr2=0x559a9f0084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f0084b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 -- 172.21.15.66:0/3441082375 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9eff9d00 con 0x559a9effc680 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.105+0000 7f88fbfff640 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f88f40049d0 tx=0x7f88f40988b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be0a187c19be2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.106+0000 7f88e17fa640 1 -- 172.21.15.66:0/3441082375 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40b4020 con 0x559a9effc680 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.106+0000 7f88e17fa640 1 -- 172.21.15.66:0/3441082375 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f409cc50 con 0x559a9effc680 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.106+0000 7f88e17fa640 1 -- 172.21.15.66:0/3441082375 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40a4f90 con 0x559a9effc680 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.106+0000 7f89044bf740 1 -- 172.21.15.66:0/3441082375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 msgr2=0x559a9f013990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.106+0000 7f89044bf740 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f88f40049d0 tx=0x7f88f40988b0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 -- 172.21.15.66:0/3441082375 shutdown_connections 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f013990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f0084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 --2- 172.21.15.66:0/3441082375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9eff39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 -- 172.21.15.66:0/3441082375 >> 172.21.15.66:0/3441082375 conn(0x559a9efeda30 msgr2=0x559a9eff8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 -- 172.21.15.66:0/3441082375 shutdown_connections 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 -- 172.21.15.66:0/3441082375 wait complete. 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 -- start start 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.107+0000 7f89044bf740 1 Processor -- start 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9f000590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f001010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1ae3a0 con 0x559a9effc680 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1adcd0 con 0x559a9eff1dc0 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1aaf10 con 0x559a9eff14a0 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55076/0 (socket says 172.21.15.66:55076) 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 -- 172.21.15.66:0/1324315756 learned_addr learned my addr 172.21.15.66:0/1324315756 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9f000590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88fbfff640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f001010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 -- 172.21.15.66:0/1324315756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 msgr2=0x559a9f000590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9f000590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 -- 172.21.15.66:0/1324315756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 msgr2=0x559a9f001010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f001010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88faffd640 1 -- 172.21.15.66:0/1324315756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9f075b60 con 0x559a9eff1dc0 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f88fbfff640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f001010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 10 client.0 _ll_register_callbacks cb 0x7f88ec054070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.108+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f409cc50 con 0x559a9eff1dc0 2024-09-15T22:46:22.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88faffd640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559a9efee7f0 tx=0x7f88f0012d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a25370c99effa6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88daffd640 10 client.25409 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88daffd640 1 -- 172.21.15.66:0/1324315756 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0010dd0 con 0x559a9eff1dc0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88daffd640 1 -- 172.21.15.66:0/1324315756 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f88f0004020 con 0x559a9eff1dc0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88daffd640 1 -- 172.21.15.66:0/1324315756 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88f0004280 con 0x559a9eff1dc0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 10 client.25409 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559a9f076d00 con 0x559a9eff1dc0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f88daffd640 1 -- 172.21.15.66:0/1324315756 <== mon.2 v2:172.21.15.87:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f88f00035f0 con 0x559a9eff1dc0 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 10 client.25409 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 20 client.25409 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.109+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f077390 0x559a9f0797d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.110+0000 7f89044bf740 4 client.25409 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:46:22.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.110+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a9ef64850 con 0x559a9f077390 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.110+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f077390 0x559a9f0797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.110+0000 7f88fb7fe640 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f077390 0x559a9f0797d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79c5252115391e server_cookie=55344f4ee5b5b7d5 in_seq=0 out_seq=0 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.110+0000 7f88daffd640 10 client.25409 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.111+0000 7f88daffd640 1 -- 172.21.15.66:0/1324315756 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559a9ef64850 con 0x559a9f077390 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.111+0000 7f88daffd640 10 client.25409 handle_command_reply: tid=0 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.111+0000 7f89044bf740 1 client.25409 shutdown 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.111+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 msgr2=0x559a9f000ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.111+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559a9efee7f0 tx=0x7f88f0012d70 comp rx=0 tx=0).stop 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 shutdown_connections 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a9effc680 0x559a9f001010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559a9f077390 0x559a9f0797d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f88daffd640 0 client.25409 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559a9eff1dc0 0x559a9f000ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 --2- 172.21.15.66:0/1324315756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a9eff14a0 0x559a9f000590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 >> 172.21.15.66:0/1324315756 conn(0x559a9efeda30 msgr2=0x559a9eff7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 shutdown_connections 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 1 -- 172.21.15.66:0/1324315756 wait complete. 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.112+0000 7f89044bf740 20 client.25409 trim_cache size 0 max 16384 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stdout: "f7a02859-ab01-4c99-b100-d29054368f3b": { 2024-09-15T22:46:22.134 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "f7a02859-ab01-4c99-b100-d29054368f3b", 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 msgr2=0x7f88e40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 0x7f88e40a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009230 tx=0x7f88ec0058d0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 msgr2=0x7f88fc1a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88f400eb10 tx=0x7f88f400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 shutdown_connections 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f88e40a34d0 0x7f88e40a5990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88fc102ef0 0x7f88fc1a4440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88fc102570 0x7f88fc199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 --2- 172.21.15.66:0/3566527645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88fc100e20 0x7f88fc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 >> 172.21.15.66:0/3566527645 conn(0x7f88fc0fc7d0 msgr2=0x7f88fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 shutdown_connections 2024-09-15T22:46:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:22.113+0000 7f89020e6640 1 -- 172.21.15.66:0/3566527645 wait complete. 2024-09-15T22:46:22.899 INFO:tasks.cephfs.filesystem:scrub status for tag:f7a02859-ab01-4c99-b100-d29054368f3b - {'path': '/', 'tag': 'f7a02859-ab01-4c99-b100-d29054368f3b', 'options': 'recursive,force'} 2024-09-15T22:46:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:22 smithi066 ceph-mon[31185]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:22 smithi087 ceph-mon[35290]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:22 smithi184 ceph-mon[35203]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:24 smithi087 ceph-mon[35290]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:46:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:24 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:46:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:24 smithi184 ceph-mon[35203]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:46:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:24 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:46:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:24 smithi066 ceph-mon[31185]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-15T22:46:25.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:24 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:46:27.251 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:26 smithi066 ceph-mon[31185]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:26 smithi087 ceph-mon[35290]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:26 smithi184 ceph-mon[35203]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-15T22:46:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:28 smithi087 ceph-mon[35290]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:46:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:28 smithi184 ceph-mon[35203]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:46:29.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:28 smithi066 ceph-mon[31185]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:29 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:29 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:29 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:30 smithi087 ceph-mon[35290]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:30 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:46:31.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:30 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:46:31.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:30 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:30 smithi184 ceph-mon[35203]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:30 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:46:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:30 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:46:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:30 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:30 smithi066 ceph-mon[31185]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:30 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:46:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:30 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:46:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:30 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:46:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:32 smithi087 ceph-mon[35290]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:32 smithi184 ceph-mon[35203]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:32 smithi066 ceph-mon[31185]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-15T22:46:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:34 smithi087 ceph-mon[35290]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-15T22:46:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:34 smithi184 ceph-mon[35203]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-15T22:46:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:34 smithi066 ceph-mon[31185]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-15T22:46:37.052 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:46:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:36 smithi087 ceph-mon[35290]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:36 smithi184 ceph-mon[35203]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:37.432 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:37.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:36 smithi066 ceph-mon[31185]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.909+0000 7fb87e35d640 1 -- 172.21.15.66:0/4171901738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 msgr2=0x7fb8781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.909+0000 7fb87e35d640 1 --2- 172.21.15.66:0/4171901738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb8781029b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009900 tx=0x7fb86c02a480 comp rx=0 tx=0).stop 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 -- 172.21.15.66:0/4171901738 shutdown_connections 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 --2- 172.21.15.66:0/4171901738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878102ef0 0x7fb87810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 --2- 172.21.15.66:0/4171901738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb8781029b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 --2- 172.21.15.66:0/4171901738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb878100e20 0x7fb878101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 -- 172.21.15.66:0/4171901738 >> 172.21.15.66:0/4171901738 conn(0x7fb8780fc7d0 msgr2=0x7fb8780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 -- 172.21.15.66:0/4171901738 shutdown_connections 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.910+0000 7fb87e35d640 1 -- 172.21.15.66:0/4171901738 wait complete. 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.911+0000 7fb87e35d640 1 Processor -- start 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.911+0000 7fb87e35d640 1 -- start start 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878100e20 0x7fb8781982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb878102ef0 0x7fb87819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb878112090 con 0x7fb878102570 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb878111f10 con 0x7fb878100e20 2024-09-15T22:46:37.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb87e35d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb878112210 con 0x7fb878102ef0 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39786/0 (socket says 172.21.15.66:39786) 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 -- 172.21.15.66:0/3903747188 learned_addr learned my addr 172.21.15.66:0/3903747188 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb877fff640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878100e20 0x7fb8781982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 -- 172.21.15.66:0/3903747188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb878102ef0 msgr2=0x7fb87819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb878102ef0 0x7fb87819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 -- 172.21.15.66:0/3903747188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878100e20 msgr2=0x7fb8781982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878100e20 0x7fb8781982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.912+0000 7fb8777fe640 1 -- 172.21.15.66:0/3903747188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87819d270 con 0x7fb878102570 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb8777fe640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb86c030630 tx=0x7fb86c030660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c03f070 con 0x7fb878102570 2024-09-15T22:46:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb86c004460 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb87e35d640 1 -- 172.21.15.66:0/3903747188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87819d500 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c035030 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.913+0000 7fb87e35d640 1 -- 172.21.15.66:0/3903747188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87819d970 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.914+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858005290 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.916+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fb86c042070 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.917+0000 7fb8757fa640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 0x7fb8600a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.917+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb86c0f0c80 con 0x7fb878102570 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.918+0000 7fb877fff640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 0x7fb8600a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.918+0000 7fb877fff640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 0x7fb8600a5a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb868009b60 tx=0x7fb868005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:37.925+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb86c0bd110 con 0x7fb878102570 2024-09-15T22:46:38.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.139+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb858005850 con 0x7fb878102570 2024-09-15T22:46:38.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.140+0000 7fb8757fa640 1 -- 172.21.15.66:0/3903747188 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fb86c0bca10 con 0x7fb878102570 2024-09-15T22:46:38.142 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:46:38.142 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-15T22:45:20:040122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:45:19.989957+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:46:38.142 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-15T22:46:38.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 msgr2=0x7fb8600a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 0x7fb8600a5a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb868009b60 tx=0x7fb868005f90 comp rx=0 tx=0).stop 2024-09-15T22:46:38.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 msgr2=0x7fb878198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:38.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb86c030630 tx=0x7fb86c030660 comp rx=0 tx=0).stop 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 shutdown_connections 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb8600a3550 0x7fb8600a5a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb878102ef0 0x7fb87819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb878102570 0x7fb878198800 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 --2- 172.21.15.66:0/3903747188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb878100e20 0x7fb8781982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:38.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.143+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 >> 172.21.15.66:0/3903747188 conn(0x7fb8780fc7d0 msgr2=0x7fb8781056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:38.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.144+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 shutdown_connections 2024-09-15T22:46:38.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:38.144+0000 7fb85effd640 1 -- 172.21.15.66:0/3903747188 wait complete. 2024-09-15T22:46:38.853 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id a21d292a --release --await' 2024-09-15T22:46:38.853 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id a21d292a --release --await 2024-09-15T22:46:39.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:38 smithi066 ceph-mon[31185]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:39.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3903747188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:38 smithi087 ceph-mon[35290]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3903747188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:38 smithi184 ceph-mon[35203]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3903747188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:39.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 -- 172.21.15.66:0/1856195734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 msgr2=0x7fb0c0100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 --2- 172.21.15.66:0/1856195734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c0100d90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009900 tx=0x7fb0bc02a410 comp rx=0 tx=0).stop 2024-09-15T22:46:39.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 -- 172.21.15.66:0/1856195734 shutdown_connections 2024-09-15T22:46:39.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 --2- 172.21.15.66:0/1856195734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 0x7fb0c01108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 --2- 172.21.15.66:0/1856195734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.740+0000 7fb0c761b640 1 --2- 172.21.15.66:0/1856195734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c0100d90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.741+0000 7fb0c761b640 1 -- 172.21.15.66:0/1856195734 >> 172.21.15.66:0/1856195734 conn(0x7fb0c00fc7d0 msgr2=0x7fb0c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.741+0000 7fb0c761b640 1 -- 172.21.15.66:0/1856195734 shutdown_connections 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.741+0000 7fb0c761b640 1 -- 172.21.15.66:0/1856195734 wait complete. 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.741+0000 7fb0c761b640 1 Processor -- start 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.741+0000 7fb0c761b640 1 -- start start 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c01a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 0x7fb0c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0114280 con 0x7fb0c01009b0 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0114100 con 0x7fb0c010e4d0 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c761b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0114400 con 0x7fb0c0101360 2024-09-15T22:46:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c53b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c53b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39794/0 (socket says 172.21.15.66:39794) 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c53b7640 1 -- 172.21.15.66:0/2913875334 learned_addr learned my addr 172.21.15.66:0/2913875334 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c01a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.742+0000 7fb0c5bb8640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 0x7fb0c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 -- 172.21.15.66:0/2913875334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 msgr2=0x7fb0c01a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c01a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 -- 172.21.15.66:0/2913875334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 msgr2=0x7fb0c019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 0x7fb0c019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 -- 172.21.15.66:0/2913875334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c019ad10 con 0x7fb0c01009b0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c01a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0b67fc640 1 -- 172.21.15.66:0/2913875334 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc03f030 con 0x7fb0c01009b0 2024-09-15T22:46:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0b67fc640 1 -- 172.21.15.66:0/2913875334 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0bc003ce0 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.743+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c019afa0 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.744+0000 7fb0b67fc640 1 -- 172.21.15.66:0/2913875334 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc035070 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.744+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c01a72f0 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.746+0000 7fb0b67fc640 1 -- 172.21.15.66:0/2913875334 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 138588+0+0 (secure 0 0 0) 0x7fb0bc042030 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.747+0000 7fb0b67fc640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 0x7fb0ac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.747+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 0x7fb0ac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0b67fc640 1 -- 172.21.15.66:0/2913875334 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb0bc0f0190 con 0x7fb0c01009b0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 Processor -- start 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 -- start start 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 0x7fb0ac0a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0c010e910 tx=0x7fb0b0009110 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177e2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed1773a620 con 0x55ed177e0240 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed176e1e50 con 0x55ed177d5060 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.748+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed177365e0 con 0x55ed177d5980 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c5bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c5bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177e2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39802/0 (socket says 172.21.15.66:39802) 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c5bb8640 1 -- 172.21.15.66:0/3027584570 learned_addr learned my addr 172.21.15.66:0/3027584570 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 -- 172.21.15.66:0/3027584570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 msgr2=0x55ed177dfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177dfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 -- 172.21.15.66:0/3027584570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 msgr2=0x55ed177e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177e2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 -- 172.21.15.66:0/3027584570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed176d2d40 con 0x55ed177d5060 2024-09-15T22:46:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d5440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ed330 tx=0x7fb0bc0bba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a7c0cd622aa5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0ab7fe640 1 -- 172.21.15.66:0/3027584570 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc049040 con 0x55ed177d5060 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0ab7fe640 1 -- 172.21.15.66:0/3027584570 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0bc0bc5c0 con 0x55ed177d5060 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.749+0000 7fb0ab7fe640 1 -- 172.21.15.66:0/3027584570 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc03be40 con 0x55ed177d5060 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3027584570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 msgr2=0x55ed177d5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d5440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0ed330 tx=0x7fb0bc0bba00 comp rx=0 tx=0).stop 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3027584570 shutdown_connections 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3027584570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d5440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3027584570 >> 172.21.15.66:0/3027584570 conn(0x55ed177d15f0 msgr2=0x55ed177d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3027584570 shutdown_connections 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.750+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3027584570 wait complete. 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.751+0000 7fb0c99f4740 1 -- start start 2024-09-15T22:46:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.751+0000 7fb0c99f4740 1 Processor -- start 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.751+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 0x55ed177dd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.751+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177e0240 0x55ed177ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed177e2bd0 con 0x55ed177d5060 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed176c2f10 con 0x55ed177d5980 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed177e2d50 con 0x55ed177e0240 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c99f4740 10 client.0 _ll_register_callbacks cb 0x55ed176e6db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c53b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 0x55ed177dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c5bb8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177e0240 0x55ed177ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40328/0 (socket says 172.21.15.66:40328) 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/998880208 learned_addr learned my addr 172.21.15.66:0/998880208 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/998880208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177e0240 msgr2=0x55ed177ddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177e0240 0x55ed177ddba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/998880208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 msgr2=0x55ed177dd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 0x55ed177dd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/998880208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed17449580 con 0x55ed177d5980 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.752+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 0x55ed177dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:39.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0015b70 tx=0x7fb0b00047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536e06e1eb54ff81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:46:39.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0025020 con 0x55ed177d5980 2024-09-15T22:46:39.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0bc0bc5c0 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb0b0013a50 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb0b0030050 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c99f4740 10 client.25427 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed17513960 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0bc0bc5c0 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb0b00143e0 con 0x55ed177d5980 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c99f4740 10 client.25427 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.753+0000 7fb0c99f4740 10 client.25427 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c99f4740 20 client.25427 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed177eff40 0x55ed177f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c99f4740 4 client.25427 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed17747b90 con 0x55ed177eff40 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed177eff40 0x55ed177f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed177eff40 0x55ed177f2400 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab75c21bd2612d29 server_cookie=9291072a949a3a5 in_seq=0 out_seq=0 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.754+0000 7fb0a8ff9640 10 client.25427 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/998880208 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed17747b90 con 0x55ed177eff40 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0a8ff9640 10 client.25427 handle_command_reply: tid=0 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 client.25427 shutdown 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 msgr2=0x55ed177dd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0015b70 tx=0x7fb0b00047d0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 shutdown_connections 2024-09-15T22:46:39.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177e0240 0x55ed177ddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed177eff40 0x55ed177f2400 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5980 0x55ed177dd660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/998880208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5060 0x55ed177dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 >> 172.21.15.66:0/998880208 conn(0x55ed177d15f0 msgr2=0x55ed177d72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0a8ff9640 0 client.25427 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:39.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 shutdown_connections 2024-09-15T22:46:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.755+0000 7fb0c99f4740 1 -- 172.21.15.66:0/998880208 wait complete. 2024-09-15T22:46:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.756+0000 7fb0c99f4740 20 client.25427 trim_cache size 0 max 16384 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.773+0000 7fb0c99f4740 1 Processor -- start 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.773+0000 7fb0c99f4740 1 -- start start 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.773+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.773+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177eb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.773+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b10d0 con 0x55ed177e0240 2024-09-15T22:46:39.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b2c10 con 0x55ed177d5060 2024-09-15T22:46:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b17a0 con 0x55ed177d5980 2024-09-15T22:46:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39818/0 (socket says 172.21.15.66:39818) 2024-09-15T22:46:39.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 -- 172.21.15.66:0/238036862 learned_addr learned my addr 172.21.15.66:0/238036862 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 -- 172.21.15.66:0/238036862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 msgr2=0x55ed177eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 -- 172.21.15.66:0/238036862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 msgr2=0x55ed177d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 -- 172.21.15.66:0/238036862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed177cfbb0 con 0x55ed177e0240 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.774+0000 7fb0c5bb8640 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8003b60 tx=0x7fb0b80096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a165b4cdb312472 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.775+0000 7fb0aaffd640 1 -- 172.21.15.66:0/238036862 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b801f020 con 0x55ed177e0240 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.775+0000 7fb0aaffd640 1 -- 172.21.15.66:0/238036862 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b8003e90 con 0x55ed177e0240 2024-09-15T22:46:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.775+0000 7fb0aaffd640 1 -- 172.21.15.66:0/238036862 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80116a0 con 0x55ed177e0240 2024-09-15T22:46:39.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.775+0000 7fb0c99f4740 1 -- 172.21.15.66:0/238036862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 msgr2=0x55ed177f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.775+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8003b60 tx=0x7fb0b80096a0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 -- 172.21.15.66:0/238036862 shutdown_connections 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177e0240 0x55ed177f7d10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5980 0x55ed177eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/238036862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177d5060 0x55ed177d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 -- 172.21.15.66:0/238036862 >> 172.21.15.66:0/238036862 conn(0x55ed177d15f0 msgr2=0x55ed177df1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 -- 172.21.15.66:0/238036862 shutdown_connections 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 -- 172.21.15.66:0/238036862 wait complete. 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 -- start start 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.776+0000 7fb0c99f4740 1 Processor -- start 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5060 0x55ed177e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177e0240 0x55ed177e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b2540 con 0x55ed177d5980 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01b1e70 con 0x55ed177e0240 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01af0b0 con 0x55ed177d5060 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c99f4740 10 client.0 _ll_register_callbacks cb 0x7fb0b0015510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39832/0 (socket says 172.21.15.66:39832) 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/3945431112 learned_addr learned my addr 172.21.15.66:0/3945431112 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5060 0x55ed177e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/3945431112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5060 msgr2=0x55ed177e7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5060 0x55ed177e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177e0240 msgr2=0x55ed177e34a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:46:39.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c5bb8640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177e0240 0x55ed177e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.777+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177e0240 0x55ed177e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0c4bb6640 1 -- 172.21.15.66:0/3945431112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed177e3a10 con 0x55ed177d5980 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0c4bb6640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0010010 tx=0x7fb0b0014610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b701361a851d2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0039060 con 0x55ed177d5980 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb0b0021470 con 0x55ed177d5980 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b8003e90 con 0x55ed177d5980 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb0b0025070 con 0x55ed177d5980 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0c99f4740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-09-15T22:46:39.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.778+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed1785aae0 con 0x55ed177d5980 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b8003e90 con 0x55ed177d5980 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb0b00344c0 con 0x55ed177d5980 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 10 client.15846 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 20 client.15846 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1785b240 0x55ed1785d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 4 client.15846 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a21d292a", "release": true, "await": true}] 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.779+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a21d292a", "release": true, "await": true}) -- 0x55ed177cc950 con 0x55ed1785b240 2024-09-15T22:46:39.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.780+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1785b240 0x55ed1785d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.780+0000 7fb0a8ff9640 10 client.15846 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.780+0000 7fb0c53b7640 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1785b240 0x55ed1785d660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfba82047c75485e server_cookie=83fd26e13214b2f8 in_seq=0 out_seq=0 2024-09-15T22:46:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0a8ff9640 1 -- 172.21.15.66:0/3945431112 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ed177cc950 con 0x55ed1785b240 2024-09-15T22:46:39.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0a8ff9640 10 client.15846 handle_command_reply: tid=0 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 client.15846 shutdown 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 msgr2=0x55ed177e2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0010010 tx=0x7fb0b0014610 comp rx=0 tx=0).stop 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 shutdown_connections 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1785b240 0x55ed1785d660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed177e0240 0x55ed177e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed177d5980 0x55ed177e2f60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 --2- 172.21.15.66:0/3945431112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed177d5060 0x55ed177e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 >> 172.21.15.66:0/3945431112 conn(0x55ed177d15f0 msgr2=0x55ed177cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0a8ff9640 0 client.15846 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:39.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 shutdown_connections 2024-09-15T22:46:39.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 1 -- 172.21.15.66:0/3945431112 wait complete. 2024-09-15T22:46:39.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.782+0000 7fb0c99f4740 20 client.15846 trim_cache size 0 max 16384 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 28, 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 4, 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "a21d292a": { 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 4, 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:46:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 150.2, 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:39.792 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:39.793 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:39.793 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:39.793 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:46:39.793 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 msgr2=0x7fb0ac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 0x7fb0ac0a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0c010e910 tx=0x7fb0b0009110 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 msgr2=0x7fb0c01a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc0042f0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 shutdown_connections 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb0ac0a3430 0x7fb0ac0a58f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c010e4d0 0x7fb0c019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0101360 0x7fb0c01a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 --2- 172.21.15.66:0/2913875334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0c01009b0 0x7fb0c01a0420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:39.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.783+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 >> 172.21.15.66:0/2913875334 conn(0x7fb0c00fc7d0 msgr2=0x7fb0c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:39.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.784+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 shutdown_connections 2024-09-15T22:46:39.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:39.784+0000 7fb0c761b640 1 -- 172.21.15.66:0/2913875334 wait complete. 2024-09-15T22:46:40.468 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a21d292a', total seconds elapsed: 33.6 2024-09-15T22:46:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:40 smithi087 ceph-mon[35290]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:40 smithi184 ceph-mon[35203]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:40 smithi066 ceph-mon[31185]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:43.214 INFO:tasks.workunit.client.0.smithi066.stderr:Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T22:46:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:42 smithi087 ceph-mon[35290]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:42 smithi184 ceph-mon[35203]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:42 smithi066 ceph-mon[31185]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:43.693 INFO:tasks.workunit.client.0.smithi066.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:46:43.693 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.694 INFO:tasks.workunit.client.0.smithi066.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:46:43.694 INFO:tasks.workunit.client.0.smithi066.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:46:43.694 INFO:tasks.workunit.client.0.smithi066.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:46:43.694 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.694 INFO:tasks.workunit.client.0.smithi066.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:46:43.695 INFO:tasks.workunit.client.0.smithi066.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:46:43.695 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.695 INFO:tasks.workunit.client.0.smithi066.stderr: git switch -c 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr:Or undo this operation with: 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr: git switch - 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:43.696 INFO:tasks.workunit.client.0.smithi066.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:46:43.698 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:46:43.718 INFO:tasks.workunit.client.0.smithi066.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:46:43.720 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:46:43.720 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:46:44.415 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:46:44.481 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:46:44.524 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:46:44.526 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:46:44.526 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:46:44.567 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:46:44.571 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T22:46:44.571 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:46:44.628 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-15T22:46:44.629 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-15T22:46:44.630 DEBUG:teuthology.orchestra.run.smithi066:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-15T22:46:44.693 INFO:tasks.workunit.client.0.smithi066.stdout:getting blogbench 2024-09-15T22:46:45.041 INFO:tasks.workunit.client.0.smithi066.stderr:+ echo 'getting blogbench' 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:--2024-09-15 22:46:44-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr: 0K .......... .......... .......... .......... .......... 49% 1.23M 0s 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr: 50K .......... .......... .......... .......... .......... 99% 2.39M 0s 2024-09-15T22:46:45.042 INFO:tasks.workunit.client.0.smithi066.stderr: 100K 100% 1.74T=0.06s 2024-09-15T22:46:45.043 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:45.043 INFO:tasks.workunit.client.0.smithi066.stderr:2024-09-15 22:46:44 (1.64 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-15T22:46:45.043 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-15T22:46:45.043 INFO:tasks.workunit.client.0.smithi066.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/ 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/m4/ 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/man/ 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/man/blogbench.8 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/man/Makefile.am 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/man/Makefile.in 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/ 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-15T22:46:45.048 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/blogbench.c 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/blogbench.h 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/Makefile.am 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/Makefile.in 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/process.c 2024-09-15T22:46:45.049 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/globals.h 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/commenter.c 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/rewriter.c 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/reader.c 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/writer.c 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/src/helpers.c 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/NEWS 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/compile 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/depcomp 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/aclocal.m4 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/README 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/configure 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/configure.ac 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/config.guess 2024-09-15T22:46:45.050 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/install-sh 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/config.sub 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/missing 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/mkinstalldirs 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/Makefile.am 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/Makefile.in 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/config.h.in 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/AUTHORS 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/INSTALL 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/ChangeLog 2024-09-15T22:46:45.051 INFO:tasks.workunit.client.0.smithi066.stdout:blogbench-1.0/COPYING 2024-09-15T22:46:45.052 INFO:tasks.workunit.client.0.smithi066.stderr:+ cd blogbench-1.0/ 2024-09-15T22:46:45.052 INFO:tasks.workunit.client.0.smithi066.stdout:making blogbench 2024-09-15T22:46:45.052 INFO:tasks.workunit.client.0.smithi066.stderr:+ echo 'making blogbench' 2024-09-15T22:46:45.052 INFO:tasks.workunit.client.0.smithi066.stderr:+ ./configure 2024-09-15T22:46:45.053 INFO:tasks.workunit.client.0.smithi066.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T22:46:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:44 smithi087 ceph-mon[35290]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:44 smithi184 ceph-mon[35203]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:44 smithi066 ceph-mon[31185]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-15T22:46:46.006 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether build environment is sane... yes 2024-09-15T22:46:46.017 INFO:tasks.workunit.client.0.smithi066.stdout:checking for gawk... gawk 2024-09-15T22:46:46.035 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether make sets $(MAKE)... yes 2024-09-15T22:46:46.046 INFO:tasks.workunit.client.0.smithi066.stdout:checking for gcc... gcc 2024-09-15T22:46:46.101 INFO:tasks.workunit.client.0.smithi066.stdout:checking for C compiler default output file name... a.out 2024-09-15T22:46:46.103 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether the C compiler works... yes 2024-09-15T22:46:46.107 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether we are cross compiling... no 2024-09-15T22:46:46.147 INFO:tasks.workunit.client.0.smithi066.stdout:checking for suffix of executables... 2024-09-15T22:46:46.191 INFO:tasks.workunit.client.0.smithi066.stdout:checking for suffix of object files... o 2024-09-15T22:46:46.227 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether we are using the GNU C compiler... yes 2024-09-15T22:46:46.266 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether gcc accepts -g... yes 2024-09-15T22:46:46.335 INFO:tasks.workunit.client.0.smithi066.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-15T22:46:46.382 INFO:tasks.workunit.client.0.smithi066.stdout:checking for style of include used by make... GNU 2024-09-15T22:46:46.483 INFO:tasks.workunit.client.0.smithi066.stdout:checking dependency style of gcc... gcc3 2024-09-15T22:46:46.483 INFO:tasks.workunit.client.0.smithi066.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T22:46:46.531 INFO:tasks.workunit.client.0.smithi066.stdout:checking how to run the C preprocessor... gcc -E 2024-09-15T22:46:46.572 INFO:tasks.workunit.client.0.smithi066.stdout:checking for egrep... grep -E 2024-09-15T22:46:46.581 INFO:tasks.workunit.client.0.smithi066.stdout:checking for AIX... no 2024-09-15T22:46:46.646 INFO:tasks.workunit.client.0.smithi066.stdout:checking for library containing strerror... none required 2024-09-15T22:46:46.791 INFO:tasks.workunit.client.0.smithi066.stdout:checking for ANSI C header files... yes 2024-09-15T22:46:46.829 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-15T22:46:46.881 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/types.h... yes 2024-09-15T22:46:46.932 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/stat.h... yes 2024-09-15T22:46:46.980 INFO:tasks.workunit.client.0.smithi066.stdout:checking for stdlib.h... yes 2024-09-15T22:46:47.030 INFO:tasks.workunit.client.0.smithi066.stdout:checking for string.h... yes 2024-09-15T22:46:47.083 INFO:tasks.workunit.client.0.smithi066.stdout:checking for memory.h... yes 2024-09-15T22:46:47.151 INFO:tasks.workunit.client.0.smithi066.stdout:checking for strings.h... yes 2024-09-15T22:46:47.219 INFO:tasks.workunit.client.0.smithi066.stdout:checking for inttypes.h... yes 2024-09-15T22:46:47.269 INFO:tasks.workunit.client.0.smithi066.stdout:checking for stdint.h... yes 2024-09-15T22:46:47.322 INFO:tasks.workunit.client.0.smithi066.stdout:checking for unistd.h... yes 2024-09-15T22:46:47.333 INFO:tasks.workunit.client.0.smithi066.stdout:checking for memory.h... (cached) yes 2024-09-15T22:46:47.338 INFO:tasks.workunit.client.0.smithi066.stdout:checking for strings.h... (cached) yes 2024-09-15T22:46:47.343 INFO:tasks.workunit.client.0.smithi066.stdout:checking for unistd.h... (cached) yes 2024-09-15T22:46:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:46 smithi087 ceph-mon[35290]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:47.388 INFO:tasks.workunit.client.0.smithi066.stdout:checking locale.h usability... yes 2024-09-15T22:46:47.408 INFO:tasks.workunit.client.0.smithi066.stdout:checking locale.h presence... yes 2024-09-15T22:46:47.409 INFO:tasks.workunit.client.0.smithi066.stdout:checking for locale.h... yes 2024-09-15T22:46:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:46 smithi184 ceph-mon[35203]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:47.423 INFO:tasks.workunit.client.0.smithi066.stdout:checking for stdlib.h... (cached) yes 2024-09-15T22:46:47.428 INFO:tasks.workunit.client.0.smithi066.stdout:checking for string.h... (cached) yes 2024-09-15T22:46:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:46 smithi066 ceph-mon[31185]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-15T22:46:47.482 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/socket.h usability... yes 2024-09-15T22:46:47.504 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/socket.h presence... yes 2024-09-15T22:46:47.504 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/socket.h... yes 2024-09-15T22:46:47.559 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/time.h usability... yes 2024-09-15T22:46:47.580 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/time.h presence... yes 2024-09-15T22:46:47.580 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/time.h... yes 2024-09-15T22:46:47.639 INFO:tasks.workunit.client.0.smithi066.stdout:checking fcntl.h usability... yes 2024-09-15T22:46:47.662 INFO:tasks.workunit.client.0.smithi066.stdout:checking fcntl.h presence... yes 2024-09-15T22:46:47.662 INFO:tasks.workunit.client.0.smithi066.stdout:checking for fcntl.h... yes 2024-09-15T22:46:47.721 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/fcntl.h usability... yes 2024-09-15T22:46:47.741 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/fcntl.h presence... yes 2024-09-15T22:46:47.742 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/fcntl.h... yes 2024-09-15T22:46:47.819 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/param.h usability... yes 2024-09-15T22:46:47.842 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/param.h presence... yes 2024-09-15T22:46:47.842 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/param.h... yes 2024-09-15T22:46:47.894 INFO:tasks.workunit.client.0.smithi066.stdout:checking ioctl.h usability... no 2024-09-15T22:46:47.918 INFO:tasks.workunit.client.0.smithi066.stdout:checking ioctl.h presence... no 2024-09-15T22:46:47.919 INFO:tasks.workunit.client.0.smithi066.stdout:checking for ioctl.h... no 2024-09-15T22:46:47.970 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/ioctl.h usability... yes 2024-09-15T22:46:47.991 INFO:tasks.workunit.client.0.smithi066.stdout:checking sys/ioctl.h presence... yes 2024-09-15T22:46:47.991 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sys/ioctl.h... yes 2024-09-15T22:46:48.041 INFO:tasks.workunit.client.0.smithi066.stdout:checking return type of signal handlers... void 2024-09-15T22:46:48.084 INFO:tasks.workunit.client.0.smithi066.stdout:checking for size_t... yes 2024-09-15T22:46:48.123 INFO:tasks.workunit.client.0.smithi066.stdout:checking for dev_t... yes 2024-09-15T22:46:48.167 INFO:tasks.workunit.client.0.smithi066.stdout:checking for short... yes 2024-09-15T22:46:48.248 INFO:tasks.workunit.client.0.smithi066.stdout:checking size of short... 2 2024-09-15T22:46:48.293 INFO:tasks.workunit.client.0.smithi066.stdout:checking for int... yes 2024-09-15T22:46:48.361 INFO:tasks.workunit.client.0.smithi066.stdout:checking size of int... 4 2024-09-15T22:46:48.405 INFO:tasks.workunit.client.0.smithi066.stdout:checking for long... yes 2024-09-15T22:46:48.474 INFO:tasks.workunit.client.0.smithi066.stdout:checking size of long... 8 2024-09-15T22:46:48.518 INFO:tasks.workunit.client.0.smithi066.stdout:checking for long long... yes 2024-09-15T22:46:48.586 INFO:tasks.workunit.client.0.smithi066.stdout:checking size of long long... 8 2024-09-15T22:46:48.628 INFO:tasks.workunit.client.0.smithi066.stdout:checking for ssize_t... yes 2024-09-15T22:46:48.668 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sig_atomic_t... yes 2024-09-15T22:46:48.719 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether gcc needs -traditional... no 2024-09-15T22:46:48.754 INFO:tasks.workunit.client.0.smithi066.stdout:checking for an ANSI C-conforming const... yes 2024-09-15T22:46:48.777 INFO:tasks.workunit.client.0.smithi066.stdout:checking for inline... inline 2024-09-15T22:46:48.836 INFO:tasks.workunit.client.0.smithi066.stdout:checking for working alloca.h... yes 2024-09-15T22:46:48.883 INFO:tasks.workunit.client.0.smithi066.stdout:checking for alloca... yes 2024-09-15T22:46:48.953 INFO:tasks.workunit.client.0.smithi066.stdout:checking for working memcmp... yes 2024-09-15T22:46:49.010 INFO:tasks.workunit.client.0.smithi066.stdout:checking for strftime... yes 2024-09-15T22:46:49.086 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-15T22:46:49.146 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether stat accepts an empty string... no 2024-09-15T22:46:49.202 INFO:tasks.workunit.client.0.smithi066.stdout:checking for vprintf... yes 2024-09-15T22:46:49.259 INFO:tasks.workunit.client.0.smithi066.stdout:checking for _doprnt... no 2024-09-15T22:46:49.281 INFO:tasks.workunit.client.0.smithi066.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-15T22:46:49.293 INFO:tasks.workunit.client.0.smithi066.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-15T22:46:49.344 INFO:tasks.workunit.client.0.smithi066.stdout:checking for the pthreads library -lpthreads... no 2024-09-15T22:46:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:48 smithi087 ceph-mon[35290]: pgmap v46: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 87 KiB/s wr, 16 op/s 2024-09-15T22:46:49.398 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether pthreads work without any flags... yes 2024-09-15T22:46:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:48 smithi184 ceph-mon[35203]: pgmap v46: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 87 KiB/s wr, 16 op/s 2024-09-15T22:46:49.444 INFO:tasks.workunit.client.0.smithi066.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-15T22:46:49.444 INFO:tasks.workunit.client.0.smithi066.stdout:checking if more special flags are required for pthreads... no 2024-09-15T22:46:49.444 INFO:tasks.workunit.client.0.smithi066.stdout:checking for cc_r... gcc 2024-09-15T22:46:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:48 smithi066 ceph-mon[31185]: pgmap v46: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 87 KiB/s wr, 16 op/s 2024-09-15T22:46:49.517 INFO:tasks.workunit.client.0.smithi066.stdout:checking for setrlimit... yes 2024-09-15T22:46:49.579 INFO:tasks.workunit.client.0.smithi066.stdout:checking for setproctitle... no 2024-09-15T22:46:49.638 INFO:tasks.workunit.client.0.smithi066.stdout:checking for getopt_long... yes 2024-09-15T22:46:49.699 INFO:tasks.workunit.client.0.smithi066.stdout:checking for strtoull... yes 2024-09-15T22:46:49.760 INFO:tasks.workunit.client.0.smithi066.stdout:checking for strtoq... yes 2024-09-15T22:46:49.821 INFO:tasks.workunit.client.0.smithi066.stdout:checking for snprintf... yes 2024-09-15T22:46:49.884 INFO:tasks.workunit.client.0.smithi066.stdout:checking for vsnprintf... yes 2024-09-15T22:46:49.946 INFO:tasks.workunit.client.0.smithi066.stdout:checking for vfprintf... yes 2024-09-15T22:46:50.008 INFO:tasks.workunit.client.0.smithi066.stdout:checking for gethostname... yes 2024-09-15T22:46:50.069 INFO:tasks.workunit.client.0.smithi066.stdout:checking for setlocale... yes 2024-09-15T22:46:50.129 INFO:tasks.workunit.client.0.smithi066.stdout:checking for sync... yes 2024-09-15T22:46:50.234 INFO:tasks.workunit.client.0.smithi066.stdout:checking whether snprintf is C99 conformant... done 2024-09-15T22:46:50.265 INFO:tasks.workunit.client.0.smithi066.stdout:configure: creating ./config.status 2024-09-15T22:46:50.431 INFO:tasks.workunit.client.0.smithi066.stdout:config.status: creating Makefile 2024-09-15T22:46:50.447 INFO:tasks.workunit.client.0.smithi066.stdout:config.status: creating src/Makefile 2024-09-15T22:46:50.468 INFO:tasks.workunit.client.0.smithi066.stdout:config.status: creating man/Makefile 2024-09-15T22:46:50.479 INFO:tasks.workunit.client.0.smithi066.stdout:config.status: creating config.h 2024-09-15T22:46:50.530 INFO:tasks.workunit.client.0.smithi066.stdout:config.status: executing depfiles commands 2024-09-15T22:46:50.663 INFO:tasks.workunit.client.0.smithi066.stderr:+ make 2024-09-15T22:46:50.673 INFO:tasks.workunit.client.0.smithi066.stdout:make all-recursive 2024-09-15T22:46:50.675 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:46:50.678 INFO:tasks.workunit.client.0.smithi066.stdout:Making all in src 2024-09-15T22:46:50.682 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T22:46:50.682 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-15T22:46:50.683 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-15T22:46:50.782 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-15T22:46:50.782 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-15T22:46:50.873 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-15T22:46:50.873 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-15T22:46:51.021 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-15T22:46:51.021 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-15T22:46:51.116 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-15T22:46:51.116 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-15T22:46:51.198 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-15T22:46:51.199 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-15T22:46:51.278 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-15T22:46:51.278 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-15T22:46:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:50 smithi087 ceph-mon[35290]: pgmap v47: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:51.379 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-15T22:46:51.379 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-15T22:46:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:50 smithi184 ceph-mon[35203]: pgmap v47: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:51.443 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-15T22:46:51.444 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-15T22:46:51.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:50 smithi066 ceph-mon[31185]: pgmap v47: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:51.505 INFO:tasks.workunit.client.0.smithi066.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-15T22:46:51.505 INFO:tasks.workunit.client.0.smithi066.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-15T22:46:51.557 INFO:tasks.workunit.client.0.smithi066.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-15T22:46:51.577 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T22:46:51.577 INFO:tasks.workunit.client.0.smithi066.stdout:Making all in man 2024-09-15T22:46:51.581 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T22:46:51.581 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Nothing to be done for 'all'. 2024-09-15T22:46:51.581 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T22:46:51.582 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:46:51.583 INFO:tasks.workunit.client.0.smithi066.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:46:51.584 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T22:46:51.584 INFO:tasks.workunit.client.0.smithi066.stderr:+ cd src 2024-09-15T22:46:51.587 INFO:tasks.workunit.client.0.smithi066.stderr:+ mkdir blogtest_in 2024-09-15T22:46:51.589 INFO:tasks.workunit.client.0.smithi066.stdout:running blogbench 2024-09-15T22:46:51.590 INFO:tasks.workunit.client.0.smithi066.stderr:+ echo 'running blogbench' 2024-09-15T22:46:51.590 INFO:tasks.workunit.client.0.smithi066.stderr:+ ./blogbench -d blogtest_in 2024-09-15T22:46:51.590 INFO:tasks.workunit.client.0.smithi066.stdout: 2024-09-15T22:46:51.590 INFO:tasks.workunit.client.0.smithi066.stdout:Frequency = 10 secs 2024-09-15T22:46:51.590 INFO:tasks.workunit.client.0.smithi066.stdout:Scratch dir = [blogtest_in] 2024-09-15T22:46:52.901 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:46:53.186 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:53.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:52 smithi066 ceph-mon[31185]: pgmap v48: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:52 smithi087 ceph-mon[35290]: pgmap v48: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:52 smithi184 ceph-mon[35203]: pgmap v48: 129 pgs: 129 active+clean; 2.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 87 KiB/s wr, 12 op/s 2024-09-15T22:46:54.576 INFO:tasks.workunit.client.0.smithi066.stdout:Spawning 3 writers... 2024-09-15T22:46:54.577 INFO:tasks.workunit.client.0.smithi066.stdout:Spawning 1 rewriters... 2024-09-15T22:46:54.577 INFO:tasks.workunit.client.0.smithi066.stdout:Spawning 5 commenters... 2024-09-15T22:46:54.578 INFO:tasks.workunit.client.0.smithi066.stdout:Spawning 100 readers... 2024-09-15T22:46:54.581 INFO:tasks.workunit.client.0.smithi066.stdout:Benchmarking for 30 iterations. 2024-09-15T22:46:54.581 INFO:tasks.workunit.client.0.smithi066.stdout:The test will run during 5 minutes. 2024-09-15T22:46:54.581 INFO:tasks.workunit.client.0.smithi066.stdout: 2024-09-15T22:46:54.581 INFO:tasks.workunit.client.0.smithi066.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 -- 172.21.15.66:0/1164040241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230102ef0 msgr2=0x7f723010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 --2- 172.21.15.66:0/1164040241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230102ef0 0x7f723010da40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7220009ca0 tx=0x7f722002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 -- 172.21.15.66:0/1164040241 shutdown_connections 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 --2- 172.21.15.66:0/1164040241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230102ef0 0x7f723010da40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 --2- 172.21.15.66:0/1164040241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 0x7f72301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 --2- 172.21.15.66:0/1164040241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230100e20 0x7f7230101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 -- 172.21.15.66:0/1164040241 >> 172.21.15.66:0/1164040241 conn(0x7f72300fc7d0 msgr2=0x7f72300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 -- 172.21.15.66:0/1164040241 shutdown_connections 2024-09-15T22:46:54.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.970+0000 7f7237df6640 1 -- 172.21.15.66:0/1164040241 wait complete. 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 Processor -- start 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 -- start start 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 0x7f72301997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 0x7f72301a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7230110f80 con 0x7f7230100e20 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7230110e00 con 0x7f7230102570 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7237df6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7230111100 con 0x7f7230102ef0 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39948/0 (socket says 172.21.15.66:39948) 2024-09-15T22:46:54.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 -- 172.21.15.66:0/1654238047 learned_addr learned my addr 172.21.15.66:0/1654238047 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235391640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 0x7f72301997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7236393640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 0x7f72301a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 -- 172.21.15.66:0/1654238047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 msgr2=0x7f72301a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 0x7f72301a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 -- 172.21.15.66:0/1654238047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 msgr2=0x7f72301997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 0x7f72301997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7235b92640 1 -- 172.21.15.66:0/1654238047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72301a4870 con 0x7f7230100e20 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.971+0000 7f7236393640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 0x7f72301a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f7235b92640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f722800e9f0 tx=0x7f722800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f722effd640 1 -- 172.21.15.66:0/1654238047 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722800cd80 con 0x7f7230100e20 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72301a4a40 con 0x7f7230100e20 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f722effd640 1 -- 172.21.15.66:0/1654238047 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7228010910 con 0x7f7230100e20 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f722effd640 1 -- 172.21.15.66:0/1654238047 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280188f0 con 0x7f7230100e20 2024-09-15T22:46:54.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.972+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301a4f80 con 0x7f7230100e20 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f723a1cf740 1 Processor -- start 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f722effd640 1 -- 172.21.15.66:0/1654238047 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7228010ac0 con 0x7f7230100e20 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f723a1cf740 1 -- start start 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.975+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f723a1cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55779370d2e0 con 0x5577937bad20 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f723a1cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5577936b4ce0 con 0x5577937a7860 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f723a1cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5577937092a0 con 0x5577937a8a10 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7236393640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39962/0 (socket says 172.21.15.66:39962) 2024-09-15T22:46:54.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7236393640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51232/0 (socket says 172.21.15.66:51232) 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 -- 172.21.15.66:0/2991717689 learned_addr learned my addr 172.21.15.66:0/2991717689 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235b92640 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 -- 172.21.15.66:0/2991717689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 msgr2=0x5577937a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 -- 172.21.15.66:0/2991717689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 msgr2=0x5577937a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937a7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 -- 172.21.15.66:0/2991717689 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557793699440 con 0x5577937bad20 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f722effd640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 0x7f72180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7235391640 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f722400bc30 tx=0x7f72240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6f8542bf81ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7236393640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 0x7f72180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f722effd640 1 -- 172.21.15.66:0/1654238047 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f72280d04c0 con 0x7f7230100e20 2024-09-15T22:46:54.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.976+0000 7f7217fff640 1 -- 172.21.15.66:0/2991717689 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722401c480 con 0x5577937bad20 2024-09-15T22:46:54.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f7217fff640 1 -- 172.21.15.66:0/2991717689 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722401cb00 con 0x5577937bad20 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f7217fff640 1 -- 172.21.15.66:0/2991717689 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224011b50 con 0x5577937bad20 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 -- 172.21.15.66:0/2991717689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 msgr2=0x5577937bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f7236393640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 0x7f72180a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7220009430 tx=0x7f7220005d80 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f722400bc30 tx=0x7f72240107a0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 -- 172.21.15.66:0/2991717689 shutdown_connections 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937bd110 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937a7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 --2- 172.21.15.66:0/2991717689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 -- 172.21.15.66:0/2991717689 >> 172.21.15.66:0/2991717689 conn(0x5577937a3a30 msgr2=0x5577937a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 -- 172.21.15.66:0/2991717689 shutdown_connections 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.977+0000 7f723a1cf740 1 -- 172.21.15.66:0/2991717689 wait complete. 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 -- start start 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 Processor -- start 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5577937bda80 con 0x5577937bad20 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5577936c8050 con 0x5577937a7860 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5577937bdc00 con 0x5577937a8a10 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f723a1cf740 10 client.0 _ll_register_callbacks cb 0x557793708160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f7236393640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f7236393640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39976/0 (socket says 172.21.15.66:39976) 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.978+0000 7f7236393640 1 -- 172.21.15.66:0/1708162446 learned_addr learned my addr 172.21.15.66:0/1708162446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7235391640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7235b92640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 -- 172.21.15.66:0/1708162446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 msgr2=0x5577937aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 -- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 msgr2=0x5577937adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:54.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 -- 172.21.15.66:0/1708162446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779347e3c0 con 0x5577937bad20 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f7236393640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7220035000 tx=0x7f722002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d030c835282258 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f72157fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220034040 con 0x5577937bad20 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f7220052470 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722401cb00 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7220052670 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f723a1cf740 10 client.15858 fetch_fsmap learned FSMap version 29 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.979+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577937c9490 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722401cb00 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f7220049690 con 0x5577937bad20 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 10 client.15858 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 20 client.15858 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:54.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5577937ca950 0x5577937ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 4 client.15858 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55779371a850 con 0x5577937ca950 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f7235b92640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5577937ca950 0x5577937ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f7235b92640 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5577937ca950 0x5577937ccda0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4babbf86c45b2f server_cookie=27695854cca771a6 in_seq=0 out_seq=0 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.980+0000 7f72157fa640 10 client.15858 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f72157fa640 1 -- 172.21.15.66:0/1708162446 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55779371a850 con 0x5577937ca950 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f72157fa640 10 client.15858 handle_command_reply: tid=0 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 client.15858 shutdown 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 msgr2=0x5577937ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7220035000 tx=0x7f722002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 shutdown_connections 2024-09-15T22:46:54.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937bad20 0x5577937ab350 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a8a10 0x5577937aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5577937ca950 0x5577937ccda0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 --2- 172.21.15.66:0/1708162446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a7860 0x5577937adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f72157fa640 0 client.15858 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 >> 172.21.15.66:0/1708162446 conn(0x5577937a3a30 msgr2=0x5577937a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 shutdown_connections 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 1 -- 172.21.15.66:0/1708162446 wait complete. 2024-09-15T22:46:55.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.981+0000 7f723a1cf740 20 client.15858 trim_cache size 0 max 16384 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.999+0000 7f723a1cf740 1 Processor -- start 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:54.999+0000 7f723a1cf740 1 -- start start 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a7860 0x5577937c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 0x5577937acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72301acf80 con 0x5577937a8a10 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72301aeaf0 con 0x5577937bad20 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f723a1cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72301ad650 con 0x5577937a7860 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39986/0 (socket says 172.21.15.66:39986) 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 -- 172.21.15.66:0/3325199891 learned_addr learned my addr 172.21.15.66:0/3325199891 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235b92640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a7860 0x5577937c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7236393640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 0x5577937acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 -- 172.21.15.66:0/3325199891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a7860 msgr2=0x5577937c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a7860 0x5577937c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 -- 172.21.15.66:0/3325199891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 msgr2=0x5577937acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 0x5577937acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 -- 172.21.15.66:0/3325199891 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577937ae0d0 con 0x5577937a8a10 2024-09-15T22:46:55.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7236393640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 0x5577937acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:55.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.000+0000 7f7235391640 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f722400bc30 tx=0x7f7224011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8432a2641fbeb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.001+0000 7f72177fe640 1 -- 172.21.15.66:0/3325199891 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224011440 con 0x5577937a8a10 2024-09-15T22:46:55.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.001+0000 7f72177fe640 1 -- 172.21.15.66:0/3325199891 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722402c070 con 0x5577937a8a10 2024-09-15T22:46:55.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.001+0000 7f72177fe640 1 -- 172.21.15.66:0/3325199891 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72240116a0 con 0x5577937a8a10 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.001+0000 7f723a1cf740 1 -- 172.21.15.66:0/3325199891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 msgr2=0x5577937aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.001+0000 7f723a1cf740 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f722400bc30 tx=0x7f7224011630 comp rx=0 tx=0).stop 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 -- 172.21.15.66:0/3325199891 shutdown_connections 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937bad20 0x5577937acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a8a10 0x5577937aa330 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 --2- 172.21.15.66:0/3325199891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937a7860 0x5577937c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 -- 172.21.15.66:0/3325199891 >> 172.21.15.66:0/3325199891 conn(0x5577937a3a30 msgr2=0x5577937ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 -- 172.21.15.66:0/3325199891 shutdown_connections 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 -- 172.21.15.66:0/3325199891 wait complete. 2024-09-15T22:46:55.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 -- start start 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.002+0000 7f723a1cf740 1 Processor -- start 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a8a10 0x5577937b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937bad20 0x5577937b9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72301ae3f0 con 0x5577937a7860 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72301add20 con 0x5577937a8a10 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72301aaf60 con 0x5577937bad20 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f723a1cf740 10 client.0 _ll_register_callbacks cb 0x7f7220009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39988/0 (socket says 172.21.15.66:39988) 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 -- 172.21.15.66:0/957543959 learned_addr learned my addr 172.21.15.66:0/957543959 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7236393640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937bad20 0x5577937b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 -- 172.21.15.66:0/957543959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937bad20 msgr2=0x5577937b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937bad20 0x5577937b9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 -- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a8a10 msgr2=0x5577937b8e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a8a10 0x5577937b8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 -- 172.21.15.66:0/957543959 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557793834640 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f7235b92640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f722800c6a0 tx=0x7f72280d2a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891d41081abe3c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.003+0000 7f72157fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.005+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722809bfb0 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.005+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f7228098ae0 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722402c070 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f722809bdd0 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 10 client.15864 fetch_fsmap learned FSMap version 29 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577938358d0 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722402c070 con 0x5577937a7860 2024-09-15T22:46:55.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f72280d0120 con 0x5577937a7860 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 10 client.15864 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 20 client.15864 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557793836080 0x5577938384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 4 client.15864 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557793714d60 con 0x557793836080 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.006+0000 7f7235391640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557793836080 0x5577938384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f7235391640 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557793836080 0x5577938384e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b904536831f160ae server_cookie=c28b62880fb96b5b in_seq=0 out_seq=0 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f72157fa640 10 client.15864 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f72157fa640 1 -- 172.21.15.66:0/957543959 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557793714d60 con 0x557793836080 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f72157fa640 10 client.15864 handle_command_reply: tid=0 2024-09-15T22:46:55.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 client.15864 shutdown 2024-09-15T22:46:55.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 msgr2=0x5577937b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f722800c6a0 tx=0x7f72280d2a40 comp rx=0 tx=0).stop 2024-09-15T22:46:55.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 shutdown_connections 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5577937bad20 0x5577937b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557793836080 0x5577938384e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5577937a8a10 0x5577937b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 --2- 172.21.15.66:0/957543959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5577937a7860 0x5577937b8910 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f72157fa640 0 client.15864 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 >> 172.21.15.66:0/957543959 conn(0x5577937a3a30 msgr2=0x5577937ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 shutdown_connections 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.007+0000 7f723a1cf740 1 -- 172.21.15.66:0/957543959 wait complete. 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f723a1cf740 20 client.15864 trim_cache size 0 max 16384 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:46:55.014 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:46:55.015 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:46:55.015 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 msgr2=0x7f72180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 0x7f72180a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7220009430 tx=0x7f7220005d80 comp rx=0 tx=0).stop 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 msgr2=0x7f72301992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f722800e9f0 tx=0x7f722800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 shutdown_connections 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72180a33b0 0x7f72180a5870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7230102ef0 0x7f72301a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7230102570 0x7f72301997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 --2- 172.21.15.66:0/1654238047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7230100e20 0x7f72301992b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:55.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.008+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 >> 172.21.15.66:0/1654238047 conn(0x7f72300fc7d0 msgr2=0x7f7230106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:55.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.009+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 shutdown_connections 2024-09-15T22:46:55.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:55.009+0000 7f7237df6640 1 -- 172.21.15.66:0/1654238047 wait complete. 2024-09-15T22:46:55.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:55 smithi066 ceph-mon[31185]: pgmap v49: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 435 KiB/s wr, 64 op/s 2024-09-15T22:46:55.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:55 smithi066 ceph-mon[31185]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-15T22:46:55.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:55 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:46:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:55 smithi087 ceph-mon[35290]: pgmap v49: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 435 KiB/s wr, 64 op/s 2024-09-15T22:46:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:55 smithi087 ceph-mon[35290]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-15T22:46:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:55 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:46:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:55 smithi184 ceph-mon[35203]: pgmap v49: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 435 KiB/s wr, 64 op/s 2024-09-15T22:46:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:55 smithi184 ceph-mon[35203]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-15T22:46:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:55 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:46:55.686 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:46:55.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:46:55.969 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 -- 172.21.15.66:0/3938355744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 msgr2=0x7ff50410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 --2- 172.21.15.66:0/3938355744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50410da40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009ca0 tx=0x7ff4fc02a950 comp rx=0 tx=0).stop 2024-09-15T22:46:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 -- 172.21.15.66:0/3938355744 shutdown_connections 2024-09-15T22:46:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 --2- 172.21.15.66:0/3938355744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50410da40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 --2- 172.21.15.66:0/3938355744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 0x7ff5041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 --2- 172.21.15.66:0/3938355744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff504101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.453+0000 7ff50c593640 1 -- 172.21.15.66:0/3938355744 >> 172.21.15.66:0/3938355744 conn(0x7ff5040fc7d0 msgr2=0x7ff5040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- 172.21.15.66:0/3938355744 shutdown_connections 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- 172.21.15.66:0/3938355744 wait complete. 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 Processor -- start 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- start start 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 0x7ff50419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff504110f80 con 0x7ff504102ef0 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff504110e00 con 0x7ff504102570 2024-09-15T22:46:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.454+0000 7ff50c593640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff504111100 con 0x7ff504100e20 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50ab30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51280/0 (socket says 172.21.15.66:51280) 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50ab30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40016/0 (socket says 172.21.15.66:40016) 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 -- 172.21.15.66:0/3954287295 learned_addr learned my addr 172.21.15.66:0/3954287295 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff509b2e640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 0x7ff50419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 -- 172.21.15.66:0/3954287295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 msgr2=0x7ff50419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 0x7ff50419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 -- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 msgr2=0x7ff50419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 -- 172.21.15.66:0/3954287295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50419f610 con 0x7ff504100e20 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50ab30640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50a32f640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff50000e9f0 tx=0x7ff50000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000ccc0 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50419f900 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff50000ce60 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500010690 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.455+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5041a71e0 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.456+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff504101200 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.458+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff5000046c0 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.458+0000 7ff4fb7fe640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 0x7ff4f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.459+0000 7ff509b2e640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 0x7ff4f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.459+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff5000d0780 con 0x7ff504100e20 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.459+0000 7ff509b2e640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 0x7ff4f00a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff50410ddf0 tx=0x7ff4f400a2d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.462+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff50009cd30 con 0x7ff504100e20 2024-09-15T22:46:56.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.688+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff50419b9c0 con 0x7ff504100e20 2024-09-15T22:46:56.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.688+0000 7ff4fb7fe640 1 -- 172.21.15.66:0/3954287295 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7ff50419b9c0 con 0x7ff504100e20 2024-09-15T22:46:56.690 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:46:56.690 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":29,"btime":"2024-09-15T22:46:53:995751+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:46:53.939779+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:46:56.690 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 29 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 msgr2=0x7ff4f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 0x7ff4f00a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff50410ddf0 tx=0x7ff4f400a2d0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 msgr2=0x7ff50419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff50000e9f0 tx=0x7ff50000edf0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 shutdown_connections 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4f00a33b0 0x7ff4f00a5870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff504102ef0 0x7ff50419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff504102570 0x7ff50419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 --2- 172.21.15.66:0/3954287295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff504100e20 0x7ff50419a660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:56.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 >> 172.21.15.66:0/3954287295 conn(0x7ff5040fc7d0 msgr2=0x7ff50406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:56.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 shutdown_connections 2024-09-15T22:46:56.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:56.691+0000 7ff50c593640 1 -- 172.21.15.66:0/3954287295 wait complete. 2024-09-15T22:46:57.271 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:57 smithi066 ceph-mon[31185]: pgmap v50: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 435 KiB/s wr, 60 op/s 2024-09-15T22:46:57.271 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:57 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3954287295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:57.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:46:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:57 smithi087 ceph-mon[35290]: pgmap v50: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 435 KiB/s wr, 60 op/s 2024-09-15T22:46:57.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:57 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3954287295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:57 smithi184 ceph-mon[35203]: pgmap v50: 129 pgs: 129 active+clean; 5.4 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 435 KiB/s wr, 60 op/s 2024-09-15T22:46:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:57 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3954287295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:46:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:58.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 -- 172.21.15.66:0/877953397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580101420 msgr2=0x7f758010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 --2- 172.21.15.66:0/877953397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580101420 0x7f758010d950 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7578009cd0 tx=0x7f757802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 -- 172.21.15.66:0/877953397 shutdown_connections 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 --2- 172.21.15.66:0/877953397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580101420 0x7f758010d950 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 --2- 172.21.15.66:0/877953397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580100a80 0x7f7580100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 --2- 172.21.15.66:0/877953397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580106a80 0x7f7580106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 -- 172.21.15.66:0/877953397 >> 172.21.15.66:0/877953397 conn(0x7f75800fc7a0 msgr2=0x7f75800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 -- 172.21.15.66:0/877953397 shutdown_connections 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.072+0000 7f7585fef640 1 -- 172.21.15.66:0/877953397 wait complete. 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 Processor -- start 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 -- start start 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580101420 0x7f7580199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580106a80 0x7f75801a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7580110e80 con 0x7f7580100a80 2024-09-15T22:46:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7580110d00 con 0x7f7580101420 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.073+0000 7f7585fef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7580111000 con 0x7f7580106a80 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40034/0 (socket says 172.21.15.66:40034) 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 -- 172.21.15.66:0/2751313598 learned_addr learned my addr 172.21.15.66:0/2751313598 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757ffff640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580106a80 0x7f75801a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757effd640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580101420 0x7f7580199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 -- 172.21.15.66:0/2751313598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580106a80 msgr2=0x7f75801a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580106a80 0x7f75801a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 -- 172.21.15.66:0/2751313598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580101420 msgr2=0x7f7580199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580101420 0x7f7580199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 -- 172.21.15.66:0/2751313598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75801a4810 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.074+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f757000d950 tx=0x7f757000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.075+0000 7f757cff9640 1 -- 172.21.15.66:0/2751313598 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570017070 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.075+0000 7f757cff9640 1 -- 172.21.15.66:0/2751313598 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7570009c30 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.075+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75801a49e0 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.075+0000 7f757cff9640 1 -- 172.21.15.66:0/2751313598 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757000f6b0 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.075+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75801a4f20 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.077+0000 7f757cff9640 1 -- 172.21.15.66:0/2751313598 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f75700109d0 con 0x7f7580100a80 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.077+0000 7f75883c8740 1 Processor -- start 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 -- start start 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757cff9640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 0x7f75680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a897ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a8987370 0x5654a8989760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5654a88e22f0 con 0x5654a897c5d0 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5654a8889cf0 con 0x5654a8987370 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f75883c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5654a88de2b0 con 0x5654a897db40 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757ffff640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 0x7f75680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757cff9640 1 -- 172.21.15.66:0/2751313598 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f75700cfc40 con 0x7f7580100a80 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a897ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51304/0 (socket says 172.21.15.66:51304) 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 -- 172.21.15.66:0/993899621 learned_addr learned my addr 172.21.15.66:0/993899621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 -- 172.21.15.66:0/993899621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a8987370 msgr2=0x5654a8989760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a8987370 0x5654a8989760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 -- 172.21.15.66:0/993899621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 msgr2=0x5654a897ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a897ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 -- 172.21.15.66:0/993899621 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a886e3a0 con 0x5654a897db40 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757ffff640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 0x7f75680a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7578004ab0 tx=0x7f7578031430 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.078+0000 7f757f7fe640 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7570097fb0 tx=0x7f7570005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bc13be8478563f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f7565ffb640 1 -- 172.21.15.66:0/993899621 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570020040 con 0x5654a897db40 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f7565ffb640 1 -- 172.21.15.66:0/993899621 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7570084e50 con 0x5654a897db40 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f7565ffb640 1 -- 172.21.15.66:0/993899621 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75700981c0 con 0x5654a897db40 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 -- 172.21.15.66:0/993899621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 msgr2=0x5654a897c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7570097fb0 tx=0x7f7570005f90 comp rx=0 tx=0).stop 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 -- 172.21.15.66:0/993899621 shutdown_connections 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a8987370 0x5654a8989760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a897ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 --2- 172.21.15.66:0/993899621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a897db40 0x5654a897c090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.079+0000 7f75883c8740 1 -- 172.21.15.66:0/993899621 >> 172.21.15.66:0/993899621 conn(0x5654a8945310 msgr2=0x5654a8978c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- 172.21.15.66:0/993899621 shutdown_connections 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- 172.21.15.66:0/993899621 wait complete. 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- start start 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 Processor -- start 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8986d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a89845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5654a898a070 con 0x5654a897db40 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5654a889d060 con 0x5654a897c5d0 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5654a898a1f0 con 0x5654a8987370 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f75883c8740 10 client.0 _ll_register_callbacks cb 0x5654a85f08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.080+0000 7f757effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40046/0 (socket says 172.21.15.66:40046) 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 -- 172.21.15.66:0/3911844364 learned_addr learned my addr 172.21.15.66:0/3911844364 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757ffff640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a89845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757f7fe640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8986d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 -- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 msgr2=0x5654a89845d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a89845d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 -- 172.21.15.66:0/3911844364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 msgr2=0x5654a8986d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8986d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 -- 172.21.15.66:0/3911844364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a86533c0 con 0x5654a897db40 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757f7fe640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8986d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f757effd640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f757400bf30 tx=0x7f7574012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81035c3b032d29ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f755effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757401f060 con 0x5654a897db40 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7570084e50 con 0x5654a897db40 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f75740108a0 con 0x5654a897db40 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7574026050 con 0x5654a897db40 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f75883c8740 10 client.15882 fetch_fsmap learned FSMap version 29 2024-09-15T22:46:58.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.081+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5654a8995bd0 con 0x5654a897db40 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7570084e50 con 0x5654a897db40 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f7574019030 con 0x5654a897db40 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 10 client.15882 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 10 client.15882 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 20 client.15882 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8997030 0x5654a8999470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 4 client.15882 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654a88ef860 con 0x5654a8997030 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f757f7fe640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8997030 0x5654a8999470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f757f7fe640 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8997030 0x5654a8999470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1173d004ceed0400 server_cookie=6348b188e5ddd90a in_seq=0 out_seq=0 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.082+0000 7f755effd640 10 client.15882 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.083+0000 7f755effd640 1 -- 172.21.15.66:0/3911844364 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654a88ef860 con 0x5654a8997030 2024-09-15T22:46:58.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.083+0000 7f755effd640 10 client.15882 handle_command_reply: tid=0 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.083+0000 7f75883c8740 1 client.15882 shutdown 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.083+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 msgr2=0x5654a8984000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.083+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f757400bf30 tx=0x7f7574012820 comp rx=0 tx=0).stop 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 shutdown_connections 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8997030 0x5654a8999470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a89845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f755effd640 0 client.15882 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a8984000 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 --2- 172.21.15.66:0/3911844364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8986d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 >> 172.21.15.66:0/3911844364 conn(0x5654a8945310 msgr2=0x5654a897e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 shutdown_connections 2024-09-15T22:46:58.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 1 -- 172.21.15.66:0/3911844364 wait complete. 2024-09-15T22:46:58.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.084+0000 7f75883c8740 20 client.15882 trim_cache size 0 max 16384 2024-09-15T22:46:58.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 Processor -- start 2024-09-15T22:46:58.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 -- start start 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8993340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a897f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75801af1b0 con 0x5654a897db40 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75801b0d20 con 0x5654a897c5d0 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f75883c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75801af880 con 0x5654a8987370 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40062/0 (socket says 172.21.15.66:40062) 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757effd640 1 -- 172.21.15.66:0/3720528772 learned_addr learned my addr 172.21.15.66:0/3720528772 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757ffff640 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a897f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757f7fe640 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8993340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757effd640 1 -- 172.21.15.66:0/3720528772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 msgr2=0x5654a897f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.098+0000 7f757effd640 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a897f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f757effd640 1 -- 172.21.15.66:0/3720528772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 msgr2=0x5654a8993340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f757effd640 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8993340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f757effd640 1 -- 172.21.15.66:0/3720528772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a8986970 con 0x5654a897db40 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f757effd640 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f757401af40 tx=0x7f757400ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e3eea6f905c9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f75657fa640 1 -- 172.21.15.66:0/3720528772 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574005230 con 0x5654a897db40 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f75657fa640 1 -- 172.21.15.66:0/3720528772 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757402f070 con 0x5654a897db40 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.099+0000 7f75657fa640 1 -- 172.21.15.66:0/3720528772 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740048e0 con 0x5654a897db40 2024-09-15T22:46:58.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- 172.21.15.66:0/3720528772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 msgr2=0x5654a897f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f757401af40 tx=0x7f757400ba30 comp rx=0 tx=0).stop 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- 172.21.15.66:0/3720528772 shutdown_connections 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a897f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897db40 0x5654a897f120 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 --2- 172.21.15.66:0/3720528772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897c5d0 0x5654a8993340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- 172.21.15.66:0/3720528772 >> 172.21.15.66:0/3720528772 conn(0x5654a8945310 msgr2=0x5654a89830f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- 172.21.15.66:0/3720528772 shutdown_connections 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- 172.21.15.66:0/3720528772 wait complete. 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 -- start start 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.100+0000 7f75883c8740 1 Processor -- start 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 0x5654a898fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a898c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75801b0620 con 0x5654a897c5d0 2024-09-15T22:46:58.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75801aff50 con 0x5654a897db40 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75801ad190 con 0x5654a8987370 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f75883c8740 10 client.0 _ll_register_callbacks cb 0x7f757400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40064/0 (socket says 172.21.15.66:40064) 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 -- 172.21.15.66:0/2510132409 learned_addr learned my addr 172.21.15.66:0/2510132409 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757ffff640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a898c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757effd640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 0x5654a898fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 -- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 msgr2=0x5654a898c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a898c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 -- 172.21.15.66:0/2510132409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 msgr2=0x5654a898fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 0x5654a898fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 -- 172.21.15.66:0/2510132409 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a898d0b0 con 0x5654a897c5d0 2024-09-15T22:46:58.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757effd640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 0x5654a898fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f757f7fe640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f757009bae0 tx=0x7f7570005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f131957a1b40a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f755effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570020040 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.101+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f75700981c0 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f757402f070 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7570009de0 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 10 client.15888 fetch_fsmap learned FSMap version 29 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5654a89fb290 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f757402f070 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7f75700860b0 con 0x5654a897c5d0 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 10 client.15888 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 10 client.15888 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 20 client.15888 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:58.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8a06180 0x5654a8a08570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 4 client.15888 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654a88e9d70 con 0x5654a8a06180 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.102+0000 7f757effd640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8a06180 0x5654a8a08570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f757effd640 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8a06180 0x5654a8a08570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d93beeae7679b942 server_cookie=5549dff8f4f8870f in_seq=0 out_seq=0 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f755effd640 10 client.15888 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f755effd640 1 -- 172.21.15.66:0/2510132409 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654a88e9d70 con 0x5654a8a06180 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f755effd640 10 client.15888 handle_command_reply: tid=0 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 client.15888 shutdown 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 msgr2=0x5654a898f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f757009bae0 tx=0x7f7570005880 comp rx=0 tx=0).stop 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 shutdown_connections 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5654a8a06180 0x5654a8a08570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654a8987370 0x5654a898c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5654a897db40 0x5654a898fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 --2- 172.21.15.66:0/2510132409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654a897c5d0 0x5654a898f6a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f755effd640 0 client.15888 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 >> 172.21.15.66:0/2510132409 conn(0x5654a8945310 msgr2=0x5654a8985860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 shutdown_connections 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 1 -- 172.21.15.66:0/2510132409 wait complete. 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.103+0000 7f75883c8740 20 client.15888 trim_cache size 0 max 16384 2024-09-15T22:46:58.114 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 msgr2=0x7f75680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 0x7f75680a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7578004ab0 tx=0x7f7578031430 comp rx=0 tx=0).stop 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 msgr2=0x7f7580199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f757000d950 tx=0x7f757000de10 comp rx=0 tx=0).stop 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 shutdown_connections 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75680a3430 0x7f75680a58f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7580106a80 0x7f75801a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580101420 0x7f7580199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 --2- 172.21.15.66:0/2751313598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7580100a80 0x7f7580199250 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:58.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 >> 172.21.15.66:0/2751313598 conn(0x7f75800fc7a0 msgr2=0x7f75800fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:58.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 shutdown_connections 2024-09-15T22:46:58.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:58.104+0000 7f7585fef640 1 -- 172.21.15.66:0/2751313598 wait complete. 2024-09-15T22:46:58.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:46:59.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:46:59 smithi066 ceph-mon[31185]: pgmap v51: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 959 KiB/s wr, 77 op/s 2024-09-15T22:46:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:46:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:46:59 smithi087 ceph-mon[35290]: pgmap v51: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 959 KiB/s wr, 77 op/s 2024-09-15T22:46:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:46:59 smithi184 ceph-mon[35203]: pgmap v51: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 959 KiB/s wr, 77 op/s 2024-09-15T22:46:59.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.728+0000 7f5060297640 1 -- 172.21.15.66:0/2742179449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102ef0 msgr2=0x7f505810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.728+0000 7f5060297640 1 --2- 172.21.15.66:0/2742179449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102ef0 0x7f505810da40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5050009ca0 tx=0x7f505002a950 comp rx=0 tx=0).stop 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 -- 172.21.15.66:0/2742179449 shutdown_connections 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 --2- 172.21.15.66:0/2742179449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102ef0 0x7f505810da40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 --2- 172.21.15.66:0/2742179449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058102570 0x7f50581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 --2- 172.21.15.66:0/2742179449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058100e20 0x7f5058101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 -- 172.21.15.66:0/2742179449 >> 172.21.15.66:0/2742179449 conn(0x7f50580fc7d0 msgr2=0x7f50580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 -- 172.21.15.66:0/2742179449 shutdown_connections 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 -- 172.21.15.66:0/2742179449 wait complete. 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 Processor -- start 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.729+0000 7f5060297640 1 -- start start 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058100e20 0x7f505819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058102ef0 0x7f505819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5058110f80 con 0x7f5058102570 2024-09-15T22:46:59.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5058110e00 con 0x7f5058100e20 2024-09-15T22:46:59.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f5060297640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5058111100 con 0x7f5058102ef0 2024-09-15T22:46:59.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40072/0 (socket says 172.21.15.66:40072) 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 -- 172.21.15.66:0/3890011420 learned_addr learned my addr 172.21.15.66:0/3890011420 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505e834640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058102ef0 0x7f505819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505e033640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058100e20 0x7f505819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 -- 172.21.15.66:0/3890011420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058102ef0 msgr2=0x7f505819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058102ef0 0x7f505819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 -- 172.21.15.66:0/3890011420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058100e20 msgr2=0x7f505819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058100e20 0x7f505819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 -- 172.21.15.66:0/3890011420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505819f630 con 0x7f5058102570 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f505d832640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f504800d950 tx=0x7f504800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.730+0000 7f504f7fe640 1 -- 172.21.15.66:0/3890011420 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048017070 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.731+0000 7f504f7fe640 1 -- 172.21.15.66:0/3890011420 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5048009c30 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.731+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505819f920 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.731+0000 7f504f7fe640 1 -- 172.21.15.66:0/3890011420 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504800f6b0 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.731+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50581a7200 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 Processor -- start 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f504f7fe640 1 -- 172.21.15.66:0/3890011420 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f50480109d0 con 0x7f5058102570 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 -- start start 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55926d6552f0 con 0x55926d6f0b40 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55926d5fccf0 con 0x55926d6fa370 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f5062670740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55926d6512b0 con 0x55926d6ef5d0 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f505e834640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f505e834640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40084/0 (socket says 172.21.15.66:40084) 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f505e834640 1 -- 172.21.15.66:0/2832420482 learned_addr learned my addr 172.21.15.66:0/2832420482 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f505d832640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.734+0000 7f505e033640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 -- 172.21.15.66:0/2832420482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 msgr2=0x55926d6efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 -- 172.21.15.66:0/2832420482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 msgr2=0x55926d6fc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6fc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 -- 172.21.15.66:0/2832420482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55926d5e13a0 con 0x55926d6f0b40 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e033640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505d832640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f504f7fe640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 0x7f50440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e834640 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5050035000 tx=0x7f5050005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb3805c2495f69a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f505e033640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 0x7f50440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f504f7fe640 1 -- 172.21.15.66:0/3890011420 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f50480cfc30 con 0x7f5058102570 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f504cdea640 1 -- 172.21.15.66:0/2832420482 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050048070 con 0x55926d6f0b40 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f504cdea640 1 -- 172.21.15.66:0/2832420482 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505002f930 con 0x55926d6f0b40 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.735+0000 7f504cdea640 1 -- 172.21.15.66:0/2832420482 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050034040 con 0x55926d6f0b40 2024-09-15T22:46:59.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 -- 172.21.15.66:0/2832420482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 msgr2=0x55926d6ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f505e033640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 0x7f50440a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55926d6ecac0 tx=0x7f5054005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5050035000 tx=0x7f5050005fa0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 -- 172.21.15.66:0/2832420482 shutdown_connections 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 --2- 172.21.15.66:0/2832420482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6ef090 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 -- 172.21.15.66:0/2832420482 >> 172.21.15.66:0/2832420482 conn(0x55926d6b8310 msgr2=0x55926d6ebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 -- 172.21.15.66:0/2832420482 shutdown_connections 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.736+0000 7f5062670740 1 -- 172.21.15.66:0/2832420482 wait complete. 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 -- start start 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 Processor -- start 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55926d6fd010 con 0x55926d6f0b40 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55926d610060 con 0x55926d6fa370 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55926d6fd190 con 0x55926d6ef5d0 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f5062670740 10 client.0 _ll_register_callbacks cb 0x55926d3638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40092/0 (socket says 172.21.15.66:40092) 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505e033640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 -- 172.21.15.66:0/1201176680 learned_addr learned my addr 172.21.15.66:0/1201176680 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505e834640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 -- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 msgr2=0x55926d6f9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6f9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 -- 172.21.15.66:0/1201176680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 msgr2=0x55926d6f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.737+0000 7f505d832640 1 -- 172.21.15.66:0/1201176680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55926d3c63c0 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f505d832640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f504809bb80 tx=0x7f5048010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445a5824fd39b668 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048020070 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f50480a4320 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f505002f930 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f504809b730 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5062670740 10 client.15900 fetch_fsmap learned FSMap version 30 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55926d708b10 con 0x55926d6f0b40 2024-09-15T22:46:59.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505002f930 con 0x55926d6f0b40 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.738+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f50480860b0 con 0x55926d6f0b40 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 10 client.15900 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 10 client.15900 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 20 client.15900 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d709f20 0x55926d70c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 4 client.15900 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55926d662860 con 0x55926d709f20 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f505e033640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d709f20 0x55926d70c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f505e033640 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d709f20 0x55926d70c330 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c5524562234c8f38 server_cookie=22beba05a4533d07 in_seq=0 out_seq=0 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.739+0000 7f5041ffb640 10 client.15900 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5041ffb640 1 -- 172.21.15.66:0/1201176680 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55926d662860 con 0x55926d709f20 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5041ffb640 10 client.15900 handle_command_reply: tid=0 2024-09-15T22:46:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 client.15900 shutdown 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 msgr2=0x55926d6f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f504809bb80 tx=0x7f5048010d70 comp rx=0 tx=0).stop 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 shutdown_connections 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d709f20 0x55926d70c330 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6f0b40 0x55926d6f7020 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 --2- 172.21.15.66:0/1201176680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d6f9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 >> 172.21.15.66:0/1201176680 conn(0x55926d6b8310 msgr2=0x55926d6f1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.740+0000 7f5041ffb640 0 client.15900 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.741+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 shutdown_connections 2024-09-15T22:46:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.741+0000 7f5062670740 1 -- 172.21.15.66:0/1201176680 wait complete. 2024-09-15T22:46:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.741+0000 7f5062670740 20 client.15900 trim_cache size 0 max 16384 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.754+0000 7f5062670740 1 Processor -- start 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.754+0000 7f5062670740 1 -- start start 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6f0b40 0x55926d6f2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f50581b12c0 con 0x55926d6ef5d0 2024-09-15T22:46:59.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50581b2ec0 con 0x55926d6fa370 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5062670740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f50581b1990 con 0x55926d6f0b40 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40102/0 (socket says 172.21.15.66:40102) 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 -- 172.21.15.66:0/1703705471 learned_addr learned my addr 172.21.15.66:0/1703705471 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e834640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505d832640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6f0b40 0x55926d6f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 -- 172.21.15.66:0/1703705471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6f0b40 msgr2=0x55926d6f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6f0b40 0x55926d6f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 -- 172.21.15.66:0/1703705471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 msgr2=0x55926d6f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 -- 172.21.15.66:0/1703705471 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55926d6efbe0 con 0x55926d6ef5d0 2024-09-15T22:46:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e834640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f505e033640 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5054009710 tx=0x7f505401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323fd08b2e2a2005 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.755+0000 7f5043fff640 1 -- 172.21.15.66:0/1703705471 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505401dae0 con 0x55926d6ef5d0 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5043fff640 1 -- 172.21.15.66:0/1703705471 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505401dc80 con 0x55926d6ef5d0 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5043fff640 1 -- 172.21.15.66:0/1703705471 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505400f620 con 0x55926d6ef5d0 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 -- 172.21.15.66:0/1703705471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 msgr2=0x55926d7062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5054009710 tx=0x7f505401b000 comp rx=0 tx=0).stop 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 -- 172.21.15.66:0/1703705471 shutdown_connections 2024-09-15T22:46:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6fa370 0x55926d6f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6f0b40 0x55926d6f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 --2- 172.21.15.66:0/1703705471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6ef5d0 0x55926d7062b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 -- 172.21.15.66:0/1703705471 >> 172.21.15.66:0/1703705471 conn(0x55926d6b8310 msgr2=0x55926d6f6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 -- 172.21.15.66:0/1703705471 shutdown_connections 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.756+0000 7f5062670740 1 -- 172.21.15.66:0/1703705471 wait complete. 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 -- start start 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 Processor -- start 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d702cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6f0b40 0x55926d6fdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f50581b2730 con 0x55926d6fa370 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50581b2060 con 0x55926d6f0b40 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f50581af2a0 con 0x55926d6ef5d0 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f5062670740 10 client.0 _ll_register_callbacks cb 0x7f50480d3470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40104/0 (socket says 172.21.15.66:40104) 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 -- 172.21.15.66:0/3047919088 learned_addr learned my addr 172.21.15.66:0/3047919088 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e033640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d702cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505d832640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6f0b40 0x55926d6fdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 -- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 msgr2=0x55926d702cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d702cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.757+0000 7f505e834640 1 -- 172.21.15.66:0/3047919088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6f0b40 msgr2=0x55926d6fdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f505e834640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6f0b40 0x55926d6fdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f505e834640 1 -- 172.21.15.66:0/3047919088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55926d6fee20 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f505e834640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5050005e30 tx=0x7f505002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ed0188ec4e4f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050048040 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5050003970 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f505401dc80 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f505005b050 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5062670740 10 client.15906 fetch_fsmap learned FSMap version 30 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55926d774d00 con 0x55926d6fa370 2024-09-15T22:46:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505401dc80 con 0x55926d6fa370 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f5050056030 con 0x55926d6fa370 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.758+0000 7f5062670740 10 client.15906 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 10 client.15906 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 20 client.15906 populate_metadata read hostname 'smithi066' 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d775090 0x55926d777480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 4 client.15906 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55926d65cd70 con 0x55926d775090 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f505e033640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d775090 0x55926d777480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f505e033640 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d775090 0x55926d777480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=57bacbdcf2526578 server_cookie=9d8e749bf0dbf640 in_seq=0 out_seq=0 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5041ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5041ffb640 1 -- 172.21.15.66:0/3047919088 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55926d65cd70 con 0x55926d775090 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5041ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-15T22:46:59.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 1 client.15906 shutdown 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 msgr2=0x55926d6fe5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.759+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5050005e30 tx=0x7f505002fd40 comp rx=0 tx=0).stop 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 shutdown_connections 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55926d775090 0x55926d777480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55926d6fa370 0x55926d6fe5f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55926d6f0b40 0x55926d6fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 --2- 172.21.15.66:0/3047919088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55926d6ef5d0 0x55926d702cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 >> 172.21.15.66:0/3047919088 conn(0x55926d6b8310 msgr2=0x55926d6f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5041ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 shutdown_connections 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 1 -- 172.21.15.66:0/3047919088 wait complete. 2024-09-15T22:46:59.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5062670740 20 client.15906 trim_cache size 0 max 16384 2024-09-15T22:46:59.775 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 msgr2=0x7f50440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 0x7f50440a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55926d6ecac0 tx=0x7f5054005f90 comp rx=0 tx=0).stop 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 msgr2=0x7f505819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.760+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f504800d950 tx=0x7f504800de10 comp rx=0 tx=0).stop 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 shutdown_connections 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50440a3430 0x7f50440a58f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5058102ef0 0x7f505819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5058102570 0x7f505819abc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 --2- 172.21.15.66:0/3890011420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058100e20 0x7f505819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:46:59.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 >> 172.21.15.66:0/3890011420 conn(0x7f50580fc7d0 msgr2=0x7f5058069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:46:59.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 shutdown_connections 2024-09-15T22:46:59.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:46:59.761+0000 7f5060297640 1 -- 172.21.15.66:0/3890011420 wait complete. 2024-09-15T22:47:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:00 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:00.386 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:00 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:00.410 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:47:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:00 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:00.673 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:01.061 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:01 smithi066 ceph-mon[31185]: pgmap v52: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 -- 172.21.15.66:0/2923913960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 msgr2=0x7f83e8110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 --2- 172.21.15.66:0/2923913960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e8110c00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009ca0 tx=0x7f83e002a8b0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 -- 172.21.15.66:0/2923913960 shutdown_connections 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 --2- 172.21.15.66:0/2923913960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e8110c00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 --2- 172.21.15.66:0/2923913960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e8102fc0 0x7f83e81005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 --2- 172.21.15.66:0/2923913960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 -- 172.21.15.66:0/2923913960 >> 172.21.15.66:0/2923913960 conn(0x7f83e8077210 msgr2=0x7f83e80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 -- 172.21.15.66:0/2923913960 shutdown_connections 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.144+0000 7f83efcf6640 1 -- 172.21.15.66:0/2923913960 wait complete. 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 Processor -- start 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 -- start start 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e819eea0 0x7f83e819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81141d0 con 0x7f83e810e810 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8114050 con 0x7f83e819eea0 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83efcf6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8114350 con 0x7f83e8102b50 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83ed291640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83ed291640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40130/0 (socket says 172.21.15.66:40130) 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83eda92640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83ed291640 1 -- 172.21.15.66:0/1180127158 learned_addr learned my addr 172.21.15.66:0/1180127158 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.145+0000 7f83ee293640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e819eea0 0x7f83e819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 -- 172.21.15.66:0/1180127158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 msgr2=0x7f83e819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 -- 172.21.15.66:0/1180127158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e819eea0 msgr2=0x7f83e819f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e819eea0 0x7f83e819f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 -- 172.21.15.66:0/1180127158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e819f960 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83eda92640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83ed291640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f83d800d950 tx=0x7f83d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83deffd640 1 -- 172.21.15.66:0/1180127158 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8017070 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83deffd640 1 -- 172.21.15.66:0/1180127158 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83d8009c30 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e819fc50 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83deffd640 1 -- 172.21.15.66:0/1180127158 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d80047a0 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.146+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e81a7430 con 0x7f83e810e810 2024-09-15T22:47:01.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.148+0000 7f83deffd640 1 -- 172.21.15.66:0/1180127158 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f83d8004020 con 0x7f83e810e810 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 Processor -- start 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 -- start start 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bc6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bd3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562757b2c2f0 con 0x562757bc65d0 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562757ad3cf0 con 0x562757bc7b40 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83f20cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562757b282b0 con 0x562757bd1370 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40144/0 (socket says 172.21.15.66:40144) 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83eda92640 1 -- 172.21.15.66:0/3509159674 learned_addr learned my addr 172.21.15.66:0/3509159674 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83ed291640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bd3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.149+0000 7f83ee293640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bc6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 -- 172.21.15.66:0/3509159674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 msgr2=0x562757bd3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bd3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 -- 172.21.15.66:0/3509159674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 msgr2=0x562757bc6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bc6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 -- 172.21.15.66:0/3509159674 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562757ab83a0 con 0x562757bc65d0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83ee293640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bc6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83deffd640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 0x7f83d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83eda92640 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f83e40115c0 tx=0x7f83e4011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee0a73782847d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83ee293640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 0x7f83d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83d3fff640 1 -- 172.21.15.66:0/3509159674 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e400f640 con 0x562757bc65d0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83deffd640 1 -- 172.21.15.66:0/1180127158 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f83d80cfcb0 con 0x7f83e810e810 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83d3fff640 1 -- 172.21.15.66:0/3509159674 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e400fcc0 con 0x562757bc65d0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.150+0000 7f83d3fff640 1 -- 172.21.15.66:0/3509159674 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4019d40 con 0x562757bc65d0 2024-09-15T22:47:01.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- 172.21.15.66:0/3509159674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 msgr2=0x562757bc6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83ee293640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 0x7f83d40a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009430 tx=0x7f83e00093c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f83e40115c0 tx=0x7f83e4011a80 comp rx=0 tx=0).stop 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- 172.21.15.66:0/3509159674 shutdown_connections 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bd3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bc6a10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3509159674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bc6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- 172.21.15.66:0/3509159674 >> 172.21.15.66:0/3509159674 conn(0x562757b8f310 msgr2=0x562757bc2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- 172.21.15.66:0/3509159674 shutdown_connections 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- 172.21.15.66:0/3509159674 wait complete. 2024-09-15T22:47:01.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 -- start start 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.151+0000 7f83f20cf740 1 Processor -- start 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bcdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562757bd4070 con 0x562757bc65d0 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562757ae7060 con 0x562757bc7b40 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562757bd41f0 con 0x562757bd1370 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83f20cf740 10 client.0 _ll_register_callbacks cb 0x56275783a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:01.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40152/0 (socket says 172.21.15.66:40152) 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83eda92640 1 -- 172.21.15.66:0/180746130 learned_addr learned my addr 172.21.15.66:0/180746130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bcdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ee293640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 -- 172.21.15.66:0/180746130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 msgr2=0x562757bce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 -- 172.21.15.66:0/180746130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 msgr2=0x562757bd0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 -- 172.21.15.66:0/180746130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56275789d3c0 con 0x562757bc7b40 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83eda92640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:01.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83ed291640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bcdff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83d80cd030 tx=0x7f83d8005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f146cdc5f9c796dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.152+0000 7f83d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d809b990 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f83d8098230 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e400fcc0 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f83d809b520 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 10 client.25490 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562757bdfb40 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e400fcc0 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f83d80a43a0 con 0x562757bc7b40 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 10 client.25490 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 10 client.25490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 20 client.25490 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757be1000 0x562757be3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 4 client.25490 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562757b39860 con 0x562757be1000 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.153+0000 7f83eda92640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757be1000 0x562757be3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.154+0000 7f83d17fa640 10 client.25490 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.154+0000 7f83eda92640 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757be1000 0x562757be3430 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=419ad37eb0fc27f5 server_cookie=15d6b313adb357d6 in_seq=0 out_seq=0 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.154+0000 7f83d17fa640 1 -- 172.21.15.66:0/180746130 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562757b39860 con 0x562757be1000 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.154+0000 7f83d17fa640 10 client.25490 handle_command_reply: tid=0 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.154+0000 7f83f20cf740 1 client.25490 shutdown 2024-09-15T22:47:01.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 msgr2=0x562757bcdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bcdff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83d80cd030 tx=0x7f83d8005bd0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 shutdown_connections 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757be1000 0x562757be3430 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bd1370 0x562757bce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc7b40 0x562757bcdff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83d17fa640 0 client.25490 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 --2- 172.21.15.66:0/180746130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bd0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 >> 172.21.15.66:0/180746130 conn(0x562757b8f310 msgr2=0x562757bc8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 shutdown_connections 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 1 -- 172.21.15.66:0/180746130 wait complete. 2024-09-15T22:47:01.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.155+0000 7f83f20cf740 20 client.25490 trim_cache size 0 max 16384 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.168+0000 7f83f20cf740 1 Processor -- start 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.168+0000 7f83f20cf740 1 -- start start 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 0x562757bcff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bc9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81b1300 con 0x562757bd1370 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81b2f30 con 0x562757bc65d0 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83f20cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81b19d0 con 0x562757bc7b40 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40166/0 (socket says 172.21.15.66:40166) 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 -- 172.21.15.66:0/3909007727 learned_addr learned my addr 172.21.15.66:0/3909007727 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ed291640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bc9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83eda92640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 0x562757bcff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 -- 172.21.15.66:0/3909007727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 msgr2=0x562757bc9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bc9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 -- 172.21.15.66:0/3909007727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 msgr2=0x562757bcff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 0x562757bcff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 -- 172.21.15.66:0/3909007727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562757bc3960 con 0x562757bd1370 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ed291640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bc9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83eda92640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 0x562757bcff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.169+0000 7f83ee293640 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f83e00308a0 tx=0x7f83e0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500b9e6d156eeb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83d37fe640 1 -- 172.21.15.66:0/3909007727 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0030c70 con 0x562757bd1370 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83d37fe640 1 -- 172.21.15.66:0/3909007727 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e0036050 con 0x562757bd1370 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83d37fe640 1 -- 172.21.15.66:0/3909007727 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0004780 con 0x562757bd1370 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 -- 172.21.15.66:0/3909007727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 msgr2=0x562757bc9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f83e00308a0 tx=0x7f83e0041000 comp rx=0 tx=0).stop 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 -- 172.21.15.66:0/3909007727 shutdown_connections 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bd1370 0x562757bc9660 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bc9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3909007727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bc65d0 0x562757bcff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 -- 172.21.15.66:0/3909007727 >> 172.21.15.66:0/3909007727 conn(0x562757b8f310 msgr2=0x562757bcf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 -- 172.21.15.66:0/3909007727 shutdown_connections 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.170+0000 7f83f20cf740 1 -- 172.21.15.66:0/3909007727 wait complete. 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 -- start start 2024-09-15T22:47:01.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 Processor -- start 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bcb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bd1370 0x562757bcbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81b27a0 con 0x562757bc65d0 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81b20a0 con 0x562757bd1370 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81af2e0 con 0x562757bc7b40 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83f20cf740 10 client.0 _ll_register_callbacks cb 0x7f83d80d34f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:01.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83eda92640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40180/0 (socket says 172.21.15.66:40180) 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83eda92640 1 -- 172.21.15.66:0/3747583177 learned_addr learned my addr 172.21.15.66:0/3747583177 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.171+0000 7f83ed291640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bcb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83ee293640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bd1370 0x562757bcbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 -- 172.21.15.66:0/3747583177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 msgr2=0x562757bcb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bcb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 -- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bd1370 msgr2=0x562757bcbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bd1370 0x562757bcbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 -- 172.21.15.66:0/3747583177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562757c4ad00 con 0x562757bc65d0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83ed291640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bcb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83eda92640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83e4019910 tx=0x7f83e400f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928948329ba317f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4019df0 con 0x562757bc65d0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f83e40050b0 con 0x562757bc65d0 2024-09-15T22:47:01.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e0036050 con 0x562757bc65d0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f83e40052b0 con 0x562757bc65d0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83f20cf740 10 client.15924 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.172+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562757c4bfc0 con 0x562757bc65d0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e0036050 con 0x562757bc65d0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f83e40035f0 con 0x562757bc65d0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 10 client.15924 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 10 client.15924 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 20 client.15924 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757c4c4f0 0x562757c4e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 4 client.15924 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562757b33d70 con 0x562757c4c4f0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83ed291640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757c4c4f0 0x562757c4e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83ed291640 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757c4c4f0 0x562757c4e8e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b9c6d1bc70ea522 server_cookie=c7776f1b46644be5 in_seq=0 out_seq=0 2024-09-15T22:47:01.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.173+0000 7f83d17fa640 10 client.15924 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83d17fa640 1 -- 172.21.15.66:0/3747583177 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562757b33d70 con 0x562757c4c4f0 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83d17fa640 10 client.15924 handle_command_reply: tid=0 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 client.15924 shutdown 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 msgr2=0x562757bcb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83e4019910 tx=0x7f83e400f450 comp rx=0 tx=0).stop 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 shutdown_connections 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562757c4c4f0 0x562757c4e8e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562757bd1370 0x562757bcbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562757bc7b40 0x562757bcb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 --2- 172.21.15.66:0/3747583177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562757bc65d0 0x562757bcb070 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83d17fa640 0 client.15924 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 >> 172.21.15.66:0/3747583177 conn(0x562757b8f310 msgr2=0x562757bd0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 shutdown_connections 2024-09-15T22:47:01.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 1 -- 172.21.15.66:0/3747583177 wait complete. 2024-09-15T22:47:01.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83f20cf740 20 client.15924 trim_cache size 0 max 16384 2024-09-15T22:47:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:01.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 msgr2=0x7f83d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.174+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 0x7f83d40a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009430 tx=0x7f83e00093c0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 msgr2=0x7f83e819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f83d800d950 tx=0x7f83d800de10 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 shutdown_connections 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f83d40a33b0 0x7f83d40a5870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e819eea0 0x7f83e819f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e810e810 0x7f83e819ab10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 --2- 172.21.15.66:0/1180127158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e8102b50 0x7f83e819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 >> 172.21.15.66:0/1180127158 conn(0x7f83e8077210 msgr2=0x7f83e810fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:01.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 shutdown_connections 2024-09-15T22:47:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:01.175+0000 7f83efcf6640 1 -- 172.21.15.66:0/1180127158 wait complete. 2024-09-15T22:47:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:01 smithi087 ceph-mon[35290]: pgmap v52: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:01 smithi184 ceph-mon[35203]: pgmap v52: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:02.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:47:02.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:02 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:02 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:02.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:02 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:02.553 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:03.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.062+0000 7f5753216640 1 -- 172.21.15.66:0/2208778731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c102ef0 msgr2=0x7f574c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.062+0000 7f5753216640 1 --2- 172.21.15.66:0/2208778731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c102ef0 0x7f574c10da40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5744009ca0 tx=0x7f574402a950 comp rx=0 tx=0).stop 2024-09-15T22:47:03.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.062+0000 7f5753216640 1 -- 172.21.15.66:0/2208778731 shutdown_connections 2024-09-15T22:47:03.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 --2- 172.21.15.66:0/2208778731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c102ef0 0x7f574c10da40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 --2- 172.21.15.66:0/2208778731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 --2- 172.21.15.66:0/2208778731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c100e20 0x7f574c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 -- 172.21.15.66:0/2208778731 >> 172.21.15.66:0/2208778731 conn(0x7f574c0fc7d0 msgr2=0x7f574c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 -- 172.21.15.66:0/2208778731 shutdown_connections 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.063+0000 7f5753216640 1 -- 172.21.15.66:0/2208778731 wait complete. 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.064+0000 7f5753216640 1 Processor -- start 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.064+0000 7f5753216640 1 -- start start 2024-09-15T22:47:03.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.064+0000 7f5753216640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5753216640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c10a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37380/0 (socket says 172.21.15.66:37380) 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5750fb2640 1 -- 172.21.15.66:0/3018405041 learned_addr learned my addr 172.21.15.66:0/3018405041 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c102ef0 0x7f574c1a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f574c110fd0 con 0x7f574c100e20 2024-09-15T22:47:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f574c110e50 con 0x7f574c102570 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f574c111150 con 0x7f574c102ef0 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f574bfff640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c10a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f57517b3640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c102ef0 0x7f574c1a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.065+0000 7f574bfff640 1 -- 172.21.15.66:0/3018405041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c102ef0 msgr2=0x7f574c1a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f574bfff640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c102ef0 0x7f574c1a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f574bfff640 1 -- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 msgr2=0x7f574c10a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f574bfff640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f574bfff640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c1a6940 con 0x7f574c102570 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f5750fb2640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f574bfff640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c10a5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f574000e9f0 tx=0x7f574000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.066+0000 7f5749ffb640 1 -- 172.21.15.66:0/3018405041 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000ccc0 con 0x7f574c102570 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.067+0000 7f5749ffb640 1 -- 172.21.15.66:0/3018405041 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5740005020 con 0x7f574c102570 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.067+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c1a6c30 con 0x7f574c102570 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.067+0000 7f5749ffb640 1 -- 172.21.15.66:0/3018405041 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57400049e0 con 0x7f574c102570 2024-09-15T22:47:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.067+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c1a7110 con 0x7f574c102570 2024-09-15T22:47:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.070+0000 7f5749ffb640 1 -- 172.21.15.66:0/3018405041 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5740004cc0 con 0x7f574c102570 2024-09-15T22:47:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.070+0000 7f57555ef740 1 Processor -- start 2024-09-15T22:47:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.070+0000 7f57555ef740 1 -- start start 2024-09-15T22:47:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fdc5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdd2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56148fd2b2f0 con 0x56148fdd0370 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56148fcd2cf0 con 0x56148fdc6b40 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57555ef740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56148fd272b0 con 0x56148fdc55d0 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57517b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57517b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53202/0 (socket says 172.21.15.66:53202) 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f57517b3640 1 -- 172.21.15.66:0/3298273389 learned_addr learned my addr 172.21.15.66:0/3298273389 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:03.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.071+0000 7f5749ffb640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 0x7f57340a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f574bfff640 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdd2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f5749ffb640 1 -- 172.21.15.66:0/3018405041 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57400cff60 con 0x7f574c102570 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 0x7f57340a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 -- 172.21.15.66:0/3298273389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 msgr2=0x56148fdc5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fdc5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 -- 172.21.15.66:0/3298273389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 msgr2=0x56148fdd2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdd2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.072+0000 7f57517b3640 1 -- 172.21.15.66:0/3298273389 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148fcb73a0 con 0x56148fdc6b40 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.073+0000 7f574bfff640 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdd2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.074+0000 7f57517b3640 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574402ae70 tx=0x7f57440039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2bccaee2688140 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.074+0000 7f57517b3640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 0x7f57340a59c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5744048000 tx=0x7f574404a000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.074+0000 7f5732ffd640 1 -- 172.21.15.66:0/3298273389 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744043050 con 0x56148fdc6b40 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.074+0000 7f5732ffd640 1 -- 172.21.15.66:0/3298273389 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f574404d070 con 0x56148fdc6b40 2024-09-15T22:47:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.074+0000 7f5732ffd640 1 -- 172.21.15.66:0/3298273389 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744034040 con 0x56148fdc6b40 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.075+0000 7f57555ef740 1 -- 172.21.15.66:0/3298273389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 msgr2=0x56148fdc5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.075+0000 7f57555ef740 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574402ae70 tx=0x7f57440039f0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 -- 172.21.15.66:0/3298273389 shutdown_connections 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdd2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fdc5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 --2- 172.21.15.66:0/3298273389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdc5090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 -- 172.21.15.66:0/3298273389 >> 172.21.15.66:0/3298273389 conn(0x56148fd8e310 msgr2=0x56148fdc1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 -- 172.21.15.66:0/3298273389 shutdown_connections 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.076+0000 7f57555ef740 1 -- 172.21.15.66:0/3298273389 wait complete. 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.077+0000 7f57555ef740 1 -- start start 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.077+0000 7f57555ef740 1 Processor -- start 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 0x56148fdcfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 0x56148fdcd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56148fdd3010 con 0x56148fdc6b40 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56148fce6060 con 0x56148fdc55d0 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56148fdd3190 con 0x56148fdd0370 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f57555ef740 10 client.0 _ll_register_callbacks cb 0x56148fa398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.078+0000 7f574bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f57517b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 0x56148fdcd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f57517b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 0x56148fdcd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49782/0 (socket says 172.21.15.66:49782) 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37404/0 (socket says 172.21.15.66:37404) 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 0x56148fdcfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f57517b3640 1 -- 172.21.15.66:0/1054413486 learned_addr learned my addr 172.21.15.66:0/1054413486 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 -- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 msgr2=0x56148fdcd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 0x56148fdcd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 -- 172.21.15.66:0/1054413486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 msgr2=0x56148fdcfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 0x56148fdcfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f574bfff640 1 -- 172.21.15.66:0/1054413486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148fa9c3c0 con 0x56148fdc6b40 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.079+0000 7f5750fb2640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 0x56148fdcfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.080+0000 7f574bfff640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f57400cd2e0 tx=0x7f574001ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c488eac7dfbb4e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.080+0000 7f572bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.080+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57400051d0 con 0x56148fdc6b40 2024-09-15T22:47:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.080+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57400d20d0 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.080+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f574404d070 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f574009be70 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 10 client.15936 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56148fde72b0 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f574404d070 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f5740013bd0 con 0x56148fdc6b40 2024-09-15T22:47:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 10 client.15936 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 10 client.15936 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:47:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 20 client.15936 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.081+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fdeabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.082+0000 7f57555ef740 4 client.15936 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.082+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56148fd38860 con 0x56148fde8770 2024-09-15T22:47:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.083+0000 7f5750fb2640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fdeabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.083+0000 7f572bfff640 10 client.15936 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.083+0000 7f5750fb2640 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fdeabd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf0d14fd0b88ed01 server_cookie=70c1cd244400b5f5 in_seq=0 out_seq=0 2024-09-15T22:47:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.087+0000 7f572bfff640 1 -- 172.21.15.66:0/1054413486 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56148fd38860 con 0x56148fde8770 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.087+0000 7f572bfff640 10 client.15936 handle_command_reply: tid=0 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.087+0000 7f57555ef740 1 client.15936 shutdown 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.087+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 msgr2=0x56148fdccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.087+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f57400cd2e0 tx=0x7f574001ceb0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 shutdown_connections 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fdeabd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdd0370 0x56148fdcd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f572bfff640 0 client.15936 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fdccfe0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 --2- 172.21.15.66:0/1054413486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc55d0 0x56148fdcfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 >> 172.21.15.66:0/1054413486 conn(0x56148fd8e310 msgr2=0x56148fdc7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 shutdown_connections 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 1 -- 172.21.15.66:0/1054413486 wait complete. 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.088+0000 7f57555ef740 20 client.15936 trim_cache size 0 max 16384 2024-09-15T22:47:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.119+0000 7f57555ef740 1 Processor -- start 2024-09-15T22:47:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.119+0000 7f57555ef740 1 -- start start 2024-09-15T22:47:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdf04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdf09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49788/0 (socket says 172.21.15.66:49788) 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 -- 172.21.15.66:0/2801623315 learned_addr learned my addr 172.21.15.66:0/2801623315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1acf50 con 0x56148fdd0370 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1aeb80 con 0x56148fdc6b40 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1ad620 con 0x56148fdc55d0 2024-09-15T22:47:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f57517b3640 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdf09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 -- 172.21.15.66:0/2801623315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 msgr2=0x56148fdf04a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:47:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdf04a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 -- 172.21.15.66:0/2801623315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 msgr2=0x56148fdf09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.120+0000 7f5750fb2640 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdf09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f5750fb2640 1 -- 172.21.15.66:0/2801623315 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56148fdc8120 con 0x56148fdc55d0 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f57517b3640 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdf09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f5750fb2640 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56148fdc2ac0 tx=0x7f573c0139d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2012d2da67572536 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f57327fc640 1 -- 172.21.15.66:0/2801623315 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c023070 con 0x56148fdc55d0 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f57327fc640 1 -- 172.21.15.66:0/2801623315 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573c0047a0 con 0x56148fdc55d0 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.121+0000 7f57327fc640 1 -- 172.21.15.66:0/2801623315 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c01f7a0 con 0x56148fdc55d0 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 msgr2=0x56148fde4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56148fdc2ac0 tx=0x7f573c0139d0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 shutdown_connections 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdd0370 0x56148fdf09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdc6b40 0x56148fdf04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 --2- 172.21.15.66:0/2801623315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fde4b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 >> 172.21.15.66:0/2801623315 conn(0x56148fd8e310 msgr2=0x56148fdc8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 shutdown_connections 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.122+0000 7f57555ef740 1 -- 172.21.15.66:0/2801623315 wait complete. 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.123+0000 7f57555ef740 1 -- start start 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.123+0000 7f57555ef740 1 Processor -- start 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fddd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fddd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 0x56148fe52470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1ae3f0 con 0x56148fdc6b40 2024-09-15T22:47:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1adcf0 con 0x56148fdd0370 2024-09-15T22:47:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1aaf70 con 0x56148fdc55d0 2024-09-15T22:47:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57555ef740 10 client.0 _ll_register_callbacks cb 0x7f57400053d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fddd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f5750fb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fddd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49800/0 (socket says 172.21.15.66:49800) 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f5750fb2640 1 -- 172.21.15.66:0/3242715153 learned_addr learned my addr 172.21.15.66:0/3242715153 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.124+0000 7f57517b3640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 0x56148fe52470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f574bfff640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fddd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 -- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 msgr2=0x56148fddd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fddd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 -- 172.21.15.66:0/3242715153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 msgr2=0x56148fddd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fddd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 -- 172.21.15.66:0/3242715153 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56148fe52ab0 con 0x56148fdd0370 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f574bfff640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fddd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57517b3640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 0x56148fe52470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5744004840 tx=0x7f574402a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48989d8014b75810 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f572bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744004450 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f573c0047a0 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5744049470 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5744043070 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.125+0000 7f57555ef740 10 client.25511 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56148fe53dc0 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f574404d040 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f5744030560 con 0x56148fdd0370 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 10 client.25511 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 10 client.25511 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:47:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 20 client.25511 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:03.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fe56060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:03.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 4 client.25511 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:03.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f573c0047a0 con 0x56148fde8770 2024-09-15T22:47:03.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.126+0000 7f5750fb2640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fe56060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:03.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.127+0000 7f572bfff640 10 client.25511 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.127+0000 7f5750fb2640 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fe56060 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=426b0ee97b9516b9 server_cookie=26314142bea28f32 in_seq=0 out_seq=0 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.129+0000 7f572bfff640 1 -- 172.21.15.66:0/3242715153 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f573c0047a0 con 0x56148fde8770 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.129+0000 7f572bfff640 10 client.25511 handle_command_reply: tid=0 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.129+0000 7f57555ef740 1 client.25511 shutdown 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 msgr2=0x56148fe52470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 0x56148fe52470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5744004840 tx=0x7f574402a950 comp rx=0 tx=0).stop 2024-09-15T22:47:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 shutdown_connections 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x56148fde8770 0x56148fe56060 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56148fdd0370 0x56148fe52470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56148fdc6b40 0x56148fddd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f572bfff640 0 client.25511 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 --2- 172.21.15.66:0/3242715153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56148fdc55d0 0x56148fddd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 >> 172.21.15.66:0/3242715153 conn(0x56148fd8e310 msgr2=0x56148fdce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 shutdown_connections 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 1 -- 172.21.15.66:0/3242715153 wait complete. 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.130+0000 7f57555ef740 20 client.25511 trim_cache size 0 max 16384 2024-09-15T22:47:03.136 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 msgr2=0x7f57340a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 0x7f57340a59c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5744048000 tx=0x7f574404a000 comp rx=0 tx=0).stop 2024-09-15T22:47:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 msgr2=0x7f574c10a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c10a5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f574000e9f0 tx=0x7f574000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 shutdown_connections 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57340a3500 0x7f57340a59c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f574c102ef0 0x7f574c1a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f574c102570 0x7f574c10a5e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 --2- 172.21.15.66:0/3018405041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f574c100e20 0x7f574c10a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 >> 172.21.15.66:0/3018405041 conn(0x7f574c0fc7d0 msgr2=0x7f574c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 shutdown_connections 2024-09-15T22:47:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:03.131+0000 7f5753216640 1 -- 172.21.15.66:0/3018405041 wait complete. 2024-09-15T22:47:03.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:03 smithi087 ceph-mon[35290]: pgmap v53: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:03 smithi184 ceph-mon[35203]: pgmap v53: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:03 smithi066 ceph-mon[31185]: pgmap v53: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 873 KiB/s wr, 69 op/s 2024-09-15T22:47:03.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:47:04.107 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:04.581 INFO:tasks.workunit.client.0.smithi066.stdout: 10 248116 863 140432 644 55826 1082 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 -- 172.21.15.66:0/1760547614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 msgr2=0x7f9e7c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 --2- 172.21.15.66:0/1760547614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c1029b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009900 tx=0x7f9e7002a480 comp rx=0 tx=0).stop 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 -- 172.21.15.66:0/1760547614 shutdown_connections 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 --2- 172.21.15.66:0/1760547614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 --2- 172.21.15.66:0/1760547614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c1029b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 --2- 172.21.15.66:0/1760547614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c100e20 0x7f9e7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 -- 172.21.15.66:0/1760547614 >> 172.21.15.66:0/1760547614 conn(0x7f9e7c0fc7d0 msgr2=0x7f9e7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 -- 172.21.15.66:0/1760547614 shutdown_connections 2024-09-15T22:47:04.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.609+0000 7f9e82599640 1 -- 172.21.15.66:0/1760547614 wait complete. 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 Processor -- start 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 -- start start 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 0x7f9e7c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1120a0 con 0x7f9e7c102570 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c111f20 con 0x7f9e7c100e20 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e82599640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c112220 con 0x7f9e7c102ef0 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37440/0 (socket says 172.21.15.66:37440) 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 0x7f9e7c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/1250984519 learned_addr learned my addr 172.21.15.66:0/1250984519 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.610+0000 7f9e80b36640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/1250984519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 msgr2=0x7f9e7c10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/1250984519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 msgr2=0x7f9e7c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 0x7f9e7c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/1250984519 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c1a6a50 con 0x7f9e7c102570 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 0x7f9e7c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:04.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e80b36640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006010 tx=0x7f9e70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e797fa640 1 -- 172.21.15.66:0/1250984519 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7003f070 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c1a6ce0 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e797fa640 1 -- 172.21.15.66:0/1250984519 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70031c30 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e797fa640 1 -- 172.21.15.66:0/1250984519 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70035030 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.611+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c1a71c0 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.613+0000 7f9e797fa640 1 -- 172.21.15.66:0/1250984519 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9e70042070 con 0x7f9e7c102570 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 Processor -- start 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 -- start start 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2954090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2954a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2961760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ad28ba2f0 con 0x562ad295f370 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562ad2861cf0 con 0x562ad2955b40 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e84972740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ad28b62b0 con 0x562ad29545d0 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2961760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e80b36640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2954090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e80b36640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2954090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53258/0 (socket says 172.21.15.66:53258) 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2954a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e80b36640 1 -- 172.21.15.66:0/3646114042 learned_addr learned my addr 172.21.15.66:0/3646114042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.614+0000 7f9e797fa640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 0x7f9e640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/3646114042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 msgr2=0x562ad2954a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2954a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/3646114042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 msgr2=0x562ad2954090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2954090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/3646114042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad28463a0 con 0x562ad295f370 2024-09-15T22:47:04.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2954a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e80b36640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 0x7f9e640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e797fa640 1 -- 172.21.15.66:0/1250984519 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9e700f0750 con 0x7f9e7c102570 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2961760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9e700edad0 tx=0x7f9e7004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e420507c7be56b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e627fc640 1 -- 172.21.15.66:0/3646114042 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70049e80 con 0x562ad295f370 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e80b36640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 0x7f9e640a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009fd0 tx=0x7f9e74004a40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e627fc640 1 -- 172.21.15.66:0/3646114042 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70031de0 con 0x562ad295f370 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.615+0000 7f9e627fc640 1 -- 172.21.15.66:0/3646114042 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700c0a10 con 0x562ad295f370 2024-09-15T22:47:04.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 -- 172.21.15.66:0/3646114042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 msgr2=0x562ad2961760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2961760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9e700edad0 tx=0x7f9e7004b000 comp rx=0 tx=0).stop 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 -- 172.21.15.66:0/3646114042 shutdown_connections 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2961760 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2954a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 --2- 172.21.15.66:0/3646114042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2954090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 -- 172.21.15.66:0/3646114042 >> 172.21.15.66:0/3646114042 conn(0x562ad291d310 msgr2=0x562ad2950c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 -- 172.21.15.66:0/3646114042 shutdown_connections 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.616+0000 7f9e84972740 1 -- 172.21.15.66:0/3646114042 wait complete. 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 -- start start 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 Processor -- start 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad295c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad295f370 0x562ad295c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562ad2961e30 con 0x562ad2955b40 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562ad2875060 con 0x562ad295f370 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ad2961fb0 con 0x562ad29545d0 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e84972740 10 client.0 _ll_register_callbacks cb 0x562ad25c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad295c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad295c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37448/0 (socket says 172.21.15.66:37448) 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/3098440152 learned_addr learned my addr 172.21.15.66:0/3098440152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.617+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49840/0 (socket says 172.21.15.66:49840) 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e80b36640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad295f370 0x562ad295c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 -- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad295f370 msgr2=0x562ad295c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad295f370 0x562ad295c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 -- 172.21.15.66:0/3098440152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 msgr2=0x562ad295c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad295c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 -- 172.21.15.66:0/3098440152 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad262b3c0 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c012cf0 tx=0x7f9e6c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=969243975ee07649 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00fe60 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e70031de0 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9e6c012110 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9e6c004050 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e84972740 10 client.25492 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.618+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562ad296d870 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70031de0 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f9e6c010430 con 0x562ad29545d0 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 10 client.25492 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:04.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 20 client.25492 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad2971160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 4 client.25492 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad28c7860 con 0x562ad296ed20 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.619+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad2971160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad2971160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3adaba7cf41ac6 server_cookie=3427f96a88305115 in_seq=0 out_seq=0 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e5b7fe640 10 client.25492 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/3098440152 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ad28c7860 con 0x562ad296ed20 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e5b7fe640 10 client.25492 handle_command_reply: tid=0 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 client.25492 shutdown 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 msgr2=0x562ad295ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c012cf0 tx=0x7f9e6c00f790 comp rx=0 tx=0).stop 2024-09-15T22:47:04.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 shutdown_connections 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad2971160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad295f370 0x562ad295c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad295c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e5b7fe640 0 client.25492 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.620+0000 7f9e84972740 1 --2- 172.21.15.66:0/3098440152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad295ed70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.621+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 >> 172.21.15.66:0/3098440152 conn(0x562ad291d310 msgr2=0x562ad2956990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.621+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 shutdown_connections 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.621+0000 7f9e84972740 1 -- 172.21.15.66:0/3098440152 wait complete. 2024-09-15T22:47:04.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.621+0000 7f9e84972740 20 client.25492 trim_cache size 0 max 16384 2024-09-15T22:47:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 Processor -- start 2024-09-15T22:47:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 -- start start 2024-09-15T22:47:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 0x562ad2955300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad295f370 0x562ad2957120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1b12f0 con 0x562ad2955b40 2024-09-15T22:47:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1b2f20 con 0x562ad29545d0 2024-09-15T22:47:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e84972740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1b19c0 con 0x562ad295f370 2024-09-15T22:47:04.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37462/0 (socket says 172.21.15.66:37462) 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/42751889 learned_addr learned my addr 172.21.15.66:0/42751889 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.635+0000 7f9e80b36640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad295f370 0x562ad2957120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 0x562ad2955300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/42751889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad295f370 msgr2=0x562ad2957120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad295f370 0x562ad2957120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/42751889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 msgr2=0x562ad2955300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 0x562ad2955300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 -- 172.21.15.66:0/42751889 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad2951950 con 0x562ad2955b40 2024-09-15T22:47:04.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 0x562ad2955300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9e700b90e0 tx=0x7f9e7003b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf95ec3d1acbdb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e61ffb640 1 -- 172.21.15.66:0/42751889 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70031de0 con 0x562ad2955b40 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e61ffb640 1 -- 172.21.15.66:0/42751889 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e700c0a10 con 0x562ad2955b40 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.636+0000 7f9e61ffb640 1 -- 172.21.15.66:0/42751889 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700edee0 con 0x562ad2955b40 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 -- 172.21.15.66:0/42751889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 msgr2=0x562ad296afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9e700b90e0 tx=0x7f9e7003b790 comp rx=0 tx=0).stop 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 -- 172.21.15.66:0/42751889 shutdown_connections 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad295f370 0x562ad2957120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad2955b40 0x562ad296afe0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 --2- 172.21.15.66:0/42751889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad29545d0 0x562ad2955300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 -- 172.21.15.66:0/42751889 >> 172.21.15.66:0/42751889 conn(0x562ad291d310 msgr2=0x562ad294ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 -- 172.21.15.66:0/42751889 shutdown_connections 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.637+0000 7f9e84972740 1 -- 172.21.15.66:0/42751889 wait complete. 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 -- start start 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 Processor -- start 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2967840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2958870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1b2790 con 0x562ad295f370 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1b2090 con 0x562ad2955b40 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c1af2d0 con 0x562ad29545d0 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e84972740 10 client.0 _ll_register_callbacks cb 0x7f9e6c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:04.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e80b36640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2958870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2967840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49860/0 (socket says 172.21.15.66:49860) 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.638+0000 7f9e7bfff640 1 -- 172.21.15.66:0/2756975569 learned_addr learned my addr 172.21.15.66:0/2756975569 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 -- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 msgr2=0x562ad2967840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2967840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 -- 172.21.15.66:0/2756975569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 msgr2=0x562ad2958870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2958870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 -- 172.21.15.66:0/2756975569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad29590a0 con 0x562ad29545d0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2967840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e7bfff640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c010820 tx=0x7f9e6c0106e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da70de12e6475b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c02d070 con 0x562ad29545d0 2024-09-15T22:47:04.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e700c0a10 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9e6c005270 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9e6c039050 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e84972740 10 client.25498 fetch_fsmap learned FSMap version 31 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.639+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562ad29d9450 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e700c0a10 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f9e6c029450 con 0x562ad29545d0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 10 client.25498 fetch_fsmap finished waiting for FSMap version 31 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 10 client.25498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 20 client.25498 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad29dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 4 client.25498 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ad28c1d70 con 0x562ad296ed20 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad29dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:04.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e5b7fe640 10 client.25498 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.640+0000 7f9e7b7fe640 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad29dbd00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b70a4b512dae7f4 server_cookie=d4b7f8bea17acd40 in_seq=0 out_seq=0 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e5b7fe640 1 -- 172.21.15.66:0/2756975569 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ad28c1d70 con 0x562ad296ed20 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e5b7fe640 10 client.25498 handle_command_reply: tid=0 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 client.25498 shutdown 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 msgr2=0x562ad2967300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c010820 tx=0x7f9e6c0106e0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 shutdown_connections 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562ad295f370 0x562ad2958870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562ad296ed20 0x562ad29dbd00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562ad2955b40 0x562ad2967840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e5b7fe640 0 client.25498 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 --2- 172.21.15.66:0/2756975569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ad29545d0 0x562ad2967300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 >> 172.21.15.66:0/2756975569 conn(0x562ad291d310 msgr2=0x562ad294f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 shutdown_connections 2024-09-15T22:47:04.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 1 -- 172.21.15.66:0/2756975569 wait complete. 2024-09-15T22:47:04.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.641+0000 7f9e84972740 20 client.25498 trim_cache size 0 max 16384 2024-09-15T22:47:04.656 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:04.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 msgr2=0x7f9e640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 0x7f9e640a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009fd0 tx=0x7f9e74004a40 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 msgr2=0x7f9e7c10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e70006010 tx=0x7f9e70003c10 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 shutdown_connections 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9e640a33b0 0x7f9e640a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e7c102ef0 0x7f9e7c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102570 0x7f9e7c10ea10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 --2- 172.21.15.66:0/1250984519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e7c100e20 0x7f9e7c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 >> 172.21.15.66:0/1250984519 conn(0x7f9e7c0fc7d0 msgr2=0x7f9e7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 shutdown_connections 2024-09-15T22:47:04.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:04.642+0000 7f9e82599640 1 -- 172.21.15.66:0/1250984519 wait complete. 2024-09-15T22:47:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:05 smithi087 ceph-mon[35290]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2024-09-15T22:47:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:05 smithi184 ceph-mon[35203]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2024-09-15T22:47:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:05 smithi066 ceph-mon[31185]: pgmap v54: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 281 op/s 2024-09-15T22:47:06.534 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:47:06.535 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:47:06.813 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:07 smithi066 ceph-mon[31185]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 228 op/s 2024-09-15T22:47:07.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:07 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:07 smithi087 ceph-mon[35290]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 228 op/s 2024-09-15T22:47:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:07 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:07 smithi184 ceph-mon[35203]: pgmap v55: 129 pgs: 129 active+clean; 58 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 228 op/s 2024-09-15T22:47:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:07 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:47:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.000+0000 7f846f337640 1 -- 172.21.15.66:0/1209973919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 msgr2=0x7f84681067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.000+0000 7f846f337640 1 --2- 172.21.15.66:0/1209973919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f84681067f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8458009900 tx=0x7f845802a410 comp rx=0 tx=0).stop 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 -- 172.21.15.66:0/1209973919 shutdown_connections 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 --2- 172.21.15.66:0/1209973919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468106f20 0x7f846810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 --2- 172.21.15.66:0/1209973919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f84681067f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 --2- 172.21.15.66:0/1209973919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468101df0 0x7f84681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 -- 172.21.15.66:0/1209973919 >> 172.21.15.66:0/1209973919 conn(0x7f84680fd8f0 msgr2=0x7f84680ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 -- 172.21.15.66:0/1209973919 shutdown_connections 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 -- 172.21.15.66:0/1209973919 wait complete. 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 Processor -- start 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 -- start start 2024-09-15T22:47:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.001+0000 7f846f337640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 0x7f846819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846f337640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846f337640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468106f20 0x7f846819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846f337640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8468111f80 con 0x7f84681027a0 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846f337640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8468111e00 con 0x7f8468101df0 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846f337640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8468112100 con 0x7f8468106f20 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846d0d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 0x7f846819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37486/0 (socket says 172.21.15.66:37486) 2024-09-15T22:47:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 -- 172.21.15.66:0/797791628 learned_addr learned my addr 172.21.15.66:0/797791628 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846d8d4640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468106f20 0x7f846819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 -- 172.21.15.66:0/797791628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468106f20 msgr2=0x7f846819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468106f20 0x7f846819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 -- 172.21.15.66:0/797791628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 msgr2=0x7f846819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 0x7f846819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 -- 172.21.15.66:0/797791628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846819f650 con 0x7f84681027a0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846d0d3640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 0x7f846819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f846c8d2640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8458006010 tx=0x7f8458004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.002+0000 7f845e7fc640 1 -- 172.21.15.66:0/797791628 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845803f030 con 0x7f84681027a0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.003+0000 7f845e7fc640 1 -- 172.21.15.66:0/797791628 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458004440 con 0x7f84681027a0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.003+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846819f8e0 con 0x7f84681027a0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.003+0000 7f845e7fc640 1 -- 172.21.15.66:0/797791628 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458035070 con 0x7f84681027a0 2024-09-15T22:47:08.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.003+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84681a7220 con 0x7f84681027a0 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.005+0000 7f845e7fc640 1 -- 172.21.15.66:0/797791628 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8458042030 con 0x7f84681027a0 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.005+0000 7f8471710740 1 Processor -- start 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.005+0000 7f8471710740 1 -- start start 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.005+0000 7f8471710740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 0x55c99015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f8471710740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c990169800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f8471710740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c99016c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f8471710740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9900c4280 con 0x55c99015eb60 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f8471710740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c99006bb10 con 0x55c99015f480 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f8471710740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c9900c0240 con 0x55c990169d40 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d8d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 0x55c99015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d8d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 0x55c99015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37494/0 (socket says 172.21.15.66:37494) 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d8d4640 1 -- 172.21.15.66:0/1324421324 learned_addr learned my addr 172.21.15.66:0/1324421324 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:08.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f845e7fc640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 0x7f84540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c990169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846c8d2640 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c99016c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d8d4640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 0x7f84540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 -- 172.21.15.66:0/1324421324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 msgr2=0x55c99016c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c99016c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f845e7fc640 1 -- 172.21.15.66:0/797791628 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f84580f03c0 con 0x7f84681027a0 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 -- 172.21.15.66:0/1324421324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 msgr2=0x55c99015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 0x55c99015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 -- 172.21.15.66:0/1324421324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9900781f0 con 0x55c99015f480 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d0d3640 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c990169800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8464005fd0 tx=0x7f8464011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a577d27725587251 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f846d8d4640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 0x7f84540a58f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84600058c0 tx=0x7f8460004730 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.006+0000 7f84537fe640 1 -- 172.21.15.66:0/1324421324 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464004d20 con 0x55c99015f480 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f84537fe640 1 -- 172.21.15.66:0/1324421324 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846400f9a0 con 0x55c99015f480 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f84537fe640 1 -- 172.21.15.66:0/1324421324 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84640044a0 con 0x55c99015f480 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 -- 172.21.15.66:0/1324421324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 msgr2=0x55c990169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c990169800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8464005fd0 tx=0x7f8464011c70 comp rx=0 tx=0).stop 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 -- 172.21.15.66:0/1324421324 shutdown_connections 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c99016c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c990169800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 --2- 172.21.15.66:0/1324421324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015eb60 0x55c99015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 -- 172.21.15.66:0/1324421324 >> 172.21.15.66:0/1324421324 conn(0x55c99015b0f0 msgr2=0x55c99015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 -- 172.21.15.66:0/1324421324 shutdown_connections 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.007+0000 7f8471710740 1 -- 172.21.15.66:0/1324421324 wait complete. 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 -- start start 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 Processor -- start 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015eb60 0x55c990166b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c990167600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c99016c910 con 0x55c99015f480 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c99007ef10 con 0x55c99015eb60 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c99016ca90 con 0x55c990169d40 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f8471710740 10 client.0 _ll_register_callbacks cb 0x55c990047a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37500/0 (socket says 172.21.15.66:37500) 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f846c8d2640 1 -- 172.21.15.66:0/4147508075 learned_addr learned my addr 172.21.15.66:0/4147508075 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f846d8d4640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c990167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.008+0000 7f846d0d3640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015eb60 0x55c990166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 -- 172.21.15.66:0/4147508075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 msgr2=0x55c990167600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c990167600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 -- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015eb60 msgr2=0x55c990166b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015eb60 0x55c990166b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 -- 172.21.15.66:0/4147508075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98fe356a0 con 0x55c99015f480 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f846c8d2640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f84580bc080 tx=0x7f8458009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f937456852825b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8450ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458049070 con 0x55c99015f480 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846400f9a0 con 0x55c99015f480 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f8458003cd0 con 0x55c99015f480 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f84580c0680 con 0x55c99015f480 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8471710740 10 client.15969 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c990178480 con 0x55c99015f480 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.009+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846400f9a0 con 0x55c99015f480 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f84580c1e10 con 0x55c99015f480 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 10 client.15969 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 20 client.15969 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c990179990 0x55c99017be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 4 client.15969 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9900d17f0 con 0x55c990179990 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f846d0d3640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c990179990 0x55c99017be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f8450ff9640 10 client.15969 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:08.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.010+0000 7f846d0d3640 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c990179990 0x55c99017be50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada4bfb97fbe176d server_cookie=44ffef51e9732f6e in_seq=0 out_seq=0 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8450ff9640 1 -- 172.21.15.66:0/4147508075 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9900d17f0 con 0x55c990179990 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8450ff9640 10 client.15969 handle_command_reply: tid=0 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 client.15969 shutdown 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 msgr2=0x55c9901670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f84580bc080 tx=0x7f8458009620 comp rx=0 tx=0).stop 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 shutdown_connections 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c990169d40 0x55c990167600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c9901670c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c990179990 0x55c99017be50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 --2- 172.21.15.66:0/4147508075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015eb60 0x55c990166b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 >> 172.21.15.66:0/4147508075 conn(0x55c99015b0f0 msgr2=0x55c990160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.011+0000 7f8450ff9640 0 client.15969 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.012+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 shutdown_connections 2024-09-15T22:47:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.012+0000 7f8471710740 1 -- 172.21.15.66:0/4147508075 wait complete. 2024-09-15T22:47:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.012+0000 7f8471710740 20 client.15969 trim_cache size 0 max 16384 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 Processor -- start 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 -- start start 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c9901689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 0x55c990181ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84681b12d0 con 0x55c99015f480 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f84681b2f90 con 0x55c990169d40 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.030+0000 7f8471710740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f84681b19a0 con 0x55c99015eb60 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c9901689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37508/0 (socket says 172.21.15.66:37508) 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846c8d2640 1 -- 172.21.15.66:0/107505334 learned_addr learned my addr 172.21.15.66:0/107505334 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d8d4640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 0x55c990181ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 -- 172.21.15.66:0/107505334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 msgr2=0x55c990181ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 0x55c990181ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 -- 172.21.15.66:0/107505334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 msgr2=0x55c990181760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 -- 172.21.15.66:0/107505334 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c99015f2b0 con 0x55c99015eb60 2024-09-15T22:47:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d8d4640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 0x55c990181ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846c8d2640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f846d0d3640 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c9901689e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f846400f790 tx=0x7f8464009280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5273817ff0a94a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f8452ffd640 1 -- 172.21.15.66:0/107505334 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846400f9a0 con 0x55c99015eb60 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f8452ffd640 1 -- 172.21.15.66:0/107505334 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846401f040 con 0x55c99015eb60 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.031+0000 7f8452ffd640 1 -- 172.21.15.66:0/107505334 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464005410 con 0x55c99015eb60 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- 172.21.15.66:0/107505334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 msgr2=0x55c9901689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c9901689e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f846400f790 tx=0x7f8464009280 comp rx=0 tx=0).stop 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- 172.21.15.66:0/107505334 shutdown_connections 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c990169d40 0x55c990181ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c99015f480 0x55c990181760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 --2- 172.21.15.66:0/107505334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c9901689e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- 172.21.15.66:0/107505334 >> 172.21.15.66:0/107505334 conn(0x55c99015b0f0 msgr2=0x55c9901682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- 172.21.15.66:0/107505334 shutdown_connections 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- 172.21.15.66:0/107505334 wait complete. 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.032+0000 7f8471710740 1 -- start start 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 Processor -- start 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c99016dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c99016e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 0x55c99016e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f84681b2800 con 0x55c990169d40 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f84681b2070 con 0x55c99015f480 2024-09-15T22:47:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f84681af2b0 con 0x55c99015eb60 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f8471710740 10 client.0 _ll_register_callbacks cb 0x7f845803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846d0d3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c99016dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846d8d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 0x55c99016e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c99016e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846d8d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 0x55c99016e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37512/0 (socket says 172.21.15.66:37512) 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846d0d3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c99016dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49918/0 (socket says 172.21.15.66:49918) 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846d8d4640 1 -- 172.21.15.66:0/3724395419 learned_addr learned my addr 172.21.15.66:0/3724395419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 -- 172.21.15.66:0/3724395419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 msgr2=0x55c99016dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c99016dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 -- 172.21.15.66:0/3724395419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 msgr2=0x55c99016e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 0x55c99016e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.033+0000 7f846c8d2640 1 -- 172.21.15.66:0/3724395419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9901e39d0 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f846c8d2640 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c99016e240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f845803b510 tx=0x7f84580d5300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3eafb5ca090ba29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458049070 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f84580bc680 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846401f040 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f84580c4f40 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 10 client.25541 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9901e4c80 con 0x55c99015f480 2024-09-15T22:47:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846401f040 con 0x55c99015f480 2024-09-15T22:47:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f8458031c70 con 0x55c99015f480 2024-09-15T22:47:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 10 client.25541 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 20 client.25541 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9901e52f0 0x55c9901e7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 4 client.25541 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.034+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c9900cbd00 con 0x55c9901e52f0 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.035+0000 7f846d0d3640 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9901e52f0 0x55c9901e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.035+0000 7f846d0d3640 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9901e52f0 0x55c9901e7710 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d1d05402415a0ca server_cookie=a916e5af982c3cc in_seq=0 out_seq=0 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.035+0000 7f8450ff9640 10 client.25541 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8450ff9640 1 -- 172.21.15.66:0/3724395419 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c9900cbd00 con 0x55c9901e52f0 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8450ff9640 10 client.25541 handle_command_reply: tid=0 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 client.25541 shutdown 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 msgr2=0x55c99016e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c99016e240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f845803b510 tx=0x7f84580d5300 comp rx=0 tx=0).stop 2024-09-15T22:47:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 shutdown_connections 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c990169d40 0x55c99016e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.036+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9901e52f0 0x55c9901e7710 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c99015f480 0x55c99016e240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 1 --2- 172.21.15.66:0/3724395419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c99015eb60 0x55c99016dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8450ff9640 0 client.25541 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 >> 172.21.15.66:0/3724395419 conn(0x55c99015b0f0 msgr2=0x55c990167360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 shutdown_connections 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 1 -- 172.21.15.66:0/3724395419 wait complete. 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f8471710740 20 client.25541 trim_cache size 0 max 16384 2024-09-15T22:47:08.044 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "8274f449-2aa0-40f4-87bf-313e4ecfcc03", 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 msgr2=0x7f84540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 0x7f84540a58f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84600058c0 tx=0x7f8460004730 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 msgr2=0x7f846819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8458006010 tx=0x7f8458004040 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 shutdown_connections 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f84540a3430 0x7f84540a58f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8468106f20 0x7f846819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84681027a0 0x7f846819abe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 --2- 172.21.15.66:0/797791628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8468101df0 0x7f846819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.037+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 >> 172.21.15.66:0/797791628 conn(0x7f84680fd8f0 msgr2=0x7f84680fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.038+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 shutdown_connections 2024-09-15T22:47:08.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:08.038+0000 7f846f337640 1 -- 172.21.15.66:0/797791628 wait complete. 2024-09-15T22:47:08.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:47:09.111 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:09.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: pgmap v56: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 289 op/s 2024-09-15T22:47:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:47:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:09 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: pgmap v56: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 289 op/s 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:09 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: pgmap v56: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 289 op/s 2024-09-15T22:47:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:47:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:09.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:09 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 -- 172.21.15.66:0/2177938748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8102570 msgr2=0x7f62b81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/2177938748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8102570 0x7f62b81029b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009900 tx=0x7f62a802a480 comp rx=0 tx=0).stop 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 -- 172.21.15.66:0/2177938748 shutdown_connections 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/2177938748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102ef0 0x7f62b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/2177938748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8102570 0x7f62b81029b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/2177938748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8100e20 0x7f62b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 -- 172.21.15.66:0/2177938748 >> 172.21.15.66:0/2177938748 conn(0x7f62b80fc7d0 msgr2=0x7f62b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 -- 172.21.15.66:0/2177938748 shutdown_connections 2024-09-15T22:47:09.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.599+0000 7f62bf9d5640 1 -- 172.21.15.66:0/2177938748 wait complete. 2024-09-15T22:47:09.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 Processor -- start 2024-09-15T22:47:09.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 -- start start 2024-09-15T22:47:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102570 0x7f62b8199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8102ef0 0x7f62b81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8110fa0 con 0x7f62b8100e20 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8110e20 con 0x7f62b8102ef0 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bf9d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8111120 con 0x7f62b8102570 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bd771640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102570 0x7f62b8199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bd771640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37534/0 (socket says 172.21.15.66:37534) 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.600+0000 7f62bd771640 1 -- 172.21.15.66:0/818547737 learned_addr learned my addr 172.21.15.66:0/818547737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bdf72640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8102ef0 0x7f62b81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 -- 172.21.15.66:0/818547737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102570 msgr2=0x7f62b8199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102570 0x7f62b8199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 -- 172.21.15.66:0/818547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8102ef0 msgr2=0x7f62b81a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8102ef0 0x7f62b81a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 -- 172.21.15.66:0/818547737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b81a48f0 con 0x7f62b8100e20 2024-09-15T22:47:09.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bd771640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ea60 tx=0x7f62b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62ae7fc640 1 -- 172.21.15.66:0/818547737 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400cde0 con 0x7f62b8100e20 2024-09-15T22:47:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b81a4ac0 con 0x7f62b8100e20 2024-09-15T22:47:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62ae7fc640 1 -- 172.21.15.66:0/818547737 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b40035f0 con 0x7f62b8100e20 2024-09-15T22:47:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62ae7fc640 1 -- 172.21.15.66:0/818547737 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4010670 con 0x7f62b8100e20 2024-09-15T22:47:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.601+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b81a4fd0 con 0x7f62b8100e20 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.604+0000 7f62ae7fc640 1 -- 172.21.15.66:0/818547737 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f62b40037a0 con 0x7f62b8100e20 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.604+0000 7f62c1dae740 1 Processor -- start 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.604+0000 7f62c1dae740 1 -- start start 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e63a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e649550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b72e5a02e0 con 0x55b72e63acc0 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b72e547ce0 con 0x55b72e649a90 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62c1dae740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b72e59c2a0 con 0x55b72e63a3a0 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bd771640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e649550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53348/0 (socket says 172.21.15.66:53348) 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 -- 172.21.15.66:0/1526892417 learned_addr learned my addr 172.21.15.66:0/1526892417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bdf72640 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e63a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 -- 172.21.15.66:0/1526892417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 msgr2=0x55b72e63a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e63a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 -- 172.21.15.66:0/1526892417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 msgr2=0x55b72e649550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e649550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 -- 172.21.15.66:0/1526892417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72e52c440 con 0x55b72e649a90 2024-09-15T22:47:09.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62ae7fc640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 0x7f62a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009230 tx=0x7f62a8005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cfdaa30af6e3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.605+0000 7f62bdf72640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 0x7f62a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62ae7fc640 1 -- 172.21.15.66:0/818547737 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f62b40d03a0 con 0x7f62b8100e20 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62a37fe640 1 -- 172.21.15.66:0/1526892417 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8035040 con 0x55b72e649a90 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62a37fe640 1 -- 172.21.15.66:0/1526892417 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a8004400 con 0x55b72e649a90 2024-09-15T22:47:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62a37fe640 1 -- 172.21.15.66:0/1526892417 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a80035f0 con 0x55b72e649a90 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62c1dae740 1 -- 172.21.15.66:0/1526892417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 msgr2=0x55b72e64be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.606+0000 7f62bdf72640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 0x7f62a40a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005fd0 tx=0x7f62b0009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009230 tx=0x7f62a8005e00 comp rx=0 tx=0).stop 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 -- 172.21.15.66:0/1526892417 shutdown_connections 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e649a90 0x55b72e64be80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e649550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1526892417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e63a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 -- 172.21.15.66:0/1526892417 >> 172.21.15.66:0/1526892417 conn(0x55b72e636a30 msgr2=0x55b72e636e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 -- 172.21.15.66:0/1526892417 shutdown_connections 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 -- 172.21.15.66:0/1526892417 wait complete. 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 -- start start 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.607+0000 7f62c1dae740 1 Processor -- start 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e646600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e649a90 0x55b72e646b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b72e64c660 con 0x55b72e63acc0 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b72e55b050 con 0x55b72e63a3a0 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b72e64c7e0 con 0x55b72e649a90 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62c1dae740 10 client.0 _ll_register_callbacks cb 0x55b72e59b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53362/0 (socket says 172.21.15.66:53362) 2024-09-15T22:47:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 -- 172.21.15.66:0/843487535 learned_addr learned my addr 172.21.15.66:0/843487535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bcf70640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e646600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bdf72640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e649a90 0x55b72e646b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 -- 172.21.15.66:0/843487535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e649a90 msgr2=0x55b72e646b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e649a90 0x55b72e646b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 -- 172.21.15.66:0/843487535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 msgr2=0x55b72e646600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e646600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 -- 172.21.15.66:0/843487535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72e3113c0 con 0x55b72e63a3a0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62bd771640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c760 tx=0x7f62b40d3ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e9aca7a8e9aef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.608+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b409bdf0 con 0x55b72e63a3a0 2024-09-15T22:47:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f62b40cd9a0 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a8004400 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f62b409bc10 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 10 client.25553 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b72e657ff0 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b409c9b0 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f62b40bc0d0 con 0x55b72e63a3a0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 10 client.25553 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 20 client.25553 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e6594b0 0x55b72e65b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 4 client.25553 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f62a8004400 con 0x55b72e6594b0 2024-09-15T22:47:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.609+0000 7f62bcf70640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e6594b0 0x55b72e65b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.610+0000 7f62bcf70640 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e6594b0 0x55b72e65b940 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dacd23a638a0aaf server_cookie=a6d0c2800be2714d in_seq=0 out_seq=0 2024-09-15T22:47:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.610+0000 7f62a0ff9640 10 client.25553 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.610+0000 7f62a0ff9640 1 -- 172.21.15.66:0/843487535 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f62a8004400 con 0x55b72e6594b0 2024-09-15T22:47:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.610+0000 7f62a0ff9640 10 client.25553 handle_command_reply: tid=0 2024-09-15T22:47:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 client.25553 shutdown 2024-09-15T22:47:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 msgr2=0x55b72e649350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c760 tx=0x7f62b40d3ae0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 shutdown_connections 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e649a90 0x55b72e646b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e646600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e6594b0 0x55b72e65b940 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 --2- 172.21.15.66:0/843487535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e63a3a0 0x55b72e649350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 >> 172.21.15.66:0/843487535 conn(0x55b72e636a30 msgr2=0x55b72e63c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62a0ff9640 0 client.25553 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 shutdown_connections 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 1 -- 172.21.15.66:0/843487535 wait complete. 2024-09-15T22:47:09.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.611+0000 7f62c1dae740 20 client.25553 trim_cache size 0 max 16384 2024-09-15T22:47:09.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 Processor -- start 2024-09-15T22:47:09.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 -- start start 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e655900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e661210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e661750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81acfc0 con 0x55b72e63acc0 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81aec80 con 0x55b72e636a30 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62c1dae740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ad690 con 0x55b72e63a3a0 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62bdf72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e661750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62bd771640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e655900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62bd771640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e655900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53364/0 (socket says 172.21.15.66:53364) 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e661210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.631+0000 7f62bd771640 1 -- 172.21.15.66:0/1778761093 learned_addr learned my addr 172.21.15.66:0/1778761093 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 -- 172.21.15.66:0/1778761093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 msgr2=0x55b72e661210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e661210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 -- 172.21.15.66:0/1778761093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 msgr2=0x55b72e655900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e655900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 -- 172.21.15.66:0/1778761093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72e636860 con 0x55b72e63acc0 2024-09-15T22:47:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62bdf72640 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e661750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55b72e649a60 tx=0x7f62b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f19b8eda712a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62a2ffd640 1 -- 172.21.15.66:0/1778761093 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004490 con 0x55b72e63acc0 2024-09-15T22:47:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62a2ffd640 1 -- 172.21.15.66:0/1778761093 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b0004630 con 0x55b72e63acc0 2024-09-15T22:47:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.632+0000 7f62a2ffd640 1 -- 172.21.15.66:0/1778761093 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001e430 con 0x55b72e63acc0 2024-09-15T22:47:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- 172.21.15.66:0/1778761093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 msgr2=0x55b72e661750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e661750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55b72e649a60 tx=0x7f62b0016000 comp rx=0 tx=0).stop 2024-09-15T22:47:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- 172.21.15.66:0/1778761093 shutdown_connections 2024-09-15T22:47:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63acc0 0x55b72e661750 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63a3a0 0x55b72e661210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1778761093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e655900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- 172.21.15.66:0/1778761093 >> 172.21.15.66:0/1778761093 conn(0x55b72e646ca0 msgr2=0x55b72e644ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- 172.21.15.66:0/1778761093 shutdown_connections 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- 172.21.15.66:0/1778761093 wait complete. 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.633+0000 7f62c1dae740 1 -- start start 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 Processor -- start 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e652380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63acc0 0x55b72e64de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ae4f0 con 0x55b72e63a3a0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81add60 con 0x55b72e636a30 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81aafa0 con 0x55b72e63acc0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62c1dae740 10 client.0 _ll_register_callbacks cb 0x7f62b40d3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37558/0 (socket says 172.21.15.66:37558) 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 -- 172.21.15.66:0/1727629028 learned_addr learned my addr 172.21.15.66:0/1727629028 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bdf72640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63acc0 0x55b72e64de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bd771640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e652380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 -- 172.21.15.66:0/1727629028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63acc0 msgr2=0x55b72e64de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63acc0 0x55b72e64de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 -- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 msgr2=0x55b72e652380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.634+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e652380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62bcf70640 1 -- 172.21.15.66:0/1727629028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72e6c31e0 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62bcf70640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005b90 tx=0x7f62a8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feed9ead48e67e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8035040 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b0004630 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f62a8051410 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f62a8051630 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62c1dae740 10 client.15993 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b72e6c4460 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.635+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b0004630 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f62a8031990 con 0x55b72e63a3a0 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 10 client.15993 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 20 client.15993 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e649a90 0x55b72e6c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 4 client.15993 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b72e5ad850 con 0x55b72e649a90 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62bd771640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e649a90 0x55b72e6c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62a0ff9640 10 client.15993 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.636+0000 7f62bd771640 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e649a90 0x55b72e6c6870 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b98c053a494ff6e server_cookie=340d837ff6333bb1 in_seq=0 out_seq=0 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62a0ff9640 1 -- 172.21.15.66:0/1727629028 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b72e5ad850 con 0x55b72e649a90 2024-09-15T22:47:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62a0ff9640 10 client.15993 handle_command_reply: tid=0 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 client.15993 shutdown 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 msgr2=0x55b72e64d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005b90 tx=0x7f62a8009260 comp rx=0 tx=0).stop 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 shutdown_connections 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b72e63acc0 0x55b72e64de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b72e63a3a0 0x55b72e64d6b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b72e649a90 0x55b72e6c6870 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 --2- 172.21.15.66:0/1727629028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b72e636a30 0x55b72e652380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62a0ff9640 0 client.15993 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 >> 172.21.15.66:0/1727629028 conn(0x55b72e646ca0 msgr2=0x55b72e6452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 shutdown_connections 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 1 -- 172.21.15.66:0/1727629028 wait complete. 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.637+0000 7f62c1dae740 20 client.15993 trim_cache size 0 max 16384 2024-09-15T22:47:09.649 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "8274f449-2aa0-40f4-87bf-313e4ecfcc03": { 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "8274f449-2aa0-40f4-87bf-313e4ecfcc03", 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:09.650 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:09.651 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:09.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 msgr2=0x7f62a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 0x7f62a40a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005fd0 tx=0x7f62b0009500 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 msgr2=0x7f62b8199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ea60 tx=0x7f62b400ef20 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 shutdown_connections 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f62a40a33b0 0x7f62a40a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b8102ef0 0x7f62b81a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b8102570 0x7f62b8199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 --2- 172.21.15.66:0/818547737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62b8100e20 0x7f62b8199330 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 >> 172.21.15.66:0/818547737 conn(0x7f62b80fc7d0 msgr2=0x7f62b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 shutdown_connections 2024-09-15T22:47:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:09.638+0000 7f62bf9d5640 1 -- 172.21.15.66:0/818547737 wait complete. 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:10 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.382 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.383 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:10 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:10.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:10 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:10.449 INFO:tasks.cephfs.filesystem:scrub status for tag:8274f449-2aa0-40f4-87bf-313e4ecfcc03 - {'path': '/', 'tag': '8274f449-2aa0-40f4-87bf-313e4ecfcc03', 'options': 'recursive,force'} 2024-09-15T22:47:11.322 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:11 smithi184 ceph-mon[35203]: pgmap v57: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:11 smithi087 ceph-mon[35290]: pgmap v57: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:11.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:11 smithi066 ceph-mon[31185]: pgmap v57: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:13 smithi087 ceph-mon[35290]: pgmap v58: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:13 smithi184 ceph-mon[35203]: pgmap v58: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:13 smithi066 ceph-mon[31185]: pgmap v58: 129 pgs: 129 active+clean; 68 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 272 op/s 2024-09-15T22:47:14.581 INFO:tasks.workunit.client.0.smithi066.stdout: 39 110073 1394 67748 1597 29411 439 2024-09-15T22:47:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:15 smithi087 ceph-mon[35290]: pgmap v59: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2024-09-15T22:47:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:15 smithi184 ceph-mon[35203]: pgmap v59: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2024-09-15T22:47:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:15 smithi066 ceph-mon[31185]: pgmap v59: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2024-09-15T22:47:17.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:17 smithi087 ceph-mon[35290]: pgmap v60: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2024-09-15T22:47:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:17 smithi184 ceph-mon[35203]: pgmap v60: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2024-09-15T22:47:17.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:17 smithi066 ceph-mon[31185]: pgmap v60: 129 pgs: 129 active+clean; 77 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 84 op/s 2024-09-15T22:47:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:19 smithi087 ceph-mon[35290]: pgmap v61: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 455 op/s 2024-09-15T22:47:19.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:19 smithi184 ceph-mon[35203]: pgmap v61: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 455 op/s 2024-09-15T22:47:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:19 smithi066 ceph-mon[31185]: pgmap v61: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 455 op/s 2024-09-15T22:47:20.361 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:20 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:20.361 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:20.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:20 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:20.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:20.452 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:20 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:20.452 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:21 smithi087 ceph-mon[35290]: pgmap v62: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:21 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:21 smithi184 ceph-mon[35203]: pgmap v62: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:21 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:21 smithi066 ceph-mon[31185]: pgmap v62: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:21 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:23 smithi087 ceph-mon[35290]: pgmap v63: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:23 smithi184 ceph-mon[35203]: pgmap v63: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:23.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:23 smithi066 ceph-mon[31185]: pgmap v63: 129 pgs: 129 active+clean; 174 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.2 MiB/s wr, 395 op/s 2024-09-15T22:47:24.582 INFO:tasks.workunit.client.0.smithi066.stdout: 46 246346 356 164096 415 40611 254 2024-09-15T22:47:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:25 smithi087 ceph-mon[35290]: pgmap v64: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 467 op/s 2024-09-15T22:47:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:25 smithi184 ceph-mon[35203]: pgmap v64: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 467 op/s 2024-09-15T22:47:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:25 smithi066 ceph-mon[31185]: pgmap v64: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 467 op/s 2024-09-15T22:47:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:27 smithi087 ceph-mon[35290]: pgmap v65: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.9 MiB/s wr, 443 op/s 2024-09-15T22:47:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:27 smithi184 ceph-mon[35203]: pgmap v65: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.9 MiB/s wr, 443 op/s 2024-09-15T22:47:27.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:27 smithi066 ceph-mon[31185]: pgmap v65: 129 pgs: 129 active+clean; 190 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.9 MiB/s wr, 443 op/s 2024-09-15T22:47:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:29 smithi087 ceph-mon[35290]: pgmap v66: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-15T22:47:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:47:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:47:29.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:29 smithi184 ceph-mon[35203]: pgmap v66: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-15T22:47:29.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:47:29.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:47:29.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:29 smithi066 ceph-mon[31185]: pgmap v66: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-15T22:47:29.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:47:29.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:47:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:47:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:47:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:47:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:47:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:47:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:47:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:31 smithi184 ceph-mon[35203]: pgmap v67: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:31 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:47:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:31 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:47:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:31 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:47:31.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:31 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:47:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:31 smithi066 ceph-mon[31185]: pgmap v67: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:31 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:47:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:31 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:47:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:31 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:47:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:31 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:47:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:31 smithi087 ceph-mon[35290]: pgmap v67: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:31 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:47:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:31 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:47:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:31 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:47:31.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:31 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:47:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:33 smithi184 ceph-mon[35203]: pgmap v68: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:33 smithi066 ceph-mon[31185]: pgmap v68: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:33 smithi087 ceph-mon[35290]: pgmap v68: 129 pgs: 129 active+clean; 197 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 106 op/s 2024-09-15T22:47:34.582 INFO:tasks.workunit.client.0.smithi066.stdout: 72 482385 1441 322212 1370 100002 1044 2024-09-15T22:47:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:35 smithi184 ceph-mon[35203]: pgmap v69: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 142 op/s 2024-09-15T22:47:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:35 smithi066 ceph-mon[31185]: pgmap v69: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 142 op/s 2024-09-15T22:47:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:35 smithi087 ceph-mon[35290]: pgmap v69: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 142 op/s 2024-09-15T22:47:36.554 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T22:47:36.555 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T22:47:36.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:47:36.922 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:37.341 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:37 smithi066 ceph-mon[31185]: pgmap v70: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 70 op/s 2024-09-15T22:47:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:37 smithi184 ceph-mon[35203]: pgmap v70: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 70 op/s 2024-09-15T22:47:37.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.432+0000 7f3a5d564640 1 -- 172.21.15.66:0/1672612756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 msgr2=0x7f3a58103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.432+0000 7f3a5d564640 1 --2- 172.21.15.66:0/1672612756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a58103110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009930 tx=0x7f3a4802a420 comp rx=0 tx=0).stop 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.432+0000 7f3a5d564640 1 -- 172.21.15.66:0/1672612756 shutdown_connections 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.432+0000 7f3a5d564640 1 --2- 172.21.15.66:0/1672612756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 --2- 172.21.15.66:0/1672612756 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 0x7f3a58107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 --2- 172.21.15.66:0/1672612756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a58103110 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 -- 172.21.15.66:0/1672612756 >> 172.21.15.66:0/1672612756 conn(0x7f3a580fc7d0 msgr2=0x7f3a580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 -- 172.21.15.66:0/1672612756 shutdown_connections 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 -- 172.21.15.66:0/1672612756 wait complete. 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 Processor -- start 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 -- start start 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 0x7f3a58198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.433+0000 7f3a5d564640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a5d564640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a581120a0 con 0x7f3a58102d30 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a5d564640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a58111f20 con 0x7f3a581082a0 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a5d564640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a58112220 con 0x7f3a581036e0 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43882/0 (socket says 172.21.15.66:43882) 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 -- 172.21.15.66:0/3899257675 learned_addr learned my addr 172.21.15.66:0/3899257675 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a577fe640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a4ffff640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 0x7f3a58198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 -- 172.21.15.66:0/3899257675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 msgr2=0x7f3a58198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 0x7f3a58198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 -- 172.21.15.66:0/3899257675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 msgr2=0x7f3a5819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 -- 172.21.15.66:0/3899257675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5819d590 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a577fe640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a56ffd640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009230 tx=0x7f3a48004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4803f030 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5819d820 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a581a5160 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.434+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a48004440 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.435+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48035070 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.435+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a58103110 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.437+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3a48042030 con 0x7f3a58102d30 2024-09-15T22:47:37.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.437+0000 7f3a54ff9640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 0x7f3a440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:37.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.438+0000 7f3a4ffff640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 0x7f3a440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:37.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.438+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3a480f0750 con 0x7f3a58102d30 2024-09-15T22:47:37.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.438+0000 7f3a4ffff640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 0x7f3a440a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a580fee70 tx=0x7f3a40005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:37.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.441+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a480bc710 con 0x7f3a58102d30 2024-09-15T22:47:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:37 smithi087 ceph-mon[35290]: pgmap v70: 129 pgs: 129 active+clean; 207 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 70 op/s 2024-09-15T22:47:37.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.667+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a5810a2b0 con 0x7f3a58102d30 2024-09-15T22:47:37.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.668+0000 7f3a54ff9640 1 -- 172.21.15.66:0/3899257675 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7f3a480c0a10 con 0x7f3a58102d30 2024-09-15T22:47:37.670 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:47:37.670 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:47:37.670 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.670+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 msgr2=0x7f3a440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.670+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 0x7f3a440a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a580fee70 tx=0x7f3a40005f90 comp rx=0 tx=0).stop 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.670+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 msgr2=0x7f3a581985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.670+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009230 tx=0x7f3a48004040 comp rx=0 tx=0).stop 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.670+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 shutdown_connections 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a440a3430 0x7f3a440a58f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a581082a0 0x7f3a5819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a581036e0 0x7f3a58198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 --2- 172.21.15.66:0/3899257675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a58102d30 0x7f3a581985e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:37.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 >> 172.21.15.66:0/3899257675 conn(0x7f3a580fc7d0 msgr2=0x7f3a58105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:37.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 shutdown_connections 2024-09-15T22:47:37.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:37.671+0000 7f3a5d564640 1 -- 172.21.15.66:0/3899257675 wait complete. 2024-09-15T22:47:38.388 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3899257675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:38.420 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T22:47:38.420 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T22:47:38.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3899257675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3899257675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:38.701 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:39.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 -- 172.21.15.66:0/794116648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0101410 msgr2=0x7f6cc010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/794116648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0101410 0x7f6cc010d940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009cd0 tx=0x7f6cb802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 -- 172.21.15.66:0/794116648 shutdown_connections 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/794116648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0101410 0x7f6cc010d940 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/794116648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0100a70 0x7f6cc0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/794116648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0106a70 0x7f6cc0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 -- 172.21.15.66:0/794116648 >> 172.21.15.66:0/794116648 conn(0x7f6cc00fc790 msgr2=0x7f6cc00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 -- 172.21.15.66:0/794116648 shutdown_connections 2024-09-15T22:47:39.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.299+0000 7f6cc5af5640 1 -- 172.21.15.66:0/794116648 wait complete. 2024-09-15T22:47:39.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 Processor -- start 2024-09-15T22:47:39.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 -- start start 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0101410 0x7f6cc0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0110e70 con 0x7f6cc0100a70 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0110cf0 con 0x7f6cc0101410 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cc5af5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0110ff0 con 0x7f6cc0106a70 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cbffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43904/0 (socket says 172.21.15.66:43904) 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/1824524871 learned_addr learned my addr 172.21.15.66:0/1824524871 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.300+0000 7f6cbffff640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49294/0 (socket says 172.21.15.66:49294) 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0101410 0x7f6cc0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 -- 172.21.15.66:0/1824524871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0101410 msgr2=0x7f6cc0197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0101410 0x7f6cc0197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 -- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 msgr2=0x7f6cc0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 -- 172.21.15.66:0/1824524871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc019c2b0 con 0x7f6cc0106a70 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.301+0000 7f6cbffff640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009bf0 tx=0x7f6cb8003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.302+0000 7f6cbcff9640 1 -- 172.21.15.66:0/1824524871 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8004040 con 0x7f6cc0106a70 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.302+0000 7f6cbcff9640 1 -- 172.21.15.66:0/1824524871 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb80046c0 con 0x7f6cc0106a70 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.302+0000 7f6cbcff9640 1 -- 172.21.15.66:0/1824524871 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8046480 con 0x7f6cc0106a70 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.302+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc019c540 con 0x7f6cc0106a70 2024-09-15T22:47:39.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.302+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc01a3e80 con 0x7f6cc0106a70 2024-09-15T22:47:39.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.305+0000 7f6cbcff9640 1 -- 172.21.15.66:0/1824524871 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6cb8030630 con 0x7f6cc0106a70 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.305+0000 7f6cbcff9640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 0x7f6ca80a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.306+0000 7f6cbcff9640 1 -- 172.21.15.66:0/1824524871 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6cb802e030 con 0x7f6cc0106a70 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.306+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 0x7f6ca80a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.306+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 0x7f6ca80a58c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0011440 tx=0x7f6cb0005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.306+0000 7f6cc7ece740 1 Processor -- start 2024-09-15T22:47:39.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 -- start start 2024-09-15T22:47:39.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 0x555f75b89700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b8c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43920/0 (socket says 172.21.15.66:43920) 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 0x555f75b89700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/1646453790 learned_addr learned my addr 172.21.15.66:0/1646453790 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f75ae1160 con 0x555f75b7c6d0 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555f75a88720 con 0x555f75b89c40 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555f75add120 con 0x555f75b7cff0 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.307+0000 7f6cbffff640 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b8c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 -- 172.21.15.66:0/1646453790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 msgr2=0x555f75b8c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b8c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 -- 172.21.15.66:0/1646453790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 msgr2=0x555f75b7cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 -- 172.21.15.66:0/1646453790 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f75852ba0 con 0x555f75b7cff0 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 0x555f75b89700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009bf0 tx=0x7f6cb4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f939dbdaa664227 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6ca5ffb640 1 -- 172.21.15.66:0/1646453790 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb401e070 con 0x555f75b7cff0 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6ca5ffb640 1 -- 172.21.15.66:0/1646453790 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb4009da0 con 0x555f75b7cff0 2024-09-15T22:47:39.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.308+0000 7f6ca5ffb640 1 -- 172.21.15.66:0/1646453790 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4018870 con 0x555f75b7cff0 2024-09-15T22:47:39.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 msgr2=0x555f75b89700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 0x555f75b89700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009bf0 tx=0x7f6cb4011810 comp rx=0 tx=0).stop 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 shutdown_connections 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b8c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7cff0 0x555f75b89700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/1646453790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7c6d0 0x555f75b7cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 >> 172.21.15.66:0/1646453790 conn(0x555f75b78de0 msgr2=0x555f75b791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 shutdown_connections 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.309+0000 7f6cc7ece740 1 -- 172.21.15.66:0/1646453790 wait complete. 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 -- start start 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 Processor -- start 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b7f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b7fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f75b8c870 con 0x555f75b7cff0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555f75a69900 con 0x555f75b89c40 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555f75b8c9f0 con 0x555f75b7c6d0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cc7ece740 10 client.0 _ll_register_callbacks cb 0x555f75a67780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.310+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b810b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49302/0 (socket says 172.21.15.66:49302) 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b7f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/4114858612 learned_addr learned my addr 172.21.15.66:0/4114858612 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbffff640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b7fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 -- 172.21.15.66:0/4114858612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 msgr2=0x555f75b810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b810b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 -- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 msgr2=0x555f75b7fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b7fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 -- 172.21.15.66:0/4114858612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f75aa9c50 con 0x555f75b7cff0 2024-09-15T22:47:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b7f570 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6cb401c040 tx=0x7f6cb4005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06e8c02519d2683 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.311+0000 7f6c9effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4028020 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6cb40035f0 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb4009da0 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6cb4033050 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 10 client.16011 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555f75b9a7b0 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb4009da0 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f6cb4021030 con 0x555f75b7cff0 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 10 client.16011 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 10 client.16011 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 20 client.16011 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75b9bbb0 0x555f75b9dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 4 client.16011 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:39.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.312+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f75aee890 con 0x555f75b9bbb0 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.313+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75b9bbb0 0x555f75b9dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.313+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75b9bbb0 0x555f75b9dfa0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424a124d90c83d7f server_cookie=7c5af892ff80db4b in_seq=0 out_seq=0 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.313+0000 7f6c9effd640 10 client.16011 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6c9effd640 1 -- 172.21.15.66:0/4114858612 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f75aee890 con 0x555f75b9bbb0 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6c9effd640 10 client.16011 handle_command_reply: tid=0 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 client.16011 shutdown 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 msgr2=0x555f75b7f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b7f570 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6cb401c040 tx=0x7f6cb4005660 comp rx=0 tx=0).stop 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 shutdown_connections 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75b9bbb0 0x555f75b9dfa0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b7fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b7f570 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4114858612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b810b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6c9effd640 0 client.16011 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.314+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 >> 172.21.15.66:0/4114858612 conn(0x555f75b78de0 msgr2=0x555f75b7eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.315+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 shutdown_connections 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.315+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4114858612 wait complete. 2024-09-15T22:47:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.315+0000 7f6cc7ece740 20 client.16011 trim_cache size 0 max 16384 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 Processor -- start 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 -- start start 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 0x555f75ba3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01acf20 con 0x555f75b89c40 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01aebe0 con 0x555f75b7cff0 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.332+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ad5f0 con 0x555f75b7c6d0 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49310/0 (socket says 172.21.15.66:49310) 2024-09-15T22:47:39.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/4285537009 learned_addr learned my addr 172.21.15.66:0/4285537009 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:39.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43952/0 (socket says 172.21.15.66:43952) 2024-09-15T22:47:39.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 0x555f75ba3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/4285537009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 msgr2=0x555f75ba3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 0x555f75ba3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/4285537009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 msgr2=0x555f75ba3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/4285537009 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f75b7ce20 con 0x555f75b7c6d0 2024-09-15T22:47:39.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbffff640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 0x555f75ba3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009780 tx=0x7f6cb0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2340d85f5f77cfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6ca57fa640 1 -- 172.21.15.66:0/4285537009 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb001cb10 con 0x555f75b7c6d0 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6ca57fa640 1 -- 172.21.15.66:0/4285537009 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb001ccb0 con 0x555f75b7c6d0 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.333+0000 7f6ca57fa640 1 -- 172.21.15.66:0/4285537009 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00296b0 con 0x555f75b7c6d0 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4285537009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 msgr2=0x555f75b89460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009780 tx=0x7f6cb0014000 comp rx=0 tx=0).stop 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4285537009 shutdown_connections 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b89c40 0x555f75ba3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b7cff0 0x555f75ba3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/4285537009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b89460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4285537009 >> 172.21.15.66:0/4285537009 conn(0x555f75b78de0 msgr2=0x555f75b77ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4285537009 shutdown_connections 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- 172.21.15.66:0/4285537009 wait complete. 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.334+0000 7f6cc7ece740 1 -- start start 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 Processor -- start 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b94170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ae450 con 0x555f75b7cff0 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01adcc0 con 0x555f75b89c40 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01aaf00 con 0x555f75b7c6d0 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cc7ece740 10 client.0 _ll_register_callbacks cb 0x7f6cb401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49318/0 (socket says 172.21.15.66:49318) 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/259914295 learned_addr learned my addr 172.21.15.66:0/259914295 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43958/0 (socket says 172.21.15.66:43958) 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.335+0000 7f6cbffff640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b94170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 msgr2=0x555f75b94170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b94170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/259914295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 msgr2=0x555f75b93c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 -- 172.21.15.66:0/259914295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f75c05800 con 0x555f75b7c6d0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cbf7fe640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000fab0 tx=0x7f6cb001cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c0b55d1a86c3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6c9effd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb001c890 con 0x555f75b7c6d0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6cb001ca30 con 0x555f75b7c6d0 2024-09-15T22:47:39.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb001ccb0 con 0x555f75b7c6d0 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6cb002b460 con 0x555f75b7c6d0 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cc7ece740 10 client.25558 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.336+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555f75c06a90 con 0x555f75b7c6d0 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb001ccb0 con 0x555f75b7c6d0 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f6cb0032070 con 0x555f75b7c6d0 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 10 client.25558 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 10 client.25558 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 20 client.25558 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75c07250 0x555f75c09670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 4 client.25558 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x555f75ae8be0 con 0x555f75c07250 2024-09-15T22:47:39.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.337+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75c07250 0x555f75c09670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:39.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.338+0000 7f6cbeffd640 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75c07250 0x555f75c09670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1658cb5f65bd00ae server_cookie=a8f6552164c77ab0 in_seq=0 out_seq=0 2024-09-15T22:47:39.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:39.338+0000 7f6c9effd640 10 client.25558 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:39 smithi184 ceph-mon[35203]: pgmap v71: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 399 op/s 2024-09-15T22:47:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:39 smithi066 ceph-mon[31185]: pgmap v71: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 399 op/s 2024-09-15T22:47:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:39 smithi087 ceph-mon[35290]: pgmap v71: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 399 op/s 2024-09-15T22:47:40.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:47:40.715 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:41.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.297+0000 7f5e67bb4640 1 -- 172.21.15.66:0/4244315337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60100e20 msgr2=0x7f5e60101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.297+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/4244315337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60100e20 0x7f5e60101200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e5002a4d0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 -- 172.21.15.66:0/4244315337 shutdown_connections 2024-09-15T22:47:41.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/4244315337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102ef0 0x7f5e60069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/4244315337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60102570 0x7f5e601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/4244315337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60100e20 0x7f5e60101200 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 -- 172.21.15.66:0/4244315337 >> 172.21.15.66:0/4244315337 conn(0x7f5e600fc7d0 msgr2=0x7f5e600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 -- 172.21.15.66:0/4244315337 shutdown_connections 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.298+0000 7f5e67bb4640 1 -- 172.21.15.66:0/4244315337 wait complete. 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 Processor -- start 2024-09-15T22:47:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 -- start start 2024-09-15T22:47:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 0x7f5e600737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 0x7f5e60073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 0x7f5e6006c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601142e0 con 0x7f5e60102ef0 2024-09-15T22:47:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60114160 con 0x7f5e60100e20 2024-09-15T22:47:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.299+0000 7f5e67bb4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60114460 con 0x7f5e60102570 2024-09-15T22:47:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.300+0000 7f5e6514f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 0x7f5e60073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.301+0000 7f5e66151640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 0x7f5e6006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.301+0000 7f5e66151640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 0x7f5e6006c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43974/0 (socket says 172.21.15.66:43974) 2024-09-15T22:47:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.301+0000 7f5e66151640 1 -- 172.21.15.66:0/858021704 learned_addr learned my addr 172.21.15.66:0/858021704 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e65950640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 0x7f5e600737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e6514f640 1 -- 172.21.15.66:0/858021704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 msgr2=0x7f5e600737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e6514f640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 0x7f5e600737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e6514f640 1 -- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 msgr2=0x7f5e6006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e6514f640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 0x7f5e6006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e6514f640 1 -- 172.21.15.66:0/858021704 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6006d1d0 con 0x7f5e60102570 2024-09-15T22:47:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.302+0000 7f5e65950640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 0x7f5e600737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:41.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.305+0000 7f5e6514f640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 0x7f5e60073d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c970 tx=0x7f5e5c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.305+0000 7f5e56ffd640 1 -- 172.21.15.66:0/858021704 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c007bb0 con 0x7f5e60102570 2024-09-15T22:47:41.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.305+0000 7f5e56ffd640 1 -- 172.21.15.66:0/858021704 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5c007d50 con 0x7f5e60102570 2024-09-15T22:47:41.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.305+0000 7f5e56ffd640 1 -- 172.21.15.66:0/858021704 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c018820 con 0x7f5e60102570 2024-09-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.308+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6006d4c0 con 0x7f5e60102570 2024-09-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.308+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e60071520 con 0x7f5e60102570 2024-09-15T22:47:41.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.314+0000 7f5e69f8d740 1 Processor -- start 2024-09-15T22:47:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.316+0000 7f5e69f8d740 1 -- start start 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 0x5651352a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 0x5651352b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56513520c2e0 con 0x5651352b1680 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5651351b3ce0 con 0x5651352a6dc0 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651352082a0 con 0x5651352a64a0 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e66151640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 0x5651352a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e65950640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e66151640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 0x5651352a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49346/0 (socket says 172.21.15.66:49346) 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e6514f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 0x5651352b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.317+0000 7f5e66151640 1 -- 172.21.15.66:0/3813301157 learned_addr learned my addr 172.21.15.66:0/3813301157 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e56ffd640 1 -- 172.21.15.66:0/858021704 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5e5c0189c0 con 0x7f5e60102570 2024-09-15T22:47:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e6514f640 1 -- 172.21.15.66:0/3813301157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 msgr2=0x5651352a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 0x5651352a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e6514f640 1 -- 172.21.15.66:0/3813301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 msgr2=0x5651352b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.318+0000 7f5e6514f640 1 -- 172.21.15.66:0/3813301157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565135198440 con 0x5651352b1680 2024-09-15T22:47:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.320+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 0x5651352b3a70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0cd340 tx=0x7f5e5c0d85f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727a35ce20ddb537 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.321+0000 7f5e56ffd640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 0x7f5e4c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.322+0000 7f5e56ffd640 1 -- 172.21.15.66:0/858021704 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5e5c0d0020 con 0x7f5e60102570 2024-09-15T22:47:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.322+0000 7f5e4bfff640 1 -- 172.21.15.66:0/3813301157 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0e3070 con 0x5651352b1680 2024-09-15T22:47:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.322+0000 7f5e4bfff640 1 -- 172.21.15.66:0/3813301157 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5c09c650 con 0x5651352b1680 2024-09-15T22:47:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.322+0000 7f5e4bfff640 1 -- 172.21.15.66:0/3813301157 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c09ba90 con 0x5651352b1680 2024-09-15T22:47:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.322+0000 7f5e66151640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 0x7f5e4c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3813301157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 msgr2=0x5651352b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 0x5651352b3a70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0cd340 tx=0x7f5e5c0d85f0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e66151640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 0x7f5e4c0a5a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e58010540 tx=0x7f5e580075e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3813301157 shutdown_connections 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352b1680 0x5651352b3a70 secure :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0cd340 tx=0x7f5e5c0d85f0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3813301157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352a64a0 0x5651352a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.323+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3813301157 >> 172.21.15.66:0/3813301157 conn(0x5651352a2a30 msgr2=0x5651352a2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.324+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3813301157 shutdown_connections 2024-09-15T22:47:41.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.324+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3813301157 wait complete. 2024-09-15T22:47:41.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.324+0000 7f5e69f8d740 1 -- start start 2024-09-15T22:47:41.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 Processor -- start 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5651352b4250 con 0x5651352a64a0 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5651351c7050 con 0x5651352a6dc0 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651352b43d0 con 0x5651352aef50 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e69f8d740 10 client.0 _ll_register_callbacks cb 0x565135207160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44000/0 (socket says 172.21.15.66:44000) 2024-09-15T22:47:41.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.325+0000 7f5e65950640 1 -- 172.21.15.66:0/3959981361 learned_addr learned my addr 172.21.15.66:0/3959981361 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:41.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e65950640 1 -- 172.21.15.66:0/3959981361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 msgr2=0x5651352bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e66151640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e65950640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e65950640 1 -- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 msgr2=0x5651352aea10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:47:41.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e65950640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352aea10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.326+0000 7f5e65950640 1 -- 172.21.15.66:0/3959981361 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565134f7d3c0 con 0x5651352a64a0 2024-09-15T22:47:41.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.327+0000 7f5e497fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:41.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.327+0000 7f5e65950640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7c7fffd17e550e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50041070 con 0x5651352a64a0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e5c09c650 con 0x5651352a64a0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5e50004250 con 0x5651352a64a0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e50041070 con 0x5651352a64a0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e69f8d740 10 client.16029 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.328+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5651352c0280 con 0x5651352a64a0 2024-09-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5c09c650 con 0x5651352a64a0 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f5e50003a60 con 0x5651352a64a0 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 10 client.16029 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 20 client.16029 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5651352c1b00 0x5651352c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 4 client.16029 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.329+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565135219850 con 0x5651352c1b00 2024-09-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.330+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5651352c1b00 0x5651352c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.331+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5651352c1b00 0x5651352c3fa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=244b21676fd046f2 server_cookie=ff6c57d2c6463421 in_seq=0 out_seq=0 2024-09-15T22:47:41.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.331+0000 7f5e497fa640 10 client.16029 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:41.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.332+0000 7f5e497fa640 1 -- 172.21.15.66:0/3959981361 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565135219850 con 0x5651352c1b00 2024-09-15T22:47:41.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.332+0000 7f5e497fa640 10 client.16029 handle_command_reply: tid=0 2024-09-15T22:47:41.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 client.16029 shutdown 2024-09-15T22:47:41.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 msgr2=0x5651352ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50004960 comp rx=0 tx=0).stop 2024-09-15T22:47:41.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 shutdown_connections 2024-09-15T22:47:41.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5651352c1b00 0x5651352c3fa0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352a6dc0 0x5651352aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.333+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3959981361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a64a0 0x5651352ae4d0 secure :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50004960 comp rx=0 tx=0).stop 2024-09-15T22:47:41.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.334+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 >> 172.21.15.66:0/3959981361 conn(0x5651352a2a30 msgr2=0x5651352a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.334+0000 7f5e497fa640 0 client.16029 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:41.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.334+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 shutdown_connections 2024-09-15T22:47:41.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.334+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3959981361 wait complete. 2024-09-15T22:47:41.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.334+0000 7f5e69f8d740 20 client.16029 trim_cache size 0 max 16384 2024-09-15T22:47:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.369+0000 7f5e69f8d740 1 Processor -- start 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 -- start start 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352aef50 0x5651352bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44010/0 (socket says 172.21.15.66:44010) 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352ad5c0 0x5651352bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e65950640 1 -- 172.21.15.66:0/3243656244 learned_addr learned my addr 172.21.15.66:0/3243656244 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b9a60 con 0x5651352a6dc0 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601bb720 con 0x5651352aef50 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601ba130 con 0x5651352ad5c0 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e6514f640 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352aef50 0x5651352bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.370+0000 7f5e66151640 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352ad5c0 0x5651352bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 -- 172.21.15.66:0/3243656244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352ad5c0 msgr2=0x5651352bd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352ad5c0 0x5651352bd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 -- 172.21.15.66:0/3243656244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352aef50 msgr2=0x5651352bd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352aef50 0x5651352bd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 -- 172.21.15.66:0/3243656244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651352aca20 con 0x5651352a6dc0 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e65950640 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f110a21931c634a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e4b7fe640 1 -- 172.21.15.66:0/3243656244 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50045890 con 0x5651352a6dc0 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e4b7fe640 1 -- 172.21.15.66:0/3243656244 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5003b3b0 con 0x5651352a6dc0 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.371+0000 7f5e4b7fe640 1 -- 172.21.15.66:0/3243656244 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5003cc40 con 0x5651352a6dc0 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 msgr2=0x5651352a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e50005fd0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 shutdown_connections 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352ad5c0 0x5651352bd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352aef50 0x5651352bd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/3243656244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352a8650 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 >> 172.21.15.66:0/3243656244 conn(0x5651352a2a30 msgr2=0x5651352a7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 shutdown_connections 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- 172.21.15.66:0/3243656244 wait complete. 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.372+0000 7f5e69f8d740 1 -- start start 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 Processor -- start 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 0x5651352b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601baf90 con 0x5651352a6dc0 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601ba800 con 0x5651352ad5c0 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b7a40 con 0x5651352aef50 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e69f8d740 10 client.0 _ll_register_callbacks cb 0x7f5e50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e6514f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 0x5651352b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e65950640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44014/0 (socket says 172.21.15.66:44014) 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.373+0000 7f5e65950640 1 -- 172.21.15.66:0/2776070884 learned_addr learned my addr 172.21.15.66:0/2776070884 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e66151640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 -- 172.21.15.66:0/2776070884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 msgr2=0x5651352b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 -- 172.21.15.66:0/2776070884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 msgr2=0x5651352b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 -- 172.21.15.66:0/2776070884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651352b5820 con 0x5651352ad5c0 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e66151640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e65950640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e6514f640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 0x5651352b4da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c09c800 tx=0x7f5e5c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78eb9a3f8434e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e497fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c018cb0 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5e5c0d3c00 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.374+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e5003b3b0 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e5c09b8b0 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 10 client.25592 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56513532c580 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5003b3b0 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f5e5c020020 con 0x5651352ad5c0 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 10 client.25592 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 20 client.25592 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56513532caf0 0x56513532eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 4 client.25592 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:47:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565135213d60 con 0x56513532caf0 2024-09-15T22:47:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.375+0000 7f5e65950640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56513532caf0 0x56513532eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.376+0000 7f5e65950640 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56513532caf0 0x56513532eee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4009675252981bfc server_cookie=4a9f343609be0cc0 in_seq=0 out_seq=0 2024-09-15T22:47:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.376+0000 7f5e497fa640 10 client.25592 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:41.380 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:41 smithi066 ceph-mon[31185]: pgmap v72: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.3 MiB/s wr, 365 op/s 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e497fa640 1 -- 172.21.15.66:0/2776070884 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x565135213d60 con 0x56513532caf0 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e497fa640 10 client.25592 handle_command_reply: tid=0 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 client.25592 shutdown 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 msgr2=0x5651352b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 0x5651352b4da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c09c800 tx=0x7f5e5c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 shutdown_connections 2024-09-15T22:47:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651352aef50 0x5651352b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56513532caf0 0x56513532eee0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5651352ad5c0 0x5651352b4da0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 --2- 172.21.15.66:0/2776070884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5651352a6dc0 0x5651352b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 >> 172.21.15.66:0/2776070884 conn(0x5651352a2a30 msgr2=0x5651352a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e497fa640 0 client.25592 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 shutdown_connections 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 1 -- 172.21.15.66:0/2776070884 wait complete. 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.377+0000 7f5e69f8d740 20 client.25592 trim_cache size 0 max 16384 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:41.382 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:47:41.383 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:47:41.383 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 msgr2=0x7f5e4c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 0x7f5e4c0a5a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e58010540 tx=0x7f5e580075e0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 msgr2=0x7f5e60073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 0x7f5e60073d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c970 tx=0x7f5e5c00ce30 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 shutdown_connections 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5e4c0a35c0 0x7f5e4c0a5a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e60102ef0 0x7f5e6006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e60102570 0x7f5e60073d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 --2- 172.21.15.66:0/858021704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e60100e20 0x7f5e600737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 >> 172.21.15.66:0/858021704 conn(0x7f5e600fc7d0 msgr2=0x7f5e6010e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 shutdown_connections 2024-09-15T22:47:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:41.378+0000 7f5e67bb4640 1 -- 172.21.15.66:0/858021704 wait complete. 2024-09-15T22:47:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:41 smithi184 ceph-mon[35203]: pgmap v72: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.3 MiB/s wr, 365 op/s 2024-09-15T22:47:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:41 smithi087 ceph-mon[35290]: pgmap v72: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.3 MiB/s wr, 365 op/s 2024-09-15T22:47:42.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:47:42.186 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:47:42.487 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 -- 172.21.15.66:0/2212177920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8103780 msgr2=0x7ff7e8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/2212177920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8103780 0x7ff7e8107bc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009cd0 tx=0x7ff7d802a8d0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 -- 172.21.15.66:0/2212177920 shutdown_connections 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/2212177920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8108300 0x7ff7e810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/2212177920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8103780 0x7ff7e8107bc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/2212177920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 0x7ff7e81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 -- 172.21.15.66:0/2212177920 >> 172.21.15.66:0/2212177920 conn(0x7ff7e80fc7d0 msgr2=0x7ff7e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 -- 172.21.15.66:0/2212177920 shutdown_connections 2024-09-15T22:47:42.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.984+0000 7ff7eed7d640 1 -- 172.21.15.66:0/2212177920 wait complete. 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 Processor -- start 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 -- start start 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 0x7ff7e8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 0x7ff7e8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8112050 con 0x7ff7e8108300 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8111ed0 con 0x7ff7e8103780 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7eed7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81121d0 con 0x7ff7e8102dd0 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 0x7ff7e8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45886/0 (socket says 172.21.15.66:45886) 2024-09-15T22:47:42.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ecb19640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 0x7ff7e8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 0x7ff7e8100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:38672/0 (socket says 172.21.15.66:38672) 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 -- 172.21.15.66:0/1417894562 learned_addr learned my addr 172.21.15.66:0/1417894562 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 -- 172.21.15.66:0/1417894562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 msgr2=0x7ff7e8100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 0x7ff7e8100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 -- 172.21.15.66:0/1417894562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 msgr2=0x7ff7e8100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 0x7ff7e8100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 -- 172.21.15.66:0/1417894562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e81a6ab0 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.985+0000 7ff7ed31a640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e9b0 tx=0x7ff7e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.986+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000cd80 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.986+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e81a6da0 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.986+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e00035f0 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.986+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0010670 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.986+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e81a72b0 con 0x7ff7e8108300 2024-09-15T22:47:42.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.987+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e81031b0 con 0x7ff7e8108300 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.988+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff7e00037a0 con 0x7ff7e8108300 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.989+0000 7ff7e5ffb640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 0x7ff7d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.989+0000 7ff7ecb19640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 0x7ff7d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.989+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff7e00d0370 con 0x7ff7e8108300 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.989+0000 7ff7ecb19640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 0x7ff7d40a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009bd0 tx=0x7ff7d0005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:42.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:42.993+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7e009c980 con 0x7ff7e8108300 2024-09-15T22:47:43.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:43 smithi066 ceph-mon[31185]: pgmap v73: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-15T22:47:43.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.212+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7e810a290 con 0x7ff7e8108300 2024-09-15T22:47:43.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.212+0000 7ff7e5ffb640 1 -- 172.21.15.66:0/1417894562 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7ff7e009c280 con 0x7ff7e8108300 2024-09-15T22:47:43.214 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:47:43.214 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:47:43.214 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 msgr2=0x7ff7d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 0x7ff7d40a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009bd0 tx=0x7ff7d0005f90 comp rx=0 tx=0).stop 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 msgr2=0x7ff7e81014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e9b0 tx=0x7ff7e000ee70 comp rx=0 tx=0).stop 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 shutdown_connections 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7d40a33b0 0x7ff7d40a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7e8108300 0x7ff7e81014b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7e8103780 0x7ff7e8100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 --2- 172.21.15.66:0/1417894562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7e8102dd0 0x7ff7e8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:43.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 >> 172.21.15.66:0/1417894562 conn(0x7ff7e80fc7d0 msgr2=0x7ff7e8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:43.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 shutdown_connections 2024-09-15T22:47:43.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:43.215+0000 7ff7eed7d640 1 -- 172.21.15.66:0/1417894562 wait complete. 2024-09-15T22:47:43.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:43 smithi087 ceph-mon[35290]: pgmap v73: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-15T22:47:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:43 smithi184 ceph-mon[35203]: pgmap v73: 129 pgs: 129 active+clean; 280 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-15T22:47:44.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:47:44.361 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:44 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1417894562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:44 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1417894562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:44.582 INFO:tasks.workunit.client.0.smithi066.stdout: 79 367377 363 244301 309 78707 246 2024-09-15T22:47:44.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:44 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1417894562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/532250774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa28102d30 msgr2=0x7ffa28103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/532250774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa28102d30 0x7ffa28103110 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009930 tx=0x7ffa1802a420 comp rx=0 tx=0).stop 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/532250774 shutdown_connections 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/532250774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 0x7ffa2810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/532250774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa281036e0 0x7ffa28107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/532250774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa28102d30 0x7ffa28103110 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/532250774 >> 172.21.15.66:0/532250774 conn(0x7ffa280fc7d0 msgr2=0x7ffa280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/532250774 shutdown_connections 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.866+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/532250774 wait complete. 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 Processor -- start 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 -- start start 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa28102d30 0x7ffa281985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 0x7ffa2819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281120a0 con 0x7ffa281036e0 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28111f20 con 0x7ffa281082a0 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.867+0000 7ffa2d0cf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28112220 con 0x7ffa28102d30 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45910/0 (socket says 172.21.15.66:45910) 2024-09-15T22:47:44.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 -- 172.21.15.66:0/3723883889 learned_addr learned my addr 172.21.15.66:0/3723883889 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa28102d30 0x7ffa281985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2759e640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 0x7ffa2819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 -- 172.21.15.66:0/3723883889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa28102d30 msgr2=0x7ffa281985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa28102d30 0x7ffa281985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 -- 172.21.15.66:0/3723883889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 msgr2=0x7ffa2819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 0x7ffa2819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 -- 172.21.15.66:0/3723883889 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2819d570 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e9f0 tx=0x7ffa1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa0ffff640 1 -- 172.21.15.66:0/3723883889 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ccc0 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2819d860 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa0ffff640 1 -- 172.21.15.66:0/3723883889 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa1c010910 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa0ffff640 1 -- 172.21.15.66:0/3723883889 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0188a0 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.868+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa281a5140 con 0x7ffa281036e0 2024-09-15T22:47:44.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 Processor -- start 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa0ffff640 1 -- 172.21.15.66:0/3723883889 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ffa1c018a40 con 0x7ffa281036e0 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 -- start start 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5601a2ce12f0 con 0x5601a2d7b5d0 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5601a2c88cf0 con 0x5601a2d86370 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5601a2cdd2b0 con 0x5601a2d7cb40 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45912/0 (socket says 172.21.15.66:45912) 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa26d9d640 1 -- 172.21.15.66:0/2179267415 learned_addr learned my addr 172.21.15.66:0/2179267415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2759e640 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.871+0000 7ffa2659c640 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 -- 172.21.15.66:0/2179267415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 msgr2=0x5601a2d7b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 -- 172.21.15.66:0/2179267415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 msgr2=0x5601a2d88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 -- 172.21.15.66:0/2179267415 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a2c6d3a0 con 0x5601a2d7b5d0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa0ffff640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 0x7ffa100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa2759e640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 0x7ffa100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa1802a940 tx=0x7ffa18005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7929ebd2f9cce885 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa0ffff640 1 -- 172.21.15.66:0/3723883889 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ffa1c0d04c0 con 0x7ffa281036e0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa0d7fa640 1 -- 172.21.15.66:0/2179267415 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18040070 con 0x5601a2d7b5d0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa0d7fa640 1 -- 172.21.15.66:0/2179267415 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa18031870 con 0x5601a2d7b5d0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.872+0000 7ffa0d7fa640 1 -- 172.21.15.66:0/2179267415 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18035040 con 0x5601a2d7b5d0 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/2179267415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 msgr2=0x5601a2d7ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2759e640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 0x7ffa100a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005fd0 tx=0x7ffa20009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffa1802a940 tx=0x7ffa18005bd0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/2179267415 shutdown_connections 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d7ba10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/2179267415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/2179267415 >> 172.21.15.66:0/2179267415 conn(0x5601a2d44310 msgr2=0x5601a2d77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/2179267415 shutdown_connections 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/2179267415 wait complete. 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 -- start start 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.873+0000 7ffa2f4a8740 1 Processor -- start 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d82ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5601a2d89010 con 0x5601a2d7b5d0 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5601a2c9c060 con 0x5601a2d7cb40 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5601a2d89190 con 0x5601a2d86370 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2f4a8740 10 client.0 _ll_register_callbacks cb 0x5601a29ef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d82ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45920/0 (socket says 172.21.15.66:45920) 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa26d9d640 1 -- 172.21.15.66:0/3707802875 learned_addr learned my addr 172.21.15.66:0/3707802875 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2759e640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 -- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 msgr2=0x5601a2d835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d835e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 -- 172.21.15.66:0/3707802875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 msgr2=0x5601a2d85d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 -- 172.21.15.66:0/3707802875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a2a523c0 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d82ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cd840 tx=0x7ffa1c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1ca04c244ee3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.874+0000 7ffa0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c09bf10 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ffa1c0d0150 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa18031870 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffa1c09bd30 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 10 client.25610 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5601a2d94ae0 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa18031870 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7ffa1c09b820 con 0x5601a2d7cb40 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 10 client.25610 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 10 client.25610 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:47:44.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 20 client.25610 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2d95f40 0x5601a2d983c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 4 client.25610 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601a2cee860 con 0x5601a2d95f40 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.875+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2d95f40 0x5601a2d983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.876+0000 7ffa0aff5640 10 client.25610 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.876+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2d95f40 0x5601a2d983c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=571cb66fdfa96c54 server_cookie=571b89fec594c0a9 in_seq=0 out_seq=0 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.876+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3707802875 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601a2cee860 con 0x5601a2d95f40 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.876+0000 7ffa0aff5640 10 client.25610 handle_command_reply: tid=0 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 client.25610 shutdown 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 msgr2=0x5601a2d82ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d82ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cd840 tx=0x7ffa1c00cef0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 shutdown_connections 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2d95f40 0x5601a2d983c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa0aff5640 0 client.25610 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d82ff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3707802875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d85d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 >> 172.21.15.66:0/3707802875 conn(0x5601a2d44310 msgr2=0x5601a2d7d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 shutdown_connections 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3707802875 wait complete. 2024-09-15T22:47:44.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.877+0000 7ffa2f4a8740 20 client.25610 trim_cache size 0 max 16384 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 Processor -- start 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 -- start start 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d7e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281af1a0 con 0x5601a2d7b5d0 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281b0e60 con 0x5601a2d86370 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281af870 con 0x5601a2d7cb40 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45928/0 (socket says 172.21.15.66:45928) 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa26d9d640 1 -- 172.21.15.66:0/1430150416 learned_addr learned my addr 172.21.15.66:0/1430150416 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2759e640 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d7e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.891+0000 7ffa2659c640 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 -- 172.21.15.66:0/1430150416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 msgr2=0x5601a2d7e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 -- 172.21.15.66:0/1430150416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 msgr2=0x5601a2d7e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d7e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 -- 172.21.15.66:0/1430150416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a2d7eba0 con 0x5601a2d7b5d0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009a20 tx=0x7ffa1802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938a8f320d565d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa0cff9640 1 -- 172.21.15.66:0/1430150416 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18040050 con 0x5601a2d7b5d0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa0cff9640 1 -- 172.21.15.66:0/1430150416 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa18031900 con 0x5601a2d7b5d0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.892+0000 7ffa0cff9640 1 -- 172.21.15.66:0/1430150416 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18035040 con 0x5601a2d7b5d0 2024-09-15T22:47:44.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/1430150416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 msgr2=0x5601a2d922b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009a20 tx=0x7ffa1802a420 comp rx=0 tx=0).stop 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/1430150416 shutdown_connections 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d86370 0x5601a2d7e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d7cb40 0x5601a2d7e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/1430150416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d922b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/1430150416 >> 172.21.15.66:0/1430150416 conn(0x5601a2d44310 msgr2=0x5601a2d820e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/1430150416 shutdown_connections 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/1430150416 wait complete. 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 -- start start 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 Processor -- start 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.893+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d89e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d8a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281b06d0 con 0x5601a2d7b5d0 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281aff40 con 0x5601a2d7cb40 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281ad180 con 0x5601a2d86370 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 10 client.0 _ll_register_callbacks cb 0x7ffa1c0d3d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa26d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45940/0 (socket says 172.21.15.66:45940) 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa26d9d640 1 -- 172.21.15.66:0/3846321567 learned_addr learned my addr 172.21.15.66:0/3846321567 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d89e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 -- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 msgr2=0x5601a2d8a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d8a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 -- 172.21.15.66:0/3846321567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 msgr2=0x5601a2d8ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 -- 172.21.15.66:0/3846321567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a2d8ac80 con 0x5601a2d7cb40 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:44.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2659c640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d89e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5601a2d845a0 tx=0x7ffa1c0096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937a8d3f57b6b5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c09bf10 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ffa1c010430 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa18031900 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffa1c09cad0 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.894+0000 7ffa2f4a8740 10 client.25616 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5601a2e09580 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa18031900 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7ffa1c0a1910 con 0x5601a2d7cb40 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 10 client.25616 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 10 client.25616 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 20 client.25616 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2e09b20 0x5601a2e0bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:44.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 4 client.25616 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601a2ce8d70 con 0x5601a2e09b20 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2e09b20 0x5601a2e0bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa26d9d640 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2e09b20 0x5601a2e0bf40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d7c2a6c6799f36af server_cookie=83c423f3751ad4f in_seq=0 out_seq=0 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.895+0000 7ffa0aff5640 10 client.25616 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa0aff5640 1 -- 172.21.15.66:0/3846321567 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601a2ce8d70 con 0x5601a2e09b20 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa0aff5640 10 client.25616 handle_command_reply: tid=0 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 client.25616 shutdown 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 msgr2=0x5601a2d89e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d89e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5601a2d845a0 tx=0x7ffa1c0096a0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 shutdown_connections 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5601a2e09b20 0x5601a2e0bf40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601a2d86370 0x5601a2d8a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5601a2d7cb40 0x5601a2d89e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 --2- 172.21.15.66:0/3846321567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601a2d7b5d0 0x5601a2d8ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa0aff5640 0 client.25616 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 >> 172.21.15.66:0/3846321567 conn(0x5601a2d44310 msgr2=0x5601a2d764e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 shutdown_connections 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 1 -- 172.21.15.66:0/3846321567 wait complete. 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.896+0000 7ffa2f4a8740 20 client.25616 trim_cache size 0 max 16384 2024-09-15T22:47:44.906 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 msgr2=0x7ffa100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 0x7ffa100a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005fd0 tx=0x7ffa20009500 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 msgr2=0x7ffa28198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e9f0 tx=0x7ffa1c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 shutdown_connections 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ffa100a33b0 0x7ffa100a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa281082a0 0x7ffa2819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa281036e0 0x7ffa28198b00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 --2- 172.21.15.66:0/3723883889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa28102d30 0x7ffa281985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:44.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 >> 172.21.15.66:0/3723883889 conn(0x7ffa280fc7d0 msgr2=0x7ffa28105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:44.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 shutdown_connections 2024-09-15T22:47:44.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:44.897+0000 7ffa2d0cf640 1 -- 172.21.15.66:0/3723883889 wait complete. 2024-09-15T22:47:45.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:45 smithi184 ceph-mon[35203]: pgmap v74: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 655 op/s 2024-09-15T22:47:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:45 smithi066 ceph-mon[31185]: pgmap v74: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 655 op/s 2024-09-15T22:47:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:45 smithi087 ceph-mon[35290]: pgmap v74: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 655 op/s 2024-09-15T22:47:46.362 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:47:46.627 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:47.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 -- 172.21.15.66:0/3750249214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 msgr2=0x7ff62010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 --2- 172.21.15.66:0/3750249214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff62010da40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff618009ca0 tx=0x7ff61802a950 comp rx=0 tx=0).stop 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 -- 172.21.15.66:0/3750249214 shutdown_connections 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 --2- 172.21.15.66:0/3750249214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff62010da40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 --2- 172.21.15.66:0/3750249214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff6201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 --2- 172.21.15.66:0/3750249214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 -- 172.21.15.66:0/3750249214 >> 172.21.15.66:0/3750249214 conn(0x7ff6200fc7d0 msgr2=0x7ff6200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 -- 172.21.15.66:0/3750249214 shutdown_connections 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 -- 172.21.15.66:0/3750249214 wait complete. 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.090+0000 7ff6267cc640 1 Processor -- start 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 -- start start 2024-09-15T22:47:47.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff620199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff620110fd0 con 0x7ff620102ef0 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff620110e50 con 0x7ff620100e20 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff6267cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff620111150 con 0x7ff620102570 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45960/0 (socket says 172.21.15.66:45960) 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff620199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 -- 172.21.15.66:0/1773098255 learned_addr learned my addr 172.21.15.66:0/1773098255 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 -- 172.21.15.66:0/1773098255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 msgr2=0x7ff620199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff620199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 -- 172.21.15.66:0/1773098255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 msgr2=0x7ff620199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff624d69640 1 -- 172.21.15.66:0/1773098255 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6201a48c0 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff620199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.091+0000 7ff61ffff640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff624d69640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff618009dc0 tx=0x7ff618003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff61d7fa640 1 -- 172.21.15.66:0/1773098255 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618034040 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff61d7fa640 1 -- 172.21.15.66:0/1773098255 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff61802f930 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff61d7fa640 1 -- 172.21.15.66:0/1773098255 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6180046a0 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6201a4a90 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.092+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201a4f70 con 0x7ff620102ef0 2024-09-15T22:47:47.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.094+0000 7ff61d7fa640 1 -- 172.21.15.66:0/1773098255 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff618037020 con 0x7ff620102ef0 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 Processor -- start 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 -- start start 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a737090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a737a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 0x55700a744760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55700a69d2f0 con 0x55700a742370 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55700a644cf0 con 0x55700a738b40 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff628ba5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55700a6992b0 con 0x55700a7375d0 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61d7fa640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 0x7ff6080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 0x55700a744760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 0x55700a744760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45974/0 (socket says 172.21.15.66:45974) 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a737a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61f7fe640 1 -- 172.21.15.66:0/2062302258 learned_addr learned my addr 172.21.15.66:0/2062302258 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a737090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff624d69640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 0x7ff6080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61d7fa640 1 -- 172.21.15.66:0/1773098255 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff6180f0d00 con 0x7ff620102ef0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 -- 172.21.15.66:0/2062302258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 msgr2=0x55700a737090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a737090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 -- 172.21.15.66:0/2062302258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 msgr2=0x55700a744760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 0x55700a744760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.095+0000 7ff61ffff640 1 -- 172.21.15.66:0/2062302258 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700a6293a0 con 0x55700a7375d0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.096+0000 7ff61ffff640 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a737a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff610009fd0 tx=0x7ff6100118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad738893424b7299 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.096+0000 7ff624d69640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 0x7ff6080a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff6180ee240 tx=0x7ff618003f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.096+0000 7ff6067fc640 1 -- 172.21.15.66:0/2062302258 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610004030 con 0x55700a7375d0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.096+0000 7ff6067fc640 1 -- 172.21.15.66:0/2062302258 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff610005500 con 0x55700a7375d0 2024-09-15T22:47:47.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.096+0000 7ff6067fc640 1 -- 172.21.15.66:0/2062302258 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610004d50 con 0x55700a7375d0 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- 172.21.15.66:0/2062302258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 msgr2=0x55700a737a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a737a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff610009fd0 tx=0x7ff6100118d0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- 172.21.15.66:0/2062302258 shutdown_connections 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a742370 0x55700a744760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a737a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- 172.21.15.66:0/2062302258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a737090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- 172.21.15.66:0/2062302258 >> 172.21.15.66:0/2062302258 conn(0x55700a700310 msgr2=0x55700a733c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- 172.21.15.66:0/2062302258 shutdown_connections 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- 172.21.15.66:0/2062302258 wait complete. 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 -- start start 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 Processor -- start 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.097+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 0x55700a73ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a742370 0x55700a73f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55700a745070 con 0x55700a7375d0 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55700a658060 con 0x55700a742370 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55700a7451f0 con 0x55700a738b40 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 10 client.0 _ll_register_callbacks cb 0x55700a3ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 0x55700a73ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45986/0 (socket says 172.21.15.66:45986) 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61f7fe640 1 -- 172.21.15.66:0/1306580375 learned_addr learned my addr 172.21.15.66:0/1306580375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a742370 0x55700a73f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 -- 172.21.15.66:0/1306580375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a742370 msgr2=0x55700a73f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a742370 0x55700a73f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 -- 172.21.15.66:0/1306580375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 msgr2=0x55700a741c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 -- 172.21.15.66:0/1306580375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700a40e3c0 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff61ffff640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 0x55700a73ef00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff610011dd0 tx=0x7ff6100038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=217dbbb505678da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff5ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100046c0 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff610005500 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.098+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff610003ca0 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6100056b0 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 10 client.25603 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55700a750a80 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff610005500 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7ff61000f5a0 con 0x55700a738b40 2024-09-15T22:47:47.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 10 client.25603 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 10 client.25603 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 20 client.25603 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a751dd0 0x55700a7541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 4 client.25603 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55700a6aa860 con 0x55700a751dd0 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.099+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a751dd0 0x55700a7541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.100+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a751dd0 0x55700a7541c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=351268c342ef0cc0 server_cookie=f5abd95273e5d77b in_seq=0 out_seq=0 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.100+0000 7ff5ff7fe640 10 client.25603 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.100+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/1306580375 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55700a6aa860 con 0x55700a751dd0 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.100+0000 7ff5ff7fe640 10 client.25603 handle_command_reply: tid=0 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.100+0000 7ff628ba5740 1 client.25603 shutdown 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 msgr2=0x55700a73ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 0x55700a73ef00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff610011dd0 tx=0x7ff6100038a0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 shutdown_connections 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a751dd0 0x55700a7541c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a742370 0x55700a73f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a738b40 0x55700a73ef00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 --2- 172.21.15.66:0/1306580375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a741c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff5ff7fe640 0 client.25603 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 >> 172.21.15.66:0/1306580375 conn(0x55700a700310 msgr2=0x55700a739960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 shutdown_connections 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 1 -- 172.21.15.66:0/1306580375 wait complete. 2024-09-15T22:47:47.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.101+0000 7ff628ba5740 20 client.25603 trim_cache size 0 max 16384 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 Processor -- start 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 -- start start 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a744330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201aced0 con 0x55700a7375d0 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201aeb90 con 0x55700a738b40 2024-09-15T22:47:47.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff628ba5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201ad5a0 con 0x55700a700310 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a744330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56140/0 (socket says 172.21.15.66:56140) 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a744330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45992/0 (socket says 172.21.15.66:45992) 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 -- 172.21.15.66:0/249828431 learned_addr learned my addr 172.21.15.66:0/249828431 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 -- 172.21.15.66:0/249828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 msgr2=0x55700a743760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 -- 172.21.15.66:0/249828431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 msgr2=0x55700a744330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a744330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.114+0000 7ff61f7fe640 1 -- 172.21.15.66:0/249828431 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55700a734960 con 0x55700a700310 2024-09-15T22:47:47.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6140058c0 tx=0x7ff614005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc0b0e80a3da00c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff605ffb640 1 -- 172.21.15.66:0/249828431 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614024040 con 0x55700a700310 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff605ffb640 1 -- 172.21.15.66:0/249828431 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff614005500 con 0x55700a700310 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff605ffb640 1 -- 172.21.15.66:0/249828431 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614022440 con 0x55700a700310 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 -- 172.21.15.66:0/249828431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 msgr2=0x55700a74e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6140058c0 tx=0x7ff614005850 comp rx=0 tx=0).stop 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 -- 172.21.15.66:0/249828431 shutdown_connections 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a7375d0 0x55700a744330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 --2- 172.21.15.66:0/249828431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a700310 0x55700a74e370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 -- 172.21.15.66:0/249828431 >> 172.21.15.66:0/249828431 conn(0x55700a73f5a0 msgr2=0x55700a740f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 -- 172.21.15.66:0/249828431 shutdown_connections 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.115+0000 7ff628ba5740 1 -- 172.21.15.66:0/249828431 wait complete. 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 -- start start 2024-09-15T22:47:47.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 Processor -- start 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 0x55700a74ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a743430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201ae400 con 0x55700a700310 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201adc70 con 0x55700a738b40 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201aaeb0 con 0x55700a7375d0 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff628ba5740 10 client.0 _ll_register_callbacks cb 0x7ff614009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 0x55700a74ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff61f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 0x55700a74ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45996/0 (socket says 172.21.15.66:45996) 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff61f7fe640 1 -- 172.21.15.66:0/3410255549 learned_addr learned my addr 172.21.15.66:0/3410255549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.116+0000 7ff61ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a743430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 -- 172.21.15.66:0/3410255549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 msgr2=0x55700a743970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 -- 172.21.15.66:0/3410255549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 msgr2=0x55700a74ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 0x55700a74ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 -- 172.21.15.66:0/3410255549 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55700a7441a0 con 0x55700a7375d0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff61ffff640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a743430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff61000f970 tx=0x7ff6100039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0c4c02e4774935 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff5ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61000fbe0 con 0x55700a7375d0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff61000fd80 con 0x55700a7375d0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff614005500 con 0x55700a7375d0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6100053a0 con 0x55700a7375d0 2024-09-15T22:47:47.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff628ba5740 10 client.25609 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.117+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55700a7bc920 con 0x55700a7375d0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff614005500 con 0x55700a7375d0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7ff610019450 con 0x55700a7375d0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 10 client.25609 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 10 client.25609 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 20 client.25609 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a742370 0x55700a7bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 4 client.25609 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55700a6a4d70 con 0x55700a742370 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a742370 0x55700a7bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff61f7fe640 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a742370 0x55700a7bf0b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e09c4cebe88e771a server_cookie=c3bc60b1f9f2e61 in_seq=0 out_seq=0 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff5ff7fe640 10 client.25609 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:47:47.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff5ff7fe640 1 -- 172.21.15.66:0/3410255549 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55700a6a4d70 con 0x55700a742370 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff5ff7fe640 10 client.25609 handle_command_reply: tid=0 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.118+0000 7ff628ba5740 1 client.25609 shutdown 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 msgr2=0x55700a743430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a743430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff61000f970 tx=0x7ff6100039e0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 shutdown_connections 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55700a742370 0x55700a7bf0b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55700a738b40 0x55700a743970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55700a7375d0 0x55700a743430 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff5ff7fe640 0 client.25609 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 --2- 172.21.15.66:0/3410255549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55700a700310 0x55700a74ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 >> 172.21.15.66:0/3410255549 conn(0x55700a73f5a0 msgr2=0x55700a7324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 shutdown_connections 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 1 -- 172.21.15.66:0/3410255549 wait complete. 2024-09-15T22:47:47.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff628ba5740 20 client.25609 trim_cache size 0 max 16384 2024-09-15T22:47:47.128 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:47.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 msgr2=0x7ff6080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 0x7ff6080a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff6180ee240 tx=0x7ff618003f90 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 msgr2=0x7ff6201a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.119+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff618009dc0 tx=0x7ff618003c10 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 shutdown_connections 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6080a3430 0x7ff6080a58f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff620102ef0 0x7ff6201a4380 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102570 0x7ff620199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 --2- 172.21.15.66:0/1773098255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff620100e20 0x7ff620199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 >> 172.21.15.66:0/1773098255 conn(0x7ff6200fc7d0 msgr2=0x7ff620106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:47.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 shutdown_connections 2024-09-15T22:47:47.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:47.120+0000 7ff6267cc640 1 -- 172.21.15.66:0/1773098255 wait complete. 2024-09-15T22:47:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:47 smithi184 ceph-mon[35203]: pgmap v75: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 619 op/s 2024-09-15T22:47:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:47 smithi066 ceph-mon[31185]: pgmap v75: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 619 op/s 2024-09-15T22:47:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:47 smithi087 ceph-mon[35290]: pgmap v75: 129 pgs: 129 active+clean; 323 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 619 op/s 2024-09-15T22:47:47.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:47:48.145 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:48.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 -- 172.21.15.66:0/1375628892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0101420 msgr2=0x7f80c010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 --2- 172.21.15.66:0/1375628892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0101420 0x7f80c010d950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009930 tx=0x7f80b802a420 comp rx=0 tx=0).stop 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 -- 172.21.15.66:0/1375628892 shutdown_connections 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 --2- 172.21.15.66:0/1375628892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0101420 0x7f80c010d950 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 --2- 172.21.15.66:0/1375628892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0100a80 0x7f80c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 --2- 172.21.15.66:0/1375628892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0106a80 0x7f80c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 -- 172.21.15.66:0/1375628892 >> 172.21.15.66:0/1375628892 conn(0x7f80c00fc7a0 msgr2=0x7f80c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 -- 172.21.15.66:0/1375628892 shutdown_connections 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.609+0000 7f80c76bf640 1 -- 172.21.15.66:0/1375628892 wait complete. 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 Processor -- start 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 -- start start 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0101420 0x7f80c00fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0106a80 0x7f80c00fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0110e80 con 0x7f80c0100a80 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0110d00 con 0x7f80c0101420 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.610+0000 7f80c76bf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0111000 con 0x7f80c0106a80 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46010/0 (socket says 172.21.15.66:46010) 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 -- 172.21.15.66:0/3445429956 learned_addr learned my addr 172.21.15.66:0/3445429956 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0101420 0x7f80c00fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0106a80 0x7f80c00fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 -- 172.21.15.66:0/3445429956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0106a80 msgr2=0x7f80c00fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0106a80 0x7f80c00fd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 -- 172.21.15.66:0/3445429956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0101420 msgr2=0x7f80c00fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0101420 0x7f80c00fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 -- 172.21.15.66:0/3445429956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c01a6900 con 0x7f80c0100a80 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c545b640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f80b400ebc0 tx=0x7f80b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80b27fc640 1 -- 172.21.15.66:0/3445429956 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4010630 con 0x7f80c0100a80 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80b27fc640 1 -- 172.21.15.66:0/3445429956 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b4010cb0 con 0x7f80c0100a80 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c01a6bf0 con 0x7f80c0100a80 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80b27fc640 1 -- 172.21.15.66:0/3445429956 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4018bd0 con 0x7f80c0100a80 2024-09-15T22:47:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.611+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c01a7130 con 0x7f80c0100a80 2024-09-15T22:47:48.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.614+0000 7f80b27fc640 1 -- 172.21.15.66:0/3445429956 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f80b40107d0 con 0x7f80c0100a80 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.614+0000 7f80c9a98740 1 Processor -- start 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.614+0000 7f80c9a98740 1 -- start start 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a1797ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17988760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a178e12f0 con 0x564a1797b5d0 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564a17888cf0 con 0x564a1797cb40 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c9a98740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564a178dd2b0 con 0x564a17986370 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:38778/0 (socket says 172.21.15.66:38778) 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c545b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a1797ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 -- 172.21.15.66:0/4021018850 learned_addr learned my addr 172.21.15.66:0/4021018850 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:48.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17988760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80b27fc640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 0x7f80ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 -- 172.21.15.66:0/4021018850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 msgr2=0x564a17988760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17988760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 -- 172.21.15.66:0/4021018850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 msgr2=0x564a1797ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a1797ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 -- 172.21.15.66:0/4021018850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1786d3a0 con 0x564a1797cb40 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80b27fc640 1 -- 172.21.15.66:0/3445429956 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f80b40d06b0 con 0x7f80c0100a80 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.615+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 0x7f80ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.616+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009930 tx=0x7f80b8005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e64ee90ef4189be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.616+0000 7f80ab7fe640 1 -- 172.21.15.66:0/4021018850 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8035040 con 0x564a1797cb40 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.616+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 0x7f80ac0a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80b804a000 tx=0x7f80b8047000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.616+0000 7f80ab7fe640 1 -- 172.21.15.66:0/4021018850 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b8046de0 con 0x564a1797cb40 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.616+0000 7f80ab7fe640 1 -- 172.21.15.66:0/4021018850 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b803b3d0 con 0x564a1797cb40 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- 172.21.15.66:0/4021018850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 msgr2=0x564a1797b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009930 tx=0x7f80b8005e20 comp rx=0 tx=0).stop 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- 172.21.15.66:0/4021018850 shutdown_connections 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17988760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a1797ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 --2- 172.21.15.66:0/4021018850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a1797b090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- 172.21.15.66:0/4021018850 >> 172.21.15.66:0/4021018850 conn(0x564a17944310 msgr2=0x564a17977c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- 172.21.15.66:0/4021018850 shutdown_connections 2024-09-15T22:47:48.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- 172.21.15.66:0/4021018850 wait complete. 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 -- start start 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.617+0000 7f80c9a98740 1 Processor -- start 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17983050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a179836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a17989070 con 0x564a1797b5d0 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564a1789c060 con 0x564a1797cb40 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564a179891f0 con 0x564a17986370 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 10 client.0 _ll_register_callbacks cb 0x564a175ef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46032/0 (socket says 172.21.15.66:46032) 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 -- 172.21.15.66:0/215079574 learned_addr learned my addr 172.21.15.66:0/215079574 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:48.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17983050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a179836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 -- 172.21.15.66:0/215079574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 msgr2=0x564a179836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a179836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 -- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 msgr2=0x564a17983050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17983050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 -- 172.21.15.66:0/215079574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a176523c0 con 0x564a1797b5d0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c545b640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f80b400eb90 tx=0x7f80b400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f550c5cb3f14d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4010e60 con 0x564a1797b5d0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f80b40d0210 con 0x564a1797b5d0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.618+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b8046de0 con 0x564a1797b5d0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f80b40cde50 con 0x564a1797b5d0 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 10 client.16089 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:48.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564a17994b90 con 0x564a1797b5d0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b8046de0 con 0x564a1797b5d0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f80b40d2c70 con 0x564a1797b5d0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 10 client.16089 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 10 client.16089 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 20 client.16089 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a179964d0 0x564a17998920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 4 client.16089 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a178ee860 con 0x564a179964d0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.619+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a179964d0 0x564a17998920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.620+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a179964d0 0x564a17998920 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ac2672256f926a2 server_cookie=b33c43a3a60b3e8 in_seq=0 out_seq=0 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.620+0000 7f80a8ff9640 10 client.16089 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:48.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.620+0000 7f80a8ff9640 1 -- 172.21.15.66:0/215079574 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a178ee860 con 0x564a179964d0 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80a8ff9640 10 client.16089 handle_command_reply: tid=0 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 client.16089 shutdown 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 msgr2=0x564a17985d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f80b400eb90 tx=0x7f80b400ef80 comp rx=0 tx=0).stop 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 shutdown_connections 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a179964d0 0x564a17998920 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a179836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17983050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 --2- 172.21.15.66:0/215079574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797b5d0 0x564a17985d50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 >> 172.21.15.66:0/215079574 conn(0x564a17944310 msgr2=0x564a1797d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80a8ff9640 0 client.16089 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:48.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 shutdown_connections 2024-09-15T22:47:48.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 1 -- 172.21.15.66:0/215079574 wait complete. 2024-09-15T22:47:48.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.621+0000 7f80c9a98740 20 client.16089 trim_cache size 0 max 16384 2024-09-15T22:47:48.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 Processor -- start 2024-09-15T22:47:48.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 -- start start 2024-09-15T22:47:48.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17984fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 0x564a1797e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01b12b0 con 0x564a17986370 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01b2f70 con 0x564a1797cb40 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c9a98740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01b1980 con 0x564a1797b5d0 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c5c5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 0x564a1797e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c545b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c5c5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 0x564a1797e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46048/0 (socket says 172.21.15.66:46048) 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c545b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56216/0 (socket says 172.21.15.66:56216) 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c5c5c640 1 -- 172.21.15.66:0/2300238208 learned_addr learned my addr 172.21.15.66:0/2300238208 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.634+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17984fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 -- 172.21.15.66:0/2300238208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 msgr2=0x564a17984fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17984fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 -- 172.21.15.66:0/2300238208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 msgr2=0x564a1797e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 0x564a1797e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 -- 172.21.15.66:0/2300238208 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a17982020 con 0x564a1797b5d0 2024-09-15T22:47:48.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80c545b640 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80b409c5a0 tx=0x7f80b40a0a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d240279f1ad5391d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80aaffd640 1 -- 172.21.15.66:0/2300238208 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40cde50 con 0x564a1797b5d0 2024-09-15T22:47:48.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80aaffd640 1 -- 172.21.15.66:0/2300238208 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b40a51d0 con 0x564a1797b5d0 2024-09-15T22:47:48.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.635+0000 7f80aaffd640 1 -- 172.21.15.66:0/2300238208 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b409b730 con 0x564a1797b5d0 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- 172.21.15.66:0/2300238208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 msgr2=0x564a17982910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80b409c5a0 tx=0x7f80b40a0a90 comp rx=0 tx=0).stop 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- 172.21.15.66:0/2300238208 shutdown_connections 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a17986370 0x564a1797e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797cb40 0x564a17984fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 --2- 172.21.15.66:0/2300238208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a1797b5d0 0x564a17982910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- 172.21.15.66:0/2300238208 >> 172.21.15.66:0/2300238208 conn(0x564a17944310 msgr2=0x564a179848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- 172.21.15.66:0/2300238208 shutdown_connections 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- 172.21.15.66:0/2300238208 wait complete. 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 -- start start 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 Processor -- start 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.636+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797b5d0 0x564a1798ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17980670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01b27e0 con 0x564a1797cb40 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01b2050 con 0x564a1797b5d0 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01af290 con 0x564a17986370 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 10 client.0 _ll_register_callbacks cb 0x7f80b40099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46062/0 (socket says 172.21.15.66:46062) 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 -- 172.21.15.66:0/3800949890 learned_addr learned my addr 172.21.15.66:0/3800949890 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c545b640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797b5d0 0x564a1798ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c5c5c640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17980670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 -- 172.21.15.66:0/3800949890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 msgr2=0x564a17980670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17980670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 -- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797b5d0 msgr2=0x564a1798ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797b5d0 0x564a1798ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 -- 172.21.15.66:0/3800949890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a17983a20 con 0x564a1797cb40 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c4c5a640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f80bc000c00 tx=0x7f80bc0108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e69f77e047e047 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0035f0 con 0x564a1797cb40 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f80bc003790 con 0x564a1797cb40 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.637+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b40a51d0 con 0x564a1797cb40 2024-09-15T22:47:48.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f80bc030050 con 0x564a1797cb40 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 10 client.16095 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564a17988ad0 con 0x564a1797cb40 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b40a51d0 con 0x564a1797cb40 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f80bc01eb50 con 0x564a1797cb40 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 10 client.16095 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 10 client.16095 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 20 client.16095 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a17a017f0 0x564a17a03c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 4 client.16095 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:48.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a178e8d70 con 0x564a17a017f0 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.638+0000 7f80c545b640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a17a017f0 0x564a17a03c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80a8ff9640 10 client.16095 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c545b640 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a17a017f0 0x564a17a03c10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b97b6a86453269d4 server_cookie=10b9d153ebd4d117 in_seq=0 out_seq=0 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80a8ff9640 1 -- 172.21.15.66:0/3800949890 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a178e8d70 con 0x564a17a017f0 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80a8ff9640 10 client.16095 handle_command_reply: tid=0 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 client.16095 shutdown 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 msgr2=0x564a1797ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f80bc000c00 tx=0x7f80bc0108c0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 shutdown_connections 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564a17a017f0 0x564a17a03c10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564a17986370 0x564a17980670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a1797cb40 0x564a1797ff30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 --2- 172.21.15.66:0/3800949890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a1797b5d0 0x564a1798ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80a8ff9640 0 client.16095 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:47:48.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 >> 172.21.15.66:0/3800949890 conn(0x564a17944310 msgr2=0x564a17991300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 shutdown_connections 2024-09-15T22:47:48.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 1 -- 172.21.15.66:0/3800949890 wait complete. 2024-09-15T22:47:48.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.639+0000 7f80c9a98740 20 client.16095 trim_cache size 0 max 16384 2024-09-15T22:47:48.647 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 msgr2=0x7f80ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 0x7f80ac0a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80b804a000 tx=0x7f80b8047000 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 msgr2=0x7f80c00fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f80b400ebc0 tx=0x7f80b400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 shutdown_connections 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f80ac0a33b0 0x7f80ac0a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80c0106a80 0x7f80c00fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c0101420 0x7f80c00fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 --2- 172.21.15.66:0/3445429956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80c0100a80 0x7f80c00fcdb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:48.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 >> 172.21.15.66:0/3445429956 conn(0x7f80c00fc7a0 msgr2=0x7f80c006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:48.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 shutdown_connections 2024-09-15T22:47:48.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:48.640+0000 7f80c76bf640 1 -- 172.21.15.66:0/3445429956 wait complete. 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6c9effd640 1 -- 172.21.15.66:0/259914295 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555f75ae8be0 con 0x555f75c07250 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6c9effd640 10 client.25558 handle_command_reply: tid=0 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 client.25558 shutdown 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 msgr2=0x555f75b936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000fab0 tx=0x7f6cb001cf70 comp rx=0 tx=0).stop 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 shutdown_connections 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555f75c07250 0x555f75c09670 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f75b89c40 0x555f75b94170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f75b7cff0 0x555f75b93c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6c9effd640 0 client.25558 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:49.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 --2- 172.21.15.66:0/259914295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f75b7c6d0 0x555f75b936f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 >> 172.21.15.66:0/259914295 conn(0x555f75b78de0 msgr2=0x555f75b88450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 shutdown_connections 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 1 -- 172.21.15.66:0/259914295 wait complete. 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.363+0000 7f6cc7ece740 20 client.25558 trim_cache size 0 max 16384 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 32, 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 6, 2024-09-15T22:47:49.366 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "955f024c": { 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 6, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 139.6, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:47:49.367 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:49.368 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 msgr2=0x7f6ca80a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 0x7f6ca80a58c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0011440 tx=0x7f6cb0005f90 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 msgr2=0x7f6cc019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009bf0 tx=0x7f6cb8003970 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 shutdown_connections 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ca80a3400 0x7f6ca80a58c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cc0106a70 0x7f6cc019bbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc0101410 0x7f6cc0197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 --2- 172.21.15.66:0/1824524871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc0100a70 0x7f6cc0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.364+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 >> 172.21.15.66:0/1824524871 conn(0x7f6cc00fc790 msgr2=0x7f6cc00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.365+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 shutdown_connections 2024-09-15T22:47:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:49.365+0000 7f6cc5af5640 1 -- 172.21.15.66:0/1824524871 wait complete. 2024-09-15T22:47:49.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:49 smithi184 ceph-mon[35203]: pgmap v76: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-15T22:47:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:49 smithi066 ceph-mon[31185]: pgmap v76: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-15T22:47:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:49 smithi087 ceph-mon[35290]: pgmap v76: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-15T22:47:49.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:47:50.559 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '955f024c', quiesce took 14.0 seconds. Will release after: 5.550000000000001 2024-09-15T22:47:50.617 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:51.172 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:51 smithi066 ceph-mon[31185]: pgmap v77: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.143+0000 7fd6160f0640 1 -- 172.21.15.66:0/3431272662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610106f10 msgr2=0x7fd61010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.143+0000 7fd6160f0640 1 --2- 172.21.15.66:0/3431272662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610106f10 0x7fd61010ea90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd608009be0 tx=0x7fd60802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 -- 172.21.15.66:0/3431272662 shutdown_connections 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 --2- 172.21.15.66:0/3431272662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610106f10 0x7fd61010ea90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 --2- 172.21.15.66:0/3431272662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 0x7fd6101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 --2- 172.21.15.66:0/3431272662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610101de0 0x7fd6101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 -- 172.21.15.66:0/3431272662 >> 172.21.15.66:0/3431272662 conn(0x7fd6100fd8c0 msgr2=0x7fd6100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 -- 172.21.15.66:0/3431272662 shutdown_connections 2024-09-15T22:47:51.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 -- 172.21.15.66:0/3431272662 wait complete. 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 Processor -- start 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.144+0000 7fd6160f0640 1 -- start start 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 0x7fd6101989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610106f10 0x7fd61019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd610111f20 con 0x7fd610101de0 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd610111da0 con 0x7fd610106f10 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd6160f0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101120a0 con 0x7fd610102790 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46088/0 (socket says 172.21.15.66:46088) 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 -- 172.21.15.66:0/568389039 learned_addr learned my addr 172.21.15.66:0/568389039 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60ffff640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610106f10 0x7fd61019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd607fff640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 0x7fd6101989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 -- 172.21.15.66:0/568389039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 msgr2=0x7fd6101989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 0x7fd6101989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 -- 172.21.15.66:0/568389039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610106f10 msgr2=0x7fd61019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610106f10 0x7fd61019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 -- 172.21.15.66:0/568389039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61019d410 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.145+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e9c0 tx=0x7fd60000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.146+0000 7fd60d7fa640 1 -- 172.21.15.66:0/568389039 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60000cde0 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.146+0000 7fd60d7fa640 1 -- 172.21.15.66:0/568389039 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6000035f0 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.146+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61019d700 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.146+0000 7fd60d7fa640 1 -- 172.21.15.66:0/568389039 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600010690 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.146+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6101a4fe0 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.148+0000 7fd60d7fa640 1 -- 172.21.15.66:0/568389039 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd6000037a0 con 0x7fd610101de0 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.148+0000 7fd6184c9740 1 Processor -- start 2024-09-15T22:47:51.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.148+0000 7fd60d7fa640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.148+0000 7fd6184c9740 1 -- start start 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60ffff640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60d7fa640 1 -- 172.21.15.66:0/568389039 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd6000d0370 con 0x7fd610101de0 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fff8fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff9a370 0x5581fff9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581ffef52f0 con 0x5581fff90b40 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5581ffe9ccf0 con 0x5581fff9a370 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd6184c9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5581ffef12b0 con 0x5581fff8f5d0 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46102/0 (socket says 172.21.15.66:46102) 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2493915129 learned_addr learned my addr 172.21.15.66:0/2493915129 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:51.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd607fff640 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fff8fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60ffff640 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff9a370 0x5581fff9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2493915129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 msgr2=0x5581fff8fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fff8fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2493915129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff9a370 msgr2=0x5581fff9c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff9a370 0x5581fff9c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2493915129 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581ffe813a0 con 0x5581fff90b40 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60ffff640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6080092f0 tx=0x7fd6080098e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.149+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd6000986e0 tx=0x7fd60009be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81369a1bcaa6ee88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd605ffb640 1 -- 172.21.15.66:0/2493915129 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000b5070 con 0x5581fff90b40 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd605ffb640 1 -- 172.21.15.66:0/2493915129 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60009c280 con 0x5581fff90b40 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd605ffb640 1 -- 172.21.15.66:0/2493915129 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000988f0 con 0x5581fff90b40 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 -- 172.21.15.66:0/2493915129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 msgr2=0x5581fff8f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd6000986e0 tx=0x7fd60009be80 comp rx=0 tx=0).stop 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 -- 172.21.15.66:0/2493915129 shutdown_connections 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff9a370 0x5581fff9c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fff8fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.150+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2493915129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff8f090 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- 172.21.15.66:0/2493915129 >> 172.21.15.66:0/2493915129 conn(0x5581fff58310 msgr2=0x5581fff8bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- 172.21.15.66:0/2493915129 shutdown_connections 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- 172.21.15.66:0/2493915129 wait complete. 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- start start 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 Processor -- start 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff8f5d0 0x5581fff99d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5581fff9d010 con 0x5581fff90b40 2024-09-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5581ffeb0060 con 0x5581fff8f5d0 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5581fff9d190 con 0x5581fff9a370 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.151+0000 7fd6184c9740 10 client.0 _ll_register_callbacks cb 0x5581ffc038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46112/0 (socket says 172.21.15.66:46112) 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 -- 172.21.15.66:0/3286230406 learned_addr learned my addr 172.21.15.66:0/3286230406 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd60ffff640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff8f5d0 0x5581fff99d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 -- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 msgr2=0x5581fff976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 -- 172.21.15.66:0/3286230406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff8f5d0 msgr2=0x5581fff99d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff8f5d0 0x5581fff99d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 -- 172.21.15.66:0/3286230406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581ffc663c0 con 0x5581fff90b40 2024-09-15T22:47:51.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd607fff640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8012700 tx=0x7fd5f8012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4ed0778fabb05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800f8c0 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd5f800fa60 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60009c280 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd5f800fc60 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd6184c9740 10 client.16107 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.152+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5581fffa8b80 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60009c280 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fd5f8010550 con 0x5581fff90b40 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 10 client.16107 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 10 client.16107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 20 client.16107 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5581fffaa090 0x5581fffac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 4 client.16107 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581fff02860 con 0x5581fffaa090 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5581fffaa090 0x5581fffac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd5eeffd640 10 client.16107 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.153+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5581fffaa090 0x5581fffac4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ceebab5268ce2216 server_cookie=cbb5eb21f9ebbf46 in_seq=0 out_seq=0 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd5eeffd640 1 -- 172.21.15.66:0/3286230406 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581fff02860 con 0x5581fffaa090 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd5eeffd640 10 client.16107 handle_command_reply: tid=0 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 client.16107 shutdown 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 msgr2=0x5581fff97090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8012700 tx=0x7fd5f8012bc0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 shutdown_connections 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5581fffaa090 0x5581fffac4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff90b40 0x5581fff97090 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 --2- 172.21.15.66:0/3286230406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff8f5d0 0x5581fff99d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd5eeffd640 0 client.16107 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.155+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 >> 172.21.15.66:0/3286230406 conn(0x5581fff58310 msgr2=0x5581fff91990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.156+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 shutdown_connections 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.156+0000 7fd6184c9740 1 -- 172.21.15.66:0/3286230406 wait complete. 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.156+0000 7fd6184c9740 20 client.16107 trim_cache size 0 max 16384 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 Processor -- start 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 -- start start 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff92180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101af1a0 con 0x5581fff8f5d0 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b0e60 con 0x5581fff90b40 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd6184c9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101af870 con 0x5581fff9a370 2024-09-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.169+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46122/0 (socket says 172.21.15.66:46122) 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 -- 172.21.15.66:0/1429109551 learned_addr learned my addr 172.21.15.66:0/1429109551 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60ffff640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd607fff640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff92180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 -- 172.21.15.66:0/1429109551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 msgr2=0x5581fff926c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff926c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 -- 172.21.15.66:0/1429109551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 msgr2=0x5581fff92180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff92180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 -- 172.21.15.66:0/1429109551 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fff8c960 con 0x5581fff8f5d0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd607fff640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff92180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd600098690 tx=0x7fd600004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d862584adfa4762 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd6057fa640 1 -- 172.21.15.66:0/1429109551 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000ba070 con 0x5581fff8f5d0 2024-09-15T22:47:51.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd6057fa640 1 -- 172.21.15.66:0/1429109551 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60009c280 con 0x5581fff8f5d0 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.170+0000 7fd6057fa640 1 -- 172.21.15.66:0/1429109551 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60007ae60 con 0x5581fff8f5d0 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- 172.21.15.66:0/1429109551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 msgr2=0x5581fff99000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd600098690 tx=0x7fd600004570 comp rx=0 tx=0).stop 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- 172.21.15.66:0/1429109551 shutdown_connections 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff9a370 0x5581fff926c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff92180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 --2- 172.21.15.66:0/1429109551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff8f5d0 0x5581fff99000 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- 172.21.15.66:0/1429109551 >> 172.21.15.66:0/1429109551 conn(0x5581fff58310 msgr2=0x5581fff988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- 172.21.15.66:0/1429109551 shutdown_connections 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- 172.21.15.66:0/1429109551 wait complete. 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.171+0000 7fd6184c9740 1 -- start start 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 Processor -- start 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff93c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 0x5581fff941c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b06d0 con 0x5581fff9a370 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101aff40 con 0x5581fff90b40 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101ad180 con 0x5581fff8f5d0 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.172+0000 7fd6184c9740 10 client.0 _ll_register_callbacks cb 0x7fd5f8009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56292/0 (socket says 172.21.15.66:56292) 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2484380375 learned_addr learned my addr 172.21.15.66:0/2484380375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60ffff640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 0x5581fff941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd607fff640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff93c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2484380375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 msgr2=0x5581fff93c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff93c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2484380375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 msgr2=0x5581fff941c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:51.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 0x5581fff941c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 -- 172.21.15.66:0/2484380375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581fff94860 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60ffff640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 0x5581fff941c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd60f7fe640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd60009f040 tx=0x7fd6000a5010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e58ec3f2699de2c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd5eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60007f060 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd6000cd970 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.173+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60009c280 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd60007ae60 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 10 client.25645 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558200018f90 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60009c280 con 0x5581fff8f5d0 2024-09-15T22:47:51.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fd600085170 con 0x5581fff8f5d0 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 10 client.25645 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 10 client.25645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 20 client.25645 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5582000192d0 0x55820001b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 4 client.25645 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5581ffefcd70 con 0x5582000192d0 2024-09-15T22:47:51.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.174+0000 7fd607fff640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5582000192d0 0x55820001b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.175+0000 7fd607fff640 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5582000192d0 0x55820001b6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db5fc4b0eb58dfad server_cookie=ba004993e9beccc3 in_seq=0 out_seq=0 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.175+0000 7fd5eeffd640 10 client.25645 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd5eeffd640 1 -- 172.21.15.66:0/2484380375 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5581ffefcd70 con 0x5582000192d0 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd5eeffd640 10 client.25645 handle_command_reply: tid=0 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 client.25645 shutdown 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 msgr2=0x5581fffa2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd60009f040 tx=0x7fd6000a5010 comp rx=0 tx=0).stop 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 shutdown_connections 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5582000192d0 0x55820001b6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5581fff9a370 0x5581fff941c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5581fff90b40 0x5581fff93c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd5eeffd640 0 client.25645 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 --2- 172.21.15.66:0/2484380375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5581fff8f5d0 0x5581fffa2a80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 >> 172.21.15.66:0/2484380375 conn(0x5581fff58310 msgr2=0x5581fff99110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 shutdown_connections 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 1 -- 172.21.15.66:0/2484380375 wait complete. 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.176+0000 7fd6184c9740 20 client.25645 trim_cache size 0 max 16384 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 msgr2=0x7fd5fc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd6080092f0 tx=0x7fd6080098e0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 msgr2=0x7fd610198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e9c0 tx=0x7fd60000ee80 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 shutdown_connections 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd610106f10 0x7fd61019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd610102790 0x7fd6101989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 --2- 172.21.15.66:0/568389039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd610101de0 0x7fd610198460 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 >> 172.21.15.66:0/568389039 conn(0x7fd6100fd8c0 msgr2=0x7fd6100fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 shutdown_connections 2024-09-15T22:47:51.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:51.177+0000 7fd6160f0640 1 -- 172.21.15.66:0/568389039 wait complete. 2024-09-15T22:47:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:51 smithi184 ceph-mon[35203]: pgmap v77: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:51 smithi087 ceph-mon[35290]: pgmap v77: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:51.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:47:52.263 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/319944136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38108300 msgr2=0x7fbf3810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/319944136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38108300 0x7fbf3810ec70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009930 tx=0x7fbf3002a420 comp rx=0 tx=0).stop 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/319944136 shutdown_connections 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/319944136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38108300 0x7fbf3810ec70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/319944136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38103780 0x7fbf38107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/319944136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38102dd0 0x7fbf381031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/319944136 >> 172.21.15.66:0/319944136 conn(0x7fbf380fc7d0 msgr2=0x7fbf380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/319944136 shutdown_connections 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.750+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/319944136 wait complete. 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 Processor -- start 2024-09-15T22:47:52.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 -- start start 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38103780 0x7fbf38100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38108300 0x7fbf381014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381120d0 con 0x7fbf38102dd0 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf38111f50 con 0x7fbf38103780 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ecf5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf38112250 con 0x7fbf38108300 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36816/0 (socket says 172.21.15.66:36816) 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 -- 172.21.15.66:0/978137762 learned_addr learned my addr 172.21.15.66:0/978137762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3d292640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38108300 0x7fbf381014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf37fff640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38103780 0x7fbf38100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 -- 172.21.15.66:0/978137762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38108300 msgr2=0x7fbf381014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38108300 0x7fbf381014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 -- 172.21.15.66:0/978137762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38103780 msgr2=0x7fbf38100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38103780 0x7fbf38100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.751+0000 7fbf3ca91640 1 -- 172.21.15.66:0/978137762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf381aaf40 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d950 tx=0x7fbf2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf35ffb640 1 -- 172.21.15.66:0/978137762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28017070 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf381ab170 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf35ffb640 1 -- 172.21.15.66:0/978137762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf28009c30 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf35ffb640 1 -- 172.21.15.66:0/978137762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800f6b0 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.752+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf381ab6b0 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.754+0000 7fbf35ffb640 1 -- 172.21.15.66:0/978137762 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbf280109d0 con 0x7fbf38102dd0 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 Processor -- start 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 -- start start 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf35ffb640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 0x7fbf240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806c7370 0x5566806c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5566806222f0 con 0x5566806bc5d0 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5566805c9cf0 con 0x5566806c7370 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf410ce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55668061e2b0 con 0x5566806bdb40 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf37fff640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 0x7fbf240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39480/0 (socket says 172.21.15.66:39480) 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf3d292640 1 -- 172.21.15.66:0/1144586246 learned_addr learned my addr 172.21.15.66:0/1144586246 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.755+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36826/0 (socket says 172.21.15.66:36826) 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806c7370 0x5566806c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf35ffb640 1 -- 172.21.15.66:0/978137762 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf280cfcb0 con 0x7fbf38102dd0 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 -- 172.21.15.66:0/1144586246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806c7370 msgr2=0x5566806c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806c7370 0x5566806c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 -- 172.21.15.66:0/1144586246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 msgr2=0x5566806bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 -- 172.21.15.66:0/1144586246 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566805ae3a0 con 0x5566806bdb40 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf37fff640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 0x7fbf240a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf381021f0 tx=0x7fbf20009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf3d292640 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5566806bd070 tx=0x7fbf30031480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b48a7c69108510 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf2effd640 1 -- 172.21.15.66:0/1144586246 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30035070 con 0x5566806bdb40 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf2effd640 1 -- 172.21.15.66:0/1144586246 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf30005020 con 0x5566806bdb40 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.756+0000 7fbf2effd640 1 -- 172.21.15.66:0/1144586246 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30004a00 con 0x5566806bdb40 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 -- 172.21.15.66:0/1144586246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 msgr2=0x5566806bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5566806bd070 tx=0x7fbf30031480 comp rx=0 tx=0).stop 2024-09-15T22:47:52.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 -- 172.21.15.66:0/1144586246 shutdown_connections 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806c7370 0x5566806c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 --2- 172.21.15.66:0/1144586246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806bc090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 -- 172.21.15.66:0/1144586246 >> 172.21.15.66:0/1144586246 conn(0x556680685310 msgr2=0x5566806b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 -- 172.21.15.66:0/1144586246 shutdown_connections 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.757+0000 7fbf410ce740 1 -- 172.21.15.66:0/1144586246 wait complete. 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 -- start start 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 Processor -- start 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5566806ca010 con 0x5566806c7370 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5566805dd060 con 0x5566806bc5d0 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5566806ca190 con 0x5566806bdb40 2024-09-15T22:47:52.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf410ce740 10 client.0 _ll_register_callbacks cb 0x5566803308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36840/0 (socket says 172.21.15.66:36840) 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf37fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf3d292640 1 -- 172.21.15.66:0/4127501366 learned_addr learned my addr 172.21.15.66:0/4127501366 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.758+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 -- 172.21.15.66:0/4127501366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 msgr2=0x5566806c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 -- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 msgr2=0x5566806c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 -- 172.21.15.66:0/4127501366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566803933c0 con 0x5566806c7370 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf3d292640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c9dab54b46909e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf17fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3004e020 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf300055e0 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf30005020 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf30059050 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf410ce740 10 client.16125 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5566806d5ae0 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.759+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf30005020 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fbf300035f0 con 0x5566806c7370 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 10 client.16125 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 20 client.16125 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5566806d6e30 0x5566806d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 4 client.16125 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55668062f860 con 0x5566806d6e30 2024-09-15T22:47:52.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5566806d6e30 0x5566806d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf17fff640 10 client.16125 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:52.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.760+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5566806d6e30 0x5566806d9220 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c9461d570fc363 server_cookie=27094f850ca14a in_seq=0 out_seq=0 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf17fff640 1 -- 172.21.15.66:0/4127501366 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55668062f860 con 0x5566806d6e30 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf17fff640 10 client.16125 handle_command_reply: tid=0 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 client.16125 shutdown 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 msgr2=0x5566806c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30032e30 comp rx=0 tx=0).stop 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 shutdown_connections 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806c4640 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5566806d6e30 0x5566806d9220 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 --2- 172.21.15.66:0/4127501366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 >> 172.21.15.66:0/4127501366 conn(0x556680685310 msgr2=0x5566806be960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf17fff640 0 client.16125 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:52.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.761+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 shutdown_connections 2024-09-15T22:47:52.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.762+0000 7fbf410ce740 1 -- 172.21.15.66:0/4127501366 wait complete. 2024-09-15T22:47:52.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.762+0000 7fbf410ce740 20 client.16125 trim_cache size 0 max 16384 2024-09-15T22:47:52.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.775+0000 7fbf410ce740 1 Processor -- start 2024-09-15T22:47:52.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 -- start start 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b5860 con 0x5566806c7370 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b7520 con 0x5566806bc5d0 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf410ce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b5f30 con 0x5566806bdb40 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36856/0 (socket says 172.21.15.66:36856) 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 -- 172.21.15.66:0/3113004973 learned_addr learned my addr 172.21.15.66:0/3113004973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf37fff640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 -- 172.21.15.66:0/3113004973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 msgr2=0x5566806dbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806dbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 -- 172.21.15.66:0/3113004973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 msgr2=0x5566806d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806d3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 -- 172.21.15.66:0/3113004973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566806b8ed0 con 0x5566806c7370 2024-09-15T22:47:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.776+0000 7fbf3d292640 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009620 tx=0x7fbf300097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb078e9b6e2b987c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf2e7fc640 1 -- 172.21.15.66:0/3113004973 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3004e070 con 0x5566806c7370 2024-09-15T22:47:52.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf2e7fc640 1 -- 172.21.15.66:0/3113004973 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf300053e0 con 0x5566806c7370 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf2e7fc640 1 -- 172.21.15.66:0/3113004973 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30035050 con 0x5566806c7370 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 -- 172.21.15.66:0/3113004973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 msgr2=0x5566806dc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009620 tx=0x7fbf300097a0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 -- 172.21.15.66:0/3113004973 shutdown_connections 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806c7370 0x5566806dc3a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806bdb40 0x5566806dbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 --2- 172.21.15.66:0/3113004973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bc5d0 0x5566806d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.777+0000 7fbf410ce740 1 -- 172.21.15.66:0/3113004973 >> 172.21.15.66:0/3113004973 conn(0x556680685310 msgr2=0x5566806c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- 172.21.15.66:0/3113004973 shutdown_connections 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- 172.21.15.66:0/3113004973 wait complete. 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- start start 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 Processor -- start 2024-09-15T22:47:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bdb40 0x5566806d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 0x5566806d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b6d90 con 0x5566806bc5d0 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b6600 con 0x5566806bdb40 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbf381b3840 con 0x5566806c7370 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf410ce740 10 client.0 _ll_register_callbacks cb 0x7fbf2800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.778+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3d292640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 0x5566806d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36866/0 (socket says 172.21.15.66:36866) 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 -- 172.21.15.66:0/122005227 learned_addr learned my addr 172.21.15.66:0/122005227 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf37fff640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bdb40 0x5566806d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 -- 172.21.15.66:0/122005227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 msgr2=0x5566806d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 0x5566806d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 -- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bdb40 msgr2=0x5566806d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bdb40 0x5566806d93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 -- 172.21.15.66:0/122005227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668073fa00 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3d292640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 0x5566806d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf3ca91640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cd090 tx=0x7fbf28010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d370cfe259006859 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf17fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28020040 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbf280cd2b0 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf300053e0 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbf280b9050 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf410ce740 10 client.16131 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.779+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556680740ce0 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf300053e0 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fbf280979c0 con 0x5566806bc5d0 2024-09-15T22:47:52.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 10 client.16131 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 20 client.16131 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556680741430 0x556680743850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 4 client.16131 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556680629d70 con 0x556680741430 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.780+0000 7fbf37fff640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556680741430 0x556680743850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf37fff640 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556680741430 0x556680743850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41414947c5600eb3 server_cookie=3a623cf9259cde0 in_seq=0 out_seq=0 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf17fff640 10 client.16131 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf17fff640 1 -- 172.21.15.66:0/122005227 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556680629d70 con 0x556680741430 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf17fff640 10 client.16131 handle_command_reply: tid=0 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 client.16131 shutdown 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 msgr2=0x5566806d8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cd090 tx=0x7fbf28010d70 comp rx=0 tx=0).stop 2024-09-15T22:47:52.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 shutdown_connections 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566806c7370 0x5566806d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556680741430 0x556680743850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566806bdb40 0x5566806d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 --2- 172.21.15.66:0/122005227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5566806bc5d0 0x5566806d8e70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf17fff640 0 client.16131 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 >> 172.21.15.66:0/122005227 conn(0x556680685310 msgr2=0x5566806c2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 shutdown_connections 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 1 -- 172.21.15.66:0/122005227 wait complete. 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.781+0000 7fbf410ce740 20 client.16131 trim_cache size 0 max 16384 2024-09-15T22:47:52.787 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:47:52.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 msgr2=0x7fbf240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 0x7fbf240a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf381021f0 tx=0x7fbf20009500 comp rx=0 tx=0).stop 2024-09-15T22:47:52.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 msgr2=0x7fbf38100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:52.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d950 tx=0x7fbf2800de10 comp rx=0 tx=0).stop 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 shutdown_connections 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbf240a33b0 0x7fbf240a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf38108300 0x7fbf381014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf38103780 0x7fbf38100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 --2- 172.21.15.66:0/978137762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf38102dd0 0x7fbf38100a30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 >> 172.21.15.66:0/978137762 conn(0x7fbf380fc7d0 msgr2=0x7fbf38105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 shutdown_connections 2024-09-15T22:47:52.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:52.782+0000 7fbf3ecf5640 1 -- 172.21.15.66:0/978137762 wait complete. 2024-09-15T22:47:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:53 smithi184 ceph-mon[35203]: pgmap v78: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:53.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:53 smithi066 ceph-mon[31185]: pgmap v78: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:53 smithi087 ceph-mon[35290]: pgmap v78: 129 pgs: 129 active+clean; 331 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 439 op/s 2024-09-15T22:47:54.582 INFO:tasks.workunit.client.0.smithi066.stdout: 79 19477 0 12480 0 4494 0 2024-09-15T22:47:54.631 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:47:54.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:47:54.894 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:55.272 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:55 smithi066 ceph-mon[31185]: pgmap v79: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 451 op/s 2024-09-15T22:47:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 -- 172.21.15.66:0/3834847377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102570 msgr2=0x7f27cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 --2- 172.21.15.66:0/3834847377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102570 0x7f27cc1029b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c002a480 comp rx=0 tx=0).stop 2024-09-15T22:47:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 -- 172.21.15.66:0/3834847377 shutdown_connections 2024-09-15T22:47:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 --2- 172.21.15.66:0/3834847377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102ef0 0x7f27cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 --2- 172.21.15.66:0/3834847377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102570 0x7f27cc1029b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 --2- 172.21.15.66:0/3834847377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 0x7f27cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 -- 172.21.15.66:0/3834847377 >> 172.21.15.66:0/3834847377 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 -- 172.21.15.66:0/3834847377 shutdown_connections 2024-09-15T22:47:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 -- 172.21.15.66:0/3834847377 wait complete. 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.360+0000 7f27d24c4640 1 Processor -- start 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 -- start start 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 0x7f27cc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 0x7f27cc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 0x7f27cc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc110f80 con 0x7f27cc102ef0 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc110e00 con 0x7f27cc100e20 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d24c4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc111100 con 0x7f27cc102570 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 0x7f27cc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 0x7f27cc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 0x7f27cc0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39516/0 (socket says 172.21.15.66:39516) 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27cb7fe640 1 -- 172.21.15.66:0/1717126186 learned_addr learned my addr 172.21.15.66:0/1717126186 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:55.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27cbfff640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 0x7f27cc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 -- 172.21.15.66:0/1717126186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 msgr2=0x7f27cc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 0x7f27cc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 -- 172.21.15.66:0/1717126186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 msgr2=0x7f27cc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 0x7f27cc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.361+0000 7f27d0a61640 1 -- 172.21.15.66:0/1717126186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc1a6990 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27d0a61640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 0x7f27cc0fd700 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009fd0 tx=0x7f27c400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27c97fa640 1 -- 172.21.15.66:0/1717126186 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400ce20 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc1a6c80 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27c97fa640 1 -- 172.21.15.66:0/1717126186 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c4005020 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27c97fa640 1 -- 172.21.15.66:0/1717126186 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4010720 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.362+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc1a7210 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.364+0000 7f27c97fa640 1 -- 172.21.15.66:0/1717126186 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f27c4005540 con 0x7f27cc102ef0 2024-09-15T22:47:55.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.365+0000 7f27d489d740 1 Processor -- start 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.365+0000 7f27d489d740 1 -- start start 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27c97fa640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ada800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240adad40 0x55f240add130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f240a35280 con 0x55f240acfb60 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f2409dcb10 con 0x55f240adad40 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d489d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f240a31240 con 0x55f240ad0480 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27c97fa640 1 -- 172.21.15.66:0/1717126186 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f27c40d0670 con 0x7f27cc102ef0 2024-09-15T22:47:55.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27d0a61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240adad40 0x55f240add130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ada800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36894/0 (socket says 172.21.15.66:36894) 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 -- 172.21.15.66:0/2947511782 learned_addr learned my addr 172.21.15.66:0/2947511782 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 -- 172.21.15.66:0/2947511782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 msgr2=0x55f240ada800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ada800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 -- 172.21.15.66:0/2947511782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240adad40 msgr2=0x55f240add130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240adad40 0x55f240add130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 -- 172.21.15.66:0/2947511782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2409e91f0 con 0x55f240acfb60 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 0x7f27b40a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27c0005770 tx=0x7f27c0004040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.366+0000 7f27cbfff640 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009cf0 tx=0x7f27bc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aece2e28093a900f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27b27fc640 1 -- 172.21.15.66:0/2947511782 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004020 con 0x55f240acfb60 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27b27fc640 1 -- 172.21.15.66:0/2947511782 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc0041c0 con 0x55f240acfb60 2024-09-15T22:47:55.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27b27fc640 1 -- 172.21.15.66:0/2947511782 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0187d0 con 0x55f240acfb60 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 -- 172.21.15.66:0/2947511782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 msgr2=0x55f240acff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009cf0 tx=0x7f27bc011810 comp rx=0 tx=0).stop 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 -- 172.21.15.66:0/2947511782 shutdown_connections 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240adad40 0x55f240add130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ada800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 --2- 172.21.15.66:0/2947511782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240acff40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 -- 172.21.15.66:0/2947511782 >> 172.21.15.66:0/2947511782 conn(0x55f240acc0f0 msgr2=0x55f240acc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 -- 172.21.15.66:0/2947511782 shutdown_connections 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.367+0000 7f27d489d740 1 -- 172.21.15.66:0/2947511782 wait complete. 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 -- start start 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 Processor -- start 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240adad40 0x55f240ad8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f240add910 con 0x55f240acfb60 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f2409eff10 con 0x55f240ad0480 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f240adda90 con 0x55f240adad40 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d489d740 10 client.0 _ll_register_callbacks cb 0x55f2409b8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36896/0 (socket says 172.21.15.66:36896) 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27cbfff640 1 -- 172.21.15.66:0/859225386 learned_addr learned my addr 172.21.15.66:0/859225386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.368+0000 7f27d0a61640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240adad40 0x55f240ad8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 -- 172.21.15.66:0/859225386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240adad40 msgr2=0x55f240ad8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240adad40 0x55f240ad8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 -- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 msgr2=0x55f240ad8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 -- 172.21.15.66:0/859225386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2407a66a0 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27cbfff640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0058c0 tx=0x7f27bc003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c38ad2ee902e440 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc026020 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f27bc005050 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27bc0041c0 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f27bc031050 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27d489d740 10 client.16143 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.369+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f240ae94c0 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc0041c0 con 0x55f240acfb60 2024-09-15T22:47:55.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f27bc018a60 con 0x55f240acfb60 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 10 client.16143 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 20 client.16143 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240aea980 0x55f240aecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 4 client.16143 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f240a427f0 con 0x55f240aea980 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.370+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240aea980 0x55f240aecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.371+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240aea980 0x55f240aecdd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a4a5a2aa5a47b3d server_cookie=1455f29fdc0058c3 in_seq=0 out_seq=0 2024-09-15T22:47:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.371+0000 7f27ab7fe640 10 client.16143 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27ab7fe640 1 -- 172.21.15.66:0/859225386 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f240a427f0 con 0x55f240aea980 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27ab7fe640 10 client.16143 handle_command_reply: tid=0 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 client.16143 shutdown 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 msgr2=0x55f240ad7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0058c0 tx=0x7f27bc003b70 comp rx=0 tx=0).stop 2024-09-15T22:47:55.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 shutdown_connections 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240adad40 0x55f240ad8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240aea980 0x55f240aecdd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 --2- 172.21.15.66:0/859225386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240acfb60 0x55f240ad7be0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27ab7fe640 0 client.16143 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 >> 172.21.15.66:0/859225386 conn(0x55f240acc0f0 msgr2=0x55f240acb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 shutdown_connections 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 1 -- 172.21.15.66:0/859225386 wait complete. 2024-09-15T22:47:55.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.372+0000 7f27d489d740 20 client.16143 trim_cache size 0 max 16384 2024-09-15T22:47:55.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.390+0000 7f27d489d740 1 Processor -- start 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 -- start start 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b1390 con 0x55f240adad40 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b3050 con 0x55f240ad0480 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d489d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b1a60 con 0x55f240acfb60 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39550/0 (socket says 172.21.15.66:39550) 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36900/0 (socket says 172.21.15.66:36900) 2024-09-15T22:47:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cbfff640 1 -- 172.21.15.66:0/151673713 learned_addr learned my addr 172.21.15.66:0/151673713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 -- 172.21.15.66:0/151673713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 msgr2=0x55f240ad9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 -- 172.21.15.66:0/151673713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 msgr2=0x55f240ad74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 -- 172.21.15.66:0/151673713 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f240ad29d0 con 0x55f240adad40 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cbfff640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.391+0000 7f27d0a61640 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f27c40cd9f0 tx=0x7f27c40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b14ad43e8c1fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27b1ffb640 1 -- 172.21.15.66:0/151673713 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c409cc80 con 0x55f240adad40 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27b1ffb640 1 -- 172.21.15.66:0/151673713 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c4079b40 con 0x55f240adad40 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27b1ffb640 1 -- 172.21.15.66:0/151673713 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c409a910 con 0x55f240adad40 2024-09-15T22:47:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 -- 172.21.15.66:0/151673713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 msgr2=0x55f240af26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f27c40cd9f0 tx=0x7f27c40058b0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 -- 172.21.15.66:0/151673713 shutdown_connections 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240af26a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240ad0480 0x55f240ad74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 --2- 172.21.15.66:0/151673713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240acfb60 0x55f240ad9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 -- 172.21.15.66:0/151673713 >> 172.21.15.66:0/151673713 conn(0x55f240acc0f0 msgr2=0x55f240acb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 -- 172.21.15.66:0/151673713 shutdown_connections 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.392+0000 7f27d489d740 1 -- 172.21.15.66:0/151673713 wait complete. 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 -- start start 2024-09-15T22:47:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 Processor -- start 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240acfb60 0x55f240ae3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240adead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b28c0 con 0x55f240adad40 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b2130 con 0x55f240acfb60 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1af370 con 0x55f240ad0480 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27d489d740 10 client.0 _ll_register_callbacks cb 0x7f27c40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.393+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39564/0 (socket says 172.21.15.66:39564) 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 -- 172.21.15.66:0/432519292 learned_addr learned my addr 172.21.15.66:0/432519292 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27d0a61640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240adead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cbfff640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240acfb60 0x55f240ae3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 -- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240acfb60 msgr2=0x55f240ae3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240acfb60 0x55f240ae3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 -- 172.21.15.66:0/432519292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 msgr2=0x55f240adead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240adead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 -- 172.21.15.66:0/432519292 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f240adf110 con 0x55f240ad0480 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27cb7fe640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009a20 tx=0x7f27c002a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6647a648bacedb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0058020 con 0x55f240ad0480 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c4079b40 con 0x55f240ad0480 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.394+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f27c0031950 con 0x55f240ad0480 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f27c0063050 con 0x55f240ad0480 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 10 client.25681 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f240b555c0 con 0x55f240ad0480 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c4079b40 con 0x55f240ad0480 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f27c0054a80 con 0x55f240ad0480 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 10 client.25681 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 10 client.25681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 20 client.25681 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240b55e30 0x55f240b58250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 4 client.25681 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f240a3cd00 con 0x55f240b55e30 2024-09-15T22:47:55.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.395+0000 7f27cbfff640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240b55e30 0x55f240b58250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.396+0000 7f27cbfff640 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240b55e30 0x55f240b58250 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3e0d97e8e4e665c server_cookie=61a3fff1a5623cb5 in_seq=0 out_seq=0 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.396+0000 7f27ab7fe640 10 client.25681 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27ab7fe640 1 -- 172.21.15.66:0/432519292 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f240a3cd00 con 0x55f240b55e30 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27ab7fe640 10 client.25681 handle_command_reply: tid=0 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 client.25681 shutdown 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 msgr2=0x55f240ade590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009a20 tx=0x7f27c002a480 comp rx=0 tx=0).stop 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 shutdown_connections 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f240adad40 0x55f240adead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f240ad0480 0x55f240ade590 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f240b55e30 0x55f240b58250 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 --2- 172.21.15.66:0/432519292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f240acfb60 0x55f240ae3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 >> 172.21.15.66:0/432519292 conn(0x55f240acc0f0 msgr2=0x55f240ad15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27ab7fe640 0 client.25681 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.397+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 shutdown_connections 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d489d740 1 -- 172.21.15.66:0/432519292 wait complete. 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d489d740 20 client.25681 trim_cache size 0 max 16384 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "2aa8bba2-f2a0-4628-824a-5eae0111bcea", 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:47:55.404 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 msgr2=0x7f27b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 0x7f27b40a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27c0005770 tx=0x7f27c0004040 comp rx=0 tx=0).stop 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 msgr2=0x7f27cc0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 0x7f27cc0fd700 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009fd0 tx=0x7f27c400ef10 comp rx=0 tx=0).stop 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 shutdown_connections 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27b40a33b0 0x7f27b40a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27cc102ef0 0x7f27cc0fd700 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27cc102570 0x7f27cc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 --2- 172.21.15.66:0/1717126186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27cc100e20 0x7f27cc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:55.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 >> 172.21.15.66:0/1717126186 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:55.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 shutdown_connections 2024-09-15T22:47:55.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:55.398+0000 7f27d24c4640 1 -- 172.21.15.66:0/1717126186 wait complete. 2024-09-15T22:47:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:55 smithi184 ceph-mon[35203]: pgmap v79: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 451 op/s 2024-09-15T22:47:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:55 smithi087 ceph-mon[35290]: pgmap v79: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 451 op/s 2024-09-15T22:47:56.110 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:47:56.265 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:47:56.291 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:47:56.291 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.291 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.291 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.292 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.293 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.421 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:47:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:56.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:47:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:56.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 -- 172.21.15.66:0/2804763683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4106a70 msgr2=0x7f02f4106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/2804763683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4106a70 0x7f02f4106e50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009930 tx=0x7f02e402a420 comp rx=0 tx=0).stop 2024-09-15T22:47:56.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 -- 172.21.15.66:0/2804763683 shutdown_connections 2024-09-15T22:47:56.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/2804763683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4101410 0x7f02f410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/2804763683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4100a70 0x7f02f4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/2804763683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4106a70 0x7f02f4106e50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 -- 172.21.15.66:0/2804763683 >> 172.21.15.66:0/2804763683 conn(0x7f02f40fc790 msgr2=0x7f02f40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 -- 172.21.15.66:0/2804763683 shutdown_connections 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.915+0000 7f02fa8d2640 1 -- 172.21.15.66:0/2804763683 wait complete. 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 Processor -- start 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 -- start start 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 0x7f02f4199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4106a70 0x7f02f41a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4110e70 con 0x7f02f4100a70 2024-09-15T22:47:56.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4110cf0 con 0x7f02f4101410 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02fa8d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4110ff0 con 0x7f02f4106a70 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36928/0 (socket says 172.21.15.66:36928) 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 -- 172.21.15.66:0/182333787 learned_addr learned my addr 172.21.15.66:0/182333787 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02ebfff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 0x7f02f4199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f8e6f640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4106a70 0x7f02f41a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 -- 172.21.15.66:0/182333787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4106a70 msgr2=0x7f02f41a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4106a70 0x7f02f41a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 -- 172.21.15.66:0/182333787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 msgr2=0x7f02f4199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 0x7f02f4199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 -- 172.21.15.66:0/182333787 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f41a48a0 con 0x7f02f4100a70 2024-09-15T22:47:56.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02ebfff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 0x7f02f4199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.916+0000 7f02f3fff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009230 tx=0x7f02e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.917+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e403f030 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.917+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4003ad0 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.917+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f41a4a70 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.917+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4035070 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.917+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41a4f50 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.918+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f4100ed0 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.919+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f02e4042030 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.920+0000 7f02f1ffb640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 0x7f02e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.920+0000 7f02ebfff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 0x7f02e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.920+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f02e40f0bd0 con 0x7f02f4100a70 2024-09-15T22:47:56.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.921+0000 7f02ebfff640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 0x7f02e00a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02f406b320 tx=0x7f02dc005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:56.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:56.924+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02e40bd1c0 con 0x7f02f4100a70 2024-09-15T22:47:56.983 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:57.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.187+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02f4108fe0 con 0x7f02f4100a70 2024-09-15T22:47:57.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.188+0000 7f02f1ffb640 1 -- 172.21.15.66:0/182333787 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7f02e40bcac0 con 0x7f02f4100a70 2024-09-15T22:47:57.189 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:47:57.189 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:47:57.190 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:47:57.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 msgr2=0x7f02e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 0x7f02e00a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02f406b320 tx=0x7f02dc005f90 comp rx=0 tx=0).stop 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 msgr2=0x7f02f41992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009230 tx=0x7f02e4004270 comp rx=0 tx=0).stop 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 shutdown_connections 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02e00a3430 0x7f02e00a58f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f4106a70 0x7f02f41a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02f4101410 0x7f02f4199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 --2- 172.21.15.66:0/182333787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02f4100a70 0x7f02f41992e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 >> 172.21.15.66:0/182333787 conn(0x7f02f40fc790 msgr2=0x7f02f40fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 shutdown_connections 2024-09-15T22:47:57.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.190+0000 7f02fa8d2640 1 -- 172.21.15.66:0/182333787 wait complete. 2024-09-15T22:47:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: pgmap v80: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: pgmap v80: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:47:57.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: pgmap v80: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 -- 172.21.15.66:0/464370607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18101420 msgr2=0x7f0e1810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/464370607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18101420 0x7f0e1810d950 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009cf0 tx=0x7f0e1002cb00 comp rx=0 tx=0).stop 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 -- 172.21.15.66:0/464370607 shutdown_connections 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/464370607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18101420 0x7f0e1810d950 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/464370607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/464370607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18106a80 0x7f0e18106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 -- 172.21.15.66:0/464370607 >> 172.21.15.66:0/464370607 conn(0x7f0e180fc7a0 msgr2=0x7f0e180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 -- 172.21.15.66:0/464370607 shutdown_connections 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.618+0000 7f0e1ee27640 1 -- 172.21.15.66:0/464370607 wait complete. 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 Processor -- start 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 -- start start 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e1819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18101420 0x7f0e1819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1810fd20 con 0x7f0e18106a80 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1810fba0 con 0x7f0e18101420 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1ee27640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1810fea0 con 0x7f0e18100a80 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36948/0 (socket says 172.21.15.66:36948) 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/4226378410 learned_addr learned my addr 172.21.15.66:0/4226378410 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e17fff640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18101420 0x7f0e1819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e1819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/4226378410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 msgr2=0x7f0e1819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e1819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/4226378410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18101420 msgr2=0x7f0e1819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18101420 0x7f0e1819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/4226378410 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1819f570 con 0x7f0e18106a80 2024-09-15T22:47:57.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.619+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e1819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:57.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005e30 tx=0x7f0e10038bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e15ffb640 1 -- 172.21.15.66:0/4226378410 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10045070 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e15ffb640 1 -- 172.21.15.66:0/4226378410 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e10038da0 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1819f800 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e15ffb640 1 -- 172.21.15.66:0/4226378410 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10040430 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.620+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e181a7140 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.622+0000 7f0e15ffb640 1 -- 172.21.15.66:0/4226378410 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0e10004450 con 0x7f0e18106a80 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 Processor -- start 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 -- start start 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e15ffb640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 0x7f0e080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e7803130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7805a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b6e775e2e0 con 0x55b6e77f8490 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7705ce0 con 0x55b6e77f8db0 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e21200740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b6e775a2a0 con 0x55b6e7803670 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 0x7f0e080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.623+0000 7f0e15ffb640 1 -- 172.21.15.66:0/4226378410 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0e100f09f0 con 0x7f0e18106a80 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36962/0 (socket says 172.21.15.66:36962) 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 -- 172.21.15.66:0/1332742410 learned_addr learned my addr 172.21.15.66:0/1332742410 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e7803130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7805a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 -- 172.21.15.66:0/1332742410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 msgr2=0x55b6e7805a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7805a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 -- 172.21.15.66:0/1332742410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 msgr2=0x55b6e7803130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e7803130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 -- 172.21.15.66:0/1332742410 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e76ea440 con 0x55b6e77f8490 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 0x7f0e080a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c005fd0 tx=0x7f0e0c0094d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400afd0 tx=0x7f0e0400a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec5907afe4a6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e02ffd640 1 -- 172.21.15.66:0/1332742410 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400f7c0 con 0x55b6e77f8490 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e02ffd640 1 -- 172.21.15.66:0/1332742410 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e0400fe40 con 0x55b6e77f8490 2024-09-15T22:47:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.624+0000 7f0e02ffd640 1 -- 172.21.15.66:0/1332742410 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0401dcc0 con 0x55b6e77f8490 2024-09-15T22:47:57.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 -- 172.21.15.66:0/1332742410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 msgr2=0x55b6e77f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400afd0 tx=0x7f0e0400a770 comp rx=0 tx=0).stop 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 -- 172.21.15.66:0/1332742410 shutdown_connections 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7805a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e7803130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 --2- 172.21.15.66:0/1332742410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e77f8870 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 -- 172.21.15.66:0/1332742410 >> 172.21.15.66:0/1332742410 conn(0x55b6e77f4a20 msgr2=0x55b6e77f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 -- 172.21.15.66:0/1332742410 shutdown_connections 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.625+0000 7f0e21200740 1 -- 172.21.15.66:0/1332742410 wait complete. 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 -- start start 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 Processor -- start 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e78001d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7800710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7806240 con 0x55b6e77f8490 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7719050 con 0x55b6e77f8db0 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b6e78063c0 con 0x55b6e7803670 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e21200740 10 client.0 _ll_register_callbacks cb 0x55b6e7759160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e1cbc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e1cbc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36968/0 (socket says 172.21.15.66:36968) 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2714311390 learned_addr learned my addr 172.21.15.66:0/2714311390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.626+0000 7f0e17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e78001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7800710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2714311390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 msgr2=0x55b6e7800710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7800710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 msgr2=0x55b6e78001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e78001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2714311390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e74cf3c0 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e78001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0117f0 tx=0x7f0e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc750a1e5e28fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0df7fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c022030 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0e0c011d70 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e0400fe40 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e0c02c050 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e21200740 10 client.16167 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.627+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b6e7811c10 con 0x55b6e77f8490 2024-09-15T22:47:57.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e0400fe40 con 0x55b6e77f8490 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f0e0c00f040 con 0x55b6e77f8490 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 10 client.16167 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 20 client.16167 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e7813190 0x55b6e7815600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 4 client.16167 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6e776b850 con 0x55b6e7813190 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.628+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e7813190 0x55b6e7815600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e7813190 0x55b6e7815600 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635f551202187b61 server_cookie=752f0219edaba9f6 in_seq=0 out_seq=0 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0df7fff640 10 client.16167 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0df7fff640 1 -- 172.21.15.66:0/2714311390 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6e776b850 con 0x55b6e7813190 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0df7fff640 10 client.16167 handle_command_reply: tid=0 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 client.16167 shutdown 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 msgr2=0x55b6e7802f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0117f0 tx=0x7f0e0c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 shutdown_connections 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e7803670 0x55b6e7800710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.629+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e7813190 0x55b6e7815600 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8db0 0x55b6e78001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 1 --2- 172.21.15.66:0/2714311390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7802f20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 >> 172.21.15.66:0/2714311390 conn(0x55b6e77f4a20 msgr2=0x55b6e77fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0df7fff640 0 client.16167 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 shutdown_connections 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 1 -- 172.21.15.66:0/2714311390 wait complete. 2024-09-15T22:47:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.630+0000 7f0e21200740 20 client.16167 trim_cache size 0 max 16384 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 Processor -- start 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 -- start start 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 0x55b6e77ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e781af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181b11a0 con 0x55b6e7803670 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181b2e60 con 0x55b6e77f8490 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e21200740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181b1870 con 0x55b6e77f8db0 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e1d3c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e1d3c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36984/0 (socket says 172.21.15.66:36984) 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.647+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/1862701229 learned_addr learned my addr 172.21.15.66:0/1862701229 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 0x55b6e77ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e781af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/1862701229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 msgr2=0x55b6e781af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e781af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/1862701229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 msgr2=0x55b6e77ffab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 0x55b6e77ffab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 -- 172.21.15.66:0/1862701229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e77f4850 con 0x55b6e7803670 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e17fff640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e781af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:47:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 0x55b6e77ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e100eddd0 tx=0x7f0e100bc260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cde38f14f750e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e027fc640 1 -- 172.21.15.66:0/1862701229 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100a5e60 con 0x55b6e7803670 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e027fc640 1 -- 172.21.15.66:0/1862701229 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e100bd000 con 0x55b6e7803670 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.648+0000 7f0e027fc640 1 -- 172.21.15.66:0/1862701229 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100bac00 con 0x55b6e7803670 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- 172.21.15.66:0/1862701229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 msgr2=0x55b6e781b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e100eddd0 tx=0x7f0e100bc260 comp rx=0 tx=0).stop 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- 172.21.15.66:0/1862701229 shutdown_connections 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e7803670 0x55b6e781b450 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e781af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 --2- 172.21.15.66:0/1862701229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e77f8490 0x55b6e77ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- 172.21.15.66:0/1862701229 >> 172.21.15.66:0/1862701229 conn(0x55b6e77f4a20 msgr2=0x55b6e7802250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- 172.21.15.66:0/1862701229 shutdown_connections 2024-09-15T22:47:57.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- 172.21.15.66:0/1862701229 wait complete. 2024-09-15T22:47:57.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 -- start start 2024-09-15T22:47:57.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.649+0000 7f0e21200740 1 Processor -- start 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e7808fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 0x55b6e787bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181b26d0 con 0x55b6e77f8490 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181b1f40 con 0x55b6e7803670 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e181af180 con 0x55b6e77f8db0 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e21200740 10 client.0 _ll_register_callbacks cb 0x7f0e0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36990/0 (socket says 172.21.15.66:36990) 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2056321978 learned_addr learned my addr 172.21.15.66:0/2056321978 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:57.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 0x55b6e787bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e7808fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2056321978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 msgr2=0x55b6e7808fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e7808fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 msgr2=0x55b6e787bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 0x55b6e787bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 -- 172.21.15.66:0/2056321978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e77f5ad0 con 0x55b6e77f8490 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1d3c4640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 0x55b6e787bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0e1cbc3640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00e6c0 tx=0x7f0e0c01ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae0062dc7ed6ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0df7fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.650+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c034070 con 0x55b6e77f8490 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0e0c01e640 con 0x55b6e77f8490 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e100bd000 con 0x55b6e77f8490 2024-09-15T22:47:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e0c040050 con 0x55b6e77f8490 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 10 client.16173 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b6e787d4a0 con 0x55b6e77f8490 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e100bd000 con 0x55b6e77f8490 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f0e0c0108a0 con 0x55b6e77f8490 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 10 client.16173 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 20 client.16173 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e787dcb0 0x55b6e78800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 4 client.16173 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6e7765d60 con 0x55b6e787dcb0 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.651+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e787dcb0 0x55b6e78800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0df7fff640 10 client.16173 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e17fff640 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e787dcb0 0x55b6e78800d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232b19f138bc7a09 server_cookie=752ed92dd8af11be in_seq=0 out_seq=0 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0df7fff640 1 -- 172.21.15.66:0/2056321978 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b6e7765d60 con 0x55b6e787dcb0 2024-09-15T22:47:57.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0df7fff640 10 client.16173 handle_command_reply: tid=0 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 client.16173 shutdown 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 msgr2=0x55b6e7808aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00e6c0 tx=0x7f0e0c01ff40 comp rx=0 tx=0).stop 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 shutdown_connections 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6e787dcb0 0x55b6e78800d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6e7803670 0x55b6e787bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6e77f8db0 0x55b6e7808fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0df7fff640 0 client.16173 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 --2- 172.21.15.66:0/2056321978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6e77f8490 0x55b6e7808aa0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 >> 172.21.15.66:0/2056321978 conn(0x55b6e77f4a20 msgr2=0x55b6e77f3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 shutdown_connections 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 1 -- 172.21.15.66:0/2056321978 wait complete. 2024-09-15T22:47:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.652+0000 7f0e21200740 20 client.16173 trim_cache size 0 max 16384 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "2aa8bba2-f2a0-4628-824a-5eae0111bcea": { 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "2aa8bba2-f2a0-4628-824a-5eae0111bcea", 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:47:57.660 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 msgr2=0x7f0e080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 0x7f0e080a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c005fd0 tx=0x7f0e0c0094d0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 msgr2=0x7f0e1819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005e30 tx=0x7f0e10038bb0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 shutdown_connections 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e080a3430 0x7f0e080a58f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e18106a80 0x7f0e1819ee90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e18101420 0x7f0e1819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 --2- 172.21.15.66:0/4226378410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e18100a80 0x7f0e1819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 >> 172.21.15.66:0/4226378410 conn(0x7f0e180fc7a0 msgr2=0x7f0e180fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 shutdown_connections 2024-09-15T22:47:57.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:57.653+0000 7f0e1ee27640 1 -- 172.21.15.66:0/4226378410 wait complete. 2024-09-15T22:47:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:58 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/182333787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:58.447 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:58 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:58.447 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/182333787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:58.477 INFO:tasks.cephfs.filesystem:scrub status for tag:2aa8bba2-f2a0-4628-824a-5eae0111bcea - {'path': '/', 'tag': '2aa8bba2-f2a0-4628-824a-5eae0111bcea', 'options': 'recursive,force'} 2024-09-15T22:47:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:58 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:47:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/182333787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:47:58.967 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 955f024c --release --await' 2024-09-15T22:47:58.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 955f024c --release --await 2024-09-15T22:47:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:47:59 smithi066 ceph-mon[31185]: pgmap v81: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-15T22:47:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:47:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:47:59 smithi184 ceph-mon[35203]: pgmap v81: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-15T22:47:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:47:59 smithi087 ceph-mon[35290]: pgmap v81: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-15T22:47:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- 172.21.15.66:0/2157121556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8102ef0 msgr2=0x7fb5a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 --2- 172.21.15.66:0/2157121556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8102ef0 0x7fb5a810da40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb598009ca0 tx=0x7fb59802a950 comp rx=0 tx=0).stop 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- 172.21.15.66:0/2157121556 shutdown_connections 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 --2- 172.21.15.66:0/2157121556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8102ef0 0x7fb5a810da40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 --2- 172.21.15.66:0/2157121556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102570 0x7fb5a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 --2- 172.21.15.66:0/2157121556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8100e20 0x7fb5a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- 172.21.15.66:0/2157121556 >> 172.21.15.66:0/2157121556 conn(0x7fb5a80fc7d0 msgr2=0x7fb5a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- 172.21.15.66:0/2157121556 shutdown_connections 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- 172.21.15.66:0/2157121556 wait complete. 2024-09-15T22:47:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 Processor -- start 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.783+0000 7fb5ad678640 1 -- start start 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8102570 0x7fb5a819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102ef0 0x7fb5a819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8110f80 con 0x7fb5a8100e20 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8110e00 con 0x7fb5a8102570 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5ad678640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8111100 con 0x7fb5a8102ef0 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37018/0 (socket says 172.21.15.66:37018) 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 -- 172.21.15.66:0/50622358 learned_addr learned my addr 172.21.15.66:0/50622358 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102ef0 0x7fb5a819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8102570 0x7fb5a819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 -- 172.21.15.66:0/50622358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102ef0 msgr2=0x7fb5a819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102ef0 0x7fb5a819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 -- 172.21.15.66:0/50622358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8102570 msgr2=0x7fb5a819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8102570 0x7fb5a819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 -- 172.21.15.66:0/50622358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a819f5b0 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.784+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c920 tx=0x7fb5a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.785+0000 7fb59ffff640 1 -- 172.21.15.66:0/50622358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0007c70 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.785+0000 7fb59ffff640 1 -- 172.21.15.66:0/50622358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5a0007e10 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.785+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a819f8a0 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.785+0000 7fb59ffff640 1 -- 172.21.15.66:0/50622358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0018890 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.785+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81a7180 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.787+0000 7fb59ffff640 1 -- 172.21.15.66:0/50622358 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb5a0018a50 con 0x7fb5a8100e20 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.787+0000 7fb5afa51740 1 Processor -- start 2024-09-15T22:47:59.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.787+0000 7fb5afa51740 1 -- start start 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd36ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557cd3642620 con 0x557cd36dd060 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557cd35e9e50 con 0x557cd36dd980 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5afa51740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557cd363e5e0 con 0x557cd36e8240 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb59ffff640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 0x7fb5940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37028/0 (socket says 172.21.15.66:37028) 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a77fe640 1 -- 172.21.15.66:0/1643468494 learned_addr learned my addr 172.21.15.66:0/1643468494 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd36ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 0x7fb5940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb59ffff640 1 -- 172.21.15.66:0/50622358 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb5a00d01b0 con 0x7fb5a8100e20 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 -- 172.21.15.66:0/1643468494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 msgr2=0x557cd36e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 -- 172.21.15.66:0/1643468494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 msgr2=0x557cd36dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a67fc640 1 -- 172.21.15.66:0/1643468494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd35dad40 con 0x557cd36e8240 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.788+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.789+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 0x7fb5940a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb598009ca0 tx=0x7fb598005c50 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.789+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd36ea630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb590005fd0 tx=0x7fb59000bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d63d723d62726 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.789+0000 7fb59d7fa640 1 -- 172.21.15.66:0/1643468494 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590003bd0 con 0x557cd36e8240 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.789+0000 7fb59d7fa640 1 -- 172.21.15.66:0/1643468494 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb590015070 con 0x557cd36e8240 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.789+0000 7fb59d7fa640 1 -- 172.21.15.66:0/1643468494 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590004db0 con 0x557cd36e8240 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- 172.21.15.66:0/1643468494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 msgr2=0x557cd36ea630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd36ea630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb590005fd0 tx=0x7fb59000bb20 comp rx=0 tx=0).stop 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- 172.21.15.66:0/1643468494 shutdown_connections 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd36ea630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- 172.21.15.66:0/1643468494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd060 0x557cd36dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- 172.21.15.66:0/1643468494 >> 172.21.15.66:0/1643468494 conn(0x557cd36d95f0 msgr2=0x557cd36d99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- 172.21.15.66:0/1643468494 shutdown_connections 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- 172.21.15.66:0/1643468494 wait complete. 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 -- start start 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 Processor -- start 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.790+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5afa51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557cd36eae10 con 0x557cd36e8240 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5afa51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557cd35caf10 con 0x557cd36dd980 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5afa51740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557cd36eaf90 con 0x557cd36dd060 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5afa51740 10 client.0 _ll_register_callbacks cb 0x557cd35eedb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a6ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37030/0 (socket says 172.21.15.66:37030) 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 -- 172.21.15.66:0/2894338791 learned_addr learned my addr 172.21.15.66:0/2894338791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a6ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39672/0 (socket says 172.21.15.66:39672) 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 -- 172.21.15.66:0/2894338791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 msgr2=0x557cd36e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 -- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 msgr2=0x557cd36e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 -- 172.21.15.66:0/2894338791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd3351580 con 0x557cd36e8240 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb59802fd30 tx=0x7fb5980095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311894df454a1cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb58e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598050030 con 0x557cd36e8240 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb598004040 con 0x557cd36e8240 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.791+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb590015070 con 0x557cd36e8240 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb59805d050 con 0x557cd36e8240 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 10 client.16185 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:59.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557cd341b960 con 0x557cd36e8240 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb590015070 con 0x557cd36e8240 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fb59804c830 con 0x557cd36e8240 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 10 client.16185 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 10 client.16185 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 20 client.16185 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd36f7d80 0x557cd36fa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 4 client.16185 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cd364fb90 con 0x557cd36f7d80 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.792+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd36f7d80 0x557cd36fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd36f7d80 0x557cd36fa220 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8f9257cf656e7d server_cookie=58d97a36f868daa2 in_seq=0 out_seq=0 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb58e7fc640 10 client.16185 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb58e7fc640 1 -- 172.21.15.66:0/2894338791 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cd364fb90 con 0x557cd36f7d80 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb58e7fc640 10 client.16185 handle_command_reply: tid=0 2024-09-15T22:47:59.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5afa51740 1 client.16185 shutdown 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 msgr2=0x557cd36e5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb59802fd30 tx=0x7fb5980095c0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 shutdown_connections 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.793+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36e8240 0x557cd36e5b50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd36f7d80 0x557cd36fa220 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd980 0x557cd36e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 --2- 172.21.15.66:0/2894338791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb58e7fc640 0 client.16185 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 >> 172.21.15.66:0/2894338791 conn(0x557cd36d95f0 msgr2=0x557cd36df320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 shutdown_connections 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 1 -- 172.21.15.66:0/2894338791 wait complete. 2024-09-15T22:47:59.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.794+0000 7fb5afa51740 20 client.16185 trim_cache size 0 max 16384 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 Processor -- start 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 -- start start 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd060 0x557cd36d8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd3700030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b11b0 con 0x557cd36dd980 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b2e70 con 0x557cd36dd060 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5afa51740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b1880 con 0x557cd36e8240 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37044/0 (socket says 172.21.15.66:37044) 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 -- 172.21.15.66:0/767095142 learned_addr learned my addr 172.21.15.66:0/767095142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd3700030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd060 0x557cd36d8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 -- 172.21.15.66:0/767095142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 msgr2=0x557cd3700030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd3700030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 -- 172.21.15.66:0/767095142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd060 msgr2=0x557cd36d8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd060 0x557cd36d8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.811+0000 7fb5a67fc640 1 -- 172.21.15.66:0/767095142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd36d9420 con 0x557cd36dd980 2024-09-15T22:47:59.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.812+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd3700030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:47:59.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.812+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb590005fd0 tx=0x7fb590004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f62b4ebf540004 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.812+0000 7fb59cff9640 1 -- 172.21.15.66:0/767095142 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590028070 con 0x557cd36dd980 2024-09-15T22:47:59.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.812+0000 7fb59cff9640 1 -- 172.21.15.66:0/767095142 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb590015050 con 0x557cd36dd980 2024-09-15T22:47:59.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.812+0000 7fb59cff9640 1 -- 172.21.15.66:0/767095142 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590011de0 con 0x557cd36dd980 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- 172.21.15.66:0/767095142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 msgr2=0x557cd36ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb590005fd0 tx=0x7fb590004560 comp rx=0 tx=0).stop 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- 172.21.15.66:0/767095142 shutdown_connections 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36e8240 0x557cd3700030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36ffaf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- 172.21.15.66:0/767095142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36dd060 0x557cd36d8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- 172.21.15.66:0/767095142 >> 172.21.15.66:0/767095142 conn(0x557cd36d95f0 msgr2=0x557cd36d7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- 172.21.15.66:0/767095142 shutdown_connections 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- 172.21.15.66:0/767095142 wait complete. 2024-09-15T22:47:59.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- start start 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 Processor -- start 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36e8240 0x557cd36ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b26e0 con 0x557cd36dd980 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b1f50 con 0x557cd36e8240 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81af190 con 0x557cd36dd060 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.813+0000 7fb5afa51740 10 client.0 _ll_register_callbacks cb 0x7fb59802fbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37054/0 (socket says 172.21.15.66:37054) 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 -- 172.21.15.66:0/792639529 learned_addr learned my addr 172.21.15.66:0/792639529 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a77fe640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36e8240 0x557cd36ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 -- 172.21.15.66:0/792639529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 msgr2=0x557cd36f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 -- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36e8240 msgr2=0x557cd36ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36e8240 0x557cd36ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 -- 172.21.15.66:0/792639529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd36da780 con 0x557cd36dd980 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5a67fc640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb590026040 tx=0x7fb590003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795e6d7d6754a384 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb58e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590033060 con 0x557cd36dd980 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb590011440 con 0x557cd36dd980 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.814+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb590015050 con 0x557cd36dd980 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb590028040 con 0x557cd36dd980 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 10 client.16191 fetch_fsmap learned FSMap version 32 2024-09-15T22:47:59.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557cd36da280 con 0x557cd36dd980 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb590015050 con 0x557cd36dd980 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fb59002b070 con 0x557cd36dd980 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 10 client.16191 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 10 client.16191 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 20 client.16191 populate_metadata read hostname 'smithi066' 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd3763b30 0x557cd3765f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 4 client.16191 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "955f024c", "release": true, "await": true}] 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "955f024c", "release": true, "await": true}) -- 0x557cd36d4950 con 0x557cd3763b30 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.815+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd3763b30 0x557cd3765f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.816+0000 7fb58e7fc640 10 client.16191 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:47:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:47:59.816+0000 7fb5a6ffd640 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd3763b30 0x557cd3765f50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0bd9959fc4ad908 server_cookie=f05880dc4389dde9 in_seq=0 out_seq=0 2024-09-15T22:48:00.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb58e7fc640 1 -- 172.21.15.66:0/792639529 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557cd36d4950 con 0x557cd3763b30 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb58e7fc640 10 client.16191 handle_command_reply: tid=0 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 client.16191 shutdown 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 msgr2=0x557cd36eca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb590026040 tx=0x7fb590003da0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 shutdown_connections 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557cd3763b30 0x557cd3765f50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb58e7fc640 0 client.16191 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557cd36e8240 0x557cd36ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557cd36dd980 0x557cd36eca60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 --2- 172.21.15.66:0/792639529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557cd36dd060 0x557cd36f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 >> 172.21.15.66:0/792639529 conn(0x557cd36d95f0 msgr2=0x557cd36e58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 shutdown_connections 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 1 -- 172.21.15.66:0/792639529 wait complete. 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.273+0000 7fb5afa51740 20 client.16191 trim_cache size 0 max 16384 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 32, 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 8, 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "955f024c": { 2024-09-15T22:48:00.276 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 8, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 139.6, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:00.277 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:00.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 msgr2=0x7fb5940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 0x7fb5940a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb598009ca0 tx=0x7fb598005c50 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 msgr2=0x7fb5a819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c920 tx=0x7fb5a000cde0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 shutdown_connections 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb5940a33b0 0x7fb5940a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5a8102ef0 0x7fb5a819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a8102570 0x7fb5a819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 --2- 172.21.15.66:0/50622358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5a8100e20 0x7fb5a819a600 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 >> 172.21.15.66:0/50622358 conn(0x7fb5a80fc7d0 msgr2=0x7fb5a806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 shutdown_connections 2024-09-15T22:48:00.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:00.274+0000 7fb5ad678640 1 -- 172.21.15.66:0/50622358 wait complete. 2024-09-15T22:48:01.348 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '955f024c', total seconds elapsed: 24.8 2024-09-15T22:48:01.348 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T22:48:01.349 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:48:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:01 smithi184 ceph-mon[35203]: pgmap v82: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:01.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:01 smithi066 ceph-mon[31185]: pgmap v82: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:01 smithi087 ceph-mon[35290]: pgmap v82: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:01.625 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 -- 172.21.15.66:0/2212884524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8102570 msgr2=0x7f03e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/2212884524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8102570 0x7f03e81029b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009900 tx=0x7f03dc02a480 comp rx=0 tx=0).stop 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 -- 172.21.15.66:0/2212884524 shutdown_connections 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/2212884524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102ef0 0x7f03e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/2212884524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8102570 0x7f03e81029b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/2212884524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8100e20 0x7f03e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 -- 172.21.15.66:0/2212884524 >> 172.21.15.66:0/2212884524 conn(0x7f03e80fc7d0 msgr2=0x7f03e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 -- 172.21.15.66:0/2212884524 shutdown_connections 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.214+0000 7f03ed0f9640 1 -- 172.21.15.66:0/2212884524 wait complete. 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.215+0000 7f03ed0f9640 1 Processor -- start 2024-09-15T22:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.215+0000 7f03ed0f9640 1 -- start start 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102570 0x7f03e8197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8102ef0 0x7f03e819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8110f50 con 0x7f03e8100e20 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8110dd0 con 0x7f03e8102ef0 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03ed0f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03e81110d0 con 0x7f03e8102570 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37080/0 (socket says 172.21.15.66:37080) 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 -- 172.21.15.66:0/3109954644 learned_addr learned my addr 172.21.15.66:0/3109954644 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e659c640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102570 0x7f03e8197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e759e640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8102ef0 0x7f03e819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 -- 172.21.15.66:0/3109954644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102570 msgr2=0x7f03e8197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102570 0x7f03e8197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 -- 172.21.15.66:0/3109954644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8102ef0 msgr2=0x7f03e819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8102ef0 0x7f03e819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 -- 172.21.15.66:0/3109954644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e819c400 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.216+0000 7f03e6d9d640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f03d800d950 tx=0x7f03d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.217+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8017070 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.217+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03d8009c30 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.217+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e819c6f0 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.217+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800f6b0 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.217+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e81a3fd0 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.218+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e8101200 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.219+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f03d80109d0 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.220+0000 7f03cffff640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 0x7f03d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.220+0000 7f03e659c640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 0x7f03d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.220+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f03d80cfc90 con 0x7f03e8100e20 2024-09-15T22:48:02.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.220+0000 7f03e659c640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 0x7f03d00a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009230 tx=0x7f03dc0058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:02.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.225+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03d8009de0 con 0x7f03e8100e20 2024-09-15T22:48:02.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.452+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03e8109090 con 0x7f03e8100e20 2024-09-15T22:48:02.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.453+0000 7f03cffff640 1 -- 172.21.15.66:0/3109954644 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7f03d809bc50 con 0x7f03e8100e20 2024-09-15T22:48:02.455 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:48:02.455 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:48:02.455 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 msgr2=0x7f03d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 0x7f03d00a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009230 tx=0x7f03dc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 msgr2=0x7f03e8197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f03d800d950 tx=0x7f03d800de10 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 shutdown_connections 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03d00a33b0 0x7f03d00a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03e8102ef0 0x7f03e819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03e8102570 0x7f03e8197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.455+0000 7f03ed0f9640 1 --2- 172.21.15.66:0/3109954644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03e8100e20 0x7f03e8197450 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.456+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 >> 172.21.15.66:0/3109954644 conn(0x7f03e80fc7d0 msgr2=0x7f03e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:02.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.456+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 shutdown_connections 2024-09-15T22:48:02.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:02.456+0000 7f03ed0f9640 1 -- 172.21.15.66:0/3109954644 wait complete. 2024-09-15T22:48:03.216 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T22:48:03.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T22:48:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:03 smithi184 ceph-mon[35203]: pgmap v83: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3109954644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:03 smithi066 ceph-mon[31185]: pgmap v83: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3109954644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:03.494 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:03 smithi087 ceph-mon[35290]: pgmap v83: 129 pgs: 129 active+clean; 342 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 21 op/s 2024-09-15T22:48:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3109954644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:04.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 -- 172.21.15.66:0/501240038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 msgr2=0x7f3e6410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/501240038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6410ec40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009cd0 tx=0x7f3e5c02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 -- 172.21.15.66:0/501240038 shutdown_connections 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/501240038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6410ec40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/501240038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e641036e0 0x7f3e64107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/501240038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e64102d30 0x7f3e64103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 -- 172.21.15.66:0/501240038 >> 172.21.15.66:0/501240038 conn(0x7f3e640fc7d0 msgr2=0x7f3e640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 -- 172.21.15.66:0/501240038 shutdown_connections 2024-09-15T22:48:04.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 -- 172.21.15.66:0/501240038 wait complete. 2024-09-15T22:48:04.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.056+0000 7f3e68ec0640 1 Processor -- start 2024-09-15T22:48:04.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 -- start start 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 0x7f3e641a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641120f0 con 0x7f3e641082a0 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64111f70 con 0x7f3e641036e0 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e68ec0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e64112270 con 0x7f3e64102d30 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 0x7f3e641a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46488/0 (socket says 172.21.15.66:46488) 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3456574225 learned_addr learned my addr 172.21.15.66:0/3456574225 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3456574225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 msgr2=0x7f3e641a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 0x7f3e641a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 msgr2=0x7f3e6419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.057+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3456574225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6419ad20 con 0x7f3e641036e0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e6259c640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 0x7f3e641a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00e9c0 tx=0x7f3e4c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e5bfff640 1 -- 172.21.15.66:0/3456574225 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00ccc0 con 0x7f3e641036e0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e5bfff640 1 -- 172.21.15.66:0/3456574225 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e4c005500 con 0x7f3e641036e0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e5bfff640 1 -- 172.21.15.66:0/3456574225 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c010690 con 0x7f3e641036e0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6419b010 con 0x7f3e641036e0 2024-09-15T22:48:04.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.058+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e641a7300 con 0x7f3e641036e0 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.060+0000 7f3e5bfff640 1 -- 172.21.15.66:0/3456574225 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3e4c010830 con 0x7f3e641036e0 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 Processor -- start 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 -- start start 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e5bfff640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 0x7f3e500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5f6306160 con 0x55e5f63a1850 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5f62ad720 con 0x55e5f63a2170 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.061+0000 7f3e6b299740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5f6302120 con 0x55e5f63aca30 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e5bfff640 1 -- 172.21.15.66:0/3456574225 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3e4c0d0480 con 0x7f3e641036e0 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 0x7f3e500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56920/0 (socket says 172.21.15.66:56920) 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 -- 172.21.15.66:0/2278541804 learned_addr learned my addr 172.21.15.66:0/2278541804 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 -- 172.21.15.66:0/2278541804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 msgr2=0x55e5f63aee20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63aee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 -- 172.21.15.66:0/2278541804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 msgr2=0x55e5f63ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 -- 172.21.15.66:0/2278541804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5f6077ba0 con 0x55e5f63a1850 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e6259c640 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3e540115f0 tx=0x7f3e54011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6708e395d508fba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.062+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 0x7f3e500a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005e30 tx=0x7f3e5c032fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e58d99640 1 -- 172.21.15.66:0/2278541804 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5401e070 con 0x55e5f63a1850 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e58d99640 1 -- 172.21.15.66:0/2278541804 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5400fb20 con 0x55e5f63a1850 2024-09-15T22:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e58d99640 1 -- 172.21.15.66:0/2278541804 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54019be0 con 0x55e5f63a1850 2024-09-15T22:48:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 -- 172.21.15.66:0/2278541804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 msgr2=0x55e5f63a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3e540115f0 tx=0x7f3e54011ab0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 -- 172.21.15.66:0/2278541804 shutdown_connections 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 --2- 172.21.15.66:0/2278541804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63a1c30 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.063+0000 7f3e6b299740 1 -- 172.21.15.66:0/2278541804 >> 172.21.15.66:0/2278541804 conn(0x55e5f639dde0 msgr2=0x55e5f639e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- 172.21.15.66:0/2278541804 shutdown_connections 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- 172.21.15.66:0/2278541804 wait complete. 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- start start 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 Processor -- start 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5f63af600 con 0x55e5f63aca30 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5f628e900 con 0x55e5f63a2170 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5f63af780 con 0x55e5f63a1850 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6b299740 10 client.0 _ll_register_callbacks cb 0x55e5f628c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53678/0 (socket says 172.21.15.66:53678) 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e6259c640 1 -- 172.21.15.66:0/837988993 learned_addr learned my addr 172.21.15.66:0/837988993 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.064+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 -- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 msgr2=0x55e5f63a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 -- 172.21.15.66:0/837988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 msgr2=0x55e5f63aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 -- 172.21.15.66:0/837988993 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5f62cec50 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6259c640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e54019920 tx=0x7f3e5400ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce0b50d559ba445 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54026020 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3e5400f640 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.065+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e5400fb20 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e5402e050 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 10 client.25729 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e5f63bb290 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5400fb20 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f3e540035f0 con 0x55e5f63a1850 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 10 client.25729 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:04.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 10 client.25729 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 20 client.25729 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f63bc750 0x55e5f63beb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 4 client.25729 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5f6313890 con 0x55e5f63bc750 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.066+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f63bc750 0x55e5f63beb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f63bc750 0x55e5f63beb40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c58a7303f2e3a646 server_cookie=48c65b510a1229a9 in_seq=0 out_seq=0 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e49ffb640 10 client.25729 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e49ffb640 1 -- 172.21.15.66:0/837988993 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5f6313890 con 0x55e5f63bc750 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e49ffb640 10 client.25729 handle_command_reply: tid=0 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 client.25729 shutdown 2024-09-15T22:48:04.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 msgr2=0x55e5f63a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e54019920 tx=0x7f3e5400ff80 comp rx=0 tx=0).stop 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 shutdown_connections 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f63bc750 0x55e5f63beb40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 --2- 172.21.15.66:0/837988993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a1850 0x55e5f63a9900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e49ffb640 0 client.25729 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.067+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 >> 172.21.15.66:0/837988993 conn(0x55e5f639dde0 msgr2=0x55e5f63a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.068+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 shutdown_connections 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.068+0000 7f3e6b299740 1 -- 172.21.15.66:0/837988993 wait complete. 2024-09-15T22:48:04.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.068+0000 7f3e6b299740 20 client.25729 trim_cache size 0 max 16384 2024-09-15T22:48:04.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 Processor -- start 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 -- start start 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641b1480 con 0x55e5f63a1850 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641b3140 con 0x55e5f63a2170 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6b299740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641b1b50 con 0x55e5f63aca30 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56938/0 (socket says 172.21.15.66:56938) 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e6259c640 1 -- 172.21.15.66:0/1839194184 learned_addr learned my addr 172.21.15.66:0/1839194184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.085+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 -- 172.21.15.66:0/1839194184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 msgr2=0x55e5f63a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 -- 172.21.15.66:0/1839194184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 msgr2=0x55e5f63c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 -- 172.21.15.66:0/1839194184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5f639dc10 con 0x55e5f63a1850 2024-09-15T22:48:04.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e62d9d640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e6259c640 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3e54010010 tx=0x7f3e54005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba89f00081dc3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e4bfff640 1 -- 172.21.15.66:0/1839194184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54026070 con 0x55e5f63a1850 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e4bfff640 1 -- 172.21.15.66:0/1839194184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e54011030 con 0x55e5f63a1850 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.086+0000 7f3e4bfff640 1 -- 172.21.15.66:0/1839194184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5401e040 con 0x55e5f63a1850 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- 172.21.15.66:0/1839194184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 msgr2=0x55e5f63c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3e54010010 tx=0x7f3e54005970 comp rx=0 tx=0).stop 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- 172.21.15.66:0/1839194184 shutdown_connections 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63aca30 0x55e5f63a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a2170 0x55e5f63c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 --2- 172.21.15.66:0/1839194184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63a1850 0x55e5f63c4310 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- 172.21.15.66:0/1839194184 >> 172.21.15.66:0/1839194184 conn(0x55e5f639dde0 msgr2=0x55e5f63a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- 172.21.15.66:0/1839194184 shutdown_connections 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- 172.21.15.66:0/1839194184 wait complete. 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 -- start start 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.087+0000 7f3e6b299740 1 Processor -- start 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a1850 0x55e5f63b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 0x55e5f63b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641b29b0 con 0x55e5f63aca30 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641b2220 con 0x55e5f63a1850 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641af460 con 0x55e5f63a2170 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6b299740 10 client.0 _ll_register_callbacks cb 0x7f3e5401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:04.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 0x55e5f63b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56946/0 (socket says 172.21.15.66:56946) 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a1850 0x55e5f63b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e62d9d640 1 -- 172.21.15.66:0/3535770402 learned_addr learned my addr 172.21.15.66:0/3535770402 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a1850 msgr2=0x55e5f63b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a1850 0x55e5f63b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3535770402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 msgr2=0x55e5f63b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 -- 172.21.15.66:0/3535770402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5f63b0c00 con 0x55e5f63a2170 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e59d9b640 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 0x55e5f63b0180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cd800 tx=0x7f3e4c0096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c161569eb58d3b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.088+0000 7f3e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c09c390 con 0x55e5f63a2170 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e54011030 con 0x55e5f63a2170 2024-09-15T22:48:04.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3e4c08b370 con 0x55e5f63a2170 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e4c0b5050 con 0x55e5f63a2170 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 10 client.25735 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e5f6427050 con 0x55e5f63a2170 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e54011030 con 0x55e5f63a2170 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f3e4c098a00 con 0x55e5f63a2170 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 10 client.25735 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 10 client.25735 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 20 client.25735 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f64278e0 0x55e5f6429d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 4 client.25735 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x55e5f630dbe0 con 0x55e5f64278e0 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.089+0000 7f3e6259c640 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f64278e0 0x55e5f6429d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:04.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.090+0000 7f3e49ffb640 10 client.25735 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:04.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:04.090+0000 7f3e6259c640 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f64278e0 0x55e5f6429d00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ddff1ce1ba5c19 server_cookie=14d15fb5a87fe1f8 in_seq=0 out_seq=0 2024-09-15T22:48:04.582 INFO:tasks.workunit.client.0.smithi066.stdout: 87 363639 408 237987 468 79796 251 2024-09-15T22:48:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:05 smithi184 ceph-mon[35203]: pgmap v84: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-15T22:48:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:05 smithi066 ceph-mon[31185]: pgmap v84: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-15T22:48:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:05 smithi087 ceph-mon[35290]: pgmap v84: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-15T22:48:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:07 smithi184 ceph-mon[35203]: pgmap v85: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 309 KiB/s wr, 35 op/s 2024-09-15T22:48:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:07 smithi066 ceph-mon[31185]: pgmap v85: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 309 KiB/s wr, 35 op/s 2024-09-15T22:48:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:07 smithi087 ceph-mon[35290]: pgmap v85: 129 pgs: 129 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 309 KiB/s wr, 35 op/s 2024-09-15T22:48:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:09 smithi184 ceph-mon[35203]: pgmap v86: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-15T22:48:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:09 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:48:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:09 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:48:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:09 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:48:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:09 smithi066 ceph-mon[31185]: pgmap v86: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-15T22:48:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:09 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:48:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:09 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:48:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:09 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:48:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:09 smithi087 ceph-mon[35290]: pgmap v86: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-15T22:48:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:09 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:48:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:09 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:48:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:09 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:48:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:48:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:48:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:48:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:48:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:48:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:48:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:11 smithi066 ceph-mon[31185]: pgmap v87: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:11.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:11 smithi184 ceph-mon[35203]: pgmap v87: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:11 smithi087 ceph-mon[35290]: pgmap v87: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:13 smithi066 ceph-mon[31185]: pgmap v88: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:13 smithi087 ceph-mon[35290]: pgmap v88: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:13 smithi184 ceph-mon[35203]: pgmap v88: 129 pgs: 129 active+clean; 358 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-09-15T22:48:14.582 INFO:tasks.workunit.client.0.smithi066.stdout: 88 25767 0 17288 3 5115 9 2024-09-15T22:48:15.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:15 smithi066 ceph-mon[31185]: pgmap v89: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2024-09-15T22:48:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:15 smithi087 ceph-mon[35290]: pgmap v89: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2024-09-15T22:48:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:15 smithi184 ceph-mon[35203]: pgmap v89: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2024-09-15T22:48:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:17 smithi066 ceph-mon[31185]: pgmap v90: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:48:17.479 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:17.479 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 32, 2024-09-15T22:48:17.479 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:48:17.479 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 10, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "d615448f": { 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 10, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 139.6, 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:48:17.480 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e49ffb640 1 -- 172.21.15.66:0/3535770402 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e5f630dbe0 con 0x55e5f64278e0 2024-09-15T22:48:17.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e49ffb640 10 client.25735 handle_command_reply: tid=0 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 client.25735 shutdown 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 msgr2=0x55e5f63b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 0x55e5f63b0180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cd800 tx=0x7f3e4c0096c0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 shutdown_connections 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5f63aca30 0x55e5f63b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5f63a2170 0x55e5f63b0180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5f64278e0 0x55e5f6429d00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 --2- 172.21.15.66:0/3535770402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5f63a1850 0x55e5f63b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 >> 172.21.15.66:0/3535770402 conn(0x55e5f639dde0 msgr2=0x55e5f639c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e49ffb640 0 client.25735 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 shutdown_connections 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 1 -- 172.21.15.66:0/3535770402 wait complete. 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.471+0000 7f3e6b299740 20 client.25735 trim_cache size 0 max 16384 2024-09-15T22:48:17.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.472+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 msgr2=0x7f3e500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.472+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 0x7f3e500a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005e30 tx=0x7f3e5c032fd0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.472+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 msgr2=0x7f3e641a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.472+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00e9c0 tx=0x7f3e4c00ee80 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 shutdown_connections 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3e500a33b0 0x7f3e500a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e641082a0 0x7f3e6419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e641036e0 0x7f3e641a0970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 --2- 172.21.15.66:0/3456574225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e64102d30 0x7f3e641a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:17.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.476+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 >> 172.21.15.66:0/3456574225 conn(0x7f3e640fc7d0 msgr2=0x7f3e64101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:17.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.480+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 shutdown_connections 2024-09-15T22:48:17.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:17.480+0000 7f3e68ec0640 1 -- 172.21.15.66:0/3456574225 wait complete. 2024-09-15T22:48:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:17 smithi087 ceph-mon[35290]: pgmap v90: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:48:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:17 smithi184 ceph-mon[35203]: pgmap v90: 129 pgs: 129 active+clean; 374 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-15T22:48:18.318 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd615448f', quiesce took 17.0 seconds. Will release after: 2.5500000000000007 2024-09-15T22:48:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:19 smithi066 ceph-mon[31185]: pgmap v91: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 281 op/s 2024-09-15T22:48:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:19 smithi087 ceph-mon[35290]: pgmap v91: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 281 op/s 2024-09-15T22:48:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:19 smithi184 ceph-mon[35203]: pgmap v91: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 281 op/s 2024-09-15T22:48:20.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:48:21.145 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:21.443 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:21 smithi066 ceph-mon[31185]: pgmap v92: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:21 smithi087 ceph-mon[35290]: pgmap v92: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 -- 172.21.15.66:0/298737107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090102570 msgr2=0x7fd0901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 --2- 172.21.15.66:0/298737107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090102570 0x7fd0901029b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd084009900 tx=0x7fd08402a480 comp rx=0 tx=0).stop 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 -- 172.21.15.66:0/298737107 shutdown_connections 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 --2- 172.21.15.66:0/298737107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 0x7fd09010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 --2- 172.21.15.66:0/298737107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090102570 0x7fd0901029b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 --2- 172.21.15.66:0/298737107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090100e20 0x7fd090101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 -- 172.21.15.66:0/298737107 >> 172.21.15.66:0/298737107 conn(0x7fd0900fc7d0 msgr2=0x7fd0900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 -- 172.21.15.66:0/298737107 shutdown_connections 2024-09-15T22:48:21.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.625+0000 7fd0965bc640 1 -- 172.21.15.66:0/298737107 wait complete. 2024-09-15T22:48:21.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.626+0000 7fd0965bc640 1 Processor -- start 2024-09-15T22:48:21.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.626+0000 7fd0965bc640 1 -- start start 2024-09-15T22:48:21.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090102570 0x7fd0901a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 0x7fd09019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd090110fa0 con 0x7fd090100e20 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd090110e20 con 0x7fd090102ef0 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd0965bc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd090111120 con 0x7fd090102570 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60294/0 (socket says 172.21.15.66:60294) 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 -- 172.21.15.66:0/3071532760 learned_addr learned my addr 172.21.15.66:0/3071532760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08f7fe640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090102570 0x7fd0901a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd094b59640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 0x7fd09019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 -- 172.21.15.66:0/3071532760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090102570 msgr2=0x7fd0901a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090102570 0x7fd0901a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 -- 172.21.15.66:0/3071532760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 msgr2=0x7fd09019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 0x7fd09019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 -- 172.21.15.66:0/3071532760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09019f3b0 con 0x7fd090100e20 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.627+0000 7fd08ffff640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b4a0 tx=0x7fd08000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.628+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080014070 con 0x7fd090100e20 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.628+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09019f6a0 con 0x7fd090100e20 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.628+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd080010af0 con 0x7fd090100e20 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.628+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0901ab6f0 con 0x7fd090100e20 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.628+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080017d10 con 0x7fd090100e20 2024-09-15T22:48:21.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.629+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c005290 con 0x7fd090100e20 2024-09-15T22:48:21.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.630+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd080017070 con 0x7fd090100e20 2024-09-15T22:48:21.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.631+0000 7fd08d7fa640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 0x7fd0780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:21.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.631+0000 7fd08f7fe640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 0x7fd0780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:21.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.631+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd0800cf630 con 0x7fd090100e20 2024-09-15T22:48:21.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.632+0000 7fd08f7fe640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 0x7fd0780a58f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd0840058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:21.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.634+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd08009bd50 con 0x7fd090100e20 2024-09-15T22:48:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:21 smithi184 ceph-mon[35203]: pgmap v92: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:21.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.850+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd07c005580 con 0x7fd090100e20 2024-09-15T22:48:21.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.851+0000 7fd08d7fa640 1 -- 172.21.15.66:0/3071532760 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7fd08009b650 con 0x7fd090100e20 2024-09-15T22:48:21.854 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:48:21.854 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:48:21.854 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:48:21.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 msgr2=0x7fd0780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 0x7fd0780a58f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd0840058d0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 msgr2=0x7fd0901a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:21.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b4a0 tx=0x7fd08000b960 comp rx=0 tx=0).stop 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 shutdown_connections 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0780a3430 0x7fd0780a58f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd090102ef0 0x7fd09019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd090102570 0x7fd0901a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 --2- 172.21.15.66:0/3071532760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd090100e20 0x7fd0901a4820 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 >> 172.21.15.66:0/3071532760 conn(0x7fd0900fc7d0 msgr2=0x7fd09006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 shutdown_connections 2024-09-15T22:48:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:21.853+0000 7fd0965bc640 1 -- 172.21.15.66:0/3071532760 wait complete. 2024-09-15T22:48:22.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:22 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3071532760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:22.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:22 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3071532760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:22.664 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id d615448f --release --await' 2024-09-15T22:48:22.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id d615448f --release --await 2024-09-15T22:48:22.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:22 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3071532760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:22.934 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:23.323 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:23 smithi066 ceph-mon[31185]: pgmap v93: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2709068217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 msgr2=0x7fb3f010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2709068217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f010e600 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009ca0 tx=0x7fb3e802a950 comp rx=0 tx=0).stop 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2709068217 shutdown_connections 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2709068217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f010e600 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2709068217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2709068217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 0x7fb3f0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2709068217 >> 172.21.15.66:0/2709068217 conn(0x7fb3f00fc7a0 msgr2=0x7fb3f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2709068217 shutdown_connections 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.411+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2709068217 wait complete. 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.412+0000 7fb3f5a16640 1 Processor -- start 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.412+0000 7fb3f5a16640 1 -- start start 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.412+0000 7fb3f5a16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 0x7fb3f0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.412+0000 7fb3f5a16640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.412+0000 7fb3f5a16640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f5a16640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0111f40 con 0x7fb3f010c180 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f5a16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f0111dc0 con 0x7fb3f0102da0 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f5a16640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01120c0 con 0x7fb3f01036c0 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44534/0 (socket says 172.21.15.66:44534) 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 -- 172.21.15.66:0/2955226733 learned_addr learned my addr 172.21.15.66:0/2955226733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:23.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 0x7fb3f0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 -- 172.21.15.66:0/2955226733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 msgr2=0x7fb3f0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 -- 172.21.15.66:0/2955226733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 msgr2=0x7fb3f0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 0x7fb3f0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 -- 172.21.15.66:0/2955226733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f019d3b0 con 0x7fb3f010c180 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3ef7fe640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb3e802ae70 tx=0x7fb3e802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f4a14640 1 -- 172.21.15.66:0/2955226733 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8034040 con 0x7fb3f010c180 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f4a14640 1 -- 172.21.15.66:0/2955226733 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3e8030920 con 0x7fb3f010c180 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f4a14640 1 -- 172.21.15.66:0/2955226733 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8045480 con 0x7fb3f010c180 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.413+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f019d640 con 0x7fb3f010c180 2024-09-15T22:48:23.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.414+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f01a4f80 con 0x7fb3f010c180 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f4a14640 1 -- 172.21.15.66:0/2955226733 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb3e8037020 con 0x7fb3f010c180 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 Processor -- start 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 -- start start 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f697240110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f697242a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f697196620 con 0x55f697230f40 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f69713de50 con 0x55f697231860 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3f7def740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f6971925e0 con 0x55f697240650 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44540/0 (socket says 172.21.15.66:44540) 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.416+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2610034072 learned_addr learned my addr 172.21.15.66:0/2610034072 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f697240110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3f4a14640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 0x7fb3dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2610034072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 msgr2=0x55f697242a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f697242a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2610034072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 msgr2=0x55f697240110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f697240110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2610034072 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69712ed40 con 0x55f697230f40 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3f4a14640 1 -- 172.21.15.66:0/2955226733 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb3e80f0f10 con 0x7fb3f010c180 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3ef7fe640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 0x7fb3dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bd30 tx=0x7fb3d8011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b07ae53be6dbda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e5ffb640 1 -- 172.21.15.66:0/2610034072 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8005020 con 0x55f697230f40 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e5ffb640 1 -- 172.21.15.66:0/2610034072 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d80047a0 con 0x55f697230f40 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.417+0000 7fb3e5ffb640 1 -- 172.21.15.66:0/2610034072 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8012650 con 0x55f697230f40 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- 172.21.15.66:0/2610034072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 msgr2=0x55f697231320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3ef7fe640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 0x7fb3dc0a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8006010 tx=0x7fb3e8004360 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bd30 tx=0x7fb3d8011750 comp rx=0 tx=0).stop 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- 172.21.15.66:0/2610034072 shutdown_connections 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f697242a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f697240110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2610034072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f697231320 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- 172.21.15.66:0/2610034072 >> 172.21.15.66:0/2610034072 conn(0x55f69722d5f0 msgr2=0x55f69722d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- 172.21.15.66:0/2610034072 shutdown_connections 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- 172.21.15.66:0/2610034072 wait complete. 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.418+0000 7fb3f7def740 1 -- start start 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 Processor -- start 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f69723da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f69723dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f697243220 con 0x55f697230f40 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f69711ef10 con 0x55f697231860 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f6972433a0 con 0x55f697240650 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3f7def740 10 client.0 _ll_register_callbacks cb 0x55f697142db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44552/0 (socket says 172.21.15.66:44552) 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 -- 172.21.15.66:0/1292604786 learned_addr learned my addr 172.21.15.66:0/1292604786 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f69723da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 -- 172.21.15.66:0/1292604786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 msgr2=0x55f69723dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f69723dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 -- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 msgr2=0x55f69723da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f69723da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.419+0000 7fb3e67fc640 1 -- 172.21.15.66:0/1292604786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f696ea5580 con 0x55f697230f40 2024-09-15T22:48:23.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bb40 tx=0x7fb3d800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceee883660aaa801 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8023070 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb3d80052c0 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d80047a0 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb3d80054e0 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 10 client.16233 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f696f6f960 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d80047a0 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fb3d801a490 con 0x55f697230f40 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 10 client.16233 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 10 client.16233 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 20 client.16233 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f697252650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 4 client.16233 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.420+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6971a3b90 con 0x55f697250260 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.421+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f697252650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.421+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f697252650 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b64aa0a6e1caad73 server_cookie=cc9d507ba5abd892 in_seq=0 out_seq=0 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.421+0000 7fb3ceffd640 10 client.16233 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3ceffd640 1 -- 172.21.15.66:0/1292604786 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6971a3b90 con 0x55f697250260 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3ceffd640 10 client.16233 handle_command_reply: tid=0 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 client.16233 shutdown 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 msgr2=0x55f69723d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bb40 tx=0x7fb3d800bf60 comp rx=0 tx=0).stop 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 shutdown_connections 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697240650 0x55f69723dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f697252650 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3ceffd640 0 client.16233 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697231860 0x55f69723da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 --2- 172.21.15.66:0/1292604786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69723d540 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 >> 172.21.15.66:0/1292604786 conn(0x55f69722d5f0 msgr2=0x55f697233350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 shutdown_connections 2024-09-15T22:48:23.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 1 -- 172.21.15.66:0/1292604786 wait complete. 2024-09-15T22:48:23.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.422+0000 7fb3f7def740 20 client.16233 trim_cache size 0 max 16384 2024-09-15T22:48:23.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.439+0000 7fb3f7def740 1 Processor -- start 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.439+0000 7fb3f7def740 1 -- start start 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.439+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.439+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697233160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697240650 0x55f697257e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3f7def740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01aced0 con 0x55f697230f40 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3f7def740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01aeb90 con 0x55f697240650 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3f7def740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01ad5a0 con 0x55f697231860 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44568/0 (socket says 172.21.15.66:44568) 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2759862956 learned_addr learned my addr 172.21.15.66:0/2759862956 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697233160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2759862956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 msgr2=0x55f697233160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697233160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2759862956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697240650 msgr2=0x55f697257e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697240650 0x55f697257e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 -- 172.21.15.66:0/2759862956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69723f480 con 0x55f697230f40 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697233160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8001eb0 tx=0x7fb3d800bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb115c21d52dcb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e57fa640 1 -- 172.21.15.66:0/2759862956 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803b020 con 0x55f697230f40 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e57fa640 1 -- 172.21.15.66:0/2759862956 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d800b420 con 0x55f697230f40 2024-09-15T22:48:23.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.440+0000 7fb3e57fa640 1 -- 172.21.15.66:0/2759862956 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8023050 con 0x55f697230f40 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- 172.21.15.66:0/2759862956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 msgr2=0x55f69722d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8001eb0 tx=0x7fb3d800bc30 comp rx=0 tx=0).stop 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- 172.21.15.66:0/2759862956 shutdown_connections 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697240650 0x55f697257e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697233160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 --2- 172.21.15.66:0/2759862956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697230f40 0x55f69722d9d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- 172.21.15.66:0/2759862956 >> 172.21.15.66:0/2759862956 conn(0x55f69722d5f0 msgr2=0x55f697232a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- 172.21.15.66:0/2759862956 shutdown_connections 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- 172.21.15.66:0/2759862956 wait complete. 2024-09-15T22:48:23.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.441+0000 7fb3f7def740 1 -- start start 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 Processor -- start 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697230f40 0x55f697244350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697244890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01ae400 con 0x55f697240650 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01adc70 con 0x55f697230f40 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f01aaeb0 con 0x55f697231860 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3f7def740 10 client.0 _ll_register_callbacks cb 0x7fb3d800be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44574/0 (socket says 172.21.15.66:44574) 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 -- 172.21.15.66:0/3754739830 learned_addr learned my addr 172.21.15.66:0/3754739830 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697244890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697230f40 0x55f697244350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 -- 172.21.15.66:0/3754739830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 msgr2=0x55f697244890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697244890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 -- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697230f40 msgr2=0x55f697244350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697230f40 0x55f697244350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3e67fc640 1 -- 172.21.15.66:0/3754739830 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6972b9dd0 con 0x55f697240650 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.442+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697244890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3e67fc640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8004cb0 tx=0x7fb3d801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6f049787744ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803b070 con 0x55f697240650 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fb3d801a600 con 0x55f697240650 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f69719e0a0 con 0x55f697240650 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb3d8023040 con 0x55f697240650 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3f7def740 10 client.16239 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:23.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f6972bb030 con 0x55f697240650 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f69719e0a0 con 0x55f697240650 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.443+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fb3d8040040 con 0x55f697240650 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 10 client.16239 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 10 client.16239 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 20 client.16239 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f6972bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 4 client.16239 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d615448f", "release": true, "await": true}] 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d615448f", "release": true, "await": true}) -- 0x55f69711a5a0 con 0x55f697250260 2024-09-15T22:48:23.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f6972bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:23.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3eeffd640 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f6972bd760 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2fa249efd3863a server_cookie=f9e6ac7dc6f628e5 in_seq=0 out_seq=0 2024-09-15T22:48:23.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.444+0000 7fb3ceffd640 10 client.16239 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:23 smithi087 ceph-mon[35290]: pgmap v93: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:23 smithi184 ceph-mon[35203]: pgmap v93: 129 pgs: 129 active+clean; 376 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 172 op/s 2024-09-15T22:48:23.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3ceffd640 1 -- 172.21.15.66:0/3754739830 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f69711a5a0 con 0x55f697250260 2024-09-15T22:48:23.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3ceffd640 10 client.16239 handle_command_reply: tid=0 2024-09-15T22:48:23.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 client.16239 shutdown 2024-09-15T22:48:23.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 msgr2=0x55f697244dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8004cb0 tx=0x7fb3d801aca0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 shutdown_connections 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f697240650 0x55f697244dd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f697231860 0x55f697244890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f697250260 0x55f6972bd760 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 --2- 172.21.15.66:0/3754739830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f697230f40 0x55f697244350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3ceffd640 0 client.16239 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.972+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 >> 172.21.15.66:0/3754739830 conn(0x55f69722d5f0 msgr2=0x55f697233270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 shutdown_connections 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f7def740 1 -- 172.21.15.66:0/3754739830 wait complete. 2024-09-15T22:48:23.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f7def740 20 client.16239 trim_cache size 0 max 16384 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 32, 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 12, 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "d615448f": { 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 12, 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:23.977 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 139.6, 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:48:23.978 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:23.979 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 msgr2=0x7fb3dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 0x7fb3dc0a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8006010 tx=0x7fb3e8004360 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 msgr2=0x7fb3f019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.973+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb3e802ae70 tx=0x7fb3e802f5b0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 shutdown_connections 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3dc0a33b0 0x7fb3dc0a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3f010c180 0x7fb3f019ccd0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3f01036c0 0x7fb3f0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 --2- 172.21.15.66:0/2955226733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3f0102da0 0x7fb3f0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:23.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 >> 172.21.15.66:0/2955226733 conn(0x7fb3f00fc7a0 msgr2=0x7fb3f00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:23.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 shutdown_connections 2024-09-15T22:48:23.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:23.974+0000 7fb3f5a16640 1 -- 172.21.15.66:0/2955226733 wait complete. 2024-09-15T22:48:24.582 INFO:tasks.workunit.client.0.smithi066.stdout: 88 197554 64 128431 20 46548 32 2024-09-15T22:48:24.714 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd615448f', total seconds elapsed: 23.4 2024-09-15T22:48:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:25 smithi066 ceph-mon[31185]: pgmap v94: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-09-15T22:48:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:25 smithi087 ceph-mon[35290]: pgmap v94: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-09-15T22:48:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:25 smithi184 ceph-mon[35203]: pgmap v94: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-09-15T22:48:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:27 smithi087 ceph-mon[35290]: pgmap v95: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 223 KiB/s wr, 102 op/s 2024-09-15T22:48:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:27 smithi184 ceph-mon[35203]: pgmap v95: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 223 KiB/s wr, 102 op/s 2024-09-15T22:48:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:27 smithi066 ceph-mon[31185]: pgmap v95: 129 pgs: 129 active+clean; 377 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 223 KiB/s wr, 102 op/s 2024-09-15T22:48:28.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:48:28.809 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:29.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 -- 172.21.15.66:0/675150898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8101410 msgr2=0x7fd1c810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/675150898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8101410 0x7fd1c810d940 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009cd0 tx=0x7fd1c002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 -- 172.21.15.66:0/675150898 shutdown_connections 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/675150898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8101410 0x7fd1c810d940 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/675150898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/675150898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8106a70 0x7fd1c8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 -- 172.21.15.66:0/675150898 >> 172.21.15.66:0/675150898 conn(0x7fd1c80fc790 msgr2=0x7fd1c80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 -- 172.21.15.66:0/675150898 shutdown_connections 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.307+0000 7fd1cefb8640 1 -- 172.21.15.66:0/675150898 wait complete. 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 Processor -- start 2024-09-15T22:48:29.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 -- start start 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 0x7fd1c819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8110e70 con 0x7fd1c8106a70 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8110cf0 con 0x7fd1c8101410 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cefb8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8110ff0 con 0x7fd1c8100a70 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cd555640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1ccd54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cd555640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44596/0 (socket says 172.21.15.66:44596) 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1cd555640 1 -- 172.21.15.66:0/1174115314 learned_addr learned my addr 172.21.15.66:0/1174115314 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.308+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 0x7fd1c819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 -- 172.21.15.66:0/1174115314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 msgr2=0x7fd1c819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 -- 172.21.15.66:0/1174115314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 msgr2=0x7fd1c819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 0x7fd1c819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 -- 172.21.15.66:0/1174115314 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c819f590 con 0x7fd1c8106a70 2024-09-15T22:48:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:29.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 0x7fd1c819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:29.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cd555640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005cc0 tx=0x7fd1c0032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1c5ffb640 1 -- 172.21.15.66:0/1174115314 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0004040 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c819f820 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1c5ffb640 1 -- 172.21.15.66:0/1174115314 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1c00046c0 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1c5ffb640 1 -- 172.21.15.66:0/1174115314 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0030e00 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.309+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c81a7160 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1c5ffb640 1 -- 172.21.15.66:0/1174115314 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd1c00305a0 con 0x7fd1c8106a70 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 Processor -- start 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 -- start start 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 0x55ef2c01e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 0x55ef2c02ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef2bf842e0 con 0x55ef2c029680 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ef2bf2bce0 con 0x55ef2c01e4a0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1d1391740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ef2bf802a0 con 0x55ef2c01edc0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 0x55ef2c01e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1ccd54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1ccd54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56818/0 (socket says 172.21.15.66:56818) 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 0x55ef2c01e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:41184/0 (socket says 172.21.15.66:41184) 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3276916265 learned_addr learned my addr 172.21.15.66:0/3276916265 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1c5ffb640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 0x7fd1b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.312+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 0x55ef2c02ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1cd555640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 0x7fd1b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3276916265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 msgr2=0x55ef2c01e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 0x55ef2c01e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3276916265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 msgr2=0x55ef2c02ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 0x55ef2c02ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3276916265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2bf10440 con 0x55ef2c01edc0 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 0x55ef2c02ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1c5ffb640 1 -- 172.21.15.66:0/1174115314 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd1c002e030 con 0x7fd1c8106a70 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0114f0 tx=0x7fd1bc0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c43bd62157fedaf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1cd555640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 0x7fd1b80a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00eec70 tx=0x7fd1c002a8e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1b2ffd640 1 -- 172.21.15.66:0/3276916265 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e070 con 0x55ef2c01edc0 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1b2ffd640 1 -- 172.21.15.66:0/3276916265 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1bc00faa0 con 0x55ef2c01edc0 2024-09-15T22:48:29.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.313+0000 7fd1b2ffd640 1 -- 172.21.15.66:0/3276916265 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc019b30 con 0x55ef2c01edc0 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- 172.21.15.66:0/3276916265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 msgr2=0x55ef2c029140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0114f0 tx=0x7fd1bc0119b0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- 172.21.15.66:0/3276916265 shutdown_connections 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c029680 0x55ef2c02ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c029140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3276916265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01e4a0 0x55ef2c01e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- 172.21.15.66:0/3276916265 >> 172.21.15.66:0/3276916265 conn(0x55ef2c01aa30 msgr2=0x55ef2c01ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- 172.21.15.66:0/3276916265 shutdown_connections 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- 172.21.15.66:0/3276916265 wait complete. 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.314+0000 7fd1d1391740 1 -- start start 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 Processor -- start 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c028fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 0x55ef2c0267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ef2c02c250 con 0x55ef2c01e4a0 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ef2bf3f050 con 0x55ef2c01edc0 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ef2c02c3d0 con 0x55ef2c029680 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1d1391740 10 client.0 _ll_register_callbacks cb 0x55ef2bf7f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:29.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c028fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1ccd54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c028fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44610/0 (socket says 172.21.15.66:44610) 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1ccd54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:41192/0 (socket says 172.21.15.66:41192) 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1c7fff640 1 -- 172.21.15.66:0/2430489213 learned_addr learned my addr 172.21.15.66:0/2430489213 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.315+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 0x55ef2c0267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 -- 172.21.15.66:0/2430489213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 msgr2=0x55ef2c0267e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 0x55ef2c0267e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 -- 172.21.15.66:0/2430489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 msgr2=0x55ef2c028fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c028fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 -- 172.21.15.66:0/2430489213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2bcf53c0 con 0x55ef2c01edc0 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 0x55ef2c0267e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:29.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc011eb0 tx=0x7fd1bc005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc771e396f1033e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e040 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd1bc00f640 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1bc00faa0 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd1bc030050 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1d1391740 10 client.25790 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.316+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ef2c037c20 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1bc00faa0 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fd1bc021070 con 0x55ef2c01edc0 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 10 client.25790 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 10 client.25790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 20 client.25790 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:29.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0390e0 0x55ef2c03b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 4 client.25790 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef2bf91850 con 0x55ef2c0390e0 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0390e0 0x55ef2c03b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0390e0 0x55ef2c03b4d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219adfd4774ed50c server_cookie=6f44b0184ff92af6 in_seq=0 out_seq=0 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.317+0000 7fd1a7fff640 10 client.25790 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1a7fff640 1 -- 172.21.15.66:0/2430489213 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef2bf91850 con 0x55ef2c0390e0 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1a7fff640 10 client.25790 handle_command_reply: tid=0 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 client.25790 shutdown 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 msgr2=0x55ef2c026280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc011eb0 tx=0x7fd1bc005750 comp rx=0 tx=0).stop 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 shutdown_connections 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c029680 0x55ef2c0267e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0390e0 0x55ef2c03b4d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c01edc0 0x55ef2c026280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 --2- 172.21.15.66:0/2430489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c028fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1a7fff640 0 client.25790 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.318+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 >> 172.21.15.66:0/2430489213 conn(0x55ef2c01aa30 msgr2=0x55ef2c020710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.319+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 shutdown_connections 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.319+0000 7fd1d1391740 1 -- 172.21.15.66:0/2430489213 wait complete. 2024-09-15T22:48:29.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.319+0000 7fd1d1391740 20 client.25790 trim_cache size 0 max 16384 2024-09-15T22:48:29.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 Processor -- start 2024-09-15T22:48:29.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 -- start start 2024-09-15T22:48:29.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c040d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c041290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81b1280 con 0x55ef2c01e4a0 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81b2f40 con 0x55ef2c029680 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1d1391740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81b1950 con 0x55ef2c01edc0 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44624/0 (socket says 172.21.15.66:44624) 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1c7fff640 1 -- 172.21.15.66:0/3320735380 learned_addr learned my addr 172.21.15.66:0/3320735380 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.344+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c040d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c041290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3320735380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 msgr2=0x55ef2c041290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c041290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3320735380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 msgr2=0x55ef2c0354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 -- 172.21.15.66:0/3320735380 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2c01ebf0 con 0x55ef2c01edc0 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c040d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc019660 tx=0x7fd1bc00f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a591862553be110 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1b27fc640 1 -- 172.21.15.66:0/3320735380 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc01e040 con 0x55ef2c01edc0 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1b27fc640 1 -- 172.21.15.66:0/3320735380 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1bc027070 con 0x55ef2c01edc0 2024-09-15T22:48:29.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.345+0000 7fd1b27fc640 1 -- 172.21.15.66:0/3320735380 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc005320 con 0x55ef2c01edc0 2024-09-15T22:48:29.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- 172.21.15.66:0/3320735380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 msgr2=0x55ef2c040d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c040d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc019660 tx=0x7fd1bc00f3c0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- 172.21.15.66:0/3320735380 shutdown_connections 2024-09-15T22:48:29.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c041290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c040d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 --2- 172.21.15.66:0/3320735380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c0354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- 172.21.15.66:0/3320735380 >> 172.21.15.66:0/3320735380 conn(0x55ef2c01aa30 msgr2=0x55ef2c025370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- 172.21.15.66:0/3320735380 shutdown_connections 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- 172.21.15.66:0/3320735380 wait complete. 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 -- start start 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.346+0000 7fd1d1391740 1 Processor -- start 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c02d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c031440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81b27b0 con 0x55ef2c01e4a0 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81b2020 con 0x55ef2c029680 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c81af260 con 0x55ef2c01edc0 2024-09-15T22:48:29.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1d1391740 10 client.0 _ll_register_callbacks cb 0x7fd1bc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:29.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44626/0 (socket says 172.21.15.66:44626) 2024-09-15T22:48:29.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 -- 172.21.15.66:0/540688284 learned_addr learned my addr 172.21.15.66:0/540688284 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:29.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c02d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c031440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 -- 172.21.15.66:0/540688284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 msgr2=0x55ef2c02d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c02d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 -- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 msgr2=0x55ef2c031440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c031440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1c7fff640 1 -- 172.21.15.66:0/540688284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2c026b50 con 0x55ef2c01e4a0 2024-09-15T22:48:29.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.347+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c02d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1c7fff640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4015010 tx=0x7fd1b4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e956597222bef26f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4004020 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd1b40041c0 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1bc027070 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd1b40043c0 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1d1391740 10 client.16257 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ef2c0a3690 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1bc027070 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.348+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fd1b4003c90 con 0x55ef2c01e4a0 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 10 client.16257 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:29.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 20 client.16257 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0a3ea0 0x55ef2c0a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 4 client.16257 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef2bf8bd60 con 0x55ef2c0a3ea0 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0a3ea0 0x55ef2c0a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1ccd54640 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0a3ea0 0x55ef2c0a62c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3f57b0de325f99 server_cookie=eeb996bdf9cee2d in_seq=0 out_seq=0 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1a7fff640 10 client.16257 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1a7fff640 1 -- 172.21.15.66:0/540688284 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ef2bf8bd60 con 0x55ef2c0a3ea0 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1a7fff640 10 client.16257 handle_command_reply: tid=0 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 1 client.16257 shutdown 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 msgr2=0x55ef2c02cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.349+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4015010 tx=0x7fd1b4015040 comp rx=0 tx=0).stop 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 shutdown_connections 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ef2c0a3ea0 0x55ef2c0a62c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef2c029680 0x55ef2c031440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ef2c01edc0 0x55ef2c02d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 --2- 172.21.15.66:0/540688284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ef2c01e4a0 0x55ef2c02cdc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 >> 172.21.15.66:0/540688284 conn(0x55ef2c01aa30 msgr2=0x55ef2c019350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1a7fff640 0 client.16257 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 shutdown_connections 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 1 -- 172.21.15.66:0/540688284 wait complete. 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1d1391740 20 client.16257 trim_cache size 0 max 16384 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:29.362 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:48:29.363 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:48:29.363 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:29.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 msgr2=0x7fd1b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 0x7fd1b80a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00eec70 tx=0x7fd1c002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 msgr2=0x7fd1c819eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.350+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0005cc0 tx=0x7fd1c0032f40 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 shutdown_connections 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd1b80a33b0 0x7fd1b80a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c8106a70 0x7fd1c819eeb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8101410 0x7fd1c819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 --2- 172.21.15.66:0/1174115314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1c8100a70 0x7fd1c819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 >> 172.21.15.66:0/1174115314 conn(0x7fd1c80fc790 msgr2=0x7fd1c806abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 shutdown_connections 2024-09-15T22:48:29.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:29.351+0000 7fd1cefb8640 1 -- 172.21.15.66:0/1174115314 wait complete. 2024-09-15T22:48:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:29 smithi087 ceph-mon[35290]: pgmap v96: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-09-15T22:48:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:29 smithi184 ceph-mon[35203]: pgmap v96: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-09-15T22:48:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:29 smithi066 ceph-mon[31185]: pgmap v96: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-09-15T22:48:30.254 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:48:30.255 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:48:30.724 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:31.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 -- 172.21.15.66:0/3451818227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 msgr2=0x7fef3810dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 --2- 172.21.15.66:0/3451818227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef3810dfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef20009900 tx=0x7fef2002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 -- 172.21.15.66:0/3451818227 shutdown_connections 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 --2- 172.21.15.66:0/3451818227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef381108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 --2- 172.21.15.66:0/3451818227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef3810dfa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 --2- 172.21.15.66:0/3451818227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef38100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 -- 172.21.15.66:0/3451818227 >> 172.21.15.66:0/3451818227 conn(0x7fef380fc7a0 msgr2=0x7fef380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 -- 172.21.15.66:0/3451818227 shutdown_connections 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 -- 172.21.15.66:0/3451818227 wait complete. 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.314+0000 7fef3dee1640 1 Processor -- start 2024-09-15T22:48:31.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 -- start start 2024-09-15T22:48:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef380736d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef3806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef3806c370 con 0x7fef3810e4e0 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef3806c1f0 con 0x7fef381012e0 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef3dee1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef3806c4f0 con 0x7fef38100930 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef377fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef380736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef377fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef380736d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56876/0 (socket says 172.21.15.66:56876) 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:41234/0 (socket says 172.21.15.66:41234) 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef377fe640 1 -- 172.21.15.66:0/3986273967 learned_addr learned my addr 172.21.15.66:0/3986273967 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.315+0000 7fef37fff640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef3806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 -- 172.21.15.66:0/3986273967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 msgr2=0x7fef380736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef380736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 -- 172.21.15.66:0/3986273967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 msgr2=0x7fef38073c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 -- 172.21.15.66:0/3986273967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3806df20 con 0x7fef3810e4e0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef2ffff640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef37fff640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef3806d750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fef30005fd0 tx=0x7fef3000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3000cdf0 con 0x7fef3810e4e0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef3dee1640 1 -- 172.21.15.66:0/3986273967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3806e210 con 0x7fef3810e4e0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef30005020 con 0x7fef3810e4e0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef3dee1640 1 -- 172.21.15.66:0/3986273967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef381af7a0 con 0x7fef3810e4e0 2024-09-15T22:48:31.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.316+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef300106d0 con 0x7fef3810e4e0 2024-09-15T22:48:31.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.318+0000 7fef3dee1640 1 -- 172.21.15.66:0/3986273967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef18005290 con 0x7fef3810e4e0 2024-09-15T22:48:31.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.319+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fef30004a40 con 0x7fef3810e4e0 2024-09-15T22:48:31.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.320+0000 7fef357fa640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 0x7fef240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:31.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.320+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fef300d05f0 con 0x7fef3810e4e0 2024-09-15T22:48:31.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.320+0000 7fef377fe640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 0x7fef240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:31.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.320+0000 7fef377fe640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 0x7fef240a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef28009ce0 tx=0x7fef28005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:31.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.324+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef3009cc00 con 0x7fef3810e4e0 2024-09-15T22:48:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:31 smithi066 ceph-mon[31185]: pgmap v97: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:31 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:48:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:31 smithi087 ceph-mon[35290]: pgmap v97: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:31 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:48:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:31 smithi184 ceph-mon[35203]: pgmap v97: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:31 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:48:31.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.683+0000 7fef3dee1640 1 -- 172.21.15.66:0/3986273967 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef18005850 con 0x7fef3810e4e0 2024-09-15T22:48:31.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.687+0000 7fef357fa640 1 -- 172.21.15.66:0/3986273967 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11988 (secure 0 0 0) 0x7fef3009c500 con 0x7fef3810e4e0 2024-09-15T22:48:31.693 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:48:31.693 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-15T22:47:06:046785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:47:05.129118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:48:31.693 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-15T22:48:31.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.698+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 msgr2=0x7fef240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.698+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 0x7fef240a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef28009ce0 tx=0x7fef28005f90 comp rx=0 tx=0).stop 2024-09-15T22:48:31.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.698+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 msgr2=0x7fef3806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.698+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef3806d750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fef30005fd0 tx=0x7fef3000ef10 comp rx=0 tx=0).stop 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 shutdown_connections 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fef240a3430 0x7fef240a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef3810e4e0 0x7fef3806d750 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef381012e0 0x7fef38073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 --2- 172.21.15.66:0/3986273967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef38100930 0x7fef380736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.699+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 >> 172.21.15.66:0/3986273967 conn(0x7fef380fc7a0 msgr2=0x7fef38102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:31.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.701+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 shutdown_connections 2024-09-15T22:48:31.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:31.704+0000 7fef2e7fc640 1 -- 172.21.15.66:0/3986273967 wait complete. 2024-09-15T22:48:32.518 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:32 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:48:32.518 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:32 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:48:32.518 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:32 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:48:32.518 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3986273967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:32.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:48:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:32 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:48:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:32 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:48:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:32 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:48:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:32 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3986273967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:32 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:48:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:32 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:48:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:32 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:48:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:32 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3986273967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:48:33.029 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:33 smithi066 ceph-mon[31185]: pgmap v98: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:33.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 -- 172.21.15.66:0/3981760420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504101de0 msgr2=0x7fa5041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/3981760420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504101de0 0x7fa5041021c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa500009900 tx=0x7fa50002a410 comp rx=0 tx=0).stop 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 -- 172.21.15.66:0/3981760420 shutdown_connections 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/3981760420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504106f10 0x7fa50410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/3981760420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504102790 0x7fa5041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/3981760420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504101de0 0x7fa5041021c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 -- 172.21.15.66:0/3981760420 >> 172.21.15.66:0/3981760420 conn(0x7fa5040fd8c0 msgr2=0x7fa5040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 -- 172.21.15.66:0/3981760420 shutdown_connections 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 -- 172.21.15.66:0/3981760420 wait complete. 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.578+0000 7fa50c6cc640 1 Processor -- start 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 -- start start 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102790 0x7fa50419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504106f10 0x7fa50419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa504111f70 con 0x7fa504102790 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa504111df0 con 0x7fa504101de0 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50c6cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041120f0 con 0x7fa504106f10 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa509c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102790 0x7fa50419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43458/0 (socket says 172.21.15.66:43458) 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 -- 172.21.15.66:0/2126582109 learned_addr learned my addr 172.21.15.66:0/2126582109 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50ac69640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504106f10 0x7fa50419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 -- 172.21.15.66:0/2126582109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504106f10 msgr2=0x7fa50419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504106f10 0x7fa50419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 -- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102790 msgr2=0x7fa50419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102790 0x7fa50419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.579+0000 7fa50a468640 1 -- 172.21.15.66:0/2126582109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50419f640 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa50a468640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa500006010 tx=0x7fa5000042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa4fb7fe640 1 -- 172.21.15.66:0/2126582109 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50003f030 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50419f8d0 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa4fb7fe640 1 -- 172.21.15.66:0/2126582109 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa500003ce0 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa4fb7fe640 1 -- 172.21.15.66:0/2126582109 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500035070 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.580+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041a7210 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.583+0000 7fa4fb7fe640 1 -- 172.21.15.66:0/2126582109 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa500042030 con 0x7fa504101de0 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.583+0000 7fa50eaa5740 1 Processor -- start 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.583+0000 7fa50eaa5740 1 -- start start 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc525d0 0x55fe0cc52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cbb82f0 con 0x55fe0cc5d370 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cb5fcf0 con 0x55fe0cc53b40 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cbb42b0 con 0x55fe0cc525d0 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43460/0 (socket says 172.21.15.66:43460) 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 -- 172.21.15.66:0/4162772096 learned_addr learned my addr 172.21.15.66:0/4162772096 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50a468640 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc525d0 0x55fe0cc52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa509c67640 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa4fb7fe640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 0x7fa4f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 -- 172.21.15.66:0/4162772096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc525d0 msgr2=0x55fe0cc52a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc525d0 0x55fe0cc52a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 -- 172.21.15.66:0/4162772096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc5d370 msgr2=0x55fe0cc5f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 -- 172.21.15.66:0/4162772096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cb443a0 con 0x55fe0cc53b40 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 0x7fa4f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa4fb7fe640 1 -- 172.21.15.66:0/2126582109 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa5000f0620 con 0x7fa504101de0 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.584+0000 7fa50ac69640 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc010440 tx=0x7fa4fc010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b719320151e201f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.585+0000 7fa4f8ff9640 1 -- 172.21.15.66:0/4162772096 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc01d400 con 0x55fe0cc53b40 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.585+0000 7fa4f8ff9640 1 -- 172.21.15.66:0/4162772096 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4fc01da80 con 0x55fe0cc53b40 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.585+0000 7fa50ac69640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 0x7fa4f00a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc021000 tx=0x7fa4fc01e000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.585+0000 7fa4f8ff9640 1 -- 172.21.15.66:0/4162772096 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc01c8f0 con 0x55fe0cc53b40 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- 172.21.15.66:0/4162772096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 msgr2=0x55fe0cc52090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc010440 tx=0x7fa4fc010900 comp rx=0 tx=0).stop 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- 172.21.15.66:0/4162772096 shutdown_connections 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc525d0 0x55fe0cc52a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/4162772096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc53b40 0x55fe0cc52090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- 172.21.15.66:0/4162772096 >> 172.21.15.66:0/4162772096 conn(0x55fe0cc1b310 msgr2=0x55fe0cc4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- 172.21.15.66:0/4162772096 shutdown_connections 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- 172.21.15.66:0/4162772096 wait complete. 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 -- start start 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.586+0000 7fa50eaa5740 1 Processor -- start 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc5a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cc60070 con 0x55fe0cc53b40 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cb73060 con 0x55fe0cc525d0 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fe0cc601f0 con 0x55fe0cc5d370 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50eaa5740 10 client.0 _ll_register_callbacks cb 0x55fe0c8c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa509c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc5a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa509c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc5a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51394/0 (socket says 172.21.15.66:51394) 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa509c67640 1 -- 172.21.15.66:0/3936368937 learned_addr learned my addr 172.21.15.66:0/3936368937 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50ac69640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 -- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 msgr2=0x55fe0cc5a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 -- 172.21.15.66:0/3936368937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 msgr2=0x55fe0cc5a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc5a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 -- 172.21.15.66:0/3936368937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0c9293c0 con 0x55fe0cc525d0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50ac69640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa50a468640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc5cd70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5000ed9a0 tx=0x7fa500005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e7965a7ee1ec8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.587+0000 7fa4edffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000dc070 con 0x55fe0cc525d0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa5000b8d10 con 0x55fe0cc525d0 2024-09-15T22:48:33.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4fc01da80 con 0x55fe0cc525d0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa500049070 con 0x55fe0cc525d0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa50eaa5740 10 client.25814 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe0cc6bb10 con 0x55fe0cc525d0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4fc01da80 con 0x55fe0cc525d0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.588+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fa5000bc900 con 0x55fe0cc525d0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 10 client.25814 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 10 client.25814 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 20 client.25814 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0cc6cf70 0x55fe0cc6f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 4 client.25814 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe0cbc5860 con 0x55fe0cc6cf70 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.589+0000 7fa509c67640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0cc6cf70 0x55fe0cc6f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.590+0000 7fa509c67640 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0cc6cf70 0x55fe0cc6f3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ff8388f42b4379d server_cookie=293454c7b08345bb in_seq=0 out_seq=0 2024-09-15T22:48:33.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.590+0000 7fa4edffb640 10 client.25814 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.590+0000 7fa4edffb640 1 -- 172.21.15.66:0/3936368937 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe0cbc5860 con 0x55fe0cc6cf70 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.590+0000 7fa4edffb640 10 client.25814 handle_command_reply: tid=0 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.590+0000 7fa50eaa5740 1 client.25814 shutdown 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 msgr2=0x55fe0cc5cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc5cd70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5000ed9a0 tx=0x7fa500005750 comp rx=0 tx=0).stop 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 shutdown_connections 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0cc6cf70 0x55fe0cc6f3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc5a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa4edffb640 0 client.25814 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc5a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/3936368937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc5cd70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 >> 172.21.15.66:0/3936368937 conn(0x55fe0cc1b310 msgr2=0x55fe0cc54960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 shutdown_connections 2024-09-15T22:48:33.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 1 -- 172.21.15.66:0/3936368937 wait complete. 2024-09-15T22:48:33.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.591+0000 7fa50eaa5740 20 client.25814 trim_cache size 0 max 16384 2024-09-15T22:48:33.608 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:33 smithi087 ceph-mon[35290]: pgmap v98: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:33.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.605+0000 7fa50eaa5740 1 Processor -- start 2024-09-15T22:48:33.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.605+0000 7fa50eaa5740 1 -- start start 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc55660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b12a0 con 0x55fe0cc53b40 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b2f60 con 0x55fe0cc525d0 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b1970 con 0x55fe0cc5d370 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa509c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa509c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51398/0 (socket says 172.21.15.66:51398) 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa509c67640 1 -- 172.21.15.66:0/1259124684 learned_addr learned my addr 172.21.15.66:0/1259124684 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50ac69640 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc55660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 -- 172.21.15.66:0/1259124684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 msgr2=0x55fe0cc55660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc55660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 -- 172.21.15.66:0/1259124684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 msgr2=0x55fe0cc55120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 -- 172.21.15.66:0/1259124684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0cc58fd0 con 0x55fe0cc525d0 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa509c67640 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa50a468640 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc598e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5000b9070 tx=0x7fa5000babb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=294a2924627e3fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.606+0000 7fa4effff640 1 -- 172.21.15.66:0/1259124684 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000dc040 con 0x55fe0cc525d0 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa4effff640 1 -- 172.21.15.66:0/1259124684 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5000c09a0 con 0x55fe0cc525d0 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa4effff640 1 -- 172.21.15.66:0/1259124684 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5000edc20 con 0x55fe0cc525d0 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 -- 172.21.15.66:0/1259124684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 msgr2=0x55fe0cc598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc598e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5000b9070 tx=0x7fa5000babb0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 -- 172.21.15.66:0/1259124684 shutdown_connections 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc5d370 0x55fe0cc55660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc53b40 0x55fe0cc55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/1259124684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc525d0 0x55fe0cc598e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.607+0000 7fa50eaa5740 1 -- 172.21.15.66:0/1259124684 >> 172.21.15.66:0/1259124684 conn(0x55fe0cc1b310 msgr2=0x55fe0cc5c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- 172.21.15.66:0/1259124684 shutdown_connections 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- 172.21.15.66:0/1259124684 wait complete. 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- start start 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 Processor -- start 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 0x55fe0cc613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 0x55fe0cc61e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b27d0 con 0x55fe0cc525d0 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b2040 con 0x55fe0cc5d370 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041af280 con 0x55fe0cc53b40 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50eaa5740 10 client.0 _ll_register_callbacks cb 0x7fa5000f6240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa509c67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa50a468640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 0x55fe0cc613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa509c67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43822/0 (socket says 172.21.15.66:43822) 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.608+0000 7fa509c67640 1 -- 172.21.15.66:0/2680708454 learned_addr learned my addr 172.21.15.66:0/2680708454 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa50ac69640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 0x55fe0cc61e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 -- 172.21.15.66:0/2680708454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 msgr2=0x55fe0cc61e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 0x55fe0cc61e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 -- 172.21.15.66:0/2680708454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 msgr2=0x55fe0cc613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 0x55fe0cc613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 -- 172.21.15.66:0/2680708454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0cc5a980 con 0x55fe0cc53b40 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa50a468640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 0x55fe0cc613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa50ac69640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 0x55fe0cc61e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa509c67640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55fe0cc6fc60 tx=0x7fa4f4010b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28d7dc38444295a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa4edffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4022070 con 0x55fe0cc53b40 2024-09-15T22:48:33.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa4f4004250 con 0x55fe0cc53b40 2024-09-15T22:48:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.609+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5000c09a0 con 0x55fe0cc53b40 2024-09-15T22:48:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa4f4004450 con 0x55fe0cc53b40 2024-09-15T22:48:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 10 client.25789 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe0ccd7fe0 con 0x55fe0cc53b40 2024-09-15T22:48:33.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5000c09a0 con 0x55fe0cc53b40 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fa4f401f400 con 0x55fe0cc53b40 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 10 client.25789 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 10 client.25789 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 20 client.25789 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0ccd8790 0x55fe0ccdabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 4 client.25789 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe0cbbfd70 con 0x55fe0ccd8790 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.610+0000 7fa50a468640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0ccd8790 0x55fe0ccdabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50a468640 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0ccd8790 0x55fe0ccdabb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c2e58352c88e85c0 server_cookie=40c873fe4d4dca78 in_seq=0 out_seq=0 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa4edffb640 10 client.25789 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa4edffb640 1 -- 172.21.15.66:0/2680708454 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe0cbbfd70 con 0x55fe0ccd8790 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa4edffb640 10 client.25789 handle_command_reply: tid=0 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 client.25789 shutdown 2024-09-15T22:48:33.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 msgr2=0x55fe0cc61900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55fe0cc6fc60 tx=0x7fa4f4010b30 comp rx=0 tx=0).stop 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 shutdown_connections 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55fe0ccd8790 0x55fe0ccdabb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe0cc5d370 0x55fe0cc61e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe0cc53b40 0x55fe0cc61900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa4edffb640 0 client.25789 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 --2- 172.21.15.66:0/2680708454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe0cc525d0 0x55fe0cc613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 >> 172.21.15.66:0/2680708454 conn(0x55fe0cc1b310 msgr2=0x55fe0cc4d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 shutdown_connections 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 1 -- 172.21.15.66:0/2680708454 wait complete. 2024-09-15T22:48:33.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.611+0000 7fa50eaa5740 20 client.25789 trim_cache size 0 max 16384 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 msgr2=0x7fa4f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 0x7fa4f00a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc021000 tx=0x7fa4fc01e000 comp rx=0 tx=0).stop 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 msgr2=0x7fa50419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa500006010 tx=0x7fa5000042f0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 shutdown_connections 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4f00a33b0 0x7fa4f00a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa504106f10 0x7fa50419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102790 0x7fa50419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 --2- 172.21.15.66:0/2126582109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa504101de0 0x7fa50419a690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 >> 172.21.15.66:0/2126582109 conn(0x7fa5040fd8c0 msgr2=0x7fa5040febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.612+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 shutdown_connections 2024-09-15T22:48:33.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:33.613+0000 7fa50c6cc640 1 -- 172.21.15.66:0/2126582109 wait complete. 2024-09-15T22:48:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:33 smithi184 ceph-mon[35203]: pgmap v98: 129 pgs: 129 active+clean; 411 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-15T22:48:34.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:48:34.582 INFO:tasks.workunit.client.0.smithi066.stdout: 110 851089 1069 554590 1155 182536 707 2024-09-15T22:48:34.856 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:35.267 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:35 smithi066 ceph-mon[31185]: pgmap v99: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-09-15T22:48:35.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 -- 172.21.15.66:0/3886828912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 msgr2=0x7fe010100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3886828912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe010100d90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009900 tx=0x7fe00c02a410 comp rx=0 tx=0).stop 2024-09-15T22:48:35.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 -- 172.21.15.66:0/3886828912 shutdown_connections 2024-09-15T22:48:35.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3886828912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe0101108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3886828912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3886828912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe010100d90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 -- 172.21.15.66:0/3886828912 >> 172.21.15.66:0/3886828912 conn(0x7fe0100fc7d0 msgr2=0x7fe0100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 -- 172.21.15.66:0/3886828912 shutdown_connections 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.370+0000 7fe0185cc640 1 -- 172.21.15.66:0/3886828912 wait complete. 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.371+0000 7fe0185cc640 1 Processor -- start 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.371+0000 7fe0185cc640 1 -- start start 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.371+0000 7fe0185cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe01019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.371+0000 7fe0185cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe0185cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe01019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe0185cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114210 con 0x7fe0101009b0 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe0185cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114090 con 0x7fe010101360 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe0185cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe010114390 con 0x7fe01010e4d0 2024-09-15T22:48:35.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe016368640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe01019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe016368640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe01019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51426/0 (socket says 172.21.15.66:51426) 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe016368640 1 -- 172.21.15.66:0/3988993419 learned_addr learned my addr 172.21.15.66:0/3988993419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe016b69640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe01019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 -- 172.21.15.66:0/3988993419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 msgr2=0x7fe01019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe01019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 -- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 msgr2=0x7fe01019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe01019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe015b67640 1 -- 172.21.15.66:0/3988993419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01019f6c0 con 0x7fe010101360 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.372+0000 7fe016b69640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe01019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe015b67640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01019ac50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e9f0 tx=0x7fe00000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe0077fe640 1 -- 172.21.15.66:0/3988993419 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00000ccc0 con 0x7fe010101360 2024-09-15T22:48:35.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01019f9b0 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe0077fe640 1 -- 172.21.15.66:0/3988993419 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe000010910 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe0077fe640 1 -- 172.21.15.66:0/3988993419 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0000188e0 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.373+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101a7290 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.375+0000 7fe0077fe640 1 -- 172.21.15.66:0/3988993419 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe000018a80 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.376+0000 7fe0077fe640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 0x7fdffc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.377+0000 7fe016368640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 0x7fdffc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.377+0000 7fe0077fe640 1 -- 172.21.15.66:0/3988993419 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fe0000d05f0 con 0x7fe010101360 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.377+0000 7fe01a9a5740 1 Processor -- start 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.377+0000 7fe01a9a5740 1 -- start start 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.377+0000 7fe016368640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 0x7fdffc0a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0096c0 tx=0x7fe00c005a20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a0f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56108a05e2f0 con 0x56108a103370 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56108a005cf0 con 0x56108a0f9b40 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56108a05a2b0 con 0x56108a0f85d0 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43512/0 (socket says 172.21.15.66:43512) 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 -- 172.21.15.66:0/3106289974 learned_addr learned my addr 172.21.15.66:0/3106289974 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016b69640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe015b67640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a0f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 -- 172.21.15.66:0/3106289974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 msgr2=0x56108a0f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a0f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 -- 172.21.15.66:0/3106289974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 msgr2=0x56108a105760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a105760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016368640 1 -- 172.21.15.66:0/3106289974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561089fea3a0 con 0x56108a0f9b40 2024-09-15T22:48:35.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.378+0000 7fe016b69640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.379+0000 7fe016368640 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009a20 tx=0x7fe00c03d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b142a24bd65290fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.379+0000 7fe004ff9640 1 -- 172.21.15.66:0/3106289974 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c035040 con 0x56108a0f9b40 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.379+0000 7fe004ff9640 1 -- 172.21.15.66:0/3106289974 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe00c04d070 con 0x56108a0f9b40 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.379+0000 7fe004ff9640 1 -- 172.21.15.66:0/3106289974 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0049a0 con 0x56108a0f9b40 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- 172.21.15.66:0/3106289974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 msgr2=0x56108a0f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009a20 tx=0x7fe00c03d000 comp rx=0 tx=0).stop 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- 172.21.15.66:0/3106289974 shutdown_connections 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a0f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/3106289974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a0f8090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- 172.21.15.66:0/3106289974 >> 172.21.15.66:0/3106289974 conn(0x56108a0c1310 msgr2=0x56108a0f4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- 172.21.15.66:0/3106289974 shutdown_connections 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- 172.21.15.66:0/3106289974 wait complete. 2024-09-15T22:48:35.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 -- start start 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.380+0000 7fe01a9a5740 1 Processor -- start 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a102d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a0f9b40 0x56108a0fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 0x56108a100530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56108a106010 con 0x56108a0f9b40 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56108a019060 con 0x56108a0f85d0 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56108a106190 con 0x56108a103370 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016368640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016368640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a102d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43514/0 (socket says 172.21.15.66:43514) 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016368640 1 -- 172.21.15.66:0/743532139 learned_addr learned my addr 172.21.15.66:0/743532139 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe015b67640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a0f9b40 0x56108a0fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 0x56108a100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe01a9a5740 10 client.0 _ll_register_callbacks cb 0x561089d6c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:35.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 -- 172.21.15.66:0/743532139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 msgr2=0x56108a102d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a102d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 -- 172.21.15.66:0/743532139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a0f9b40 msgr2=0x56108a0fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a0f9b40 0x56108a0fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.381+0000 7fe016b69640 1 -- 172.21.15.66:0/743532139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561089dcf3c0 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00c04d070 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe016b69640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 0x56108a100530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe008005fd0 tx=0x7fe008011df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d9c55302ee30a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fdff9ffb640 10 client.25801 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fdff9ffb640 1 -- 172.21.15.66:0/743532139 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008010c00 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fdff9ffb640 1 -- 172.21.15.66:0/743532139 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fe008010da0 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fdff9ffb640 1 -- 172.21.15.66:0/743532139 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe008004b20 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 10 client.25801 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=32}) -- 0x56108a111910 con 0x56108a103370 2024-09-15T22:48:35.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fdff9ffb640 1 -- 172.21.15.66:0/743532139 <== mon.1 v2:172.21.15.184:3300/0 4 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fe00801a410 con 0x56108a103370 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 10 client.25801 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 10 client.25801 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 20 client.25801 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a112cc0 0x56108a1150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 4 client.25801 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.382+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56108a06b860 con 0x56108a112cc0 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.383+0000 7fe016368640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a112cc0 0x56108a1150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.383+0000 7fdff9ffb640 10 client.25801 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:48:35.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.383+0000 7fe016368640 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a112cc0 0x56108a1150f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81b7cf770e4e2e00 server_cookie=73317c3f1ee3e59d in_seq=0 out_seq=0 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fdff9ffb640 1 -- 172.21.15.66:0/743532139 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56108a06b860 con 0x56108a112cc0 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fdff9ffb640 10 client.25801 handle_command_reply: tid=0 2024-09-15T22:48:35.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 client.25801 shutdown 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 msgr2=0x56108a100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 0x56108a100530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe008005fd0 tx=0x7fe008011df0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 shutdown_connections 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a112cc0 0x56108a1150f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a103370 0x56108a100530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a0f9b40 0x56108a0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fdff9ffb640 0 client.25801 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/743532139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 >> 172.21.15.66:0/743532139 conn(0x56108a0c1310 msgr2=0x56108a0fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 shutdown_connections 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 1 -- 172.21.15.66:0/743532139 wait complete. 2024-09-15T22:48:35.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.384+0000 7fe01a9a5740 20 client.25801 trim_cache size 0 max 16384 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.412+0000 7fe01a9a5740 1 Processor -- start 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.412+0000 7fe01a9a5740 1 -- start start 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.412+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.412+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a11a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a11af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101b1320 con 0x56108a103370 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101b2fe0 con 0x56108a0f9b40 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101b19f0 con 0x56108a0f85d0 2024-09-15T22:48:35.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016b69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a11af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43864/0 (socket says 172.21.15.66:43864) 2024-09-15T22:48:35.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 -- 172.21.15.66:0/1446181248 learned_addr learned my addr 172.21.15.66:0/1446181248 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:35.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe015b67640 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a11a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 -- 172.21.15.66:0/1446181248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 msgr2=0x56108a11a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a11a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 -- 172.21.15.66:0/1446181248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 msgr2=0x56108a11af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a11af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 -- 172.21.15.66:0/1446181248 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108a102920 con 0x56108a0f85d0 2024-09-15T22:48:35.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe015b67640 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a11a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fe016368640 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00c005ab0 tx=0x7fe00c0053c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8e906abf1d425f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.413+0000 7fdffbfff640 1 -- 172.21.15.66:0/1446181248 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c040040 con 0x56108a0f85d0 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fdffbfff640 1 -- 172.21.15.66:0/1446181248 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe00c060070 con 0x56108a0f85d0 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fdffbfff640 1 -- 172.21.15.66:0/1446181248 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c035040 con 0x56108a0f85d0 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 -- 172.21.15.66:0/1446181248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 msgr2=0x56108a10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00c005ab0 tx=0x7fe00c0053c0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 -- 172.21.15.66:0/1446181248 shutdown_connections 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a11af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f9b40 0x56108a11a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/1446181248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f85d0 0x56108a10f2b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.414+0000 7fe01a9a5740 1 -- 172.21.15.66:0/1446181248 >> 172.21.15.66:0/1446181248 conn(0x56108a0c1310 msgr2=0x56108a0fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- 172.21.15.66:0/1446181248 shutdown_connections 2024-09-15T22:48:35.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- 172.21.15.66:0/1446181248 wait complete. 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- start start 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 Processor -- start 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a1075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a17c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101b2850 con 0x56108a103370 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101b20c0 con 0x56108a0f85d0 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101af300 con 0x56108a0f9b40 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe01a9a5740 10 client.0 _ll_register_callbacks cb 0x7fe008009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe015b67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe015b67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43868/0 (socket says 172.21.15.66:43868) 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.415+0000 7fe015b67640 1 -- 172.21.15.66:0/2296580522 learned_addr learned my addr 172.21.15.66:0/2296580522 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe016368640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a1075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe016b69640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a17c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 -- 172.21.15.66:0/2296580522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 msgr2=0x56108a1075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a1075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 -- 172.21.15.66:0/2296580522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 msgr2=0x56108a17c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a17c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 -- 172.21.15.66:0/2296580522 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108a17ced0 con 0x56108a0f9b40 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe016b69640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a17c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe015b67640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0000a4be0 tx=0x7fe00009cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9713be5ac651ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fdff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0000a0850 con 0x56108a0f9b40 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fe0000b52b0 con 0x56108a0f9b40 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00c060070 con 0x56108a0f9b40 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe00007e050 con 0x56108a0f9b40 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe01a9a5740 10 client.25807 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:35.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.416+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56108a17e0b0 con 0x56108a0f9b40 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe00c060070 con 0x56108a0f9b40 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fe00009b980 con 0x56108a0f9b40 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 10 client.25807 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 10 client.25807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 20 client.25807 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a17e850 0x56108a180c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 4 client.25807 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56108a065d70 con 0x56108a17e850 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe016368640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a17e850 0x56108a180c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fdff9ffb640 10 client.25807 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.417+0000 7fe016368640 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a17e850 0x56108a180c40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be5f47d7c9511ce7 server_cookie=de4b3efdc2ffa3ee in_seq=0 out_seq=0 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fdff9ffb640 1 -- 172.21.15.66:0/2296580522 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56108a065d70 con 0x56108a17e850 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fdff9ffb640 10 client.25807 handle_command_reply: tid=0 2024-09-15T22:48:35.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 client.25807 shutdown 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 msgr2=0x56108a107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0000a4be0 tx=0x7fe00009cba0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 shutdown_connections 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56108a17e850 0x56108a180c40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56108a103370 0x56108a17c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56108a0f9b40 0x56108a107b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fdff9ffb640 0 client.25807 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 --2- 172.21.15.66:0/2296580522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56108a0f85d0 0x56108a1075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 >> 172.21.15.66:0/2296580522 conn(0x56108a0c1310 msgr2=0x56108a0f34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 shutdown_connections 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 1 -- 172.21.15.66:0/2296580522 wait complete. 2024-09-15T22:48:35.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe01a9a5740 20 client.25807 trim_cache size 0 max 16384 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 msgr2=0x7fdffc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 0x7fdffc0a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0096c0 tx=0x7fe00c005a20 comp rx=0 tx=0).stop 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 msgr2=0x7fe01019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.418+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01019ac50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e9f0 tx=0x7fe00000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 shutdown_connections 2024-09-15T22:48:35.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdffc0a3430 0x7fdffc0a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe01010e4d0 0x7fe01019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe010101360 0x7fe01019ac50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 --2- 172.21.15.66:0/3988993419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0101009b0 0x7fe01019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 >> 172.21.15.66:0/3988993419 conn(0x7fe0100fc7d0 msgr2=0x7fe0100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 shutdown_connections 2024-09-15T22:48:35.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:35.419+0000 7fe0185cc640 1 -- 172.21.15.66:0/3988993419 wait complete. 2024-09-15T22:48:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:35 smithi087 ceph-mon[35290]: pgmap v99: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-09-15T22:48:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:35 smithi184 ceph-mon[35203]: pgmap v99: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-09-15T22:48:36.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:48:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 -- 172.21.15.66:0/3222915152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 msgr2=0x7f008c10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 --2- 172.21.15.66:0/3222915152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c10e9c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0084009cd0 tx=0x7f008402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 -- 172.21.15.66:0/3222915152 shutdown_connections 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 --2- 172.21.15.66:0/3222915152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c10e9c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 --2- 172.21.15.66:0/3222915152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 0x7f008c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 --2- 172.21.15.66:0/3222915152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008c107af0 0x7f008c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 -- 172.21.15.66:0/3222915152 >> 172.21.15.66:0/3222915152 conn(0x7f008c0fd700 msgr2=0x7f008c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 -- 172.21.15.66:0/3222915152 shutdown_connections 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.085+0000 7f0092b9e640 1 -- 172.21.15.66:0/3222915152 wait complete. 2024-09-15T22:48:37.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 Processor -- start 2024-09-15T22:48:37.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 -- start start 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 0x7f008c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008c107af0 0x7f008c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f008c111ef0 con 0x7f008c102380 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f008c111d70 con 0x7f008c1019e0 2024-09-15T22:48:37.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0092b9e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f008c112070 con 0x7f008c107af0 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51486/0 (socket says 172.21.15.66:51486) 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 -- 172.21.15.66:0/2610246602 learned_addr learned my addr 172.21.15.66:0/2610246602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f0091b9c640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 0x7f008c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 -- 172.21.15.66:0/2610246602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008c107af0 msgr2=0x7f008c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008c107af0 0x7f008c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 -- 172.21.15.66:0/2610246602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 msgr2=0x7f008c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 0x7f008c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.086+0000 7f009139b640 1 -- 172.21.15.66:0/2610246602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c19d2c0 con 0x7f008c102380 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f009139b640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c920 tx=0x7f007c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f0082ffd640 1 -- 172.21.15.66:0/2610246602 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c007c70 con 0x7f008c102380 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c19d5b0 con 0x7f008c102380 2024-09-15T22:48:37.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f0082ffd640 1 -- 172.21.15.66:0/2610246602 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f007c007e10 con 0x7f008c102380 2024-09-15T22:48:37.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f0082ffd640 1 -- 172.21.15.66:0/2610246602 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c018890 con 0x7f008c102380 2024-09-15T22:48:37.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.087+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c1a4e90 con 0x7f008c102380 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.089+0000 7f0082ffd640 1 -- 172.21.15.66:0/2610246602 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f007c018b30 con 0x7f008c102380 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 Processor -- start 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 -- start start 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da18bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a82d97e2f0 con 0x55a82da19d20 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a82d925cf0 con 0x55a82da187b0 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f00961d9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a82d97a2b0 con 0x55a82da27960 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f0082ffd640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 0x7f00780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f009239d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f009239d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da18270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51496/0 (socket says 172.21.15.66:51496) 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f009239d640 1 -- 172.21.15.66:0/916957025 learned_addr learned my addr 172.21.15.66:0/916957025 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f0091b9c640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da18bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f009239d640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 0x7f00780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.090+0000 7f009139b640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 -- 172.21.15.66:0/916957025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 msgr2=0x55a82da29d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0082ffd640 1 -- 172.21.15.66:0/2610246602 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f007c0d0240 con 0x7f008c102380 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 -- 172.21.15.66:0/916957025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 msgr2=0x55a82da18270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da18270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 -- 172.21.15.66:0/916957025 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82d90a3a0 con 0x55a82da187b0 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f009139b640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:37.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0091b9c640 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da18bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f00880045b0 tx=0x7f008800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d805b6255de83f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f009239d640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 0x7f00780a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0084004af0 tx=0x7f00840093c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0077fff640 1 -- 172.21.15.66:0/916957025 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088003bd0 con 0x55a82da187b0 2024-09-15T22:48:37.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0077fff640 1 -- 172.21.15.66:0/916957025 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0088015070 con 0x55a82da187b0 2024-09-15T22:48:37.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.091+0000 7f0077fff640 1 -- 172.21.15.66:0/916957025 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088004d00 con 0x55a82da187b0 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 -- 172.21.15.66:0/916957025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 msgr2=0x55a82da18bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da18bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f00880045b0 tx=0x7f008800bb20 comp rx=0 tx=0).stop 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 -- 172.21.15.66:0/916957025 shutdown_connections 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da18bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 --2- 172.21.15.66:0/916957025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da18270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 -- 172.21.15.66:0/916957025 >> 172.21.15.66:0/916957025 conn(0x55a82d9e1310 msgr2=0x55a82da14e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 -- 172.21.15.66:0/916957025 shutdown_connections 2024-09-15T22:48:37.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.092+0000 7f00961d9740 1 -- 172.21.15.66:0/916957025 wait complete. 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 -- start start 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 Processor -- start 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da19d20 0x55a82da24550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a82da2a660 con 0x55a82da27960 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a82d939060 con 0x55a82da187b0 2024-09-15T22:48:37.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a82da2a7e0 con 0x55a82da19d20 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f00961d9740 10 client.0 _ll_register_callbacks cb 0x55a82d68c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f009239d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f009239d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51502/0 (socket says 172.21.15.66:51502) 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f009239d640 1 -- 172.21.15.66:0/1724243610 learned_addr learned my addr 172.21.15.66:0/1724243610 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.093+0000 7f0091b9c640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009139b640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da19d20 0x55a82da24550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 -- 172.21.15.66:0/1724243610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da19d20 msgr2=0x55a82da24550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da19d20 0x55a82da24550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 -- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 msgr2=0x55a82da272a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da272a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 -- 172.21.15.66:0/1724243610 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82d6ef3c0 con 0x55a82da27960 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f009239d640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0084009430 tx=0x7f0084044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee8bd31c8180a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00757fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084005450 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0088015070 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f00840055f0 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f008405a050 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00961d9740 10 client.16311 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.094+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a82da36040 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0088015070 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f0084030070 con 0x55a82da27960 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 10 client.16311 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 10 client.16311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 20 client.16311 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82da37450 0x55a82da398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 4 client.16311 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a82d98b860 con 0x55a82da37450 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.095+0000 7f0091b9c640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82da37450 0x55a82da398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f0091b9c640 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82da37450 0x55a82da398c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa65a47ec491040a server_cookie=a63213da2aa502ae in_seq=0 out_seq=0 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00757fa640 10 client.16311 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00757fa640 1 -- 172.21.15.66:0/1724243610 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a82d98b860 con 0x55a82da37450 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00757fa640 10 client.16311 handle_command_reply: tid=0 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00961d9740 1 client.16311 shutdown 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 msgr2=0x55a82da24a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.096+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0084009430 tx=0x7f0084044000 comp rx=0 tx=0).stop 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 shutdown_connections 2024-09-15T22:48:37.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82da37450 0x55a82da398c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da27960 0x55a82da24a90 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da19d20 0x55a82da24550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 --2- 172.21.15.66:0/1724243610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da272a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00757fa640 0 client.16311 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 >> 172.21.15.66:0/1724243610 conn(0x55a82d9e1310 msgr2=0x55a82da1ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 shutdown_connections 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 1 -- 172.21.15.66:0/1724243610 wait complete. 2024-09-15T22:48:37.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.097+0000 7f00961d9740 20 client.16311 trim_cache size 0 max 16384 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 Processor -- start 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 -- start start 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da33930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1acc90 con 0x55a82da19d20 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1ae950 con 0x55a82da187b0 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f00961d9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1ad360 con 0x55a82da27960 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51504/0 (socket says 172.21.15.66:51504) 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 -- 172.21.15.66:0/1404256804 learned_addr learned my addr 172.21.15.66:0/1404256804 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f0091b9c640 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da33930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009239d640 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 -- 172.21.15.66:0/1404256804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 msgr2=0x55a82da29290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 -- 172.21.15.66:0/1404256804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 msgr2=0x55a82da33930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da33930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 -- 172.21.15.66:0/1404256804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82da150b0 con 0x55a82da19d20 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.110+0000 7f009139b640 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f007c0985b0 tx=0x7f007c0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585064dd2adbe1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00777fe640 1 -- 172.21.15.66:0/1404256804 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c09bab0 con 0x55a82da19d20 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00777fe640 1 -- 172.21.15.66:0/1404256804 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f007c09c850 con 0x55a82da19d20 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00777fe640 1 -- 172.21.15.66:0/1404256804 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c0a4dc0 con 0x55a82da19d20 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 -- 172.21.15.66:0/1404256804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 msgr2=0x55a82da28d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f007c0985b0 tx=0x7f007c0bc040 comp rx=0 tx=0).stop 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 -- 172.21.15.66:0/1404256804 shutdown_connections 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da27960 0x55a82da29290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da28d50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 --2- 172.21.15.66:0/1404256804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da187b0 0x55a82da33930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 -- 172.21.15.66:0/1404256804 >> 172.21.15.66:0/1404256804 conn(0x55a82d9e1310 msgr2=0x55a82da22e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 -- 172.21.15.66:0/1404256804 shutdown_connections 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.111+0000 7f00961d9740 1 -- 172.21.15.66:0/1404256804 wait complete. 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 -- start start 2024-09-15T22:48:37.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 Processor -- start 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da187b0 0x55a82da3ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 0x55a82da3f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1ae1c0 con 0x55a82da19d20 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1ada30 con 0x55a82da27960 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1aac70 con 0x55a82da187b0 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f00961d9740 10 client.0 _ll_register_callbacks cb 0x7f0084004f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:37.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f009139b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51516/0 (socket says 172.21.15.66:51516) 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.112+0000 7f009139b640 1 -- 172.21.15.66:0/621517941 learned_addr learned my addr 172.21.15.66:0/621517941 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009239d640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 0x55a82da3f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f0091b9c640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da187b0 0x55a82da3ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 -- 172.21.15.66:0/621517941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da187b0 msgr2=0x55a82da3ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da187b0 0x55a82da3ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 -- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 msgr2=0x55a82da3f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 0x55a82da3f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 -- 172.21.15.66:0/621517941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82da2df90 con 0x55a82da19d20 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009239d640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 0x55a82da3f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f009139b640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cd670 tx=0x7f007c00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d748725dcd7a967d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:37.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00757fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c018e20 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f007c0987c0 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f007c09c850 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f007c0a4dc0 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00961d9740 10 client.16317 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a82daa24a0 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.113+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f007c09c850 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f007c0bc0b0 con 0x55a82da19d20 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 10 client.16317 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 20 client.16317 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82daa2b70 0x55a82daa4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 4 client.16317 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:48:37.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a82d985d70 con 0x55a82daa2b70 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f0091b9c640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82daa2b70 0x55a82daa4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f00757fa640 10 client.16317 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.114+0000 7f0091b9c640 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82daa2b70 0x55a82daa4f90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=930600ec12376a92 server_cookie=b7120a152662b3b1 in_seq=0 out_seq=0 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00757fa640 1 -- 172.21.15.66:0/621517941 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a82d985d70 con 0x55a82daa2b70 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00757fa640 10 client.16317 handle_command_reply: tid=0 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 client.16317 shutdown 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 msgr2=0x55a82da3f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f007c0cd670 tx=0x7f007c00ff30 comp rx=0 tx=0).stop 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 shutdown_connections 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55a82daa2b70 0x55a82daa4f90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a82da27960 0x55a82da3f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00757fa640 0 client.16317 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a82da19d20 0x55a82da3f2b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 --2- 172.21.15.66:0/621517941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a82da187b0 0x55a82da3ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 >> 172.21.15.66:0/621517941 conn(0x55a82d9e1310 msgr2=0x55a82da25db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 shutdown_connections 2024-09-15T22:48:37.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 1 -- 172.21.15.66:0/621517941 wait complete. 2024-09-15T22:48:37.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.115+0000 7f00961d9740 20 client.16317 trim_cache size 0 max 16384 2024-09-15T22:48:37.123 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 msgr2=0x7f00780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 0x7f00780a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0084004af0 tx=0x7f00840093c0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 msgr2=0x7f008c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c920 tx=0x7f007c00cde0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 shutdown_connections 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00780a33b0 0x7f00780a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008c107af0 0x7f008c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f008c102380 0x7f008c198850 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 --2- 172.21.15.66:0/2610246602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f008c1019e0 0x7f008c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:37.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 >> 172.21.15.66:0/2610246602 conn(0x7f008c0fd700 msgr2=0x7f008c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:37.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 shutdown_connections 2024-09-15T22:48:37.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:37.116+0000 7f0092b9e640 1 -- 172.21.15.66:0/2610246602 wait complete. 2024-09-15T22:48:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:37 smithi066 ceph-mon[31185]: pgmap v100: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-09-15T22:48:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:37 smithi087 ceph-mon[35290]: pgmap v100: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-09-15T22:48:37.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:37 smithi184 ceph-mon[35203]: pgmap v100: 129 pgs: 129 active+clean; 421 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 257 op/s 2024-09-15T22:48:38.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:48:38.764 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 -- 172.21.15.66:0/34106314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102ef0 msgr2=0x7f55a410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 --2- 172.21.15.66:0/34106314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102ef0 0x7f55a410da40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f559c009ca0 tx=0x7f559c02a950 comp rx=0 tx=0).stop 2024-09-15T22:48:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 -- 172.21.15.66:0/34106314 shutdown_connections 2024-09-15T22:48:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 --2- 172.21.15.66:0/34106314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102ef0 0x7f55a410da40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 --2- 172.21.15.66:0/34106314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102570 0x7f55a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 --2- 172.21.15.66:0/34106314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.309+0000 7f55a945a640 1 -- 172.21.15.66:0/34106314 >> 172.21.15.66:0/34106314 conn(0x7f55a40fc7d0 msgr2=0x7f55a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.310+0000 7f55a945a640 1 -- 172.21.15.66:0/34106314 shutdown_connections 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.310+0000 7f55a945a640 1 -- 172.21.15.66:0/34106314 wait complete. 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.310+0000 7f55a945a640 1 Processor -- start 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.310+0000 7f55a945a640 1 -- start start 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 0x7f55a419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 0x7f55a419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55a4110fd0 con 0x7f55a4102570 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55a4110e50 con 0x7f55a4102ef0 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a945a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f55a4111150 con 0x7f55a4100e20 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43944/0 (socket says 172.21.15.66:43944) 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 -- 172.21.15.66:0/1815102670 learned_addr learned my addr 172.21.15.66:0/1815102670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 0x7f55a419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 0x7f55a419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 -- 172.21.15.66:0/1815102670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 msgr2=0x7f55a419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 0x7f55a419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 -- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 msgr2=0x7f55a419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 0x7f55a419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a2ffd640 1 -- 172.21.15.66:0/1815102670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a419f600 con 0x7f55a4100e20 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 0x7f55a419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.311+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 0x7f55a419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f559400e9f0 tx=0x7f559400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f558bfff640 1 -- 172.21.15.66:0/1815102670 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559400cd80 con 0x7f55a4100e20 2024-09-15T22:48:39.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f558bfff640 1 -- 172.21.15.66:0/1815102670 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5594010910 con 0x7f55a4100e20 2024-09-15T22:48:39.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a419f8f0 con 0x7f55a4100e20 2024-09-15T22:48:39.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f558bfff640 1 -- 172.21.15.66:0/1815102670 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940188f0 con 0x7f55a4100e20 2024-09-15T22:48:39.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.312+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41a71d0 con 0x7f55a4100e20 2024-09-15T22:48:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f558bfff640 1 -- 172.21.15.66:0/1815102670 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5594018af0 con 0x7f55a4100e20 2024-09-15T22:48:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 Processor -- start 2024-09-15T22:48:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 -- start start 2024-09-15T22:48:39.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe6a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5558ffdc32f0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5558ffd6acf0 con 0x5558ffe68370 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55ab833740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5558ffdbf2b0 con 0x5558ffe5eb40 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43948/0 (socket says 172.21.15.66:43948) 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51544/0 (socket says 172.21.15.66:51544) 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.316+0000 7f55a37fe640 1 -- 172.21.15.66:0/1110057999 learned_addr learned my addr 172.21.15.66:0/1110057999 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:39.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe6a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 -- 172.21.15.66:0/1110057999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 msgr2=0x5558ffe6a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe6a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 -- 172.21.15.66:0/1110057999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 msgr2=0x5558ffe5da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 -- 172.21.15.66:0/1110057999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ffd4f3a0 con 0x5558ffe5eb40 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f558bfff640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 0x7f558c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f559c009ca0 tx=0x7f559c005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64eee2216af0405 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 0x7f558c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f558bfff640 1 -- 172.21.15.66:0/1815102670 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f55940d05c0 con 0x7f55a4100e20 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55897fa640 1 -- 172.21.15.66:0/1110057999 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c048070 con 0x5558ffe5eb40 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55897fa640 1 -- 172.21.15.66:0/1110057999 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f559c003e50 con 0x5558ffe5eb40 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.317+0000 7f55897fa640 1 -- 172.21.15.66:0/1110057999 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c034040 con 0x5558ffe5eb40 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.318+0000 7f55ab833740 1 -- 172.21.15.66:0/1110057999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 msgr2=0x5558ffe5d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.318+0000 7f55ab833740 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f559c009ca0 tx=0x7f559c005f80 comp rx=0 tx=0).stop 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 -- 172.21.15.66:0/1110057999 shutdown_connections 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe6a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe5da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 --2- 172.21.15.66:0/1110057999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5eb40 0x5558ffe5d090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 -- 172.21.15.66:0/1110057999 >> 172.21.15.66:0/1110057999 conn(0x5558ffe26310 msgr2=0x5558ffe59c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55a2ffd640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 0x7f558c0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5558ffe5aac0 tx=0x7f55940d3f40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 -- 172.21.15.66:0/1110057999 shutdown_connections 2024-09-15T22:48:39.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 -- 172.21.15.66:0/1110057999 wait complete. 2024-09-15T22:48:39.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 -- start start 2024-09-15T22:48:39.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.319+0000 7f55ab833740 1 Processor -- start 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe65630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe65b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5558ffe6b010 con 0x5558ffe5eb40 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5558ffd7e060 con 0x5558ffe68370 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5558ffe6b190 con 0x5558ffe5d5d0 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55ab833740 10 client.0 _ll_register_callbacks cb 0x5558ffad18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe65630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe65b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43962/0 (socket says 172.21.15.66:43962) 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe65630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51548/0 (socket says 172.21.15.66:51548) 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 -- 172.21.15.66:0/3603284994 learned_addr learned my addr 172.21.15.66:0/3603284994 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:39.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 -- 172.21.15.66:0/3603284994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 msgr2=0x5558ffe65b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe65b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 -- 172.21.15.66:0/3603284994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 msgr2=0x5558ffe65630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.320+0000 7f55a37fe640 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe65630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f55a37fe640 1 -- 172.21.15.66:0/3603284994 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ffb343c0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f55a37fe640 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f559c009620 tx=0x7f559c02ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c24ab316e33f9fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f5586ff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c048030 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f559c003e50 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f559c040070 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f559c06b050 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f55ab833740 10 client.25831 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558ffe6b010 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.321+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f559c003e50 con 0x5558ffe5d5d0 2024-09-15T22:48:39.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f559c030ae0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 10 client.25831 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 10 client.25831 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 20 client.25831 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffe88d30 0x5558ffe8b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 4 client.25831 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558ffdd0860 con 0x5558ffe88d30 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55a27fc640 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffe88d30 0x5558ffe8b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f5586ff5640 10 client.25831 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:48:39.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.322+0000 7f55a27fc640 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffe88d30 0x5558ffe8b120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98467d49967f3b7c server_cookie=3e3a09f9afe523f in_seq=0 out_seq=0 2024-09-15T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.328+0000 7f5586ff5640 1 -- 172.21.15.66:0/3603284994 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558ffdd0860 con 0x5558ffe88d30 2024-09-15T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.328+0000 7f5586ff5640 10 client.25831 handle_command_reply: tid=0 2024-09-15T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.328+0000 7f55ab833740 1 client.25831 shutdown 2024-09-15T22:48:39.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.328+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 msgr2=0x5558ffe650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.328+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f559c009620 tx=0x7f559c02ff70 comp rx=0 tx=0).stop 2024-09-15T22:48:39.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 shutdown_connections 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffe88d30 0x5558ffe8b120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe68370 0x5558ffe65b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe65630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 --2- 172.21.15.66:0/3603284994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe5d5d0 0x5558ffe650f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 >> 172.21.15.66:0/3603284994 conn(0x5558ffe26310 msgr2=0x5558ffe5f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.329+0000 7f5586ff5640 0 client.25831 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.330+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 shutdown_connections 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.330+0000 7f55ab833740 1 -- 172.21.15.66:0/3603284994 wait complete. 2024-09-15T22:48:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.330+0000 7f55ab833740 20 client.25831 trim_cache size 0 max 16384 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 Processor -- start 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 -- start start 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 0x5558ffe90910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe90e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406e0b0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406fd70 con 0x5558ffe5eb40 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55ab833740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406e780 con 0x5558ffe68370 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51550/0 (socket says 172.21.15.66:51550) 2024-09-15T22:48:39.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a37fe640 1 -- 172.21.15.66:0/1781288471 learned_addr learned my addr 172.21.15.66:0/1781288471 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 0x5558ffe90910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe90e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 -- 172.21.15.66:0/1781288471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 msgr2=0x5558ffe90e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe90e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 -- 172.21.15.66:0/1781288471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 msgr2=0x5558ffe58c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a27fc640 1 -- 172.21.15.66:0/1781288471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ffe742b0 con 0x5558ffe5eb40 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.344+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.345+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 0x5558ffe90910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5558ffe8b8b0 tx=0x7f5598011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab98dd905393ba7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.345+0000 7f5588ff9640 1 -- 172.21.15.66:0/1781288471 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598021070 con 0x5558ffe5eb40 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.345+0000 7f5588ff9640 1 -- 172.21.15.66:0/1781288471 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55980035f0 con 0x5558ffe5eb40 2024-09-15T22:48:39.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.345+0000 7f5588ff9640 1 -- 172.21.15.66:0/1781288471 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559801c620 con 0x5558ffe5eb40 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- 172.21.15.66:0/1781288471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 msgr2=0x5558ffe90910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 0x5558ffe90910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5558ffe8b8b0 tx=0x7f5598011810 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- 172.21.15.66:0/1781288471 shutdown_connections 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe90e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5eb40 0x5558ffe90910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- 172.21.15.66:0/1781288471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5d5d0 0x5558ffe58c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- 172.21.15.66:0/1781288471 >> 172.21.15.66:0/1781288471 conn(0x5558ffe26310 msgr2=0x5558ffe58500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- 172.21.15.66:0/1781288471 shutdown_connections 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- 172.21.15.66:0/1781288471 wait complete. 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- start start 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 Processor -- start 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe70960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe61720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406f5e0 con 0x5558ffe5eb40 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406ee50 con 0x5558ffe5d5d0 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.346+0000 7f55ab833740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f55a406c0d0 con 0x5558ffe68370 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55ab833740 10 client.0 _ll_register_callbacks cb 0x7f559c046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe70960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43642/0 (socket says 172.21.15.66:43642) 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 -- 172.21.15.66:0/1113730480 learned_addr learned my addr 172.21.15.66:0/1113730480 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe61720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 -- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 msgr2=0x5558ffe61720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe61720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 -- 172.21.15.66:0/1113730480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 msgr2=0x5558ffe70960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe70960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 -- 172.21.15.66:0/1113730480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ffe61c60 con 0x5558ffe5d5d0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55a37fe640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f559c030eb0 tx=0x7f559c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2050267a5b0ffec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f5586ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c034040 con 0x5558ffe5d5d0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f559c065020 con 0x5558ffe5d5d0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.347+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55980035f0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f559c048040 con 0x5558ffe5d5d0 2024-09-15T22:48:39.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 10 client.25868 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558ffef30e0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55980035f0 con 0x5558ffe5d5d0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f559c068070 con 0x5558ffe5d5d0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 10 client.25868 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 10 client.25868 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 20 client.25868 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffef3550 0x5558ffef5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 4 client.25868 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558ffdcad70 con 0x5558ffef3550 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffef3550 0x5558ffef5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f55a27fc640 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffef3550 0x5558ffef5970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=912b31ef110c1c89 server_cookie=112ef4c77ed52b72 in_seq=0 out_seq=0 2024-09-15T22:48:39.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.348+0000 7f5586ff5640 10 client.25868 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:48:39.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f5586ff5640 1 -- 172.21.15.66:0/1113730480 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558ffdcad70 con 0x5558ffef3550 2024-09-15T22:48:39.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f5586ff5640 10 client.25868 handle_command_reply: tid=0 2024-09-15T22:48:39.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 client.25868 shutdown 2024-09-15T22:48:39.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 msgr2=0x5558ffe70420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f559c030eb0 tx=0x7f559c000f40 comp rx=0 tx=0).stop 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 shutdown_connections 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5558ffef3550 0x5558ffef5970 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5558ffe68370 0x5558ffe61720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558ffe5eb40 0x5558ffe70960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f5586ff5640 0 client.25868 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 --2- 172.21.15.66:0/1113730480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5558ffe5d5d0 0x5558ffe70420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.369+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 >> 172.21.15.66:0/1113730480 conn(0x5558ffe26310 msgr2=0x5558ffe658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 shutdown_connections 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55ab833740 1 -- 172.21.15.66:0/1113730480 wait complete. 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55ab833740 20 client.25868 trim_cache size 0 max 16384 2024-09-15T22:48:39.373 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:48:39.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 msgr2=0x7f558c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 0x7f558c0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5558ffe5aac0 tx=0x7f55940d3f40 comp rx=0 tx=0).stop 2024-09-15T22:48:39.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 msgr2=0x7f55a419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:39.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f559400e9f0 tx=0x7f559400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 shutdown_connections 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f558c0a33b0 0x7f558c0a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a4102ef0 0x7f55a419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55a4102570 0x7f55a419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 --2- 172.21.15.66:0/1815102670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55a4100e20 0x7f55a419a650 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f559400e9f0 tx=0x7f559400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.370+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 >> 172.21.15.66:0/1815102670 conn(0x7f55a40fc7d0 msgr2=0x7f55a406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.371+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 shutdown_connections 2024-09-15T22:48:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:39.371+0000 7f55a945a640 1 -- 172.21.15.66:0/1815102670 wait complete. 2024-09-15T22:48:39.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:39 smithi066 ceph-mon[31185]: pgmap v101: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 329 op/s 2024-09-15T22:48:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:39 smithi087 ceph-mon[35290]: pgmap v101: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 329 op/s 2024-09-15T22:48:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:39 smithi184 ceph-mon[35203]: pgmap v101: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 329 op/s 2024-09-15T22:48:40.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:48:40.767 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 -- 172.21.15.66:0/2811265858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102ef0 msgr2=0x7f755810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 --2- 172.21.15.66:0/2811265858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102ef0 0x7f755810da40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7550009ca0 tx=0x7f755002a950 comp rx=0 tx=0).stop 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 -- 172.21.15.66:0/2811265858 shutdown_connections 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 --2- 172.21.15.66:0/2811265858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102ef0 0x7f755810da40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 --2- 172.21.15.66:0/2811265858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558102570 0x7f75581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 --2- 172.21.15.66:0/2811265858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558100e20 0x7f7558101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 -- 172.21.15.66:0/2811265858 >> 172.21.15.66:0/2811265858 conn(0x7f75580fc7d0 msgr2=0x7f75580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 -- 172.21.15.66:0/2811265858 shutdown_connections 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.281+0000 7f7560618640 1 -- 172.21.15.66:0/2811265858 wait complete. 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.282+0000 7f7560618640 1 Processor -- start 2024-09-15T22:48:41.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.282+0000 7f7560618640 1 -- start start 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558100e20 0x7f75581992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558102ef0 0x7f75581a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7558110f80 con 0x7f7558102570 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7558110e00 con 0x7f7558102ef0 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f7560618640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7558111100 con 0x7f7558100e20 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51570/0 (socket says 172.21.15.66:51570) 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 -- 172.21.15.66:0/307456451 learned_addr learned my addr 172.21.15.66:0/307456451 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755ebb5640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558102ef0 0x7f75581a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755e3b4640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558100e20 0x7f75581992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 -- 172.21.15.66:0/307456451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558100e20 msgr2=0x7f75581992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558100e20 0x7f75581992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 -- 172.21.15.66:0/307456451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558102ef0 msgr2=0x7f75581a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558102ef0 0x7f75581a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 -- 172.21.15.66:0/307456451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75581a4870 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.283+0000 7f755dbb3640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f754800d950 tx=0x7f754800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.284+0000 7f754f7fe640 1 -- 172.21.15.66:0/307456451 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548017070 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.284+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75581a4a40 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.284+0000 7f754f7fe640 1 -- 172.21.15.66:0/307456451 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7548009c30 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.284+0000 7f754f7fe640 1 -- 172.21.15.66:0/307456451 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754800f6b0 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.284+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75581a4f50 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.286+0000 7f75629f1740 1 Processor -- start 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.286+0000 7f75629f1740 1 -- start start 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f754f7fe640 1 -- 172.21.15.66:0/307456451 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f75480109d0 con 0x7f7558102570 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc875a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc886b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5608cc7db2f0 con 0x5608cc876b40 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5608cc782cf0 con 0x5608cc8755d0 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f75629f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5608cc7d72b0 con 0x5608cc884780 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755ebb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755ebb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51576/0 (socket says 172.21.15.66:51576) 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc875a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755ebb5640 1 -- 172.21.15.66:0/247766418 learned_addr learned my addr 172.21.15.66:0/247766418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755dbb3640 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc886b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 -- 172.21.15.66:0/247766418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 msgr2=0x5608cc886b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc886b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 -- 172.21.15.66:0/247766418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 msgr2=0x5608cc875090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755e3b4640 1 -- 172.21.15.66:0/247766418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608cc7673a0 con 0x5608cc8755d0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.287+0000 7f755ebb5640 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f754f7fe640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 0x7f75440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f755e3b4640 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc875a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f755400bbf0 tx=0x7f75540107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b537e3a5fba8870f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f755ebb5640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 0x7f75440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f754f7fe640 1 -- 172.21.15.66:0/307456451 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f75480cfc60 con 0x7f7558102570 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f754cff9640 1 -- 172.21.15.66:0/247766418 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554004030 con 0x5608cc8755d0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f754cff9640 1 -- 172.21.15.66:0/247766418 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75540041d0 con 0x5608cc8755d0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.288+0000 7f754cff9640 1 -- 172.21.15.66:0/247766418 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75540116c0 con 0x5608cc8755d0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 -- 172.21.15.66:0/247766418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 msgr2=0x5608cc875a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f755ebb5640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 0x7f75440a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7550009430 tx=0x7f7550005c50 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc875a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f755400bbf0 tx=0x7f75540107a0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 -- 172.21.15.66:0/247766418 shutdown_connections 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc886b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc875a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 --2- 172.21.15.66:0/247766418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc875090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 -- 172.21.15.66:0/247766418 >> 172.21.15.66:0/247766418 conn(0x5608cc83e310 msgr2=0x5608cc871c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 -- 172.21.15.66:0/247766418 shutdown_connections 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.289+0000 7f75629f1740 1 -- 172.21.15.66:0/247766418 wait complete. 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 -- start start 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 Processor -- start 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc8841b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc881460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc881bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5608cc887480 con 0x5608cc876b40 2024-09-15T22:48:41.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5608cc796060 con 0x5608cc8755d0 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5608cc887600 con 0x5608cc884780 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f75629f1740 10 client.0 _ll_register_callbacks cb 0x5608cc4e98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f755e3b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc8841b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc881460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc881460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51582/0 (socket says 172.21.15.66:51582) 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f755dbb3640 1 -- 172.21.15.66:0/599427320 learned_addr learned my addr 172.21.15.66:0/599427320 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.290+0000 7f755ebb5640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc881bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 -- 172.21.15.66:0/599427320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 msgr2=0x5608cc881bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc881bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 -- 172.21.15.66:0/599427320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 msgr2=0x5608cc881460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc881460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 -- 172.21.15.66:0/599427320 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608cc54c3c0 con 0x5608cc8755d0 2024-09-15T22:48:41.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f755e3b4640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc8841b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7554011010 tx=0x7f755400bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41328ef837c78529 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f7541ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75540035f0 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f7554003790 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75540041d0 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f755402e050 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f75629f1740 10 client.25880 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.291+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5608cc892f60 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75540041d0 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f75540046c0 con 0x5608cc8755d0 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 10 client.25880 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:41.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 20 client.25880 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc894360 0x5608cc896750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 4 client.25880 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608cc7e8860 con 0x5608cc894360 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f755dbb3640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc894360 0x5608cc896750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f755dbb3640 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc894360 0x5608cc896750 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33eddaa1b9a2d165 server_cookie=7607edabaceb7909 in_seq=0 out_seq=0 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.292+0000 7f7541ffb640 10 client.25880 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f7541ffb640 1 -- 172.21.15.66:0/599427320 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608cc7e8860 con 0x5608cc894360 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f7541ffb640 10 client.25880 handle_command_reply: tid=0 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 client.25880 shutdown 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 msgr2=0x5608cc8841b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc8841b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7554011010 tx=0x7f755400bfd0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 shutdown_connections 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc881bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc881460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc894360 0x5608cc896750 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 --2- 172.21.15.66:0/599427320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc8841b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f7541ffb640 0 client.25880 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 >> 172.21.15.66:0/599427320 conn(0x5608cc83e310 msgr2=0x5608cc877930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 shutdown_connections 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 1 -- 172.21.15.66:0/599427320 wait complete. 2024-09-15T22:48:41.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.293+0000 7f75629f1740 20 client.25880 trim_cache size 0 max 16384 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 Processor -- start 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 -- start start 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc871e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc89be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc89c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75581acf80 con 0x5608cc876b40 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75581aec40 con 0x5608cc8755d0 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f75629f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75581ad650 con 0x5608cc884780 2024-09-15T22:48:41.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc89be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f755dbb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc89be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51592/0 (socket says 172.21.15.66:51592) 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.307+0000 7f755dbb3640 1 -- 172.21.15.66:0/941104861 learned_addr learned my addr 172.21.15.66:0/941104861 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc871e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755ebb5640 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc89c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 -- 172.21.15.66:0/941104861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 msgr2=0x5608cc89c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc89c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 -- 172.21.15.66:0/941104861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 msgr2=0x5608cc89be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc89be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 -- 172.21.15.66:0/941104861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608cc872960 con 0x5608cc8755d0 2024-09-15T22:48:41.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f755e3b4640 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc871e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f755400b980 tx=0x7f75540107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd63245dfa487338 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f7543fff640 1 -- 172.21.15.66:0/941104861 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755402b040 con 0x5608cc8755d0 2024-09-15T22:48:41.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f7543fff640 1 -- 172.21.15.66:0/941104861 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755401f070 con 0x5608cc8755d0 2024-09-15T22:48:41.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.308+0000 7f7543fff640 1 -- 172.21.15.66:0/941104861 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75540041a0 con 0x5608cc8755d0 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- 172.21.15.66:0/941104861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 msgr2=0x5608cc871e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc871e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f755400b980 tx=0x7f75540107a0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- 172.21.15.66:0/941104861 shutdown_connections 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc89c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc876b40 0x5608cc89be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 --2- 172.21.15.66:0/941104861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc8755d0 0x5608cc871e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- 172.21.15.66:0/941104861 >> 172.21.15.66:0/941104861 conn(0x5608cc83e310 msgr2=0x5608cc871700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- 172.21.15.66:0/941104861 shutdown_connections 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- 172.21.15.66:0/941104861 wait complete. 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.309+0000 7f75629f1740 1 -- start start 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 Processor -- start 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 0x5608cc87ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc87f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75581ae4b0 con 0x5608cc8755d0 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75581add20 con 0x5608cc876b40 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75581aaf60 con 0x5608cc884780 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f75629f1740 10 client.0 _ll_register_callbacks cb 0x7f7550009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51608/0 (socket says 172.21.15.66:51608) 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 -- 172.21.15.66:0/866635101 learned_addr learned my addr 172.21.15.66:0/866635101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755dbb3640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 0x5608cc87ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755ebb5640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc87f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 -- 172.21.15.66:0/866635101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 msgr2=0x5608cc87f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc87f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 -- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 msgr2=0x5608cc87ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:41.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 0x5608cc87ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755e3b4640 1 -- 172.21.15.66:0/866635101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608cc8fde80 con 0x5608cc8755d0 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755ebb5640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc87f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.310+0000 7f755dbb3640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 0x5608cc87ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f755e3b4640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75540047d0 tx=0x7f755400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aab1dcfa5ba2643 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:41.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554040060 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f755401f070 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f7554003f40 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7554047050 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f75629f1740 10 client.16353 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5608cc8ff160 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755401f070 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.311+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f75540116a0 con 0x5608cc8755d0 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 10 client.16353 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 20 client.16353 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc8ff7a0 0x5608cc901bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 4 client.16353 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:48:41.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608cc7e2d70 con 0x5608cc8ff7a0 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f755dbb3640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc8ff7a0 0x5608cc901bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f7541ffb640 10 client.16353 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f755dbb3640 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc8ff7a0 0x5608cc901bc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0639d42f647807d server_cookie=515687e3ca8e4df0 in_seq=0 out_seq=0 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f7541ffb640 1 -- 172.21.15.66:0/866635101 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608cc7e2d70 con 0x5608cc8ff7a0 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.312+0000 7f7541ffb640 10 client.16353 handle_command_reply: tid=0 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 client.16353 shutdown 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 msgr2=0x5608cc87e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75540047d0 tx=0x7f755400b480 comp rx=0 tx=0).stop 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 shutdown_connections 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5608cc884780 0x5608cc87f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608cc8ff7a0 0x5608cc901bc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608cc876b40 0x5608cc87ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 --2- 172.21.15.66:0/866635101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5608cc8755d0 0x5608cc87e590 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 >> 172.21.15.66:0/866635101 conn(0x5608cc83e310 msgr2=0x5608cc8704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f7541ffb640 0 client.16353 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 shutdown_connections 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 1 -- 172.21.15.66:0/866635101 wait complete. 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f75629f1740 20 client.16353 trim_cache size 0 max 16384 2024-09-15T22:48:41.321 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 msgr2=0x7f75440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.313+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 0x7f75440a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7550009430 tx=0x7f7550005c50 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 msgr2=0x7f75581997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f754800d950 tx=0x7f754800de10 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 shutdown_connections 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f75440a33b0 0x7f75440a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7558102ef0 0x7f75581a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7558102570 0x7f75581997f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 --2- 172.21.15.66:0/307456451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7558100e20 0x7f75581992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:41.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 >> 172.21.15.66:0/307456451 conn(0x7f75580fc7d0 msgr2=0x7f7558106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 shutdown_connections 2024-09-15T22:48:41.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:41.314+0000 7f7560618640 1 -- 172.21.15.66:0/307456451 wait complete. 2024-09-15T22:48:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:41 smithi066 ceph-mon[31185]: pgmap v102: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:41.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:41 smithi184 ceph-mon[35203]: pgmap v102: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:41 smithi087 ceph-mon[35290]: pgmap v102: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:43.338 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:48:43.338 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:48:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:43 smithi087 ceph-mon[35290]: pgmap v103: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:43.663 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:43.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:43 smithi184 ceph-mon[35203]: pgmap v103: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:43.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:43 smithi066 ceph-mon[31185]: pgmap v103: 129 pgs: 129 active+clean; 426 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- 172.21.15.66:0/423242997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 msgr2=0x7fa91410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 --2- 172.21.15.66:0/423242997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91410eaa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ca0 tx=0x7fa90c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- 172.21.15.66:0/423242997 shutdown_connections 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 --2- 172.21.15.66:0/423242997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91410eaa0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 --2- 172.21.15.66:0/423242997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa9141067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 --2- 172.21.15.66:0/423242997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- 172.21.15.66:0/423242997 >> 172.21.15.66:0/423242997 conn(0x7fa9140fd8f0 msgr2=0x7fa9140ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- 172.21.15.66:0/423242997 shutdown_connections 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- 172.21.15.66:0/423242997 wait complete. 2024-09-15T22:48:44.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 Processor -- start 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.146+0000 7fa91ade5640 1 -- start start 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa914198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa914111fd0 con 0x7fa914106f20 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa914111e50 con 0x7fa9141027a0 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa91ade5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa914112150 con 0x7fa914101df0 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55452/0 (socket says 172.21.15.66:55452) 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa919382640 1 -- 172.21.15.66:0/1200278574 learned_addr learned my addr 172.21.15.66:0/1200278574 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa913fff640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa914198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 -- 172.21.15.66:0/1200278574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 msgr2=0x7fa914198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa914198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 -- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 msgr2=0x7fa91419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 -- 172.21.15.66:0/1200278574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91419d3a0 con 0x7fa914101df0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa913fff640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa914198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.147+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141983f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa90800e9f0 tx=0x7fa90800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.148+0000 7fa911ffb640 1 -- 172.21.15.66:0/1200278574 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90800ccc0 con 0x7fa914101df0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.148+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91419d690 con 0x7fa914101df0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.148+0000 7fa911ffb640 1 -- 172.21.15.66:0/1200278574 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa908005020 con 0x7fa914101df0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.148+0000 7fa911ffb640 1 -- 172.21.15.66:0/1200278574 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080049e0 con 0x7fa914101df0 2024-09-15T22:48:44.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.148+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9141a4f70 con 0x7fa914101df0 2024-09-15T22:48:44.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa911ffb640 1 -- 172.21.15.66:0/1200278574 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa908005560 con 0x7fa914101df0 2024-09-15T22:48:44.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 Processor -- start 2024-09-15T22:48:44.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 -- start start 2024-09-15T22:48:44.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e853e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e854360 0x55f78e862c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e865540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f78e7b9280 con 0x55f78e854360 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f78e760b10 con 0x55f78e853a40 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.151+0000 7fa91d1be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f78e7b5240 con 0x55f78e863150 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa918b81640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e854360 0x55f78e862c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa913fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e865540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e853e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa913fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e865540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:38144/0 (socket says 172.21.15.66:38144) 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa913fff640 1 -- 172.21.15.66:0/3654801167 learned_addr learned my addr 172.21.15.66:0/3654801167 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 -- 172.21.15.66:0/3654801167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 msgr2=0x55f78e865540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e865540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 -- 172.21.15.66:0/3654801167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e854360 msgr2=0x55f78e862c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e854360 0x55f78e862c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 -- 172.21.15.66:0/3654801167 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78e76d1f0 con 0x55f78e853a40 2024-09-15T22:48:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa919382640 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e853e20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa90c006010 tx=0x7fa90c02f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30fc393fba34c066 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.152+0000 7fa911ffb640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 0x7fa9040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa8feffd640 1 -- 172.21.15.66:0/3654801167 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c031db0 con 0x55f78e853a40 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 0x7fa9040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa8feffd640 1 -- 172.21.15.66:0/3654801167 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa90c036030 con 0x55f78e853a40 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa8feffd640 1 -- 172.21.15.66:0/3654801167 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0043c0 con 0x55f78e853a40 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa911ffb640 1 -- 172.21.15.66:0/1200278574 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa9080d0110 con 0x7fa914101df0 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.153+0000 7fa91d1be740 1 -- 172.21.15.66:0/3654801167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 msgr2=0x55f78e853e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e853e20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa90c006010 tx=0x7fa90c02f3c0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa918b81640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 0x7fa9040a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9080cd540 tx=0x7fa9080054d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 -- 172.21.15.66:0/3654801167 shutdown_connections 2024-09-15T22:48:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e865540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e854360 0x55f78e862c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 --2- 172.21.15.66:0/3654801167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e853e20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 -- 172.21.15.66:0/3654801167 >> 172.21.15.66:0/3654801167 conn(0x55f78e8500f0 msgr2=0x55f78e8504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 -- 172.21.15.66:0/3654801167 shutdown_connections 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 -- 172.21.15.66:0/3654801167 wait complete. 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 -- start start 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.154+0000 7fa91d1be740 1 Processor -- start 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e854360 0x55f78e8605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e860af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f78e865ba0 con 0x55f78e853a40 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f78e773f10 con 0x55f78e854360 2024-09-15T22:48:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f78e865d20 con 0x55f78e863150 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa91d1be740 10 client.0 _ll_register_callbacks cb 0x55f78e73ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55460/0 (socket says 172.21.15.66:55460) 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 -- 172.21.15.66:0/2277580762 learned_addr learned my addr 172.21.15.66:0/2277580762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e860af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa913fff640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e854360 0x55f78e8605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 -- 172.21.15.66:0/2277580762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 msgr2=0x55f78e860af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e860af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 -- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e854360 msgr2=0x55f78e8605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e854360 0x55f78e8605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 -- 172.21.15.66:0/2277580762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f78e52a6a0 con 0x55f78e853a40 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa919382640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa90c005e30 tx=0x7fa90c031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e947df4f3617ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.155+0000 7fa8f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c059060 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa90c003d80 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa90c036030 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa90c004140 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 10 client.16365 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f78e865ba0 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa90c036030 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fa90c043070 con 0x55f78e853a40 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 10 client.16365 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 20 client.16365 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e872a50 0x55f78e874e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 4 client.16365 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.156+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f78e7c67f0 con 0x55f78e872a50 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.157+0000 7fa913fff640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e872a50 0x55f78e874e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.157+0000 7fa913fff640 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e872a50 0x55f78e874e40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64292d4386124eff server_cookie=f887576818dd4d20 in_seq=0 out_seq=0 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.157+0000 7fa8f3fff640 10 client.16365 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa8f3fff640 1 -- 172.21.15.66:0/2277580762 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f78e7c67f0 con 0x55f78e872a50 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa8f3fff640 10 client.16365 handle_command_reply: tid=0 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 client.16365 shutdown 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 msgr2=0x55f78e860070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa90c005e30 tx=0x7fa90c031a10 comp rx=0 tx=0).stop 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 shutdown_connections 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e863150 0x55f78e860af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e872a50 0x55f78e874e40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e854360 0x55f78e8605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa8f3fff640 0 client.16365 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:44.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2277580762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e860070 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 >> 172.21.15.66:0/2277580762 conn(0x55f78e8500f0 msgr2=0x55f78e855e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 shutdown_connections 2024-09-15T22:48:44.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 1 -- 172.21.15.66:0/2277580762 wait complete. 2024-09-15T22:48:44.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.158+0000 7fa91d1be740 20 client.16365 trim_cache size 0 max 16384 2024-09-15T22:48:44.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.177+0000 7fa91d1be740 1 Processor -- start 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.177+0000 7fa91d1be740 1 -- start start 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e860940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e87a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ace30 con 0x55f78e863150 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141aeaf0 con 0x55f78e853a40 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa91d1be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ad500 con 0x55f78e854360 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55464/0 (socket says 172.21.15.66:55464) 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 -- 172.21.15.66:0/2543824834 learned_addr learned my addr 172.21.15.66:0/2543824834 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa913fff640 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e87a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e860940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 -- 172.21.15.66:0/2543824834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 msgr2=0x55f78e87a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e87a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 -- 172.21.15.66:0/2543824834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 msgr2=0x55f78e860940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e860940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 -- 172.21.15.66:0/2543824834 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78e854190 con 0x55f78e863150 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa919382640 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa90c031fd0 tx=0x7fa90c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3cde4bd95bf545 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.178+0000 7fa8fe7fc640 1 -- 172.21.15.66:0/2543824834 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c059030 con 0x55f78e863150 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa8fe7fc640 1 -- 172.21.15.66:0/2543824834 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa90c036040 con 0x55f78e863150 2024-09-15T22:48:44.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa8fe7fc640 1 -- 172.21.15.66:0/2543824834 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c003de0 con 0x55f78e863150 2024-09-15T22:48:44.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 -- 172.21.15.66:0/2543824834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 msgr2=0x55f78e87ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa90c031fd0 tx=0x7fa90c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 -- 172.21.15.66:0/2543824834 shutdown_connections 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e863150 0x55f78e87ac40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e87a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 --2- 172.21.15.66:0/2543824834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e853a40 0x55f78e860940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 -- 172.21.15.66:0/2543824834 >> 172.21.15.66:0/2543824834 conn(0x55f78e8500f0 msgr2=0x55f78e84f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 -- 172.21.15.66:0/2543824834 shutdown_connections 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.179+0000 7fa91d1be740 1 -- 172.21.15.66:0/2543824834 wait complete. 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 -- start start 2024-09-15T22:48:44.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 Processor -- start 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e866c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e863150 0x55f78e8673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141ae360 con 0x55f78e853a40 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141adbd0 con 0x55f78e863150 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141aae10 con 0x55f78e854360 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa91d1be740 10 client.0 _ll_register_callbacks cb 0x7fa90000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa919382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55468/0 (socket says 172.21.15.66:55468) 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa919382640 1 -- 172.21.15.66:0/76194757 learned_addr learned my addr 172.21.15.66:0/76194757 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.180+0000 7fa913fff640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e866c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e863150 0x55f78e8673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 -- 172.21.15.66:0/76194757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 msgr2=0x55f78e866c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e866c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 -- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e863150 msgr2=0x55f78e8673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e863150 0x55f78e8673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 -- 172.21.15.66:0/76194757 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f78e8dc6d0 con 0x55f78e853a40 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa913fff640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e866c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa919382640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009620 tx=0x7fa90c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2d416d2d91053e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa8f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c059070 con 0x55f78e853a40 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa90c036040 con 0x55f78e853a40 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa90c0042e0 con 0x55f78e853a40 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa90c02f3c0 con 0x55f78e853a40 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa91d1be740 10 client.16371 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:44.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.181+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f78e8dd8a0 con 0x55f78e853a40 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa90c036040 con 0x55f78e853a40 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7fa90c043040 con 0x55f78e853a40 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 10 client.16371 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 20 client.16371 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e8ddda0 0x55f78e8e01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 4 client.16371 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f78e7c0d00 con 0x55f78e8ddda0 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.182+0000 7fa913fff640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e8ddda0 0x55f78e8e01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.183+0000 7fa8f3fff640 10 client.16371 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.183+0000 7fa913fff640 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e8ddda0 0x55f78e8e01c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8792a8e0bcd20900 server_cookie=e48750784d4e673c in_seq=0 out_seq=0 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.183+0000 7fa8f3fff640 1 -- 172.21.15.66:0/76194757 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f78e7c0d00 con 0x55f78e8ddda0 2024-09-15T22:48:44.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.183+0000 7fa8f3fff640 10 client.16371 handle_command_reply: tid=0 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.183+0000 7fa91d1be740 1 client.16371 shutdown 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 msgr2=0x55f78e86b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009620 tx=0x7fa90c02bfd0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 shutdown_connections 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f78e8ddda0 0x55f78e8e01c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f78e863150 0x55f78e8673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f78e854360 0x55f78e866c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 --2- 172.21.15.66:0/76194757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f78e853a40 0x55f78e86b8e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 >> 172.21.15.66:0/76194757 conn(0x55f78e8500f0 msgr2=0x55f78e855d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa8f3fff640 0 client.16371 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 shutdown_connections 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 1 -- 172.21.15.66:0/76194757 wait complete. 2024-09-15T22:48:44.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.184+0000 7fa91d1be740 20 client.16371 trim_cache size 0 max 16384 2024-09-15T22:48:44.192 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:44.192 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:48:44.192 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "6d8dedd8-50a6-4563-9a53-7a99c945a608", 2024-09-15T22:48:44.192 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:48:44.192 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 msgr2=0x7fa9040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 0x7fa9040a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9080cd540 tx=0x7fa9080054d0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 msgr2=0x7fa9141983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141983f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa90800e9f0 tx=0x7fa90800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 shutdown_connections 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa9040a33b0 0x7fa9040a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa914106f20 0x7fa91419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9141027a0 0x7fa914198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 --2- 172.21.15.66:0/1200278574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa914101df0 0x7fa9141983f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:44.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 >> 172.21.15.66:0/1200278574 conn(0x7fa9140fd8f0 msgr2=0x7fa9140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:44.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 shutdown_connections 2024-09-15T22:48:44.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:44.185+0000 7fa91ade5640 1 -- 172.21.15.66:0/1200278574 wait complete. 2024-09-15T22:48:44.583 INFO:tasks.workunit.client.0.smithi066.stdout: 121 461966 562 307491 666 108201 609 2024-09-15T22:48:45.080 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:48:45.228 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:48:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: 2024-09-15T22:48:44.926+0000 7fa28e751640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000163c [...4,head] /volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33/ auth{0=1,2=1,3=1,4=1} v90514 ap=2 DIRTYPARENT f(v2 m2024-09-15T22:47:34.872356+0000 56=56+0) n(v2 rc2024-09-15T22:47:34.872356+0000 b1817641 57=56+1) (inest sync->mix g=0,2,3,4) caps={24970=pAsLsXsFs/pAsLsXsFsx@117} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x563839cfbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x2000000163c:[<0x10000000399/blog-33 v90514>,<0x10000000208/blogtest_in v1162>,<0x10000000201/src v2035>,<0x10000000006/blogbench-1.0 v1789>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/9623457f-b6b7-45df-8f7b-fed8f4e559f1 v68>,<0x10000000001/sv_1 v87>,<0x10000000000/qa v74>,<0x1/volumes v72>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-15T22:47:23.966441+0000 55=55+0)","ondisk_value.rstat":"n(v0 rc2024-09-15T22:47:34.872356+0000 b1817641 57=56+1)","memory_value.dirstat":"f(v2 m2024-09-15T22:47:34.872356+0000 56=56+0)","memory_value.rstat":"n(v2 rc2024-09-15T22:47:34.872356+0000 b1817641 57=56+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-09-15T22:48:45.228 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: 2024-09-15T22:48:45.056+0000 7fa28e751640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c60 [...5,head] /volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/ auth{0=1,2=2,3=1,4=1} fragtree_t(*^3) v130130 ap=2 DIRTYPARENT f(v2 m2024-09-15T22:48:04.289130+0000 141=141+0) n(v4 rc2024-09-15T22:48:04.289130+0000 b4474974 142=141+1) old_inodes=1 (inest sync->mix g=0,2,3,4) caps={24970=pAsLsXsFs/pAsLsXsFsx@348} | ptrwaiter=0 dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x563838c83080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x20000001c60:[<0x10000000399/blog-47 v130130>,<0x10000000208/blogtest_in v1176>,<0x10000000201/src v2035>,<0x10000000006/blogbench-1.0 v1789>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/9623457f-b6b7-45df-8f7b-fed8f4e559f1 v68>,<0x10000000001/sv_1 v87>,<0x10000000000/qa v74>,<0x1/volumes v72>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 140=140+0)","ondisk_value.rstat":"n(v0 rc2024-09-15T22:48:04.289130+0000 b4474974 142=141+1)","memory_value.dirstat":"f(v2 m2024-09-15T22:48:04.289130+0000 141=141+0)","memory_value.rstat":"n(v4 rc2024-09-15T22:48:04.289130+0000 b4474974 142=141+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-09-15T22:48:45.406 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: pgmap v104: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 373 op/s 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details 2024-09-15T22:48:45.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:45 smithi066 ceph-mon[31185]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47) see mds.i log and `damage ls` output for details 2024-09-15T22:48:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: pgmap v104: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 373 op/s 2024-09-15T22:48:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:48:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details 2024-09-15T22:48:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:45 smithi087 ceph-mon[35290]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47) see mds.i log and `damage ls` output for details 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: pgmap v104: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 373 op/s 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details 2024-09-15T22:48:45.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:45 smithi184 ceph-mon[35203]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47) see mds.i log and `damage ls` output for details 2024-09-15T22:48:46.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.943+0000 7f57abbe3640 1 -- 172.21.15.66:0/2511879480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4102d90 msgr2=0x7f57a4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 --2- 172.21.15.66:0/2511879480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4102d90 0x7f57a4103170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009930 tx=0x7f57a002a420 comp rx=0 tx=0).stop 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 -- 172.21.15.66:0/2511879480 shutdown_connections 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 --2- 172.21.15.66:0/2511879480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 0x7f57a410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 --2- 172.21.15.66:0/2511879480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4103740 0x7f57a4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 --2- 172.21.15.66:0/2511879480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4102d90 0x7f57a4103170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 -- 172.21.15.66:0/2511879480 >> 172.21.15.66:0/2511879480 conn(0x7f57a40fc7d0 msgr2=0x7f57a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 -- 172.21.15.66:0/2511879480 shutdown_connections 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 -- 172.21.15.66:0/2511879480 wait complete. 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 Processor -- start 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.944+0000 7f57abbe3640 1 -- start start 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4102d90 0x7f57a4198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 0x7f57a419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4112090 con 0x7f57a4102d90 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4111f10 con 0x7f57a4103740 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57abbe3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4112210 con 0x7f57a4108290 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a997f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4102d90 0x7f57a4198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60714/0 (socket says 172.21.15.66:60714) 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 -- 172.21.15.66:0/1097912324 learned_addr learned my addr 172.21.15.66:0/1097912324 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57aa180640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 0x7f57a419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 -- 172.21.15.66:0/1097912324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 msgr2=0x7f57a419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 0x7f57a419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 -- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4102d90 msgr2=0x7f57a4198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4102d90 0x7f57a4198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.945+0000 7f57a917e640 1 -- 172.21.15.66:0/1097912324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a419d5e0 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f57a917e640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9c0 tx=0x7f579400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f579affd640 1 -- 172.21.15.66:0/1097912324 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579400cd80 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f579affd640 1 -- 172.21.15.66:0/1097912324 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5794005500 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a419d8d0 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f579affd640 1 -- 172.21.15.66:0/1097912324 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794010690 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.946+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a41a51b0 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.948+0000 7f579affd640 1 -- 172.21.15.66:0/1097912324 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f57940046c0 con 0x7f57a4103740 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.948+0000 7f57adfbc740 1 Processor -- start 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 -- start start 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 0x5575c1cf4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1d03550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 0x5575c1d05e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575c1c5a2e0 con 0x5575c1cf4380 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575c1c01ce0 con 0x5575c1cf4ca0 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57adfbc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575c1c562a0 con 0x5575c1d03a90 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57aa180640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 0x5575c1cf4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57aa180640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 0x5575c1cf4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55488/0 (socket says 172.21.15.66:55488) 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57aa180640 1 -- 172.21.15.66:0/3020557624 learned_addr learned my addr 172.21.15.66:0/3020557624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57a997f640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1d03550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.949+0000 7f57a917e640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 0x5575c1d05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 -- 172.21.15.66:0/3020557624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 msgr2=0x5575c1d05e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 0x5575c1d05e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 -- 172.21.15.66:0/3020557624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 msgr2=0x5575c1cf4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 0x5575c1cf4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 -- 172.21.15.66:0/3020557624 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c1be6440 con 0x5575c1cf4ca0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f579affd640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 0x7f57900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a917e640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 0x5575c1d05e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57aa180640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 0x7f57900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f57a997f640 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1d03550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57a0005940 tx=0x7f57a0005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1379dd85fd95f05d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f579affd640 1 -- 172.21.15.66:0/1097912324 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57940d0410 con 0x7f57a4103740 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f578ffff640 1 -- 172.21.15.66:0/3020557624 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0040070 con 0x5575c1cf4ca0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f578ffff640 1 -- 172.21.15.66:0/3020557624 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a0031870 con 0x5575c1cf4ca0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.950+0000 7f578ffff640 1 -- 172.21.15.66:0/3020557624 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0035040 con 0x5575c1cf4ca0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 -- 172.21.15.66:0/3020557624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 msgr2=0x5575c1d03550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57aa180640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 0x7f57900a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f579c011630 tx=0x7f579c009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1d03550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57a0005940 tx=0x7f57a0005bd0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 -- 172.21.15.66:0/3020557624 shutdown_connections 2024-09-15T22:48:46.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1d03a90 0x5575c1d05e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1d03550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3020557624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4380 0x5575c1cf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 -- 172.21.15.66:0/3020557624 >> 172.21.15.66:0/3020557624 conn(0x5575c1cf0a30 msgr2=0x5575c1cf0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 -- 172.21.15.66:0/3020557624 shutdown_connections 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.951+0000 7f57adfbc740 1 -- 172.21.15.66:0/3020557624 wait complete. 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 -- start start 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 Processor -- start 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d00c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575c1d06660 con 0x5575c1cf4ca0 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5575c1c15050 con 0x5575c1d03a90 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5575c1d067e0 con 0x5575c1cf4380 2024-09-15T22:48:46.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57adfbc740 10 client.0 _ll_register_callbacks cb 0x5575c1c55160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57a917e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57a997f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57a917e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55498/0 (socket says 172.21.15.66:55498) 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57a917e640 1 -- 172.21.15.66:0/4064225316 learned_addr learned my addr 172.21.15.66:0/4064225316 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57a997f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:38208/0 (socket says 172.21.15.66:38208) 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.952+0000 7f57aa180640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d00c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 -- 172.21.15.66:0/4064225316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 msgr2=0x5575c1d033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 -- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 msgr2=0x5575c1d00c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d00c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 -- 172.21.15.66:0/4064225316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c19cb3c0 con 0x5575c1cf4ca0 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57aa180640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d00c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:46.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a997f640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57a917e640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f579409c2b0 tx=0x7f57940d3d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1f120f133993d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f578d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579409bc80 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57940a4b00 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a0031870 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f57940d3e30 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57adfbc740 10 client.16383 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.953+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575c1d12070 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a0031870 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f57940b50f0 con 0x5575c1cf4ca0 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 10 client.16383 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 20 client.16383 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d13580 0x5575c1d15970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 4 client.16383 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575c1c67850 con 0x5575c1d13580 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57a997f640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d13580 0x5575c1d15970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f57a997f640 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d13580 0x5575c1d15970 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9444d82616bf0a2 server_cookie=272b76ce105c6d06 in_seq=0 out_seq=0 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.954+0000 7f578d7fa640 10 client.16383 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f578d7fa640 1 -- 172.21.15.66:0/4064225316 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575c1c67850 con 0x5575c1d13580 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f578d7fa640 10 client.16383 handle_command_reply: tid=0 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 client.16383 shutdown 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 msgr2=0x5575c1d006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f579409c2b0 tx=0x7f57940d3d30 comp rx=0 tx=0).stop 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 shutdown_connections 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d13580 0x5575c1d15970 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d00c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d006b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 --2- 172.21.15.66:0/4064225316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 >> 172.21.15.66:0/4064225316 conn(0x5575c1cf0a30 msgr2=0x5575c1cf6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.955+0000 7f578d7fa640 0 client.16383 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.956+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 shutdown_connections 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.956+0000 7f57adfbc740 1 -- 172.21.15.66:0/4064225316 wait complete. 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.956+0000 7f57adfbc740 20 client.16383 trim_cache size 0 max 16384 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 Processor -- start 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 -- start start 2024-09-15T22:48:46.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d0f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41acef0 con 0x5575c1d03a90 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41aebb0 con 0x5575c1cf4ca0 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.975+0000 7f57adfbc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41ad5c0 con 0x5575c1cf4380 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57a917e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55502/0 (socket says 172.21.15.66:55502) 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57a917e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60738/0 (socket says 172.21.15.66:60738) 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 -- 172.21.15.66:0/2844445506 learned_addr learned my addr 172.21.15.66:0/2844445506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57a997f640 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d0f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 -- 172.21.15.66:0/2844445506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 msgr2=0x5575c1d0f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d0f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 -- 172.21.15.66:0/2844445506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 msgr2=0x5575c1cfbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 -- 172.21.15.66:0/2844445506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c1cf4ad0 con 0x5575c1d03a90 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57a917e640 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f57aa180640 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f579c0040a0 tx=0x7f579c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d26cb2287339e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f578f7fe640 1 -- 172.21.15.66:0/2844445506 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c00f6a0 con 0x5575c1d03a90 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f578f7fe640 1 -- 172.21.15.66:0/2844445506 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c00fd20 con 0x5575c1d03a90 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.976+0000 7f578f7fe640 1 -- 172.21.15.66:0/2844445506 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01e430 con 0x5575c1d03a90 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- 172.21.15.66:0/2844445506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 msgr2=0x5575c1d1b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f579c0040a0 tx=0x7f579c01a000 comp rx=0 tx=0).stop 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- 172.21.15.66:0/2844445506 shutdown_connections 2024-09-15T22:48:46.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1d03a90 0x5575c1d1b280 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1cf4ca0 0x5575c1cfbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 --2- 172.21.15.66:0/2844445506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d0f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- 172.21.15.66:0/2844445506 >> 172.21.15.66:0/2844445506 conn(0x5575c1cf0a30 msgr2=0x5575c1cfb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- 172.21.15.66:0/2844445506 shutdown_connections 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- 172.21.15.66:0/2844445506 wait complete. 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.977+0000 7f57adfbc740 1 -- start start 2024-09-15T22:48:46.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 Processor -- start 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d76210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41ae420 con 0x5575c1cf4ca0 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41adc90 con 0x5575c1d03a90 2024-09-15T22:48:46.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41aaed0 con 0x5575c1cf4380 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57adfbc740 10 client.0 _ll_register_callbacks cb 0x7f5794009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57a917e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57aa180640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d76210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57a917e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55506/0 (socket says 172.21.15.66:55506) 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57a917e640 1 -- 172.21.15.66:0/3207722937 learned_addr learned my addr 172.21.15.66:0/3207722937 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:48:46.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.978+0000 7f57a997f640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 -- 172.21.15.66:0/3207722937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 msgr2=0x5575c1d071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 -- 172.21.15.66:0/3207722937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 msgr2=0x5575c1d076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 -- 172.21.15.66:0/3207722937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c1d00f80 con 0x5575c1d03a90 2024-09-15T22:48:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57a917e640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:48:46.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57aa180640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d76210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f579c004870 tx=0x7f579c009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8802808a98b9c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:48:46.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f578d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:48:46.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c004a40 con 0x5575c1d03a90 2024-09-15T22:48:46.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579c00fd20 con 0x5575c1d03a90 2024-09-15T22:48:46.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f579c004be0 con 0x5575c1d03a90 2024-09-15T22:48:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f579c004de0 con 0x5575c1d03a90 2024-09-15T22:48:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57adfbc740 10 client.25922 fetch_fsmap learned FSMap version 32 2024-09-15T22:48:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575c1d7da70 con 0x5575c1d03a90 2024-09-15T22:48:46.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.979+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c00fd20 con 0x5575c1d03a90 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) ==== 8402+0+0 (secure 0 0 0) 0x7f579c005310 con 0x5575c1d03a90 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 10 client.25922 fetch_fsmap finished waiting for FSMap version 32 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 10 client.25922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 20 client.25922 populate_metadata read hostname 'smithi066' 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d7e140 0x5575c1d80560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:48:46.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 4 client.25922 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5575c1c61d60 con 0x5575c1d7e140 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57a997f640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d7e140 0x5575c1d80560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57a997f640 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d7e140 0x5575c1d80560 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3234ce8b08f58bfa server_cookie=c47d9c011326f554 in_seq=0 out_seq=0 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f578d7fa640 10 client.25922 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f578d7fa640 1 -- 172.21.15.66:0/3207722937 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5575c1c61d60 con 0x5575c1d7e140 2024-09-15T22:48:46.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f578d7fa640 10 client.25922 handle_command_reply: tid=0 2024-09-15T22:48:46.089 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:48:46.089 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: "6d8dedd8-50a6-4563-9a53-7a99c945a608": { 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "6d8dedd8-50a6-4563-9a53-7a99c945a608", 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:48:46.090 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:46.091 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:48:46.091 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:48:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.980+0000 7f57adfbc740 1 client.25922 shutdown 2024-09-15T22:48:46.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 msgr2=0x5575c1d76210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d76210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f579c004870 tx=0x7f579c009ef0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 shutdown_connections 2024-09-15T22:48:46.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5575c1d7e140 0x5575c1d80560 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5575c1d03a90 0x5575c1d76210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575c1cf4ca0 0x5575c1d076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f578d7fa640 0 client.25922 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 --2- 172.21.15.66:0/3207722937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5575c1cf4380 0x5575c1d071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 >> 172.21.15.66:0/3207722937 conn(0x5575c1cf0a30 msgr2=0x5575c1cef350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 shutdown_connections 2024-09-15T22:48:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 1 -- 172.21.15.66:0/3207722937 wait complete. 2024-09-15T22:48:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57adfbc740 20 client.25922 trim_cache size 0 max 16384 2024-09-15T22:48:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 msgr2=0x7f57900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 0x7f57900a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f579c011630 tx=0x7f579c009500 comp rx=0 tx=0).stop 2024-09-15T22:48:46.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 msgr2=0x7f57a4198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:48:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.981+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9c0 tx=0x7f579400ee80 comp rx=0 tx=0).stop 2024-09-15T22:48:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 shutdown_connections 2024-09-15T22:48:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57900a3430 0x7f57900a58f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57a4108290 0x7f57a419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57a4103740 0x7f57a4198b70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 --2- 172.21.15.66:0/1097912324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57a4102d90 0x7f57a4198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:48:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 >> 172.21.15.66:0/1097912324 conn(0x7f57a40fc7d0 msgr2=0x7f57a4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:48:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 shutdown_connections 2024-09-15T22:48:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:48:45.982+0000 7f57abbe3640 1 -- 172.21.15.66:0/1097912324 wait complete. 2024-09-15T22:48:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.603 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.604 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:46.604 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.604 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:46.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:47.171 INFO:tasks.cephfs.filesystem:scrub status for tag:6d8dedd8-50a6-4563-9a53-7a99c945a608 - {'path': '/', 'tag': '6d8dedd8-50a6-4563-9a53-7a99c945a608', 'options': 'recursive,force'} 2024-09-15T22:48:47.452 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:47 smithi066 ceph-mon[31185]: pgmap v105: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 274 op/s 2024-09-15T22:48:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:47 smithi087 ceph-mon[35290]: pgmap v105: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 274 op/s 2024-09-15T22:48:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:47 smithi184 ceph-mon[35203]: pgmap v105: 129 pgs: 129 active+clean; 467 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 274 op/s 2024-09-15T22:48:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:49 smithi087 ceph-mon[35290]: pgmap v106: 129 pgs: 129 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 307 op/s 2024-09-15T22:48:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:49 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:48:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:49 smithi184 ceph-mon[35203]: pgmap v106: 129 pgs: 129 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 307 op/s 2024-09-15T22:48:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:49 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:48:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:49 smithi066 ceph-mon[31185]: pgmap v106: 129 pgs: 129 active+clean; 473 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 307 op/s 2024-09-15T22:48:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:49 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:48:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:51 smithi087 ceph-mon[35290]: pgmap v107: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:51 smithi184 ceph-mon[35203]: pgmap v107: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:51.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:51 smithi066 ceph-mon[31185]: pgmap v107: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:53 smithi087 ceph-mon[35290]: pgmap v108: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:53 smithi184 ceph-mon[35203]: pgmap v108: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:53.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:53 smithi066 ceph-mon[31185]: pgmap v108: 129 pgs: 129 active+clean; 534 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.5 MiB/s wr, 495 op/s 2024-09-15T22:48:54.582 INFO:tasks.workunit.client.0.smithi066.stdout: 137 1444340 1028 981752 901 362932 1496 2024-09-15T22:48:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:55 smithi087 ceph-mon[35290]: pgmap v109: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-15T22:48:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:55 smithi184 ceph-mon[35203]: pgmap v109: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-15T22:48:55.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:55 smithi066 ceph-mon[31185]: pgmap v109: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-15T22:48:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:56 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:56 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:56.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:56 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:48:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:57 smithi087 ceph-mon[35290]: pgmap v110: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 397 op/s 2024-09-15T22:48:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:57 smithi184 ceph-mon[35203]: pgmap v110: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 397 op/s 2024-09-15T22:48:57.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:57 smithi066 ceph-mon[31185]: pgmap v110: 129 pgs: 129 active+clean; 554 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 397 op/s 2024-09-15T22:48:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:48:59 smithi087 ceph-mon[35290]: pgmap v111: 129 pgs: 129 active+clean; 557 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 412 op/s 2024-09-15T22:48:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:48:59 smithi184 ceph-mon[35203]: pgmap v111: 129 pgs: 129 active+clean; 557 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 412 op/s 2024-09-15T22:48:59.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:48:59 smithi066 ceph-mon[31185]: pgmap v111: 129 pgs: 129 active+clean; 557 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 412 op/s 2024-09-15T22:49:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:01 smithi087 ceph-mon[35290]: pgmap v112: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.8 MiB/s wr, 449 op/s 2024-09-15T22:49:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:01 smithi184 ceph-mon[35203]: pgmap v112: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.8 MiB/s wr, 449 op/s 2024-09-15T22:49:01.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:01 smithi066 ceph-mon[31185]: pgmap v112: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.8 MiB/s wr, 449 op/s 2024-09-15T22:49:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:03 smithi087 ceph-mon[35290]: pgmap v113: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-09-15T22:49:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:03 smithi184 ceph-mon[35203]: pgmap v113: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-09-15T22:49:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:03 smithi066 ceph-mon[31185]: pgmap v113: 129 pgs: 129 active+clean; 571 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 189 op/s 2024-09-15T22:49:04.582 INFO:tasks.workunit.client.0.smithi066.stdout: 173 1319042 1865 879573 1968 335168 924 2024-09-15T22:49:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:49:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:49:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:49:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:49:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:49:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:49:04.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:49:04.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:49:04.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:49:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:05 smithi087 ceph-mon[35290]: pgmap v114: 129 pgs: 129 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-09-15T22:49:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:49:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:49:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:05 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:05.600 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:05 smithi066 ceph-mon[31185]: pgmap v114: 129 pgs: 129 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-09-15T22:49:05.600 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:49:05.600 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:49:05.600 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:05 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:05 smithi184 ceph-mon[35203]: pgmap v114: 129 pgs: 129 active+clean; 588 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-09-15T22:49:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:49:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:49:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:05 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:07 smithi087 ceph-mon[35290]: pgmap v115: 129 pgs: 129 active+clean; 594 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-09-15T22:49:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:07 smithi184 ceph-mon[35203]: pgmap v115: 129 pgs: 129 active+clean; 594 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-09-15T22:49:07.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:07 smithi066 ceph-mon[31185]: pgmap v115: 129 pgs: 129 active+clean; 594 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.9 MiB/s wr, 212 op/s 2024-09-15T22:49:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:09 smithi087 ceph-mon[35290]: pgmap v116: 129 pgs: 129 active+clean; 608 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-09-15T22:49:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:09 smithi184 ceph-mon[35203]: pgmap v116: 129 pgs: 129 active+clean; 608 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-09-15T22:49:09.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:09 smithi066 ceph-mon[31185]: pgmap v116: 129 pgs: 129 active+clean; 608 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-09-15T22:49:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:11 smithi087 ceph-mon[35290]: pgmap v117: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 648 op/s 2024-09-15T22:49:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:11 smithi184 ceph-mon[35203]: pgmap v117: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 648 op/s 2024-09-15T22:49:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:11 smithi066 ceph-mon[31185]: pgmap v117: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 648 op/s 2024-09-15T22:49:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:13 smithi087 ceph-mon[35290]: pgmap v118: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 577 op/s 2024-09-15T22:49:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:13 smithi184 ceph-mon[35203]: pgmap v118: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 577 op/s 2024-09-15T22:49:13.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:13 smithi066 ceph-mon[31185]: pgmap v118: 129 pgs: 129 active+clean; 698 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 577 op/s 2024-09-15T22:49:14.582 INFO:tasks.workunit.client.0.smithi066.stdout: 196 829486 1158 555939 1278 192292 156 2024-09-15T22:49:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:15 smithi087 ceph-mon[35290]: pgmap v119: 129 pgs: 129 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 881 op/s 2024-09-15T22:49:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:15 smithi184 ceph-mon[35203]: pgmap v119: 129 pgs: 129 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 881 op/s 2024-09-15T22:49:15.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:15 smithi066 ceph-mon[31185]: pgmap v119: 129 pgs: 129 active+clean; 779 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 881 op/s 2024-09-15T22:49:17.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:49:17.472 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:17 smithi087 ceph-mon[35290]: pgmap v120: 129 pgs: 129 active+clean; 794 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 836 op/s 2024-09-15T22:49:17.624 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:17 smithi066 ceph-mon[31185]: pgmap v120: 129 pgs: 129 active+clean; 794 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 836 op/s 2024-09-15T22:49:17.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:17 smithi184 ceph-mon[35203]: pgmap v120: 129 pgs: 129 active+clean; 794 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 836 op/s 2024-09-15T22:49:18.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.369+0000 7fbb2827c640 1 -- 172.21.15.66:0/2239815760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 msgr2=0x7fbb2010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.369+0000 7fbb2827c640 1 --2- 172.21.15.66:0/2239815760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 0x7fbb2010da40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009c10 tx=0x7fbb1802a7c0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 -- 172.21.15.66:0/2239815760 shutdown_connections 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 --2- 172.21.15.66:0/2239815760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 0x7fbb2010da40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 --2- 172.21.15.66:0/2239815760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 --2- 172.21.15.66:0/2239815760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 0x7fbb20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 -- 172.21.15.66:0/2239815760 >> 172.21.15.66:0/2239815760 conn(0x7fbb200fc7d0 msgr2=0x7fbb200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.371+0000 7fbb2827c640 1 -- 172.21.15.66:0/2239815760 shutdown_connections 2024-09-15T22:49:18.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.372+0000 7fbb2827c640 1 -- 172.21.15.66:0/2239815760 wait complete. 2024-09-15T22:49:18.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 Processor -- start 2024-09-15T22:49:18.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 -- start start 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 0x7fbb200739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 0x7fbb2010cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2006c620 con 0x7fbb20102570 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2006c4a0 con 0x7fbb20100e20 2024-09-15T22:49:18.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.373+0000 7fbb2827c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2006c7a0 con 0x7fbb20102ef0 2024-09-15T22:49:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.374+0000 7fbb25817640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.374+0000 7fbb25817640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58232/0 (socket says 172.21.15.66:58232) 2024-09-15T22:49:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.374+0000 7fbb25817640 1 -- 172.21.15.66:0/3705477132 learned_addr learned my addr 172.21.15.66:0/3705477132 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.374+0000 7fbb26018640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 0x7fbb200739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.375+0000 7fbb25817640 1 -- 172.21.15.66:0/3705477132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 msgr2=0x7fbb2010cc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:49:18.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.375+0000 7fbb25817640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 0x7fbb2010cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.375+0000 7fbb25817640 1 -- 172.21.15.66:0/3705477132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 msgr2=0x7fbb200739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.375+0000 7fbb25817640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 0x7fbb200739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.375+0000 7fbb25817640 1 -- 172.21.15.66:0/3705477132 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2010d550 con 0x7fbb20102570 2024-09-15T22:49:18.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.376+0000 7fbb25817640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000ea90 tx=0x7fbb1000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.378+0000 7fbb177fe640 1 -- 172.21.15.66:0/3705477132 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000cc90 con 0x7fbb20102570 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.379+0000 7fbb177fe640 1 -- 172.21.15.66:0/3705477132 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb1000ce30 con 0x7fbb20102570 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.379+0000 7fbb177fe640 1 -- 172.21.15.66:0/3705477132 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10010430 con 0x7fbb20102570 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.379+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2010d840 con 0x7fbb20102570 2024-09-15T22:49:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.379+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb201ab590 con 0x7fbb20102570 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.387+0000 7fbb2a655740 1 Processor -- start 2024-09-15T22:49:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.387+0000 7fbb177fe640 1 -- 172.21.15.66:0/3705477132 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbb10005000 con 0x7fbb20102570 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.389+0000 7fbb177fe640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 0x7fbb0c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.389+0000 7fbb177fe640 1 -- 172.21.15.66:0/3705477132 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbb100d04e0 con 0x7fbb20102570 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.390+0000 7fbb26819640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 0x7fbb0c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.390+0000 7fbb2a655740 1 -- start start 2024-09-15T22:49:18.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.391+0000 7fbb26819640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 0x7fbb0c0a5a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb180099a0 tx=0x7fbb18005fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74604b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 0x55f746056140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb26819640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb26819640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58242/0 (socket says 172.21.15.66:58242) 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb26819640 1 -- 172.21.15.66:0/1076900121 learned_addr learned my addr 172.21.15.66:0/1076900121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.392+0000 7fbb26018640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74604b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.393+0000 7fbb25817640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 0x55f746056140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.393+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f745fb12e0 con 0x55f746056680 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.393+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f745f58ce0 con 0x55f74604b4a0 2024-09-15T22:49:18.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.393+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f745fad2a0 con 0x55f74604bdc0 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.398+0000 7fbb26819640 1 -- 172.21.15.66:0/1076900121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 msgr2=0x55f746056140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.398+0000 7fbb26819640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 0x55f746056140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.398+0000 7fbb26819640 1 -- 172.21.15.66:0/1076900121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 msgr2=0x55f74604b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.398+0000 7fbb26819640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74604b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.399+0000 7fbb26819640 1 -- 172.21.15.66:0/1076900121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f745f3d440 con 0x55f746056680 2024-09-15T22:49:18.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.399+0000 7fbb26819640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb18033000 tx=0x7fbb1803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2243265e44cf40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.400+0000 7fbb26018640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74604b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:18.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.400+0000 7fbb25817640 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 0x55f746056140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.400+0000 7fbb14dea640 1 -- 172.21.15.66:0/1076900121 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18044050 con 0x55f746056680 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.400+0000 7fbb14dea640 1 -- 172.21.15.66:0/1076900121 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb1804e070 con 0x55f746056680 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.400+0000 7fbb14dea640 1 -- 172.21.15.66:0/1076900121 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1803e870 con 0x55f746056680 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.401+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 msgr2=0x55f746058a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.401+0000 7fbb2a655740 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb18033000 tx=0x7fbb1803b000 comp rx=0 tx=0).stop 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.402+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 shutdown_connections 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.402+0000 7fbb2a655740 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f746056680 0x55f746058a70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.402+0000 7fbb2a655740 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604bdc0 0x55f746056140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.402+0000 7fbb2a655740 1 --2- 172.21.15.66:0/1076900121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74604b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.402+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 >> 172.21.15.66:0/1076900121 conn(0x55f746047a30 msgr2=0x55f746047e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.406+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 shutdown_connections 2024-09-15T22:49:18.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.408+0000 7fbb2a655740 1 -- 172.21.15.66:0/1076900121 wait complete. 2024-09-15T22:49:18.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.409+0000 7fbb2a655740 1 -- start start 2024-09-15T22:49:18.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.410+0000 7fbb2a655740 1 Processor -- start 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 0x55f746055ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604bdc0 0x55f7460532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f746053800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f746059250 con 0x55f74604b4a0 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f745f6c050 con 0x55f74604bdc0 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f7460593d0 con 0x55f746056680 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb2a655740 10 client.0 _ll_register_callbacks cb 0x55f745fac160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb26819640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f746053800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb26819640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f746053800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35690/0 (socket says 172.21.15.66:35690) 2024-09-15T22:49:18.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.414+0000 7fbb26819640 1 -- 172.21.15.66:0/738781728 learned_addr learned my addr 172.21.15.66:0/738781728 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.415+0000 7fbb26018640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 0x55f746055ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.415+0000 7fbb25817640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604bdc0 0x55f7460532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.416+0000 7fbb26018640 1 -- 172.21.15.66:0/738781728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 msgr2=0x55f746053800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.416+0000 7fbb26018640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f746053800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.416+0000 7fbb26018640 1 -- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604bdc0 msgr2=0x55f7460532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.416+0000 7fbb26018640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604bdc0 0x55f7460532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.416+0000 7fbb26018640 1 -- 172.21.15.66:0/738781728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f745d223c0 con 0x55f74604b4a0 2024-09-15T22:49:18.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.417+0000 7fbb26018640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 0x55f746055ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00afd0 tx=0x7fbb1c010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c9b53d240e4b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.417+0000 7fbb09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.417+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00f9a0 con 0x55f74604b4a0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.417+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb1804e070 con 0x55f74604b4a0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.418+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbb1c00fb40 con 0x55f74604b4a0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.418+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb1c00fd40 con 0x55f74604b4a0 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.418+0000 7fbb2a655740 10 client.16401 fetch_fsmap learned FSMap version 33 2024-09-15T22:49:18.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.418+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f746064c80 con 0x55f74604b4a0 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.420+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb1804e070 con 0x55f74604b4a0 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.420+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 33) ==== 8390+0+0 (secure 0 0 0) 0x7fbb1c019410 con 0x55f74604b4a0 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 10 client.16401 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 20 client.16401 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f746066140 0x55f746068550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 4 client.16401 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:18.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.423+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f745fbe850 con 0x55f746066140 2024-09-15T22:49:18.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.425+0000 7fbb25817640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f746066140 0x55f746068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.427+0000 7fbb25817640 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f746066140 0x55f746068550 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c7a9739f6eba39 server_cookie=500f73040c53a3e0 in_seq=0 out_seq=0 2024-09-15T22:49:18.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.427+0000 7fbb09ffb640 10 client.16401 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:18.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.430+0000 7fbb09ffb640 1 -- 172.21.15.66:0/738781728 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f745fbe850 con 0x55f746066140 2024-09-15T22:49:18.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.430+0000 7fbb09ffb640 10 client.16401 handle_command_reply: tid=0 2024-09-15T22:49:18.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.431+0000 7fbb2a655740 1 client.16401 shutdown 2024-09-15T22:49:18.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.437+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 msgr2=0x55f746055ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.437+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 0x55f746055ff0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00afd0 tx=0x7fbb1c010af0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 shutdown_connections 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f746053800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f746066140 0x55f746068550 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604bdc0 0x55f7460532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 --2- 172.21.15.66:0/738781728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604b4a0 0x55f746055ff0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.444+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 >> 172.21.15.66:0/738781728 conn(0x55f746047a30 msgr2=0x55f74604d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.445+0000 7fbb09ffb640 0 client.16401 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:18.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.449+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 shutdown_connections 2024-09-15T22:49:18.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.453+0000 7fbb2a655740 1 -- 172.21.15.66:0/738781728 wait complete. 2024-09-15T22:49:18.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.454+0000 7fbb2a655740 20 client.16401 trim_cache size 0 max 16384 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.499+0000 7fbb2a655740 1 Processor -- start 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 -- start start 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f746052ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f746056680 0x55f74606ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c6910 con 0x55f74604bdc0 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c8540 con 0x55f746056680 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb2a655740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c6fe0 con 0x55f74604b4a0 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb26018640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb26018640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35702/0 (socket says 172.21.15.66:35702) 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.500+0000 7fbb26018640 1 -- 172.21.15.66:0/131404922 learned_addr learned my addr 172.21.15.66:0/131404922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb25817640 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f746052ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb26018640 1 -- 172.21.15.66:0/131404922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f746056680 msgr2=0x55f74606ddf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:49:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb26018640 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f746056680 0x55f74606ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb26018640 1 -- 172.21.15.66:0/131404922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 msgr2=0x55f746052ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb26018640 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f746052ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.501+0000 7fbb26018640 1 -- 172.21.15.66:0/131404922 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f746048ba0 con 0x55f74604b4a0 2024-09-15T22:49:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.503+0000 7fbb26018640 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00ac40 tx=0x7fbb1c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b43fac5ab20e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.504+0000 7fbb0bfff640 1 -- 172.21.15.66:0/131404922 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c02e070 con 0x55f74604b4a0 2024-09-15T22:49:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.504+0000 7fbb0bfff640 1 -- 172.21.15.66:0/131404922 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb1c00f9a0 con 0x55f74604b4a0 2024-09-15T22:49:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.504+0000 7fbb0bfff640 1 -- 172.21.15.66:0/131404922 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c005290 con 0x55f74604b4a0 2024-09-15T22:49:18.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 -- 172.21.15.66:0/131404922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 msgr2=0x55f7460624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00ac40 tx=0x7fbb1c0058a0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 -- 172.21.15.66:0/131404922 shutdown_connections 2024-09-15T22:49:18.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f746056680 0x55f74606ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f746052ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 --2- 172.21.15.66:0/131404922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f74604b4a0 0x55f7460624b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.506+0000 7fbb2a655740 1 -- 172.21.15.66:0/131404922 >> 172.21.15.66:0/131404922 conn(0x55f746047a30 msgr2=0x55f74604d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.510+0000 7fbb2a655740 1 -- 172.21.15.66:0/131404922 shutdown_connections 2024-09-15T22:49:18.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.510+0000 7fbb2a655740 1 -- 172.21.15.66:0/131404922 wait complete. 2024-09-15T22:49:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.511+0000 7fbb2a655740 1 -- start start 2024-09-15T22:49:18.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.511+0000 7fbb2a655740 1 Processor -- start 2024-09-15T22:49:18.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.512+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74605e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.512+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f74605ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb26018640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74605e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb2a655740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb26018640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74605e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46130/0 (socket says 172.21.15.66:46130) 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb2a655740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c7e40 con 0x55f74604bdc0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb2a655740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c76b0 con 0x55f74604b4a0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb2a655740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb201c4910 con 0x55f746056680 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb2a655740 10 client.0 _ll_register_callbacks cb 0x7fbb1c00a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb26819640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb26819640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35714/0 (socket says 172.21.15.66:35714) 2024-09-15T22:49:18.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.513+0000 7fbb26819640 1 -- 172.21.15.66:0/3967151125 learned_addr learned my addr 172.21.15.66:0/3967151125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.514+0000 7fbb26819640 1 -- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 msgr2=0x55f74605e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.514+0000 7fbb26819640 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74605e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.514+0000 7fbb26819640 1 -- 172.21.15.66:0/3967151125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 msgr2=0x55f74605ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.514+0000 7fbb26819640 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f74605ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.514+0000 7fbb26819640 1 -- 172.21.15.66:0/3967151125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f746050260 con 0x55f746056680 2024-09-15T22:49:18.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.518+0000 7fbb26819640 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004990 tx=0x7fbb18005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c020ff036c0b956e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:18.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.519+0000 7fbb09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.519+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18057070 con 0x55f746056680 2024-09-15T22:49:18.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.519+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fbb1803e4e0 con 0x55f746056680 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.520+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb1c00f9a0 con 0x55f746056680 2024-09-15T22:49:18.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.520+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb18044020 con 0x55f746056680 2024-09-15T22:49:18.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.534+0000 7fbb2a655740 10 client.25903 fetch_fsmap learned FSMap version 33 2024-09-15T22:49:18.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.534+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f7460d07d0 con 0x55f746056680 2024-09-15T22:49:18.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.534+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb1c00f9a0 con 0x55f746056680 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.534+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 33) ==== 8390+0+0 (secure 0 0 0) 0x7fbb1805c830 con 0x55f746056680 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 10 client.25903 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 20 client.25903 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f7460d0ab0 0x55f7460d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 4 client.25903 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:49:18.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.535+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f745fb8d60 con 0x55f7460d0ab0 2024-09-15T22:49:18.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.540+0000 7fbb26018640 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f7460d0ab0 0x55f7460d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:18.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.543+0000 7fbb26018640 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f7460d0ab0 0x55f7460d2ea0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7114dce8dd14d297 server_cookie=f42900868f22c6f6 in_seq=0 out_seq=0 2024-09-15T22:49:18.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb09ffb640 10 client.25903 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:18.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb09ffb640 1 -- 172.21.15.66:0/3967151125 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f745fb8d60 con 0x55f7460d0ab0 2024-09-15T22:49:18.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb09ffb640 10 client.25903 handle_command_reply: tid=0 2024-09-15T22:49:18.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb2a655740 1 client.25903 shutdown 2024-09-15T22:49:18.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 msgr2=0x55f74604fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.544+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004990 tx=0x7fbb18005bd0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 shutdown_connections 2024-09-15T22:49:18.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f746056680 0x55f74604fb20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f74604bdc0 0x55f74605ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f7460d0ab0 0x55f7460d2ea0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 --2- 172.21.15.66:0/3967151125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f74604b4a0 0x55f74605e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 >> 172.21.15.66:0/3967151125 conn(0x55f746047a30 msgr2=0x55f74604e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.545+0000 7fbb09ffb640 0 client.25903 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:18.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.547+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 shutdown_connections 2024-09-15T22:49:18.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.548+0000 7fbb2a655740 1 -- 172.21.15.66:0/3967151125 wait complete. 2024-09-15T22:49:18.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.548+0000 7fbb2a655740 20 client.25903 trim_cache size 0 max 16384 2024-09-15T22:49:18.551 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:49:18.551 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:49:18.551 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:49:18.551 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.552+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 msgr2=0x7fbb0c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.552+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 0x7fbb0c0a5a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb180099a0 tx=0x7fbb18005fd0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.552+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 msgr2=0x7fbb20073ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.552+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000ea90 tx=0x7fbb1000ef50 comp rx=0 tx=0).stop 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 shutdown_connections 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb0c0a35c0 0x7fbb0c0a5a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb20102ef0 0x7fbb2010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb20102570 0x7fbb20073ee0 secure :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000ea90 tx=0x7fbb1000ef50 comp rx=0 tx=0).stop 2024-09-15T22:49:18.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 --2- 172.21.15.66:0/3705477132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb20100e20 0x7fbb200739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:18.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.553+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 >> 172.21.15.66:0/3705477132 conn(0x7fbb200fc7d0 msgr2=0x7fbb2010e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:18.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.555+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 shutdown_connections 2024-09-15T22:49:18.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:18.555+0000 7fbb2827c640 1 -- 172.21.15.66:0/3705477132 wait complete. 2024-09-15T22:49:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:19 smithi087 ceph-mon[35290]: pgmap v121: 129 pgs: 129 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-15T22:49:19.636 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:19 smithi066 ceph-mon[31185]: pgmap v121: 129 pgs: 129 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-15T22:49:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:19 smithi184 ceph-mon[35203]: pgmap v121: 129 pgs: 129 active+clean; 803 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-15T22:49:19.982 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:49:19.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:49:20.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:20 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:20 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:20 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:21 smithi087 ceph-mon[35290]: pgmap v122: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 805 op/s 2024-09-15T22:49:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:21 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:21 smithi184 ceph-mon[35203]: pgmap v122: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 805 op/s 2024-09-15T22:49:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:21 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:21 smithi066 ceph-mon[31185]: pgmap v122: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 18 MiB/s wr, 805 op/s 2024-09-15T22:49:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:21 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:23 smithi184 ceph-mon[35203]: pgmap v123: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 411 op/s 2024-09-15T22:49:23.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:23 smithi066 ceph-mon[31185]: pgmap v123: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 411 op/s 2024-09-15T22:49:23.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:23 smithi087 ceph-mon[35290]: pgmap v123: 129 pgs: 129 active+clean; 813 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 411 op/s 2024-09-15T22:49:24.583 INFO:tasks.workunit.client.0.smithi066.stdout: 246 1816100 2609 1199404 2369 343353 572 2024-09-15T22:49:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:25 smithi184 ceph-mon[35203]: pgmap v124: 129 pgs: 129 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 482 op/s 2024-09-15T22:49:25.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:25 smithi066 ceph-mon[31185]: pgmap v124: 129 pgs: 129 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 482 op/s 2024-09-15T22:49:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:25 smithi087 ceph-mon[35290]: pgmap v124: 129 pgs: 129 active+clean; 827 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 482 op/s 2024-09-15T22:49:26.559 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:26.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:26 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:26.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:26 smithi184 ceph-mon[35203]: pgmap v125: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2024-09-15T22:49:26.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:26 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:26.702 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:26 smithi066 ceph-mon[31185]: pgmap v125: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2024-09-15T22:49:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:26 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:26.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:26 smithi087 ceph-mon[35290]: pgmap v125: 129 pgs: 129 active+clean; 844 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 229 op/s 2024-09-15T22:49:27.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.725+0000 7fe838cb9640 1 -- 172.21.15.66:0/1616269993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834109e00 msgr2=0x7fe8340742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:27.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.725+0000 7fe838cb9640 1 --2- 172.21.15.66:0/1616269993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834109e00 0x7fe8340742d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b4a0 tx=0x7fe82402ba00 comp rx=0 tx=0).stop 2024-09-15T22:49:27.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 -- 172.21.15.66:0/1616269993 shutdown_connections 2024-09-15T22:49:27.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 --2- 172.21.15.66:0/1616269993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe834074990 0x7fe83407b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:27.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 --2- 172.21.15.66:0/1616269993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834109e00 0x7fe8340742d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 --2- 172.21.15.66:0/1616269993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 -- 172.21.15.66:0/1616269993 >> 172.21.15.66:0/1616269993 conn(0x7fe83406e140 msgr2=0x7fe83406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 -- 172.21.15.66:0/1616269993 shutdown_connections 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.727+0000 7fe838cb9640 1 -- 172.21.15.66:0/1616269993 wait complete. 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.728+0000 7fe838cb9640 1 Processor -- start 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 -- start start 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 0x7fe83407af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834075fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:27.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8340764f0 0x7fe8340769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe834084e00 con 0x7fe8340764f0 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe834084c80 con 0x7fe834109450 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe838cb9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe834084f80 con 0x7fe834074990 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe83259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 0x7fe83407af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe83259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 0x7fe83407af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:38846/0 (socket says 172.21.15.66:38846) 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.729+0000 7fe83259c640 1 -- 172.21.15.66:0/2655266015 learned_addr learned my addr 172.21.15.66:0/2655266015 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834075fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 -- 172.21.15.66:0/2655266015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 msgr2=0x7fe83407af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:27.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 0x7fe83407af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 -- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8340764f0 msgr2=0x7fe8340769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8340764f0 0x7fe8340769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.730+0000 7fe831d9b640 1 -- 172.21.15.66:0/2655266015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe834137290 con 0x7fe834109450 2024-09-15T22:49:27.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.731+0000 7fe831d9b640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834075fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b3f0 tx=0x7fe824030890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:27.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.732+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824034070 con 0x7fe834109450 2024-09-15T22:49:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.732+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe834137520 con 0x7fe834109450 2024-09-15T22:49:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.732+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8341379d0 con 0x7fe834109450 2024-09-15T22:49:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.738+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe824030c10 con 0x7fe834109450 2024-09-15T22:49:27.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.739+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824039870 con 0x7fe834109450 2024-09-15T22:49:27.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.740+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe814005290 con 0x7fe834109450 2024-09-15T22:49:27.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.745+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe824037070 con 0x7fe834109450 2024-09-15T22:49:27.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.746+0000 7fe8237fe640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 0x7fe81c0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:27.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.746+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fe8240f0fe0 con 0x7fe834109450 2024-09-15T22:49:27.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.747+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8240bd610 con 0x7fe834109450 2024-09-15T22:49:27.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.747+0000 7fe83259c640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 0x7fe81c0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:27.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:27.748+0000 7fe83259c640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 0x7fe81c0a58e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009c20 tx=0x7fe82c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:28.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.235+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe814005580 con 0x7fe834109450 2024-09-15T22:49:28.245 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:49:28.245 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"btime":"2024-09-15T22:49:25:352898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:49:24.947083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:49:28.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.242+0000 7fe8237fe640 1 -- 172.21.15.66:0/2655266015 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11986 (secure 0 0 0) 0x7fe8240bcf10 con 0x7fe834109450 2024-09-15T22:49:28.246 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-09-15T22:49:28.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 msgr2=0x7fe81c0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:28.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 0x7fe81c0a58e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009c20 tx=0x7fe82c005f90 comp rx=0 tx=0).stop 2024-09-15T22:49:28.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 msgr2=0x7fe834075fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:28.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834075fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe82400b3f0 tx=0x7fe824030890 comp rx=0 tx=0).stop 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 shutdown_connections 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe81c0a3420 0x7fe81c0a58e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8340764f0 0x7fe8340769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe834109450 0x7fe834075fb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 --2- 172.21.15.66:0/2655266015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe834074990 0x7fe83407af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:28.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.248+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 >> 172.21.15.66:0/2655266015 conn(0x7fe83406e140 msgr2=0x7fe8340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:28.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.250+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 shutdown_connections 2024-09-15T22:49:28.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:28.251+0000 7fe838cb9640 1 -- 172.21.15.66:0/2655266015 wait complete. 2024-09-15T22:49:28.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:28 smithi184 ceph-mon[35203]: pgmap v126: 129 pgs: 129 active+clean; 886 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-09-15T22:49:28.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2655266015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:28.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:28 smithi066 ceph-mon[31185]: pgmap v126: 129 pgs: 129 active+clean; 886 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-09-15T22:49:28.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2655266015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:29.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:28 smithi087 ceph-mon[35290]: pgmap v126: 129 pgs: 129 active+clean; 886 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-09-15T22:49:29.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2655266015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:29.992 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:49:30.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:30 smithi066 ceph-mon[31185]: pgmap v127: 129 pgs: 129 active+clean; 940 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 485 op/s 2024-09-15T22:49:31.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:30 smithi087 ceph-mon[35290]: pgmap v127: 129 pgs: 129 active+clean; 940 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 485 op/s 2024-09-15T22:49:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:31.268 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:30 smithi184 ceph-mon[35203]: pgmap v127: 129 pgs: 129 active+clean; 940 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 485 op/s 2024-09-15T22:49:31.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:31 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:31.851 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:31 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 -- 172.21.15.66:0/1930421118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae101091f0 msgr2=0x7fae101095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 --2- 172.21.15.66:0/1930421118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae101091f0 0x7fae101095d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009900 tx=0x7fae0c02a4b0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 -- 172.21.15.66:0/1930421118 shutdown_connections 2024-09-15T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 --2- 172.21.15.66:0/1930421118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 0x7fae10116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 --2- 172.21.15.66:0/1930421118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae10109b10 0x7fae10114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 --2- 172.21.15.66:0/1930421118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae101091f0 0x7fae101095d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 -- 172.21.15.66:0/1930421118 >> 172.21.15.66:0/1930421118 conn(0x7fae1006e140 msgr2=0x7fae1006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 -- 172.21.15.66:0/1930421118 shutdown_connections 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.904+0000 7fae1789a640 1 -- 172.21.15.66:0/1930421118 wait complete. 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 Processor -- start 2024-09-15T22:49:31.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 -- start start 2024-09-15T22:49:31.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae10109b10 0x7fae101a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 0x7fae101a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae1011a7a0 con 0x7fae10109b10 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae1011a620 con 0x7fae101091f0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.905+0000 7fae1789a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae1011a920 con 0x7fae10114ab0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57178/0 (socket says 172.21.15.66:57178) 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 -- 172.21.15.66:0/3278837550 learned_addr learned my addr 172.21.15.66:0/3278837550 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15e37640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 0x7fae101a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 -- 172.21.15.66:0/3278837550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 msgr2=0x7fae101a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 0x7fae101a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 -- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae10109b10 msgr2=0x7fae101a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae10109b10 0x7fae101a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.906+0000 7fae15636640 1 -- 172.21.15.66:0/3278837550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae101a11e0 con 0x7fae101091f0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.907+0000 7fae15636640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006010 tx=0x7fae0c0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.907+0000 7fae067fc640 1 -- 172.21.15.66:0/3278837550 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c03f030 con 0x7fae101091f0 2024-09-15T22:49:31.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.907+0000 7fae067fc640 1 -- 172.21.15.66:0/3278837550 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0c003ad0 con 0x7fae101091f0 2024-09-15T22:49:31.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.907+0000 7fae067fc640 1 -- 172.21.15.66:0/3278837550 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c03f030 con 0x7fae101091f0 2024-09-15T22:49:31.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.908+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae101a1470 con 0x7fae101091f0 2024-09-15T22:49:31.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.908+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae101ad7c0 con 0x7fae101091f0 2024-09-15T22:49:31.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.912+0000 7fae067fc640 1 -- 172.21.15.66:0/3278837550 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fae0c042030 con 0x7fae101091f0 2024-09-15T22:49:31.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.913+0000 7fae19c73740 1 Processor -- start 2024-09-15T22:49:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.914+0000 7fae19c73740 1 -- start start 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.914+0000 7fae19c73740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d5087f8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.914+0000 7fae19c73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087f8df0 0x55d5087fd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae19c73740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae067fc640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 0x7fadfc0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae19c73740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d5087542f0 con 0x55d5087f8440 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae19c73740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d5086fbcf0 con 0x55d5087fda40 2024-09-15T22:49:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae19c73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d5087502b0 con 0x55d5087f8df0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae067fc640 1 -- 172.21.15.66:0/3278837550 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fae0c040070 con 0x7fae101091f0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57188/0 (socket says 172.21.15.66:57188) 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 -- 172.21.15.66:0/664838013 learned_addr learned my addr 172.21.15.66:0/664838013 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae15636640 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087f8df0 0x55d5087fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae15e37640 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d5087f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 -- 172.21.15.66:0/664838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087f8df0 msgr2=0x55d5087fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087f8df0 0x55d5087fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 -- 172.21.15.66:0/664838013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 msgr2=0x55d5087f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae15e37640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 0x7fadfc0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d5087f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.915+0000 7fae14e35640 1 -- 172.21.15.66:0/664838013 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5086e03a0 con 0x55d5087fda40 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.916+0000 7fae14e35640 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae0000aa30 tx=0x7fae0000aef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4dbb4f4751ed701 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.916+0000 7fadfb7fe640 1 -- 172.21.15.66:0/664838013 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000ce40 con 0x55d5087fda40 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.916+0000 7fadfb7fe640 1 -- 172.21.15.66:0/664838013 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0000f930 con 0x55d5087fda40 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.916+0000 7fadfb7fe640 1 -- 172.21.15.66:0/664838013 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000ce40 con 0x55d5087fda40 2024-09-15T22:49:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.916+0000 7fae15e37640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 0x7fadfc0a5c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae08009270 tx=0x7fae08009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.917+0000 7fae19c73740 1 -- 172.21.15.66:0/664838013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 msgr2=0x55d5087fdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.917+0000 7fae19c73740 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae0000aa30 tx=0x7fae0000aef0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 -- 172.21.15.66:0/664838013 shutdown_connections 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087fda40 0x55d5087fdef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087f8df0 0x55d5087fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 --2- 172.21.15.66:0/664838013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d5087f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 -- 172.21.15.66:0/664838013 >> 172.21.15.66:0/664838013 conn(0x55d5087b7310 msgr2=0x55d5087ea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 -- 172.21.15.66:0/664838013 shutdown_connections 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 -- 172.21.15.66:0/664838013 wait complete. 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 -- start start 2024-09-15T22:49:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.918+0000 7fae19c73740 1 Processor -- start 2024-09-15T22:49:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d508803e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5088010e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d5088048d0 con 0x55d5087f8440 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d50870f060 con 0x55d5087f8df0 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d508804a50 con 0x55d5087fda40 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae15e37640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae15e37640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:38884/0 (socket says 172.21.15.66:38884) 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae15e37640 1 -- 172.21.15.66:0/3621282050 learned_addr learned my addr 172.21.15.66:0/3621282050 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.919+0000 7fae19c73740 10 client.0 _ll_register_callbacks cb 0x55d5084628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.920+0000 7fae15e37640 1 -- 172.21.15.66:0/3621282050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 msgr2=0x55d5088010e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.920+0000 7fae15e37640 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5088010e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.920+0000 7fae15e37640 1 -- 172.21.15.66:0/3621282050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 msgr2=0x55d508803e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.920+0000 7fae15e37640 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d508803e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.920+0000 7fae15e37640 1 -- 172.21.15.66:0/3621282050 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5084c53c0 con 0x55d5087fda40 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.921+0000 7fae15e37640 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae0800eca0 tx=0x7fae08004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4636c7d8547f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.922+0000 7fadf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.922+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08018070 con 0x55d5087fda40 2024-09-15T22:49:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.922+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fae08028670 con 0x55d5087fda40 2024-09-15T22:49:31.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.922+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae0000f930 con 0x55d5087fda40 2024-09-15T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.923+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fae08028870 con 0x55d5087fda40 2024-09-15T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 10 client.25918 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d5088102f0 con 0x55d5087fda40 2024-09-15T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae0000f930 con 0x55d5087fda40 2024-09-15T22:49:31.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fae0801f550 con 0x55d5087fda40 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 10 client.25918 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 10 client.25918 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 20 client.25918 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d5088117b0 0x55d508813c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 4 client.25918 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.924+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d508761860 con 0x55d5088117b0 2024-09-15T22:49:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.925+0000 7fae15636640 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d5088117b0 0x55d508813c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.926+0000 7fae15636640 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d5088117b0 0x55d508813c20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6dfc5f5beff986b server_cookie=f4cda109fcdc7822 in_seq=0 out_seq=0 2024-09-15T22:49:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.926+0000 7fadf8ff9640 10 client.25918 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.926+0000 7fadf8ff9640 1 -- 172.21.15.66:0/3621282050 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d508761860 con 0x55d5088117b0 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.926+0000 7fadf8ff9640 10 client.25918 handle_command_reply: tid=0 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.926+0000 7fae19c73740 1 client.25918 shutdown 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 msgr2=0x55d508801620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae0800eca0 tx=0x7fae08004a40 comp rx=0 tx=0).stop 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 shutdown_connections 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d5088117b0 0x55d508813c20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508801620 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5088010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 --2- 172.21.15.66:0/3621282050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d508803e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 >> 172.21.15.66:0/3621282050 conn(0x55d5087b7310 msgr2=0x55d5087f7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.927+0000 7fadf8ff9640 0 client.25918 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:49:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.928+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 shutdown_connections 2024-09-15T22:49:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.928+0000 7fae19c73740 1 -- 172.21.15.66:0/3621282050 wait complete. 2024-09-15T22:49:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.928+0000 7fae19c73740 20 client.25918 trim_cache size 0 max 16384 2024-09-15T22:49:31.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.955+0000 7fae19c73740 1 Processor -- start 2024-09-15T22:49:31.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.955+0000 7fae19c73740 1 -- start start 2024-09-15T22:49:31.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d50880db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b5820 con 0x55d5087f8440 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b7420 con 0x55d5087f8df0 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae19c73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b5ef0 con 0x55d5087fda40 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae14e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae14e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57204/0 (socket says 172.21.15.66:57204) 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae14e35640 1 -- 172.21.15.66:0/2323741720 learned_addr learned my addr 172.21.15.66:0/2323741720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.956+0000 7fae15e37640 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 -- 172.21.15.66:0/2323741720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 msgr2=0x55d508819530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 -- 172.21.15.66:0/2323741720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 msgr2=0x55d50880db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d50880db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 -- 172.21.15.66:0/2323741720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5087eac20 con 0x55d5087f8df0 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.957+0000 7fae14e35640 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a950 tx=0x7fae00005c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a364fa15e7305b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.958+0000 7fadfaffd640 1 -- 172.21.15.66:0/2323741720 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000ce40 con 0x55d5087f8df0 2024-09-15T22:49:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.958+0000 7fadfaffd640 1 -- 172.21.15.66:0/2323741720 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae00018d20 con 0x55d5087f8df0 2024-09-15T22:49:31.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.958+0000 7fadfaffd640 1 -- 172.21.15.66:0/2323741720 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae000047a0 con 0x55d5087f8df0 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 -- 172.21.15.66:0/2323741720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 msgr2=0x55d5087fcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a950 tx=0x7fae00005c10 comp rx=0 tx=0).stop 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 -- 172.21.15.66:0/2323741720 shutdown_connections 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8df0 0x55d5087fcfa0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a950 tx=0x7fae00005c10 comp rx=0 tx=0).stop 2024-09-15T22:49:31.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 --2- 172.21.15.66:0/2323741720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d5087f8440 0x55d50880db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 -- 172.21.15.66:0/2323741720 >> 172.21.15.66:0/2323741720 conn(0x55d5087b7310 msgr2=0x55d5087fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 -- 172.21.15.66:0/2323741720 shutdown_connections 2024-09-15T22:49:31.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.959+0000 7fae19c73740 1 -- 172.21.15.66:0/2323741720 wait complete. 2024-09-15T22:49:31.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.960+0000 7fae19c73740 1 -- start start 2024-09-15T22:49:31.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.960+0000 7fae19c73740 1 Processor -- start 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 0x55d5088191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d508819c60 0x55d50887b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae14e35640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b6d50 con 0x55d508819c60 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b65c0 con 0x55d5087f8440 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae101b3800 con 0x55d5087fda40 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae14e35640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:38898/0 (socket says 172.21.15.66:38898) 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae14e35640 1 -- 172.21.15.66:0/2398142634 learned_addr learned my addr 172.21.15.66:0/2398142634 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae19c73740 10 client.0 _ll_register_callbacks cb 0x7fae08009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.961+0000 7fae15636640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 0x55d5088191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.962+0000 7fae15636640 1 -- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 msgr2=0x55d508819720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.962+0000 7fae15636640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.962+0000 7fae15636640 1 -- 172.21.15.66:0/2398142634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d508819c60 msgr2=0x55d50887b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.962+0000 7fae15636640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d508819c60 0x55d50887b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.962+0000 7fae15636640 1 -- 172.21.15.66:0/2398142634 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50887ba40 con 0x55d5087f8440 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.963+0000 7fae15636640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 0x55d5088191e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0ed370 tx=0x7fae0c0045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d9ba810f60a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.963+0000 7fadf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:49:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.963+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c03f040 con 0x55d5087f8440 2024-09-15T22:49:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.963+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fae0c0ed5f0 con 0x55d5087f8440 2024-09-15T22:49:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.963+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae00018d20 con 0x55d5087f8440 2024-09-15T22:49:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.964+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fae0c035040 con 0x55d5087f8440 2024-09-15T22:49:31.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.964+0000 7fae19c73740 10 client.25952 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:31.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.965+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d50887cd60 con 0x55d5087f8440 2024-09-15T22:49:31.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.965+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae00018d20 con 0x55d5087f8440 2024-09-15T22:49:31.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.965+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fae0c0b8570 con 0x55d5087f8440 2024-09-15T22:49:31.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 10 client.25952 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:31.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 10 client.25952 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:49:31.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 20 client.25952 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:31.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d50887d460 0x55d50887f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:31.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 4 client.25952 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:49:31.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d50875bd70 con 0x55d50887d460 2024-09-15T22:49:31.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.966+0000 7fae14e35640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d50887d460 0x55d50887f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:31.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fae14e35640 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d50887d460 0x55d50887f880 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=64651970413f5999 server_cookie=1591f17f6ac46522 in_seq=0 out_seq=0 2024-09-15T22:49:31.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fadf8ff9640 10 client.25952 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fadf8ff9640 1 -- 172.21.15.66:0/2398142634 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d50875bd70 con 0x55d50887d460 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fadf8ff9640 10 client.25952 handle_command_reply: tid=0 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fae19c73740 1 client.25952 shutdown 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.968+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 msgr2=0x55d5088191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 0x55d5088191e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0ed370 tx=0x7fae0c0045f0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 shutdown_connections 2024-09-15T22:49:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d50887d460 0x55d50887f880 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d508819c60 0x55d50887b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5087fda40 0x55d508819720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 --2- 172.21.15.66:0/2398142634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d5087f8440 0x55d5088191e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 >> 172.21.15.66:0/2398142634 conn(0x55d5087b7310 msgr2=0x55d508803160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fadf8ff9640 0 client.25952 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:49:31.971 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 shutdown_connections 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 1 -- 172.21.15.66:0/2398142634 wait complete. 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.969+0000 7fae19c73740 20 client.25952 trim_cache size 0 max 16384 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 msgr2=0x7fadfc0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 0x7fadfc0a5c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae08009270 tx=0x7fae08009500 comp rx=0 tx=0).stop 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 msgr2=0x7fae101a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae0c006010 tx=0x7fae0c0040c0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 shutdown_connections 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fadfc0a37b0 0x7fadfc0a5c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10114ab0 0x7fae101a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae10109b10 0x7fae101a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 --2- 172.21.15.66:0/3278837550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae101091f0 0x7fae101a68f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.970+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 >> 172.21.15.66:0/3278837550 conn(0x7fae1006e140 msgr2=0x7fae100708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.971+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 shutdown_connections 2024-09-15T22:49:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:31.971+0000 7fae1789a640 1 -- 172.21.15.66:0/3278837550 wait complete. 2024-09-15T22:49:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:31 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:32.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:31 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:49:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:31 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:49:32.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:31 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:49:33.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:32 smithi087 ceph-mon[35290]: pgmap v128: 129 pgs: 129 active+clean; 949 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-15T22:49:33.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:32 smithi184 ceph-mon[35203]: pgmap v128: 129 pgs: 129 active+clean; 949 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-15T22:49:33.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:32 smithi066 ceph-mon[31185]: pgmap v128: 129 pgs: 129 active+clean; 949 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 483 op/s 2024-09-15T22:49:33.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:49:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:33 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:49:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:33 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:49:33.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:33 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:49:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:33 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:49:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:33 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:49:34.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:33 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:49:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:33 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:49:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:33 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:49:34.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:33 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:49:34.583 INFO:tasks.workunit.client.0.smithi066.stdout: 270 1636398 1580 1083519 1484 318133 1244 2024-09-15T22:49:35.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:34 smithi184 ceph-mon[35203]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 833 op/s 2024-09-15T22:49:35.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:34 smithi066 ceph-mon[31185]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 833 op/s 2024-09-15T22:49:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:34 smithi087 ceph-mon[35290]: pgmap v129: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 833 op/s 2024-09-15T22:49:37.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:36 smithi066 ceph-mon[31185]: pgmap v130: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 817 op/s 2024-09-15T22:49:37.330 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.8 2024-09-15T22:49:37.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:49:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:36 smithi087 ceph-mon[35290]: pgmap v130: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 817 op/s 2024-09-15T22:49:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:36 smithi184 ceph-mon[35203]: pgmap v130: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 21 MiB/s wr, 817 op/s 2024-09-15T22:49:39.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:38 smithi066 ceph-mon[31185]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 799 op/s 2024-09-15T22:49:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:38 smithi087 ceph-mon[35290]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 799 op/s 2024-09-15T22:49:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:38 smithi184 ceph-mon[35203]: pgmap v131: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 799 op/s 2024-09-15T22:49:39.985 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:40.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.907+0000 7ff7cad1f640 1 -- 172.21.15.66:0/2945475830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c4101270 msgr2=0x7ff7c410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.907+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/2945475830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c4101270 0x7ff7c410d7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009860 tx=0x7ff7b402a360 comp rx=0 tx=0).stop 2024-09-15T22:49:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.910+0000 7ff7cad1f640 1 -- 172.21.15.66:0/2945475830 shutdown_connections 2024-09-15T22:49:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.910+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/2945475830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c4101270 0x7ff7c410d7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.910+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/2945475830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7c41008d0 0x7ff7c4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.910+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/2945475830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.910+0000 7ff7cad1f640 1 -- 172.21.15.66:0/2945475830 >> 172.21.15.66:0/2945475830 conn(0x7ff7c40fc610 msgr2=0x7ff7c40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.911+0000 7ff7cad1f640 1 -- 172.21.15.66:0/2945475830 shutdown_connections 2024-09-15T22:49:40.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.912+0000 7ff7cad1f640 1 -- 172.21.15.66:0/2945475830 wait complete. 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.913+0000 7ff7cad1f640 1 Processor -- start 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 -- start start 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 0x7ff7c4073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7c4101270 0x7ff7c406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410fbe0 con 0x7ff7c41068d0 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410fa60 con 0x7ff7c4101270 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.914+0000 7ff7cad1f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c406c9c0 con 0x7ff7c41008d0 2024-09-15T22:49:40.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 0x7ff7c4073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59942/0 (socket says 172.21.15.66:59942) 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7ca51e640 1 -- 172.21.15.66:0/4222722536 learned_addr learned my addr 172.21.15.66:0/4222722536 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/4222722536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7c4101270 msgr2=0x7ff7c406bce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7c4101270 0x7ff7c406bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 msgr2=0x7ff7c406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/4222722536 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41af1d0 con 0x7ff7c41008d0 2024-09-15T22:49:40.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.915+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.916+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 0x7ff7c4073d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e790 tx=0x7ff7bc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.917+0000 7ff7baffd640 1 -- 172.21.15.66:0/4222722536 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00eea0 con 0x7ff7c41008d0 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.917+0000 7ff7baffd640 1 -- 172.21.15.66:0/4222722536 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7bc00ccc0 con 0x7ff7c41008d0 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.917+0000 7ff7baffd640 1 -- 172.21.15.66:0/4222722536 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc018820 con 0x7ff7c41008d0 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.917+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c419a1a0 con 0x7ff7c41008d0 2024-09-15T22:49:40.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.918+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c419a690 con 0x7ff7c41008d0 2024-09-15T22:49:40.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.923+0000 7ff7ce35a740 1 Processor -- start 2024-09-15T22:49:40.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.923+0000 7ff7ce35a740 1 -- start start 2024-09-15T22:49:40.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5184bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60134/0 (socket says 172.21.15.66:60134) 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ca51e640 1 -- 172.21.15.66:0/4117879429 learned_addr learned my addr 172.21.15.66:0/4117879429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5197d30 0x55f2e519a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f2e50ea2f0 con 0x55f2e5197d30 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f2e5091cf0 con 0x55f2e5185cf0 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.924+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f2e50e62b0 con 0x55f2e5184780 2024-09-15T22:49:40.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.925+0000 7ff7c951c640 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5197d30 0x55f2e519a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 -- 172.21.15.66:0/4117879429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 msgr2=0x55f2e5184bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5184bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 -- 172.21.15.66:0/4117879429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5197d30 msgr2=0x55f2e519a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5197d30 0x55f2e519a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 -- 172.21.15.66:0/4117879429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e50763a0 con 0x55f2e5185cf0 2024-09-15T22:49:40.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40095a0 tx=0x7ff7b4030360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f679ee37a55a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.926+0000 7ff7affff640 1 -- 172.21.15.66:0/4117879429 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4064020 con 0x55f2e5185cf0 2024-09-15T22:49:40.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.927+0000 7ff7affff640 1 -- 172.21.15.66:0/4117879429 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b4059040 con 0x55f2e5185cf0 2024-09-15T22:49:40.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.929+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 msgr2=0x55f2e5184240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.929+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40095a0 tx=0x7ff7b4030360 comp rx=0 tx=0).stop 2024-09-15T22:49:40.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.929+0000 7ff7baffd640 1 -- 172.21.15.66:0/4222722536 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff7bc0189c0 con 0x7ff7c41008d0 2024-09-15T22:49:40.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.931+0000 7ff7baffd640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 0x7ff7b00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.931+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 0x7ff7b00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.932+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 0x7ff7b00a59c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4030520 tx=0x7ff7b405f480 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.933+0000 7ff7baffd640 1 -- 172.21.15.66:0/4222722536 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff7bc09a170 con 0x7ff7c41008d0 2024-09-15T22:49:40.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.934+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 shutdown_connections 2024-09-15T22:49:40.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.934+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5197d30 0x55f2e519a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.934+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5184bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.934+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/4117879429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5184240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.934+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 >> 172.21.15.66:0/4117879429 conn(0x55f2e514d310 msgr2=0x55f2e5180e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.935+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 shutdown_connections 2024-09-15T22:49:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.936+0000 7ff7ce35a740 1 -- 172.21.15.66:0/4117879429 wait complete. 2024-09-15T22:49:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.937+0000 7ff7ce35a740 1 -- start start 2024-09-15T22:49:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.937+0000 7ff7ce35a740 1 Processor -- start 2024-09-15T22:49:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5197570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e5194820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e5194d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f2e519aa20 con 0x55f2e5185cf0 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f2e50a5060 con 0x55f2e5197d30 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f2e519aba0 con 0x55f2e5184780 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7ce35a740 10 client.0 _ll_register_callbacks cb 0x55f2e4df88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e5194820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e5194820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59960/0 (socket says 172.21.15.66:59960) 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7c951c640 1 -- 172.21.15.66:0/1476230007 learned_addr learned my addr 172.21.15.66:0/1476230007 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.938+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e5194d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/1476230007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 msgr2=0x55f2e5194d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e5194d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/1476230007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 msgr2=0x55f2e5194820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e5194820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/1476230007 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e4e5b3c0 con 0x55f2e5184780 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.939+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5197570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0cd540 tx=0x7ff7bc0a4840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fac8fb8359951b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.941+0000 7ff7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.941+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc098b00 con 0x55f2e5184780 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.941+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7b4059040 con 0x55f2e5184780 2024-09-15T22:49:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.941+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff7bc0a4c80 con 0x55f2e5184780 2024-09-15T22:49:40.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.950+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff7bc098ca0 con 0x55f2e5184780 2024-09-15T22:49:40.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.951+0000 7ff7ce35a740 10 client.25933 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:40.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.951+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f2e5189900 con 0x55f2e5184780 2024-09-15T22:49:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.952+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b4059040 con 0x55f2e5184780 2024-09-15T22:49:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.952+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff7bc0cd7c0 con 0x55f2e5184780 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 10 client.25933 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 10 client.25933 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 20 client.25933 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e518ad60 0x55f2e518d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 4 client.25933 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.953+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2e50f7860 con 0x55f2e518ad60 2024-09-15T22:49:40.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.955+0000 7ff7c951c640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e518ad60 0x55f2e518d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:40.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.957+0000 7ff7c951c640 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e518ad60 0x55f2e518d1a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=426637877ff7ae60 server_cookie=f3ad89003d49ae6 in_seq=0 out_seq=0 2024-09-15T22:49:40.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.958+0000 7ff7ad7fa640 10 client.25933 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:49:40.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.961+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/1476230007 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2e50f7860 con 0x55f2e518ad60 2024-09-15T22:49:40.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.961+0000 7ff7ad7fa640 10 client.25933 handle_command_reply: tid=0 2024-09-15T22:49:40.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.962+0000 7ff7ce35a740 1 client.25933 shutdown 2024-09-15T22:49:40.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.965+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 msgr2=0x55f2e5197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:40.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.965+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5197570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0cd540 tx=0x7ff7bc0a4840 comp rx=0 tx=0).stop 2024-09-15T22:49:40.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 shutdown_connections 2024-09-15T22:49:40.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e518ad60 0x55f2e518d1a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e5194d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e5194820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/1476230007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e5197570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:40.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 >> 172.21.15.66:0/1476230007 conn(0x55f2e514d310 msgr2=0x55f2e5186b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:40.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ad7fa640 0 client.25933 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:49:40.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.967+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 shutdown_connections 2024-09-15T22:49:40.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.968+0000 7ff7ce35a740 1 -- 172.21.15.66:0/1476230007 wait complete. 2024-09-15T22:49:40.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:40.971+0000 7ff7ce35a740 20 client.25933 trim_cache size 0 max 16384 2024-09-15T22:49:41.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.004+0000 7ff7ce35a740 1 Processor -- start 2024-09-15T22:49:41.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.005+0000 7ff7ce35a740 1 -- start start 2024-09-15T22:49:41.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.005+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 0x55f2e51900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.005+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5199120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.005+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5197d30 0x55f2e5199660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60158/0 (socket says 172.21.15.66:60158) 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7c951c640 1 -- 172.21.15.66:0/2781387638 learned_addr learned my addr 172.21.15.66:0/2781387638 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7ca51e640 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5197d30 0x55f2e5199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8010150 con 0x55f2e5184780 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8011d50 con 0x55f2e5185cf0 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.006+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8010820 con 0x55f2e5197d30 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.007+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 0x55f2e51900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.008+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/2781387638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5197d30 msgr2=0x55f2e5199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.008+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5197d30 0x55f2e5199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.008+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/2781387638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 msgr2=0x55f2e5199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:41.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.009+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.009+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/2781387638 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e51a3da0 con 0x55f2e5184780 2024-09-15T22:49:41.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.010+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 0x55f2e51900c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc09c1c0 tx=0x7ff7bc0a0380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5c50c52607db17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:41.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.013+0000 7ff7af7fe640 1 -- 172.21.15.66:0/2781387638 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc098e40 con 0x55f2e5184780 2024-09-15T22:49:41.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.014+0000 7ff7af7fe640 1 -- 172.21.15.66:0/2781387638 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7bc01ee50 con 0x55f2e5184780 2024-09-15T22:49:41.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.014+0000 7ff7af7fe640 1 -- 172.21.15.66:0/2781387638 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc098e40 con 0x55f2e5184780 2024-09-15T22:49:41.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 msgr2=0x55f2e51900c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 0x55f2e51900c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc09c1c0 tx=0x7ff7bc0a0380 comp rx=0 tx=0).stop 2024-09-15T22:49:41.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 shutdown_connections 2024-09-15T22:49:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5197d30 0x55f2e5199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5185cf0 0x55f2e5199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/2781387638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5184780 0x55f2e51900c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.016+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 >> 172.21.15.66:0/2781387638 conn(0x55f2e514d310 msgr2=0x55f2e5193910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.022+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 shutdown_connections 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.022+0000 7ff7ce35a740 1 -- 172.21.15.66:0/2781387638 wait complete. 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.022+0000 7ff7ce35a740 1 -- start start 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.023+0000 7ff7ce35a740 1 Processor -- start 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e51b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7c9d1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7c9d1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:40074/0 (socket says 172.21.15.66:40074) 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e51b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7c951c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e51b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59986/0 (socket says 172.21.15.66:59986) 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.024+0000 7ff7ce35a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e51b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ce35a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8011680 con 0x55f2e5185cf0 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e51b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ca51e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e51b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60170/0 (socket says 172.21.15.66:60170) 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ca51e640 1 -- 172.21.15.66:0/152546917 learned_addr learned my addr 172.21.15.66:0/152546917 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ce35a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8010ef0 con 0x55f2e5197d30 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a800e130 con 0x55f2e5184780 2024-09-15T22:49:41.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.025+0000 7ff7ce35a740 10 client.0 _ll_register_callbacks cb 0x7ff7bc024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.028+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/152546917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 msgr2=0x55f2e51b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.028+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e51b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.028+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/152546917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 msgr2=0x55f2e51b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.028+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e51b97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.028+0000 7ff7c9d1d640 1 -- 172.21.15.66:0/152546917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e51ba540 con 0x55f2e5184780 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.029+0000 7ff7c9d1d640 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc018490 tx=0x7ff7bc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=419ccbb6b3929027 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:41.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.029+0000 7ff7ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:41.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.031+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc098e40 con 0x55f2e5184780 2024-09-15T22:49:41.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.031+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff7bc09b730 con 0x55f2e5184780 2024-09-15T22:49:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.032+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7bc01ee50 con 0x55f2e5184780 2024-09-15T22:49:41.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.033+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff7bc099010 con 0x55f2e5184780 2024-09-15T22:49:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.034+0000 7ff7ce35a740 10 client.25939 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.034+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f2e521afb0 con 0x55f2e5184780 2024-09-15T22:49:41.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7bc01ee50 con 0x55f2e5184780 2024-09-15T22:49:41.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff7bc0a1610 con 0x55f2e5184780 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 10 client.25939 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 10 client.25939 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 20 client.25939 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e521b360 0x55f2e521d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 4 client.25939 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:49:41.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.035+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2e5185960 con 0x55f2e521b360 2024-09-15T22:49:41.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.038+0000 7ff7c951c640 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e521b360 0x55f2e521d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:41.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.040+0000 7ff7c951c640 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e521b360 0x55f2e521d7a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d0bd198b1ada9bd server_cookie=aa76f245245e12fd in_seq=0 out_seq=0 2024-09-15T22:49:41.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.040+0000 7ff7ad7fa640 10 client.25939 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:49:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.042+0000 7ff7ad7fa640 1 -- 172.21.15.66:0/152546917 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2e5185960 con 0x55f2e521b360 2024-09-15T22:49:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.042+0000 7ff7ad7fa640 10 client.25939 handle_command_reply: tid=0 2024-09-15T22:49:41.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.042+0000 7ff7ce35a740 1 client.25939 shutdown 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.043+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 msgr2=0x55f2e51a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.044+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc018490 tx=0x7ff7bc000bc0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 shutdown_connections 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55f2e521b360 0x55f2e521d7a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2e5197d30 0x55f2e51b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f2e5185cf0 0x55f2e51b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 --2- 172.21.15.66:0/152546917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f2e5184780 0x55f2e51a05d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 >> 172.21.15.66:0/152546917 conn(0x55f2e514d310 msgr2=0x55f2e51a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:41.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.045+0000 7ff7ad7fa640 0 client.25939 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:49:41.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.047+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 shutdown_connections 2024-09-15T22:49:41.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.050+0000 7ff7ce35a740 1 -- 172.21.15.66:0/152546917 wait complete. 2024-09-15T22:49:41.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.051+0000 7ff7ce35a740 20 client.25939 trim_cache size 0 max 16384 2024-09-15T22:49:41.054 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:49:41.060 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:40 smithi066 ceph-mon[31185]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 729 op/s 2024-09-15T22:49:41.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.055+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 msgr2=0x7ff7b00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.055+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 0x7ff7b00a59c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4030520 tx=0x7ff7b405f480 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.055+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 msgr2=0x7ff7c4073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.055+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 0x7ff7c4073d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e790 tx=0x7ff7bc00ec50 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.056+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 shutdown_connections 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.056+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff7b00a3500 0x7ff7b00a59c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.056+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7c41068d0 0x7ff7c406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.056+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7c4101270 0x7ff7c406bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.056+0000 7ff7cad1f640 1 --2- 172.21.15.66:0/4222722536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c41008d0 0x7ff7c4073d10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.057+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 >> 172.21.15.66:0/4222722536 conn(0x7ff7c40fc610 msgr2=0x7ff7c40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.057+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 shutdown_connections 2024-09-15T22:49:41.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:41.057+0000 7ff7cad1f640 1 -- 172.21.15.66:0/4222722536 wait complete. 2024-09-15T22:49:41.225 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:40 smithi184 ceph-mon[35203]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 729 op/s 2024-09-15T22:49:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:40 smithi087 ceph-mon[35290]: pgmap v132: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 729 op/s 2024-09-15T22:49:43.202 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:42 smithi066 ceph-mon[31185]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 523 op/s 2024-09-15T22:49:43.203 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:43.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:49:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:42 smithi087 ceph-mon[35290]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 523 op/s 2024-09-15T22:49:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:42 smithi184 ceph-mon[35203]: pgmap v133: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 523 op/s 2024-09-15T22:49:44.583 INFO:tasks.workunit.client.0.smithi066.stdout: 310 2059795 2186 1361017 2042 471397 2958 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.729+0000 7f9bc001b640 1 -- 172.21.15.66:0/243417208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109830 msgr2=0x7f9bb8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.729+0000 7f9bc001b640 1 --2- 172.21.15.66:0/243417208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109830 0x7f9bb8109c90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bb001acb0 tx=0x7f9bb003b8e0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.730+0000 7f9bc001b640 1 -- 172.21.15.66:0/243417208 shutdown_connections 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.730+0000 7f9bc001b640 1 --2- 172.21.15.66:0/243417208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bb811b140 0x7f9bb811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.730+0000 7f9bc001b640 1 --2- 172.21.15.66:0/243417208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109830 0x7f9bb8109c90 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bb001acb0 tx=0x7f9bb003b8e0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.730+0000 7f9bc001b640 1 --2- 172.21.15.66:0/243417208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb8109450 0x7f9bb8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.730+0000 7f9bc001b640 1 -- 172.21.15.66:0/243417208 >> 172.21.15.66:0/243417208 conn(0x7f9bb806e140 msgr2=0x7f9bb806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.732+0000 7f9bc001b640 1 -- 172.21.15.66:0/243417208 shutdown_connections 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.734+0000 7f9bc001b640 1 -- 172.21.15.66:0/243417208 wait complete. 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 Processor -- start 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 -- start start 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109450 0x7f9bb811a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bb8116ee0 0x7f9bb8117390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8113300 con 0x7f9bb8109450 2024-09-15T22:49:44.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8113180 con 0x7f9bb8116ee0 2024-09-15T22:49:44.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.735+0000 7f9bc001b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8113480 con 0x7f9bb811b140 2024-09-15T22:49:44.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.736+0000 7f9bbd5b6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.737+0000 7f9bbd5b6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51104/0 (socket says 172.21.15.66:51104) 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.737+0000 7f9bbd5b6640 1 -- 172.21.15.66:0/692782950 learned_addr learned my addr 172.21.15.66:0/692782950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.738+0000 7f9bbd5b6640 1 -- 172.21.15.66:0/692782950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bb8116ee0 msgr2=0x7f9bb8117390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.738+0000 7f9bbd5b6640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bb8116ee0 0x7f9bb8117390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.738+0000 7f9bbd5b6640 1 -- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109450 msgr2=0x7f9bb811a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.738+0000 7f9bbd5b6640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109450 0x7f9bb811a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:44.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.738+0000 7f9bbd5b6640 1 -- 172.21.15.66:0/692782950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb81ab1f0 con 0x7f9bb811b140 2024-09-15T22:49:44.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.745+0000 7f9bbd5b6640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bb003be50 tx=0x7f9bb001a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:44.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.748+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0050070 con 0x7f9bb811b140 2024-09-15T22:49:44.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.748+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb81ab480 con 0x7f9bb811b140 2024-09-15T22:49:44.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.748+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81ab900 con 0x7f9bb811b140 2024-09-15T22:49:44.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.748+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb0004720 con 0x7f9bb811b140 2024-09-15T22:49:44.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.748+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb004c400 con 0x7f9bb811b140 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.753+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9bb0004240 con 0x7f9bb811b140 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.754+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9c005290 con 0x7f9bb811b140 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.756+0000 7f9baeffd640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 0x7f9ba40a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.757+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9bb0101d30 con 0x7f9bb811b140 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.759+0000 7f9bbddb7640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 0x7f9ba40a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:44.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.763+0000 7f9bbddb7640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 0x7f9ba40a5a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400a990 tx=0x7f9bb4005c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:44.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:44.768+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bb00ce340 con 0x7f9bb811b140 2024-09-15T22:49:44.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:44 smithi066 ceph-mon[31185]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-15T22:49:45.261 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:49:45.261 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":37,"btime":"2024-09-15T22:49:30:673911+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:49:29.946069+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:49:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.257+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b9c005850 con 0x7f9bb811b140 2024-09-15T22:49:45.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.258+0000 7f9baeffd640 1 -- 172.21.15.66:0/692782950 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11988 (secure 0 0 0) 0x7f9bb00cdc40 con 0x7f9bb811b140 2024-09-15T22:49:45.262 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 37 2024-09-15T22:49:45.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.264+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 msgr2=0x7f9ba40a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:45.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.264+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 0x7f9ba40a5a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400a990 tx=0x7f9bb4005c70 comp rx=0 tx=0).stop 2024-09-15T22:49:45.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.264+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 msgr2=0x7f9bb81169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:45.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.264+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bb003be50 tx=0x7f9bb001a180 comp rx=0 tx=0).stop 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 shutdown_connections 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ba40a3540 0x7f9ba40a5a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bb8116ee0 0x7f9bb8117390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bb811b140 0x7f9bb81169a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 --2- 172.21.15.66:0/692782950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bb8109450 0x7f9bb811a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.269+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 >> 172.21.15.66:0/692782950 conn(0x7f9bb806e140 msgr2=0x7f9bb8070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.271+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 shutdown_connections 2024-09-15T22:49:45.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:45.272+0000 7f9bc001b640 1 -- 172.21.15.66:0/692782950 wait complete. 2024-09-15T22:49:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:44 smithi087 ceph-mon[35290]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-15T22:49:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:44 smithi184 ceph-mon[35203]: pgmap v134: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 597 op/s 2024-09-15T22:49:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:46 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/692782950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:46 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/692782950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:46.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:46 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/692782950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:49:46.794 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 133.8 --await-for 45.0' 2024-09-15T22:49:46.794 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 133.8 --await-for 45.0 2024-09-15T22:49:47.055 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:47 smithi066 ceph-mon[31185]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 303 op/s 2024-09-15T22:49:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:47 smithi087 ceph-mon[35290]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 303 op/s 2024-09-15T22:49:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:47 smithi184 ceph-mon[35203]: pgmap v135: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 303 op/s 2024-09-15T22:49:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:49 smithi087 ceph-mon[35290]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 357 op/s 2024-09-15T22:49:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:49 smithi184 ceph-mon[35203]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 357 op/s 2024-09-15T22:49:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:49 smithi066 ceph-mon[31185]: pgmap v136: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.6 MiB/s wr, 357 op/s 2024-09-15T22:49:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:51.180 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:51 smithi066 ceph-mon[31185]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 467 op/s 2024-09-15T22:49:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.271+0000 7f319f30f640 1 -- 172.21.15.66:0/1022366585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109450 msgr2=0x7f3198109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.271+0000 7f319f30f640 1 --2- 172.21.15.66:0/1022366585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109450 0x7f3198109830 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f319400d910 tx=0x7f319402c3b0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.272+0000 7f319f30f640 1 -- 172.21.15.66:0/1022366585 shutdown_connections 2024-09-15T22:49:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.272+0000 7f319f30f640 1 --2- 172.21.15.66:0/1022366585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319810ea80 0x7f31981154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.272+0000 7f319f30f640 1 --2- 172.21.15.66:0/1022366585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3198109e00 0x7f319810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.272+0000 7f319f30f640 1 --2- 172.21.15.66:0/1022366585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109450 0x7f3198109830 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.272+0000 7f319f30f640 1 -- 172.21.15.66:0/1022366585 >> 172.21.15.66:0/1022366585 conn(0x7f319806e2d0 msgr2=0x7f319806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.274+0000 7f319f30f640 1 -- 172.21.15.66:0/1022366585 shutdown_connections 2024-09-15T22:49:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.277+0000 7f319f30f640 1 -- 172.21.15.66:0/1022366585 wait complete. 2024-09-15T22:49:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.278+0000 7f319f30f640 1 Processor -- start 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 -- start start 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3198109450 0x7f319811e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319810ea80 0x7f3198118ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3198117260 con 0x7f3198109e00 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31981170e0 con 0x7f3198109450 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319f30f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f31981173e0 con 0x7f319810ea80 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48586/0 (socket says 172.21.15.66:48586) 2024-09-15T22:49:51.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.282+0000 7f319c8aa640 1 -- 172.21.15.66:0/1226478540 learned_addr learned my addr 172.21.15.66:0/1226478540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:51.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.284+0000 7f319c8aa640 1 -- 172.21.15.66:0/1226478540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319810ea80 msgr2=0x7f3198118ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.284+0000 7f319c8aa640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319810ea80 0x7f3198118ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.284+0000 7f319c8aa640 1 -- 172.21.15.66:0/1226478540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3198109450 msgr2=0x7f319811e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.284+0000 7f319c8aa640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3198109450 0x7f319811e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.284+0000 7f319c8aa640 1 -- 172.21.15.66:0/1226478540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3198119780 con 0x7f3198109e00 2024-09-15T22:49:51.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.290+0000 7f319c8aa640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f318800b470 tx=0x7f318800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.297+0000 7f318e7fc640 1 -- 172.21.15.66:0/1226478540 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188015020 con 0x7f3198109e00 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.297+0000 7f318e7fc640 1 -- 172.21.15.66:0/1226478540 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3188011d70 con 0x7f3198109e00 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.297+0000 7f318e7fc640 1 -- 172.21.15.66:0/1226478540 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318800f340 con 0x7f3198109e00 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.297+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31981bc1a0 con 0x7f3198109e00 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.297+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981bc660 con 0x7f3198109e00 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.303+0000 7f31a16e8740 1 Processor -- start 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 -- start start 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 0x5561085b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b65d0 0x5561085b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55610851c2f0 con 0x5561085b7b40 2024-09-15T22:49:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5561084c3cf0 con 0x5561085b65d0 2024-09-15T22:49:51.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.304+0000 7f31a16e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5561085182b0 con 0x5561085c1370 2024-09-15T22:49:51.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.306+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.306+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51130/0 (socket says 172.21.15.66:51130) 2024-09-15T22:49:51.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.306+0000 7f319c8aa640 1 -- 172.21.15.66:0/2285168273 learned_addr learned my addr 172.21.15.66:0/2285168273 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:51.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.308+0000 7f319d0ab640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b65d0 0x5561085b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.308+0000 7f319d8ac640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 0x5561085b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.310+0000 7f319c8aa640 1 -- 172.21.15.66:0/2285168273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b65d0 msgr2=0x5561085b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.310+0000 7f319c8aa640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b65d0 0x5561085b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.310+0000 7f319c8aa640 1 -- 172.21.15.66:0/2285168273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 msgr2=0x5561085b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.316+0000 7f318e7fc640 1 -- 172.21.15.66:0/1226478540 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3188018020 con 0x7f3198109e00 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.316+0000 7f319c8aa640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 0x5561085b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.316+0000 7f319c8aa640 1 -- 172.21.15.66:0/2285168273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561084a83a0 con 0x5561085c1370 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.316+0000 7f319d8ac640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 0x5561085b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.317+0000 7f318e7fc640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 0x7f31840a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.318+0000 7f319d8ac640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 0x7f31840a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.319+0000 7f319c8aa640 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31880d29c0 tx=0x7f31880d6fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d18a060c33014ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.320+0000 7f31837fe640 1 -- 172.21.15.66:0/2285168273 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318809d760 con 0x5561085c1370 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.320+0000 7f31837fe640 1 -- 172.21.15.66:0/2285168273 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31880a1c50 con 0x5561085c1370 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.322+0000 7f31a16e8740 1 -- 172.21.15.66:0/2285168273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 msgr2=0x5561085c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.322+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31880d29c0 tx=0x7f31880d6fb0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f319d8ac640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 0x7f31840a5aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31980734e0 tx=0x7f319000a040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 -- 172.21.15.66:0/2285168273 shutdown_connections 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085c3760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b65d0 0x5561085b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2285168273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b7b40 0x5561085b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 -- 172.21.15.66:0/2285168273 >> 172.21.15.66:0/2285168273 conn(0x55610857f310 msgr2=0x5561085b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f318e7fc640 1 -- 172.21.15.66:0/1226478540 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31880d5590 con 0x7f3198109e00 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.328+0000 7f31a16e8740 1 -- 172.21.15.66:0/2285168273 shutdown_connections 2024-09-15T22:49:51.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.329+0000 7f31a16e8740 1 -- 172.21.15.66:0/2285168273 wait complete. 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.329+0000 7f31a16e8740 1 -- start start 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.329+0000 7f31a16e8740 1 Processor -- start 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085be020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085c1370 0x5561085be610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5561085c40c0 con 0x5561085c1370 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5561084d7060 con 0x5561085b7b40 2024-09-15T22:49:51.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5561085c4240 con 0x5561085b65d0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.330+0000 7f31a16e8740 10 client.0 _ll_register_callbacks cb 0x55610822a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51142/0 (socket says 172.21.15.66:51142) 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 -- 172.21.15.66:0/3985628333 learned_addr learned my addr 172.21.15.66:0/3985628333 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319c8aa640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 -- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 msgr2=0x5561085be020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085be020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 -- 172.21.15.66:0/3985628333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085c1370 msgr2=0x5561085be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085c1370 0x5561085be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.331+0000 7f319d0ab640 1 -- 172.21.15.66:0/3985628333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610828d3c0 con 0x5561085b65d0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.334+0000 7f319d0ab640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f319400d910 tx=0x7f319400d500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a22b5dfb11c4a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.334+0000 7f3180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194041020 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556108529860 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3194005300 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f319404c050 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f31a16e8740 10 client.25951 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.335+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5561085f1c50 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.336+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556108529860 con 0x5561085b65d0 2024-09-15T22:49:51.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.336+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f319403c030 con 0x5561085b65d0 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.337+0000 7f31a16e8740 10 client.25951 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f31a16e8740 10 client.25951 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f31a16e8740 20 client.25951 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5561085f3530 0x5561085f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f31a16e8740 4 client.25951 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:51.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556108523d70 con 0x5561085f3530 2024-09-15T22:49:51.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.338+0000 7f319c8aa640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5561085f3530 0x5561085f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.341+0000 7f319c8aa640 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5561085f3530 0x5561085f59d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb46a133a6ebb6db server_cookie=5fa26c2fc2513e92 in_seq=0 out_seq=0 2024-09-15T22:49:51.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.342+0000 7f3180ff9640 10 client.25951 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:49:51.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.342+0000 7f3180ff9640 1 -- 172.21.15.66:0/3985628333 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556108523d70 con 0x5561085f3530 2024-09-15T22:49:51.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.342+0000 7f3180ff9640 10 client.25951 handle_command_reply: tid=0 2024-09-15T22:49:51.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.342+0000 7f31a16e8740 1 client.25951 shutdown 2024-09-15T22:49:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:51 smithi087 ceph-mon[35290]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 467 op/s 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 msgr2=0x5561085c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f319400d910 tx=0x7f319400d500 comp rx=0 tx=0).stop 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 shutdown_connections 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5561085f3530 0x5561085f59d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085c1370 0x5561085be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085be020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 --2- 172.21.15.66:0/3985628333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b65d0 0x5561085c0d70 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f319400d910 tx=0x7f319400d500 comp rx=0 tx=0).stop 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 >> 172.21.15.66:0/3985628333 conn(0x55610857f310 msgr2=0x5561085b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.344+0000 7f3180ff9640 0 client.25951 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.345+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 shutdown_connections 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.345+0000 7f31a16e8740 1 -- 172.21.15.66:0/3985628333 wait complete. 2024-09-15T22:49:51.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.345+0000 7f31a16e8740 20 client.25951 trim_cache size 0 max 16384 2024-09-15T22:49:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.382+0000 7f31a16e8740 1 Processor -- start 2024-09-15T22:49:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.383+0000 7f31a16e8740 1 -- start start 2024-09-15T22:49:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.383+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.383+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51150/0 (socket says 172.21.15.66:51150) 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f319c8aa640 1 -- 172.21.15.66:0/995658536 learned_addr learned my addr 172.21.15.66:0/995658536 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f317c010150 con 0x5561085b2f20 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f317c011d50 con 0x5561085b7b40 2024-09-15T22:49:51.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f317c010820 con 0x5561085c1370 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.384+0000 7f319d0ab640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319d8ac640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319c8aa640 1 -- 172.21.15.66:0/995658536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 msgr2=0x5561085cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319c8aa640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319c8aa640 1 -- 172.21.15.66:0/995658536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 msgr2=0x5561085fb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319c8aa640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085fb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319c8aa640 1 -- 172.21.15.66:0/995658536 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561085c10e0 con 0x5561085c1370 2024-09-15T22:49:51.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319d8ac640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.385+0000 7f319d0ab640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.388+0000 7f319c8aa640 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31880d7fd0 tx=0x7f31880d9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8230866bf6d22ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.393+0000 7f3182ffd640 1 -- 172.21.15.66:0/995658536 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31880a0eb0 con 0x5561085c1370 2024-09-15T22:49:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.393+0000 7f3182ffd640 1 -- 172.21.15.66:0/995658536 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31880a1550 con 0x5561085c1370 2024-09-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.394+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 msgr2=0x5561085bff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.394+0000 7f31a16e8740 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31880d7fd0 tx=0x7f31880d9040 comp rx=0 tx=0).stop 2024-09-15T22:49:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.401+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 shutdown_connections 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.401+0000 7f31a16e8740 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.401+0000 7f31a16e8740 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085c1370 0x5561085bff90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.401+0000 7f31a16e8740 1 --2- 172.21.15.66:0/995658536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085b7b40 0x5561085cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.401+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 >> 172.21.15.66:0/995658536 conn(0x55610857f310 msgr2=0x5561085bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.402+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 shutdown_connections 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.406+0000 7f31a16e8740 1 -- 172.21.15.66:0/995658536 wait complete. 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.406+0000 7f31a16e8740 1 -- start start 2024-09-15T22:49:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.406+0000 7f31a16e8740 1 Processor -- start 2024-09-15T22:49:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 0x5561085bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f31a16e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085c1370 0x5561085bb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 0x5561085bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f319c8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 0x5561085bacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:51166/0 (socket says 172.21.15.66:51166) 2024-09-15T22:49:51.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.410+0000 7f319c8aa640 1 -- 172.21.15.66:0/2913884393 learned_addr learned my addr 172.21.15.66:0/2913884393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.411+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f317c011680 con 0x5561085b2f20 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.411+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f317c010ef0 con 0x5561085c1370 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.411+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f317c00e130 con 0x5561085b7b40 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.411+0000 7f31a16e8740 10 client.0 _ll_register_callbacks cb 0x7f319400d790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.411+0000 7f319d0ab640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 -- 172.21.15.66:0/2913884393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 msgr2=0x5561085bacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 0x5561085bacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 -- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085c1370 msgr2=0x5561085bb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085c1370 0x5561085bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561085bba40 con 0x5561085b2f20 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.412+0000 7f319d0ab640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085c9c60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f31940345f0 tx=0x7f3194035f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d1877d48e6c825 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.413+0000 7f3180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.414+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194041050 con 0x5561085b2f20 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.415+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31880a1550 con 0x5561085b2f20 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.415+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3194005100 con 0x5561085b2f20 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.415+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3194061050 con 0x5561085b2f20 2024-09-15T22:49:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.416+0000 7f31a16e8740 10 client.16443 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.416+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55610865e290 con 0x5561085b2f20 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31880a1550 con 0x5561085b2f20 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f3194004bc0 con 0x5561085b2f20 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 10 client.16443 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 10 client.16443 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 20 client.16443 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55610865e960 0x556108660da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 4 client.16443 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.417+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561084a0170 con 0x55610865e960 2024-09-15T22:49:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.419+0000 7f319c8aa640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55610865e960 0x556108660da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:51.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:51 smithi184 ceph-mon[35203]: pgmap v137: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 467 op/s 2024-09-15T22:49:51.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.431+0000 7f3180ff9640 10 client.16443 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:49:51.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.431+0000 7f319c8aa640 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55610865e960 0x556108660da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d12cbe125c35cfe6 server_cookie=d1605adc545c807f in_seq=0 out_seq=0 2024-09-15T22:49:51.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.431+0000 7f3180ff9640 1 -- 172.21.15.66:0/2913884393 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561084a0170 con 0x55610865e960 2024-09-15T22:49:51.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.431+0000 7f3180ff9640 10 client.16443 handle_command_reply: tid=0 2024-09-15T22:49:51.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.431+0000 7f31a16e8740 1 client.16443 shutdown 2024-09-15T22:49:51.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 msgr2=0x5561085c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085c9c60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f31940345f0 tx=0x7f3194035f40 comp rx=0 tx=0).stop 2024-09-15T22:49:51.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 shutdown_connections 2024-09-15T22:49:51.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55610865e960 0x556108660da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561085c1370 0x5561085bb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5561085b7b40 0x5561085bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 --2- 172.21.15.66:0/2913884393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561085b2f20 0x5561085c9c60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 >> 172.21.15.66:0/2913884393 conn(0x55610857f310 msgr2=0x5561085bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f3180ff9640 0 client.16443 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:49:51.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 shutdown_connections 2024-09-15T22:49:51.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 1 -- 172.21.15.66:0/2913884393 wait complete. 2024-09-15T22:49:51.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.435+0000 7f31a16e8740 20 client.16443 trim_cache size 0 max 16384 2024-09-15T22:49:51.446 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:49:51.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.442+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 msgr2=0x7f31840a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.442+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 0x7f31840a5aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31980734e0 tx=0x7f319000a040 comp rx=0 tx=0).stop 2024-09-15T22:49:51.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.442+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 msgr2=0x7f3198118980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:51.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.442+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f318800b470 tx=0x7f318800b930 comp rx=0 tx=0).stop 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 shutdown_connections 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31840a35e0 0x7f31840a5aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f319810ea80 0x7f3198118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3198109e00 0x7f3198118980 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 --2- 172.21.15.66:0/1226478540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3198109450 0x7f319811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.443+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 >> 172.21.15.66:0/1226478540 conn(0x7f319806e2d0 msgr2=0x7f319810c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.444+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 shutdown_connections 2024-09-15T22:49:51.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:51.444+0000 7f319f30f640 1 -- 172.21.15.66:0/1226478540 wait complete. 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:52.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:49:53.079 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:53 smithi066 ceph-mon[31185]: pgmap v138: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 542 op/s 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.293+0000 7fc8d47d2640 1 -- 172.21.15.66:0/2085545661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc108450 msgr2=0x7fc8cc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.293+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/2085545661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc108450 0x7fc8cc108830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009860 tx=0x7fc8c402a360 comp rx=0 tx=0).stop 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 -- 172.21.15.66:0/2085545661 shutdown_connections 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/2085545661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc10d530 0x7fc8cc1150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/2085545661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/2085545661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc108450 0x7fc8cc108830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 -- 172.21.15.66:0/2085545661 >> 172.21.15.66:0/2085545661 conn(0x7fc8cc077ba0 msgr2=0x7fc8cc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 -- 172.21.15.66:0/2085545661 shutdown_connections 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.294+0000 7fc8d47d2640 1 -- 172.21.15.66:0/2085545661 wait complete. 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.295+0000 7fc8d47d2640 1 Processor -- start 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.295+0000 7fc8d47d2640 1 -- start start 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.296+0000 7fc8d47d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.296+0000 7fc8d47d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.297+0000 7fc8d256e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.297+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.297+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54666/0 (socket says 172.21.15.66:54666) 2024-09-15T22:49:53.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.298+0000 7fc8d256e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54874/0 (socket says 172.21.15.66:54874) 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.299+0000 7fc8d47d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc10d530 0x7fc8cc19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.299+0000 7fc8d47d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc118620 con 0x7fc8cc108e00 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.299+0000 7fc8d47d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1184a0 con 0x7fc8cc10d530 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.299+0000 7fc8d47d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1187a0 con 0x7fc8cc108450 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.299+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/3958072832 learned_addr learned my addr 172.21.15.66:0/3958072832 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/3958072832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 msgr2=0x7fc8cc1a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/3958072832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc10d530 msgr2=0x7fc8cc19e910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc10d530 0x7fc8cc19e910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/3958072832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc19f0e0 con 0x7fc8cc108e00 2024-09-15T22:49:53.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.301+0000 7fc8d256e640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-15T22:49:53.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.302+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800efb0 tx=0x7fc8c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.305+0000 7fc8c37fe640 1 -- 172.21.15.66:0/3958072832 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c801b070 con 0x7fc8cc108e00 2024-09-15T22:49:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.305+0000 7fc8c37fe640 1 -- 172.21.15.66:0/3958072832 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c800ba50 con 0x7fc8cc108e00 2024-09-15T22:49:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.305+0000 7fc8c37fe640 1 -- 172.21.15.66:0/3958072832 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8016c70 con 0x7fc8cc108e00 2024-09-15T22:49:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.307+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc19f3d0 con 0x7fc8cc108e00 2024-09-15T22:49:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.307+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc1ab620 con 0x7fc8cc108e00 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.310+0000 7fc8d6bab740 1 Processor -- start 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.310+0000 7fc8d6bab740 1 -- start start 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805620 0x55697b805a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b821410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55697b76b2a0 con 0x55697b805620 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55697b712b10 con 0x55697b821950 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55697b767260 con 0x55697b805f40 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53040/0 (socket says 172.21.15.66:53040) 2024-09-15T22:49:53.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.311+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/2944795251 learned_addr learned my addr 172.21.15.66:0/2944795251 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/2944795251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 msgr2=0x55697b821410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b821410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/2944795251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805620 msgr2=0x55697b805a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805620 0x55697b805a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/2944795251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55697b4dcb90 con 0x55697b821950 2024-09-15T22:49:53.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8c37fe640 1 -- 172.21.15.66:0/3958072832 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc8c800bc00 con 0x7fc8cc108e00 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.316+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80f6a10 tx=0x7fc8c80fa140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a751b9fcafceb14e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.318+0000 7fc8c37fe640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 0x7fc8b80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.318+0000 7fc8c0ff9640 1 -- 172.21.15.66:0/2944795251 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8100070 con 0x55697b821950 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.318+0000 7fc8c0ff9640 1 -- 172.21.15.66:0/2944795251 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c80fae10 con 0x55697b821950 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.318+0000 7fc8c37fe640 1 -- 172.21.15.66:0/3958072832 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc8c8047040 con 0x7fc8cc108e00 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 -- 172.21.15.66:0/2944795251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 msgr2=0x55697b823d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80f6a10 tx=0x7fc8c80fa140 comp rx=0 tx=0).stop 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 -- 172.21.15.66:0/2944795251 shutdown_connections 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b823d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b821410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/2944795251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805620 0x55697b805a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.319+0000 7fc8d6bab740 1 -- 172.21.15.66:0/2944795251 >> 172.21.15.66:0/2944795251 conn(0x55697b801cf0 msgr2=0x55697b8020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.322+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 0x7fc8b80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.322+0000 7fc8d6bab740 1 -- 172.21.15.66:0/2944795251 shutdown_connections 2024-09-15T22:49:53.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.322+0000 7fc8d6bab740 1 -- 172.21.15.66:0/2944795251 wait complete. 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 0x7fc8b80a5a80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009610 tx=0x7fc8bc006c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 -- start start 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 Processor -- start 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805f40 0x55697b812fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55697b808460 con 0x55697b805f40 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55697b6f36e0 con 0x55697b821950 2024-09-15T22:49:53.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55697b8085e0 con 0x55697b805620 2024-09-15T22:49:53.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.323+0000 7fc8d6bab740 10 client.0 _ll_register_callbacks cb 0x55697b717a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.327+0000 7fc8d256e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.327+0000 7fc8d2d6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.327+0000 7fc8d2d6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53042/0 (socket says 172.21.15.66:53042) 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.327+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/779525572 learned_addr learned my addr 172.21.15.66:0/779525572 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805f40 0x55697b812fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/779525572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 msgr2=0x55697b812a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/779525572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805f40 msgr2=0x55697b812fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805f40 0x55697b812fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.328+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/779525572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55697b80e590 con 0x55697b821950 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.329+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013e60 tx=0x7fc8bc004810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=201c448dbf40dda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.329+0000 7fc8b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:49:53.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.330+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc01d5f0 con 0x55697b821950 2024-09-15T22:49:53.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.330+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc8bc01d790 con 0x55697b821950 2024-09-15T22:49:53.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.335+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c80fae10 con 0x55697b821950 2024-09-15T22:49:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.335+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc01d990 con 0x55697b821950 2024-09-15T22:49:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.337+0000 7fc8d6bab740 10 client.25982 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:53.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.337+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55697b81c990 con 0x55697b821950 2024-09-15T22:49:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.340+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c80fae10 con 0x55697b821950 2024-09-15T22:49:53.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.340+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fc8bc012070 con 0x55697b821950 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 10 client.25982 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 10 client.25982 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 20 client.25982 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b81ddf0 0x55697b820220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 4 client.25982 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:53.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.342+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55697b7789d0 con 0x55697b81ddf0 2024-09-15T22:49:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.343+0000 7fc8d256e640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b81ddf0 0x55697b820220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.345+0000 7fc8d256e640 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b81ddf0 0x55697b820220 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f4a69ee9fee281 server_cookie=1916f91f821f7cfe in_seq=0 out_seq=0 2024-09-15T22:49:53.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.345+0000 7fc8b5ffb640 10 client.25982 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:53 smithi087 ceph-mon[35290]: pgmap v138: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 542 op/s 2024-09-15T22:49:53.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.348+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/779525572 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55697b7789d0 con 0x55697b81ddf0 2024-09-15T22:49:53.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.348+0000 7fc8b5ffb640 10 client.25982 handle_command_reply: tid=0 2024-09-15T22:49:53.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.350+0000 7fc8d6bab740 1 client.25982 shutdown 2024-09-15T22:49:53.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 msgr2=0x55697b80ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013e60 tx=0x7fc8bc004810 comp rx=0 tx=0).stop 2024-09-15T22:49:53.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 shutdown_connections 2024-09-15T22:49:53.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b81ddf0 0x55697b820220 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b821950 0x55697b80ddb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b805f40 0x55697b812fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/779525572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 >> 172.21.15.66:0/779525572 conn(0x55697b801cf0 msgr2=0x55697b807a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.354+0000 7fc8b5ffb640 0 client.25982 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.355+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 shutdown_connections 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.355+0000 7fc8d6bab740 1 -- 172.21.15.66:0/779525572 wait complete. 2024-09-15T22:49:53.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.355+0000 7fc8d6bab740 20 client.25982 trim_cache size 0 max 16384 2024-09-15T22:49:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:53.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.410+0000 7fc8d6bab740 1 Processor -- start 2024-09-15T22:49:53.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.414+0000 7fc8d6bab740 1 -- start start 2024-09-15T22:49:53.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.414+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.414+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 0x55697b8211f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.414+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b83a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06d5c0 con 0x55697b821950 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 0x55697b8211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06f1c0 con 0x55697b805f40 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06dc90 con 0x55697b805620 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 0x55697b8211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53054/0 (socket says 172.21.15.66:53054) 2024-09-15T22:49:53.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d1d6d640 1 -- 172.21.15.66:0/3080080720 learned_addr learned my addr 172.21.15.66:0/3080080720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d256e640 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b83a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/3080080720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 msgr2=0x55697b812f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/3080080720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 msgr2=0x55697b8211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 0x55697b8211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.415+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/3080080720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55697b806bd0 con 0x55697b821950 2024-09-15T22:49:53.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.416+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b83a320 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013e30 tx=0x7fc8bc012260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d5cf85e700f8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.418+0000 7fc8b7fff640 1 -- 172.21.15.66:0/3080080720 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc01c790 con 0x55697b821950 2024-09-15T22:49:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:53 smithi184 ceph-mon[35203]: pgmap v138: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 542 op/s 2024-09-15T22:49:53.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.422+0000 7fc8b7fff640 1 -- 172.21.15.66:0/3080080720 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc022070 con 0x55697b821950 2024-09-15T22:49:53.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.422+0000 7fc8b7fff640 1 -- 172.21.15.66:0/3080080720 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc01cd60 con 0x55697b821950 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 -- 172.21.15.66:0/3080080720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 msgr2=0x55697b83a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b83a320 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc013e30 tx=0x7fc8bc012260 comp rx=0 tx=0).stop 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 -- 172.21.15.66:0/3080080720 shutdown_connections 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b83a320 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805f40 0x55697b8211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/3080080720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805620 0x55697b812f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.423+0000 7fc8d6bab740 1 -- 172.21.15.66:0/3080080720 >> 172.21.15.66:0/3080080720 conn(0x55697b801cf0 msgr2=0x55697b820ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.429+0000 7fc8d6bab740 1 -- 172.21.15.66:0/3080080720 shutdown_connections 2024-09-15T22:49:53.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.429+0000 7fc8d6bab740 1 -- 172.21.15.66:0/3080080720 wait complete. 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.429+0000 7fc8d6bab740 1 -- start start 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 Processor -- start 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805620 0x55697b819d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b8150c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06eaf0 con 0x55697b821950 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06e360 con 0x55697b805620 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc082b20 con 0x55697b805f40 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.430+0000 7fc8d6bab740 10 client.0 _ll_register_callbacks cb 0x7fc8bc013ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.431+0000 7fc8d2d6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.431+0000 7fc8d2d6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54716/0 (socket says 172.21.15.66:54716) 2024-09-15T22:49:53.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.431+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/1669598412 learned_addr learned my addr 172.21.15.66:0/1669598412 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:53.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.431+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/1669598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 msgr2=0x55697b8150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.431+0000 7fc8d1d6d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b8150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.433+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b8150c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.433+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805620 msgr2=0x55697b819d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:53.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.433+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805620 0x55697b819d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.433+0000 7fc8d2d6f640 1 -- 172.21.15.66:0/1669598412 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55697b815b40 con 0x55697b821950 2024-09-15T22:49:53.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.433+0000 7fc8d1d6d640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b8150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:49:53.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.435+0000 7fc8d2d6f640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009ea0 tx=0x7fc8bc0122d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c27e72c6ed5ed14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.435+0000 7fc8b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:49:53.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.436+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc03f060 con 0x55697b821950 2024-09-15T22:49:53.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.436+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc022070 con 0x55697b821950 2024-09-15T22:49:53.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.437+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc8bc027860 con 0x55697b821950 2024-09-15T22:49:53.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.437+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc027a80 con 0x55697b821950 2024-09-15T22:49:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.440+0000 7fc8d6bab740 10 client.16458 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.440+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55697b89cfe0 con 0x55697b821950 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.442+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc022070 con 0x55697b821950 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fc8bc02f070 con 0x55697b821950 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 10 client.16458 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 10 client.16458 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 20 client.16458 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b89d660 0x55697b89fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 4 client.16458 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.8, "await_for": 45.0}] 2024-09-15T22:49:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.443+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.8, "await_for": 45.0}) -- 0x55697b772d20 con 0x55697b89d660 2024-09-15T22:49:53.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.445+0000 7fc8d256e640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b89d660 0x55697b89fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.450+0000 7fc8d256e640 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b89d660 0x55697b89fa50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39f665b9d76bb9 server_cookie=5cafe7aece68eb42 in_seq=0 out_seq=0 2024-09-15T22:49:53.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:53.450+0000 7fc8b5ffb640 10 client.16458 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.148+0000 7f88371a2640 1 -- 172.21.15.66:0/851563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 msgr2=0x7f88301124b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.148+0000 7f88371a2640 1 --2- 172.21.15.66:0/851563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8820009860 tx=0x7f882002a3d0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.150+0000 7f88371a2640 1 -- 172.21.15.66:0/851563 shutdown_connections 2024-09-15T22:49:54.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.150+0000 7f88371a2640 1 --2- 172.21.15.66:0/851563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88301129f0 0x7f8830114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.150+0000 7f88371a2640 1 --2- 172.21.15.66:0/851563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.150+0000 7f88371a2640 1 --2- 172.21.15.66:0/851563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8830074590 0x7f8830074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.150+0000 7f88371a2640 1 -- 172.21.15.66:0/851563 >> 172.21.15.66:0/851563 conn(0x7f88300fd700 msgr2=0x7f88300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.155+0000 7f88371a2640 1 -- 172.21.15.66:0/851563 shutdown_connections 2024-09-15T22:49:54.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.156+0000 7f88371a2640 1 -- 172.21.15.66:0/851563 wait complete. 2024-09-15T22:49:54.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.156+0000 7f88371a2640 1 Processor -- start 2024-09-15T22:49:54.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 -- start start 2024-09-15T22:49:54.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 0x7f8830111f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88301129f0 0x7f883010b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8830118550 con 0x7f88301129f0 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f88301183d0 con 0x7f8830074590 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88371a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88301186d0 con 0x7f8830074eb0 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f883599f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f883599f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54938/0 (socket says 172.21.15.66:54938) 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f883599f640 1 -- 172.21.15.66:0/1577405063 learned_addr learned my addr 172.21.15.66:0/1577405063 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.161+0000 7f88361a0640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 0x7f8830111f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 -- 172.21.15.66:0/1577405063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 msgr2=0x7f88301124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 -- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88301129f0 msgr2=0x7f883010b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88301129f0 0x7f883010b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 -- 172.21.15.66:0/1577405063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883010ba90 con 0x7f8830074590 2024-09-15T22:49:54.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88361a0640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 0x7f8830111f60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f882800ed70 tx=0x7f882800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.162+0000 7f88277fe640 1 -- 172.21.15.66:0/1577405063 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882801c070 con 0x7f8830074590 2024-09-15T22:49:54.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.163+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883010bd80 con 0x7f8830074590 2024-09-15T22:49:54.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.163+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883010fda0 con 0x7f8830074590 2024-09-15T22:49:54.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.163+0000 7f88277fe640 1 -- 172.21.15.66:0/1577405063 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8828017b20 con 0x7f8830074590 2024-09-15T22:49:54.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.165+0000 7f88277fe640 1 -- 172.21.15.66:0/1577405063 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882800fc20 con 0x7f8830074590 2024-09-15T22:49:54.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.169+0000 7f883a7dd740 1 Processor -- start 2024-09-15T22:49:54.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.169+0000 7f88277fe640 1 -- 172.21.15.66:0/1577405063 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f882801f060 con 0x7f8830074590 2024-09-15T22:49:54.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.170+0000 7f88277fe640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 0x7f881c0a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.171+0000 7f88277fe640 1 -- 172.21.15.66:0/1577405063 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f88280cff40 con 0x7f8830074590 2024-09-15T22:49:54.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.171+0000 7f88369a1640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 0x7f881c0a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 -- start start 2024-09-15T22:49:54.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159faed20 0x55b159fad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fadbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b159f132f0 con 0x55b159fb8550 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b159ebacf0 con 0x55b159fad7b0 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.172+0000 7f883a7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b159f0f2b0 con 0x55b159faed20 2024-09-15T22:49:54.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.173+0000 7f88369a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.173+0000 7f88369a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54728/0 (socket says 172.21.15.66:54728) 2024-09-15T22:49:54.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.173+0000 7f88369a1640 1 -- 172.21.15.66:0/1365768762 learned_addr learned my addr 172.21.15.66:0/1365768762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:54.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.173+0000 7f88361a0640 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159faed20 0x55b159fad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.174+0000 7f883599f640 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fadbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.175+0000 7f88369a1640 1 -- 172.21.15.66:0/1365768762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159faed20 msgr2=0x55b159fad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.175+0000 7f88369a1640 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159faed20 0x55b159fad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.175+0000 7f88369a1640 1 -- 172.21.15.66:0/1365768762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 msgr2=0x55b159fadbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.175+0000 7f88369a1640 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fadbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.175+0000 7f88369a1640 1 -- 172.21.15.66:0/1365768762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159e9f3a0 con 0x55b159fb8550 2024-09-15T22:49:54.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.176+0000 7f88369a1640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 0x7f881c0a58a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f882c014770 tx=0x7f882c00b920 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.176+0000 7f88369a1640 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f882c0058c0 tx=0x7f882c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bca3b13a4c95ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.178+0000 7f8824dea640 1 -- 172.21.15.66:0/1365768762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c012df0 con 0x55b159fb8550 2024-09-15T22:49:54.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.178+0000 7f8824dea640 1 -- 172.21.15.66:0/1365768762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c024070 con 0x55b159fb8550 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.178+0000 7f8824dea640 1 -- 172.21.15.66:0/1365768762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c01f9e0 con 0x55b159fb8550 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.179+0000 7f883a7dd740 1 -- 172.21.15.66:0/1365768762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 msgr2=0x55b159fba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.179+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f882c0058c0 tx=0x7f882c019000 comp rx=0 tx=0).stop 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.180+0000 7f883a7dd740 1 -- 172.21.15.66:0/1365768762 shutdown_connections 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.180+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fb8550 0x55b159fba940 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.180+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fadbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.180+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1365768762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159faed20 0x55b159fad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.180+0000 7f883a7dd740 1 -- 172.21.15.66:0/1365768762 >> 172.21.15.66:0/1365768762 conn(0x55b159f76310 msgr2=0x55b159fa9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.184+0000 7f883a7dd740 1 -- 172.21.15.66:0/1365768762 shutdown_connections 2024-09-15T22:49:54.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.184+0000 7f883a7dd740 1 -- 172.21.15.66:0/1365768762 wait complete. 2024-09-15T22:49:54.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.184+0000 7f883a7dd740 1 -- start start 2024-09-15T22:49:54.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.185+0000 7f883a7dd740 1 Processor -- start 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159faed20 0x55b159fb51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b159fbb1f0 con 0x55b159faed20 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b159ece060 con 0x55b159fad7b0 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b159fbb370 con 0x55b159fb8550 2024-09-15T22:49:54.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.187+0000 7f883a7dd740 10 client.0 _ll_register_callbacks cb 0x55b159c218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.188+0000 7f88369a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.188+0000 7f88369a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54968/0 (socket says 172.21.15.66:54968) 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.188+0000 7f88369a1640 1 -- 172.21.15.66:0/1930305268 learned_addr learned my addr 172.21.15.66:0/1930305268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f883599f640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159faed20 0x55b159fb51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f88369a1640 1 -- 172.21.15.66:0/1930305268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 msgr2=0x55b159fb7f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:54.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f88369a1640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fb7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f88369a1640 1 -- 172.21.15.66:0/1930305268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159faed20 msgr2=0x55b159fb51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f88369a1640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159faed20 0x55b159fb51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.189+0000 7f88369a1640 1 -- 172.21.15.66:0/1930305268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b159c843c0 con 0x55b159fb8550 2024-09-15T22:49:54.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.191+0000 7f88369a1640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b7b0 tx=0x7f882c005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4f682abd4380aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.191+0000 7f8819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:54.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.191+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c01fa70 con 0x55b159fb8550 2024-09-15T22:49:54.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.192+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f882c024070 con 0x55b159fb8550 2024-09-15T22:49:54.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.192+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f882c00f6d0 con 0x55b159fb8550 2024-09-15T22:49:54.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.193+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f882c03b050 con 0x55b159fb8550 2024-09-15T22:49:54.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.195+0000 7f883a7dd740 10 client.25975 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:54.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.195+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b159fd7d30 con 0x55b159fb8550 2024-09-15T22:49:54.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.196+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f882c024070 con 0x55b159fb8550 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f882c01fce0 con 0x55b159fb8550 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 10 client.25975 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 10 client.25975 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 20 client.25975 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b159fdb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 4 client.25975 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:54.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.197+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b159f20860 con 0x55b159fd9140 2024-09-15T22:49:54.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.198+0000 7f88361a0640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b159fdb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.204+0000 7f88361a0640 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b159fdb530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4db45a09c036398c server_cookie=e537bd6d480f45c3 in_seq=0 out_seq=0 2024-09-15T22:49:54.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.204+0000 7f8819ffb640 10 client.25975 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:49:54.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.209+0000 7f8819ffb640 1 -- 172.21.15.66:0/1930305268 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b159f20860 con 0x55b159fd9140 2024-09-15T22:49:54.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.209+0000 7f8819ffb640 10 client.25975 handle_command_reply: tid=0 2024-09-15T22:49:54.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.213+0000 7f883a7dd740 1 client.25975 shutdown 2024-09-15T22:49:54.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.214+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 msgr2=0x55b159fb57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.214+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b7b0 tx=0x7f882c005850 comp rx=0 tx=0).stop 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 shutdown_connections 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b159fdb530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb57e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f8819ffb640 0 client.25975 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159faed20 0x55b159fb51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1930305268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159fad7b0 0x55b159fb7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 >> 172.21.15.66:0/1930305268 conn(0x55b159f76310 msgr2=0x55b159fafb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 shutdown_connections 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 1 -- 172.21.15.66:0/1930305268 wait complete. 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.215+0000 7f883a7dd740 20 client.25975 trim_cache size 0 max 16384 2024-09-15T22:49:54.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.249+0000 7f883a7dd740 1 Processor -- start 2024-09-15T22:49:54.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.249+0000 7f883a7dd740 1 -- start start 2024-09-15T22:49:54.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.249+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fa9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883a7dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f881400feb0 con 0x55b159fad7b0 2024-09-15T22:49:54.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883599f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883599f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53102/0 (socket says 172.21.15.66:53102) 2024-09-15T22:49:54.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883599f640 1 -- 172.21.15.66:0/1396404300 learned_addr learned my addr 172.21.15.66:0/1396404300 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:54.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8814011ab0 con 0x55b159faed20 2024-09-15T22:49:54.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.250+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8814010580 con 0x55b159fb8550 2024-09-15T22:49:54.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.252+0000 7f883599f640 1 -- 172.21.15.66:0/1396404300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 msgr2=0x55b159fb0300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:49:54.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.252+0000 7f883599f640 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb0300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.252+0000 7f883599f640 1 -- 172.21.15.66:0/1396404300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 msgr2=0x55b159fa9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.252+0000 7f883599f640 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fa9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.252+0000 7f883599f640 1 -- 172.21.15.66:0/1396404300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159fad4b0 con 0x55b159faed20 2024-09-15T22:49:54.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.254+0000 7f883599f640 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f882002a9c0 tx=0x7f8820030bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b1a959b907d133 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.256+0000 7f881bfff640 1 -- 172.21.15.66:0/1396404300 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820030ce0 con 0x55b159faed20 2024-09-15T22:49:54.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.256+0000 7f881bfff640 1 -- 172.21.15.66:0/1396404300 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8820030e80 con 0x55b159faed20 2024-09-15T22:49:54.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 msgr2=0x55b159fa4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f882002a9c0 tx=0x7f8820030bf0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 shutdown_connections 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fa4b90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 --2- 172.21.15.66:0/1396404300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fa9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.257+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 >> 172.21.15.66:0/1396404300 conn(0x55b159f76310 msgr2=0x55b159fa98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.258+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 shutdown_connections 2024-09-15T22:49:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.258+0000 7f883a7dd740 1 -- 172.21.15.66:0/1396404300 wait complete. 2024-09-15T22:49:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 -- start start 2024-09-15T22:49:54.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 Processor -- start 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fc0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fb1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88140113e0 con 0x55b159fad7b0 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8814010c50 con 0x55b159faed20 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f881400df40 con 0x55b159fb8550 2024-09-15T22:49:54.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.259+0000 7f883a7dd740 10 client.0 _ll_register_callbacks cb 0x7f88280981a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.260+0000 7f88369a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f883599f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fb1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54984/0 (socket says 172.21.15.66:54984) 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 -- 172.21.15.66:0/3785439551 learned_addr learned my addr 172.21.15.66:0/3785439551 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 -- 172.21.15.66:0/3785439551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 msgr2=0x55b159fb1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fb1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 -- 172.21.15.66:0/3785439551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 msgr2=0x55b159fc0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:54.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fc0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.261+0000 7f88369a1640 1 -- 172.21.15.66:0/3785439551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b159fb2af0 con 0x55b159fb8550 2024-09-15T22:49:54.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.262+0000 7f88369a1640 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f882c01f630 tx=0x7f882c031f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b102e4bca5e556bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.265+0000 7f8819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:49:54.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.265+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c00bdf0 con 0x55b159fb8550 2024-09-15T22:49:54.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.265+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b159f1ad70 con 0x55b159fb8550 2024-09-15T22:49:54.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.265+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f882c030420 con 0x55b159fb8550 2024-09-15T22:49:54.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.266+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f882c030660 con 0x55b159fb8550 2024-09-15T22:49:54.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.266+0000 7f883a7dd740 10 client.25978 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:54.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.266+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b15a043b90 con 0x55b159fb8550 2024-09-15T22:49:54.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b159f1ad70 con 0x55b159fb8550 2024-09-15T22:49:54.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f882c00faa0 con 0x55b159fb8550 2024-09-15T22:49:54.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 10 client.25978 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:54.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 10 client.25978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:49:54.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 20 client.25978 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:54.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b15a046430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 4 client.25978 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:49:54.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.267+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b159e97170 con 0x55b159fd9140 2024-09-15T22:49:54.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.270+0000 7f88361a0640 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b15a046430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.279+0000 7f88361a0640 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b15a046430 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=334f520debeb99fa server_cookie=4994bd5b61e5e106 in_seq=0 out_seq=0 2024-09-15T22:49:54.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.279+0000 7f8819ffb640 10 client.25978 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:49:54.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.280+0000 7f8819ffb640 1 -- 172.21.15.66:0/3785439551 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b159e97170 con 0x55b159fd9140 2024-09-15T22:49:54.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.280+0000 7f8819ffb640 10 client.25978 handle_command_reply: tid=0 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 client.25978 shutdown 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 msgr2=0x55b159fb2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f882c01f630 tx=0x7f882c031f80 comp rx=0 tx=0).stop 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 shutdown_connections 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b159fd9140 0x55b15a046430 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b159fb8550 0x55b159fb2400 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b159faed20 0x55b159fb1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 --2- 172.21.15.66:0/3785439551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b159fad7b0 0x55b159fc0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 >> 172.21.15.66:0/3785439551 conn(0x55b159f76310 msgr2=0x55b159fb6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f8819ffb640 0 client.25978 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 shutdown_connections 2024-09-15T22:49:54.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.281+0000 7f883a7dd740 1 -- 172.21.15.66:0/3785439551 wait complete. 2024-09-15T22:49:54.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.284+0000 7f883a7dd740 20 client.25978 trim_cache size 0 max 16384 2024-09-15T22:49:54.288 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:49:54.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 msgr2=0x7f881c0a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 0x7f881c0a58a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f882c014770 tx=0x7f882c00b920 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 msgr2=0x7f8830111f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 0x7f8830111f60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f882800ed70 tx=0x7f882800c6e0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 shutdown_connections 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f881c0a33e0 0x7f881c0a58a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88301129f0 0x7f883010b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8830074eb0 0x7f88301124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 --2- 172.21.15.66:0/1577405063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8830074590 0x7f8830111f60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 >> 172.21.15.66:0/1577405063 conn(0x7f88300fd700 msgr2=0x7f88300fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 shutdown_connections 2024-09-15T22:49:54.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:54.287+0000 7f88371a2640 1 -- 172.21.15.66:0/1577405063 wait complete. 2024-09-15T22:49:54.583 INFO:tasks.workunit.client.0.smithi066.stdout: 327 1295938 769 836182 732 319149 1341 2024-09-15T22:49:55.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:49:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:55 smithi087 ceph-mon[35290]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 820 op/s 2024-09-15T22:49:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:55 smithi184 ceph-mon[35203]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 820 op/s 2024-09-15T22:49:55.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:55 smithi066 ceph-mon[31185]: pgmap v139: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 820 op/s 2024-09-15T22:49:55.584 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:56.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 -- 172.21.15.66:0/3554045529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74103740 msgr2=0x7efe74107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 --2- 172.21.15.66:0/3554045529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74103740 0x7efe74107b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009930 tx=0x7efe5c02a420 comp rx=0 tx=0).stop 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 -- 172.21.15.66:0/3554045529 shutdown_connections 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 --2- 172.21.15.66:0/3554045529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74108290 0x7efe7410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 --2- 172.21.15.66:0/3554045529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74103740 0x7efe74107b80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 --2- 172.21.15.66:0/3554045529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe74103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 -- 172.21.15.66:0/3554045529 >> 172.21.15.66:0/3554045529 conn(0x7efe740fc7d0 msgr2=0x7efe740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 -- 172.21.15.66:0/3554045529 shutdown_connections 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.728+0000 7efe7af1e640 1 -- 172.21.15.66:0/3554045529 wait complete. 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 Processor -- start 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 -- start start 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe741009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74103740 0x7efe74100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe74112090 con 0x7efe74108290 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe74111f10 con 0x7efe74102d90 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe7af1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe74112210 con 0x7efe74103740 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe794bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe78cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe741009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe78cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe741009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53120/0 (socket says 172.21.15.66:53120) 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe794bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54764/0 (socket says 172.21.15.66:54764) 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe78cba640 1 -- 172.21.15.66:0/4179383615 learned_addr learned my addr 172.21.15.66:0/4179383615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe73fff640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74103740 0x7efe74100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe794bb640 1 -- 172.21.15.66:0/4179383615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74103740 msgr2=0x7efe74100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.729+0000 7efe794bb640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74103740 0x7efe74100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe794bb640 1 -- 172.21.15.66:0/4179383615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 msgr2=0x7efe741009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe794bb640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe741009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe794bb640 1 -- 172.21.15.66:0/4179383615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe741a6b30 con 0x7efe74108290 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe794bb640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00da10 tx=0x7efe6c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe71ffb640 1 -- 172.21.15.66:0/4179383615 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00bd70 con 0x7efe74108290 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe71ffb640 1 -- 172.21.15.66:0/4179383615 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe6c003e50 con 0x7efe74108290 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe71ffb640 1 -- 172.21.15.66:0/4179383615 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0106a0 con 0x7efe74108290 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe741a6e20 con 0x7efe74108290 2024-09-15T22:49:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.730+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe741a72e0 con 0x7efe74108290 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe7d2f7740 1 Processor -- start 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe71ffb640 1 -- 172.21.15.66:0/4179383615 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efe6c003970 con 0x7efe74108290 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe7d2f7740 1 -- start start 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x56532253a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.733+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322547760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5653224a02f0 con 0x56532253bb40 2024-09-15T22:49:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x565322447cf0 con 0x56532253a5d0 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56532249c2b0 con 0x565322545370 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53132/0 (socket says 172.21.15.66:53132) 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x56532253a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 -- 172.21.15.66:0/3890016414 learned_addr learned my addr 172.21.15.66:0/3890016414 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe73fff640 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322547760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 -- 172.21.15.66:0/3890016414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 msgr2=0x565322547760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322547760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 -- 172.21.15.66:0/3890016414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 msgr2=0x56532253a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x56532253a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 -- 172.21.15.66:0/3890016414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532242c3a0 con 0x56532253a5d0 2024-09-15T22:49:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe71ffb640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 0x7efe600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe78cba640 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b7e0 tx=0x7efe6400bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d2135b06a4809b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.734+0000 7efe73fff640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 0x7efe600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.735+0000 7efe71ffb640 1 -- 172.21.15.66:0/4179383615 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efe6c0d03e0 con 0x7efe74108290 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.735+0000 7efe6affd640 1 -- 172.21.15.66:0/3890016414 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe64003dd0 con 0x56532253a5d0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.735+0000 7efe6affd640 1 -- 172.21.15.66:0/3890016414 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe64015070 con 0x56532253a5d0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.735+0000 7efe6affd640 1 -- 172.21.15.66:0/3890016414 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe640106a0 con 0x56532253a5d0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3890016414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 msgr2=0x56532253aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b7e0 tx=0x7efe6400bbe0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe73fff640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 0x7efe600a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe5c004770 tx=0x7efe5c000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3890016414 shutdown_connections 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322547760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x56532253aa10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3890016414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x56532253a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3890016414 >> 172.21.15.66:0/3890016414 conn(0x565322503310 msgr2=0x565322536c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3890016414 shutdown_connections 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3890016414 wait complete. 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 -- start start 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.736+0000 7efe7d2f7740 1 Processor -- start 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 0x5653225425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5653225480c0 con 0x56532253bb40 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56532245b060 con 0x565322545370 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565322548240 con 0x56532253a5d0 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe7d2f7740 10 client.0 _ll_register_callbacks cb 0x5653221ae8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe78cba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 0x5653225425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe78cba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55008/0 (socket says 172.21.15.66:55008) 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54780/0 (socket says 172.21.15.66:54780) 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe78cba640 1 -- 172.21.15.66:0/1240433375 learned_addr learned my addr 172.21.15.66:0/1240433375 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 -- 172.21.15.66:0/1240433375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 msgr2=0x565322544d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 -- 172.21.15.66:0/1240433375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 msgr2=0x565322542000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe794bb640 1 -- 172.21.15.66:0/1240433375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653222113c0 con 0x565322545370 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe73fff640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.737+0000 7efe78cba640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe794bb640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 0x5653225425d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0cd760 tx=0x7efe6c09bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b38d282d226f4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0a4f60 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efe6c0042e0 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe64015070 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efe6c003c60 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 10 client.26006 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x565322553bf0 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe64015070 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efe6c024060 con 0x565322545370 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 10 client.26006 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 10 client.26006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 20 client.26006 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x565322555580 0x5653225579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 4 client.26006 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.738+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653224ad860 con 0x565322555580 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.739+0000 7efe78cba640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x565322555580 0x5653225579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.739+0000 7efe78cba640 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x565322555580 0x5653225579d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e775fb7647effa2 server_cookie=4735f0352f84615 in_seq=0 out_seq=0 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.739+0000 7efe53fff640 10 client.26006 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe53fff640 1 -- 172.21.15.66:0/1240433375 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653224ad860 con 0x565322555580 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe53fff640 10 client.26006 handle_command_reply: tid=0 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 client.26006 shutdown 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 msgr2=0x5653225425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 0x5653225425d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0cd760 tx=0x7efe6c09bd10 comp rx=0 tx=0).stop 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 shutdown_connections 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x565322555580 0x5653225579d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565322545370 0x5653225425d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x565322542000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/1240433375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56532253a5d0 0x565322544d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 >> 172.21.15.66:0/1240433375 conn(0x565322503310 msgr2=0x56532253c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe53fff640 0 client.26006 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 shutdown_connections 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 1 -- 172.21.15.66:0/1240433375 wait complete. 2024-09-15T22:49:56.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.741+0000 7efe7d2f7740 20 client.26006 trim_cache size 0 max 16384 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 Processor -- start 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 -- start start 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x565322551360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322540e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe741acf90 con 0x56532253bb40 2024-09-15T22:49:56.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe741aeb90 con 0x56532253a5d0 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ad660 con 0x565322545370 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54786/0 (socket says 172.21.15.66:54786) 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe73fff640 1 -- 172.21.15.66:0/333887081 learned_addr learned my addr 172.21.15.66:0/333887081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe78cba640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x565322551360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.755+0000 7efe794bb640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322540e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 -- 172.21.15.66:0/333887081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 msgr2=0x565322540e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322540e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 -- 172.21.15.66:0/333887081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 msgr2=0x565322551360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x565322551360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 -- 172.21.15.66:0/333887081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653225450c0 con 0x56532253bb40 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe78cba640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x565322551360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:56.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe73fff640 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009930 tx=0x7efe5c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c016b26123f7413 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe6a7fc640 1 -- 172.21.15.66:0/333887081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c044070 con 0x56532253bb40 2024-09-15T22:49:56.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe6a7fc640 1 -- 172.21.15.66:0/333887081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe5c050070 con 0x56532253bb40 2024-09-15T22:49:56.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.756+0000 7efe6a7fc640 1 -- 172.21.15.66:0/333887081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c035040 con 0x56532253bb40 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- 172.21.15.66:0/333887081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 msgr2=0x5653225408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009930 tx=0x7efe5c009260 comp rx=0 tx=0).stop 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- 172.21.15.66:0/333887081 shutdown_connections 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322540e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253bb40 0x5653225408d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/333887081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253a5d0 0x565322551360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- 172.21.15.66:0/333887081 >> 172.21.15.66:0/333887081 conn(0x565322503310 msgr2=0x565322541fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- 172.21.15.66:0/333887081 shutdown_connections 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- 172.21.15.66:0/333887081 wait complete. 2024-09-15T22:49:56.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.757+0000 7efe7d2f7740 1 -- start start 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 Processor -- start 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253a5d0 0x565322548490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322548f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ae4c0 con 0x56532253a5d0 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe741add30 con 0x56532253bb40 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe741aaf90 con 0x565322545370 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe7d2f7740 10 client.0 _ll_register_callbacks cb 0x7efe6c0045e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe78cba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253a5d0 0x565322548490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53166/0 (socket says 172.21.15.66:53166) 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe794bb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322548f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.758+0000 7efe73fff640 1 -- 172.21.15.66:0/3517014614 learned_addr learned my addr 172.21.15.66:0/3517014614 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 -- 172.21.15.66:0/3517014614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 msgr2=0x565322548f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322548f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 -- 172.21.15.66:0/3517014614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253a5d0 msgr2=0x565322548490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253a5d0 0x565322548490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 -- 172.21.15.66:0/3517014614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653225be270 con 0x56532253bb40 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe73fff640 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009230 tx=0x7efe5c009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b07995793aa4e22f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe53fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c035040 con 0x56532253bb40 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe5c050070 con 0x56532253bb40 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efe5c055890 con 0x56532253bb40 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efe5c044040 con 0x56532253bb40 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe7d2f7740 10 client.26012 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:56.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.759+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5653225bf490 con 0x56532253bb40 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe5c050070 con 0x56532253bb40 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efe5c06b780 con 0x56532253bb40 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 10 client.26012 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 10 client.26012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 20 client.26012 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5653225bfc20 0x5653225c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 4 client.26012 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653224a7d70 con 0x5653225bfc20 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.760+0000 7efe78cba640 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5653225bfc20 0x5653225c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.761+0000 7efe78cba640 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5653225bfc20 0x5653225c2040 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff7a86438c2df77 server_cookie=9b8c4547be0249e9 in_seq=0 out_seq=0 2024-09-15T22:49:56.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.761+0000 7efe53fff640 10 client.26012 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:56.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe53fff640 1 -- 172.21.15.66:0/3517014614 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653224a7d70 con 0x5653225bfc20 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe53fff640 10 client.26012 handle_command_reply: tid=0 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 client.26012 shutdown 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 msgr2=0x5653225489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009230 tx=0x7efe5c009620 comp rx=0 tx=0).stop 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 shutdown_connections 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565322545370 0x565322548f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5653225bfc20 0x5653225c2040 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56532253bb40 0x5653225489d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 --2- 172.21.15.66:0/3517014614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56532253a5d0 0x565322548490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe53fff640 0 client.26012 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 >> 172.21.15.66:0/3517014614 conn(0x565322503310 msgr2=0x565322536700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 shutdown_connections 2024-09-15T22:49:56.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 1 -- 172.21.15.66:0/3517014614 wait complete. 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.762+0000 7efe7d2f7740 20 client.26012 trim_cache size 0 max 16384 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 msgr2=0x7efe600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 0x7efe600a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe5c004770 tx=0x7efe5c000bc0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 msgr2=0x7efe74101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00da10 tx=0x7efe6c00ded0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 shutdown_connections 2024-09-15T22:49:56.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe600a33b0 0x7efe600a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe74108290 0x7efe74101470 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe74103740 0x7efe74100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 --2- 172.21.15.66:0/4179383615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe74102d90 0x7efe741009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.763+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 >> 172.21.15.66:0/4179383615 conn(0x7efe740fc7d0 msgr2=0x7efe74105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.764+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 shutdown_connections 2024-09-15T22:49:56.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:56.764+0000 7efe7af1e640 1 -- 172.21.15.66:0/4179383615 wait complete. 2024-09-15T22:49:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:57 smithi087 ceph-mon[35290]: pgmap v140: 129 pgs: 129 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 800 op/s 2024-09-15T22:49:57.367 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:57 smithi066 ceph-mon[31185]: pgmap v140: 129 pgs: 129 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 800 op/s 2024-09-15T22:49:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:57 smithi184 ceph-mon[35203]: pgmap v140: 129 pgs: 129 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 16 MiB/s wr, 800 op/s 2024-09-15T22:49:58.584 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:49:58.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:49:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:49:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:49:59 smithi087 ceph-mon[35290]: pgmap v141: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 19 MiB/s wr, 954 op/s 2024-09-15T22:49:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:49:59 smithi184 ceph-mon[35203]: pgmap v141: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 19 MiB/s wr, 954 op/s 2024-09-15T22:49:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:49:59 smithi066 ceph-mon[31185]: pgmap v141: 129 pgs: 129 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 19 MiB/s wr, 954 op/s 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 -- 172.21.15.66:0/991364351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114100aa0 msgr2=0x7f111410ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 --2- 172.21.15.66:0/991364351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114100aa0 0x7f111410ea20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f110c009ca0 tx=0x7f110c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 -- 172.21.15.66:0/991364351 shutdown_connections 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 --2- 172.21.15.66:0/991364351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114100aa0 0x7f111410ea20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 --2- 172.21.15.66:0/991364351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100100 0x7f1114100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 --2- 172.21.15.66:0/991364351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1114106b80 0x7f1114106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 -- 172.21.15.66:0/991364351 >> 172.21.15.66:0/991364351 conn(0x7f1114077230 msgr2=0x7f11140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 -- 172.21.15.66:0/991364351 shutdown_connections 2024-09-15T22:49:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 -- 172.21.15.66:0/991364351 wait complete. 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.854+0000 7f1119949640 1 Processor -- start 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 -- start start 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1114100100 0x7f11141012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1114112050 con 0x7f1114106b80 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1114111ed0 con 0x7f1114100aa0 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f1119949640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11141121d0 con 0x7f1114100100 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f110bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54808/0 (socket says 172.21.15.66:54808) 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f110bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53174/0 (socket says 172.21.15.66:53174) 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 -- 172.21.15.66:0/583150272 learned_addr learned my addr 172.21.15.66:0/583150272 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 -- 172.21.15.66:0/583150272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1114100100 msgr2=0x7f11141012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1114100100 0x7f11141012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 -- 172.21.15.66:0/583150272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 msgr2=0x7f1114101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f11137fe640 1 -- 172.21.15.66:0/583150272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11141a6910 con 0x7f1114106b80 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.855+0000 7f110bfff640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.856+0000 7f11137fe640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f110c0319f0 tx=0x7f110c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.856+0000 7f1118947640 1 -- 172.21.15.66:0/583150272 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c003b70 con 0x7f1114106b80 2024-09-15T22:49:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.856+0000 7f1118947640 1 -- 172.21.15.66:0/583150272 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c003d10 con 0x7f1114106b80 2024-09-15T22:49:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.856+0000 7f1118947640 1 -- 172.21.15.66:0/583150272 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c02fcb0 con 0x7f1114106b80 2024-09-15T22:49:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.856+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141a6ba0 con 0x7f1114106b80 2024-09-15T22:49:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.857+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141a7090 con 0x7f1114106b80 2024-09-15T22:49:59.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.860+0000 7f1118947640 1 -- 172.21.15.66:0/583150272 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f110c004050 con 0x7f1114106b80 2024-09-15T22:49:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 Processor -- start 2024-09-15T22:49:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 -- start start 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def23be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def251940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555def1a1280 con 0x555def24f550 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555def148b10 con 0x555def23c3a0 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f111bd22740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555def19d240 con 0x555def23ba80 2024-09-15T22:49:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53184/0 (socket says 172.21.15.66:53184) 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f1112ffd640 1 -- 172.21.15.66:0/561989684 learned_addr learned my addr 172.21.15.66:0/561989684 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f110bfff640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def251940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.861+0000 7f110bfff640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def23be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 -- 172.21.15.66:0/561989684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 msgr2=0x555def23be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def23be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1118947640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 0x7f11000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 -- 172.21.15.66:0/561989684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 msgr2=0x555def251940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def251940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 -- 172.21.15.66:0/561989684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555def1551f0 con 0x555def23c3a0 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f110bfff640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def251940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1112ffd640 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bc0 tx=0x7f110400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e767f0d51470014 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f11137fe640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 0x7f11000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1109ffb640 1 -- 172.21.15.66:0/561989684 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104005020 con 0x555def23c3a0 2024-09-15T22:49:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1109ffb640 1 -- 172.21.15.66:0/561989684 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11040047a0 con 0x555def23c3a0 2024-09-15T22:49:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1109ffb640 1 -- 172.21.15.66:0/561989684 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104010690 con 0x555def23c3a0 2024-09-15T22:49:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.862+0000 7f1118947640 1 -- 172.21.15.66:0/583150272 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f110c0f1040 con 0x7f1114106b80 2024-09-15T22:49:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.863+0000 7f11137fe640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 0x7f11000a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f110c0bd110 tx=0x7f110c088040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.863+0000 7f111bd22740 1 -- 172.21.15.66:0/561989684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 msgr2=0x555def24f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.863+0000 7f111bd22740 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bc0 tx=0x7f110400e720 comp rx=0 tx=0).stop 2024-09-15T22:49:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 -- 172.21.15.66:0/561989684 shutdown_connections 2024-09-15T22:49:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def251940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24f010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 --2- 172.21.15.66:0/561989684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def23be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 -- 172.21.15.66:0/561989684 >> 172.21.15.66:0/561989684 conn(0x555def2380f0 msgr2=0x555def2384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 -- 172.21.15.66:0/561989684 shutdown_connections 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.864+0000 7f111bd22740 1 -- 172.21.15.66:0/561989684 wait complete. 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.865+0000 7f111bd22740 1 -- start start 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.865+0000 7f111bd22740 1 Processor -- start 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.865+0000 7f111bd22740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def24c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def24cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555def2520c0 con 0x555def24f550 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555def15bf10 con 0x555def23c3a0 2024-09-15T22:49:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555def252240 con 0x555def23ba80 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f111bd22740 10 client.0 _ll_register_callbacks cb 0x555def124a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53192/0 (socket says 172.21.15.66:53192) 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 -- 172.21.15.66:0/3635800817 learned_addr learned my addr 172.21.15.66:0/3635800817 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f110bfff640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def24cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f110bfff640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def24c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 -- 172.21.15.66:0/3635800817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 msgr2=0x555def24c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def24c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 -- 172.21.15.66:0/3635800817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 msgr2=0x555def24cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def24cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.866+0000 7f1112ffd640 1 -- 172.21.15.66:0/3635800817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555deef126a0 con 0x555def23c3a0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1104005f80 tx=0x7f1104005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea5f4c1b03819359 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f10f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:49:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104026020 con 0x555def23c3a0 2024-09-15T22:49:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f11040051c0 con 0x555def23c3a0 2024-09-15T22:49:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11040047a0 con 0x555def23c3a0 2024-09-15T22:49:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1104031050 con 0x555def23c3a0 2024-09-15T22:49:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f111bd22740 10 client.26024 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555def25ddb0 con 0x555def23c3a0 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.867+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11040047a0 con 0x555def23c3a0 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f1104010430 con 0x555def23c3a0 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 10 client.26024 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 10 client.26024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 20 client.26024 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def25f100 0x555def2614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 4 client.26024 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555def1ae7f0 con 0x555def25f100 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.868+0000 7f110bfff640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def25f100 0x555def2614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.869+0000 7f10f2ffd640 10 client.26024 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:59.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.869+0000 7f110bfff640 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def25f100 0x555def2614f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea6433d7078495e server_cookie=e6f65f89561e77a5 in_seq=0 out_seq=0 2024-09-15T22:49:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3635800817 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555def1ae7f0 con 0x555def25f100 2024-09-15T22:49:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f10f2ffd640 10 client.26024 handle_command_reply: tid=0 2024-09-15T22:49:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 client.26024 shutdown 2024-09-15T22:49:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 msgr2=0x555def24c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1104005f80 tx=0x7f1104005fb0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 shutdown_connections 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def24f550 0x555def24cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def25f100 0x555def2614f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def24c9e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 --2- 172.21.15.66:0/3635800817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def24c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.873+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 >> 172.21.15.66:0/3635800817 conn(0x555def2380f0 msgr2=0x555def237270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.874+0000 7f10f2ffd640 0 client.26024 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.874+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 shutdown_connections 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.874+0000 7f111bd22740 1 -- 172.21.15.66:0/3635800817 wait complete. 2024-09-15T22:49:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.874+0000 7f111bd22740 20 client.26024 trim_cache size 0 max 16384 2024-09-15T22:49:59.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.902+0000 7f111bd22740 1 Processor -- start 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.902+0000 7f111bd22740 1 -- start start 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def266b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def24f550 0x555def267060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f11141acf50 con 0x555def23ba80 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11141aeb50 con 0x555def23c3a0 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f111bd22740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11141ad620 con 0x555def24f550 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54832/0 (socket says 172.21.15.66:54832) 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 -- 172.21.15.66:0/1597360087 learned_addr learned my addr 172.21.15.66:0/1597360087 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f1112ffd640 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def266b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def24f550 0x555def267060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 -- 172.21.15.66:0/1597360087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def24f550 msgr2=0x555def267060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def24f550 0x555def267060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 -- 172.21.15.66:0/1597360087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 msgr2=0x555def266b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def266b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.903+0000 7f110bfff640 1 -- 172.21.15.66:0/1597360087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555def24a9f0 con 0x555def23ba80 2024-09-15T22:49:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.904+0000 7f110bfff640 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0058c0 tx=0x7f10fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4887eb5a04ba6703 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.904+0000 7f11097fa640 1 -- 172.21.15.66:0/1597360087 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc01a040 con 0x555def23ba80 2024-09-15T22:49:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.904+0000 7f11097fa640 1 -- 172.21.15.66:0/1597360087 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10fc00fdc0 con 0x555def23ba80 2024-09-15T22:49:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.904+0000 7f11097fa640 1 -- 172.21.15.66:0/1597360087 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc005610 con 0x555def23ba80 2024-09-15T22:49:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 -- 172.21.15.66:0/1597360087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 msgr2=0x555def237160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0058c0 tx=0x7f10fc004730 comp rx=0 tx=0).stop 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 -- 172.21.15.66:0/1597360087 shutdown_connections 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def24f550 0x555def267060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def23c3a0 0x555def266b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 --2- 172.21.15.66:0/1597360087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23ba80 0x555def237160 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 -- 172.21.15.66:0/1597360087 >> 172.21.15.66:0/1597360087 conn(0x555def2380f0 msgr2=0x555def236a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.905+0000 7f111bd22740 1 -- 172.21.15.66:0/1597360087 shutdown_connections 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.906+0000 7f111bd22740 1 -- 172.21.15.66:0/1597360087 wait complete. 2024-09-15T22:49:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.906+0000 7f111bd22740 1 -- start start 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 Processor -- start 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def253420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def24f550 0x555def253ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f11141ae480 con 0x555def23c3a0 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11141adcf0 con 0x555def24f550 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11141aaf30 con 0x555def23ba80 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f111bd22740 10 client.0 _ll_register_callbacks cb 0x7f1104009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54842/0 (socket says 172.21.15.66:54842) 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f110bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def253420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f1112ffd640 1 -- 172.21.15.66:0/3576611201 learned_addr learned my addr 172.21.15.66:0/3576611201 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.907+0000 7f110bfff640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def24f550 0x555def253ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 -- 172.21.15.66:0/3576611201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 msgr2=0x555def253420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def253420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 -- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def24f550 msgr2=0x555def253ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def24f550 0x555def253ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 -- 172.21.15.66:0/3576611201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555def2c8cf0 con 0x555def23c3a0 2024-09-15T22:49:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f1112ffd640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1104005f50 tx=0x7f1104010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f9b29be293da9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.908+0000 7f10f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104039020 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f1104010c70 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10fc00fdc0 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1104026070 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f111bd22740 10 client.16503 fetch_fsmap learned FSMap version 37 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555def2c9fb0 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.909+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10fc00fdc0 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f1104004f50 con 0x555def23c3a0 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 10 client.16503 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 20 client.16503 populate_metadata read hostname 'smithi066' 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def2ca610 0x555def2cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 4 client.16503 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:49:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555def1a8d00 con 0x555def2ca610 2024-09-15T22:49:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.910+0000 7f110bfff640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def2ca610 0x555def2cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.911+0000 7f10f2ffd640 10 client.16503 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.911+0000 7f110bfff640 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def2ca610 0x555def2cca30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1619c01b90ea012 server_cookie=fc6c718e757893c0 in_seq=0 out_seq=0 2024-09-15T22:49:59.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.915+0000 7f10f2ffd640 1 -- 172.21.15.66:0/3576611201 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555def1a8d00 con 0x555def2ca610 2024-09-15T22:49:59.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.915+0000 7f10f2ffd640 10 client.16503 handle_command_reply: tid=0 2024-09-15T22:49:59.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 client.16503 shutdown 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 msgr2=0x555def253960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1104005f50 tx=0x7f1104010660 comp rx=0 tx=0).stop 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 shutdown_connections 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555def2ca610 0x555def2cca30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555def24f550 0x555def253ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555def23c3a0 0x555def253960 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 --2- 172.21.15.66:0/3576611201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555def23ba80 0x555def253420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f10f2ffd640 0 client.16503 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:49:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 >> 172.21.15.66:0/3576611201 conn(0x555def2380f0 msgr2=0x555def237270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 shutdown_connections 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 1 -- 172.21.15.66:0/3576611201 wait complete. 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.916+0000 7f111bd22740 20 client.16503 trim_cache size 0 max 16384 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "f9ada57d-30a7-4e9b-bec0-bc755705f4d8", 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:49:59.919 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:49:59.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 msgr2=0x7f11000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 0x7f11000a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f110c0bd110 tx=0x7f110c088040 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 msgr2=0x7f1114101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f110c0319f0 tx=0x7f110c031a20 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 shutdown_connections 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f11000a3430 0x7f11000a58f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1114106b80 0x7f1114101d60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1114100aa0 0x7f1114101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 --2- 172.21.15.66:0/583150272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1114100100 0x7f11141012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.917+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 >> 172.21.15.66:0/583150272 conn(0x7f1114077230 msgr2=0x7f11140fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.918+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 shutdown_connections 2024-09-15T22:49:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:49:59.918+0000 7f1119949640 1 -- 172.21.15.66:0/583150272 wait complete. 2024-09-15T22:50:00.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:00 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:50:00.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:00 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:00.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:00 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:00.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:00 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:00.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:00 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T22:50:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:00 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:50:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:00 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:00 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:00 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:00 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T22:50:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:00 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:50:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:00 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:00 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:00 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:00 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T22:50:00.896 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:50:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:01 smithi066 ceph-mon[31185]: pgmap v142: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-15T22:50:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:01 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:01 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:01.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:01 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:01.292 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:01 smithi087 ceph-mon[35290]: pgmap v142: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-15T22:50:01.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:01 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:01.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:01 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:01.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:01 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:01.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:01 smithi184 ceph-mon[35203]: pgmap v142: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.07k op/s 2024-09-15T22:50:01.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:01 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:01.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:01 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:01.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:01 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:01.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 -- 172.21.15.66:0/3567227436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 msgr2=0x7f73c010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 --2- 172.21.15.66:0/3567227436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c010eaa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009ca0 tx=0x7f73b802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 -- 172.21.15.66:0/3567227436 shutdown_connections 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 --2- 172.21.15.66:0/3567227436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c010eaa0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 --2- 172.21.15.66:0/3567227436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 0x7f73c01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 --2- 172.21.15.66:0/3567227436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 -- 172.21.15.66:0/3567227436 >> 172.21.15.66:0/3567227436 conn(0x7f73c00fd8f0 msgr2=0x7f73c00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 -- 172.21.15.66:0/3567227436 shutdown_connections 2024-09-15T22:50:01.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.844+0000 7f73c7296640 1 -- 172.21.15.66:0/3567227436 wait complete. 2024-09-15T22:50:01.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.845+0000 7f73c7296640 1 Processor -- start 2024-09-15T22:50:01.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.845+0000 7f73c7296640 1 -- start start 2024-09-15T22:50:01.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 0x7f73c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0111f80 con 0x7f73c0106f20 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0111e00 con 0x7f73c01027a0 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c7296640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0112100 con 0x7f73c0101df0 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55088/0 (socket says 172.21.15.66:55088) 2024-09-15T22:50:01.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 -- 172.21.15.66:0/165140844 learned_addr learned my addr 172.21.15.66:0/165140844 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:01.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c4831640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 0x7f73c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5833640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 -- 172.21.15.66:0/165140844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 msgr2=0x7f73c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 0x7f73c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 -- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 msgr2=0x7f73c0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5032640 1 -- 172.21.15.66:0/165140844 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c01a6880 con 0x7f73c0101df0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.846+0000 7f73c5833640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73c5032640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00e9f0 tx=0x7f73bc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73b67fc640 1 -- 172.21.15.66:0/165140844 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00cd80 con 0x7f73c0101df0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c01a6b70 con 0x7f73c0101df0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01a70b0 con 0x7f73c0101df0 2024-09-15T22:50:01.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73b67fc640 1 -- 172.21.15.66:0/165140844 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc005500 con 0x7f73c0101df0 2024-09-15T22:50:01.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.847+0000 7f73b67fc640 1 -- 172.21.15.66:0/165140844 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0216a0 con 0x7f73c0101df0 2024-09-15T22:50:01.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.850+0000 7f73c966f740 1 Processor -- start 2024-09-15T22:50:01.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 -- start start 2024-09-15T22:50:01.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c173de90 0x55f0c1740280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0c16902e0 con 0x55f0c172ace0 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f0c1637ce0 con 0x55f0c172a3c0 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c966f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f0c168c2a0 con 0x55f0c173de90 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73b67fc640 1 -- 172.21.15.66:0/165140844 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f73bc005020 con 0x7f73c0101df0 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c5833640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c5833640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53232/0 (socket says 172.21.15.66:53232) 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c5833640 1 -- 172.21.15.66:0/3740007940 learned_addr learned my addr 172.21.15.66:0/3740007940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c4831640 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c173de90 0x55f0c1740280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.851+0000 7f73c5032640 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.852+0000 7f73c5833640 1 -- 172.21.15.66:0/3740007940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c173de90 msgr2=0x55f0c1740280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.852+0000 7f73c5833640 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c173de90 0x55f0c1740280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.852+0000 7f73c5833640 1 -- 172.21.15.66:0/3740007940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 msgr2=0x55f0c173d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.852+0000 7f73c5833640 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.852+0000 7f73c5833640 1 -- 172.21.15.66:0/3740007940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c161c440 con 0x55f0c172a3c0 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.853+0000 7f73c5833640 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005f60 tx=0x7f73b8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe24e683d8a404fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.853+0000 7f73ab7fe640 1 -- 172.21.15.66:0/3740007940 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8031db0 con 0x55f0c172a3c0 2024-09-15T22:50:01.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.853+0000 7f73ab7fe640 1 -- 172.21.15.66:0/3740007940 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8036070 con 0x55f0c172a3c0 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.853+0000 7f73ab7fe640 1 -- 172.21.15.66:0/3740007940 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80042b0 con 0x55f0c172a3c0 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.853+0000 7f73b67fc640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 0x7f73ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c5032640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 0x7f73ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73b67fc640 1 -- 172.21.15.66:0/165140844 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f73bc0d0400 con 0x7f73c0101df0 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 -- 172.21.15.66:0/3740007940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 msgr2=0x55f0c172a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005f60 tx=0x7f73b8005f90 comp rx=0 tx=0).stop 2024-09-15T22:50:01.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 -- 172.21.15.66:0/3740007940 shutdown_connections 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c173de90 0x55f0c1740280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 --2- 172.21.15.66:0/3740007940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172a3c0 0x55f0c172a7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.854+0000 7f73c966f740 1 -- 172.21.15.66:0/3740007940 >> 172.21.15.66:0/3740007940 conn(0x55f0c1726a30 msgr2=0x55f0c1726e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.855+0000 7f73c966f740 1 -- 172.21.15.66:0/3740007940 shutdown_connections 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.855+0000 7f73c966f740 1 -- 172.21.15.66:0/3740007940 wait complete. 2024-09-15T22:50:01.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.855+0000 7f73c5032640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 0x7f73ac0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0cd830 tx=0x7f73bc0986d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.855+0000 7f73c966f740 1 -- start start 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.855+0000 7f73c966f740 1 Processor -- start 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c173d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c173aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0c1740820 con 0x55f0c172ace0 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f0c164b050 con 0x55f0c173de90 2024-09-15T22:50:01.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f0c17409a0 con 0x55f0c172a3c0 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c966f740 10 client.0 _ll_register_callbacks cb 0x55f0c168b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c4831640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c4831640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54878/0 (socket says 172.21.15.66:54878) 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c4831640 1 -- 172.21.15.66:0/2366246469 learned_addr learned my addr 172.21.15.66:0/2366246469 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c5833640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c173d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c5833640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c173aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c5833640 1 -- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 msgr2=0x55f0c173aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.856+0000 7f73c5833640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c173aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c5833640 1 -- 172.21.15.66:0/2366246469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 msgr2=0x55f0c173aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c5833640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c5833640 1 -- 172.21.15.66:0/2366246469 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c14013c0 con 0x55f0c172a3c0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c4831640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c5833640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c173d7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006010 tx=0x7f73b8031930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c23b744a91c09ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8003b80 con 0x55f0c172a3c0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b8036070 con 0x55f0c172a3c0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.857+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f73b8003d20 con 0x55f0c172a3c0 2024-09-15T22:50:01.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f73b8004050 con 0x55f0c172a3c0 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73c966f740 10 client.26023 fetch_fsmap learned FSMap version 37 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f0c1740820 con 0x55f0c172a3c0 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8036070 con 0x55f0c172a3c0 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f73b8042020 con 0x55f0c172a3c0 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73c966f740 10 client.26023 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.858+0000 7f73c966f740 10 client.26023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c966f740 20 client.26023 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c174d760 0x55f0c174fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c966f740 4 client.26023 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0c169d850 con 0x55f0c174d760 2024-09-15T22:50:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c4831640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c174d760 0x55f0c174fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73c4831640 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c174d760 0x55f0c174fba0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77d71a7fb6f4017 server_cookie=3c3438c02026ffb in_seq=0 out_seq=0 2024-09-15T22:50:01.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.859+0000 7f73a8ff9640 10 client.26023 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.863+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2366246469 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0c169d850 con 0x55f0c174d760 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.863+0000 7f73a8ff9640 10 client.26023 handle_command_reply: tid=0 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 client.26023 shutdown 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 msgr2=0x55f0c173d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c173d7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006010 tx=0x7f73b8031930 comp rx=0 tx=0).stop 2024-09-15T22:50:01.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 shutdown_connections 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c174d760 0x55f0c174fba0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c173aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c173aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 --2- 172.21.15.66:0/2366246469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c173d7e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 >> 172.21.15.66:0/2366246469 conn(0x55f0c1726a30 msgr2=0x55f0c1725b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73a8ff9640 0 client.26023 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:01.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 shutdown_connections 2024-09-15T22:50:01.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.864+0000 7f73c966f740 1 -- 172.21.15.66:0/2366246469 wait complete. 2024-09-15T22:50:01.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.865+0000 7f73c966f740 20 client.26023 trim_cache size 0 max 16384 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 Processor -- start 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 -- start start 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c1749b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 0x55f0c17559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f73a400fff0 con 0x55f0c173de90 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4011bf0 con 0x55f0c172ace0 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c966f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73a40106c0 con 0x55f0c172a3c0 2024-09-15T22:50:01.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c5833640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 0x55f0c17559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c4831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c4831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:53248/0 (socket says 172.21.15.66:53248) 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c5833640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 0x55f0c17559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54890/0 (socket says 172.21.15.66:54890) 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.888+0000 7f73c4831640 1 -- 172.21.15.66:0/194119773 learned_addr learned my addr 172.21.15.66:0/194119773 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c5833640 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c1749b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 -- 172.21.15.66:0/194119773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 msgr2=0x55f0c1749b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c1749b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 -- 172.21.15.66:0/194119773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 msgr2=0x55f0c17559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 0x55f0c17559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 -- 172.21.15.66:0/194119773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c1740620 con 0x55f0c172ace0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73c4831640 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f0c173a320 tx=0x7f73b0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0a4b00df5faa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.889+0000 7f73aaffd640 1 -- 172.21.15.66:0/194119773 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0005020 con 0x55f0c172ace0 2024-09-15T22:50:01.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.890+0000 7f73aaffd640 1 -- 172.21.15.66:0/194119773 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b00047a0 con 0x55f0c172ace0 2024-09-15T22:50:01.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.890+0000 7f73aaffd640 1 -- 172.21.15.66:0/194119773 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b000f9f0 con 0x55f0c172ace0 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 -- 172.21.15.66:0/194119773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 msgr2=0x55f0c1755470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f0c173a320 tx=0x7f73b0005f90 comp rx=0 tx=0).stop 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 -- 172.21.15.66:0/194119773 shutdown_connections 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c173de90 0x55f0c17559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c172ace0 0x55f0c1755470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 --2- 172.21.15.66:0/194119773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c1749b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 -- 172.21.15.66:0/194119773 >> 172.21.15.66:0/194119773 conn(0x55f0c1726a30 msgr2=0x55f0c172c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 -- 172.21.15.66:0/194119773 shutdown_connections 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.891+0000 7f73c966f740 1 -- 172.21.15.66:0/194119773 wait complete. 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c966f740 1 -- start start 2024-09-15T22:50:01.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c966f740 1 Processor -- start 2024-09-15T22:50:01.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c966f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c17463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c966f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c4831640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c4831640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54892/0 (socket says 172.21.15.66:54892) 2024-09-15T22:50:01.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.892+0000 7f73c966f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c1741c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c966f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4011520 con 0x55f0c172ace0 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c966f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4010d90 con 0x55f0c173de90 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c966f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73a400dfd0 con 0x55f0c172a3c0 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c966f740 10 client.0 _ll_register_callbacks cb 0x7f73bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 -- 172.21.15.66:0/2289300234 learned_addr learned my addr 172.21.15.66:0/2289300234 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c5833640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c17463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c5833640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c1741c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 -- 172.21.15.66:0/2289300234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 msgr2=0x55f0c17463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c17463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 -- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 msgr2=0x55f0c1741c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c1741c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 -- 172.21.15.66:0/2289300234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c1742490 con 0x55f0c172ace0 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73c4831640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f73b0004770 tx=0x7f73b0012110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e4d76e42669b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.893+0000 7f73a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0037060 con 0x55f0c172ace0 2024-09-15T22:50:01.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f73b0004b60 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b00047a0 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f73b003e050 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73c966f740 10 client.16521 fetch_fsmap learned FSMap version 37 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f0c17b83b0 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.894+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b0004d60 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f73b000fcf0 con 0x55f0c172ace0 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 10 client.16521 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 20 client.16521 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:01.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c17b8aa0 0x55f0c17baec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:01.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 4 client.16521 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:50:01.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f73b00047a0 con 0x55f0c17b8aa0 2024-09-15T22:50:01.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c5833640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c17b8aa0 0x55f0c17baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:01.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73c5833640 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c17b8aa0 0x55f0c17baec0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f50baa31d0babc server_cookie=1e2e010043cfec41 in_seq=0 out_seq=0 2024-09-15T22:50:01.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.895+0000 7f73a8ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:01.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73a8ff9640 1 -- 172.21.15.66:0/2289300234 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x7f73b00047a0 con 0x55f0c17b8aa0 2024-09-15T22:50:01.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73a8ff9640 10 client.16521 handle_command_reply: tid=0 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 client.16521 shutdown 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 msgr2=0x55f0c1741720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f73b0004770 tx=0x7f73b0012110 comp rx=0 tx=0).stop 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 shutdown_connections 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f0c17b8aa0 0x55f0c17baec0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0c173de90 0x55f0c1741c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0c172ace0 0x55f0c1741720 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 --2- 172.21.15.66:0/2289300234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f0c172a3c0 0x55f0c17463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73a8ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 >> 172.21.15.66:0/2289300234 conn(0x55f0c1726a30 msgr2=0x55f0c173c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.899+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 shutdown_connections 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c966f740 1 -- 172.21.15.66:0/2289300234 wait complete. 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c966f740 20 client.16521 trim_cache size 0 max 16384 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (10217 inodes in the stack)", 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stdout: "f9ada57d-30a7-4e9b-bec0-bc755705f4d8": { 2024-09-15T22:50:01.918 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "f9ada57d-30a7-4e9b-bec0-bc755705f4d8", 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 msgr2=0x7f73ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 0x7f73ac0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0cd830 tx=0x7f73bc0986d0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 msgr2=0x7f73c00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00e9f0 tx=0x7f73bc00edf0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 shutdown_connections 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f73ac0a33b0 0x7f73ac0a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c0106f20 0x7f73c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01027a0 0x7f73c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 --2- 172.21.15.66:0/165140844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c0101df0 0x7f73c00744f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.900+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 >> 172.21.15.66:0/165140844 conn(0x7f73c00fd8f0 msgr2=0x7f73c00fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.901+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 shutdown_connections 2024-09-15T22:50:01.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:01.901+0000 7f73c7296640 1 -- 172.21.15.66:0/165140844 wait complete. 2024-09-15T22:50:02.767 INFO:tasks.cephfs.filesystem:scrub status for tag:f9ada57d-30a7-4e9b-bec0-bc755705f4d8 - {'path': '/', 'tag': 'f9ada57d-30a7-4e9b-bec0-bc755705f4d8', 'options': 'recursive,force'} 2024-09-15T22:50:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:03 smithi184 ceph-mon[35203]: pgmap v143: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 967 op/s 2024-09-15T22:50:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:03 smithi066 ceph-mon[31185]: pgmap v143: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 967 op/s 2024-09-15T22:50:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:03 smithi087 ceph-mon[35290]: pgmap v143: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 967 op/s 2024-09-15T22:50:04.583 INFO:tasks.workunit.client.0.smithi066.stdout: 327 74 21 28 0 140 204 2024-09-15T22:50:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:05 smithi184 ceph-mon[35203]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 999 op/s 2024-09-15T22:50:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:05 smithi066 ceph-mon[31185]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 999 op/s 2024-09-15T22:50:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:05 smithi087 ceph-mon[35290]: pgmap v144: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 999 op/s 2024-09-15T22:50:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:07 smithi184 ceph-mon[35203]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 808 op/s 2024-09-15T22:50:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:07 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:07 smithi066 ceph-mon[31185]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 808 op/s 2024-09-15T22:50:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:07 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:07 smithi087 ceph-mon[35290]: pgmap v145: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 808 op/s 2024-09-15T22:50:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:07 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:09 smithi184 ceph-mon[35203]: pgmap v146: 129 pgs: 129 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-15T22:50:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:09 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:09 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:09 smithi066 ceph-mon[31185]: pgmap v146: 129 pgs: 129 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-15T22:50:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:09 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:09 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:09 smithi087 ceph-mon[35290]: pgmap v146: 129 pgs: 129 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-15T22:50:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:09 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:09 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:11 smithi184 ceph-mon[35203]: pgmap v147: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.5 MiB/s wr, 808 op/s 2024-09-15T22:50:11.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:11 smithi066 ceph-mon[31185]: pgmap v147: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.5 MiB/s wr, 808 op/s 2024-09-15T22:50:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:11 smithi087 ceph-mon[35290]: pgmap v147: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.5 MiB/s wr, 808 op/s 2024-09-15T22:50:12.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8b5ffb640 1 -- 172.21.15.66:0/1669598412 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55697b772d20 con 0x55697b89d660 2024-09-15T22:50:12.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8b5ffb640 10 client.16458 handle_command_reply: tid=0 2024-09-15T22:50:12.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 client.16458 shutdown 2024-09-15T22:50:12.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 msgr2=0x55697b815600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009ea0 tx=0x7fc8bc0122d0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 shutdown_connections 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55697b821950 0x55697b815600 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55697b805f40 0x55697b8150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55697b89d660 0x55697b89fa50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 --2- 172.21.15.66:0/1669598412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697b805620 0x55697b819d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8b5ffb640 0 client.16458 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 >> 172.21.15.66:0/1669598412 conn(0x55697b801cf0 msgr2=0x55697b800650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 shutdown_connections 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 1 -- 172.21.15.66:0/1669598412 wait complete. 2024-09-15T22:50:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.228+0000 7fc8d6bab740 20 client.16458 trim_cache size 0 max 16384 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 37, 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 14, 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:50:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "8288b00": { 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 14, 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:50:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:50:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:50:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 133.8, 2024-09-15T22:50:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:50:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:50:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:12.235 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 msgr2=0x7fc8b80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 0x7fc8b80a5a80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009610 tx=0x7fc8bc006c70 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 msgr2=0x7fc8cc1a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800efb0 tx=0x7fc8c800c800 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 shutdown_connections 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc8b80a35c0 0x7fc8b80a5a80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc10d530 0x7fc8cc19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8cc108e00 0x7fc8cc1a4c90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 --2- 172.21.15.66:0/3958072832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8cc108450 0x7fc8cc1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 >> 172.21.15.66:0/3958072832 conn(0x7fc8cc077ba0 msgr2=0x7fc8cc079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 shutdown_connections 2024-09-15T22:50:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:12.229+0000 7fc8d47d2640 1 -- 172.21.15.66:0/3958072832 wait complete. 2024-09-15T22:50:13.193 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8288b00', quiesce took 35.9 seconds. Will release after: -22.099999999999998 2024-09-15T22:50:13.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:50:13.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:13 smithi087 ceph-mon[35290]: pgmap v148: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-15T22:50:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:13 smithi184 ceph-mon[35203]: pgmap v148: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-15T22:50:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:13 smithi066 ceph-mon[31185]: pgmap v148: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 659 op/s 2024-09-15T22:50:13.517 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:14.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 -- 172.21.15.66:0/3149037844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 msgr2=0x7f392010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 --2- 172.21.15.66:0/3149037844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392010d960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3918009ca0 tx=0x7f391802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 -- 172.21.15.66:0/3149037844 shutdown_connections 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 --2- 172.21.15.66:0/3149037844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392010d960 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 --2- 172.21.15.66:0/3149037844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f39201056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 --2- 172.21.15.66:0/3149037844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 -- 172.21.15.66:0/3149037844 >> 172.21.15.66:0/3149037844 conn(0x7f3920077230 msgr2=0x7f39200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 -- 172.21.15.66:0/3149037844 shutdown_connections 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.000+0000 7f392778a640 1 -- 172.21.15.66:0/3149037844 wait complete. 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 Processor -- start 2024-09-15T22:50:14.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 -- start start 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f3920198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3920110e40 con 0x7f3920105de0 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3920110cc0 con 0x7f3920101e20 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f392778a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3920110fc0 con 0x7f3920101470 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925526640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36120/0 (socket says 172.21.15.66:36120) 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 -- 172.21.15.66:0/3072481152 learned_addr learned my addr 172.21.15.66:0/3072481152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3924d25640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f3920198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 -- 172.21.15.66:0/3072481152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 msgr2=0x7f3920198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 -- 172.21.15.66:0/3072481152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 msgr2=0x7f3920198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f3920198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925d27640 1 -- 172.21.15.66:0/3072481152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392019d3c0 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3925526640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.001+0000 7f3924d25640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f3920198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f3925d27640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3918031a20 tx=0x7f3918031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918003b70 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3918003d10 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392019d650 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391802fc40 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.002+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39201a4f90 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.003+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3920101850 con 0x7f3920105de0 2024-09-15T22:50:14.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.005+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3918004050 con 0x7f3920105de0 2024-09-15T22:50:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.005+0000 7f39167fc640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 0x7f390c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.005+0000 7f3925526640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 0x7f390c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.006+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f39180f1070 con 0x7f3920105de0 2024-09-15T22:50:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.006+0000 7f3925526640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 0x7f390c0a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fc0 tx=0x7f391c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:14.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.011+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39180bd820 con 0x7f3920105de0 2024-09-15T22:50:14.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.270+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f392010a090 con 0x7f3920105de0 2024-09-15T22:50:14.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.271+0000 7f39167fc640 1 -- 172.21.15.66:0/3072481152 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11988 (secure 0 0 0) 0x7f39180bd120 con 0x7f3920105de0 2024-09-15T22:50:14.272 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:50:14.273 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 37 2024-09-15T22:50:14.273 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":37,"btime":"2024-09-15T22:49:30:673911+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:49:29.946069+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 msgr2=0x7f390c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 0x7f390c0a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f391c009fc0 tx=0x7f391c005f90 comp rx=0 tx=0).stop 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 msgr2=0x7f392019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3918031a20 tx=0x7f3918031a50 comp rx=0 tx=0).stop 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 shutdown_connections 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f390c0a3430 0x7f390c0a58f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3920105de0 0x7f392019cce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3920101e20 0x7f3920198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 --2- 172.21.15.66:0/3072481152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3920101470 0x7f3920198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 >> 172.21.15.66:0/3072481152 conn(0x7f3920077230 msgr2=0x7f39201003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:14.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 shutdown_connections 2024-09-15T22:50:14.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:14.274+0000 7f392778a640 1 -- 172.21.15.66:0/3072481152 wait complete. 2024-09-15T22:50:14.583 INFO:tasks.workunit.client.0.smithi066.stdout: 327 7126 0 5545 0 2430 0 2024-09-15T22:50:15.108 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 8288b00 --release --await' 2024-09-15T22:50:15.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 8288b00 --release --await 2024-09-15T22:50:15.407 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:15 smithi184 ceph-mon[35203]: pgmap v149: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-09-15T22:50:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:15 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3072481152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:15 smithi066 ceph-mon[31185]: pgmap v149: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-09-15T22:50:15.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:15 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3072481152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:15 smithi087 ceph-mon[35290]: pgmap v149: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 9.5 MiB/s wr, 653 op/s 2024-09-15T22:50:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:15 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3072481152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:16.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.036+0000 7ff5534df640 1 -- 172.21.15.66:0/3128650287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 msgr2=0x7ff54c100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.036+0000 7ff5534df640 1 --2- 172.21.15.66:0/3128650287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c100d60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff548009860 tx=0x7ff54802a400 comp rx=0 tx=0).stop 2024-09-15T22:50:16.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.037+0000 7ff5534df640 1 -- 172.21.15.66:0/3128650287 shutdown_connections 2024-09-15T22:50:16.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.037+0000 7ff5534df640 1 --2- 172.21.15.66:0/3128650287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 0x7ff54c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.037+0000 7ff5534df640 1 --2- 172.21.15.66:0/3128650287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 0x7ff54c105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.037+0000 7ff5534df640 1 --2- 172.21.15.66:0/3128650287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c100d60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.037+0000 7ff5534df640 1 -- 172.21.15.66:0/3128650287 >> 172.21.15.66:0/3128650287 conn(0x7ff54c0fc610 msgr2=0x7ff54c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.038+0000 7ff5534df640 1 -- 172.21.15.66:0/3128650287 shutdown_connections 2024-09-15T22:50:16.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.038+0000 7ff5534df640 1 -- 172.21.15.66:0/3128650287 wait complete. 2024-09-15T22:50:16.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.039+0000 7ff5534df640 1 Processor -- start 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.039+0000 7ff5534df640 1 -- start start 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.040+0000 7ff5534df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.040+0000 7ff5534df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 0x7ff54c114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.040+0000 7ff5524dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.040+0000 7ff5524dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36142/0 (socket says 172.21.15.66:36142) 2024-09-15T22:50:16.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.040+0000 7ff5534df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 0x7ff54c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.041+0000 7ff5524dd640 1 -- 172.21.15.66:0/3330340645 learned_addr learned my addr 172.21.15.66:0/3330340645 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:16.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.041+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c118480 con 0x7ff54c100980 2024-09-15T22:50:16.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.041+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c118300 con 0x7ff54c1012a0 2024-09-15T22:50:16.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.041+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c118600 con 0x7ff54c105d90 2024-09-15T22:50:16.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.042+0000 7ff552cde640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 0x7ff54c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.043+0000 7ff551cdc640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 0x7ff54c114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.045+0000 7ff5524dd640 1 -- 172.21.15.66:0/3330340645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 msgr2=0x7ff54c10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.045+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 0x7ff54c10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.045+0000 7ff5524dd640 1 -- 172.21.15.66:0/3330340645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 msgr2=0x7ff54c114e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.045+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 0x7ff54c114e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.045+0000 7ff5524dd640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c10e2a0 con 0x7ff54c100980 2024-09-15T22:50:16.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.049+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c00 tx=0x7ff5480052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.050+0000 7ff5437fe640 1 -- 172.21.15.66:0/3330340645 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548040070 con 0x7ff54c100980 2024-09-15T22:50:16.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.050+0000 7ff5437fe640 1 -- 172.21.15.66:0/3330340645 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5480318e0 con 0x7ff54c100980 2024-09-15T22:50:16.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.051+0000 7ff5437fe640 1 -- 172.21.15.66:0/3330340645 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548004be0 con 0x7ff54c100980 2024-09-15T22:50:16.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.051+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c10e530 con 0x7ff54c100980 2024-09-15T22:50:16.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.051+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c112480 con 0x7ff54c100980 2024-09-15T22:50:16.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.057+0000 7ff556b1a740 1 Processor -- start 2024-09-15T22:50:16.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 -- start start 2024-09-15T22:50:16.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 0x55b765d8beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d8e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b765ce6620 con 0x55b765d81210 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b765c8de50 con 0x55b765d81b30 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff556b1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b765ce25e0 con 0x55b765d8c3f0 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff552cde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff552cde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36148/0 (socket says 172.21.15.66:36148) 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.058+0000 7ff552cde640 1 -- 172.21.15.66:0/3053931061 learned_addr learned my addr 172.21.15.66:0/3053931061 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.059+0000 7ff5437fe640 1 -- 172.21.15.66:0/3330340645 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff548043070 con 0x7ff54c100980 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.059+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 0x55b765d8beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.059+0000 7ff551cdc640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d8e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff552cde640 1 -- 172.21.15.66:0/3053931061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 msgr2=0x55b765d8e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:16.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff552cde640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d8e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff552cde640 1 -- 172.21.15.66:0/3053931061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 msgr2=0x55b765d8beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:16.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff552cde640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 0x55b765d8beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff552cde640 1 -- 172.21.15.66:0/3053931061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b765c7ed40 con 0x55b765d81210 2024-09-15T22:50:16.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.062+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 0x55b765d8beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:16.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.068+0000 7ff5437fe640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 0x7ff5380a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.069+0000 7ff5437fe640 1 -- 172.21.15.66:0/3330340645 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff5480f0d00 con 0x7ff54c100980 2024-09-15T22:50:16.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.069+0000 7ff552cde640 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff544009f10 tx=0x7ff5440107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e2bd5d4674ff5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.069+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 0x7ff5380a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.070+0000 7ff540ff9640 1 -- 172.21.15.66:0/3053931061 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544003b70 con 0x55b765d81210 2024-09-15T22:50:16.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.070+0000 7ff540ff9640 1 -- 172.21.15.66:0/3053931061 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff544003d10 con 0x55b765d81210 2024-09-15T22:50:16.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 -- 172.21.15.66:0/3053931061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 msgr2=0x55b765d815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff544009f10 tx=0x7ff5440107e0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff5524dd640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 0x7ff5380a5a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55b765d7e600 tx=0x7ff54802a400 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 -- 172.21.15.66:0/3053931061 shutdown_connections 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d8e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81b30 0x55b765d8beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3053931061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d815f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.071+0000 7ff556b1a740 1 -- 172.21.15.66:0/3053931061 >> 172.21.15.66:0/3053931061 conn(0x55b765d7d7a0 msgr2=0x55b765d7db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.074+0000 7ff556b1a740 1 -- 172.21.15.66:0/3053931061 shutdown_connections 2024-09-15T22:50:16.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.074+0000 7ff556b1a740 1 -- 172.21.15.66:0/3053931061 wait complete. 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.074+0000 7ff556b1a740 1 -- start start 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.074+0000 7ff556b1a740 1 Processor -- start 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765d89170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d89bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b765d8f010 con 0x55b765d81b30 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b765c6ef10 con 0x55b765d81210 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b765d8f190 con 0x55b765d8c3f0 2024-09-15T22:50:16.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.075+0000 7ff556b1a740 10 client.0 _ll_register_callbacks cb 0x55b765c92db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:16.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.076+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.076+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36162/0 (socket says 172.21.15.66:36162) 2024-09-15T22:50:16.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.076+0000 7ff551cdc640 1 -- 172.21.15.66:0/338107391 learned_addr learned my addr 172.21.15.66:0/338107391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.077+0000 7ff551cdc640 1 -- 172.21.15.66:0/338107391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 msgr2=0x55b765d89bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.077+0000 7ff551cdc640 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d89bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.077+0000 7ff551cdc640 1 -- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 msgr2=0x55b765d89170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.077+0000 7ff551cdc640 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765d89170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.077+0000 7ff551cdc640 1 -- 172.21.15.66:0/338107391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7659f5580 con 0x55b765d81b30 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.078+0000 7ff551cdc640 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00f4c0 tx=0x7ff53c00f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8eea1a4f1b4e32b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.078+0000 7ff535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:50:16.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.078+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013850 con 0x55b765d81b30 2024-09-15T22:50:16.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.078+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff544003d10 con 0x55b765d81b30 2024-09-15T22:50:16.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.078+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff53c0139f0 con 0x55b765d81b30 2024-09-15T22:50:16.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.079+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff53c024050 con 0x55b765d81b30 2024-09-15T22:50:16.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.079+0000 7ff556b1a740 10 client.16539 fetch_fsmap learned FSMap version 37 2024-09-15T22:50:16.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.079+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b765abf960 con 0x55b765d81b30 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.081+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff544003d10 con 0x55b765d81b30 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.081+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff53c0123c0 con 0x55b765d81b30 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 10 client.16539 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 10 client.16539 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 20 client.16539 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d9bf50 0x55b765d9e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 4 client.16539 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:16.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.082+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b765cf3b90 con 0x55b765d9bf50 2024-09-15T22:50:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.087+0000 7ff552cde640 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d9bf50 0x55b765d9e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.103+0000 7ff552cde640 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d9bf50 0x55b765d9e3f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f450cd69fbfe37 server_cookie=86563f7077673d5c in_seq=0 out_seq=0 2024-09-15T22:50:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.104+0000 7ff535ffb640 10 client.16539 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.109+0000 7ff535ffb640 1 -- 172.21.15.66:0/338107391 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b765cf3b90 con 0x55b765d9bf50 2024-09-15T22:50:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.109+0000 7ff535ffb640 10 client.16539 handle_command_reply: tid=0 2024-09-15T22:50:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.110+0000 7ff556b1a740 1 client.16539 shutdown 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 msgr2=0x55b765d896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00f4c0 tx=0x7ff53c00f980 comp rx=0 tx=0).stop 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 shutdown_connections 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d8c3f0 0x55b765d89bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81b30 0x55b765d896b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d9bf50 0x55b765d9e3f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 --2- 172.21.15.66:0/338107391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765d89170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 >> 172.21.15.66:0/338107391 conn(0x55b765d7d7a0 msgr2=0x55b765d834d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff535ffb640 0 client.16539 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 shutdown_connections 2024-09-15T22:50:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 1 -- 172.21.15.66:0/338107391 wait complete. 2024-09-15T22:50:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.113+0000 7ff556b1a740 20 client.16539 trim_cache size 0 max 16384 2024-09-15T22:50:16.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.152+0000 7ff556b1a740 1 Processor -- start 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 -- start start 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d7c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d8c3f0 0x55b765da4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1bdf40 con 0x55b765d81210 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1bfb40 con 0x55b765d8c3f0 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.153+0000 7ff556b1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1be610 con 0x55b765d81b30 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.155+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.155+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52554/0 (socket says 172.21.15.66:52554) 2024-09-15T22:50:16.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.155+0000 7ff551cdc640 1 -- 172.21.15.66:0/3343683276 learned_addr learned my addr 172.21.15.66:0/3343683276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:16.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff552cde640 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d8c3f0 0x55b765da4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff552cde640 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d7c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff551cdc640 1 -- 172.21.15.66:0/3343683276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d8c3f0 msgr2=0x55b765da4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:16.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff551cdc640 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d8c3f0 0x55b765da4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff551cdc640 1 -- 172.21.15.66:0/3343683276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 msgr2=0x55b765d7c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:16.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff551cdc640 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d7c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.157+0000 7ff551cdc640 1 -- 172.21.15.66:0/3343683276 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b765d7d5d0 con 0x55b765d81b30 2024-09-15T22:50:16.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.163+0000 7ff551cdc640 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff53c000ea0 tx=0x7ff53c00a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0b75502e597ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.167+0000 7ff537fff640 1 -- 172.21.15.66:0/3343683276 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c02e020 con 0x55b765d81b30 2024-09-15T22:50:16.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.167+0000 7ff537fff640 1 -- 172.21.15.66:0/3343683276 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53c005e50 con 0x55b765d81b30 2024-09-15T22:50:16.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.167+0000 7ff537fff640 1 -- 172.21.15.66:0/3343683276 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013a30 con 0x55b765d81b30 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 -- 172.21.15.66:0/3343683276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 msgr2=0x55b765da3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff53c000ea0 tx=0x7ff53c00a120 comp rx=0 tx=0).stop 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 -- 172.21.15.66:0/3343683276 shutdown_connections 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d8c3f0 0x55b765da4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765da3d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 --2- 172.21.15.66:0/3343683276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d81210 0x55b765d7c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.169+0000 7ff556b1a740 1 -- 172.21.15.66:0/3343683276 >> 172.21.15.66:0/3343683276 conn(0x55b765d7d7a0 msgr2=0x55b765d7c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.172+0000 7ff556b1a740 1 -- 172.21.15.66:0/3343683276 shutdown_connections 2024-09-15T22:50:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.172+0000 7ff556b1a740 1 -- 172.21.15.66:0/3343683276 wait complete. 2024-09-15T22:50:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.172+0000 7ff556b1a740 1 -- start start 2024-09-15T22:50:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.172+0000 7ff556b1a740 1 Processor -- start 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.173+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765e03cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.173+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff556b1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d8c3f0 0x55b765e00ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff556b1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1bf470 con 0x55b765d8c3f0 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff556b1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1bece0 con 0x55b765d81210 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff556b1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1bbf20 con 0x55b765d81b30 2024-09-15T22:50:16.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff556b1a740 10 client.0 _ll_register_callbacks cb 0x7ff53c00ad60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:16.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.174+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.175+0000 7ff551cdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52562/0 (socket says 172.21.15.66:52562) 2024-09-15T22:50:16.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.175+0000 7ff551cdc640 1 -- 172.21.15.66:0/2223250383 learned_addr learned my addr 172.21.15.66:0/2223250383 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:16.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.177+0000 7ff551cdc640 1 -- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 msgr2=0x55b765e03cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:16.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.177+0000 7ff551cdc640 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765e03cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.177+0000 7ff551cdc640 1 -- 172.21.15.66:0/2223250383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d8c3f0 msgr2=0x55b765e00ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:16.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.177+0000 7ff551cdc640 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d8c3f0 0x55b765e00ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.177+0000 7ff551cdc640 1 -- 172.21.15.66:0/2223250383 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b765e011e0 con 0x55b765d81b30 2024-09-15T22:50:16.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.181+0000 7ff551cdc640 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff53c012900 tx=0x7ff53c006f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4196ac2f0fe617a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.181+0000 7ff535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:50:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.181+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c02e040 con 0x55b765d81b30 2024-09-15T22:50:16.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.182+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff53c005e50 con 0x55b765d81b30 2024-09-15T22:50:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.185+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7ff53c005970 con 0x55b765d81b30 2024-09-15T22:50:16.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.189+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff53c0125d0 con 0x55b765d81b30 2024-09-15T22:50:16.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.189+0000 7ff556b1a740 10 client.26050 fetch_fsmap learned FSMap version 37 2024-09-15T22:50:16.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.189+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b765d93b40 con 0x55b765d81b30 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.191+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53c005e50 con 0x55b765d81b30 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.191+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff53c013ba0 con 0x55b765d81b30 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 10 client.26050 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 10 client.26050 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 20 client.26050 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d942f0 0x55b765d94700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 4 client.26050 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8288b00", "release": true, "await": true}] 2024-09-15T22:50:16.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8288b00", "release": true, "await": true}) -- 0x55b765cee0a0 con 0x55b765d942f0 2024-09-15T22:50:16.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.192+0000 7ff552cde640 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d942f0 0x55b765d94700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.196+0000 7ff535ffb640 10 client.26050 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:16.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:16.196+0000 7ff552cde640 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d942f0 0x55b765d94700 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31dc82ba40a63ec server_cookie=932b2d9da2d52a87 in_seq=0 out_seq=0 2024-09-15T22:50:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:16 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:16.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:16 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:16 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff535ffb640 1 -- 172.21.15.66:0/2223250383 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b765cee0a0 con 0x55b765d942f0 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff535ffb640 10 client.26050 handle_command_reply: tid=0 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 client.26050 shutdown 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 msgr2=0x55b765e04210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff53c012900 tx=0x7ff53c006f10 comp rx=0 tx=0).stop 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 shutdown_connections 2024-09-15T22:50:17.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b765d8c3f0 0x55b765e00ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b765d81b30 0x55b765e04210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b765d942f0 0x55b765d94700 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 --2- 172.21.15.66:0/2223250383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b765d81210 0x55b765e03cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff535ffb640 0 client.26050 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 >> 172.21.15.66:0/2223250383 conn(0x55b765d7d7a0 msgr2=0x55b765d7c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 shutdown_connections 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.177+0000 7ff556b1a740 1 -- 172.21.15.66:0/2223250383 wait complete. 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff556b1a740 20 client.26050 trim_cache size 0 max 16384 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:50:17.180 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 37, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 16, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "8288b00": { 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 16, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 133.8, 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:50:17.181 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:50:17.182 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 msgr2=0x7ff5380a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 0x7ff5380a5a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55b765d7e600 tx=0x7ff54802a400 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 msgr2=0x7ff54c114950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c00 tx=0x7ff5480052f0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 shutdown_connections 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5380a3580 0x7ff5380a5a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff54c105d90 0x7ff54c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff54c1012a0 0x7ff54c114e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 --2- 172.21.15.66:0/3330340645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c100980 0x7ff54c114950 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 >> 172.21.15.66:0/3330340645 conn(0x7ff54c0fc610 msgr2=0x7ff54c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:17.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.178+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 shutdown_connections 2024-09-15T22:50:17.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:17.179+0000 7ff5534df640 1 -- 172.21.15.66:0/3330340645 wait complete. 2024-09-15T22:50:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:17 smithi184 ceph-mon[35203]: pgmap v150: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 519 op/s 2024-09-15T22:50:17.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:17 smithi066 ceph-mon[31185]: pgmap v150: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 519 op/s 2024-09-15T22:50:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:17 smithi087 ceph-mon[35290]: pgmap v150: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 8.3 MiB/s wr, 519 op/s 2024-09-15T22:50:18.013 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8288b00', total seconds elapsed: 40.7 2024-09-15T22:50:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:19 smithi184 ceph-mon[35203]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 9.3 MiB/s wr, 587 op/s 2024-09-15T22:50:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:19 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:50:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:19 smithi066 ceph-mon[31185]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 9.3 MiB/s wr, 587 op/s 2024-09-15T22:50:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:19 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:50:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:19 smithi087 ceph-mon[35290]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 9.3 MiB/s wr, 587 op/s 2024-09-15T22:50:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:19 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:50:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:50:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:21 smithi184 ceph-mon[35203]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 8.6 MiB/s wr, 625 op/s 2024-09-15T22:50:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:21 smithi066 ceph-mon[31185]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 8.6 MiB/s wr, 625 op/s 2024-09-15T22:50:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:21 smithi087 ceph-mon[35290]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 8.6 MiB/s wr, 625 op/s 2024-09-15T22:50:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:23 smithi184 ceph-mon[35203]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 7.6 MiB/s wr, 547 op/s 2024-09-15T22:50:23.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:23 smithi066 ceph-mon[31185]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 7.6 MiB/s wr, 547 op/s 2024-09-15T22:50:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:23 smithi087 ceph-mon[35290]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 7.6 MiB/s wr, 547 op/s 2024-09-15T22:50:24.583 INFO:tasks.workunit.client.0.smithi066.stdout: 339 63491 636 40653 563 15333 408 2024-09-15T22:50:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:25 smithi184 ceph-mon[35203]: pgmap v154: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-15T22:50:25.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:25 smithi066 ceph-mon[31185]: pgmap v154: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-15T22:50:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:25 smithi087 ceph-mon[35290]: pgmap v154: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-15T22:50:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:27 smithi184 ceph-mon[35203]: pgmap v155: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.2 MiB/s wr, 793 op/s 2024-09-15T22:50:27.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:27 smithi066 ceph-mon[31185]: pgmap v155: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.2 MiB/s wr, 793 op/s 2024-09-15T22:50:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:27 smithi087 ceph-mon[35290]: pgmap v155: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.2 MiB/s wr, 793 op/s 2024-09-15T22:50:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:29 smithi184 ceph-mon[35203]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 961 op/s 2024-09-15T22:50:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:50:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:50:29.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:29 smithi066 ceph-mon[31185]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 961 op/s 2024-09-15T22:50:29.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:50:29.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:50:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:29 smithi087 ceph-mon[35290]: pgmap v156: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.2 MiB/s wr, 961 op/s 2024-09-15T22:50:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:50:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:50:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:50:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:50:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:50:30.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:50:30.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:50:30.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:50:30.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:50:30.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:50:30.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:50:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:31 smithi066 ceph-mon[31185]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 951 op/s 2024-09-15T22:50:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:31 smithi087 ceph-mon[35290]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 951 op/s 2024-09-15T22:50:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:31 smithi184 ceph-mon[35203]: pgmap v157: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.1 MiB/s wr, 951 op/s 2024-09-15T22:50:32.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:50:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:33 smithi087 ceph-mon[35290]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 805 op/s 2024-09-15T22:50:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:33 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:50:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:33 smithi184 ceph-mon[35203]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 805 op/s 2024-09-15T22:50:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:33 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:50:33.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:33 smithi066 ceph-mon[31185]: pgmap v158: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.6 MiB/s wr, 805 op/s 2024-09-15T22:50:33.701 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:33 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:50:34.588 INFO:tasks.workunit.client.0.smithi066.stdout: 367 1568736 1585 1019648 1366 409894 1683 2024-09-15T22:50:35.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:35 smithi066 ceph-mon[31185]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.0 MiB/s wr, 823 op/s 2024-09-15T22:50:35.509 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:35 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:35 smithi087 ceph-mon[35290]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.0 MiB/s wr, 823 op/s 2024-09-15T22:50:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:35 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:35.615 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:35 smithi184 ceph-mon[35203]: pgmap v159: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.0 MiB/s wr, 823 op/s 2024-09-15T22:50:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:35 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 -- 172.21.15.66:0/1705554082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109450 msgr2=0x7fa44c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 --2- 172.21.15.66:0/1705554082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109450 0x7fa44c110250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009900 tx=0x7fa43c02a440 comp rx=0 tx=0).stop 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 -- 172.21.15.66:0/1705554082 shutdown_connections 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 --2- 172.21.15.66:0/1705554082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 0x7fa44c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 --2- 172.21.15.66:0/1705554082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c109830 0x7fa44c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 --2- 172.21.15.66:0/1705554082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109450 0x7fa44c110250 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009900 tx=0x7fa43c02a440 comp rx=0 tx=0).stop 2024-09-15T22:50:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.484+0000 7fa451385640 1 -- 172.21.15.66:0/1705554082 >> 172.21.15.66:0/1705554082 conn(0x7fa44c06e140 msgr2=0x7fa44c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.487+0000 7fa451385640 1 -- 172.21.15.66:0/1705554082 shutdown_connections 2024-09-15T22:50:36.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.487+0000 7fa451385640 1 -- 172.21.15.66:0/1705554082 wait complete. 2024-09-15T22:50:36.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.488+0000 7fa451385640 1 Processor -- start 2024-09-15T22:50:36.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.488+0000 7fa451385640 1 -- start start 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 0x7fa44c1118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c111e30 0x7fa44c1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c120df0 con 0x7fa44c11b140 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c120c70 con 0x7fa44c111e30 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.489+0000 7fa451385640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c120f70 con 0x7fa44c109830 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.490+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.490+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53494/0 (socket says 172.21.15.66:53494) 2024-09-15T22:50:36.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.490+0000 7fa44affd640 1 -- 172.21.15.66:0/155026017 learned_addr learned my addr 172.21.15.66:0/155026017 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.490+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c111e30 0x7fa44c1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 0x7fa44c1118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44affd640 1 -- 172.21.15.66:0/155026017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c111e30 msgr2=0x7fa44c1122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44affd640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c111e30 0x7fa44c1122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44affd640 1 -- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 msgr2=0x7fa44c1118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44affd640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 0x7fa44c1118f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.492+0000 7fa44affd640 1 -- 172.21.15.66:0/155026017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c116410 con 0x7fa44c109830 2024-09-15T22:50:36.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.496+0000 7fa44affd640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009850 tx=0x7fa43c0056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.498+0000 7fa433fff640 1 -- 172.21.15.66:0/155026017 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c041070 con 0x7fa44c109830 2024-09-15T22:50:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.498+0000 7fa433fff640 1 -- 172.21.15.66:0/155026017 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa43c0041e0 con 0x7fa44c109830 2024-09-15T22:50:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.498+0000 7fa433fff640 1 -- 172.21.15.66:0/155026017 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c03de50 con 0x7fa44c109830 2024-09-15T22:50:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.498+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c1166a0 con 0x7fa44c109830 2024-09-15T22:50:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.498+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44c116b60 con 0x7fa44c109830 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.506+0000 7fa45375e740 1 Processor -- start 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 -- start start 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 0x55a05d4a3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a05d3fe2e0 con 0x55a05d4984a0 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a05d3a5ce0 con 0x55a05d4a3680 2024-09-15T22:50:36.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.509+0000 7fa45375e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a05d3fa2a0 con 0x55a05d498dc0 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.511+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 0x55a05d4a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.512+0000 7fa44b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.512+0000 7fa44b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58612/0 (socket says 172.21.15.66:58612) 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.512+0000 7fa44b7fe640 1 -- 172.21.15.66:0/2139497077 learned_addr learned my addr 172.21.15.66:0/2139497077 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.512+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.512+0000 7fa433fff640 1 -- 172.21.15.66:0/155026017 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa43c044070 con 0x7fa44c109830 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2139497077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 msgr2=0x55a05d4a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 0x55a05d4a3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2139497077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 msgr2=0x55a05d498880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2139497077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a05d38a440 con 0x55a05d4a3680 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.519+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a5a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa44c113140 tx=0x7fa44000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a58b21938c68e622 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.520+0000 7fa433fff640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 0x7fa4340a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.520+0000 7fa433fff640 1 -- 172.21.15.66:0/155026017 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa43c0f09a0 con 0x7fa44c109830 2024-09-15T22:50:36.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.521+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:36.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.521+0000 7fa44affd640 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 0x55a05d4a3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:36.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.522+0000 7fa4317fa640 1 -- 172.21.15.66:0/2139497077 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440015070 con 0x55a05d4a3680 2024-09-15T22:50:36.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.523+0000 7fa4317fa640 1 -- 172.21.15.66:0/2139497077 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4400035f0 con 0x55a05d4a3680 2024-09-15T22:50:36.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.524+0000 7fa45375e740 1 -- 172.21.15.66:0/2139497077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 msgr2=0x55a05d4a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.524+0000 7fa45375e740 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a5a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa44c113140 tx=0x7fa44000f730 comp rx=0 tx=0).stop 2024-09-15T22:50:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 0x7fa4340a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa45375e740 1 -- 172.21.15.66:0/2139497077 shutdown_connections 2024-09-15T22:50:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa45375e740 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a5a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa45375e740 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d498dc0 0x55a05d4a3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa45375e740 1 --2- 172.21.15.66:0/2139497077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d498880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.526+0000 7fa45375e740 1 -- 172.21.15.66:0/2139497077 >> 172.21.15.66:0/2139497077 conn(0x55a05d494a30 msgr2=0x55a05d494e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.527+0000 7fa45375e740 1 -- 172.21.15.66:0/2139497077 shutdown_connections 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.527+0000 7fa45375e740 1 -- 172.21.15.66:0/2139497077 wait complete. 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.527+0000 7fa45375e740 1 -- start start 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.527+0000 7fa45375e740 1 Processor -- start 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.528+0000 7fa45375e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53516/0 (socket says 172.21.15.66:53516) 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa44affd640 1 -- 172.21.15.66:0/2924849319 learned_addr learned my addr 172.21.15.66:0/2924849319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a05d4a62a0 con 0x55a05d498dc0 2024-09-15T22:50:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a05d3b9050 con 0x55a05d4a3680 2024-09-15T22:50:36.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a05d4a6420 con 0x55a05d4984a0 2024-09-15T22:50:36.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.529+0000 7fa45375e740 10 client.0 _ll_register_callbacks cb 0x55a05d3f9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 -- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 msgr2=0x55a05d4a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 -- 172.21.15.66:0/2924849319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 msgr2=0x55a05d4a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a05d16f3c0 con 0x55a05d4984a0 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa44affd640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa43c004bb0 tx=0x7fa43c0b8bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a7ae51c4afd7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa42eff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:50:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c04b040 con 0x55a05d4984a0 2024-09-15T22:50:36.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.531+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4400035f0 con 0x55a05d4984a0 2024-09-15T22:50:36.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.532+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa43c0b8ec0 con 0x55a05d4984a0 2024-09-15T22:50:36.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.532+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:36.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.533+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa43c0bc1b0 con 0x55a05d4984a0 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.537+0000 7fa45375e740 10 client.26062 fetch_fsmap learned FSMap version 38 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.537+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a05d4a6390 con 0x55a05d4984a0 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.540+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4400035f0 con 0x55a05d4984a0 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.540+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7fa43c03d5e0 con 0x55a05d4984a0 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 10 client.26062 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 10 client.26062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 20 client.26062 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d4b31d0 0x55a05d4b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 4 client.26062 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:36.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.543+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a05d40b850 con 0x55a05d4b31d0 2024-09-15T22:50:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.546+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d4b31d0 0x55a05d4b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.548+0000 7fa44b7fe640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 0x7fa4340a5c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa444005cc0 tx=0x7fa444005bd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.551+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d4b31d0 0x55a05d4b5670 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de3a912a353f8ce server_cookie=af8c6a2418e9dbaa in_seq=0 out_seq=0 2024-09-15T22:50:36.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.551+0000 7fa42eff5640 10 client.26062 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.557+0000 7fa42eff5640 1 -- 172.21.15.66:0/2924849319 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a05d40b850 con 0x55a05d4b31d0 2024-09-15T22:50:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.557+0000 7fa42eff5640 10 client.26062 handle_command_reply: tid=0 2024-09-15T22:50:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.557+0000 7fa45375e740 1 client.26062 shutdown 2024-09-15T22:50:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.558+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 msgr2=0x55a05d4a2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.558+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa43c004bb0 tx=0x7fa43c0b8bb0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 shutdown_connections 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d4b31d0 0x55a05d4b5670 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 --2- 172.21.15.66:0/2924849319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d4984a0 0x55a05d4a2f50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 >> 172.21.15.66:0/2924849319 conn(0x55a05d494a30 msgr2=0x55a05d49a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.560+0000 7fa42eff5640 0 client.26062 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:36.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.563+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 shutdown_connections 2024-09-15T22:50:36.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.566+0000 7fa45375e740 1 -- 172.21.15.66:0/2924849319 wait complete. 2024-09-15T22:50:36.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.567+0000 7fa45375e740 20 client.26062 trim_cache size 0 max 16384 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.611+0000 7fa45375e740 1 Processor -- start 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.612+0000 7fa45375e740 1 -- start start 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.612+0000 7fa45375e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d493a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.612+0000 7fa45375e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d4baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d493a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d493a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53518/0 (socket says 172.21.15.66:53518) 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa44affd640 1 -- 172.21.15.66:0/2301572359 learned_addr learned my addr 172.21.15.66:0/2301572359 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa45375e740 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d498dc0 0x55a05d4bb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c6d70 con 0x55a05d4984a0 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c89a0 con 0x55a05d498dc0 2024-09-15T22:50:36.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.613+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c7440 con 0x55a05d494a30 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d4baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2301572359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 msgr2=0x55a05d493a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d493a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2301572359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d498dc0 msgr2=0x55a05d4bb480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d498dc0 0x55a05d4bb480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.614+0000 7fa44a7fc640 1 -- 172.21.15.66:0/2301572359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a05d494860 con 0x55a05d4984a0 2024-09-15T22:50:36.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.615+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d4baf40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55a05d4a1840 tx=0x7fa44000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d718f9abf57f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.617+0000 7fa430ff9640 1 -- 172.21.15.66:0/2301572359 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440015040 con 0x55a05d4984a0 2024-09-15T22:50:36.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.618+0000 7fa430ff9640 1 -- 172.21.15.66:0/2301572359 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440004410 con 0x55a05d4984a0 2024-09-15T22:50:36.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.618+0000 7fa430ff9640 1 -- 172.21.15.66:0/2301572359 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440011df0 con 0x55a05d4984a0 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 msgr2=0x55a05d4baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d4baf40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55a05d4a1840 tx=0x7fa44000b3e0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 shutdown_connections 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d498dc0 0x55a05d4bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d4984a0 0x55a05d4baf40 secure :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55a05d4a1840 tx=0x7fa44000b3e0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 --2- 172.21.15.66:0/2301572359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d493a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.620+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 >> 172.21.15.66:0/2301572359 conn(0x55a05d4a08a0 msgr2=0x55a05d493370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.625+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 shutdown_connections 2024-09-15T22:50:36.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.626+0000 7fa45375e740 1 -- 172.21.15.66:0/2301572359 wait complete. 2024-09-15T22:50:36.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.627+0000 7fa45375e740 1 -- start start 2024-09-15T22:50:36.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.627+0000 7fa45375e740 1 Processor -- start 2024-09-15T22:50:36.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.627+0000 7fa45375e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.627+0000 7fa45375e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa45375e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa45375e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c82a0 con 0x55a05d498dc0 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa45375e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c7b10 con 0x55a05d4a3680 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa45375e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1c4d50 con 0x55a05d494a30 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa45375e740 10 client.0 _ll_register_callbacks cb 0x7fa43c02a9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa44affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53524/0 (socket says 172.21.15.66:53524) 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.628+0000 7fa44affd640 1 -- 172.21.15.66:0/1822308081 learned_addr learned my addr 172.21.15.66:0/1822308081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.630+0000 7fa44affd640 1 -- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 msgr2=0x55a05d4a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.630+0000 7fa44affd640 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a94b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.630+0000 7fa44affd640 1 -- 172.21.15.66:0/1822308081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 msgr2=0x55a05d4a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.630+0000 7fa44affd640 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.630+0000 7fa44affd640 1 -- 172.21.15.66:0/1822308081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a05d4a9af0 con 0x55a05d494a30 2024-09-15T22:50:36.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.633+0000 7fa44affd640 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c54c0 tx=0x7fa43c0bd0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98126b94e262bf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.633+0000 7fa42eff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:50:36.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.633+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c04b070 con 0x55a05d494a30 2024-09-15T22:50:36.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.633+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fa43c03d5e0 con 0x55a05d494a30 2024-09-15T22:50:36.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.634+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa440004410 con 0x55a05d494a30 2024-09-15T22:50:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.634+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa43c0ca050 con 0x55a05d494a30 2024-09-15T22:50:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.636+0000 7fa45375e740 10 client.26068 fetch_fsmap learned FSMap version 38 2024-09-15T22:50:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.636+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a05d51dd40 con 0x55a05d494a30 2024-09-15T22:50:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440004410 con 0x55a05d494a30 2024-09-15T22:50:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7fa43c0bdb80 con 0x55a05d494a30 2024-09-15T22:50:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 10 client.26068 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T22:50:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 10 client.26068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:50:36.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 20 client.26068 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:36.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d51e300 0x55a05d520780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 4 client.26068 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:50:36.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.637+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a05d405d60 con 0x55a05d51e300 2024-09-15T22:50:36.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.638+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d51e300 0x55a05d520780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.641+0000 7fa42eff5640 10 client.26068 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:36.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.642+0000 7fa44a7fc640 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d51e300 0x55a05d520780 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d70136e1c57ebc3 server_cookie=cc96134e6f462289 in_seq=0 out_seq=0 2024-09-15T22:50:36.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.646+0000 7fa42eff5640 1 -- 172.21.15.66:0/1822308081 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a05d405d60 con 0x55a05d51e300 2024-09-15T22:50:36.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.646+0000 7fa42eff5640 10 client.26068 handle_command_reply: tid=0 2024-09-15T22:50:36.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.646+0000 7fa45375e740 1 client.26068 shutdown 2024-09-15T22:50:36.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.654+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 msgr2=0x55a05d4abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.654+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c54c0 tx=0x7fa43c0bd0b0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.658+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 shutdown_connections 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a05d51e300 0x55a05d520780 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a05d4a3680 0x55a05d4a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a05d498dc0 0x55a05d4a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa45375e740 1 --2- 172.21.15.66:0/1822308081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a05d494a30 0x55a05d4abc20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 >> 172.21.15.66:0/1822308081 conn(0x55a05d4a08a0 msgr2=0x55a05d4932b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.659+0000 7fa42eff5640 0 client.26068 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.662+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 shutdown_connections 2024-09-15T22:50:36.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.662+0000 7fa45375e740 1 -- 172.21.15.66:0/1822308081 wait complete. 2024-09-15T22:50:36.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.663+0000 7fa45375e740 20 client.26068 trim_cache size 0 max 16384 2024-09-15T22:50:36.665 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:50:36.665 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:50:36.665 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:50:36.665 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:50:36.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 msgr2=0x7fa4340a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 0x7fa4340a5c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa444005cc0 tx=0x7fa444005bd0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 msgr2=0x7fa44c118860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009850 tx=0x7fa43c0056d0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 shutdown_connections 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa4340a3760 0x7fa4340a5c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c111e30 0x7fa44c1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa44c11b140 0x7fa44c1118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 --2- 172.21.15.66:0/155026017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa44c109830 0x7fa44c118860 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009850 tx=0x7fa43c0056d0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.664+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 >> 172.21.15.66:0/155026017 conn(0x7fa44c06e140 msgr2=0x7fa44c11c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.665+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 shutdown_connections 2024-09-15T22:50:36.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:36.665+0000 7fa451385640 1 -- 172.21.15.66:0/155026017 wait complete. 2024-09-15T22:50:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:37 smithi066 ceph-mon[31185]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-09-15T22:50:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:37 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:50:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:37 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:50:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:37 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:50:37.549 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:50:37.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:50:37.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:37 smithi087 ceph-mon[35290]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-09-15T22:50:37.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:37 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:50:37.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:37 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:50:37.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:37 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:50:37.677 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:37 smithi184 ceph-mon[35203]: pgmap v160: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 5.7 MiB/s wr, 632 op/s 2024-09-15T22:50:37.677 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:37 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:50:37.677 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:37 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:50:37.677 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:37 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:50:39.143 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:39 smithi087 ceph-mon[35290]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 656 op/s 2024-09-15T22:50:39.664 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:39 smithi066 ceph-mon[31185]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 656 op/s 2024-09-15T22:50:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:39 smithi184 ceph-mon[35203]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 8.2 MiB/s wr, 656 op/s 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.327+0000 7efe2b504640 1 -- 172.21.15.66:0/1631832609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109450 msgr2=0x7efe24109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.327+0000 7efe2b504640 1 --2- 172.21.15.66:0/1631832609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109450 0x7efe24109830 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009ca0 tx=0x7efe1c02a8f0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.328+0000 7efe2b504640 1 -- 172.21.15.66:0/1631832609 shutdown_connections 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.328+0000 7efe2b504640 1 --2- 172.21.15.66:0/1631832609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe240742d0 0x7efe2407bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.328+0000 7efe2b504640 1 --2- 172.21.15.66:0/1631832609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe24109e00 0x7efe24074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.328+0000 7efe2b504640 1 --2- 172.21.15.66:0/1631832609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24109450 0x7efe24109830 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.328+0000 7efe2b504640 1 -- 172.21.15.66:0/1631832609 >> 172.21.15.66:0/1631832609 conn(0x7efe2406e140 msgr2=0x7efe2406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.330+0000 7efe2b504640 1 -- 172.21.15.66:0/1631832609 shutdown_connections 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.336+0000 7efe2b504640 1 -- 172.21.15.66:0/1631832609 wait complete. 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.336+0000 7efe2b504640 1 Processor -- start 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 -- start start 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24109e00 0x7efe2407fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24080020 0x7efe240804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe2407e780 con 0x7efe24080020 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe2407e600 con 0x7efe24109e00 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe2b504640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe2407e900 con 0x7efe240742d0 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe292a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe28a9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24109e00 0x7efe2407fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe292a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53542/0 (socket says 172.21.15.66:53542) 2024-09-15T22:50:40.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.337+0000 7efe292a0640 1 -- 172.21.15.66:0/5517794 learned_addr learned my addr 172.21.15.66:0/5517794 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe29aa1640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24080020 0x7efe240804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe292a0640 1 -- 172.21.15.66:0/5517794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24109e00 msgr2=0x7efe2407fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe292a0640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24109e00 0x7efe2407fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe292a0640 1 -- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24080020 msgr2=0x7efe240804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe292a0640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24080020 0x7efe240804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.343+0000 7efe292a0640 1 -- 172.21.15.66:0/5517794 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241bbfa0 con 0x7efe240742d0 2024-09-15T22:50:40.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.346+0000 7efe292a0640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe1c02ae60 tx=0x7efe1c030820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.347+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c030e20 con 0x7efe240742d0 2024-09-15T22:50:40.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.347+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241bc230 con 0x7efe240742d0 2024-09-15T22:50:40.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.348+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241bc790 con 0x7efe240742d0 2024-09-15T22:50:40.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.349+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe1c036040 con 0x7efe240742d0 2024-09-15T22:50:40.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.349+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c03b8a0 con 0x7efe240742d0 2024-09-15T22:50:40.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.354+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efe1c043030 con 0x7efe240742d0 2024-09-15T22:50:40.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.356+0000 7efe1a7fc640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 0x7efe100a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.357+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efe1c0f06f0 con 0x7efe240742d0 2024-09-15T22:50:40.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.357+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe08005290 con 0x7efe240742d0 2024-09-15T22:50:40.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.358+0000 7efe28a9f640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 0x7efe100a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.366+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe1c0bc650 con 0x7efe240742d0 2024-09-15T22:50:40.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.367+0000 7efe28a9f640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 0x7efe100a59b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe240812a0 tx=0x7efe2000b390 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.860 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:50:40.860 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"btime":"2024-09-15T22:50:34:200729+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:50:33.952699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:50:40.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.852+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe08005850 con 0x7efe240742d0 2024-09-15T22:50:40.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.853+0000 7efe1a7fc640 1 -- 172.21.15.66:0/5517794 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11989 (secure 0 0 0) 0x7efe1c0c0950 con 0x7efe240742d0 2024-09-15T22:50:40.861 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 38 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 msgr2=0x7efe100a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 0x7efe100a59b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe240812a0 tx=0x7efe2000b390 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 msgr2=0x7efe24084a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe1c02ae60 tx=0x7efe1c030820 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 shutdown_connections 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efe100a34f0 0x7efe100a59b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe24080020 0x7efe240804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24109e00 0x7efe2407fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 --2- 172.21.15.66:0/5517794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240742d0 0x7efe24084a50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 >> 172.21.15.66:0/5517794 conn(0x7efe2406e140 msgr2=0x7efe240719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 shutdown_connections 2024-09-15T22:50:40.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:40.859+0000 7efe2b504640 1 -- 172.21.15.66:0/5517794 wait complete. 2024-09-15T22:50:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:41 smithi087 ceph-mon[35290]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 743 op/s 2024-09-15T22:50:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:41 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/5517794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:41.661 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:41 smithi066 ceph-mon[31185]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 743 op/s 2024-09-15T22:50:41.662 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:41 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/5517794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:41 smithi184 ceph-mon[35203]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 743 op/s 2024-09-15T22:50:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:41 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/5517794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:42.112 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:50:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:43 smithi087 ceph-mon[35290]: pgmap v163: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 670 op/s 2024-09-15T22:50:43.642 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T22:50:43.643 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.35 2024-09-15T22:50:43.643 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:50:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:43 smithi184 ceph-mon[35203]: pgmap v163: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 670 op/s 2024-09-15T22:50:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:43 smithi066 ceph-mon[31185]: pgmap v163: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 670 op/s 2024-09-15T22:50:44.588 INFO:tasks.workunit.client.0.smithi066.stdout: 396 1557655 1366 1032159 1676 439988 1691 2024-09-15T22:50:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:45 smithi087 ceph-mon[35290]: pgmap v164: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 768 op/s 2024-09-15T22:50:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:45 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:45 smithi184 ceph-mon[35203]: pgmap v164: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 768 op/s 2024-09-15T22:50:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:45 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:45.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:45 smithi066 ceph-mon[31185]: pgmap v164: 129 pgs: 129 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 768 op/s 2024-09-15T22:50:45.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:45 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:47 smithi087 ceph-mon[35290]: pgmap v165: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 707 op/s 2024-09-15T22:50:47.609 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:47 smithi066 ceph-mon[31185]: pgmap v165: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 707 op/s 2024-09-15T22:50:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:47 smithi184 ceph-mon[35203]: pgmap v165: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 707 op/s 2024-09-15T22:50:48.992 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:49 smithi087 ceph-mon[35290]: pgmap v166: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 674 op/s 2024-09-15T22:50:49.664 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:49 smithi066 ceph-mon[31185]: pgmap v166: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 674 op/s 2024-09-15T22:50:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:49 smithi184 ceph-mon[35203]: pgmap v166: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 674 op/s 2024-09-15T22:50:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:50 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:50.635 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:50 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:50.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:50 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:50:50.712 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:50.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.712+0000 7efce0144640 1 -- 172.21.15.66:0/1368244204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 msgr2=0x7efcd811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.713+0000 7efce0144640 1 --2- 172.21.15.66:0/1368244204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd811d530 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efcd001acb0 tx=0x7efcd003b920 comp rx=0 tx=0).stop 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.716+0000 7efce0144640 1 -- 172.21.15.66:0/1368244204 shutdown_connections 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.716+0000 7efce0144640 1 --2- 172.21.15.66:0/1368244204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd811d530 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.716+0000 7efce0144640 1 --2- 172.21.15.66:0/1368244204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109830 0x7efcd8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.716+0000 7efce0144640 1 --2- 172.21.15.66:0/1368244204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109450 0x7efcd8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.716+0000 7efce0144640 1 -- 172.21.15.66:0/1368244204 >> 172.21.15.66:0/1368244204 conn(0x7efcd806e140 msgr2=0x7efcd806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.717+0000 7efce0144640 1 -- 172.21.15.66:0/1368244204 shutdown_connections 2024-09-15T22:50:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.718+0000 7efce0144640 1 -- 172.21.15.66:0/1368244204 wait complete. 2024-09-15T22:50:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.720+0000 7efce0144640 1 Processor -- start 2024-09-15T22:50:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.720+0000 7efce0144640 1 -- start start 2024-09-15T22:50:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.720+0000 7efce0144640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.721+0000 7efce0144640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 0x7efcd8116970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.721+0000 7efce0144640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd8116eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.721+0000 7efce0144640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efcd8113390 con 0x7efcd811b140 2024-09-15T22:50:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.721+0000 7efce0144640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcd8113210 con 0x7efcd8109830 2024-09-15T22:50:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.721+0000 7efce0144640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efcd8113510 con 0x7efcd8109450 2024-09-15T22:50:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcddee0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 0x7efcd8116970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 0x7efcd8116970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:51894/0 (socket says 172.21.15.66:51894) 2024-09-15T22:50:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcddee0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49346/0 (socket says 172.21.15.66:49346) 2024-09-15T22:50:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcddee0640 1 -- 172.21.15.66:0/629745774 learned_addr learned my addr 172.21.15.66:0/629745774 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.722+0000 7efcde6e1640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd8116eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.723+0000 7efcddee0640 1 -- 172.21.15.66:0/629745774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 msgr2=0x7efcd8116970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.723+0000 7efcddee0640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 0x7efcd8116970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.723+0000 7efcddee0640 1 -- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 msgr2=0x7efcd8116eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.723+0000 7efcddee0640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd8116eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.723+0000 7efcddee0640 1 -- 172.21.15.66:0/629745774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd81175e0 con 0x7efcd8109450 2024-09-15T22:50:50.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.726+0000 7efcddee0640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efcd400b450 tx=0x7efcd400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.727+0000 7efcceffd640 1 -- 172.21.15.66:0/629745774 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4015020 con 0x7efcd8109450 2024-09-15T22:50:50.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.727+0000 7efcceffd640 1 -- 172.21.15.66:0/629745774 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd4011d70 con 0x7efcd8109450 2024-09-15T22:50:50.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.727+0000 7efce0144640 1 -- 172.21.15.66:0/629745774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd81ab170 con 0x7efcd8109450 2024-09-15T22:50:50.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.727+0000 7efce0144640 1 -- 172.21.15.66:0/629745774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd81ab620 con 0x7efcd8109450 2024-09-15T22:50:50.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.732+0000 7efce251d740 1 Processor -- start 2024-09-15T22:50:50.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efcceffd640 1 -- 172.21.15.66:0/629745774 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd400f340 con 0x7efcd8109450 2024-09-15T22:50:50.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 -- start start 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212ef4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563212e4d2f0 con 0x563212ee7e60 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563212df4cf0 con 0x563212ee73e0 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efce251d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563212e492b0 con 0x563212ee8b40 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efcde6e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efcde6e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49356/0 (socket says 172.21.15.66:49356) 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.733+0000 7efcde6e1640 1 -- 172.21.15.66:0/2058116393 learned_addr learned my addr 172.21.15.66:0/2058116393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.734+0000 7efcde6e1640 1 -- 172.21.15.66:0/2058116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 msgr2=0x563212ee7840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.734+0000 7efcde6e1640 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee7840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.734+0000 7efcde6e1640 1 -- 172.21.15.66:0/2058116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 msgr2=0x563212ef4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.734+0000 7efcde6e1640 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212ef4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.735+0000 7efcde6e1640 1 -- 172.21.15.66:0/2058116393 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563212dd93a0 con 0x563212ee8b40 2024-09-15T22:50:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.735+0000 7efcde6e1640 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcd0046000 tx=0x7efcd0040400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6921afaea0cf59b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.736+0000 7efcc37fe640 1 -- 172.21.15.66:0/2058116393 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0045070 con 0x563212ee8b40 2024-09-15T22:50:50.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.736+0000 7efcc37fe640 1 -- 172.21.15.66:0/2058116393 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcd0003e50 con 0x563212ee8b40 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 -- 172.21.15.66:0/2058116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 msgr2=0x563212ee8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcd0046000 tx=0x7efcd0040400 comp rx=0 tx=0).stop 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 -- 172.21.15.66:0/2058116393 shutdown_connections 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212ef4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 --2- 172.21.15.66:0/2058116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee8b40 0x563212ee8f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.738+0000 7efce251d740 1 -- 172.21.15.66:0/2058116393 >> 172.21.15.66:0/2058116393 conn(0x563212eb0310 msgr2=0x563212ee3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.742+0000 7efce251d740 1 -- 172.21.15.66:0/2058116393 shutdown_connections 2024-09-15T22:50:50.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.742+0000 7efcceffd640 1 -- 172.21.15.66:0/629745774 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efcd4018020 con 0x7efcd8109450 2024-09-15T22:50:50.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.744+0000 7efcceffd640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 0x7efcc40a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.744+0000 7efcceffd640 1 -- 172.21.15.66:0/629745774 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efcd4099920 con 0x7efcd8109450 2024-09-15T22:50:50.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.745+0000 7efce251d740 1 -- 172.21.15.66:0/2058116393 wait complete. 2024-09-15T22:50:50.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.745+0000 7efce251d740 1 -- start start 2024-09-15T22:50:50.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.745+0000 7efce251d740 1 Processor -- start 2024-09-15T22:50:50.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ef42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563212ef5060 con 0x563212ef1a90 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563212e08060 con 0x563212ee73e0 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563212ef51e0 con 0x563212ee7e60 2024-09-15T22:50:50.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.746+0000 7efce251d740 10 client.0 _ll_register_callbacks cb 0x563212b5b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:50.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.747+0000 7efcde6e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.747+0000 7efcde6e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55414/0 (socket says 172.21.15.66:55414) 2024-09-15T22:50:50.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.747+0000 7efcde6e1640 1 -- 172.21.15.66:0/4205647810 learned_addr learned my addr 172.21.15.66:0/4205647810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:50.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcddee0640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ef42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcde6e1640 1 -- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 msgr2=0x563212ef1550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcde6e1640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef1550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcde6e1640 1 -- 172.21.15.66:0/4205647810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 msgr2=0x563212ef42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcde6e1640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ef42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.748+0000 7efcde6e1640 1 -- 172.21.15.66:0/4205647810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563212bbe3c0 con 0x563212ef1a90 2024-09-15T22:50:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.749+0000 7efcde6e1640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efcd003bf10 tx=0x7efcd0042dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37951eacdfce2152 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.749+0000 7efcdd6df640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 0x7efcc40a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.749+0000 7efcc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:50:50.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.750+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0045040 con 0x563212ef1a90 2024-09-15T22:50:50.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.750+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563212e5a860 con 0x563212ef1a90 2024-09-15T22:50:50.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.750+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efcd0003b80 con 0x563212ef1a90 2024-09-15T22:50:50.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.751+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efcd0066050 con 0x563212ef1a90 2024-09-15T22:50:50.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.753+0000 7efce251d740 10 client.16569 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:50.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.753+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x563212ef5060 con 0x563212ef1a90 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.753+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563212e5a860 con 0x563212ef1a90 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.753+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7efcd0053020 con 0x563212ef1a90 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 10 client.16569 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 10 client.16569 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 20 client.16569 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f01ef0 0x563212f042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 4 client.16569 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.756+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563212e54d70 con 0x563212f01ef0 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.757+0000 7efcddee0640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f01ef0 0x563212f042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.758+0000 7efcdd6df640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 0x7efcc40a5890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x563212ef2b00 tx=0x7efcc8009530 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.763+0000 7efcddee0640 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f01ef0 0x563212f042e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e0faaf30501fecc8 server_cookie=9c41e67ae400c16 in_seq=0 out_seq=0 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.763+0000 7efcc17fa640 10 client.16569 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.764+0000 7efcc17fa640 1 -- 172.21.15.66:0/4205647810 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563212e54d70 con 0x563212f01ef0 2024-09-15T22:50:50.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.764+0000 7efcc17fa640 10 client.16569 handle_command_reply: tid=0 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.765+0000 7efce251d740 1 client.16569 shutdown 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 msgr2=0x563212ef1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efcd003bf10 tx=0x7efcd0042dc0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 shutdown_connections 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f01ef0 0x563212f042e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212ef1f10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 --2- 172.21.15.66:0/4205647810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ef42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 >> 172.21.15.66:0/4205647810 conn(0x563212eb0310 msgr2=0x563212ee31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.767+0000 7efcc17fa640 0 client.16569 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:50:50.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.768+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 shutdown_connections 2024-09-15T22:50:50.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.768+0000 7efce251d740 1 -- 172.21.15.66:0/4205647810 wait complete. 2024-09-15T22:50:50.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.769+0000 7efce251d740 20 client.16569 trim_cache size 0 max 16384 2024-09-15T22:50:50.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.821+0000 7efce251d740 1 Processor -- start 2024-09-15T22:50:50.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.824+0000 7efce251d740 1 -- start start 2024-09-15T22:50:50.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212eeb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc010180 con 0x563212ef1a90 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc011e40 con 0x563212ee73e0 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efce251d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc010850 con 0x563212ee7e60 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49380/0 (socket says 172.21.15.66:49380) 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.825+0000 7efcdd6df640 1 -- 172.21.15.66:0/2678062266 learned_addr learned my addr 172.21.15.66:0/2678062266 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:50.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.826+0000 7efcddee0640 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 -- 172.21.15.66:0/2678062266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 msgr2=0x563212ee9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 -- 172.21.15.66:0/2678062266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 msgr2=0x563212eeb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212eeb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 -- 172.21.15.66:0/2678062266 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563212ee49d0 con 0x563212ee7e60 2024-09-15T22:50:50.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.828+0000 7efcdd6df640 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efcc8006fd0 tx=0x7efcc8011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a673ad74cf35791a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.837+0000 7efce0144640 1 -- 172.21.15.66:0/2678062266 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc801b040 con 0x563212ee7e60 2024-09-15T22:50:50.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.837+0000 7efce0144640 1 -- 172.21.15.66:0/2678062266 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcc8024070 con 0x563212ee7e60 2024-09-15T22:50:50.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.837+0000 7efce0144640 1 -- 172.21.15.66:0/2678062266 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8013d80 con 0x563212ee7e60 2024-09-15T22:50:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.839+0000 7efce251d740 1 -- 172.21.15.66:0/2678062266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 msgr2=0x563212ef34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.839+0000 7efce251d740 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efcc8006fd0 tx=0x7efcc8011000 comp rx=0 tx=0).stop 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.843+0000 7efce251d740 1 -- 172.21.15.66:0/2678062266 shutdown_connections 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.843+0000 7efce251d740 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ef1a90 0x563212eeb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.843+0000 7efce251d740 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee7e60 0x563212ef34c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.843+0000 7efce251d740 1 --2- 172.21.15.66:0/2678062266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ee73e0 0x563212ee9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.843+0000 7efce251d740 1 -- 172.21.15.66:0/2678062266 >> 172.21.15.66:0/2678062266 conn(0x563212eb0310 msgr2=0x563212ef2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.846+0000 7efce251d740 1 -- 172.21.15.66:0/2678062266 shutdown_connections 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.846+0000 7efce251d740 1 -- 172.21.15.66:0/2678062266 wait complete. 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.847+0000 7efce251d740 1 -- start start 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.847+0000 7efce251d740 1 Processor -- start 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.848+0000 7efce251d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee73e0 0x563212eeb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.848+0000 7efce251d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.848+0000 7efce251d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ef1a90 0x563212eebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.848+0000 7efce251d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0116b0 con 0x563212ee7e60 2024-09-15T22:50:50.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.849+0000 7efce251d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc010f20 con 0x563212ef1a90 2024-09-15T22:50:50.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.849+0000 7efce251d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc00e160 con 0x563212ee73e0 2024-09-15T22:50:50.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.849+0000 7efce251d740 10 client.0 _ll_register_callbacks cb 0x7efcd001ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:50.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.850+0000 7efcde6e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ef1a90 0x563212eebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.850+0000 7efcddee0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee73e0 0x563212eeb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.851+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.851+0000 7efcdd6df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55436/0 (socket says 172.21.15.66:55436) 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.851+0000 7efcdd6df640 1 -- 172.21.15.66:0/3872423179 learned_addr learned my addr 172.21.15.66:0/3872423179 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 -- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee73e0 msgr2=0x563212eeb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee73e0 0x563212eeb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 -- 172.21.15.66:0/3872423179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ef1a90 msgr2=0x563212eebef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ef1a90 0x563212eebef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 -- 172.21.15.66:0/3872423179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563212ef9840 con 0x563212ee7e60 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.852+0000 7efcdd6df640 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efcc8015850 tx=0x7efcc8013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5d5b02768f4a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.853+0000 7efcc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:50:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.853+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc802f020 con 0x563212ee7e60 2024-09-15T22:50:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.853+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcc8024070 con 0x563212ee7e60 2024-09-15T22:50:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.853+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7efcc8013d70 con 0x563212ee7e60 2024-09-15T22:50:50.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.854+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efcc803a050 con 0x563212ee7e60 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.854+0000 7efce251d740 10 client.16572 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.854+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x563212efab40 con 0x563212ee7e60 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.859+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcc8028900 con 0x563212ee7e60 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.859+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7efcc801e030 con 0x563212ee7e60 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.859+0000 7efce251d740 10 client.16572 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:50.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.859+0000 7efce251d740 10 client.16572 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:50:50.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.859+0000 7efce251d740 20 client.16572 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:50.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.860+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f6c960 0x563212f6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.860+0000 7efce251d740 4 client.16572 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:50:50.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.860+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7efcc8024070 con 0x563212f6c960 2024-09-15T22:50:50.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.865+0000 7efcddee0640 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f6c960 0x563212f6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.866+0000 7efcddee0640 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f6c960 0x563212f6ed50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b73cff6b2e5e036 server_cookie=f64c08901a6140b in_seq=0 out_seq=0 2024-09-15T22:50:50.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.867+0000 7efcc17fa640 10 client.16572 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:50:50.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.870+0000 7efcc17fa640 1 -- 172.21.15.66:0/3872423179 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7efcc8024070 con 0x563212f6c960 2024-09-15T22:50:50.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.870+0000 7efcc17fa640 10 client.16572 handle_command_reply: tid=0 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.870+0000 7efce251d740 1 client.16572 shutdown 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.871+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 msgr2=0x563212eeb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.871+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efcc8015850 tx=0x7efcc8013680 comp rx=0 tx=0).stop 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 shutdown_connections 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x563212f6c960 0x563212f6ed50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563212ef1a90 0x563212eebef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563212ee7e60 0x563212eeb970 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 --2- 172.21.15.66:0/3872423179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563212ee73e0 0x563212eeb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 >> 172.21.15.66:0/3872423179 conn(0x563212eb0310 msgr2=0x563212ee31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.875+0000 7efcc17fa640 0 client.16572 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:50:50.888 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.878+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 shutdown_connections 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.878+0000 7efce251d740 1 -- 172.21.15.66:0/3872423179 wait complete. 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.879+0000 7efce251d740 20 client.16572 trim_cache size 0 max 16384 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 msgr2=0x7efcc40a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 0x7efcc40a5890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x563212ef2b00 tx=0x7efcc8009530 comp rx=0 tx=0).stop 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 msgr2=0x7efcd811a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efcd400b450 tx=0x7efcd400b910 comp rx=0 tx=0).stop 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 shutdown_connections 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efcc40a33d0 0x7efcc40a5890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcd811b140 0x7efcd8116eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd8109830 0x7efcd8116970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 --2- 172.21.15.66:0/629745774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efcd8109450 0x7efcd811a8d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 >> 172.21.15.66:0/629745774 conn(0x7efcd806e140 msgr2=0x7efcd8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.880+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 shutdown_connections 2024-09-15T22:50:50.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:50.881+0000 7efcccff9640 1 -- 172.21.15.66:0/629745774 wait complete. 2024-09-15T22:50:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:51 smithi184 ceph-mon[35203]: pgmap v167: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 637 op/s 2024-09-15T22:50:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:51 smithi066 ceph-mon[31185]: pgmap v167: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 637 op/s 2024-09-15T22:50:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:51 smithi087 ceph-mon[35290]: pgmap v167: 129 pgs: 129 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 637 op/s 2024-09-15T22:50:52.141 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 -- 172.21.15.66:0/367627634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 msgr2=0x7fe31810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 --2- 172.21.15.66:0/367627634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 0x7fe31810ce00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe310009be0 tx=0x7fe31002a710 comp rx=0 tx=0).stop 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 -- 172.21.15.66:0/367627634 shutdown_connections 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 --2- 172.21.15.66:0/367627634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe3181150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 --2- 172.21.15.66:0/367627634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 0x7fe31810ce00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 --2- 172.21.15.66:0/367627634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe318108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.884+0000 7fe31e054640 1 -- 172.21.15.66:0/367627634 >> 172.21.15.66:0/367627634 conn(0x7fe318077ba0 msgr2=0x7fe318079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.892+0000 7fe31e054640 1 -- 172.21.15.66:0/367627634 shutdown_connections 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.892+0000 7fe31e054640 1 -- 172.21.15.66:0/367627634 wait complete. 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.894+0000 7fe31e054640 1 Processor -- start 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.894+0000 7fe31e054640 1 -- start start 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe31e054640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe3181a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe31e054640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 0x7fe3181a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe31e054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe31819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe31e054640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe318118530 con 0x7fe31810d530 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe317fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe31819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe317fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe31819e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35880/0 (socket says 172.21.15.66:35880) 2024-09-15T22:50:52.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.895+0000 7fe317fff640 1 -- 172.21.15.66:0/698269585 learned_addr learned my addr 172.21.15.66:0/698269585 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.899+0000 7fe3177fe640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe3181a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.899+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181183b0 con 0x7fe318108450 2024-09-15T22:50:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.899+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181186b0 con 0x7fe318108e00 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.901+0000 7fe3177fe640 1 -- 172.21.15.66:0/698269585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 msgr2=0x7fe3181a4c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.901+0000 7fe3177fe640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 0x7fe3181a4c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.901+0000 7fe3177fe640 1 -- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 msgr2=0x7fe31819e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.901+0000 7fe3177fe640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe31819e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.901+0000 7fe3177fe640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31819efb0 con 0x7fe318108450 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.902+0000 7fe3177fe640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe3181a46c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00e790 tx=0x7fe30c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.903+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00eea0 con 0x7fe318108450 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.904+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31819f2a0 con 0x7fe318108450 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.904+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3181ab590 con 0x7fe318108450 2024-09-15T22:50:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.904+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c00ccc0 con 0x7fe318108450 2024-09-15T22:50:52.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.904+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c018820 con 0x7fe318108450 2024-09-15T22:50:52.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.906+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304005290 con 0x7fe318108450 2024-09-15T22:50:52.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.909+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe30c0189c0 con 0x7fe318108450 2024-09-15T22:50:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.910+0000 7fe314ff9640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 0x7fe3000a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.911+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fe30c0d03d0 con 0x7fe318108450 2024-09-15T22:50:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.914+0000 7fe316ffd640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 0x7fe3000a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.915+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe30c0541b0 con 0x7fe318108450 2024-09-15T22:50:52.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:52.915+0000 7fe316ffd640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 0x7fe3000a5a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe31002ad00 tx=0x7fe310005fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:53.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.376+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe304005850 con 0x7fe318108450 2024-09-15T22:50:53.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.380+0000 7fe314ff9640 1 -- 172.21.15.66:0/698269585 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11995 (secure 0 0 0) 0x7fe30c09c980 con 0x7fe318108450 2024-09-15T22:50:53.383 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:50:53.383 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":40,"btime":"2024-09-15T22:50:49:303898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:50:48.952823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:50:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 40 2024-09-15T22:50:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 msgr2=0x7fe3000a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 0x7fe3000a5a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe31002ad00 tx=0x7fe310005fd0 comp rx=0 tx=0).stop 2024-09-15T22:50:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 msgr2=0x7fe3181a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:53.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe3181a46c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00e790 tx=0x7fe30c00ec50 comp rx=0 tx=0).stop 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 shutdown_connections 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe3000a3580 0x7fe3000a5a40 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe31002ad00 tx=0x7fe310005fd0 comp rx=0 tx=0).stop 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31810d530 0x7fe31819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318108e00 0x7fe3181a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 --2- 172.21.15.66:0/698269585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe318108450 0x7fe3181a46c0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00e790 tx=0x7fe30c00ec50 comp rx=0 tx=0).stop 2024-09-15T22:50:53.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.387+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 >> 172.21.15.66:0/698269585 conn(0x7fe318077ba0 msgr2=0x7fe318078eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:53.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.390+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 shutdown_connections 2024-09-15T22:50:53.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:53.391+0000 7fe31e054640 1 -- 172.21.15.66:0/698269585 wait complete. 2024-09-15T22:50:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:53 smithi184 ceph-mon[35203]: pgmap v168: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.7 MiB/s wr, 489 op/s 2024-09-15T22:50:53.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:53 smithi066 ceph-mon[31185]: pgmap v168: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.7 MiB/s wr, 489 op/s 2024-09-15T22:50:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:53 smithi087 ceph-mon[35290]: pgmap v168: 129 pgs: 129 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 7.7 MiB/s wr, 489 op/s 2024-09-15T22:50:54.413 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:54 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/698269585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:54.414 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 145.35 --await-for 45.0' 2024-09-15T22:50:54.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 145.35 --await-for 45.0 2024-09-15T22:50:54.588 INFO:tasks.workunit.client.0.smithi066.stdout: 418 1669738 1307 1123772 1205 459392 1301 2024-09-15T22:50:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:54 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/698269585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:54.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:54 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/698269585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:50:55.558 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:55 smithi184 ceph-mon[35203]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-15T22:50:55.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:55 smithi066 ceph-mon[31185]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-15T22:50:55.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:55 smithi087 ceph-mon[35290]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 601 op/s 2024-09-15T22:50:56.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:56 smithi066 ceph-mon[31185]: pgmap v170: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-15T22:50:56.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:56 smithi087 ceph-mon[35290]: pgmap v170: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-15T22:50:56.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:56 smithi184 ceph-mon[35203]: pgmap v170: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 614 op/s 2024-09-15T22:50:57.478 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:50:57.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 -- 172.21.15.66:0/3243213410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0102790 msgr2=0x7f4dd01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 --2- 172.21.15.66:0/3243213410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0102790 0x7f4dd01067e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009be0 tx=0x7f4dc802a710 comp rx=0 tx=0).stop 2024-09-15T22:50:57.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 -- 172.21.15.66:0/3243213410 shutdown_connections 2024-09-15T22:50:57.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 --2- 172.21.15.66:0/3243213410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0106f10 0x7f4dd010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 --2- 172.21.15.66:0/3243213410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0102790 0x7f4dd01067e0 secure :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009be0 tx=0x7f4dc802a710 comp rx=0 tx=0).stop 2024-09-15T22:50:57.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 --2- 172.21.15.66:0/3243213410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dd0101de0 0x7f4dd01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.500+0000 7f4dd65a0640 1 -- 172.21.15.66:0/3243213410 >> 172.21.15.66:0/3243213410 conn(0x7f4dd00fd8e0 msgr2=0x7f4dd00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.505+0000 7f4dd65a0640 1 -- 172.21.15.66:0/3243213410 shutdown_connections 2024-09-15T22:50:57.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.508+0000 7f4dd65a0640 1 -- 172.21.15.66:0/3243213410 wait complete. 2024-09-15T22:50:57.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.509+0000 7f4dd65a0640 1 Processor -- start 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 -- start start 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0106f10 0x7f4dd01115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dd0111ae0 0x7f4dd0111f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010fdb0 con 0x7f4dd0106f10 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010fc30 con 0x7f4dd0111ae0 2024-09-15T22:50:57.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.511+0000 7f4dd65a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010ff30 con 0x7f4dd0101de0 2024-09-15T22:50:57.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.513+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.513+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35920/0 (socket says 172.21.15.66:35920) 2024-09-15T22:50:57.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.513+0000 7f4dcffff640 1 -- 172.21.15.66:0/2312132219 learned_addr learned my addr 172.21.15.66:0/2312132219 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:57.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.514+0000 7f4dcffff640 1 -- 172.21.15.66:0/2312132219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dd0111ae0 msgr2=0x7f4dd0111f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:57.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.514+0000 7f4dcffff640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dd0111ae0 0x7f4dd0111f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.514+0000 7f4dcffff640 1 -- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0106f10 msgr2=0x7f4dd01115a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.514+0000 7f4dcffff640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0106f10 0x7f4dd01115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.514+0000 7f4dcffff640 1 -- 172.21.15.66:0/2312132219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd006bc40 con 0x7f4dd0101de0 2024-09-15T22:50:57.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.515+0000 7f4dcffff640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000ea20 tx=0x7f4dc000eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.516+0000 7f4dcd7fa640 1 -- 172.21.15.66:0/2312132219 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000cd80 con 0x7f4dd0101de0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.516+0000 7f4dcd7fa640 1 -- 172.21.15.66:0/2312132219 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc0010910 con 0x7f4dd0101de0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.516+0000 7f4dcd7fa640 1 -- 172.21.15.66:0/2312132219 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0018980 con 0x7f4dd0101de0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.516+0000 7f4dd65a0640 1 -- 172.21.15.66:0/2312132219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd006bf30 con 0x7f4dd0101de0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.516+0000 7f4dd65a0640 1 -- 172.21.15.66:0/2312132219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd006c420 con 0x7f4dd0101de0 2024-09-15T22:50:57.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.521+0000 7f4dd8979740 1 Processor -- start 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 -- start start 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fd3e0 0x55a1489fd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fde60 0x55a148a0a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a1489632f0 con 0x55a1489fd3e0 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a14890acf0 con 0x55a1489feb40 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd8979740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a14895f2b0 con 0x55a1489fde60 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37232/0 (socket says 172.21.15.66:37232) 2024-09-15T22:50:57.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.523+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/44256765 learned_addr learned my addr 172.21.15.66:0/44256765 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:57.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.525+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/44256765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fde60 msgr2=0x55a148a0a640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:57.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.525+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fde60 0x55a148a0a640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.525+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/44256765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fd3e0 msgr2=0x55a1489fd840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:57.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.525+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fd3e0 0x55a1489fd840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.525+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/44256765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1488ef3a0 con 0x55a1489feb40 2024-09-15T22:50:57.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.527+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009a50 tx=0x7f4dc4009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7caa7c4747169ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.529+0000 7f4dcd7fa640 1 -- 172.21.15.66:0/2312132219 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4dc0010ac0 con 0x7f4dd0101de0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.530+0000 7f4dcd7fa640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 0x7f4db80a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.531+0000 7f4dcd7fa640 1 -- 172.21.15.66:0/2312132219 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4dc00d06a0 con 0x7f4dd0101de0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.532+0000 7f4dd65a0640 1 -- 172.21.15.66:0/44256765 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400ec10 con 0x55a1489feb40 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.532+0000 7f4dd65a0640 1 -- 172.21.15.66:0/44256765 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc400edb0 con 0x55a1489feb40 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.532+0000 7f4dd65a0640 1 -- 172.21.15.66:0/44256765 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4010430 con 0x55a1489feb40 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.533+0000 7f4dcffff640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 0x7f4db80a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.536+0000 7f4dd8979740 1 -- 172.21.15.66:0/44256765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 msgr2=0x55a1489fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.536+0000 7f4dd8979740 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009a50 tx=0x7f4dc4009f10 comp rx=0 tx=0).stop 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dcffff640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 0x7f4db80a5aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55a1489fae80 tx=0x7f4dc0009590 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dd8979740 1 -- 172.21.15.66:0/44256765 shutdown_connections 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dd8979740 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fde60 0x55a148a0a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dd8979740 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fd3e0 0x55a1489fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dd8979740 1 --2- 172.21.15.66:0/44256765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489feb40 0x55a1489fef20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.539+0000 7f4dd8979740 1 -- 172.21.15.66:0/44256765 >> 172.21.15.66:0/44256765 conn(0x55a1489c6310 msgr2=0x55a1489f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.543+0000 7f4dd8979740 1 -- 172.21.15.66:0/44256765 shutdown_connections 2024-09-15T22:50:57.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.544+0000 7f4dd8979740 1 -- 172.21.15.66:0/44256765 wait complete. 2024-09-15T22:50:57.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.544+0000 7f4dd8979740 1 -- start start 2024-09-15T22:50:57.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.545+0000 7f4dd8979740 1 Processor -- start 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489feb40 0x55a148a07c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a148a0b070 con 0x55a1489fde60 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a14891e060 con 0x55a1489fd3e0 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a148a0b1f0 con 0x55a1489feb40 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd8979740 10 client.0 _ll_register_callbacks cb 0x55a1486718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.549+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37240/0 (socket says 172.21.15.66:37240) 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/3004562121 learned_addr learned my addr 172.21.15.66:0/3004562121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489feb40 0x55a148a07c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489feb40 msgr2=0x55a148a07c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489feb40 0x55a148a07c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/3004562121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 msgr2=0x55a148a07750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a07750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.550+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/3004562121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1486d43c0 con 0x55a1489fd3e0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4004a90 tx=0x7f4dc4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd631cdcf66e3e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4daf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc404d060 con 0x55a1489fd3e0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc400edb0 con 0x55a1489fd3e0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4dc400ea90 con 0x55a1489fd3e0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4dc4054050 con 0x55a1489fd3e0 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4dd8979740 10 client.26093 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a148a16a30 con 0x55a1489fd3e0 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.551+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc400edb0 con 0x55a1489fd3e0 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f4dc4048400 con 0x55a1489fd3e0 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 10 client.26093 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 10 client.26093 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 20 client.26093 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a148a18180 0x55a148a1a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 4 client.26093 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:57.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.553+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a148970860 con 0x55a148a18180 2024-09-15T22:50:57.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.558+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a148a18180 0x55a148a1a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.565+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a148a18180 0x55a148a1a600 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=de0eb90e38f75df5 server_cookie=bc993dd26ef164fe in_seq=0 out_seq=0 2024-09-15T22:50:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.565+0000 7f4daf7fe640 10 client.26093 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:50:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.569+0000 7f4daf7fe640 1 -- 172.21.15.66:0/3004562121 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a148970860 con 0x55a148a18180 2024-09-15T22:50:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.569+0000 7f4daf7fe640 10 client.26093 handle_command_reply: tid=0 2024-09-15T22:50:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.569+0000 7f4dd8979740 1 client.26093 shutdown 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 msgr2=0x55a148a0a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4004a90 tx=0x7f4dc4004af0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 shutdown_connections 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a148a18180 0x55a148a1a600 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489feb40 0x55a148a07c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a07750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 --2- 172.21.15.66:0/3004562121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489fd3e0 0x55a148a0a4a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.572+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 >> 172.21.15.66:0/3004562121 conn(0x55a1489c6310 msgr2=0x55a1489f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.573+0000 7f4daf7fe640 0 client.26093 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:50:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.584+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 shutdown_connections 2024-09-15T22:50:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.584+0000 7f4dd8979740 1 -- 172.21.15.66:0/3004562121 wait complete. 2024-09-15T22:50:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.584+0000 7f4dd8979740 20 client.26093 trim_cache size 0 max 16384 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.616+0000 7f4dd8979740 1 Processor -- start 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.616+0000 7f4dd8979740 1 -- start start 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a1489fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a1489f9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37246/0 (socket says 172.21.15.66:37246) 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/2489186045 learned_addr learned my addr 172.21.15.66:0/2489186045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b5f80 con 0x55a1489fde60 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b7c40 con 0x55a1489c6310 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b6650 con 0x55a1489fd3e0 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.617+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a1489fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.618+0000 7f4dcf7fe640 1 -- 172.21.15.66:0/2489186045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 msgr2=0x55a148a14310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.618+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.618+0000 7f4dcf7fe640 1 -- 172.21.15.66:0/2489186045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 msgr2=0x55a1489f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.618+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a1489f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.618+0000 7f4dcf7fe640 1 -- 172.21.15.66:0/2489186045 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1489fa460 con 0x55a1489fd3e0 2024-09-15T22:50:57.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.621+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a1489fff30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8008000 tx=0x7f4dc80314e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2f4ef00f14613c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.622+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.629+0000 7f4db5ffb640 1 -- 172.21.15.66:0/2489186045 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8036040 con 0x55a1489fd3e0 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.629+0000 7f4db5ffb640 1 -- 172.21.15.66:0/2489186045 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc8003e50 con 0x55a1489fd3e0 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.629+0000 7f4db5ffb640 1 -- 172.21.15.66:0/2489186045 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80316e0 con 0x55a1489fd3e0 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.631+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 msgr2=0x55a1489fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.631+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a1489fff30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8008000 tx=0x7f4dc80314e0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.633+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 shutdown_connections 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.633+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a1489f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.633+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a1489fff30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.633+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2489186045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a14310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.633+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 >> 172.21.15.66:0/2489186045 conn(0x55a148a07df0 msgr2=0x55a1489f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.636+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 shutdown_connections 2024-09-15T22:50:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.636+0000 7f4dd8979740 1 -- 172.21.15.66:0/2489186045 wait complete. 2024-09-15T22:50:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.637+0000 7f4dd8979740 1 -- start start 2024-09-15T22:50:57.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.637+0000 7f4dd8979740 1 Processor -- start 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.638+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.638+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a148a01f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.638+0000 7f4dd8979740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a02440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.638+0000 7f4dd8979740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b74b0 con 0x55a1489fde60 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd8979740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b6d20 con 0x55a1489c6310 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd8979740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b3f60 con 0x55a1489fd3e0 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a148a01f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd8979740 10 client.0 _ll_register_callbacks cb 0x7f4dc40051a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd4b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37262/0 (socket says 172.21.15.66:37262) 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.639+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/2151721812 learned_addr learned my addr 172.21.15.66:0/2151721812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.640+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 msgr2=0x55a148a01f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.640+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a148a01f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.640+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/2151721812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 msgr2=0x55a148a02440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.640+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a02440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.640+0000 7f4dd4b3d640 1 -- 172.21.15.66:0/2151721812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a148a02b80 con 0x55a1489c6310 2024-09-15T22:50:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.643+0000 7f4dd4b3d640 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e860 tx=0x7f4dc40489c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903109bbc62a63cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.643+0000 7f4daf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:50:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.643+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc404d070 con 0x55a1489c6310 2024-09-15T22:50:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.643+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4dc4048400 con 0x55a1489c6310 2024-09-15T22:50:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.644+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc8003e50 con 0x55a1489c6310 2024-09-15T22:50:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.647+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4dc4004b60 con 0x55a1489c6310 2024-09-15T22:50:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.647+0000 7f4dd8979740 10 client.26096 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:57.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.647+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a148a82ee0 con 0x55a1489c6310 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.651+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc4048600 con 0x55a1489c6310 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.651+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f4dc4057030 con 0x55a1489c6310 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 10 client.26096 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 10 client.26096 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 20 client.26096 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a1489feb40 0x55a148a85510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 4 client.26096 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:50:57.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.652+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4dc8003e50 con 0x55a1489feb40 2024-09-15T22:50:57.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.654+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a1489feb40 0x55a148a85510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.656+0000 7f4daf7fe640 10 client.26096 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:50:57.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.656+0000 7f4dcf7fe640 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a1489feb40 0x55a148a85510 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e0d23d34922ec4c server_cookie=58ee653bb2b95fd in_seq=0 out_seq=0 2024-09-15T22:50:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.661+0000 7f4daf7fe640 1 -- 172.21.15.66:0/2151721812 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4dc8003e50 con 0x55a1489feb40 2024-09-15T22:50:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.661+0000 7f4daf7fe640 10 client.26096 handle_command_reply: tid=0 2024-09-15T22:50:57.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.661+0000 7f4dd8979740 1 client.26096 shutdown 2024-09-15T22:50:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.663+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 msgr2=0x55a148a10aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.663+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400e860 tx=0x7f4dc40489c0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.665+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 shutdown_connections 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.665+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a1489feb40 0x55a148a85510 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.665+0000 7f4daf7fe640 0 client.26096 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.666+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1489fde60 0x55a148a02440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.666+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1489fd3e0 0x55a148a01f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.666+0000 7f4dd8979740 1 --2- 172.21.15.66:0/2151721812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a1489c6310 0x55a148a10aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.666+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 >> 172.21.15.66:0/2151721812 conn(0x55a148a07df0 msgr2=0x55a148a05be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.667+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 shutdown_connections 2024-09-15T22:50:57.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.667+0000 7f4dd8979740 1 -- 172.21.15.66:0/2151721812 wait complete. 2024-09-15T22:50:57.677 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:50:57.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.673+0000 7f4dd8979740 20 client.26096 trim_cache size 0 max 16384 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 msgr2=0x7f4db80a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 0x7f4db80a5aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55a1489fae80 tx=0x7f4dc0009590 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 msgr2=0x7f4dd0117520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000ea20 tx=0x7f4dc000eee0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 shutdown_connections 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db80a35e0 0x7f4db80a5aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dd0111ae0 0x7f4dd0111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dd0106f10 0x7f4dd01115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 --2- 172.21.15.66:0/2312132219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dd0101de0 0x7f4dd0117520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.675+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 >> 172.21.15.66:0/2312132219 conn(0x7f4dd00fd8e0 msgr2=0x7f4dd00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.676+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 shutdown_connections 2024-09-15T22:50:57.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:57.676+0000 7f4db6ffd640 1 -- 172.21.15.66:0/2312132219 wait complete. 2024-09-15T22:50:58.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:50:58.950 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:50:58 smithi066 ceph-mon[31185]: pgmap v171: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 683 op/s 2024-09-15T22:50:59.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:50:58 smithi087 ceph-mon[35290]: pgmap v171: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 683 op/s 2024-09-15T22:50:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:50:58 smithi184 ceph-mon[35203]: pgmap v171: 129 pgs: 129 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 683 op/s 2024-09-15T22:50:59.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 -- 172.21.15.66:0/2332878849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 msgr2=0x7f6690109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 --2- 172.21.15.66:0/2332878849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f6690109c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6688009900 tx=0x7f668802a440 comp rx=0 tx=0).stop 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 -- 172.21.15.66:0/2332878849 shutdown_connections 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 --2- 172.21.15.66:0/2332878849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669011b140 0x7f669011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 --2- 172.21.15.66:0/2332878849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f6690109c90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 --2- 172.21.15.66:0/2332878849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 0x7f6690110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.616+0000 7f6695da8640 1 -- 172.21.15.66:0/2332878849 >> 172.21.15.66:0/2332878849 conn(0x7f669006e140 msgr2=0x7f669006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.617+0000 7f6695da8640 1 -- 172.21.15.66:0/2332878849 shutdown_connections 2024-09-15T22:50:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.618+0000 7f6695da8640 1 -- 172.21.15.66:0/2332878849 wait complete. 2024-09-15T22:50:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.619+0000 7f6695da8640 1 Processor -- start 2024-09-15T22:50:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.626+0000 7f6695da8640 1 -- start start 2024-09-15T22:50:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.626+0000 7f6695da8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 0x7f669011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.626+0000 7f6695da8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f6695da8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669011b140 0x7f66901135a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f6695da8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6690120e10 con 0x7f6690109450 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f6695da8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6690120c90 con 0x7f669011b140 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f6695da8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6690120f90 con 0x7f6690109830 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f668effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f668effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35980/0 (socket says 172.21.15.66:35980) 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f668effd640 1 -- 172.21.15.66:0/1684851352 learned_addr learned my addr 172.21.15.66:0/1684851352 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.627+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 0x7f669011a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 -- 172.21.15.66:0/1684851352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669011b140 msgr2=0x7f66901135a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669011b140 0x7f66901135a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 -- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 msgr2=0x7f669011a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 0x7f669011a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 -- 172.21.15.66:0/1684851352 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6690113e60 con 0x7f6690109830 2024-09-15T22:50:59.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.628+0000 7f668effd640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f668802aa30 tx=0x7f6688003d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.629+0000 7f668cff9640 1 -- 172.21.15.66:0/1684851352 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688041020 con 0x7f6690109830 2024-09-15T22:50:59.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.629+0000 7f668cff9640 1 -- 172.21.15.66:0/1684851352 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6688005160 con 0x7f6690109830 2024-09-15T22:50:59.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.629+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66901140f0 con 0x7f6690109830 2024-09-15T22:50:59.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.629+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901181f0 con 0x7f6690109830 2024-09-15T22:50:59.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.630+0000 7f668cff9640 1 -- 172.21.15.66:0/1684851352 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668803db40 con 0x7f6690109830 2024-09-15T22:50:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.634+0000 7f668cff9640 1 -- 172.21.15.66:0/1684851352 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6688044020 con 0x7f6690109830 2024-09-15T22:50:59.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.638+0000 7f6698181740 1 Processor -- start 2024-09-15T22:50:59.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.638+0000 7f668cff9640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 0x7f667c0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.639+0000 7f668cff9640 1 -- 172.21.15.66:0/1684851352 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f66880f0ed0 con 0x7f6690109830 2024-09-15T22:50:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 -- start start 2024-09-15T22:50:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5612c9455160 con 0x5612c94f0850 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5612c93fc720 con 0x5612c94f1170 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.643+0000 7f6698181740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5612c9451120 con 0x5612c94fba30 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.644+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.644+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35954/0 (socket says 172.21.15.66:35954) 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.644+0000 7f668f7fe640 1 -- 172.21.15.66:0/248690377 learned_addr learned my addr 172.21.15.66:0/248690377 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 -- 172.21.15.66:0/248690377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 msgr2=0x5612c94fde20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fde20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 -- 172.21.15.66:0/248690377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 msgr2=0x5612c94fb4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fb4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 -- 172.21.15.66:0/248690377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c91c6ba0 con 0x5612c94f0850 2024-09-15T22:50:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.645+0000 7f668f7fe640 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6680009fa0 tx=0x7f668000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca86a75772918606 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.647+0000 7f6685ffb640 1 -- 172.21.15.66:0/248690377 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668001a070 con 0x5612c94f0850 2024-09-15T22:50:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.647+0000 7f6685ffb640 1 -- 172.21.15.66:0/248690377 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66800158f0 con 0x5612c94f0850 2024-09-15T22:50:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.648+0000 7f6698181740 1 -- 172.21.15.66:0/248690377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 msgr2=0x5612c94f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.648+0000 7f6698181740 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6680009fa0 tx=0x7f668000c8b0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f668ffff640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 0x7f667c0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f6698181740 1 -- 172.21.15.66:0/248690377 shutdown_connections 2024-09-15T22:50:59.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f6698181740 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f6698181740 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f6698181740 1 --2- 172.21.15.66:0/248690377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94f0c30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.650+0000 7f6698181740 1 -- 172.21.15.66:0/248690377 >> 172.21.15.66:0/248690377 conn(0x5612c94ecde0 msgr2=0x5612c94ed1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.653+0000 7f6698181740 1 -- 172.21.15.66:0/248690377 shutdown_connections 2024-09-15T22:50:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.655+0000 7f6698181740 1 -- 172.21.15.66:0/248690377 wait complete. 2024-09-15T22:50:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 -- start start 2024-09-15T22:50:59.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 Processor -- start 2024-09-15T22:50:59.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c94f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5612c94fe650 con 0x5612c94fba30 2024-09-15T22:50:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5612c93dd900 con 0x5612c94f1170 2024-09-15T22:50:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5612c94fe7d0 con 0x5612c94f0850 2024-09-15T22:50:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.656+0000 7f6698181740 10 client.0 _ll_register_callbacks cb 0x5612c93db780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.657+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.657+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35986/0 (socket says 172.21.15.66:35986) 2024-09-15T22:50:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.657+0000 7f668f7fe640 1 -- 172.21.15.66:0/1849874142 learned_addr learned my addr 172.21.15.66:0/1849874142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:59.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.658+0000 7f668ffff640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c94f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.658+0000 7f668effd640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668ffff640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 0x7f667c0a5a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6678005fd0 tx=0x7f667800b430 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668f7fe640 1 -- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 msgr2=0x5612c94f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668f7fe640 1 -- 172.21.15.66:0/1849874142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 msgr2=0x5612c94f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c94f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.659+0000 7f668f7fe640 1 -- 172.21.15.66:0/1849874142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c941dc50 con 0x5612c94f0850 2024-09-15T22:50:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.661+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6680018040 tx=0x7f6680009d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb7ab6f67d26163 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.662+0000 7f666effd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:50:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.666+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680024020 con 0x5612c94f0850 2024-09-15T22:50:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.666+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66800158f0 con 0x5612c94f0850 2024-09-15T22:50:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.666+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6680015410 con 0x5612c94f0850 2024-09-15T22:50:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.670+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f668001a040 con 0x5612c94f0850 2024-09-15T22:50:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.670+0000 7f6698181740 10 client.26110 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:59.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.670+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5612c950a2c0 con 0x5612c94f0850 2024-09-15T22:50:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.672+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66800158f0 con 0x5612c94f0850 2024-09-15T22:50:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.672+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f668001d030 con 0x5612c94f0850 2024-09-15T22:50:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 10 client.26110 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 10 client.26110 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:50:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 20 client.26110 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c950b610 0x5612c950da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 4 client.26110 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.674+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612c9462890 con 0x5612c950b610 2024-09-15T22:50:59.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.676+0000 7f668effd640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c950b610 0x5612c950da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.679+0000 7f668effd640 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c950b610 0x5612c950da00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc71f88ccb25d4d7 server_cookie=7b791d17aae777d6 in_seq=0 out_seq=0 2024-09-15T22:50:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.679+0000 7f666effd640 10 client.26110 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.684+0000 7f666effd640 1 -- 172.21.15.66:0/1849874142 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612c9462890 con 0x5612c950b610 2024-09-15T22:50:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.684+0000 7f666effd640 10 client.26110 handle_command_reply: tid=0 2024-09-15T22:50:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.684+0000 7f6698181740 1 client.26110 shutdown 2024-09-15T22:50:59.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.687+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 msgr2=0x5612c94f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.687+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6680018040 tx=0x7f6680009d60 comp rx=0 tx=0).stop 2024-09-15T22:50:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 shutdown_connections 2024-09-15T22:50:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c94f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c950b610 0x5612c950da00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 --2- 172.21.15.66:0/1849874142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f87d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.689+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 >> 172.21.15.66:0/1849874142 conn(0x5612c94ecde0 msgr2=0x5612c94f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.693+0000 7f666effd640 0 client.26110 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:50:59.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.695+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 shutdown_connections 2024-09-15T22:50:59.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.699+0000 7f6698181740 1 -- 172.21.15.66:0/1849874142 wait complete. 2024-09-15T22:50:59.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.703+0000 7f6698181740 20 client.26110 trim_cache size 0 max 16384 2024-09-15T22:50:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.754+0000 7f6698181740 1 Processor -- start 2024-09-15T22:50:59.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.754+0000 7f6698181740 1 -- start start 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f6698181740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f6698181740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:36002/0 (socket says 172.21.15.66:36002) 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f668effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f668effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37296/0 (socket says 172.21.15.66:37296) 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.755+0000 7f668f7fe640 1 -- 172.21.15.66:0/1138418506 learned_addr learned my addr 172.21.15.66:0/1138418506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:59.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.757+0000 7f6698181740 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c9513570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.758+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6670010150 con 0x5612c94fba30 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.758+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6670011e10 con 0x5612c94f1170 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.758+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6670010820 con 0x5612c94f0850 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 -- 172.21.15.66:0/1138418506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 msgr2=0x5612c94f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 -- 172.21.15.66:0/1138418506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 msgr2=0x5612c9513570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c9513570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 -- 172.21.15.66:0/1138418506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c94ecc10 con 0x5612c94f1170 2024-09-15T22:50:59.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.759+0000 7f668effd640 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f66880ee250 tx=0x7f668800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76c66a1bdddfe4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.760+0000 7f66857fa640 1 -- 172.21.15.66:0/1138418506 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880c1190 con 0x5612c94f1170 2024-09-15T22:50:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.760+0000 7f66857fa640 1 -- 172.21.15.66:0/1138418506 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66880c0040 con 0x5612c94f1170 2024-09-15T22:50:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.760+0000 7f66857fa640 1 -- 172.21.15.66:0/1138418506 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880b9450 con 0x5612c94f1170 2024-09-15T22:50:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 msgr2=0x5612c9513030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f66880ee250 tx=0x7f668800b040 comp rx=0 tx=0).stop 2024-09-15T22:50:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 shutdown_connections 2024-09-15T22:50:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94fba30 0x5612c9513570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c9513030 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 --2- 172.21.15.66:0/1138418506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94f0850 0x5612c94f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.761+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 >> 172.21.15.66:0/1138418506 conn(0x5612c94ecde0 msgr2=0x5612c94eb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.762+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 shutdown_connections 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.762+0000 7f6698181740 1 -- 172.21.15.66:0/1138418506 wait complete. 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.763+0000 7f6698181740 1 -- start start 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.763+0000 7f6698181740 1 Processor -- start 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6670011680 con 0x5612c94f0850 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6670010ef0 con 0x5612c94f1170 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f667000e130 con 0x5612c94fba30 2024-09-15T22:50:59.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.764+0000 7f6698181740 10 client.0 _ll_register_callbacks cb 0x7f6680018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.765+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.765+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35966/0 (socket says 172.21.15.66:35966) 2024-09-15T22:50:59.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.765+0000 7f668f7fe640 1 -- 172.21.15.66:0/1615127620 learned_addr learned my addr 172.21.15.66:0/1615127620 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.767+0000 7f668f7fe640 1 -- 172.21.15.66:0/1615127620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 msgr2=0x5612c94fd500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.767+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fd500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.767+0000 7f668f7fe640 1 -- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 msgr2=0x5612c94fcfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.767+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fcfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.767+0000 7f668f7fe640 1 -- 172.21.15.66:0/1615127620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c9501f60 con 0x5612c94f0850 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.768+0000 7f668f7fe640 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f66800097e0 tx=0x7f6680015610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7325eec3b515a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.768+0000 7f666effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:50:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.769+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680038060 con 0x5612c94f0850 2024-09-15T22:50:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.769+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66880c0040 con 0x5612c94f0850 2024-09-15T22:50:59.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.769+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6680020420 con 0x5612c94f0850 2024-09-15T22:50:59.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.774+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f668003f050 con 0x5612c94f0850 2024-09-15T22:50:59.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.776+0000 7f6698181740 10 client.16593 fetch_fsmap learned FSMap version 40 2024-09-15T22:50:59.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.776+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5612c9576210 con 0x5612c94f0850 2024-09-15T22:50:59.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.776+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66880c0040 con 0x5612c94f0850 2024-09-15T22:50:59.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.776+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f668001d050 con 0x5612c94f0850 2024-09-15T22:50:59.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 10 client.16593 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:50:59.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 10 client.16593 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:50:59.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 20 client.16593 populate_metadata read hostname 'smithi066' 2024-09-15T22:50:59.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c95768c0 0x5612c9578ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 4 client.16593 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.35, "await_for": 45.0}] 2024-09-15T22:50:59.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.777+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.35, "await_for": 45.0}) -- 0x5612c945cbe0 con 0x5612c95768c0 2024-09-15T22:50:59.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.786+0000 7f668effd640 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c95768c0 0x5612c9578ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.787+0000 7f668effd640 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c95768c0 0x5612c9578ce0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2512a302c0ce0f8c server_cookie=12a8cb3e44cc105c in_seq=0 out_seq=0 2024-09-15T22:50:59.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:50:59.787+0000 7f666effd640 10 client.16593 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:00.232 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:01.004 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:00 smithi066 ceph-mon[31185]: pgmap v172: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 830 op/s 2024-09-15T22:51:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:00 smithi087 ceph-mon[35290]: pgmap v172: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 830 op/s 2024-09-15T22:51:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:00 smithi184 ceph-mon[35203]: pgmap v172: 129 pgs: 129 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 16 MiB/s wr, 830 op/s 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2488472163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4100e20 msgr2=0x7f9ce4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2488472163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4100e20 0x7f9ce4101200 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009900 tx=0x7f9ce002a480 comp rx=0 tx=0).stop 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2488472163 shutdown_connections 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2488472163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102ef0 0x7f9ce410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2488472163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4102570 0x7f9ce41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2488472163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4100e20 0x7f9ce4101200 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2488472163 >> 172.21.15.66:0/2488472163 conn(0x7f9ce40fc7d0 msgr2=0x7f9ce40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2488472163 shutdown_connections 2024-09-15T22:51:01.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.191+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2488472163 wait complete. 2024-09-15T22:51:01.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 Processor -- start 2024-09-15T22:51:01.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 -- start start 2024-09-15T22:51:01.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102570 0x7f9ce40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4102ef0 0x7f9ce40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4110fa0 con 0x7f9ce4102ef0 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4110e20 con 0x7f9ce4100e20 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ceb52e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4111120 con 0x7f9ce4102570 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.192+0000 7f9ce92ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37314/0 (socket says 172.21.15.66:37314) 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 -- 172.21.15.66:0/2593621207 learned_addr learned my addr 172.21.15.66:0/2593621207 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102570 0x7f9ce40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4102ef0 0x7f9ce40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 -- 172.21.15.66:0/2593621207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102570 msgr2=0x7f9ce40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102570 0x7f9ce40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 -- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4102ef0 msgr2=0x7f9ce40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4102ef0 0x7f9ce40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 -- 172.21.15.66:0/2593621207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce41a6a10 con 0x7f9ce4100e20 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ce92ca640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ce002aa70 tx=0x7f9ce0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9cda7fc640 1 -- 172.21.15.66:0/2593621207 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce003f070 con 0x7f9ce4100e20 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce41a6ca0 con 0x7f9ce4100e20 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9cda7fc640 1 -- 172.21.15.66:0/2593621207 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ce0031c30 con 0x7f9ce4100e20 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.193+0000 7f9cda7fc640 1 -- 172.21.15.66:0/2593621207 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0035030 con 0x7f9ce4100e20 2024-09-15T22:51:01.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.194+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce41a7180 con 0x7f9ce4100e20 2024-09-15T22:51:01.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.196+0000 7f9cda7fc640 1 -- 172.21.15.66:0/2593621207 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9ce0042070 con 0x7f9ce4100e20 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.196+0000 7f9ced907740 1 Processor -- start 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.196+0000 7f9ced907740 1 -- start start 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e7d601d2f0 con 0x55e7d60b8b40 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e7d5fc4cf0 con 0x55e7d60b75d0 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ced907740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e7d60192b0 con 0x55e7d60c2370 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce8ac9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce92ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35990/0 (socket says 172.21.15.66:35990) 2024-09-15T22:51:01.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 -- 172.21.15.66:0/314347154 learned_addr learned my addr 172.21.15.66:0/314347154 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 -- 172.21.15.66:0/314347154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 msgr2=0x55e7d60c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 -- 172.21.15.66:0/314347154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 msgr2=0x55e7d60b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce9acb640 1 -- 172.21.15.66:0/314347154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d5fa93a0 con 0x55e7d60b8b40 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.197+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:01.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9cda7fc640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 0x7f9cd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9ce92ca640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 0x7f9cd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009f90 tx=0x7f9cdc010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e809f0bc2918ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9cda7fc640 1 -- 172.21.15.66:0/2593621207 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9ce00f04a0 con 0x7f9ce4100e20 2024-09-15T22:51:01.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9ccf7fe640 1 -- 172.21.15.66:0/314347154 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011700 con 0x55e7d60b8b40 2024-09-15T22:51:01.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9ccf7fe640 1 -- 172.21.15.66:0/314347154 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cdc011d80 con 0x55e7d60b8b40 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.198+0000 7f9ccf7fe640 1 -- 172.21.15.66:0/314347154 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc018380 con 0x55e7d60b8b40 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 -- 172.21.15.66:0/314347154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 msgr2=0x55e7d60b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ce92ca640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 0x7f9cd00a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55e7d60b4ac0 tx=0x7f9ce00f3f50 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009f90 tx=0x7f9cdc010860 comp rx=0 tx=0).stop 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 -- 172.21.15.66:0/314347154 shutdown_connections 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 --2- 172.21.15.66:0/314347154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60b7090 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 -- 172.21.15.66:0/314347154 >> 172.21.15.66:0/314347154 conn(0x55e7d6080310 msgr2=0x55e7d60b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 -- 172.21.15.66:0/314347154 shutdown_connections 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.199+0000 7f9ced907740 1 -- 172.21.15.66:0/314347154 wait complete. 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 -- start start 2024-09-15T22:51:01.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 Processor -- start 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60bf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e7d60c5070 con 0x55e7d60b8b40 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e7d5fd8060 con 0x55e7d60c2370 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e7d60c51f0 con 0x55e7d60b75d0 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ced907740 10 client.0 _ll_register_callbacks cb 0x55e7d5d2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ce8ac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:36044/0 (socket says 172.21.15.66:36044) 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.200+0000 7f9ce9acb640 1 -- 172.21.15.66:0/2197323536 learned_addr learned my addr 172.21.15.66:0/2197323536 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/2197323536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 msgr2=0x55e7d60c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 msgr2=0x55e7d60bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/2197323536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d5d8e3c0 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60bf030 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40fe710 tx=0x7f9cd4012a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87cced5f1eeba69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9cccff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4004030 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9cd40041d0 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.201+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cdc011d80 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9cd40043d0 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 10 client.16605 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e7d60d0c00 con 0x55e7d60b8b40 2024-09-15T22:51:01.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cdc011d80 con 0x55e7d60b8b40 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f9cd4003840 con 0x55e7d60b8b40 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 10 client.16605 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 10 client.16605 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 20 client.16605 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d60d2350 0x55e7d60d4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 4 client.16605 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7d602a860 con 0x55e7d60d2350 2024-09-15T22:51:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.202+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d60d2350 0x55e7d60d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.203+0000 7f9cccff9640 10 client.16605 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.203+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d60d2350 0x55e7d60d4740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14512ffaeb05a60c server_cookie=9d23c1c938828d7a in_seq=0 out_seq=0 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9cccff9640 1 -- 172.21.15.66:0/2197323536 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7d602a860 con 0x55e7d60d2350 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9cccff9640 10 client.16605 handle_command_reply: tid=0 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 client.16605 shutdown 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 msgr2=0x55e7d60bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60bf030 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40fe710 tx=0x7f9cd4012a80 comp rx=0 tx=0).stop 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 shutdown_connections 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d60d2350 0x55e7d60d4740 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60bf030 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 --2- 172.21.15.66:0/2197323536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 >> 172.21.15.66:0/2197323536 conn(0x55e7d6080310 msgr2=0x55e7d60b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9cccff9640 0 client.16605 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:01.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 shutdown_connections 2024-09-15T22:51:01.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 1 -- 172.21.15.66:0/2197323536 wait complete. 2024-09-15T22:51:01.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.221+0000 7f9ced907740 20 client.16605 trim_cache size 0 max 16384 2024-09-15T22:51:01.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 Processor -- start 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 -- start start 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41b1320 con 0x55e7d60b8b40 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41b2fe0 con 0x55e7d60c2370 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ced907740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41b19f0 con 0x55e7d60b75d0 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ce8ac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ce8ac9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36016/0 (socket says 172.21.15.66:36016) 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/1878616656 learned_addr learned my addr 172.21.15.66:0/1878616656 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.238+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/1878616656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 msgr2=0x55e7d60ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/1878616656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 msgr2=0x55e7d60bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 -- 172.21.15.66:0/1878616656 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d60b3ed0 con 0x55e7d60b8b40 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4000c00 tx=0x7f9cd4009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a630fe339c408d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9cceffd640 1 -- 172.21.15.66:0/1878616656 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd402e070 con 0x55e7d60b8b40 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9cceffd640 1 -- 172.21.15.66:0/1878616656 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd40035f0 con 0x55e7d60b8b40 2024-09-15T22:51:01.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.239+0000 7f9cceffd640 1 -- 172.21.15.66:0/1878616656 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4005440 con 0x55e7d60b8b40 2024-09-15T22:51:01.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 -- 172.21.15.66:0/1878616656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 msgr2=0x55e7d60be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4000c00 tx=0x7f9cd4009d80 comp rx=0 tx=0).stop 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 -- 172.21.15.66:0/1878616656 shutdown_connections 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60c2370 0x55e7d60bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60be8f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 --2- 172.21.15.66:0/1878616656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60b75d0 0x55e7d60ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 -- 172.21.15.66:0/1878616656 >> 172.21.15.66:0/1878616656 conn(0x55e7d6080310 msgr2=0x55e7d60ba310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 -- 172.21.15.66:0/1878616656 shutdown_connections 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.241+0000 7f9ced907740 1 -- 172.21.15.66:0/1878616656 wait complete. 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 -- start start 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 Processor -- start 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41b2850 con 0x55e7d60b8b40 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41b20c0 con 0x55e7d60b75d0 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41af300 con 0x55e7d60c2370 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.242+0000 7f9ced907740 10 client.0 _ll_register_callbacks cb 0x7f9cd4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37358/0 (socket says 172.21.15.66:37358) 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 -- 172.21.15.66:0/2371259971 learned_addr learned my addr 172.21.15.66:0/2371259971 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 -- 172.21.15.66:0/2371259971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 msgr2=0x55e7d60c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 -- 172.21.15.66:0/2371259971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 msgr2=0x55e7d60c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.243+0000 7f9ce9acb640 1 -- 172.21.15.66:0/2371259971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d60c6c20 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.244+0000 7f9ce9acb640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc000f80 tx=0x7f9cd4009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7be9266e2285b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.244+0000 7f9cccff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.244+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc032040 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.245+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f9cdc003970 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.245+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cd40035f0 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.245+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9cdc019e50 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.245+0000 7f9ced907740 10 client.26120 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.245+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e7d61454c0 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd40035f0 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f9cdc036070 con 0x55e7d60b75d0 2024-09-15T22:51:01.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 10 client.26120 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 10 client.26120 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 20 client.26120 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d61459a0 0x55e7d6147d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 4 client.26120 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7d6024d70 con 0x55e7d61459a0 2024-09-15T22:51:01.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.246+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d61459a0 0x55e7d6147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.249+0000 7f9ce8ac9640 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d61459a0 0x55e7d6147d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa727c4bfab6a500 server_cookie=d9cc516a82bc782e in_seq=0 out_seq=0 2024-09-15T22:51:01.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.249+0000 7f9cccff9640 10 client.26120 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:01.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.275+0000 7f9cccff9640 1 -- 172.21.15.66:0/2371259971 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7d6024d70 con 0x55e7d61459a0 2024-09-15T22:51:01.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.275+0000 7f9cccff9640 10 client.26120 handle_command_reply: tid=0 2024-09-15T22:51:01.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.275+0000 7f9ced907740 1 client.26120 shutdown 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 msgr2=0x55e7d60caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc000f80 tx=0x7f9cd4009e30 comp rx=0 tx=0).stop 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 shutdown_connections 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55e7d61459a0 0x55e7d6147d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e7d60c2370 0x55e7d60c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9cccff9640 0 client.26120 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e7d60b8b40 0x55e7d60c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 --2- 172.21.15.66:0/2371259971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7d60b75d0 0x55e7d60caba0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 >> 172.21.15.66:0/2371259971 conn(0x55e7d6080310 msgr2=0x55e7d60c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 shutdown_connections 2024-09-15T22:51:01.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.277+0000 7f9ced907740 1 -- 172.21.15.66:0/2371259971 wait complete. 2024-09-15T22:51:01.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.278+0000 7f9ced907740 20 client.26120 trim_cache size 0 max 16384 2024-09-15T22:51:01.281 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.278+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 msgr2=0x7f9cd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.278+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 0x7f9cd00a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55e7d60b4ac0 tx=0x7f9ce00f3f50 comp rx=0 tx=0).stop 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 msgr2=0x7f9ce40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ce002aa70 tx=0x7f9ce0003c10 comp rx=0 tx=0).stop 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 shutdown_connections 2024-09-15T22:51:01.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9cd00a33b0 0x7f9cd00a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ce4102ef0 0x7f9ce40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce4102570 0x7f9ce40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 --2- 172.21.15.66:0/2593621207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ce4100e20 0x7f9ce40fcc80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 >> 172.21.15.66:0/2593621207 conn(0x7f9ce40fc7d0 msgr2=0x7f9ce406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 shutdown_connections 2024-09-15T22:51:01.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:01.279+0000 7f9ceb52e640 1 -- 172.21.15.66:0/2593621207 wait complete. 2024-09-15T22:51:02.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:51:02.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:02 smithi066 ceph-mon[31185]: pgmap v173: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-15T22:51:02.998 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:03.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:02 smithi087 ceph-mon[35290]: pgmap v173: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-15T22:51:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:02 smithi184 ceph-mon[35203]: pgmap v173: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-15T22:51:03.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 -- 172.21.15.66:0/475497927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8100e20 msgr2=0x7f04e8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 --2- 172.21.15.66:0/475497927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8100e20 0x7f04e8101200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009930 tx=0x7f04d802a4d0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 -- 172.21.15.66:0/475497927 shutdown_connections 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 --2- 172.21.15.66:0/475497927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8102ef0 0x7f04e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 --2- 172.21.15.66:0/475497927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 --2- 172.21.15.66:0/475497927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8100e20 0x7f04e8101200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 -- 172.21.15.66:0/475497927 >> 172.21.15.66:0/475497927 conn(0x7f04e80fc7d0 msgr2=0x7f04e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 -- 172.21.15.66:0/475497927 shutdown_connections 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.549+0000 7f04edc28640 1 -- 172.21.15.66:0/475497927 wait complete. 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 Processor -- start 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 -- start start 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8100e20 0x7f04e8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8102ef0 0x7f04e819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8110f80 con 0x7f04e8102570 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8110e00 con 0x7f04e8102ef0 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04edc28640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8111100 con 0x7f04e8100e20 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60252/0 (socket says 172.21.15.66:60252) 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04e6ffd640 1 -- 172.21.15.66:0/1878873679 learned_addr learned my addr 172.21.15.66:0/1878873679 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.550+0000 7f04e77fe640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8100e20 0x7f04e8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e7fff640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8102ef0 0x7f04e819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 -- 172.21.15.66:0/1878873679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8100e20 msgr2=0x7f04e8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8100e20 0x7f04e8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 -- 172.21.15.66:0/1878873679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8102ef0 msgr2=0x7f04e819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8102ef0 0x7f04e819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 -- 172.21.15.66:0/1878873679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e819d520 con 0x7f04e8102570 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009d50 tx=0x7f04dc00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e4ff9640 1 -- 172.21.15.66:0/1878873679 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc004020 con 0x7f04e8102570 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e819d810 con 0x7f04e8102570 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e4ff9640 1 -- 172.21.15.66:0/1878873679 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04dc0041c0 con 0x7f04e8102570 2024-09-15T22:51:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04e4ff9640 1 -- 172.21.15.66:0/1878873679 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc019670 con 0x7f04e8102570 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.551+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e80fcbb0 con 0x7f04e8102570 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.554+0000 7f04e4ff9640 1 -- 172.21.15.66:0/1878873679 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f04dc0035f0 con 0x7f04e8102570 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.554+0000 7f04f0001740 1 Processor -- start 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.554+0000 7f04f0001740 1 -- start start 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b69a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b76760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5636d3acf2f0 con 0x5636d3b6ab40 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5636d3a76cf0 con 0x5636d3b695d0 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04f0001740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5636d3acb2b0 con 0x5636d3b74370 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b69a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60266/0 (socket says 172.21.15.66:60266) 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 -- 172.21.15.66:0/1470924894 learned_addr learned my addr 172.21.15.66:0/1470924894 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b76760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 -- 172.21.15.66:0/1470924894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 msgr2=0x5636d3b76760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b76760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 -- 172.21.15.66:0/1470924894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 msgr2=0x5636d3b69a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b69a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e7fff640 1 -- 172.21.15.66:0/1470924894 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d3a5b3a0 con 0x5636d3b6ab40 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.555+0000 7f04e4ff9640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 0x7f04d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04e7fff640 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009fd0 tx=0x7f04e00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460f57419a170be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04e77fe640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 0x7f04d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04e4ff9640 1 -- 172.21.15.66:0/1878873679 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04dc0d3a90 con 0x7f04e8102570 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04cdffb640 1 -- 172.21.15.66:0/1470924894 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004d20 con 0x5636d3b6ab40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04cdffb640 1 -- 172.21.15.66:0/1470924894 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04e0004050 con 0x5636d3b6ab40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.556+0000 7f04cdffb640 1 -- 172.21.15.66:0/1470924894 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0005260 con 0x5636d3b6ab40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- 172.21.15.66:0/1470924894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 msgr2=0x5636d3b69090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009fd0 tx=0x7f04e00118d0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04e77fe640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 0x7f04d00a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009900 tx=0x7f04d80058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- 172.21.15.66:0/1470924894 shutdown_connections 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b76760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b69a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 --2- 172.21.15.66:0/1470924894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b69090 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- 172.21.15.66:0/1470924894 >> 172.21.15.66:0/1470924894 conn(0x5636d3b32310 msgr2=0x5636d3b65c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- 172.21.15.66:0/1470924894 shutdown_connections 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- 172.21.15.66:0/1470924894 wait complete. 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.557+0000 7f04f0001740 1 -- start start 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 Processor -- start 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b71020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5636d3b77070 con 0x5636d3b6ab40 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5636d3a8a060 con 0x5636d3b695d0 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5636d3b771f0 con 0x5636d3b74370 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04f0001740 10 client.0 _ll_register_callbacks cb 0x5636d37dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47022/0 (socket says 172.21.15.66:47022) 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 -- 172.21.15.66:0/3135195262 learned_addr learned my addr 172.21.15.66:0/3135195262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b71020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e7fff640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 -- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 msgr2=0x5636d3b71610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b71610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 -- 172.21.15.66:0/3135195262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 msgr2=0x5636d3b71020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b71020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.558+0000 7f04e77fe640 1 -- 172.21.15.66:0/3135195262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d38403c0 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04e77fe640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009930 tx=0x7f04d8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd194ebb9c9ecc19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d804e070 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e0004050 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04d8003ac0 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f04d805a050 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04f0001740 10 client.26132 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.559+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5636d3b82b10 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04e0004050 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f04d803d450 con 0x5636d3b695d0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 10 client.26132 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 10 client.26132 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 20 client.26132 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3b84410 0x5636d3b86800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 4 client.26132 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636d3adc860 con 0x5636d3b84410 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.560+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3b84410 0x5636d3b86800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.561+0000 7f04c6ffd640 10 client.26132 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.561+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3b84410 0x5636d3b86800 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffdeff211308402 server_cookie=b3befa462f48efcc in_seq=0 out_seq=0 2024-09-15T22:51:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.613+0000 7f04c6ffd640 1 -- 172.21.15.66:0/3135195262 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636d3adc860 con 0x5636d3b84410 2024-09-15T22:51:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.613+0000 7f04c6ffd640 10 client.26132 handle_command_reply: tid=0 2024-09-15T22:51:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.613+0000 7f04f0001740 1 client.26132 shutdown 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 msgr2=0x5636d3b73d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009930 tx=0x7f04d8009260 comp rx=0 tx=0).stop 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 shutdown_connections 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3b84410 0x5636d3b86800 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b71020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 --2- 172.21.15.66:0/3135195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b73d70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04c6ffd640 0 client.26132 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 >> 172.21.15.66:0/3135195262 conn(0x5636d3b32310 msgr2=0x5636d3b6b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 shutdown_connections 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 1 -- 172.21.15.66:0/3135195262 wait complete. 2024-09-15T22:51:03.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.614+0000 7f04f0001740 20 client.26132 trim_cache size 0 max 16384 2024-09-15T22:51:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 Processor -- start 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 -- start start 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b695d0 0x5636d3b708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 0x5636d3b89d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81acf10 con 0x5636d3b74370 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81aebd0 con 0x5636d3b6ab40 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04f0001740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81ad5e0 con 0x5636d3b695d0 2024-09-15T22:51:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47034/0 (socket says 172.21.15.66:47034) 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 0x5636d3b89d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04e6ffd640 1 -- 172.21.15.66:0/3862494930 learned_addr learned my addr 172.21.15.66:0/3862494930 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.634+0000 7f04e77fe640 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b695d0 0x5636d3b708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 -- 172.21.15.66:0/3862494930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b695d0 msgr2=0x5636d3b708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b695d0 0x5636d3b708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 -- 172.21.15.66:0/3862494930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 msgr2=0x5636d3b89d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 0x5636d3b89d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 -- 172.21.15.66:0/3862494930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d3b740e0 con 0x5636d3b6ab40 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e7fff640 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 0x5636d3b89d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004770 tx=0x7f04dc003d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e75e2cda12a88a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04cd7fa640 1 -- 172.21.15.66:0/3862494930 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc09fa50 con 0x5636d3b6ab40 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04cd7fa640 1 -- 172.21.15.66:0/3862494930 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04dc0db040 con 0x5636d3b6ab40 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.635+0000 7f04cd7fa640 1 -- 172.21.15.66:0/3862494930 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc0d1090 con 0x5636d3b6ab40 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 -- 172.21.15.66:0/3862494930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 msgr2=0x5636d3b89820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04dc004770 tx=0x7f04dc003d20 comp rx=0 tx=0).stop 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 -- 172.21.15.66:0/3862494930 shutdown_connections 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b74370 0x5636d3b89d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b6ab40 0x5636d3b89820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 --2- 172.21.15.66:0/3862494930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b695d0 0x5636d3b708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 -- 172.21.15.66:0/3862494930 >> 172.21.15.66:0/3862494930 conn(0x5636d3b32310 msgr2=0x5636d3b6f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 -- 172.21.15.66:0/3862494930 shutdown_connections 2024-09-15T22:51:03.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.636+0000 7f04f0001740 1 -- 172.21.15.66:0/3862494930 wait complete. 2024-09-15T22:51:03.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 -- start start 2024-09-15T22:51:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 Processor -- start 2024-09-15T22:51:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81ae440 con 0x5636d3b6ab40 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81adcb0 con 0x5636d3b695d0 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81aaef0 con 0x5636d3b74370 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.637+0000 7f04f0001740 10 client.0 _ll_register_callbacks cb 0x7f04d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47048/0 (socket says 172.21.15.66:47048) 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 -- 172.21.15.66:0/31116471 learned_addr learned my addr 172.21.15.66:0/31116471 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e7fff640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 -- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 msgr2=0x5636d3b875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 -- 172.21.15.66:0/31116471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 msgr2=0x5636d3b87090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b87090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 -- 172.21.15.66:0/31116471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d3b87b90 con 0x5636d3b695d0 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04e77fe640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04d80096c0 tx=0x7f04d803d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91af7f8a6b011e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.638+0000 7f04c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8062070 con 0x5636d3b695d0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f04d80038c0 con 0x5636d3b695d0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04dc0db040 con 0x5636d3b695d0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f04d806e050 con 0x5636d3b695d0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04f0001740 10 client.26138 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5636d3bf7330 con 0x5636d3b695d0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.639+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04dc0db040 con 0x5636d3b695d0 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f04d804a830 con 0x5636d3b695d0 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 10 client.26138 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 10 client.26138 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 20 client.26138 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3bf7ae0 0x5636d3bf9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 4 client.26138 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636d3ad6d70 con 0x5636d3bf7ae0 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.640+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3bf7ae0 0x5636d3bf9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.642+0000 7f04c6ffd640 10 client.26138 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.642+0000 7f04e6ffd640 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3bf7ae0 0x5636d3bf9f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d38fd124bf9bcd32 server_cookie=dfc30a2efc9a7499 in_seq=0 out_seq=0 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.735+0000 7f04c6ffd640 1 -- 172.21.15.66:0/31116471 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636d3ad6d70 con 0x5636d3bf7ae0 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.735+0000 7f04c6ffd640 10 client.26138 handle_command_reply: tid=0 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.735+0000 7f04f0001740 1 client.26138 shutdown 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.735+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 msgr2=0x5636d3b89d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.735+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04d80096c0 tx=0x7f04d803d680 comp rx=0 tx=0).stop 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 shutdown_connections 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5636d3bf7ae0 0x5636d3bf9f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5636d3b74370 0x5636d3b875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5636d3b6ab40 0x5636d3b87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 --2- 172.21.15.66:0/31116471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636d3b695d0 0x5636d3b89d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04c6ffd640 0 client.26138 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 >> 172.21.15.66:0/31116471 conn(0x5636d3b32310 msgr2=0x5636d3b6f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 shutdown_connections 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 1 -- 172.21.15.66:0/31116471 wait complete. 2024-09-15T22:51:03.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.736+0000 7f04f0001740 20 client.26138 trim_cache size 0 max 16384 2024-09-15T22:51:03.956 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 msgr2=0x7f04d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 0x7f04d00a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009900 tx=0x7f04d80058d0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 msgr2=0x7f04e8198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009d50 tx=0x7f04dc00b690 comp rx=0 tx=0).stop 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 shutdown_connections 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04d00a33b0 0x7f04d00a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04e8102ef0 0x7f04e819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04e8102570 0x7f04e8198ab0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 --2- 172.21.15.66:0/1878873679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04e8100e20 0x7f04e8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 >> 172.21.15.66:0/1878873679 conn(0x7f04e80fc7d0 msgr2=0x7f04e806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 shutdown_connections 2024-09-15T22:51:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:03.737+0000 7f04edc28640 1 -- 172.21.15.66:0/1878873679 wait complete. 2024-09-15T22:51:04.588 INFO:tasks.workunit.client.0.smithi066.stdout: 433 679354 777 458715 769 194782 1497 2024-09-15T22:51:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:04 smithi087 ceph-mon[35290]: pgmap v174: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-15T22:51:05.099 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:04 smithi066 ceph-mon[31185]: pgmap v174: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-15T22:51:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:04 smithi184 ceph-mon[35203]: pgmap v174: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 15 MiB/s wr, 809 op/s 2024-09-15T22:51:05.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:51:05.644 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 -- 172.21.15.66:0/142528966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8106b80 msgr2=0x7f3ab8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 --2- 172.21.15.66:0/142528966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8106b80 0x7f3ab8106f60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009900 tx=0x7f3aac02a410 comp rx=0 tx=0).stop 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 -- 172.21.15.66:0/142528966 shutdown_connections 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 --2- 172.21.15.66:0/142528966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100aa0 0x7f3ab810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 --2- 172.21.15.66:0/142528966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8100100 0x7f3ab8100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 --2- 172.21.15.66:0/142528966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8106b80 0x7f3ab8106f60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 -- 172.21.15.66:0/142528966 >> 172.21.15.66:0/142528966 conn(0x7f3ab8077230 msgr2=0x7f3ab80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 -- 172.21.15.66:0/142528966 shutdown_connections 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.161+0000 7f3abed0e640 1 -- 172.21.15.66:0/142528966 wait complete. 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 Processor -- start 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 -- start start 2024-09-15T22:51:06.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100100 0x7f3ab819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab8102660 con 0x7f3ab8100aa0 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81024e0 con 0x7f3ab8100100 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abed0e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81027e0 con 0x7f3ab8106b80 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abd2ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abd2ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44720/0 (socket says 172.21.15.66:44720) 2024-09-15T22:51:06.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60298/0 (socket says 172.21.15.66:60298) 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 -- 172.21.15.66:0/3646599948 learned_addr learned my addr 172.21.15.66:0/3646599948 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.162+0000 7f3abcaaa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100100 0x7f3ab819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 -- 172.21.15.66:0/3646599948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100100 msgr2=0x7f3ab819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100100 0x7f3ab819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 -- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 msgr2=0x7f3ab819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3abd2ab640 1 -- 172.21.15.66:0/3646599948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab819f670 con 0x7f3ab8106b80 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.163+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.164+0000 7f3abd2ab640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009c90 tx=0x7f3ab000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.164+0000 7f3ab5ffb640 1 -- 172.21.15.66:0/3646599948 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0010630 con 0x7f3ab8106b80 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.164+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab819f960 con 0x7f3ab8106b80 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.164+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab81a7240 con 0x7f3ab8106b80 2024-09-15T22:51:06.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.165+0000 7f3ab5ffb640 1 -- 172.21.15.66:0/3646599948 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab0010cb0 con 0x7f3ab8106b80 2024-09-15T22:51:06.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.165+0000 7f3ab5ffb640 1 -- 172.21.15.66:0/3646599948 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0017ce0 con 0x7f3ab8106b80 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.168+0000 7f3ab5ffb640 1 -- 172.21.15.66:0/3646599948 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3ab00173c0 con 0x7f3ab8106b80 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.168+0000 7f3ac10e7740 1 Processor -- start 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.168+0000 7f3ac10e7740 1 -- start start 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbaf1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbafe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5592dba572f0 con 0x5592dbaf15d0 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5592db9fecf0 con 0x5592dbaf2b40 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5592dba532b0 con 0x5592dbafc370 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3abcaaa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbaf1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47068/0 (socket says 172.21.15.66:47068) 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3abcaaa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbaf1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60300/0 (socket says 172.21.15.66:60300) 2024-09-15T22:51:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 -- 172.21.15.66:0/563820720 learned_addr learned my addr 172.21.15.66:0/563820720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbafe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab5ffb640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 0x7f3aa80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 -- 172.21.15.66:0/563820720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 msgr2=0x5592dbafe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbafe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 -- 172.21.15.66:0/563820720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 msgr2=0x5592dbaf1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbaf1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3ab7fff640 1 -- 172.21.15.66:0/563820720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592db9e33a0 con 0x5592dbaf2b40 2024-09-15T22:51:06.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.169+0000 7f3abd2ab640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 0x7f3aa80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3ab5ffb640 1 -- 172.21.15.66:0/3646599948 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3ab00d0770 con 0x7f3ab8106b80 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400bfd0 tx=0x7f3aa400bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6106acf079d61d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3aa2ffd640 1 -- 172.21.15.66:0/563820720 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4010bd0 con 0x5592dbaf2b40 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3abd2ab640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 0x7f3aa80a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0099050 tx=0x7f3ab0098280 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3aa2ffd640 1 -- 172.21.15.66:0/563820720 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aa4010d70 con 0x5592dbaf2b40 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.170+0000 7f3aa2ffd640 1 -- 172.21.15.66:0/563820720 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4003de0 con 0x5592dbaf2b40 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 -- 172.21.15.66:0/563820720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 msgr2=0x5592dbaf1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400bfd0 tx=0x7f3aa400bbf0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 -- 172.21.15.66:0/563820720 shutdown_connections 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbafe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbaf1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/563820720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf1090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 -- 172.21.15.66:0/563820720 >> 172.21.15.66:0/563820720 conn(0x5592dbaba310 msgr2=0x5592dbaedc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 -- 172.21.15.66:0/563820720 shutdown_connections 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.171+0000 7f3ac10e7740 1 -- 172.21.15.66:0/563820720 wait complete. 2024-09-15T22:51:06.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.172+0000 7f3ac10e7740 1 -- start start 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.172+0000 7f3ac10e7740 1 Processor -- start 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf15d0 0x5592dbafbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 0x5592dbaf9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5592dbaff070 con 0x5592dbafc370 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5592dba12060 con 0x5592dbaf2b40 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5592dbaff1f0 con 0x5592dbaf15d0 2024-09-15T22:51:06.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ac10e7740 10 client.0 _ll_register_callbacks cb 0x5592db7658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 0x5592dbaf9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 0x5592dbaf9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60306/0 (socket says 172.21.15.66:60306) 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ab7fff640 1 -- 172.21.15.66:0/611227478 learned_addr learned my addr 172.21.15.66:0/611227478 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf15d0 0x5592dbafbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 -- 172.21.15.66:0/611227478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf15d0 msgr2=0x5592dbafbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf15d0 0x5592dbafbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 -- 172.21.15.66:0/611227478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 msgr2=0x5592dbaf9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 0x5592dbaf9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 -- 172.21.15.66:0/611227478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592db7c83c0 con 0x5592dbaf2b40 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.173+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf9020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3aac02aa00 tx=0x7f3aac004440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f978c9c4edb483 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac035040 con 0x5592dbaf2b40 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3aac005450 con 0x5592dbaf2b40 2024-09-15T22:51:06.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa4010d70 con 0x5592dbaf2b40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3aac04f050 con 0x5592dbaf2b40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 10 client.26150 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5592dbb0ab70 con 0x5592dbaf2b40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aac041070 con 0x5592dbaf2b40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f3aac003a30 con 0x5592dbaf2b40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 10 client.26150 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 10 client.26150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 20 client.26150 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:06.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb0c0b0 0x5592dbb0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 4 client.26150 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:06.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.174+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3aa4010d70 con 0x5592dbb0c0b0 2024-09-15T22:51:06.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.175+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb0c0b0 0x5592dbb0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.175+0000 7f3a97fff640 10 client.26150 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:06.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.175+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb0c0b0 0x5592dbb0e4d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bbd045ffde12453 server_cookie=2c30551f01882896 in_seq=0 out_seq=0 2024-09-15T22:51:06.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.232+0000 7f3a97fff640 1 -- 172.21.15.66:0/611227478 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3aa4010d70 con 0x5592dbb0c0b0 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.232+0000 7f3a97fff640 10 client.26150 handle_command_reply: tid=0 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.232+0000 7f3ac10e7740 1 client.26150 shutdown 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 msgr2=0x5592dbaf9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf9020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3aac02aa00 tx=0x7f3aac004440 comp rx=0 tx=0).stop 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 shutdown_connections 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbafc370 0x5592dbaf9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb0c0b0 0x5592dbb0e4d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf2b40 0x5592dbaf9020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/611227478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf15d0 0x5592dbafbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3a97fff640 0 client.26150 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 >> 172.21.15.66:0/611227478 conn(0x5592dbaba310 msgr2=0x5592dbaf3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 shutdown_connections 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 1 -- 172.21.15.66:0/611227478 wait complete. 2024-09-15T22:51:06.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.233+0000 7f3ac10e7740 20 client.26150 trim_cache size 0 max 16384 2024-09-15T22:51:06.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.249+0000 7f3ac10e7740 1 Processor -- start 2024-09-15T22:51:06.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.249+0000 7f3ac10e7740 1 -- start start 2024-09-15T22:51:06.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.249+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.249+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf2b40 0x5592dbaf88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.249+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbafc370 0x5592dbb13d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c00fff0 con 0x5592dbaf15d0 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c011cb0 con 0x5592dbafc370 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0106c0 con 0x5592dbaf2b40 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60312/0 (socket says 172.21.15.66:60312) 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 -- 172.21.15.66:0/1391998223 learned_addr learned my addr 172.21.15.66:0/1391998223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf2b40 0x5592dbaf88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbafc370 0x5592dbb13d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 -- 172.21.15.66:0/1391998223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf2b40 msgr2=0x5592dbaf88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf2b40 0x5592dbaf88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 -- 172.21.15.66:0/1391998223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbafc370 msgr2=0x5592dbb13d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbafc370 0x5592dbb13d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 -- 172.21.15.66:0/1391998223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592dbaedde0 con 0x5592dbaf15d0 2024-09-15T22:51:06.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.250+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4003990 tx=0x7f3aa4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ced72359e166e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.251+0000 7f3aa27fc640 1 -- 172.21.15.66:0/1391998223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4045070 con 0x5592dbaf15d0 2024-09-15T22:51:06.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.251+0000 7f3aa27fc640 1 -- 172.21.15.66:0/1391998223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aa4046040 con 0x5592dbaf15d0 2024-09-15T22:51:06.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.251+0000 7f3aa27fc640 1 -- 172.21.15.66:0/1391998223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4004a20 con 0x5592dbaf15d0 2024-09-15T22:51:06.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- 172.21.15.66:0/1391998223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 msgr2=0x5592dbb08370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4003990 tx=0x7f3aa4014040 comp rx=0 tx=0).stop 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- 172.21.15.66:0/1391998223 shutdown_connections 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbafc370 0x5592dbb13d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbaf2b40 0x5592dbaf88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/1391998223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf15d0 0x5592dbb08370 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- 172.21.15.66:0/1391998223 >> 172.21.15.66:0/1391998223 conn(0x5592dbaba310 msgr2=0x5592dbaf8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- 172.21.15.66:0/1391998223 shutdown_connections 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- 172.21.15.66:0/1391998223 wait complete. 2024-09-15T22:51:06.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 -- start start 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.252+0000 7f3ac10e7740 1 Processor -- start 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 0x5592dbb00790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbb00cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c011520 con 0x5592dbaf2b40 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c010d90 con 0x5592dbaf15d0 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c00dfd0 con 0x5592dbafc370 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ac10e7740 10 client.0 _ll_register_callbacks cb 0x7f3aac009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3abcaaa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 0x5592dbb00790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47094/0 (socket says 172.21.15.66:47094) 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 -- 172.21.15.66:0/587590327 learned_addr learned my addr 172.21.15.66:0/587590327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbb00cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 -- 172.21.15.66:0/587590327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 msgr2=0x5592dbb00cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbb00cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 -- 172.21.15.66:0/587590327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 msgr2=0x5592dbb00790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 0x5592dbb00790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3ab7fff640 1 -- 172.21.15.66:0/587590327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592dbb75d60 con 0x5592dbaf15d0 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.253+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 0x5592dbb00790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3ab7fff640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c010 tx=0x7f3aa4032040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa1150fc25767122 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3a97fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4045050 con 0x5592dbaf15d0 2024-09-15T22:51:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa4046040 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3aa4042410 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3aa405e050 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3ac10e7740 10 client.26156 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5592dbb77020 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.254+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aa4046040 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f3aa4041070 con 0x5592dbaf15d0 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 10 client.26156 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 10 client.26156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 20 client.26156 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb77550 0x5592dbb79970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 4 client.26156 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592dba64860 con 0x5592dbb77550 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb77550 0x5592dbb79970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3a97fff640 10 client.26156 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.255+0000 7f3abcaaa640 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb77550 0x5592dbb79970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a79c80d6892dba9f server_cookie=200ff152ed199d88 in_seq=0 out_seq=0 2024-09-15T22:51:06.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3a97fff640 1 -- 172.21.15.66:0/587590327 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592dba64860 con 0x5592dbb77550 2024-09-15T22:51:06.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3a97fff640 10 client.26156 handle_command_reply: tid=0 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 client.26156 shutdown 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 msgr2=0x5592dbb00250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c010 tx=0x7f3aa4032040 comp rx=0 tx=0).stop 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 shutdown_connections 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5592dbafc370 0x5592dbb00cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5592dbaf2b40 0x5592dbb00790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5592dbb77550 0x5592dbb79970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 --2- 172.21.15.66:0/587590327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5592dbaf15d0 0x5592dbb00250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3a97fff640 0 client.26156 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:06.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.268+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 >> 172.21.15.66:0/587590327 conn(0x5592dbaba310 msgr2=0x5592dbaf3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.269+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 shutdown_connections 2024-09-15T22:51:06.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.269+0000 7f3ac10e7740 1 -- 172.21.15.66:0/587590327 wait complete. 2024-09-15T22:51:06.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.269+0000 7f3ac10e7740 20 client.26156 trim_cache size 0 max 16384 2024-09-15T22:51:06.272 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:06.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 msgr2=0x7f3aa80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 0x7f3aa80a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0099050 tx=0x7f3ab0098280 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 msgr2=0x7f3ab819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009c90 tx=0x7f3ab000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 shutdown_connections 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3aa80a3430 0x7f3aa80a58f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ab8106b80 0x7f3ab819ef90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab8100aa0 0x7f3ab819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 --2- 172.21.15.66:0/3646599948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab8100100 0x7f3ab819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 >> 172.21.15.66:0/3646599948 conn(0x7f3ab8077230 msgr2=0x7f3ab8104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 shutdown_connections 2024-09-15T22:51:06.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:06.270+0000 7f3abed0e640 1 -- 172.21.15.66:0/3646599948 wait complete. 2024-09-15T22:51:07.091 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:06 smithi066 ceph-mon[31185]: pgmap v175: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 650 op/s 2024-09-15T22:51:07.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:06 smithi087 ceph-mon[35290]: pgmap v175: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 650 op/s 2024-09-15T22:51:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:06 smithi184 ceph-mon[35203]: pgmap v175: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 650 op/s 2024-09-15T22:51:08.129 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:51:08.130 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:51:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:08.902 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:08 smithi066 ceph-mon[31185]: pgmap v176: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 641 op/s 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 -- 172.21.15.66:0/1360411898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde8810c590 msgr2=0x7fde8810c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 --2- 172.21.15.66:0/1360411898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde8810c590 0x7fde8810c9f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fde78009900 tx=0x7fde7802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 -- 172.21.15.66:0/1360411898 shutdown_connections 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 --2- 172.21.15.66:0/1360411898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810cf30 0x7fde88119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 --2- 172.21.15.66:0/1360411898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde8810c590 0x7fde8810c9f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 --2- 172.21.15.66:0/1360411898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde88112640 0x7fde88112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.009+0000 7fde90064640 1 -- 172.21.15.66:0/1360411898 >> 172.21.15.66:0/1360411898 conn(0x7fde8806cdc0 msgr2=0x7fde8806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.010+0000 7fde90064640 1 -- 172.21.15.66:0/1360411898 shutdown_connections 2024-09-15T22:51:09.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.010+0000 7fde90064640 1 -- 172.21.15.66:0/1360411898 wait complete. 2024-09-15T22:51:09.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 Processor -- start 2024-09-15T22:51:09.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 -- start start 2024-09-15T22:51:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810c590 0x7fde8806db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde8810cf30 0x7fde8806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde8811c9b0 con 0x7fde88112640 2024-09-15T22:51:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde8811c830 con 0x7fde8810cf30 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.011+0000 7fde90064640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde8811cb30 con 0x7fde8810c590 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.012+0000 7fde8e601640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.012+0000 7fde8e601640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60338/0 (socket says 172.21.15.66:60338) 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.012+0000 7fde8e601640 1 -- 172.21.15.66:0/1467541995 learned_addr learned my addr 172.21.15.66:0/1467541995 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.012+0000 7fde8de00640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810c590 0x7fde8806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.012+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde8810cf30 0x7fde8806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 -- 172.21.15.66:0/1467541995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810c590 msgr2=0x7fde8806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810c590 0x7fde8806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 -- 172.21.15.66:0/1467541995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde8810cf30 msgr2=0x7fde8806e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde8810cf30 0x7fde8806e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 -- 172.21.15.66:0/1467541995 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde881b33b0 con 0x7fde88112640 2024-09-15T22:51:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.013+0000 7fde8e601640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fde8000cd10 tx=0x7fde8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.014+0000 7fde7effd640 1 -- 172.21.15.66:0/1467541995 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8000f450 con 0x7fde88112640 2024-09-15T22:51:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.014+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde881b36a0 con 0x7fde88112640 2024-09-15T22:51:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.014+0000 7fde7effd640 1 -- 172.21.15.66:0/1467541995 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde8000fad0 con 0x7fde88112640 2024-09-15T22:51:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.014+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881b3b60 con 0x7fde88112640 2024-09-15T22:51:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.014+0000 7fde7effd640 1 -- 172.21.15.66:0/1467541995 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80018bf0 con 0x7fde88112640 2024-09-15T22:51:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.019+0000 7fde7effd640 1 -- 172.21.15.66:0/1467541995 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fde8000fc80 con 0x7fde88112640 2024-09-15T22:51:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.019+0000 7fde9243d740 1 Processor -- start 2024-09-15T22:51:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 -- start start 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbab5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559dcba0d280 con 0x559dcbaa8480 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559dcb9b4b10 con 0x559dcbaa7b60 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde9243d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559dcba09240 con 0x559dcbab2d40 2024-09-15T22:51:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde8de00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47118/0 (socket says 172.21.15.66:47118) 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde8de00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60346/0 (socket says 172.21.15.66:60346) 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.020+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1178879663 learned_addr learned my addr 172.21.15.66:0/1178879663 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbab5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde7effd640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 0x7fde740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1178879663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 msgr2=0x559dcbab5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbab5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8e601640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 0x7fde740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1178879663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 msgr2=0x559dcbab2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1178879663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dcb9c11f0 con 0x559dcbaa7b60 2024-09-15T22:51:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde7effd640 1 -- 172.21.15.66:0/1467541995 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fde800d0470 con 0x7fde88112640 2024-09-15T22:51:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8e601640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 0x7fde740a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde8009c310 tx=0x7fde800984d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.021+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde78005ec0 tx=0x7fde78005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5d59042d896686 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.022+0000 7fde73fff640 1 -- 172.21.15.66:0/1178879663 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78035030 con 0x559dcbaa7b60 2024-09-15T22:51:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.022+0000 7fde73fff640 1 -- 172.21.15.66:0/1178879663 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde780038c0 con 0x559dcbaa7b60 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 -- 172.21.15.66:0/1178879663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 msgr2=0x559dcbaa7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde78005ec0 tx=0x7fde78005d70 comp rx=0 tx=0).stop 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 -- 172.21.15.66:0/1178879663 shutdown_connections 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbab5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 --2- 172.21.15.66:0/1178879663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbaa7f40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 -- 172.21.15.66:0/1178879663 >> 172.21.15.66:0/1178879663 conn(0x559dcbaa40f0 msgr2=0x559dcbaa44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.023+0000 7fde9243d740 1 -- 172.21.15.66:0/1178879663 shutdown_connections 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.024+0000 7fde9243d740 1 -- 172.21.15.66:0/1178879663 wait complete. 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.024+0000 7fde9243d740 1 -- start start 2024-09-15T22:51:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.025+0000 7fde9243d740 1 Processor -- start 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.025+0000 7fde9243d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbaafb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbab2d40 0x559dcbab02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559dcbab5960 con 0x559dcbaa8480 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559dcb9c7f10 con 0x559dcbab2d40 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559dcbab5ae0 con 0x559dcbaa7b60 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde9243d740 10 client.0 _ll_register_callbacks cb 0x559dcb990a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44802/0 (socket says 172.21.15.66:44802) 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 -- 172.21.15.66:0/2221000546 learned_addr learned my addr 172.21.15.66:0/2221000546 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbab2d40 0x559dcbab02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 -- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbab2d40 msgr2=0x559dcbab02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbab2d40 0x559dcbab02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 -- 172.21.15.66:0/2221000546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 msgr2=0x559dcbaafb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbaafb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.026+0000 7fde8d5ff640 1 -- 172.21.15.66:0/2221000546 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dcb77e6a0 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde78004390 tx=0x7fde78004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7b086d9ae230c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde717fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78055060 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fde78031950 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde780038c0 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fde78035070 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde9243d740 10 client.26176 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.027+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559dcbab5960 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde780038c0 con 0x559dcbaa7b60 2024-09-15T22:51:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7fde78005330 con 0x559dcbaa7b60 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 10 client.26176 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 20 client.26176 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbac4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 4 client.26176 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.028+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dcba1a7f0 con 0x559dcbac2670 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.029+0000 7fde8de00640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbac4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.030+0000 7fde717fa640 10 client.26176 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.030+0000 7fde8de00640 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbac4a60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=379c4b120d98a58b server_cookie=e9220dc7d0ea5d6 in_seq=0 out_seq=0 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde717fa640 1 -- 172.21.15.66:0/2221000546 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dcba1a7f0 con 0x559dcbac2670 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde717fa640 10 client.26176 handle_command_reply: tid=0 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde9243d740 1 client.26176 shutdown 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 msgr2=0x559dcbab27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde78004390 tx=0x7fde78004320 comp rx=0 tx=0).stop 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.032+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 shutdown_connections 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbac4a60 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbab2d40 0x559dcbab02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde717fa640 0 client.26176 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbaafb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 --2- 172.21.15.66:0/2221000546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbaa7b60 0x559dcbab27d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 >> 172.21.15.66:0/2221000546 conn(0x559dcbaa40f0 msgr2=0x559dcbaa9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 shutdown_connections 2024-09-15T22:51:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 1 -- 172.21.15.66:0/2221000546 wait complete. 2024-09-15T22:51:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.033+0000 7fde9243d740 20 client.26176 trim_cache size 0 max 16384 2024-09-15T22:51:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.054+0000 7fde9243d740 1 Processor -- start 2024-09-15T22:51:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.054+0000 7fde9243d740 1 -- start start 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.054+0000 7fde9243d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde9243d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa8480 0x559dcbaca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde9243d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbaca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde9243d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde881bde00 con 0x559dcbaa7b60 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde9243d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde881bfac0 con 0x559dcbaa8480 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde9243d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde881be4d0 con 0x559dcbab2d40 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60370/0 (socket says 172.21.15.66:60370) 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1287677362 learned_addr learned my addr 172.21.15.66:0/1287677362 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8de00640 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa8480 0x559dcbaca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbaca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1287677362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 msgr2=0x559dcbaca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbaca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1287677362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa8480 msgr2=0x559dcbaca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa8480 0x559dcbaca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 -- 172.21.15.66:0/1287677362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dcbab0620 con 0x559dcbaa7b60 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fde78005940 tx=0x7fde78005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7e6be057c0c8f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.055+0000 7fde737fe640 1 -- 172.21.15.66:0/1287677362 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78055070 con 0x559dcbaa7b60 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde737fe640 1 -- 172.21.15.66:0/1287677362 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde78041030 con 0x559dcbaa7b60 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde737fe640 1 -- 172.21.15.66:0/1287677362 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7803b960 con 0x559dcbaa7b60 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 -- 172.21.15.66:0/1287677362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 msgr2=0x559dcbaaa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fde78005940 tx=0x7fde78005d70 comp rx=0 tx=0).stop 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 -- 172.21.15.66:0/1287677362 shutdown_connections 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbaca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa8480 0x559dcbaca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 --2- 172.21.15.66:0/1287677362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa7b60 0x559dcbaaa590 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 -- 172.21.15.66:0/1287677362 >> 172.21.15.66:0/1287677362 conn(0x559dcbaa40f0 msgr2=0x559dcbaaec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 -- 172.21.15.66:0/1287677362 shutdown_connections 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.056+0000 7fde9243d740 1 -- 172.21.15.66:0/1287677362 wait complete. 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 -- start start 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 Processor -- start 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbab7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbb2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde881bf330 con 0x559dcbaa8480 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde881beba0 con 0x559dcbaa7b60 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde881bbde0 con 0x559dcbab2d40 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde9243d740 10 client.0 _ll_register_callbacks cb 0x7fde84009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.057+0000 7fde8de00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8d5ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbab7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60378/0 (socket says 172.21.15.66:60378) 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 -- 172.21.15.66:0/422651712 learned_addr learned my addr 172.21.15.66:0/422651712 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbb2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 -- 172.21.15.66:0/422651712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 msgr2=0x559dcbb2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbb2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 -- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 msgr2=0x559dcbab7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbab7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 -- 172.21.15.66:0/422651712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dcbab2b40 con 0x559dcbaa8480 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde8de00640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fde840058c0 tx=0x7fde8401d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d55812c7bd1de93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde717fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84004220 con 0x559dcbaa8480 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fde840043c0 con 0x559dcbaa8480 2024-09-15T22:51:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.058+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde78041030 con 0x559dcbaa8480 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fde840107c0 con 0x559dcbaa8480 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 10 client.16659 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559dcbb2d6e0 con 0x559dcbaa8480 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde78041030 con 0x559dcbaa8480 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7fde8402f470 con 0x559dcbaa8480 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 10 client.16659 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 20 client.16659 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbb2ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 4 client.16659 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559dcba14d00 con 0x559dcbac2670 2024-09-15T22:51:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.059+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbb2ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.060+0000 7fde717fa640 10 client.16659 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.060+0000 7fde8d5ff640 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbb2ff90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92bee05017f82931 server_cookie=b0efd88d6127c416 in_seq=0 out_seq=0 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde717fa640 1 -- 172.21.15.66:0/422651712 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559dcba14d00 con 0x559dcbac2670 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde717fa640 10 client.16659 handle_command_reply: tid=0 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 client.16659 shutdown 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 msgr2=0x559dcbab76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fde840058c0 tx=0x7fde8401d750 comp rx=0 tx=0).stop 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 shutdown_connections 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dcbab2d40 0x559dcbb2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559dcbaa8480 0x559dcbab76c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559dcbac2670 0x559dcbb2ff90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 --2- 172.21.15.66:0/422651712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559dcbaa7b60 0x559dcbab7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 >> 172.21.15.66:0/422651712 conn(0x559dcbaa40f0 msgr2=0x559dcbab1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.062+0000 7fde717fa640 0 client.16659 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 shutdown_connections 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde9243d740 1 -- 172.21.15.66:0/422651712 wait complete. 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde9243d740 20 client.16659 trim_cache size 0 max 16384 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:51:09.069 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "3db6b3d6-29c5-4c2d-bd3d-4e235cc9240c", 2024-09-15T22:51:09.070 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:51:09.070 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 msgr2=0x7fde740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 0x7fde740a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde8009c310 tx=0x7fde800984d0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 msgr2=0x7fde8806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fde8000cd10 tx=0x7fde8000a620 comp rx=0 tx=0).stop 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 shutdown_connections 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde740a33b0 0x7fde740a5870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde88112640 0x7fde8806e600 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde8810cf30 0x7fde8806e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 --2- 172.21.15.66:0/1467541995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8810c590 0x7fde8806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.063+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 >> 172.21.15.66:0/1467541995 conn(0x7fde8806cdc0 msgr2=0x7fde8810ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.064+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 shutdown_connections 2024-09-15T22:51:09.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:09.064+0000 7fde90064640 1 -- 172.21.15.66:0/1467541995 wait complete. 2024-09-15T22:51:09.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:08 smithi087 ceph-mon[35290]: pgmap v176: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 641 op/s 2024-09-15T22:51:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:08 smithi184 ceph-mon[35203]: pgmap v176: 129 pgs: 129 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 641 op/s 2024-09-15T22:51:09.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:51:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:09.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:10.067 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:10.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:10.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:10.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:10.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:10.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:10.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 -- 172.21.15.66:0/4053306042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102ef0 msgr2=0x7f026c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 --2- 172.21.15.66:0/4053306042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102ef0 0x7f026c10da40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0264009ca0 tx=0x7f026402a950 comp rx=0 tx=0).stop 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 -- 172.21.15.66:0/4053306042 shutdown_connections 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 --2- 172.21.15.66:0/4053306042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102ef0 0x7f026c10da40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 --2- 172.21.15.66:0/4053306042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102570 0x7f026c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 --2- 172.21.15.66:0/4053306042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.604+0000 7f027114a640 1 -- 172.21.15.66:0/4053306042 >> 172.21.15.66:0/4053306042 conn(0x7f026c0fc7d0 msgr2=0x7f026c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.605+0000 7f027114a640 1 -- 172.21.15.66:0/4053306042 shutdown_connections 2024-09-15T22:51:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.605+0000 7f027114a640 1 -- 172.21.15.66:0/4053306042 wait complete. 2024-09-15T22:51:10.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.606+0000 7f027114a640 1 Processor -- start 2024-09-15T22:51:10.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.606+0000 7f027114a640 1 -- start start 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.606+0000 7f027114a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.606+0000 7f027114a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f027114a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102ef0 0x7f026c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f027114a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f026c110fd0 con 0x7f026c102570 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60394/0 (socket says 172.21.15.66:60394) 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44840/0 (socket says 172.21.15.66:44840) 2024-09-15T22:51:10.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 -- 172.21.15.66:0/1092696254 learned_addr learned my addr 172.21.15.66:0/1092696254 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:10.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f027114a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f026c110e50 con 0x7f026c102ef0 2024-09-15T22:51:10.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f026c111150 con 0x7f026c100e20 2024-09-15T22:51:10.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026b59e640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102ef0 0x7f026c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 -- 172.21.15.66:0/1092696254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102ef0 msgr2=0x7f026c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102ef0 0x7f026c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 -- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 msgr2=0x7f026c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.607+0000 7f026ad9d640 1 -- 172.21.15.66:0/1092696254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c19f610 con 0x7f026c100e20 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f026a59c640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d770 tx=0x7f025c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f0253fff640 1 -- 172.21.15.66:0/1092696254 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c017070 con 0x7f026c100e20 2024-09-15T22:51:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c19f900 con 0x7f026c100e20 2024-09-15T22:51:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1a71e0 con 0x7f026c100e20 2024-09-15T22:51:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f0253fff640 1 -- 172.21.15.66:0/1092696254 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025c005500 con 0x7f026c100e20 2024-09-15T22:51:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.608+0000 7f0253fff640 1 -- 172.21.15.66:0/1092696254 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c020060 con 0x7f026c100e20 2024-09-15T22:51:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 Processor -- start 2024-09-15T22:51:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 -- start start 2024-09-15T22:51:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8ccb0 0x55e2bda8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 0x55e2bda9a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e2bd9ea2e0 con 0x55e2bda97e90 2024-09-15T22:51:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e2bd991ce0 con 0x55e2bda8ccb0 2024-09-15T22:51:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0273523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e2bd9e62a0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.612+0000 7f0253fff640 1 -- 172.21.15.66:0/1092696254 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f025c010460 con 0x7f026c100e20 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.613+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.613+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44856/0 (socket says 172.21.15.66:44856) 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.613+0000 7f026b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8ccb0 0x55e2bda8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.613+0000 7f026ad9d640 1 -- 172.21.15.66:0/1730422947 learned_addr learned my addr 172.21.15.66:0/1730422947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:10.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.613+0000 7f026a59c640 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 0x55e2bda9a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026ad9d640 1 -- 172.21.15.66:0/1730422947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8ccb0 msgr2=0x55e2bda8d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8ccb0 0x55e2bda8d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026ad9d640 1 -- 172.21.15.66:0/1730422947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 msgr2=0x55e2bda9a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 0x55e2bda9a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026ad9d640 1 -- 172.21.15.66:0/1730422947 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2bd976440 con 0x55e2bda8d5d0 2024-09-15T22:51:10.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.614+0000 7f026a59c640 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 0x55e2bda9a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f0253fff640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 0x7f02540a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ccc20 tx=0x7f025c0d7240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bddadf7ce1a46111 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f026b59e640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 0x7f02540a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f0253fff640 1 -- 172.21.15.66:0/1092696254 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f025c0cf9c0 con 0x7f026c100e20 2024-09-15T22:51:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f02517fa640 1 -- 172.21.15.66:0/1730422947 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c097bc0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f026b59e640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 0x7f02540a5970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0264006010 tx=0x7f0264005d80 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f02517fa640 1 -- 172.21.15.66:0/1730422947 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025c0046c0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.615+0000 7f02517fa640 1 -- 172.21.15.66:0/1730422947 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c09b280 con 0x55e2bda8d5d0 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 -- 172.21.15.66:0/1730422947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 msgr2=0x55e2bda97950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ccc20 tx=0x7f025c0d7240 comp rx=0 tx=0).stop 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 -- 172.21.15.66:0/1730422947 shutdown_connections 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda97e90 0x55e2bda9a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8d5d0 0x55e2bda97950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 --2- 172.21.15.66:0/1730422947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8ccb0 0x55e2bda8d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 -- 172.21.15.66:0/1730422947 >> 172.21.15.66:0/1730422947 conn(0x55e2bda89240 msgr2=0x55e2bda89620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 -- 172.21.15.66:0/1730422947 shutdown_connections 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.616+0000 7f0273523740 1 -- 172.21.15.66:0/1730422947 wait complete. 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.617+0000 7f0273523740 1 -- start start 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.617+0000 7f0273523740 1 Processor -- start 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.617+0000 7f0273523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda8d5d0 0x55e2bda94a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 0x55e2bda94f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e2bda9aab0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e2bd9a5050 con 0x55e2bda97e90 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e2bda9ac30 con 0x55e2bda8ccb0 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f0273523740 10 client.0 _ll_register_callbacks cb 0x55e2bd9e5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 0x55e2bda94f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44868/0 (socket says 172.21.15.66:44868) 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026ad9d640 1 -- 172.21.15.66:0/1767678392 learned_addr learned my addr 172.21.15.66:0/1767678392 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026a59c640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda8d5d0 0x55e2bda94a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 -- 172.21.15.66:0/1767678392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 msgr2=0x55e2bda977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 -- 172.21.15.66:0/1767678392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda8d5d0 msgr2=0x55e2bda94a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda8d5d0 0x55e2bda94a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.618+0000 7f026b59e640 1 -- 172.21.15.66:0/1767678392 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2bd75b3c0 con 0x55e2bda97e90 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f026b59e640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 0x55e2bda94f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0264005e30 tx=0x7f02640095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37172c46c898626 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f024eff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264055060 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0264004250 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f025c0046c0 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f026405c050 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f0273523740 10 client.26186 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.619+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e2bdaa64c0 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025c0046c0 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f0264030b40 con 0x55e2bda97e90 2024-09-15T22:51:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 10 client.26186 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 10 client.26186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 20 client.26186 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bdaa7ed0 0x55e2bdaaa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 4 client.26186 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.620+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2bd9f7850 con 0x55e2bdaa7ed0 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.621+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bdaa7ed0 0x55e2bdaaa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.621+0000 7f026ad9d640 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bdaa7ed0 0x55e2bdaaa330 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77ea826caa893dc2 server_cookie=86849d953efb2198 in_seq=0 out_seq=0 2024-09-15T22:51:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.622+0000 7f024eff5640 10 client.26186 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:10.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.623+0000 7f024eff5640 1 -- 172.21.15.66:0/1767678392 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2bd9f7850 con 0x55e2bdaa7ed0 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.623+0000 7f024eff5640 10 client.26186 handle_command_reply: tid=0 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 client.26186 shutdown 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 msgr2=0x55e2bda94f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 0x55e2bda94f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0264005e30 tx=0x7f02640095c0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 shutdown_connections 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bdaa7ed0 0x55e2bdaaa330 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda97e90 0x55e2bda94f90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda8d5d0 0x55e2bda94a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 --2- 172.21.15.66:0/1767678392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 >> 172.21.15.66:0/1767678392 conn(0x55e2bda89240 msgr2=0x55e2bda8ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f024eff5640 0 client.26186 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 shutdown_connections 2024-09-15T22:51:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.624+0000 7f0273523740 1 -- 172.21.15.66:0/1767678392 wait complete. 2024-09-15T22:51:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.625+0000 7f0273523740 20 client.26186 trim_cache size 0 max 16384 2024-09-15T22:51:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.650+0000 7f0273523740 1 Processor -- start 2024-09-15T22:51:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.650+0000 7f0273523740 1 -- start start 2024-09-15T22:51:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bdaafc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bdab0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f025800fff0 con 0x55e2bda89240 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0258011cb0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f0273523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f02580106c0 con 0x55e2bda8ccb0 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f026a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bdaafc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f026a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bdaafc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44882/0 (socket says 172.21.15.66:44882) 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f026a59c640 1 -- 172.21.15.66:0/887227724 learned_addr learned my addr 172.21.15.66:0/887227724 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f026b59e640 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bdab0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.651+0000 7f026ad9d640 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 -- 172.21.15.66:0/887227724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 msgr2=0x55e2bdaafc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bdaafc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 -- 172.21.15.66:0/887227724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 msgr2=0x55e2bdaa3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 -- 172.21.15.66:0/887227724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2bda97b10 con 0x55e2bda8d5d0 2024-09-15T22:51:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f026b59e640 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bdab0180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0264009ca0 tx=0x7f026402fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6b8c530be76285 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f0250ff9640 1 -- 172.21.15.66:0/887227724 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264055040 con 0x55e2bda8d5d0 2024-09-15T22:51:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f0250ff9640 1 -- 172.21.15.66:0/887227724 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f026402f3a0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.652+0000 7f0250ff9640 1 -- 172.21.15.66:0/887227724 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264034040 con 0x55e2bda8d5d0 2024-09-15T22:51:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.653+0000 7f0273523740 1 -- 172.21.15.66:0/887227724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 msgr2=0x55e2bdab0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.653+0000 7f0273523740 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bdab0180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0264009ca0 tx=0x7f026402fd00 comp rx=0 tx=0).stop 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 -- 172.21.15.66:0/887227724 shutdown_connections 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bdab0180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bdaafc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 --2- 172.21.15.66:0/887227724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 -- 172.21.15.66:0/887227724 >> 172.21.15.66:0/887227724 conn(0x55e2bda950f0 msgr2=0x55e2bda93320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 -- 172.21.15.66:0/887227724 shutdown_connections 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 -- 172.21.15.66:0/887227724 wait complete. 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 -- start start 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.654+0000 7f0273523740 1 Processor -- start 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda9b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0258011520 con 0x55e2bda89240 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0258010d90 con 0x55e2bda8d5d0 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f025800dfd0 con 0x55e2bda8ccb0 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47220/0 (socket says 172.21.15.66:47220) 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 -- 172.21.15.66:0/2070493704 learned_addr learned my addr 172.21.15.66:0/2070493704 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f0273523740 10 client.0 _ll_register_callbacks cb 0x7f0264009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 -- 172.21.15.66:0/2070493704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 msgr2=0x55e2bda9b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda9b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026b59e640 1 -- 172.21.15.66:0/2070493704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 msgr2=0x55e2bdaa0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.655+0000 7f026ad9d640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.656+0000 7f026b59e640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.656+0000 7f026b59e640 1 -- 172.21.15.66:0/2070493704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2bda9c600 con 0x55e2bda8d5d0 2024-09-15T22:51:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.656+0000 7f026ad9d640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.657+0000 7f026b59e640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0264009bf0 tx=0x7f026403a850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed5eaeb010ee975 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.657+0000 7f024eff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.657+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264067070 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.657+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f0264004600 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.657+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f026402f3a0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.658+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0264055050 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.658+0000 7f0273523740 10 client.26192 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.658+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e2bdb12b00 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.658+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f026402f3a0 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.658+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f026406a030 con 0x55e2bda8d5d0 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 10 client.26192 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 10 client.26192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 20 client.26192 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bda97e90 0x55e2bdb151a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 4 client.26192 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:51:10.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e2bd9f1d60 con 0x55e2bda97e90 2024-09-15T22:51:10.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.659+0000 7f026ad9d640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bda97e90 0x55e2bdb151a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.660+0000 7f024eff5640 10 client.26192 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:10.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.660+0000 7f026ad9d640 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bda97e90 0x55e2bdb151a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbbef89c3e842a3 server_cookie=1df409b6098392a2 in_seq=0 out_seq=0 2024-09-15T22:51:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f024eff5640 1 -- 172.21.15.66:0/2070493704 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55e2bd9f1d60 con 0x55e2bda97e90 2024-09-15T22:51:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f024eff5640 10 client.26192 handle_command_reply: tid=0 2024-09-15T22:51:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 client.26192 shutdown 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 msgr2=0x55e2bda9bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0264009bf0 tx=0x7f026403a850 comp rx=0 tx=0).stop 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 shutdown_connections 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e2bda97e90 0x55e2bdb151a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e2bda8d5d0 0x55e2bda9bdd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e2bda8ccb0 0x55e2bda9b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 --2- 172.21.15.66:0/2070493704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e2bda89240 0x55e2bdaa0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 >> 172.21.15.66:0/2070493704 conn(0x55e2bda950f0 msgr2=0x55e2bda8e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f024eff5640 0 client.26192 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.664+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 shutdown_connections 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.665+0000 7f0273523740 1 -- 172.21.15.66:0/2070493704 wait complete. 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.665+0000 7f0273523740 20 client.26192 trim_cache size 0 max 16384 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (13175 inodes in the stack)", 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stdout: "3db6b3d6-29c5-4c2d-bd3d-4e235cc9240c": { 2024-09-15T22:51:10.669 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:51:10.670 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "3db6b3d6-29c5-4c2d-bd3d-4e235cc9240c", 2024-09-15T22:51:10.670 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:51:10.670 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:10.670 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:10.670 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:10.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 msgr2=0x7f02540a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 0x7f02540a5970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0264006010 tx=0x7f0264005d80 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 msgr2=0x7f026c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d770 tx=0x7f025c00dc30 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 shutdown_connections 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f02540a34b0 0x7f02540a5970 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f026c102ef0 0x7f026c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102570 0x7f026c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 --2- 172.21.15.66:0/1092696254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f026c100e20 0x7f026c19a660 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 >> 172.21.15.66:0/1092696254 conn(0x7f026c0fc7d0 msgr2=0x7f026c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 shutdown_connections 2024-09-15T22:51:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:10.666+0000 7f027114a640 1 -- 172.21.15.66:0/1092696254 wait complete. 2024-09-15T22:51:11.077 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:10 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:51:11.077 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:10 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:11.077 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:11.077 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:11.078 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:10 smithi184 ceph-mon[35203]: pgmap v177: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 612 op/s 2024-09-15T22:51:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:10 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:51:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:10 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:10 smithi087 ceph-mon[35290]: pgmap v177: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 612 op/s 2024-09-15T22:51:11.162 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:10 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:51:11.163 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:10 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:11.163 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:11.163 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:11.163 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:10 smithi066 ceph-mon[31185]: pgmap v177: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 612 op/s 2024-09-15T22:51:11.624 INFO:tasks.cephfs.filesystem:scrub status for tag:3db6b3d6-29c5-4c2d-bd3d-4e235cc9240c - {'path': '/', 'tag': '3db6b3d6-29c5-4c2d-bd3d-4e235cc9240c', 'options': 'recursive,force'} 2024-09-15T22:51:13.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:12 smithi087 ceph-mon[35290]: pgmap v178: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.4 MiB/s wr, 514 op/s 2024-09-15T22:51:13.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:12 smithi184 ceph-mon[35203]: pgmap v178: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.4 MiB/s wr, 514 op/s 2024-09-15T22:51:13.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:12 smithi066 ceph-mon[31185]: pgmap v178: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.4 MiB/s wr, 514 op/s 2024-09-15T22:51:14.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:13 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:14.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:13 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:14.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:13 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:14.588 INFO:tasks.workunit.client.0.smithi066.stdout: 433 285 0 291 0 63 0 2024-09-15T22:51:15.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:14 smithi087 ceph-mon[35290]: pgmap v179: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-09-15T22:51:15.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:14 smithi184 ceph-mon[35203]: pgmap v179: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-09-15T22:51:15.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:14 smithi066 ceph-mon[31185]: pgmap v179: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-09-15T22:51:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:16 smithi087 ceph-mon[35290]: pgmap v180: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-15T22:51:17.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:16 smithi184 ceph-mon[35203]: pgmap v180: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-15T22:51:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:16 smithi066 ceph-mon[31185]: pgmap v180: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.3 MiB/s wr, 579 op/s 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.691+0000 7f666effd640 1 -- 172.21.15.66:0/1615127620 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5612c945cbe0 con 0x5612c95768c0 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.691+0000 7f666effd640 10 client.16593 handle_command_reply: tid=0 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.691+0000 7f6698181740 1 client.16593 shutdown 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 msgr2=0x5612c94fca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f66800097e0 tx=0x7f6680015610 comp rx=0 tx=0).stop 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 shutdown_connections 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612c94fba30 0x5612c94fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5612c95768c0 0x5612c9578ce0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5612c94f1170 0x5612c94fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 --2- 172.21.15.66:0/1615127620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612c94f0850 0x5612c94fca80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f666effd640 0 client.16593 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 >> 172.21.15.66:0/1615127620 conn(0x5612c94ecde0 msgr2=0x5612c94f22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 shutdown_connections 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 1 -- 172.21.15.66:0/1615127620 wait complete. 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.692+0000 7f6698181740 20 client.16593 trim_cache size 0 max 16384 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 40, 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 18, 2024-09-15T22:51:18.695 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "44097cd3": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 18, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 145.3, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:18.697 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 msgr2=0x7f667c0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 0x7f667c0a5a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6678005fd0 tx=0x7f667800b430 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 msgr2=0x7f669011a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f668802aa30 tx=0x7f6688003d80 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 shutdown_connections 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f667c0a3540 0x7f667c0a5a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669011b140 0x7f66901135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690109830 0x7f669011a9e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 --2- 172.21.15.66:0/1684851352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6690109450 0x7f669011a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 >> 172.21.15.66:0/1684851352 conn(0x7f669006e140 msgr2=0x7f6690070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:18.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 shutdown_connections 2024-09-15T22:51:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:18.693+0000 7f6695da8640 1 -- 172.21.15.66:0/1684851352 wait complete. 2024-09-15T22:51:18.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:18 smithi066 ceph-mon[31185]: pgmap v181: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-15T22:51:19.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:18 smithi087 ceph-mon[35290]: pgmap v181: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-15T22:51:19.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:18 smithi184 ceph-mon[35203]: pgmap v181: 129 pgs: 129 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-15T22:51:20.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:20.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:20.674 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '44097cd3', quiesce took 37.0 seconds. Will release after: -11.649999999999999 2024-09-15T22:51:20.675 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:51:21.015 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:21.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:20 smithi184 ceph-mon[35203]: pgmap v182: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.1 MiB/s wr, 711 op/s 2024-09-15T22:51:21.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:20 smithi066 ceph-mon[31185]: pgmap v182: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.1 MiB/s wr, 711 op/s 2024-09-15T22:51:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:20 smithi087 ceph-mon[35290]: pgmap v182: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.1 MiB/s wr, 711 op/s 2024-09-15T22:51:21.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 -- 172.21.15.66:0/1921844090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 msgr2=0x7f622010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 --2- 172.21.15.66:0/1921844090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622010ea90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6218009ca0 tx=0x7f621802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 -- 172.21.15.66:0/1921844090 shutdown_connections 2024-09-15T22:51:21.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 --2- 172.21.15.66:0/1921844090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622010ea90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 --2- 172.21.15.66:0/1921844090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220102790 0x7f62201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 --2- 172.21.15.66:0/1921844090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220101de0 0x7f62201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 -- 172.21.15.66:0/1921844090 >> 172.21.15.66:0/1921844090 conn(0x7f62200fd8e0 msgr2=0x7f62200ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 -- 172.21.15.66:0/1921844090 shutdown_connections 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.547+0000 7f6228185640 1 -- 172.21.15.66:0/1921844090 wait complete. 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 Processor -- start 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 -- start start 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 0x7f6220198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6220111f70 con 0x7f6220106f10 2024-09-15T22:51:21.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6220111df0 con 0x7f6220101de0 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6228185640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62201120f0 con 0x7f6220102790 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6225f21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6225720640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 0x7f6220198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6225f21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:36766/0 (socket says 172.21.15.66:36766) 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.548+0000 7f6225f21640 1 -- 172.21.15.66:0/3315356518 learned_addr learned my addr 172.21.15.66:0/3315356518 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6226722640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 -- 172.21.15.66:0/3315356518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 msgr2=0x7f6220198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 0x7f6220198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 -- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 msgr2=0x7f622019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 -- 172.21.15.66:0/3315356518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622019d3a0 con 0x7f6220101de0 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225720640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 0x7f6220198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:21.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6225f21640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f621c00e9f0 tx=0x7f621c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c00cd80 con 0x7f6220101de0 2024-09-15T22:51:21.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622019d690 con 0x7f6220101de0 2024-09-15T22:51:21.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.549+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f621c010910 con 0x7f6220101de0 2024-09-15T22:51:21.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.550+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0188f0 con 0x7f6220101de0 2024-09-15T22:51:21.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.550+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62201a4f70 con 0x7f6220101de0 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.551+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62201021c0 con 0x7f6220101de0 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.552+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f621c010ac0 con 0x7f6220101de0 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.553+0000 7f6216ffd640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 0x7f620c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.553+0000 7f6225720640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 0x7f620c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.553+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f621c0d0740 con 0x7f6220101de0 2024-09-15T22:51:21.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.554+0000 7f6225720640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 0x7f620c0a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62200fdd70 tx=0x7f6210005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.558+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f621c09c700 con 0x7f6220101de0 2024-09-15T22:51:21.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.850+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6220199750 con 0x7f6220101de0 2024-09-15T22:51:21.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.851+0000 7f6216ffd640 1 -- 172.21.15.66:0/3315356518 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11995 (secure 0 0 0) 0x7f621c0a0a00 con 0x7f6220101de0 2024-09-15T22:51:21.853 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:51:21.853 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":40,"btime":"2024-09-15T22:50:49:303898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:50:48.952823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:51:21.853 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 40 2024-09-15T22:51:21.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 msgr2=0x7f620c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 0x7f620c0a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62200fdd70 tx=0x7f6210005f90 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 msgr2=0x7f62201983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f621c00e9f0 tx=0x7f621c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 shutdown_connections 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f620c0a33b0 0x7f620c0a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6220106f10 0x7f622019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6220102790 0x7f6220198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 --2- 172.21.15.66:0/3315356518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6220101de0 0x7f62201983f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 >> 172.21.15.66:0/3315356518 conn(0x7f62200fd8e0 msgr2=0x7f62200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 shutdown_connections 2024-09-15T22:51:21.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:21.854+0000 7f6228185640 1 -- 172.21.15.66:0/3315356518 wait complete. 2024-09-15T22:51:22.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:21 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:22.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3315356518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:21 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:22.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3315356518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:22.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:21 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:22.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3315356518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:23.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:22 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:22 smithi066 ceph-mon[31185]: pgmap v183: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-15T22:51:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:22 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:22 smithi087 ceph-mon[35290]: pgmap v183: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-15T22:51:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:22 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:22 smithi184 ceph-mon[35203]: pgmap v183: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-15T22:51:24.025 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 44097cd3 --release --await' 2024-09-15T22:51:24.026 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 44097cd3 --release --await 2024-09-15T22:51:24.528 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:24.590 INFO:tasks.workunit.client.0.smithi066.stdout: 433 27744 0 17947 0 9781 0 2024-09-15T22:51:24.940 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:24 smithi066 ceph-mon[31185]: pgmap v184: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.8 MiB/s wr, 791 op/s 2024-09-15T22:51:25.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 -- 172.21.15.66:0/2845585633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 msgr2=0x7f61281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 --2- 172.21.15.66:0/2845585633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f61281029b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6114009900 tx=0x7f611402a480 comp rx=0 tx=0).stop 2024-09-15T22:51:25.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 -- 172.21.15.66:0/2845585633 shutdown_connections 2024-09-15T22:51:25.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 --2- 172.21.15.66:0/2845585633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 --2- 172.21.15.66:0/2845585633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f61281029b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 --2- 172.21.15.66:0/2845585633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f6128101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 -- 172.21.15.66:0/2845585633 >> 172.21.15.66:0/2845585633 conn(0x7f61280fc7d0 msgr2=0x7f61280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 -- 172.21.15.66:0/2845585633 shutdown_connections 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.172+0000 7f612ef9b640 1 -- 172.21.15.66:0/2845585633 wait complete. 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 Processor -- start 2024-09-15T22:51:25.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 -- start start 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f612819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6128110f80 con 0x7f6128102570 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6128110e00 con 0x7f6128100e20 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.173+0000 7f612ef9b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6128111100 con 0x7f6128102ef0 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612d538640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58298/0 (socket says 172.21.15.66:58298) 2024-09-15T22:51:25.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612d538640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612819eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49430/0 (socket says 172.21.15.66:49430) 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f6127fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f612819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 -- 172.21.15.66:0/1074749758 learned_addr learned my addr 172.21.15.66:0/1074749758 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 -- 172.21.15.66:0/1074749758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 msgr2=0x7f612819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 -- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 msgr2=0x7f612819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f612819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 -- 172.21.15.66:0/1074749758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612819f6d0 con 0x7f6128100e20 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f612cd37640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9f0 tx=0x7f611c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f6125ffb640 1 -- 172.21.15.66:0/1074749758 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c00cd80 con 0x7f6128100e20 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.174+0000 7f6125ffb640 1 -- 172.21.15.66:0/1074749758 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f611c010910 con 0x7f6128100e20 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.175+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612819f9c0 con 0x7f6128100e20 2024-09-15T22:51:25.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.175+0000 7f6125ffb640 1 -- 172.21.15.66:0/1074749758 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c018990 con 0x7f6128100e20 2024-09-15T22:51:25.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.175+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61281a72a0 con 0x7f6128100e20 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6125ffb640 1 -- 172.21.15.66:0/1074749758 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f611c010ac0 con 0x7f6128100e20 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 Processor -- start 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 -- start start 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c04630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5569d8b5c620 con 0x5569d8c02240 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5569d8b03e50 con 0x5569d8bf7060 2024-09-15T22:51:25.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f6131374740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5569d8b585e0 con 0x5569d8bf7980 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f612cd37640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f612d538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.178+0000 7f612d538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58310/0 (socket says 172.21.15.66:58310) 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612d538640 1 -- 172.21.15.66:0/3746803161 learned_addr learned my addr 172.21.15.66:0/3746803161 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612cd37640 1 -- 172.21.15.66:0/3746803161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 msgr2=0x5569d8bf7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612cd37640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612cd37640 1 -- 172.21.15.66:0/3746803161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 msgr2=0x5569d8c04630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:51:25.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f6127fff640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c04630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612cd37640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c04630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612cd37640 1 -- 172.21.15.66:0/3746803161 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d8af4d40 con 0x5569d8bf7980 2024-09-15T22:51:25.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f612d538640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:25.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f6127fff640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c04630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:25.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.179+0000 7f6125ffb640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 0x7f61180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f612cd37640 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c01d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f611c0cd780 tx=0x7f611c0d6a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2850528ec2108e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f612d538640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 0x7f61180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f6125ffb640 1 -- 172.21.15.66:0/1074749758 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f611c0d0400 con 0x7f6128100e20 2024-09-15T22:51:25.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f6112ffd640 1 -- 172.21.15.66:0/3746803161 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c026030 con 0x5569d8bf7980 2024-09-15T22:51:25.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f6112ffd640 1 -- 172.21.15.66:0/3746803161 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f611c09c3c0 con 0x5569d8bf7980 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.180+0000 7f6112ffd640 1 -- 172.21.15.66:0/3746803161 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c09bd20 con 0x5569d8bf7980 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- 172.21.15.66:0/3746803161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 msgr2=0x5569d8c01d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f612d538640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 0x7f61180a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6120009fd0 tx=0x7f6120009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c01d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f611c0cd780 tx=0x7f611c0d6a70 comp rx=0 tx=0).stop 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- 172.21.15.66:0/3746803161 shutdown_connections 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c04630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c01d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 --2- 172.21.15.66:0/3746803161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- 172.21.15.66:0/3746803161 >> 172.21.15.66:0/3746803161 conn(0x5569d8bf35f0 msgr2=0x5569d8bf39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- 172.21.15.66:0/3746803161 shutdown_connections 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- 172.21.15.66:0/3746803161 wait complete. 2024-09-15T22:51:25.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.181+0000 7f6131374740 1 -- start start 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 Processor -- start 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 0x5569d8bff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8bff690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5569d8c04e10 con 0x5569d8bf7060 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5569d8ae4f10 con 0x5569d8c02240 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5569d8c04f90 con 0x5569d8bf7980 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6131374740 10 client.0 _ll_register_callbacks cb 0x5569d8b08db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f612cd37640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 0x5569d8bff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6127fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8bff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f612d538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6127fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8bff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49452/0 (socket says 172.21.15.66:49452) 2024-09-15T22:51:25.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f612d538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58326/0 (socket says 172.21.15.66:58326) 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f612cd37640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 0x5569d8bff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34212/0 (socket says 172.21.15.66:34212) 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.182+0000 7f6127fff640 1 -- 172.21.15.66:0/193916591 learned_addr learned my addr 172.21.15.66:0/193916591 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 -- 172.21.15.66:0/193916591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 msgr2=0x5569d8bff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8bff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 -- 172.21.15.66:0/193916591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 msgr2=0x5569d8bff150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 0x5569d8bff150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 -- 172.21.15.66:0/193916591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569d886b580 con 0x5569d8c02240 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f612d538640 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f612000fa80 tx=0x7f6120004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7e362226321e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6107fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120004b20 con 0x5569d8c02240 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f6120017030 con 0x5569d8c02240 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f611c09c3c0 con 0x5569d8c02240 2024-09-15T22:51:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6120004cc0 con 0x5569d8c02240 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6131374740 10 client.26210 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5569d8935960 con 0x5569d8c02240 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.183+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f611c09c3c0 con 0x5569d8c02240 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f61200046a0 con 0x5569d8c02240 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 10 client.26210 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 10 client.26210 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 20 client.26210 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c11e00 0x5569d8c14270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 4 client.26210 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569d8b69b90 con 0x5569d8c11e00 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f612cd37640 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c11e00 0x5569d8c14270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f612cd37640 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c11e00 0x5569d8c14270 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a04e66bc787a62 server_cookie=f1c4fb542f906c69 in_seq=0 out_seq=0 2024-09-15T22:51:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.184+0000 7f6107fff640 10 client.26210 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6107fff640 1 -- 172.21.15.66:0/193916591 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569d8b69b90 con 0x5569d8c11e00 2024-09-15T22:51:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6107fff640 10 client.26210 handle_command_reply: tid=0 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 client.26210 shutdown 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 msgr2=0x5569d8bffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f612000fa80 tx=0x7f6120004ab0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 shutdown_connections 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c11e00 0x5569d8c14270 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8c02240 0x5569d8bffbd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8bff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 --2- 172.21.15.66:0/193916591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7060 0x5569d8bff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 >> 172.21.15.66:0/193916591 conn(0x5569d8bf35f0 msgr2=0x5569d8bf92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6107fff640 0 client.26210 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 shutdown_connections 2024-09-15T22:51:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.186+0000 7f6131374740 1 -- 172.21.15.66:0/193916591 wait complete. 2024-09-15T22:51:25.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.187+0000 7f6131374740 20 client.26210 trim_cache size 0 max 16384 2024-09-15T22:51:25.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.210+0000 7f6131374740 1 Processor -- start 2024-09-15T22:51:25.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.210+0000 7f6131374740 1 -- start start 2024-09-15T22:51:25.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.210+0000 7f6131374740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6131374740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7980 0x5569d8bfda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6131374740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 0x5569d8bf2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6131374740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61281b13a0 con 0x5569d8bf7980 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6131374740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61281b3060 con 0x5569d8bf7060 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6131374740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61281b1a70 con 0x5569d8c02240 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 0x5569d8bf2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58340/0 (socket says 172.21.15.66:58340) 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612cd37640 1 -- 172.21.15.66:0/3327486049 learned_addr learned my addr 172.21.15.66:0/3327486049 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f6127fff640 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7980 0x5569d8bfda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 -- 172.21.15.66:0/3327486049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 msgr2=0x5569d8bf9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 -- 172.21.15.66:0/3327486049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7980 msgr2=0x5569d8bfda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7980 0x5569d8bfda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 -- 172.21.15.66:0/3327486049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569d8c01090 con 0x5569d8c02240 2024-09-15T22:51:25.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.211+0000 7f612d538640 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 0x5569d8bf2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6120018040 tx=0x7f6120011660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f153e668b12bdd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.212+0000 7f61127fc640 1 -- 172.21.15.66:0/3327486049 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612003b070 con 0x5569d8c02240 2024-09-15T22:51:25.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.212+0000 7f61127fc640 1 -- 172.21.15.66:0/3327486049 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6120003e50 con 0x5569d8c02240 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.212+0000 7f61127fc640 1 -- 172.21.15.66:0/3327486049 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61200046f0 con 0x5569d8c02240 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- 172.21.15.66:0/3327486049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 msgr2=0x5569d8bf2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 0x5569d8bf2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6120018040 tx=0x7f6120011660 comp rx=0 tx=0).stop 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- 172.21.15.66:0/3327486049 shutdown_connections 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8c02240 0x5569d8bf2640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8bf7980 0x5569d8bfda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 --2- 172.21.15.66:0/3327486049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8bf9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- 172.21.15.66:0/3327486049 >> 172.21.15.66:0/3327486049 conn(0x5569d8bf35f0 msgr2=0x5569d8bf1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- 172.21.15.66:0/3327486049 shutdown_connections 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- 172.21.15.66:0/3327486049 wait complete. 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 -- start start 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.213+0000 7f6131374740 1 Processor -- start 2024-09-15T22:51:25.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61281b28d0 con 0x5569d8c02240 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61281b2140 con 0x5569d8bf7060 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61281af380 con 0x5569d8bf7980 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6131374740 10 client.0 _ll_register_callbacks cb 0x7f612000f940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612d538640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f6127fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612cd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58346/0 (socket says 172.21.15.66:58346) 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612cd37640 1 -- 172.21.15.66:0/1761029564 learned_addr learned my addr 172.21.15.66:0/1761029564 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612cd37640 1 -- 172.21.15.66:0/1761029564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 msgr2=0x5569d8c067a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.214+0000 7f612cd37640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c067a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f612cd37640 1 -- 172.21.15.66:0/1761029564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 msgr2=0x5569d8c7bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f612cd37640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c7bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f612cd37640 1 -- 172.21.15.66:0/1761029564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569d8bfe100 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6127fff640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f612cd37640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f611c098820 tx=0x7f611c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1fc79cdc552b55f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c09bd20 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f611c09a6c0 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6120003e50 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f611c098660 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6131374740 10 client.26216 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5569d8c7cf80 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6120003e50 con 0x5569d8bf7060 2024-09-15T22:51:25.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.215+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f611c0cda00 con 0x5569d8bf7060 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 10 client.26216 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 10 client.26216 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 20 client.26216 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c7d260 0x5569d8c7f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 4 client.26216 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "44097cd3", "release": true, "await": true}] 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "44097cd3", "release": true, "await": true}) -- 0x5569d8b640a0 con 0x5569d8c7d260 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6127fff640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c7d260 0x5569d8c7f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6127fff640 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c7d260 0x5569d8c7f680 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10fb1eabe94934ca server_cookie=7c825b78327ee24b in_seq=0 out_seq=0 2024-09-15T22:51:25.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:25.216+0000 7f6107fff640 10 client.26216 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:24 smithi087 ceph-mon[35290]: pgmap v184: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.8 MiB/s wr, 791 op/s 2024-09-15T22:51:25.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:24 smithi184 ceph-mon[35203]: pgmap v184: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.8 MiB/s wr, 791 op/s 2024-09-15T22:51:26.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.324+0000 7f6107fff640 1 -- 172.21.15.66:0/1761029564 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5569d8b640a0 con 0x5569d8c7d260 2024-09-15T22:51:26.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.324+0000 7f6107fff640 10 client.26216 handle_command_reply: tid=0 2024-09-15T22:51:26.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.324+0000 7f6131374740 1 client.26216 shutdown 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 msgr2=0x5569d8c06260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f611c098820 tx=0x7f611c009310 comp rx=0 tx=0).stop 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 shutdown_connections 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5569d8c02240 0x5569d8c7bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5569d8bf7980 0x5569d8c067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5569d8c7d260 0x5569d8c7f680 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 --2- 172.21.15.66:0/1761029564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5569d8bf7060 0x5569d8c06260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6107fff640 0 client.26216 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.325+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 >> 172.21.15.66:0/1761029564 conn(0x5569d8bf35f0 msgr2=0x5569d8bff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.326+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 shutdown_connections 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.326+0000 7f6131374740 1 -- 172.21.15.66:0/1761029564 wait complete. 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.326+0000 7f6131374740 20 client.26216 trim_cache size 0 max 16384 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 40, 2024-09-15T22:51:26.328 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 20, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "44097cd3": { 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 20, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 145.3, 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:51:26.329 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:26.330 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 msgr2=0x7f61180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 0x7f61180a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6120009fd0 tx=0x7f6120009500 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 msgr2=0x7f612819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9f0 tx=0x7f611c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 shutdown_connections 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61180a33b0 0x7f61180a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6128102ef0 0x7f612819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6128102570 0x7f612819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 --2- 172.21.15.66:0/1074749758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6128100e20 0x7f612819a720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.328+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 >> 172.21.15.66:0/1074749758 conn(0x7f61280fc7d0 msgr2=0x7f612806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.329+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 shutdown_connections 2024-09-15T22:51:26.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:26.329+0000 7f612ef9b640 1 -- 172.21.15.66:0/1074749758 wait complete. 2024-09-15T22:51:27.019 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '44097cd3', total seconds elapsed: 43.4 2024-09-15T22:51:27.020 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.35 2024-09-15T22:51:27.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:51:27.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:26 smithi066 ceph-mon[31185]: pgmap v185: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.6 MiB/s wr, 685 op/s 2024-09-15T22:51:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:26 smithi087 ceph-mon[35290]: pgmap v185: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.6 MiB/s wr, 685 op/s 2024-09-15T22:51:27.365 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:26 smithi184 ceph-mon[35203]: pgmap v185: 129 pgs: 129 active+clean; 1.9 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 4.6 MiB/s wr, 685 op/s 2024-09-15T22:51:27.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 -- 172.21.15.66:0/1711924861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d0106f20 msgr2=0x7f31d010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 --2- 172.21.15.66:0/1711924861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d0106f20 0x7f31d010eaa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009ca0 tx=0x7f31c802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 -- 172.21.15.66:0/1711924861 shutdown_connections 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 --2- 172.21.15.66:0/1711924861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d0106f20 0x7f31d010eaa0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 --2- 172.21.15.66:0/1711924861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d01027a0 0x7f31d01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 --2- 172.21.15.66:0/1711924861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.894+0000 7f31d754d640 1 -- 172.21.15.66:0/1711924861 >> 172.21.15.66:0/1711924861 conn(0x7f31d00fd8f0 msgr2=0x7f31d00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.895+0000 7f31d754d640 1 -- 172.21.15.66:0/1711924861 shutdown_connections 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.895+0000 7f31d754d640 1 -- 172.21.15.66:0/1711924861 wait complete. 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.896+0000 7f31d754d640 1 Processor -- start 2024-09-15T22:51:27.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.896+0000 7f31d754d640 1 -- start start 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.896+0000 7f31d754d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d754d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d01027a0 0x7f31d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d754d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 0x7f31d0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d754d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111f80 con 0x7f31d01027a0 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d754d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111e00 con 0x7f31d0101df0 2024-09-15T22:51:27.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d754d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112100 con 0x7f31d0106f20 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58372/0 (socket says 172.21.15.66:58372) 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 -- 172.21.15.66:0/1365714861 learned_addr learned my addr 172.21.15.66:0/1365714861 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d4ae8640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d01027a0 0x7f31d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d5aea640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 0x7f31d0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 -- 172.21.15.66:0/1365714861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 msgr2=0x7f31d0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 0x7f31d0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 -- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d01027a0 msgr2=0x7f31d0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d01027a0 0x7f31d0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.897+0000 7f31d52e9640 1 -- 172.21.15.66:0/1365714861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d01a68a0 con 0x7f31d0101df0 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31d5aea640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 0x7f31d0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:27.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31d52e9640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00cd80 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31cc010910 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc018990 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.898+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d01a6b90 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.899+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d0198140 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.900+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b4005290 con 0x7f31d0101df0 2024-09-15T22:51:27.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.901+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f31cc018b30 con 0x7f31d0101df0 2024-09-15T22:51:27.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.902+0000 7f31c67fc640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 0x7f31bc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.902+0000 7f31d4ae8640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 0x7f31bc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.902+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31cc0d0370 con 0x7f31d0101df0 2024-09-15T22:51:27.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.902+0000 7f31d4ae8640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 0x7f31bc0a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31d0075f80 tx=0x7f31c0005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:27.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:27.910+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31cc09c980 con 0x7f31d0101df0 2024-09-15T22:51:28.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:27 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:27 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:27 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.233+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b4005850 con 0x7f31d0101df0 2024-09-15T22:51:28.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.234+0000 7f31c67fc640 1 -- 172.21.15.66:0/1365714861 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11995 (secure 0 0 0) 0x7f31cc09c280 con 0x7f31d0101df0 2024-09-15T22:51:28.235 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:51:28.235 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":40,"btime":"2024-09-15T22:50:49:303898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:50:48.952823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:51:28.236 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 40 2024-09-15T22:51:28.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 msgr2=0x7f31bc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 0x7f31bc0a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31d0075f80 tx=0x7f31c0005f90 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 msgr2=0x7f31d00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 shutdown_connections 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31bc0a3430 0x7f31bc0a58f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d0106f20 0x7f31d0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31d01027a0 0x7f31d0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 --2- 172.21.15.66:0/1365714861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0101df0 0x7f31d00744f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 >> 172.21.15.66:0/1365714861 conn(0x7f31d00fd8f0 msgr2=0x7f31d00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 shutdown_connections 2024-09-15T22:51:28.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:28.236+0000 7f31d754d640 1 -- 172.21.15.66:0/1365714861 wait complete. 2024-09-15T22:51:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:27 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:27 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:27 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:27 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:27 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:27 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:28.927 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 145.35 --await-for 45.0' 2024-09-15T22:51:28.927 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 145.35 --await-for 45.0 2024-09-15T22:51:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:28 smithi066 ceph-mon[31185]: pgmap v186: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-15T22:51:29.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:28 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1365714861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:28 smithi087 ceph-mon[35290]: pgmap v186: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-15T22:51:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:28 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1365714861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:29.354 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:28 smithi184 ceph-mon[35203]: pgmap v186: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 5.3 MiB/s wr, 766 op/s 2024-09-15T22:51:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:28 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1365714861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 -- 172.21.15.66:0/292808784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 msgr2=0x7f41581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 --2- 172.21.15.66:0/292808784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f41581021c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4148009900 tx=0x7f414802a410 comp rx=0 tx=0).stop 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 -- 172.21.15.66:0/292808784 shutdown_connections 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 --2- 172.21.15.66:0/292808784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158106f10 0x7f415810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 --2- 172.21.15.66:0/292808784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158102790 0x7f41581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 --2- 172.21.15.66:0/292808784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f41581021c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 -- 172.21.15.66:0/292808784 >> 172.21.15.66:0/292808784 conn(0x7f41580fd8e0 msgr2=0x7f41580ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 -- 172.21.15.66:0/292808784 shutdown_connections 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.529+0000 7f415e432640 1 -- 172.21.15.66:0/292808784 wait complete. 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.530+0000 7f415e432640 1 Processor -- start 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.530+0000 7f415e432640 1 -- start start 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 0x7f4158198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 0x7f415819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4158111f70 con 0x7f4158101de0 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4158111df0 con 0x7f4158106f10 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415e432640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f41581120f0 con 0x7f4158102790 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f4157fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 0x7f4158198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f4157fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34262/0 (socket says 172.21.15.66:34262) 2024-09-15T22:51:30.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415c9cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 0x7f415819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f4157fff640 1 -- 172.21.15.66:0/1665175982 learned_addr learned my addr 172.21.15.66:0/1665175982 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 -- 172.21.15.66:0/1665175982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 msgr2=0x7f415819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 0x7f415819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 -- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 msgr2=0x7f4158198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 -- 172.21.15.66:0/1665175982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415819d4e0 con 0x7f4158102790 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f415c9cf640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 0x7f415819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f4157fff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.531+0000 7f414ffff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 0x7f4158198a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f414000e9f0 tx=0x7f414000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.532+0000 7f4155ffb640 1 -- 172.21.15.66:0/1665175982 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414000ccc0 con 0x7f4158102790 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.532+0000 7f4155ffb640 1 -- 172.21.15.66:0/1665175982 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4140010910 con 0x7f4158102790 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.532+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415819d7d0 con 0x7f4158102790 2024-09-15T22:51:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.532+0000 7f4155ffb640 1 -- 172.21.15.66:0/1665175982 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140018960 con 0x7f4158102790 2024-09-15T22:51:30.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.532+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41581a50b0 con 0x7f4158102790 2024-09-15T22:51:30.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 Processor -- start 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 -- start start 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b58f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f4155ffb640 1 -- 172.21.15.66:0/1665175982 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4140010ac0 con 0x7f4158102790 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b6b5851160 con 0x55b6b58f7a30 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b6b57f8720 con 0x55b6b58ed170 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f416080b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b6b584d120 con 0x55b6b58ec850 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f415c9cf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f415c9cf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49508/0 (socket says 172.21.15.66:49508) 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f414ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f415c9cf640 1 -- 172.21.15.66:0/272905149 learned_addr learned my addr 172.21.15.66:0/272905149 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.535+0000 7f4157fff640 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b58f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 -- 172.21.15.66:0/272905149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 msgr2=0x55b6b58f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b58f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 -- 172.21.15.66:0/272905149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 msgr2=0x55b6b58f9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 -- 172.21.15.66:0/272905149 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b55c2ba0 con 0x55b6b58ec850 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f414ffff640 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f415c9cf640 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4150011790 tx=0x7f4150011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8186f6b60144c304 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f4155ffb640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 0x7f41440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f414e7fc640 1 -- 172.21.15.66:0/272905149 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150003c30 con 0x55b6b58ec850 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f4155ffb640 1 -- 172.21.15.66:0/1665175982 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f41400d0480 con 0x7f4158102790 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f414e7fc640 1 -- 172.21.15.66:0/272905149 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f415000fe80 con 0x55b6b58ec850 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.536+0000 7f4157fff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 0x7f41440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f414e7fc640 1 -- 172.21.15.66:0/272905149 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500193e0 con 0x55b6b58ec850 2024-09-15T22:51:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 -- 172.21.15.66:0/272905149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 msgr2=0x55b6b58ecc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f4157fff640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 0x7f41440a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55b6b58e9c40 tx=0x7f4148005a20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4150011790 tx=0x7f4150011c50 comp rx=0 tx=0).stop 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 -- 172.21.15.66:0/272905149 shutdown_connections 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b58f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 --2- 172.21.15.66:0/272905149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ecc30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 -- 172.21.15.66:0/272905149 >> 172.21.15.66:0/272905149 conn(0x55b6b58e8de0 msgr2=0x55b6b58e91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 -- 172.21.15.66:0/272905149 shutdown_connections 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.537+0000 7f416080b740 1 -- 172.21.15.66:0/272905149 wait complete. 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.538+0000 7f416080b740 1 -- start start 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.538+0000 7f416080b740 1 Processor -- start 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.538+0000 7f416080b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 0x55b6b58f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.538+0000 7f416080b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 0x55b6b58f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f416080b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f416080b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b6b58feab0 con 0x55b6b58f7a30 2024-09-15T22:51:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f416080b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b6b57d9900 con 0x55b6b58ec850 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f416080b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b6b58fec30 con 0x55b6b58ed170 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f416080b740 10 client.0 _ll_register_callbacks cb 0x55b6b57d7780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f4157fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 0x55b6b58f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f4157fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 0x55b6b58f48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58408/0 (socket says 172.21.15.66:58408) 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f4157fff640 1 -- 172.21.15.66:0/3805368048 learned_addr learned my addr 172.21.15.66:0/3805368048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f415c9cf640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 0x55b6b58f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 -- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 msgr2=0x55b6b58f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 0x55b6b58f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 -- 172.21.15.66:0/3805368048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 msgr2=0x55b6b58f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f414ffff640 1 -- 172.21.15.66:0/3805368048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b5819c50 con 0x55b6b58ed170 2024-09-15T22:51:30.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.539+0000 7f415c9cf640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f414ffff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 0x55b6b58f4e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f41400cd800 tx=0x7f414009c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7396ce659563743 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f41377fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400a5000 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f414009b890 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6b585e890 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.540+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f414009ba90 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 10 client.26236 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b6b590a6f0 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41400b5140 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f4140098190 con 0x55b6b58ed170 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 10 client.26236 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 10 client.26236 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 20 client.26236 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b590bb70 0x55b6b590df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 4 client.26236 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.541+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b585e890 con 0x55b6b590bb70 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.542+0000 7f4157fff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b590bb70 0x55b6b590df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.542+0000 7f4157fff640 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b590bb70 0x55b6b590df60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fe7a43581fdde76 server_cookie=5a77fe750de6d037 in_seq=0 out_seq=0 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.542+0000 7f41377fe640 10 client.26236 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f41377fe640 1 -- 172.21.15.66:0/3805368048 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6b585e890 con 0x55b6b590bb70 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f41377fe640 10 client.26236 handle_command_reply: tid=0 2024-09-15T22:51:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 client.26236 shutdown 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 msgr2=0x55b6b58f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 0x55b6b58f4e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f41400cd800 tx=0x7f414009c070 comp rx=0 tx=0).stop 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 shutdown_connections 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58f7a30 0x55b6b58f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ed170 0x55b6b58f4e30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b590bb70 0x55b6b590df60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 --2- 172.21.15.66:0/3805368048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ec850 0x55b6b58f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f41377fe640 0 client.26236 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 >> 172.21.15.66:0/3805368048 conn(0x55b6b58e8de0 msgr2=0x55b6b58eeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 shutdown_connections 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 1 -- 172.21.15.66:0/3805368048 wait complete. 2024-09-15T22:51:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.545+0000 7f416080b740 20 client.26236 trim_cache size 0 max 16384 2024-09-15T22:51:30.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 Processor -- start 2024-09-15T22:51:30.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 -- start start 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58f7a30 0x55b6b58e8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41581acea0 con 0x55b6b58ed170 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41581aeb60 con 0x55b6b58f7a30 2024-09-15T22:51:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f416080b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f41581ad570 con 0x55b6b58ec850 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f414ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f4157fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f414ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34278/0 (socket says 172.21.15.66:34278) 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f414ffff640 1 -- 172.21.15.66:0/1530959791 learned_addr learned my addr 172.21.15.66:0/1530959791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.566+0000 7f415c9cf640 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58f7a30 0x55b6b58e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 -- 172.21.15.66:0/1530959791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 msgr2=0x55b6b58ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 -- 172.21.15.66:0/1530959791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58f7a30 msgr2=0x55b6b58e8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58f7a30 0x55b6b58e8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 -- 172.21.15.66:0/1530959791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b58fa160 con 0x55b6b58ed170 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414ffff640 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f414000c6a0 tx=0x7f41400a08c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73a27df99399dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414dffb640 1 -- 172.21.15.66:0/1530959791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140098190 con 0x55b6b58ed170 2024-09-15T22:51:30.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414dffb640 1 -- 172.21.15.66:0/1530959791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41400d0160 con 0x55b6b58ed170 2024-09-15T22:51:30.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.567+0000 7f414dffb640 1 -- 172.21.15.66:0/1530959791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400b5140 con 0x55b6b58ed170 2024-09-15T22:51:30.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- 172.21.15.66:0/1530959791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 msgr2=0x55b6b58e7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f414000c6a0 tx=0x7f41400a08c0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- 172.21.15.66:0/1530959791 shutdown_connections 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58f7a30 0x55b6b58e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ed170 0x55b6b58e7dd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 --2- 172.21.15.66:0/1530959791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58ec850 0x55b6b58ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- 172.21.15.66:0/1530959791 >> 172.21.15.66:0/1530959791 conn(0x55b6b58e8de0 msgr2=0x55b6b58e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- 172.21.15.66:0/1530959791 shutdown_connections 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- 172.21.15.66:0/1530959791 wait complete. 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.568+0000 7f416080b740 1 -- start start 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 Processor -- start 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 0x55b6b596eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58f7a30 0x55b6b58ff430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41581ae3d0 con 0x55b6b58ec850 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41581adc40 con 0x55b6b58ed170 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f41581aae80 con 0x55b6b58f7a30 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f416080b740 10 client.0 _ll_register_callbacks cb 0x7f414000ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58438/0 (socket says 172.21.15.66:58438) 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 -- 172.21.15.66:0/3891489261 learned_addr learned my addr 172.21.15.66:0/3891489261 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f4157fff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 0x55b6b596eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f415c9cf640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58f7a30 0x55b6b58ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 -- 172.21.15.66:0/3891489261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58f7a30 msgr2=0x55b6b58ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58f7a30 0x55b6b58ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 -- 172.21.15.66:0/3891489261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 msgr2=0x55b6b596eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 0x55b6b596eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.569+0000 7f414ffff640 1 -- 172.21.15.66:0/3891489261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b58ffc30 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f4157fff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 0x55b6b596eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f414ffff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f414009c3d0 tx=0x7f4140005b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15991fd799c636b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f41377fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400b5350 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41400d0160 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4140010430 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4140010650 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f416080b740 10 client.26240 fetch_fsmap learned FSMap version 40 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b6b59762a0 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.570+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41400d0160 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 40) ==== 8418+0+0 (secure 0 0 0) 0x7f41400a18d0 con 0x55b6b58ed170 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 10 client.26240 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:51:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 10 client.26240 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 20 client.26240 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b5976870 0x55b6b5978c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 4 client.26240 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.35, "await_for": 45.0}] 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.35, "await_for": 45.0}) -- 0x55b6b5858be0 con 0x55b6b5976870 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f4157fff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b5976870 0x55b6b5978c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f41377fe640 10 client.26240 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:30.571+0000 7f4157fff640 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b5976870 0x55b6b5978c90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77461d80db5f4ce1 server_cookie=5a1b776e1a0f7478 in_seq=0 out_seq=0 2024-09-15T22:51:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:30 smithi087 ceph-mon[35290]: pgmap v187: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.3 MiB/s wr, 857 op/s 2024-09-15T22:51:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:30 smithi184 ceph-mon[35203]: pgmap v187: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.3 MiB/s wr, 857 op/s 2024-09-15T22:51:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:30 smithi066 ceph-mon[31185]: pgmap v187: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 5.3 MiB/s wr, 857 op/s 2024-09-15T22:51:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:32 smithi087 ceph-mon[35290]: pgmap v188: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.8 MiB/s wr, 803 op/s 2024-09-15T22:51:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:32 smithi184 ceph-mon[35203]: pgmap v188: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.8 MiB/s wr, 803 op/s 2024-09-15T22:51:33.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:32 smithi066 ceph-mon[31185]: pgmap v188: 129 pgs: 129 active+clean; 2.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.8 MiB/s wr, 803 op/s 2024-09-15T22:51:34.596 INFO:tasks.workunit.client.0.smithi066.stdout: 439 43364 370 29454 225 12242 414 2024-09-15T22:51:35.250 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:34 smithi066 ceph-mon[31185]: pgmap v189: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.7 MiB/s wr, 825 op/s 2024-09-15T22:51:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:34 smithi087 ceph-mon[35290]: pgmap v189: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.7 MiB/s wr, 825 op/s 2024-09-15T22:51:35.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:34 smithi184 ceph-mon[35203]: pgmap v189: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 5.7 MiB/s wr, 825 op/s 2024-09-15T22:51:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:36 smithi087 ceph-mon[35290]: pgmap v190: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 5.5 MiB/s wr, 729 op/s 2024-09-15T22:51:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:36 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:51:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:36 smithi184 ceph-mon[35203]: pgmap v190: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 5.5 MiB/s wr, 729 op/s 2024-09-15T22:51:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:36 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:51:37.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:36 smithi066 ceph-mon[31185]: pgmap v190: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 5.5 MiB/s wr, 729 op/s 2024-09-15T22:51:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:36 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:51:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:38 smithi087 ceph-mon[35290]: pgmap v191: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 5.5 MiB/s wr, 634 op/s 2024-09-15T22:51:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:38 smithi184 ceph-mon[35203]: pgmap v191: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 5.5 MiB/s wr, 634 op/s 2024-09-15T22:51:39.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:38 smithi066 ceph-mon[31185]: pgmap v191: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 5.5 MiB/s wr, 634 op/s 2024-09-15T22:51:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:39 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:51:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:39 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:51:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:39 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:51:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:39 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:51:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:39 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:51:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:39 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:51:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:39 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:51:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:39 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:51:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:39 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:51:41.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:40 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:51:41.323 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:40 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:51:41.324 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:40 smithi184 ceph-mon[35203]: pgmap v192: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-15T22:51:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:40 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:51:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:40 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:51:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:40 smithi087 ceph-mon[35290]: pgmap v192: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-15T22:51:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:40 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:51:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:40 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:51:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:40 smithi066 ceph-mon[31185]: pgmap v192: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-15T22:51:41.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:51:41.883 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:42.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:41 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:42.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:41 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:51:42.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:41 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:51:42.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:41 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:51:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:41 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:41 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:51:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:41 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:51:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:41 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:51:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:41 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:41 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:51:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:41 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:51:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:41 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 -- 172.21.15.66:0/3798207189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 msgr2=0x7fc71010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 --2- 172.21.15.66:0/3798207189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71010eaf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc708009930 tx=0x7fc70802a420 comp rx=0 tx=0).stop 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 -- 172.21.15.66:0/3798207189 shutdown_connections 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 --2- 172.21.15.66:0/3798207189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71010eaf0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 --2- 172.21.15.66:0/3798207189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 0x7fc710106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 --2- 172.21.15.66:0/3798207189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 0x7fc710100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 -- 172.21.15.66:0/3798207189 >> 172.21.15.66:0/3798207189 conn(0x7fc710077210 msgr2=0x7fc7100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 -- 172.21.15.66:0/3798207189 shutdown_connections 2024-09-15T22:51:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.393+0000 7fc714e89640 1 -- 172.21.15.66:0/3798207189 wait complete. 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.394+0000 7fc714e89640 1 Processor -- start 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.394+0000 7fc714e89640 1 -- start start 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 0x7fc710198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 0x7fc7101989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111fa0 con 0x7fc710106f50 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111e20 con 0x7fc710100350 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc714e89640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112120 con 0x7fc710100d00 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38564/0 (socket says 172.21.15.66:38564) 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 -- 172.21.15.66:0/2301032905 learned_addr learned my addr 172.21.15.66:0/2301032905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 0x7fc7101989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70e59c640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 0x7fc710198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 -- 172.21.15.66:0/2301032905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 msgr2=0x7fc7101989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 0x7fc7101989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 -- 172.21.15.66:0/2301032905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 msgr2=0x7fc710198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 0x7fc710198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 -- 172.21.15.66:0/2301032905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71019d410 con 0x7fc710106f50 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.395+0000 7fc70ed9d640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc708005ab0 tx=0x7fc7080040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.396+0000 7fc7077fe640 1 -- 172.21.15.66:0/2301032905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70803f030 con 0x7fc710106f50 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.396+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71019d6a0 con 0x7fc710106f50 2024-09-15T22:51:42.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.396+0000 7fc7077fe640 1 -- 172.21.15.66:0/2301032905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7080044c0 con 0x7fc710106f50 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.396+0000 7fc7077fe640 1 -- 172.21.15.66:0/2301032905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708035070 con 0x7fc710106f50 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.396+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101a4fe0 con 0x7fc710106f50 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.398+0000 7fc7077fe640 1 -- 172.21.15.66:0/2301032905 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc708042030 con 0x7fc710106f50 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.398+0000 7fc717262740 1 Processor -- start 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.398+0000 7fc717262740 1 -- start start 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.398+0000 7fc717262740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322b9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc717262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc717262740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 0x55d322bade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc717262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d322b022e0 con 0x55d322b9cca0 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc717262740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d322aa9ce0 con 0x55d322baba90 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc717262740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d322afe2a0 con 0x55d322b9c380 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc7077fe640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 0x7fc6fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322b9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38568/0 (socket says 172.21.15.66:38568) 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 -- 172.21.15.66:0/167499099 learned_addr learned my addr 172.21.15.66:0/167499099 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322b9c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:59736/0 (socket says 172.21.15.66:59736) 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 0x55d322bade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70ed9d640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 0x7fc6fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 -- 172.21.15.66:0/167499099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 msgr2=0x55d322b9c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322b9c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 -- 172.21.15.66:0/167499099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 msgr2=0x55d322bade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 0x55d322bade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 -- 172.21.15.66:0/167499099 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d322a8e440 con 0x55d322b9cca0 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc7077fe640 1 -- 172.21.15.66:0/2301032905 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc7080f04a0 con 0x7fc710106f50 2024-09-15T22:51:42.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 0x55d322bade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70e59c640 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc70000ae90 tx=0x7fc70000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9e8817917b3080 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.399+0000 7fc70ed9d640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 0x7fc6fc0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ed970 tx=0x7fc7080e7220 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc704ff9640 1 -- 172.21.15.66:0/167499099 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700011850 con 0x55d322b9cca0 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc704ff9640 1 -- 172.21.15.66:0/167499099 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70001a480 con 0x55d322b9cca0 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc704ff9640 1 -- 172.21.15.66:0/167499099 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700010630 con 0x55d322b9cca0 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 -- 172.21.15.66:0/167499099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 msgr2=0x55d322bab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc70000ae90 tx=0x7fc70000f730 comp rx=0 tx=0).stop 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 -- 172.21.15.66:0/167499099 shutdown_connections 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322baba90 0x55d322bade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bab550 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 --2- 172.21.15.66:0/167499099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322b9c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 -- 172.21.15.66:0/167499099 >> 172.21.15.66:0/167499099 conn(0x55d322b98a30 msgr2=0x55d322b98e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 -- 172.21.15.66:0/167499099 shutdown_connections 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.400+0000 7fc717262740 1 -- 172.21.15.66:0/167499099 wait complete. 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 -- start start 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 Processor -- start 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322ba86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322ba8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d322bae660 con 0x55d322b9c380 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d322abd050 con 0x55d322b9cca0 2024-09-15T22:51:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d322bae7e0 con 0x55d322baba90 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc717262740 10 client.0 _ll_register_callbacks cb 0x55d322afd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38582/0 (socket says 172.21.15.66:38582) 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc70dd9b640 1 -- 172.21.15.66:0/3960826531 learned_addr learned my addr 172.21.15.66:0/3960826531 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc70e59c640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322ba86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.401+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322ba8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 -- 172.21.15.66:0/3960826531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 msgr2=0x55d322ba8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322ba8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 -- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 msgr2=0x55d322ba86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322ba86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 -- 172.21.15.66:0/3960826531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3228733c0 con 0x55d322b9c380 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009f30 tx=0x7fc6f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8926387433f205c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800fc50 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc70001a480 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc6f800fdf0 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc6f802a050 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc717262740 10 client.16728 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d322bba0d0 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70001a480 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.402+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7fc6f801d030 con 0x55d322b9c380 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 10 client.16728 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:42.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 20 client.16728 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322bbb590 0x55d322bbd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 4 client.16728 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d322b0f850 con 0x55d322bbb590 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc70e59c640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322bbb590 0x55d322bbd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc6f5ffb640 10 client.16728 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.403+0000 7fc70e59c640 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322bbb590 0x55d322bbd9a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f51223591f7f493 server_cookie=42d632beede371b8 in_seq=0 out_seq=0 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/3960826531 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d322b0f850 con 0x55d322bbb590 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc6f5ffb640 10 client.16728 handle_command_reply: tid=0 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 client.16728 shutdown 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 msgr2=0x55d322bab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009f30 tx=0x7fc6f80046c0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 shutdown_connections 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322ba8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322bbb590 0x55d322bbd9a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322ba86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc6f5ffb640 0 client.16728 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 --2- 172.21.15.66:0/3960826531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9c380 0x55d322bab3b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 >> 172.21.15.66:0/3960826531 conn(0x55d322b98a30 msgr2=0x55d322b9e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 shutdown_connections 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 1 -- 172.21.15.66:0/3960826531 wait complete. 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.404+0000 7fc717262740 20 client.16728 trim_cache size 0 max 16384 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 Processor -- start 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 -- start start 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9c380 0x55d322bb7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322bc37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101acff0 con 0x55d322b9cca0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101aecb0 con 0x55d322b9c380 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.421+0000 7fc717262740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101ad6c0 con 0x55d322baba90 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38584/0 (socket says 172.21.15.66:38584) 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 -- 172.21.15.66:0/1273655824 learned_addr learned my addr 172.21.15.66:0/1273655824 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322bc37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9c380 0x55d322bb7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 -- 172.21.15.66:0/1273655824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 msgr2=0x55d322bc37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322bc37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 -- 172.21.15.66:0/1273655824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9c380 msgr2=0x55d322bb7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9c380 0x55d322bb7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 -- 172.21.15.66:0/1273655824 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d322b9cad0 con 0x55d322b9cca0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc70e59c640 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc700005c40 tx=0x7fc70001ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c2fb834f120e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc6f7fff640 1 -- 172.21.15.66:0/1273655824 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700004be0 con 0x55d322b9cca0 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc6f7fff640 1 -- 172.21.15.66:0/1273655824 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc700003e50 con 0x55d322b9cca0 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.422+0000 7fc6f7fff640 1 -- 172.21.15.66:0/1273655824 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700004280 con 0x55d322b9cca0 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- 172.21.15.66:0/1273655824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 msgr2=0x55d322bc32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc700005c40 tx=0x7fc70001ae80 comp rx=0 tx=0).stop 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- 172.21.15.66:0/1273655824 shutdown_connections 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322baba90 0x55d322bc37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322b9cca0 0x55d322bc32b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- 172.21.15.66:0/1273655824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9c380 0x55d322bb7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- 172.21.15.66:0/1273655824 >> 172.21.15.66:0/1273655824 conn(0x55d322b98a30 msgr2=0x55d322ba3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- 172.21.15.66:0/1273655824 shutdown_connections 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- 172.21.15.66:0/1273655824 wait complete. 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 -- start start 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 Processor -- start 2024-09-15T22:51:42.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322bafbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.423+0000 7fc717262740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322bb00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101ae520 con 0x55d322baba90 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101add90 con 0x55d322b9cca0 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101aafd0 con 0x55d322b9c380 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 10 client.0 _ll_register_callbacks cb 0x7fc6f8010970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38596/0 (socket says 172.21.15.66:38596) 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 -- 172.21.15.66:0/984949044 learned_addr learned my addr 172.21.15.66:0/984949044 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70e59c640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322bb00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322bafbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 -- 172.21.15.66:0/984949044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 msgr2=0x55d322bafbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322bafbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 -- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 msgr2=0x55d322bb00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322bb00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 -- 172.21.15.66:0/984949044 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d322ba8f80 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70e59c640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322bb00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc70dd9b640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009730 tx=0x7fc6f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0b94740651ffae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc6f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8004940 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc700003e50 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.424+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc6f8027070 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc6f8004ae0 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 10 client.16734 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d322c26790 con 0x55d322baba90 2024-09-15T22:51:42.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc700003e50 con 0x55d322baba90 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7fc6f801d050 con 0x55d322baba90 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 10 client.16734 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 20 client.16734 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322c26da0 0x55d322c291c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 4 client.16734 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d322b09d60 con 0x55d322c26da0 2024-09-15T22:51:42.450 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.425+0000 7fc70e59c640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322c26da0 0x55d322c291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc70e59c640 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322c26da0 0x55d322c291c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ab6e74c5153fcf server_cookie=fbc669b34f753cc8 in_seq=0 out_seq=0 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc6f5ffb640 10 client.16734 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc6f5ffb640 1 -- 172.21.15.66:0/984949044 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d322b09d60 con 0x55d322c26da0 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc6f5ffb640 10 client.16734 handle_command_reply: tid=0 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 client.16734 shutdown 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 msgr2=0x55d322c25280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009730 tx=0x7fc6f80046c0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 shutdown_connections 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d322baba90 0x55d322c25280 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d322c26da0 0x55d322c291c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d322b9cca0 0x55d322bb00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 --2- 172.21.15.66:0/984949044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d322b9c380 0x55d322bafbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc6f5ffb640 0 client.16734 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 >> 172.21.15.66:0/984949044 conn(0x55d322b98a30 msgr2=0x55d322b97350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 shutdown_connections 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 1 -- 172.21.15.66:0/984949044 wait complete. 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.426+0000 7fc717262740 20 client.16734 trim_cache size 0 max 16384 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 msgr2=0x7fc6fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 0x7fc6fc0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7080ed970 tx=0x7fc7080e7220 comp rx=0 tx=0).stop 2024-09-15T22:51:42.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 msgr2=0x7fc71019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc708005ab0 tx=0x7fc7080040c0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 shutdown_connections 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6fc0a33b0 0x7fc6fc0a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710106f50 0x7fc71019cd30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710100d00 0x7fc7101989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 --2- 172.21.15.66:0/2301032905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc710100350 0x7fc710198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 >> 172.21.15.66:0/2301032905 conn(0x7fc710077210 msgr2=0x7fc710105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 shutdown_connections 2024-09-15T22:51:42.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.427+0000 7fc714e89640 1 -- 172.21.15.66:0/2301032905 wait complete. 2024-09-15T22:51:42.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.875+0000 7f41377fe640 1 -- 172.21.15.66:0/3891489261 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b6b5858be0 con 0x55b6b5976870 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.875+0000 7f41377fe640 10 client.26240 handle_command_reply: tid=0 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 client.26240 shutdown 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 msgr2=0x55b6b596f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f414009c3d0 tx=0x7f4140005b20 comp rx=0 tx=0).stop 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 shutdown_connections 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b6b58f7a30 0x55b6b58ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b6b5976870 0x55b6b5978c90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6b58ed170 0x55b6b596f0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f41377fe640 0 client.26240 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:42.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 --2- 172.21.15.66:0/3891489261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b6b58ec850 0x55b6b596eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 >> 172.21.15.66:0/3891489261 conn(0x55b6b58e8de0 msgr2=0x55b6b58f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 shutdown_connections 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 1 -- 172.21.15.66:0/3891489261 wait complete. 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.876+0000 7f416080b740 20 client.26240 trim_cache size 0 max 16384 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 41, 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 22, 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:51:42.879 INFO:teuthology.orchestra.run.smithi066.stdout: "a6ca8cd4": { 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 22, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 145.3, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:51:42.880 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:42.881 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 msgr2=0x7f41440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 0x7f41440a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55b6b58e9c40 tx=0x7f4148005a20 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 msgr2=0x7f4158198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 0x7f4158198a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f414000e9f0 tx=0x7f414000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 shutdown_connections 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f41440a33b0 0x7f41440a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4158106f10 0x7f415819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4158102790 0x7f4158198a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 --2- 172.21.15.66:0/1665175982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158101de0 0x7f4158198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 >> 172.21.15.66:0/1665175982 conn(0x7f41580fd8e0 msgr2=0x7f41580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 shutdown_connections 2024-09-15T22:51:42.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:42.877+0000 7f415e432640 1 -- 172.21.15.66:0/1665175982 wait complete. 2024-09-15T22:51:43.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:43 smithi066 ceph-mon[31185]: pgmap v193: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 496 op/s 2024-09-15T22:51:43.312 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:51:43.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:51:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:43 smithi184 ceph-mon[35203]: pgmap v193: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 496 op/s 2024-09-15T22:51:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:43 smithi087 ceph-mon[35290]: pgmap v193: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 496 op/s 2024-09-15T22:51:44.283 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a6ca8cd4', quiesce took 17.3 seconds. Will release after: 8.05 2024-09-15T22:51:44.393 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:44.590 INFO:tasks.workunit.client.0.smithi066.stdout: 439 6285 0 3728 0 1846 0 2024-09-15T22:51:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.925+0000 7f3d4fccc640 1 -- 172.21.15.66:0/789758260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48101de0 msgr2=0x7f3d481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.925+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/789758260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48101de0 0x7f3d481021c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009900 tx=0x7f3d4402a410 comp rx=0 tx=0).stop 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 -- 172.21.15.66:0/789758260 shutdown_connections 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/789758260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48106f10 0x7f3d4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/789758260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48102790 0x7f3d481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/789758260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48101de0 0x7f3d481021c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 -- 172.21.15.66:0/789758260 >> 172.21.15.66:0/789758260 conn(0x7f3d480fd8c0 msgr2=0x7f3d480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 -- 172.21.15.66:0/789758260 shutdown_connections 2024-09-15T22:51:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 -- 172.21.15.66:0/789758260 wait complete. 2024-09-15T22:51:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 Processor -- start 2024-09-15T22:51:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.926+0000 7f3d4fccc640 1 -- start start 2024-09-15T22:51:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 0x7f3d48198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 0x7f3d48198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 0x7f3d4819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3d48111f70 con 0x7f3d48102790 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3d48111df0 con 0x7f3d48101de0 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4fccc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3d481120f0 con 0x7f3d48106f10 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 0x7f3d48198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4da68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 0x7f3d48198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4e269640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 0x7f3d4819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4da68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 0x7f3d48198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58022/0 (socket says 172.21.15.66:58022) 2024-09-15T22:51:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4da68640 1 -- 172.21.15.66:0/2655734744 learned_addr learned my addr 172.21.15.66:0/2655734744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 -- 172.21.15.66:0/2655734744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 msgr2=0x7f3d4819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 0x7f3d4819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 -- 172.21.15.66:0/2655734744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 msgr2=0x7f3d48198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 0x7f3d48198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4d267640 1 -- 172.21.15.66:0/2655734744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4819d400 con 0x7f3d48102790 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.927+0000 7f3d4e269640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 0x7f3d4819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d4d267640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 0x7f3d48198990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800e9f0 tx=0x7f3d3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800ccc0 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d38005020 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4819d6f0 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d481a4fd0 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.928+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380049e0 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.929+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2c005290 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.931+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3d38004c80 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.932+0000 7f3d3effd640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 0x7f3d340a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.932+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f3d380cfdb0 con 0x7f3d48102790 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.932+0000 7f3d4da68640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 0x7f3d340a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.933+0000 7f3d4da68640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 0x7f3d340a59c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d440096c0 tx=0x7f3d44005a20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:44.936+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d3809c4d0 con 0x7f3d48102790 2024-09-15T22:51:45.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.230+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d2c005580 con 0x7f3d48102790 2024-09-15T22:51:45.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.231+0000 7f3d3effd640 1 -- 172.21.15.66:0/2655734744 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11993 (secure 0 0 0) 0x7f3d3809bdd0 con 0x7f3d48102790 2024-09-15T22:51:45.233 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:51:45.233 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":41,"btime":"2024-09-15T22:51:40:970839+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:51:39.984150+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:51:45.233 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 41 2024-09-15T22:51:45.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.233+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 msgr2=0x7f3d340a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:45.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.233+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 0x7f3d340a59c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3d440096c0 tx=0x7f3d44005a20 comp rx=0 tx=0).stop 2024-09-15T22:51:45.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 msgr2=0x7f3d48198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:45.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 0x7f3d48198990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800e9f0 tx=0x7f3d3800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 shutdown_connections 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3d340a3500 0x7f3d340a59c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d48106f10 0x7f3d4819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d48102790 0x7f3d48198990 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 --2- 172.21.15.66:0/2655734744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101de0 0x7f3d48198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 >> 172.21.15.66:0/2655734744 conn(0x7f3d480fd8c0 msgr2=0x7f3d480fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 shutdown_connections 2024-09-15T22:51:45.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:45.234+0000 7f3d4fccc640 1 -- 172.21.15.66:0/2655734744 wait complete. 2024-09-15T22:51:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:45 smithi087 ceph-mon[35290]: pgmap v194: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 392 op/s 2024-09-15T22:51:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:45 smithi184 ceph-mon[35203]: pgmap v194: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 392 op/s 2024-09-15T22:51:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:45 smithi066 ceph-mon[31185]: pgmap v194: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 392 op/s 2024-09-15T22:51:45.954 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:51:46.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:46 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2655734744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:46.281 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:46 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2655734744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:46 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2655734744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:46.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 -- 172.21.15.66:0/588416631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c410c180 msgr2=0x7fd4c410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 --2- 172.21.15.66:0/588416631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c410c180 0x7fd4c410e610 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009ca0 tx=0x7fd4bc02a950 comp rx=0 tx=0).stop 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 -- 172.21.15.66:0/588416631 shutdown_connections 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 --2- 172.21.15.66:0/588416631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c410c180 0x7fd4c410e610 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 --2- 172.21.15.66:0/588416631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4103670 0x7fd4c410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 --2- 172.21.15.66:0/588416631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c4102d50 0x7fd4c4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 -- 172.21.15.66:0/588416631 >> 172.21.15.66:0/588416631 conn(0x7fd4c40fc7d0 msgr2=0x7fd4c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 -- 172.21.15.66:0/588416631 shutdown_connections 2024-09-15T22:51:46.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.792+0000 7fd4c9431640 1 -- 172.21.15.66:0/588416631 wait complete. 2024-09-15T22:51:46.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 Processor -- start 2024-09-15T22:51:46.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 -- start start 2024-09-15T22:51:46.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 0x7fd4c419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c410c180 0x7fd4c419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111f30 con 0x7fd4c4103670 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111db0 con 0x7fd4c4102d50 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.793+0000 7fd4c9431640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41120b0 con 0x7fd4c410c180 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58032/0 (socket says 172.21.15.66:58032) 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1541015252 learned_addr learned my addr 172.21.15.66:0/1541015252 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c410c180 0x7fd4c419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 0x7fd4c419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1541015252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c410c180 msgr2=0x7fd4c419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c410c180 0x7fd4c419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 msgr2=0x7fd4c419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 0x7fd4c419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1541015252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c419f5a0 con 0x7fd4c4102d50 2024-09-15T22:51:46.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.794+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 0x7fd4c419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e9f0 tx=0x7fd4ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4bbfff640 1 -- 172.21.15.66:0/1541015252 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00cd80 con 0x7fd4c4102d50 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c419f890 con 0x7fd4c4102d50 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4bbfff640 1 -- 172.21.15.66:0/1541015252 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac010910 con 0x7fd4c4102d50 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a7170 con 0x7fd4c4102d50 2024-09-15T22:51:46.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.795+0000 7fd4bbfff640 1 -- 172.21.15.66:0/1541015252 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0188f0 con 0x7fd4c4102d50 2024-09-15T22:51:46.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.798+0000 7fd4bbfff640 1 -- 172.21.15.66:0/1541015252 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd4ac010ac0 con 0x7fd4c4102d50 2024-09-15T22:51:46.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.798+0000 7fd4cb80a740 1 Processor -- start 2024-09-15T22:51:46.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.798+0000 7fd4cb80a740 1 -- start start 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1869a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1876760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5583f17cf2f0 con 0x5583f18695d0 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5583f1776cf0 con 0x5583f186ab40 2024-09-15T22:51:46.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583f17cb2b0 con 0x5583f1874370 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58036/0 (socket says 172.21.15.66:58036) 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4c37fe640 1 -- 172.21.15.66:0/3226675451 learned_addr learned my addr 172.21.15.66:0/3226675451 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1869a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4bbfff640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 0x7fd4b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.799+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1876760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 0x7fd4b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4bbfff640 1 -- 172.21.15.66:0/1541015252 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd4ac0d0430 con 0x7fd4c4102d50 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/3226675451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 msgr2=0x5583f1876760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1876760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/3226675451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 msgr2=0x5583f1869090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/3226675451 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f175b3a0 con 0x5583f18695d0 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 0x7fd4b00a58f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009a60 tx=0x7fd4bc02a950 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.800+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1869a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cd7b0 tx=0x7fd4ac01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aa994a57c4ef35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.801+0000 7fd4b97fa640 1 -- 172.21.15.66:0/3226675451 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0b5300 con 0x5583f18695d0 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.801+0000 7fd4b97fa640 1 -- 172.21.15.66:0/3226675451 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac09c3f0 con 0x5583f18695d0 2024-09-15T22:51:46.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.801+0000 7fd4b97fa640 1 -- 172.21.15.66:0/3226675451 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac018b90 con 0x5583f18695d0 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 -- 172.21.15.66:0/3226675451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 msgr2=0x5583f1869a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1869a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cd7b0 tx=0x7fd4ac01f000 comp rx=0 tx=0).stop 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 -- 172.21.15.66:0/3226675451 shutdown_connections 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1876760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1869a10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/3226675451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1869090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.802+0000 7fd4cb80a740 1 -- 172.21.15.66:0/3226675451 >> 172.21.15.66:0/3226675451 conn(0x5583f1832310 msgr2=0x5583f1865c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.803+0000 7fd4cb80a740 1 -- 172.21.15.66:0/3226675451 shutdown_connections 2024-09-15T22:51:46.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.803+0000 7fd4cb80a740 1 -- 172.21.15.66:0/3226675451 wait complete. 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.803+0000 7fd4cb80a740 1 -- start start 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.803+0000 7fd4cb80a740 1 Processor -- start 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f18695d0 0x5583f1873d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 0x5583f1870fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5583f1876fb0 con 0x5583f186ab40 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5583f178a060 con 0x5583f1874370 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583f1877130 con 0x5583f18695d0 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f18695d0 0x5583f1873d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 0x5583f1870fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58042/0 (socket says 172.21.15.66:58042) 2024-09-15T22:51:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 -- 172.21.15.66:0/1149611764 learned_addr learned my addr 172.21.15.66:0/1149611764 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4cb80a740 10 client.0 _ll_register_callbacks cb 0x5583f14dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 -- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f18695d0 msgr2=0x5583f1873d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f18695d0 0x5583f1873d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 -- 172.21.15.66:0/1149611764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 msgr2=0x5583f1870fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.804+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 0x5583f1870fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4c37fe640 1 -- 172.21.15.66:0/1149611764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f15403c0 con 0x5583f1874370 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 0x5583f1870fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc005e30 tx=0x7fd4bc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d40d84f03ac8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc043050 con 0x5583f1874370 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4ac09c3f0 con 0x5583f1874370 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.805+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd4bc004450 con 0x5583f1874370 2024-09-15T22:51:46.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd4bc05c050 con 0x5583f1874370 2024-09-15T22:51:46.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 10 client.26270 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:46.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5583f1882a60 con 0x5583f1874370 2024-09-15T22:51:46.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac09c3f0 con 0x5583f1874370 2024-09-15T22:51:46.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7fd4bc030440 con 0x5583f1874370 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 10 client.26270 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 10 client.26270 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 20 client.26270 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f1883e70 0x5583f1886310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 4 client.26270 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.806+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583f17dc860 con 0x5583f1883e70 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.807+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f1883e70 0x5583f1886310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.807+0000 7fd4aa7fc640 10 client.26270 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.807+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f1883e70 0x5583f1886310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=50dc4e061b9cf946 server_cookie=bbafbdc3aeeaf45e in_seq=0 out_seq=0 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1149611764 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583f17dc860 con 0x5583f1883e70 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4aa7fc640 10 client.26270 handle_command_reply: tid=0 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 client.26270 shutdown 2024-09-15T22:51:46.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 msgr2=0x5583f1871570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc005e30 tx=0x7fd4bc0095c0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 shutdown_connections 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f1883e70 0x5583f1886310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f1871570 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f186ab40 0x5583f1870fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1149611764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f18695d0 0x5583f1873d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4aa7fc640 0 client.26270 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.808+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 >> 172.21.15.66:0/1149611764 conn(0x5583f1832310 msgr2=0x5583f186b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.809+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 shutdown_connections 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.809+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1149611764 wait complete. 2024-09-15T22:51:46.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.809+0000 7fd4cb80a740 20 client.26270 trim_cache size 0 max 16384 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.825+0000 7fd4cb80a740 1 Processor -- start 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.825+0000 7fd4cb80a740 1 -- start start 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1865700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1865c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41b13c0 con 0x5583f18695d0 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41b3080 con 0x5583f186ab40 2024-09-15T22:51:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41b1a90 con 0x5583f1874370 2024-09-15T22:51:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38652/0 (socket says 172.21.15.66:38652) 2024-09-15T22:51:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1150992397 learned_addr learned my addr 172.21.15.66:0/1150992397 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1865c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1865700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1150992397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 msgr2=0x5583f1865c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1865c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1150992397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 msgr2=0x5583f1865700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1865700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.826+0000 7fd4c2ffd640 1 -- 172.21.15.66:0/1150992397 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f1866bc0 con 0x5583f18695d0 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.827+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cddb0 tx=0x7fd4ac09be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c744bda9c6f0b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.827+0000 7fd4b8ff9640 1 -- 172.21.15.66:0/1150992397 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0a4fb0 con 0x5583f18695d0 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.827+0000 7fd4b8ff9640 1 -- 172.21.15.66:0/1150992397 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac09c3f0 con 0x5583f18695d0 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.827+0000 7fd4b8ff9640 1 -- 172.21.15.66:0/1150992397 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac018dd0 con 0x5583f18695d0 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1150992397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 msgr2=0x5583f1880280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cddb0 tx=0x7fd4ac09be80 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1150992397 shutdown_connections 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f1874370 0x5583f1865c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f186ab40 0x5583f1865700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1150992397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f1880280 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1150992397 >> 172.21.15.66:0/1150992397 conn(0x5583f1832310 msgr2=0x5583f1870f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1150992397 shutdown_connections 2024-09-15T22:51:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1150992397 wait complete. 2024-09-15T22:51:46.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.828+0000 7fd4cb80a740 1 -- start start 2024-09-15T22:51:46.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 Processor -- start 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f187c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f186e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41b28f0 con 0x5583f18695d0 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41b2160 con 0x5583f1874370 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41af3a0 con 0x5583f186ab40 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4cb80a740 10 client.0 _ll_register_callbacks cb 0x7fd4bc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4c27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4c27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:59866/0 (socket says 172.21.15.66:59866) 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4c27fc640 1 -- 172.21.15.66:0/1005039423 learned_addr learned my addr 172.21.15.66:0/1005039423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f186e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.829+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f187c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 -- 172.21.15.66:0/1005039423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 msgr2=0x5583f186e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f186e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 -- 172.21.15.66:0/1005039423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 msgr2=0x5583f187c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f187c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 -- 172.21.15.66:0/1005039423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f186e760 con 0x5583f186ab40 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c37fe640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f186e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f187c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4c27fc640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4102960 tx=0x7fd4b400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96be84f2911cebc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004230 con 0x5583f186ab40 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4ac09c3f0 con 0x5583f186ab40 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.830+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fd4b40043d0 con 0x5583f186ab40 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd4b402b050 con 0x5583f186ab40 2024-09-15T22:51:46.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 10 client.26284 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5583f18eeb00 con 0x5583f186ab40 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ac09c3f0 con 0x5583f186ab40 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7fd4b401d840 con 0x5583f186ab40 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 10 client.26284 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 10 client.26284 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 20 client.26284 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.831+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f18ef2e0 0x5583f18f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4cb80a740 4 client.26284 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583f17d6d70 con 0x5583f18ef2e0 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f18ef2e0 0x5583f18f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4c2ffd640 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f18ef2e0 0x5583f18f1700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c14fdc66bee17fe8 server_cookie=872e9ab8eca7baaf in_seq=0 out_seq=0 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4aa7fc640 10 client.26284 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4aa7fc640 1 -- 172.21.15.66:0/1005039423 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583f17d6d70 con 0x5583f18ef2e0 2024-09-15T22:51:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4aa7fc640 10 client.26284 handle_command_reply: tid=0 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.832+0000 7fd4cb80a740 1 client.26284 shutdown 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 msgr2=0x5583f186dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4102960 tx=0x7fd4b400f850 comp rx=0 tx=0).stop 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 shutdown_connections 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5583f18ef2e0 0x5583f18f1700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5583f1874370 0x5583f186e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f186ab40 0x5583f186dbb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 --2- 172.21.15.66:0/1005039423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5583f18695d0 0x5583f187c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 >> 172.21.15.66:0/1005039423 conn(0x5583f1832310 msgr2=0x5583f18656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4aa7fc640 0 client.26284 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 shutdown_connections 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 1 -- 172.21.15.66:0/1005039423 wait complete. 2024-09-15T22:51:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.833+0000 7fd4cb80a740 20 client.26284 trim_cache size 0 max 16384 2024-09-15T22:51:46.839 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 msgr2=0x7fd4b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 0x7fd4b00a58f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009a60 tx=0x7fd4bc02a950 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 msgr2=0x7fd4c419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e9f0 tx=0x7fd4ac00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 shutdown_connections 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd4b00a3430 0x7fd4b00a58f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4c410c180 0x7fd4c419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4c4103670 0x7fd4c419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 --2- 172.21.15.66:0/1541015252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c4102d50 0x7fd4c419a5f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 >> 172.21.15.66:0/1541015252 conn(0x7fd4c40fc7d0 msgr2=0x7fd4c41008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 shutdown_connections 2024-09-15T22:51:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:46.834+0000 7fd4c9431640 1 -- 172.21.15.66:0/1541015252 wait complete. 2024-09-15T22:51:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:47 smithi184 ceph-mon[35203]: pgmap v195: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 327 op/s 2024-09-15T22:51:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:47 smithi066 ceph-mon[31185]: pgmap v195: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 327 op/s 2024-09-15T22:51:47.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:51:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:47 smithi087 ceph-mon[35290]: pgmap v195: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 327 op/s 2024-09-15T22:51:47.874 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:48.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 -- 172.21.15.66:0/2451571778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378100a80 msgr2=0x7f2378100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 --2- 172.21.15.66:0/2451571778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378100a80 0x7f2378100ee0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2364009930 tx=0x7f236402a420 comp rx=0 tx=0).stop 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 -- 172.21.15.66:0/2451571778 shutdown_connections 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 --2- 172.21.15.66:0/2451571778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378101420 0x7f237810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 --2- 172.21.15.66:0/2451571778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378100a80 0x7f2378100ee0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 --2- 172.21.15.66:0/2451571778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378106a80 0x7f2378106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 -- 172.21.15.66:0/2451571778 >> 172.21.15.66:0/2451571778 conn(0x7f23780fc7a0 msgr2=0x7f23780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 -- 172.21.15.66:0/2451571778 shutdown_connections 2024-09-15T22:51:48.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.405+0000 7f237ed6b640 1 -- 172.21.15.66:0/2451571778 wait complete. 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.406+0000 7f237ed6b640 1 Processor -- start 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.406+0000 7f237ed6b640 1 -- start start 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.406+0000 7f237ed6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.406+0000 7f237ed6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378101420 0x7f23781975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237ed6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378106a80 0x7f2378197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237ed6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2378110e40 con 0x7f2378101420 2024-09-15T22:51:48.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237ed6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2378110cc0 con 0x7f2378106a80 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237ed6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2378110fc0 con 0x7f2378100a80 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:59882/0 (socket says 172.21.15.66:59882) 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 -- 172.21.15.66:0/3530220998 learned_addr learned my addr 172.21.15.66:0/3530220998 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f2377fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378101420 0x7f23781975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237d308640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378106a80 0x7f2378197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 -- 172.21.15.66:0/3530220998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378106a80 msgr2=0x7f2378197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378106a80 0x7f2378197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 -- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378101420 msgr2=0x7f23781975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378101420 0x7f23781975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 -- 172.21.15.66:0/3530220998 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23781a6910 con 0x7f2378100a80 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.407+0000 7f237cb07640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f236c00e9f0 tx=0x7f236c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.408+0000 7f2375ffb640 1 -- 172.21.15.66:0/3530220998 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cd80 con 0x7f2378100a80 2024-09-15T22:51:48.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.408+0000 7f2375ffb640 1 -- 172.21.15.66:0/3530220998 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236c010910 con 0x7f2378100a80 2024-09-15T22:51:48.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.408+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23781a6c00 con 0x7f2378100a80 2024-09-15T22:51:48.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.408+0000 7f2375ffb640 1 -- 172.21.15.66:0/3530220998 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c018990 con 0x7f2378100a80 2024-09-15T22:51:48.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.408+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23781a7160 con 0x7f2378100a80 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.411+0000 7f2375ffb640 1 -- 172.21.15.66:0/3530220998 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f236c010ac0 con 0x7f2378100a80 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.411+0000 7f2381144740 1 Processor -- start 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.411+0000 7f2381144740 1 -- start start 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 0x55df0cb70090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb70a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df0cad62f0 con 0x55df0cb71b40 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55df0ca7dcf0 con 0x55df0cb7b370 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2381144740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55df0cad22b0 con 0x55df0cb705d0 2024-09-15T22:51:48.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 0x55df0cb70090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 0x55df0cb70090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38694/0 (socket says 172.21.15.66:38694) 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f237d308640 1 -- 172.21.15.66:0/3865828785 learned_addr learned my addr 172.21.15.66:0/3865828785 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58078/0 (socket says 172.21.15.66:58078) 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f237cb07640 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb70a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 -- 172.21.15.66:0/3865828785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 msgr2=0x55df0cb70a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb70a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 -- 172.21.15.66:0/3865828785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 msgr2=0x55df0cb70090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 0x55df0cb70090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.412+0000 7f2377fff640 1 -- 172.21.15.66:0/3865828785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0ca623a0 con 0x55df0cb7b370 2024-09-15T22:51:48.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2377fff640 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2364005940 tx=0x7f2364005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3214e90d2d7add9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2375ffb640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 0x7f23680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2375ffb640 1 -- 172.21.15.66:0/3530220998 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f236c0d0370 con 0x7f2378100a80 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f237d308640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 0x7f23680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2362ffd640 1 -- 172.21.15.66:0/3865828785 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364040070 con 0x55df0cb7b370 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2362ffd640 1 -- 172.21.15.66:0/3865828785 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2364031870 con 0x55df0cb7b370 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.413+0000 7f2362ffd640 1 -- 172.21.15.66:0/3865828785 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364035040 con 0x55df0cb7b370 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 -- 172.21.15.66:0/3865828785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 msgr2=0x55df0cb7d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2364005940 tx=0x7f2364005bd0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f237d308640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 0x7f23680a58f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2370003bc0 tx=0x7f2370009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 -- 172.21.15.66:0/3865828785 shutdown_connections 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb7b370 0x55df0cb7d760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb70a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 --2- 172.21.15.66:0/3865828785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb71b40 0x55df0cb70090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.414+0000 7f2381144740 1 -- 172.21.15.66:0/3865828785 >> 172.21.15.66:0/3865828785 conn(0x55df0cb39310 msgr2=0x55df0cb6cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- 172.21.15.66:0/3865828785 shutdown_connections 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- 172.21.15.66:0/3865828785 wait complete. 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- start start 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 Processor -- start 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb7ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb78050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df0cb7e010 con 0x55df0cb7b370 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55df0ca91060 con 0x55df0cb71b40 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.415+0000 7f2381144740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55df0cb7e190 con 0x55df0cb705d0 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2381144740 10 client.0 _ll_register_callbacks cb 0x55df0c7e48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb78050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38710/0 (socket says 172.21.15.66:38710) 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237d308640 1 -- 172.21.15.66:0/2281238219 learned_addr learned my addr 172.21.15.66:0/2281238219 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:48.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237cb07640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb7ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 -- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 msgr2=0x55df0cb7ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb7ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 -- 172.21.15.66:0/2281238219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 msgr2=0x55df0cb787e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 -- 172.21.15.66:0/2281238219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0c8473c0 con 0x55df0cb71b40 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237cb07640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb7ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f237d308640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:48.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2377fff640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb78050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2364005940 tx=0x7f2364005230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a727547371f7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.416+0000 7f2357fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364040070 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2364004240 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2364031870 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2364056050 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2381144740 10 client.26288 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55df0cb92300 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2364031870 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.417+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7f23640035f0 con 0x55df0cb71b40 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 10 client.26288 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 10 client.26288 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 20 client.26288 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cb93650 0x55df0cb95a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 4 client.26288 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:48.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df0cae3860 con 0x55df0cb93650 2024-09-15T22:51:48.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f237cb07640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cb93650 0x55df0cb95a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.418+0000 7f2357fff640 10 client.26288 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:51:48.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.419+0000 7f237cb07640 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cb93650 0x55df0cb95a40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c32a217cf95e3fc server_cookie=e320d3ba73d95e86 in_seq=0 out_seq=0 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.421+0000 7f2357fff640 1 -- 172.21.15.66:0/2281238219 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df0cae3860 con 0x55df0cb93650 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.421+0000 7f2357fff640 10 client.26288 handle_command_reply: tid=0 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.421+0000 7f2381144740 1 client.26288 shutdown 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 msgr2=0x55df0cb78050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb78050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2364005940 tx=0x7f2364005230 comp rx=0 tx=0).stop 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 shutdown_connections 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cb93650 0x55df0cb95a40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb78050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 --2- 172.21.15.66:0/2281238219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb7ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 >> 172.21.15.66:0/2281238219 conn(0x55df0cb39310 msgr2=0x55df0cb72960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2357fff640 0 client.26288 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 shutdown_connections 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 1 -- 172.21.15.66:0/2281238219 wait complete. 2024-09-15T22:51:48.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.422+0000 7f2381144740 20 client.26288 trim_cache size 0 max 16384 2024-09-15T22:51:48.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 Processor -- start 2024-09-15T22:51:48.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 -- start start 2024-09-15T22:51:48.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb77050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb73120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23781ace70 con 0x55df0cb7b370 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23781aeb30 con 0x55df0cb71b40 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2381144740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f23781ad540 con 0x55df0cb705d0 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f2377fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb73120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f237d308640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38724/0 (socket says 172.21.15.66:38724) 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.440+0000 7f237d308640 1 -- 172.21.15.66:0/2538071236 learned_addr learned my addr 172.21.15.66:0/2538071236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f237cb07640 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb77050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 -- 172.21.15.66:0/2538071236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 msgr2=0x55df0cb77050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb77050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 -- 172.21.15.66:0/2538071236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 msgr2=0x55df0cb73660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 -- 172.21.15.66:0/2538071236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0cb87790 con 0x55df0cb71b40 2024-09-15T22:51:48.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f237d308640 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:48.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.441+0000 7f2377fff640 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb73120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2364003a40 tx=0x7f2364009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ae38cb2d6effbd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f23627fc640 1 -- 172.21.15.66:0/2538071236 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236405f070 con 0x55df0cb71b40 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f23627fc640 1 -- 172.21.15.66:0/2538071236 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236404d070 con 0x55df0cb71b40 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f23627fc640 1 -- 172.21.15.66:0/2538071236 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364040070 con 0x55df0cb71b40 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 -- 172.21.15.66:0/2538071236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 msgr2=0x55df0cb73120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb73120 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2364003a40 tx=0x7f2364009780 comp rx=0 tx=0).stop 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 -- 172.21.15.66:0/2538071236 shutdown_connections 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb73660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb71b40 0x55df0cb73120 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 --2- 172.21.15.66:0/2538071236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb705d0 0x55df0cb77050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 -- 172.21.15.66:0/2538071236 >> 172.21.15.66:0/2538071236 conn(0x55df0cb39310 msgr2=0x55df0cb76940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 -- 172.21.15.66:0/2538071236 shutdown_connections 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.442+0000 7f2381144740 1 -- 172.21.15.66:0/2538071236 wait complete. 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.443+0000 7f2381144740 1 -- start start 2024-09-15T22:51:48.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.443+0000 7f2381144740 1 Processor -- start 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.443+0000 7f2381144740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.443+0000 7f2381144740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 0x55df0cb83960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.443+0000 7f2381144740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb74480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237cb07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2381144740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23781ae3a0 con 0x55df0cb7b370 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2381144740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23781adc10 con 0x55df0cb705d0 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2381144740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f23781aae70 con 0x55df0cb71b40 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237cb07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58104/0 (socket says 172.21.15.66:58104) 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237cb07640 1 -- 172.21.15.66:0/1929664734 learned_addr learned my addr 172.21.15.66:0/1929664734 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2381144740 10 client.0 _ll_register_callbacks cb 0x7f2370009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb74480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2377fff640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 0x55df0cb83960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 -- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 msgr2=0x55df0cb83960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 0x55df0cb83960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 -- 172.21.15.66:0/1929664734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 msgr2=0x55df0cb83420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237d308640 1 -- 172.21.15.66:0/1929664734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0cb749c0 con 0x55df0cb7b370 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f2377fff640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 0x55df0cb83960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.444+0000 7f237cb07640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f237d308640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb74480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f23700044d0 tx=0x7f2370004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7439863d0936b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2357fff640 10 client.16776 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f236404d070 con 0x55df0cb7b370 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2357fff640 1 -- 172.21.15.66:0/1929664734 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237001fce0 con 0x55df0cb7b370 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2357fff640 1 -- 172.21.15.66:0/1929664734 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f2370017030 con 0x55df0cb7b370 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2357fff640 1 -- 172.21.15.66:0/1929664734 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2370004b20 con 0x55df0cb7b370 2024-09-15T22:51:48.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2381144740 10 client.16776 fetch_fsmap learned FSMap version 41 2024-09-15T22:51:48.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.445+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55df0cbfd830 con 0x55df0cb7b370 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2357fff640 1 -- 172.21.15.66:0/1929664734 <== mon.0 v2:172.21.15.66:3300/0 4 ==== fsmap(e 41) ==== 8414+0+0 (secure 0 0 0) 0x7f2370004cc0 con 0x55df0cb7b370 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 10 client.16776 fetch_fsmap finished waiting for FSMap version 41 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 10 client.16776 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 20 client.16776 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cbfde60 0x55df0cc00280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:48.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 4 client.16776 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df0caddd70 con 0x55df0cbfde60 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.446+0000 7f237cb07640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cbfde60 0x55df0cc00280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.447+0000 7f237cb07640 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cbfde60 0x55df0cc00280 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c8b195a6e30092f server_cookie=9ef708305c9b9e1f in_seq=0 out_seq=0 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.447+0000 7f2357fff640 10 client.16776 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2357fff640 1 -- 172.21.15.66:0/1929664734 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df0caddd70 con 0x55df0cbfde60 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2357fff640 10 client.16776 handle_command_reply: tid=0 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 client.16776 shutdown 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 msgr2=0x55df0cb74480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb74480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f23700044d0 tx=0x7f2370004a40 comp rx=0 tx=0).stop 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 shutdown_connections 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55df0cbfde60 0x55df0cc00280 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df0cb7b370 0x55df0cb74480 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55df0cb71b40 0x55df0cb83960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 --2- 172.21.15.66:0/1929664734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df0cb705d0 0x55df0cb83420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2357fff640 0 client.16776 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.448+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 >> 172.21.15.66:0/1929664734 conn(0x55df0cb39310 msgr2=0x55df0cb77160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 shutdown_connections 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f2381144740 1 -- 172.21.15.66:0/1929664734 wait complete. 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f2381144740 20 client.16776 trim_cache size 0 max 16384 2024-09-15T22:51:48.453 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 msgr2=0x7f23680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 0x7f23680a58f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2370003bc0 tx=0x7f2370009500 comp rx=0 tx=0).stop 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 msgr2=0x7f23781970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.449+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f236c00e9f0 tx=0x7f236c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 shutdown_connections 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23680a3430 0x7f23680a58f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2378106a80 0x7f2378197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2378101420 0x7f23781975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 --2- 172.21.15.66:0/3530220998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2378100a80 0x7f23781970a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:48.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 >> 172.21.15.66:0/3530220998 conn(0x7f23780fc7a0 msgr2=0x7f23780fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:48.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 shutdown_connections 2024-09-15T22:51:48.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:48.450+0000 7f237ed6b640 1 -- 172.21.15.66:0/3530220998 wait complete. 2024-09-15T22:51:49.202 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:51:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:49 smithi184 ceph-mon[35203]: pgmap v196: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-15T22:51:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:49 smithi066 ceph-mon[31185]: pgmap v196: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-15T22:51:49.517 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:49 smithi087 ceph-mon[35290]: pgmap v196: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.1 MiB/s wr, 413 op/s 2024-09-15T22:51:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 -- 172.21.15.66:0/3645278049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848100e20 msgr2=0x7f4848101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 --2- 172.21.15.66:0/3645278049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848100e20 0x7f4848101200 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4838009900 tx=0x7f483802a480 comp rx=0 tx=0).stop 2024-09-15T22:51:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 -- 172.21.15.66:0/3645278049 shutdown_connections 2024-09-15T22:51:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 --2- 172.21.15.66:0/3645278049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 0x7f484810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 --2- 172.21.15.66:0/3645278049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848102570 0x7f48481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 --2- 172.21.15.66:0/3645278049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848100e20 0x7f4848101200 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.141+0000 7f484e929640 1 -- 172.21.15.66:0/3645278049 >> 172.21.15.66:0/3645278049 conn(0x7f48480fc7d0 msgr2=0x7f48480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.142+0000 7f484e929640 1 -- 172.21.15.66:0/3645278049 shutdown_connections 2024-09-15T22:51:50.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.142+0000 7f484e929640 1 -- 172.21.15.66:0/3645278049 wait complete. 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 Processor -- start 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 -- start start 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 0x7f48481087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 0x7f4848108d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f484806a980 con 0x7f4848102570 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f484806a800 con 0x7f4848100e20 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f484e929640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f484806ab00 con 0x7f4848102ef0 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f48477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 0x7f48481087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.143+0000 7f4847fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f4847fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58118/0 (socket says 172.21.15.66:58118) 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f4847fff640 1 -- 172.21.15.66:0/893116694 learned_addr learned my addr 172.21.15.66:0/893116694 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f484cec6640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 0x7f4848108d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 -- 172.21.15.66:0/893116694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 msgr2=0x7f4848108d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 0x7f4848108d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 -- 172.21.15.66:0/893116694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 msgr2=0x7f484810d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 -- 172.21.15.66:0/893116694 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481094b0 con 0x7f4848102570 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f4847fff640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:50.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.144+0000 7f48477fe640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 0x7f48481087f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9f0 tx=0x7f483c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.145+0000 7f48457fa640 1 -- 172.21.15.66:0/893116694 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c00ccc0 con 0x7f4848102570 2024-09-15T22:51:50.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.146+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48481a2930 con 0x7f4848102570 2024-09-15T22:51:50.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.146+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a2e60 con 0x7f4848102570 2024-09-15T22:51:50.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.146+0000 7f48457fa640 1 -- 172.21.15.66:0/893116694 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f483c010910 con 0x7f4848102570 2024-09-15T22:51:50.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.146+0000 7f48457fa640 1 -- 172.21.15.66:0/893116694 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c018790 con 0x7f4848102570 2024-09-15T22:51:50.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.148+0000 7f48457fa640 1 -- 172.21.15.66:0/893116694 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f483c018930 con 0x7f4848102570 2024-09-15T22:51:50.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.149+0000 7f4850d02740 1 Processor -- start 2024-09-15T22:51:50.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.149+0000 7f4850d02740 1 -- start start 2024-09-15T22:51:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x558590527a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590532370 0x558590534760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55859048d2f0 con 0x5585905275d0 2024-09-15T22:51:50.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558590434cf0 con 0x558590528b40 2024-09-15T22:51:50.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4850d02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5585904892b0 con 0x558590532370 2024-09-15T22:51:50.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f48457fa640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 0x7f48300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58126/0 (socket says 172.21.15.66:58126) 2024-09-15T22:51:50.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 -- 172.21.15.66:0/3658233928 learned_addr learned my addr 172.21.15.66:0/3658233928 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:50.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4847fff640 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x558590527a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 0x7f48300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f48457fa640 1 -- 172.21.15.66:0/893116694 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f483c0d0310 con 0x7f4848102570 2024-09-15T22:51:50.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 -- 172.21.15.66:0/3658233928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590532370 msgr2=0x558590534760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590532370 0x558590534760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 -- 172.21.15.66:0/3658233928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 msgr2=0x558590527a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x558590527a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f484cec6640 1 -- 172.21.15.66:0/3658233928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585904193a0 con 0x558590528b40 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.150+0000 7f4847fff640 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x558590527a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.151+0000 7f484cec6640 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4840005f40 tx=0x7f484000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76114096f5414a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.151+0000 7f484cec6640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 0x7f48300a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f484000fc90 tx=0x7f484000e000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.151+0000 7f482e7fc640 1 -- 172.21.15.66:0/3658233928 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840022070 con 0x558590528b40 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.151+0000 7f482e7fc640 1 -- 172.21.15.66:0/3658233928 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4840011050 con 0x558590528b40 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.151+0000 7f482e7fc640 1 -- 172.21.15.66:0/3658233928 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840010740 con 0x558590528b40 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 -- 172.21.15.66:0/3658233928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 msgr2=0x558590527090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4840005f40 tx=0x7f484000f790 comp rx=0 tx=0).stop 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 -- 172.21.15.66:0/3658233928 shutdown_connections 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590532370 0x558590534760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x558590527a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 --2- 172.21.15.66:0/3658233928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590528b40 0x558590527090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 -- 172.21.15.66:0/3658233928 >> 172.21.15.66:0/3658233928 conn(0x5585904f0310 msgr2=0x558590523c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.152+0000 7f4850d02740 1 -- 172.21.15.66:0/3658233928 shutdown_connections 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.153+0000 7f4850d02740 1 -- 172.21.15.66:0/3658233928 wait complete. 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.153+0000 7f4850d02740 1 -- start start 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.153+0000 7f4850d02740 1 Processor -- start 2024-09-15T22:51:50.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 0x55859052f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558590535010 con 0x558590528b40 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558590448060 con 0x558590532370 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558590535190 con 0x5585905275d0 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4850d02740 10 client.0 _ll_register_callbacks cb 0x55859019b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:59952/0 (socket says 172.21.15.66:59952) 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 -- 172.21.15.66:0/3359579306 learned_addr learned my addr 172.21.15.66:0/3359579306 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f484cec6640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f48477fe640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 0x55859052f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 -- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 msgr2=0x55859052f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.154+0000 7f4847fff640 1 -- 172.21.15.66:0/3359579306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 msgr2=0x55859052f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4847fff640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 0x55859052f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4847fff640 1 -- 172.21.15.66:0/3359579306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585901fe3c0 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f48477fe640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 0x55859052f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4847fff640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48380096c0 tx=0x7f48380035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=577d7b06803b022 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f48277fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035040 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4840011050 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4838003ce0 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f483804e050 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4850d02740 10 client.26308 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.155+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558590536db0 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4840011050 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f483803c6a0 con 0x5585905275d0 2024-09-15T22:51:50.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 10 client.26308 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 10 client.26308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 20 client.26308 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905381c0 0x55859053a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 4 client.26308 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55859049a860 con 0x5585905381c0 2024-09-15T22:51:50.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.156+0000 7f48477fe640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905381c0 0x55859053a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.157+0000 7f48277fe640 10 client.26308 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.157+0000 7f48477fe640 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905381c0 0x55859053a660 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e82d97377192dcd6 server_cookie=1058b2d91d291025 in_seq=0 out_seq=0 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.158+0000 7f48277fe640 1 -- 172.21.15.66:0/3359579306 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55859049a860 con 0x5585905381c0 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.158+0000 7f48277fe640 10 client.26308 handle_command_reply: tid=0 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 client.26308 shutdown 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 msgr2=0x558590531db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48380096c0 tx=0x7f48380035f0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 shutdown_connections 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905381c0 0x55859053a660 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f48277fe640 0 client.26308 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590528b40 0x55859052f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 --2- 172.21.15.66:0/3359579306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585905275d0 0x558590531db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 >> 172.21.15.66:0/3359579306 conn(0x5585904f0310 msgr2=0x558590529930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 shutdown_connections 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 1 -- 172.21.15.66:0/3359579306 wait complete. 2024-09-15T22:51:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.159+0000 7f4850d02740 20 client.26308 trim_cache size 0 max 16384 2024-09-15T22:51:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.175+0000 7f4850d02740 1 Processor -- start 2024-09-15T22:51:50.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.175+0000 7f4850d02740 1 -- start start 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x55859052f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859052a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f483400fff0 con 0x5585905275d0 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4834011cb0 con 0x558590532370 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4850d02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48340106c0 con 0x558590528b40 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4847fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x55859052f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58148/0 (socket says 172.21.15.66:58148) 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f4847fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x55859052f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38768/0 (socket says 172.21.15.66:38768) 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 -- 172.21.15.66:0/3469939068 learned_addr learned my addr 172.21.15.66:0/3469939068 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f48477fe640 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859052a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 -- 172.21.15.66:0/3469939068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 msgr2=0x55859052a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859052a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 -- 172.21.15.66:0/3469939068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 msgr2=0x55859052f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x55859052f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 -- 172.21.15.66:0/3469939068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558590523510 con 0x558590532370 2024-09-15T22:51:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.176+0000 7f484cec6640 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4840009600 tx=0x7f4840013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e4b3b5f015828d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f482dffb640 1 -- 172.21.15.66:0/3469939068 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840022070 con 0x558590532370 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f482dffb640 1 -- 172.21.15.66:0/3469939068 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4840011250 con 0x558590532370 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f482dffb640 1 -- 172.21.15.66:0/3469939068 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840027450 con 0x558590532370 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 -- 172.21.15.66:0/3469939068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 msgr2=0x55859052a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4840009600 tx=0x7f4840013040 comp rx=0 tx=0).stop 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 -- 172.21.15.66:0/3469939068 shutdown_connections 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558590532370 0x55859052a660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859052a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.177+0000 7f4850d02740 1 --2- 172.21.15.66:0/3469939068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585905275d0 0x55859052f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.178+0000 7f4850d02740 1 -- 172.21.15.66:0/3469939068 >> 172.21.15.66:0/3469939068 conn(0x5585904f0310 msgr2=0x55859052e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.178+0000 7f4850d02740 1 -- 172.21.15.66:0/3469939068 shutdown_connections 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.178+0000 7f4850d02740 1 -- 172.21.15.66:0/3469939068 wait complete. 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.178+0000 7f4850d02740 1 -- start start 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.178+0000 7f4850d02740 1 Processor -- start 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859053e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 0x5585905cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4834011520 con 0x558590532370 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4847fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4847fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58158/0 (socket says 172.21.15.66:58158) 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4847fff640 1 -- 172.21.15.66:0/4213497506 learned_addr learned my addr 172.21.15.66:0/4213497506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f484cec6640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 0x5585905cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f48477fe640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859053e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4834010d90 con 0x5585905275d0 2024-09-15T22:51:50.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.179+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f483400dfd0 con 0x558590528b40 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4850d02740 10 client.0 _ll_register_callbacks cb 0x7f4838009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 -- 172.21.15.66:0/4213497506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 msgr2=0x55859053e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859053e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 -- 172.21.15.66:0/4213497506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 msgr2=0x5585905cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 0x5585905cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585905cdab0 con 0x5585905275d0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f484cec6640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 0x5585905cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4847fff640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48380096c0 tx=0x7f4838009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba37431e9b55102a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f48277fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035070 con 0x5585905275d0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f4838005040 con 0x5585905275d0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4840011250 con 0x5585905275d0 2024-09-15T22:51:50.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4838003660 con 0x5585905275d0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4850d02740 10 client.26312 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5585905ced30 con 0x5585905275d0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.180+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4838003e50 con 0x5585905275d0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f4838004b80 con 0x5585905275d0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 10 client.26312 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 10 client.26312 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 20 client.26312 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905cf500 0x5585905d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 4 client.26312 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4840011250 con 0x5585905cf500 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f48477fe640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905cf500 0x5585905d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f48477fe640 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905cf500 0x5585905d1920 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d5185d8111094f0 server_cookie=692e37600db3d5e2 in_seq=0 out_seq=0 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.181+0000 7f48277fe640 10 client.26312 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:50.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f48277fe640 1 -- 172.21.15.66:0/4213497506 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4840011250 con 0x5585905cf500 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f48277fe640 10 client.26312 handle_command_reply: tid=0 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 client.26312 shutdown 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 msgr2=0x55859053e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48380096c0 tx=0x7f4838009560 comp rx=0 tx=0).stop 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 shutdown_connections 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5585905cf500 0x5585905d1920 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558590532370 0x5585905cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558590528b40 0x55859053e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f48277fe640 0 client.26312 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 --2- 172.21.15.66:0/4213497506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585905275d0 0x55859053e480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 >> 172.21.15.66:0/4213497506 conn(0x5585904f0310 msgr2=0x5585905224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 shutdown_connections 2024-09-15T22:51:50.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.182+0000 7f4850d02740 1 -- 172.21.15.66:0/4213497506 wait complete. 2024-09-15T22:51:50.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f4850d02740 20 client.26312 trim_cache size 0 max 16384 2024-09-15T22:51:50.189 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:50.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 msgr2=0x7f48300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 0x7f48300a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f484000fc90 tx=0x7f484000e000 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 msgr2=0x7f48481087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 0x7f48481087f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9f0 tx=0x7f483c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 shutdown_connections 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48300a3430 0x7f48300a58f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4848102ef0 0x7f4848108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4848102570 0x7f48481087f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 --2- 172.21.15.66:0/893116694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4848100e20 0x7f484810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 >> 172.21.15.66:0/893116694 conn(0x7f48480fc7d0 msgr2=0x7f48480fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 shutdown_connections 2024-09-15T22:51:50.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:50.183+0000 7f484e929640 1 -- 172.21.15.66:0/893116694 wait complete. 2024-09-15T22:51:50.885 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:51:51.186 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:51 smithi184 ceph-mon[35203]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-15T22:51:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:51 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:51 smithi066 ceph-mon[31185]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-15T22:51:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:51 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:51 smithi087 ceph-mon[35290]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 664 op/s 2024-09-15T22:51:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:51 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 -- 172.21.15.66:0/3979440282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 msgr2=0x7f312c110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 --2- 172.21.15.66:0/3979440282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c110cc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3124009ca0 tx=0x7f312402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 -- 172.21.15.66:0/3979440282 shutdown_connections 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 --2- 172.21.15.66:0/3979440282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c110cc0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 --2- 172.21.15.66:0/3979440282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 --2- 172.21.15.66:0/3979440282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 -- 172.21.15.66:0/3979440282 >> 172.21.15.66:0/3979440282 conn(0x7f312c0ffa50 msgr2=0x7f312c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 -- 172.21.15.66:0/3979440282 shutdown_connections 2024-09-15T22:51:51.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.704+0000 7f3134232640 1 -- 172.21.15.66:0/3979440282 wait complete. 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 Processor -- start 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 -- start start 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f312c114150 con 0x7f312c109140 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f312c113fd0 con 0x7f312c1049c0 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3134232640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1142d0 con 0x7f312c104010 2024-09-15T22:51:51.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f31317cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f3131fce640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f31317cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58170/0 (socket says 172.21.15.66:58170) 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f31327cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.705+0000 7f31317cd640 1 -- 172.21.15.66:0/538204610 learned_addr learned my addr 172.21.15.66:0/538204610 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 -- 172.21.15.66:0/538204610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 msgr2=0x7f312c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 -- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 msgr2=0x7f312c19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 -- 172.21.15.66:0/538204610 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c19f5a0 con 0x7f312c104010 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f31317cd640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:51.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3131fce640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c19a5f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f312800e9f0 tx=0x7f312800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3122ffd640 1 -- 172.21.15.66:0/538204610 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312800ccc0 con 0x7f312c104010 2024-09-15T22:51:51.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3122ffd640 1 -- 172.21.15.66:0/538204610 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3128010910 con 0x7f312c104010 2024-09-15T22:51:51.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c19f890 con 0x7f312c104010 2024-09-15T22:51:51.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3122ffd640 1 -- 172.21.15.66:0/538204610 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128018960 con 0x7f312c104010 2024-09-15T22:51:51.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.706+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c1a7170 con 0x7f312c104010 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 Processor -- start 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 -- start start 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b5fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b6c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a836ac52f0 con 0x55a836b6a370 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a836a6ccf0 con 0x55a836b60b40 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f313660b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a836ac12b0 con 0x55a836b5f5d0 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.709+0000 7f3122ffd640 1 -- 172.21.15.66:0/538204610 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3128010ac0 con 0x7f312c104010 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31317cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58180/0 (socket says 172.21.15.66:58180) 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 -- 172.21.15.66:0/1491290047 learned_addr learned my addr 172.21.15.66:0/1491290047 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f3131fce640 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b5fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 -- 172.21.15.66:0/1491290047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 msgr2=0x55a836b5fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b5fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 -- 172.21.15.66:0/1491290047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 msgr2=0x55a836b6c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b6c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 -- 172.21.15.66:0/1491290047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a836a513a0 con 0x55a836b60b40 2024-09-15T22:51:51.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31317cd640 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b6c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f31327cf640 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3124009ca0 tx=0x7f3124005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f8c71b0fcf2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.710+0000 7f3122ffd640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 0x7f31180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3117fff640 1 -- 172.21.15.66:0/1491290047 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124031db0 con 0x55a836b60b40 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3117fff640 1 -- 172.21.15.66:0/1491290047 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3124036040 con 0x55a836b60b40 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3117fff640 1 -- 172.21.15.66:0/1491290047 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31240042a0 con 0x55a836b60b40 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3122ffd640 1 -- 172.21.15.66:0/538204610 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f31280d0480 con 0x7f312c104010 2024-09-15T22:51:51.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3131fce640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 0x7f31180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f3131fce640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 0x7f31180a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31280cd8b0 tx=0x7f3128098040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f313660b740 1 -- 172.21.15.66:0/1491290047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 msgr2=0x55a836b5f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.711+0000 7f313660b740 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3124009ca0 tx=0x7f3124005f10 comp rx=0 tx=0).stop 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 -- 172.21.15.66:0/1491290047 shutdown_connections 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b6c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b5fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 --2- 172.21.15.66:0/1491290047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b60b40 0x55a836b5f090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 -- 172.21.15.66:0/1491290047 >> 172.21.15.66:0/1491290047 conn(0x55a836b28310 msgr2=0x55a836b5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 -- 172.21.15.66:0/1491290047 shutdown_connections 2024-09-15T22:51:51.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 -- 172.21.15.66:0/1491290047 wait complete. 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 -- start start 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.712+0000 7f313660b740 1 Processor -- start 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b69d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b60b40 0x55a836b67000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 0x55a836b675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a836b6ce90 con 0x55a836b60b40 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a836a80060 con 0x55a836b6a370 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a836b6d010 con 0x55a836b5f5d0 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f313660b740 10 client.0 _ll_register_callbacks cb 0x55a8367d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f31327cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 0x55a836b675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f31327cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 0x55a836b675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58196/0 (socket says 172.21.15.66:58196) 2024-09-15T22:51:51.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f31327cf640 1 -- 172.21.15.66:0/2280010611 learned_addr learned my addr 172.21.15.66:0/2280010611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f31327cf640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b69d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.713+0000 7f31317cd640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b60b40 0x55a836b67000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 -- 172.21.15.66:0/2280010611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 msgr2=0x55a836b675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 0x55a836b675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 -- 172.21.15.66:0/2280010611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b60b40 msgr2=0x55a836b67000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b60b40 0x55a836b67000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 -- 172.21.15.66:0/2280010611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8368363c0 con 0x55a836b5f5d0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31327cf640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b69d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3124009620 tx=0x7f312402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c36c468ae58ed22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31157fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312402f610 con 0x55a836b5f5d0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3124036040 con 0x55a836b5f5d0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f312402f7b0 con 0x55a836b5f5d0 2024-09-15T22:51:51.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f312402f9b0 con 0x55a836b5f5d0 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f313660b740 10 client.26326 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.714+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a836b6ce90 con 0x55a836b5f5d0 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3124036040 con 0x55a836b5f5d0 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f3124050040 con 0x55a836b5f5d0 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 10 client.26326 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 10 client.26326 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 20 client.26326 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836b79e00 0x55a836b7c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 4 client.26326 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.715+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a836ad2860 con 0x55a836b79e00 2024-09-15T22:51:51.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.716+0000 7f31317cd640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836b79e00 0x55a836b7c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.716+0000 7f31317cd640 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836b79e00 0x55a836b7c220 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65ee826b03b024bb server_cookie=31c44fad57858700 in_seq=0 out_seq=0 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.716+0000 7f31157fa640 10 client.26326 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f31157fa640 1 -- 172.21.15.66:0/2280010611 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a836ad2860 con 0x55a836b79e00 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f31157fa640 10 client.26326 handle_command_reply: tid=0 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 client.26326 shutdown 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 msgr2=0x55a836b69d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b69d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3124009620 tx=0x7f312402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 shutdown_connections 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836b79e00 0x55a836b7c220 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b6a370 0x55a836b675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b60b40 0x55a836b67000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 --2- 172.21.15.66:0/2280010611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b5f5d0 0x55a836b69d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f31157fa640 0 client.26326 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:51.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 >> 172.21.15.66:0/2280010611 conn(0x55a836b28310 msgr2=0x55a836b61960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 shutdown_connections 2024-09-15T22:51:51.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 1 -- 172.21.15.66:0/2280010611 wait complete. 2024-09-15T22:51:51.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.718+0000 7f313660b740 20 client.26326 trim_cache size 0 max 16384 2024-09-15T22:51:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 Processor -- start 2024-09-15T22:51:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 -- start start 2024-09-15T22:51:51.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b76130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1b12f0 con 0x55a836b6a370 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1b2fb0 con 0x55a836b5f5d0 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f313660b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1b19c0 con 0x55a836b60b40 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f31327cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f31327cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b76130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f31327cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38820/0 (socket says 172.21.15.66:38820) 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f31327cf640 1 -- 172.21.15.66:0/2192776286 learned_addr learned my addr 172.21.15.66:0/2192776286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.735+0000 7f31317cd640 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 -- 172.21.15.66:0/2192776286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 msgr2=0x55a836b668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 -- 172.21.15.66:0/2192776286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 msgr2=0x55a836b76130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b76130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 -- 172.21.15.66:0/2192776286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a836b60760 con 0x55a836b6a370 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31327cf640 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3124009ca0 tx=0x7f3124000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e0973b2a52a703 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31177fe640 1 -- 172.21.15.66:0/2192776286 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124009800 con 0x55a836b6a370 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31177fe640 1 -- 172.21.15.66:0/2192776286 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3124036040 con 0x55a836b6a370 2024-09-15T22:51:51.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.736+0000 7f31177fe640 1 -- 172.21.15.66:0/2192776286 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124030820 con 0x55a836b6a370 2024-09-15T22:51:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- 172.21.15.66:0/2192776286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 msgr2=0x55a836b62120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3124009ca0 tx=0x7f3124000f40 comp rx=0 tx=0).stop 2024-09-15T22:51:51.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- 172.21.15.66:0/2192776286 shutdown_connections 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b62120 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 --2- 172.21.15.66:0/2192776286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b76130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- 172.21.15.66:0/2192776286 >> 172.21.15.66:0/2192776286 conn(0x55a836b28310 msgr2=0x55a836b69080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- 172.21.15.66:0/2192776286 shutdown_connections 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- 172.21.15.66:0/2192776286 wait complete. 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 -- start start 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.737+0000 7f313660b740 1 Processor -- start 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b72480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b63860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1b2820 con 0x55a836b6a370 2024-09-15T22:51:51.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1b2090 con 0x55a836b5f5d0 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1af2d0 con 0x55a836b60b40 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f313660b740 10 client.0 _ll_register_callbacks cb 0x7f31280d3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60034/0 (socket says 172.21.15.66:60034) 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 -- 172.21.15.66:0/3855637399 learned_addr learned my addr 172.21.15.66:0/3855637399 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31327cf640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b63860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31327cf640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 -- 172.21.15.66:0/3855637399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 msgr2=0x55a836b72480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b72480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.738+0000 7f31317cd640 1 -- 172.21.15.66:0/3855637399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 msgr2=0x55a836b63860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31317cd640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b63860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31317cd640 1 -- 172.21.15.66:0/3855637399 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a836b63f20 con 0x55a836b60b40 2024-09-15T22:51:51.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31317cd640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f311c004700 tx=0x7f311c012410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=911628f0475d4763 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31157fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c02a020 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f311c005220 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3124036040 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f311c032050 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f313660b740 10 client.26332 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.739+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a836becce0 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3124036040 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f311c025070 con 0x55a836b60b40 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 10 client.26332 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 10 client.26332 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 20 client.26332 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836bed5a0 0x55a836bef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:51.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 4 client.26332 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:51.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a836accd70 con 0x55a836bed5a0 2024-09-15T22:51:51.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.740+0000 7f31327cf640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836bed5a0 0x55a836bef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:51.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.741+0000 7f31157fa640 10 client.26332 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:51.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.741+0000 7f31327cf640 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836bed5a0 0x55a836bef9c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac53959b95ba8f67 server_cookie=a048ee86a72677fb in_seq=0 out_seq=0 2024-09-15T22:51:51.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f31157fa640 1 -- 172.21.15.66:0/3855637399 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a836accd70 con 0x55a836bed5a0 2024-09-15T22:51:51.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f31157fa640 10 client.26332 handle_command_reply: tid=0 2024-09-15T22:51:51.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 client.26332 shutdown 2024-09-15T22:51:51.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 msgr2=0x55a836b729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f311c004700 tx=0x7f311c012410 comp rx=0 tx=0).stop 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 shutdown_connections 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a836bed5a0 0x55a836bef9c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a836b6a370 0x55a836b63860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a836b60b40 0x55a836b729c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 --2- 172.21.15.66:0/3855637399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a836b5f5d0 0x55a836b72480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f31157fa640 0 client.26332 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 >> 172.21.15.66:0/3855637399 conn(0x55a836b28310 msgr2=0x55a836b5a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.742+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 shutdown_connections 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f313660b740 1 -- 172.21.15.66:0/3855637399 wait complete. 2024-09-15T22:51:51.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f313660b740 20 client.26332 trim_cache size 0 max 16384 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 msgr2=0x7f31180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 0x7f31180a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31280cd8b0 tx=0x7f3128098040 comp rx=0 tx=0).stop 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 msgr2=0x7f312c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.743+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c19a5f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f312800e9f0 tx=0x7f312800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 shutdown_connections 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f31180a33b0 0x7f31180a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f312c109140 0x7f312c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f312c1049c0 0x7f312c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 --2- 172.21.15.66:0/538204610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f312c104010 0x7f312c19a5f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 >> 172.21.15.66:0/538204610 conn(0x7f312c0ffa50 msgr2=0x7f312c100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 shutdown_connections 2024-09-15T22:51:51.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:51.744+0000 7f3134232640 1 -- 172.21.15.66:0/538204610 wait complete. 2024-09-15T22:51:52.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:51:52.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:51:52.682 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.177+0000 7f596e637640 1 -- 172.21.15.66:0/3710104840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 msgr2=0x7f596810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.177+0000 7f596e637640 1 --2- 172.21.15.66:0/3710104840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f596810eaa0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5960009ca0 tx=0x7f596002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 -- 172.21.15.66:0/3710104840 shutdown_connections 2024-09-15T22:51:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 --2- 172.21.15.66:0/3710104840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f596810eaa0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 --2- 172.21.15.66:0/3710104840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f59681067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 --2- 172.21.15.66:0/3710104840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 -- 172.21.15.66:0/3710104840 >> 172.21.15.66:0/3710104840 conn(0x7f59680fd8b0 msgr2=0x7f59680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 -- 172.21.15.66:0/3710104840 shutdown_connections 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 -- 172.21.15.66:0/3710104840 wait complete. 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 Processor -- start 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.178+0000 7f596e637640 1 -- start start 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f5968074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f5968074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5968111f80 con 0x7f5968106f20 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5968111e00 con 0x7f5968101df0 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596e637640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5968112100 con 0x7f59681027a0 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f5967fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f5967fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55774/0 (socket says 172.21.15.66:55774) 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f5967fff640 1 -- 172.21.15.66:0/1586423991 learned_addr learned my addr 172.21.15.66:0/1586423991 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f596cbd4640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f5968074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.179+0000 7f59677fe640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f5968074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 -- 172.21.15.66:0/1586423991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 msgr2=0x7f5968074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f5968074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 -- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 msgr2=0x7f5968074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f5968074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 -- 172.21.15.66:0/1586423991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59681a6900 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f59677fe640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f5968074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f5967fff640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f595800e9f0 tx=0x7f595800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595800cd80 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5958010910 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958018990 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59681a6bf0 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.180+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59681a7130 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.181+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59681021d0 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.183+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5958010ac0 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.183+0000 7f59657fa640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 0x7f59500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.183+0000 7f59677fe640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 0x7f59500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.184+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f59580d07d0 con 0x7f5968101df0 2024-09-15T22:51:53.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.184+0000 7f59677fe640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 0x7f59500a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5968075f80 tx=0x7f595c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.187+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f595809c790 con 0x7f5968101df0 2024-09-15T22:51:53.275 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:53.401 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:53 smithi066 ceph-mon[31185]: pgmap v198: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 810 op/s 2024-09-15T22:51:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:53 smithi184 ceph-mon[35203]: pgmap v198: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 810 op/s 2024-09-15T22:51:53.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.479+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f596810a190 con 0x7f5968101df0 2024-09-15T22:51:53.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.480+0000 7f59657fa640 1 -- 172.21.15.66:0/1586423991 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11991 (secure 0 0 0) 0x7f59580a0a90 con 0x7f5968101df0 2024-09-15T22:51:53.481 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:51:53.481 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":42,"btime":"2024-09-15T22:51:50:137303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:51:49.985832+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:51:53.481 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 42 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 msgr2=0x7f59500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 0x7f59500a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5968075f80 tx=0x7f595c005f90 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 msgr2=0x7f59680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f595800e9f0 tx=0x7f595800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 shutdown_connections 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59500a33b0 0x7f59500a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5968106f20 0x7f5968074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59681027a0 0x7f5968074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 --2- 172.21.15.66:0/1586423991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5968101df0 0x7f59680744f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.482+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 >> 172.21.15.66:0/1586423991 conn(0x7f59680fd8b0 msgr2=0x7f59680fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.483+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 shutdown_connections 2024-09-15T22:51:53.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.483+0000 7f596e637640 1 -- 172.21.15.66:0/1586423991 wait complete. 2024-09-15T22:51:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:53 smithi087 ceph-mon[35290]: pgmap v198: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.5 MiB/s wr, 810 op/s 2024-09-15T22:51:53.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 -- 172.21.15.66:0/3613597246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac106f20 msgr2=0x7f11ac10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/3613597246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac106f20 0x7f11ac10eaa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009ca0 tx=0x7f11a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 -- 172.21.15.66:0/3613597246 shutdown_connections 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/3613597246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac106f20 0x7f11ac10eaa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/3613597246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/3613597246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac101df0 0x7f11ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 -- 172.21.15.66:0/3613597246 >> 172.21.15.66:0/3613597246 conn(0x7f11ac0fd8f0 msgr2=0x7f11ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 -- 172.21.15.66:0/3613597246 shutdown_connections 2024-09-15T22:51:53.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.978+0000 7f11b2c3e640 1 -- 172.21.15.66:0/3613597246 wait complete. 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 Processor -- start 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 -- start start 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 0x7f11ac19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac111f80 con 0x7f11ac101df0 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac111e00 con 0x7f11ac106f20 2024-09-15T22:51:53.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b2c3e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac112100 con 0x7f11ac1027a0 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b09da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b11db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 0x7f11ac19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b09da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52944/0 (socket says 172.21.15.66:52944) 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.980+0000 7f11b09da640 1 -- 172.21.15.66:0/172010829 learned_addr learned my addr 172.21.15.66:0/172010829 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11abfff640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 -- 172.21.15.66:0/172010829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 msgr2=0x7f11ac198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 -- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 msgr2=0x7f11ac1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 -- 172.21.15.66:0/172010829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac19d370 con 0x7f11ac106f20 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b09da640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11abfff640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11b11db640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 0x7f11ac19cc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11a402ade0 tx=0x7f11a40319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.981+0000 7f11a9ffb640 1 -- 172.21.15.66:0/172010829 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4003b70 con 0x7f11ac106f20 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.982+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac19d600 con 0x7f11ac106f20 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.982+0000 7f11a9ffb640 1 -- 172.21.15.66:0/172010829 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a4003d10 con 0x7f11ac106f20 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.982+0000 7f11a9ffb640 1 -- 172.21.15.66:0/172010829 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a402fcb0 con 0x7f11ac106f20 2024-09-15T22:51:53.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.982+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac1a4f40 con 0x7f11ac106f20 2024-09-15T22:51:53.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.984+0000 7f11a9ffb640 1 -- 172.21.15.66:0/172010829 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f11a4004050 con 0x7f11ac106f20 2024-09-15T22:51:53.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 Processor -- start 2024-09-15T22:51:53.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 -- start start 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daaaea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daab9370 0x5602daabb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5602daa142f0 con 0x5602daaafb40 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5602da9bbcf0 con 0x5602daab9370 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b5017740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5602daa102b0 con 0x5602daaae5d0 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52954/0 (socket says 172.21.15.66:52954) 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11abfff640 1 -- 172.21.15.66:0/963994682 learned_addr learned my addr 172.21.15.66:0/963994682 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11a9ffb640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 0x7f119c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11b09da640 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daaaea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.985+0000 7f11abfff640 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daab9370 0x5602daabb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 -- 172.21.15.66:0/963994682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 msgr2=0x5602daaaea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daaaea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 -- 172.21.15.66:0/963994682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daab9370 msgr2=0x5602daabb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daab9370 0x5602daabb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 -- 172.21.15.66:0/963994682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602da9a03a0 con 0x5602daaafb40 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11a9ffb640 1 -- 172.21.15.66:0/172010829 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f11a40f1210 con 0x7f11ac106f20 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11b11db640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 0x7f119c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f11abfff640 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1198005f60 tx=0x7f1198009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97c4909976cae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f1196ffd640 1 -- 172.21.15.66:0/963994682 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198013db0 con 0x5602daaafb40 2024-09-15T22:51:53.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f1196ffd640 1 -- 172.21.15.66:0/963994682 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11980130d0 con 0x5602daaafb40 2024-09-15T22:51:53.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.986+0000 7f1196ffd640 1 -- 172.21.15.66:0/963994682 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980116d0 con 0x5602daaafb40 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 -- 172.21.15.66:0/963994682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 msgr2=0x5602daaae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1198005f60 tx=0x7f1198009670 comp rx=0 tx=0).stop 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b11db640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 0x7f119c0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009ca0 tx=0x7f11a402a8c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 -- 172.21.15.66:0/963994682 shutdown_connections 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daab9370 0x5602daabb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daaaea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 --2- 172.21.15.66:0/963994682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daaae090 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 -- 172.21.15.66:0/963994682 >> 172.21.15.66:0/963994682 conn(0x5602daa77310 msgr2=0x5602daaaac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:53.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 -- 172.21.15.66:0/963994682 shutdown_connections 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.987+0000 7f11b5017740 1 -- 172.21.15.66:0/963994682 wait complete. 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 -- start start 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 Processor -- start 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daab8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 0x5602daab60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5602daac0360 con 0x5602daab9370 2024-09-15T22:51:53.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5602da9cf060 con 0x5602daaafb40 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5602daac04e0 con 0x5602daaae5d0 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.988+0000 7f11b5017740 10 client.0 _ll_register_callbacks cb 0x5602da7228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 0x5602daab60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52970/0 (socket says 172.21.15.66:52970) 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11abfff640 1 -- 172.21.15.66:0/2190632251 learned_addr learned my addr 172.21.15.66:0/2190632251 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11abfff640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daab8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 -- 172.21.15.66:0/2190632251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 msgr2=0x5602daab8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daab8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 -- 172.21.15.66:0/2190632251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 msgr2=0x5602daab6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 -- 172.21.15.66:0/2190632251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602da7853c0 con 0x5602daaafb40 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11abfff640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f11b09da640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 0x5602daab60b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f11a0005fd0 tx=0x7f11a00039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36fcd3ba456e5f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f118bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.989+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00117d0 con 0x5602daaafb40 2024-09-15T22:51:53.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f11a0011970 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11980130d0 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f11a0011b70 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 10 client.26348 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5602daacbf20 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11980130d0 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f11a0010440 con 0x5602daaafb40 2024-09-15T22:51:53.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 10 client.26348 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 10 client.26348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 20 client.26348 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602daacd480 0x5602daacf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 4 client.26348 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602daa21860 con 0x5602daacd480 2024-09-15T22:51:53.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.990+0000 7f11abfff640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602daacd480 0x5602daacf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:53.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.991+0000 7f11abfff640 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602daacd480 0x5602daacf870 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb18e88a3435992d server_cookie=d2de29c123993d93 in_seq=0 out_seq=0 2024-09-15T22:51:53.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.991+0000 7f118bfff640 10 client.26348 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f118bfff640 1 -- 172.21.15.66:0/2190632251 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602daa21860 con 0x5602daacd480 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f118bfff640 10 client.26348 handle_command_reply: tid=0 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 client.26348 shutdown 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 msgr2=0x5602daab60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 0x5602daab60b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f11a0005fd0 tx=0x7f11a00039c0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 shutdown_connections 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daab6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602daacd480 0x5602daacf870 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaafb40 0x5602daab60b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 --2- 172.21.15.66:0/2190632251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaae5d0 0x5602daab8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f118bfff640 0 client.26348 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:54.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 >> 172.21.15.66:0/2190632251 conn(0x5602daa77310 msgr2=0x5602daab0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 shutdown_connections 2024-09-15T22:51:54.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.992+0000 7f11b5017740 1 -- 172.21.15.66:0/2190632251 wait complete. 2024-09-15T22:51:54.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:53.993+0000 7f11b5017740 20 client.26348 trim_cache size 0 max 16384 2024-09-15T22:51:54.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.009+0000 7f11b5017740 1 Processor -- start 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.009+0000 7f11b5017740 1 -- start start 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 0x5602daab8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daad5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1acec0 con 0x5602daab9370 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1aeb80 con 0x5602daaae5d0 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b5017740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1ad590 con 0x5602daaafb40 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b09da640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 0x5602daab8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55812/0 (socket says 172.21.15.66:55812) 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 -- 172.21.15.66:0/3912502646 learned_addr learned my addr 172.21.15.66:0/3912502646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:54.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11b09da640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 0x5602daab8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53240/0 (socket says 172.21.15.66:53240) 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daad5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 -- 172.21.15.66:0/3912502646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 msgr2=0x5602daab8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 0x5602daab8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 -- 172.21.15.66:0/3912502646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 msgr2=0x5602daad5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daad5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.010+0000 7f11abfff640 1 -- 172.21.15.66:0/3912502646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602daacfbe0 con 0x5602daaae5d0 2024-09-15T22:51:54.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.011+0000 7f11abfff640 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e00 tx=0x7f11980098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aedd52c2cd5675ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.011+0000 7f11967fc640 1 -- 172.21.15.66:0/3912502646 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119800fb60 con 0x5602daaae5d0 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.011+0000 7f11967fc640 1 -- 172.21.15.66:0/3912502646 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1198035070 con 0x5602daaae5d0 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.011+0000 7f11967fc640 1 -- 172.21.15.66:0/3912502646 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198004ad0 con 0x5602daaae5d0 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 -- 172.21.15.66:0/3912502646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 msgr2=0x5602daaaad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e00 tx=0x7f11980098f0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 -- 172.21.15.66:0/3912502646 shutdown_connections 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daab9370 0x5602daad5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daaafb40 0x5602daab8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 --2- 172.21.15.66:0/3912502646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daaaad70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 -- 172.21.15.66:0/3912502646 >> 172.21.15.66:0/3912502646 conn(0x5602daa77310 msgr2=0x5602daab7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 -- 172.21.15.66:0/3912502646 shutdown_connections 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.012+0000 7f11b5017740 1 -- 172.21.15.66:0/3912502646 wait complete. 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 -- start start 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 Processor -- start 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daac5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daab9370 0x5602daab26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1ae3f0 con 0x5602daaafb40 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1adc60 con 0x5602daaae5d0 2024-09-15T22:51:54.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1aaea0 con 0x5602daab9370 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b5017740 10 client.0 _ll_register_callbacks cb 0x7f11a000be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55820/0 (socket says 172.21.15.66:55820) 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.013+0000 7f11b09da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daac5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 -- 172.21.15.66:0/2331459000 learned_addr learned my addr 172.21.15.66:0/2331459000 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daab9370 0x5602daab26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 -- 172.21.15.66:0/2331459000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daab9370 msgr2=0x5602daab26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daab9370 0x5602daab26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 -- 172.21.15.66:0/2331459000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 msgr2=0x5602daac5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daac5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 -- 172.21.15.66:0/2331459000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602daab2c20 con 0x5602daaae5d0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11abfff640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1198013250 tx=0x7f119800fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa74b17e9c931ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f118bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980315d0 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1198035070 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.014+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f1198031770 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1198031970 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 10 client.26354 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5602dab378f0 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1198035070 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f119803e430 con 0x5602daaae5d0 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 10 client.26354 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 10 client.26354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 20 client.26354 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:54.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602dab37ed0 0x5602dab3a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 4 client.26354 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:51:54.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602daa1bd70 con 0x5602dab37ed0 2024-09-15T22:51:54.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.015+0000 7f11b09da640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602dab37ed0 0x5602dab3a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.016+0000 7f11b09da640 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602dab37ed0 0x5602dab3a2f0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f5d48a5ad2a6b0 server_cookie=2bebae18cc378cee in_seq=0 out_seq=0 2024-09-15T22:51:54.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.016+0000 7f118bfff640 10 client.26354 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:54.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f118bfff640 1 -- 172.21.15.66:0/2331459000 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602daa1bd70 con 0x5602dab37ed0 2024-09-15T22:51:54.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f118bfff640 10 client.26354 handle_command_reply: tid=0 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 client.26354 shutdown 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 msgr2=0x5602daac57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1198013250 tx=0x7f119800fef0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 shutdown_connections 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602daab9370 0x5602daab26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5602daaafb40 0x5602daac5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5602dab37ed0 0x5602dab3a2f0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 --2- 172.21.15.66:0/2331459000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5602daaae5d0 0x5602daac57c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 >> 172.21.15.66:0/2331459000 conn(0x5602daa77310 msgr2=0x5602daab8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f118bfff640 0 client.26354 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:54.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 shutdown_connections 2024-09-15T22:51:54.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 1 -- 172.21.15.66:0/2331459000 wait complete. 2024-09-15T22:51:54.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.018+0000 7f11b5017740 20 client.26354 trim_cache size 0 max 16384 2024-09-15T22:51:54.024 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:51:54.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 msgr2=0x7f119c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 0x7f119c0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009ca0 tx=0x7f11a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 msgr2=0x7f11ac19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 0x7f11ac19cc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11a402ade0 tx=0x7f11a40319f0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 shutdown_connections 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f119c0a33b0 0x7f119c0a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11ac106f20 0x7f11ac19cc90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11ac1027a0 0x7f11ac198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 --2- 172.21.15.66:0/172010829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11ac101df0 0x7f11ac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 >> 172.21.15.66:0/172010829 conn(0x7f11ac0fd8f0 msgr2=0x7f11ac0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 shutdown_connections 2024-09-15T22:51:54.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:54.019+0000 7f11b2c3e640 1 -- 172.21.15.66:0/172010829 wait complete. 2024-09-15T22:51:54.357 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:54 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1586423991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:54 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1586423991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:54.590 INFO:tasks.workunit.client.0.smithi066.stdout: 439 67985 0 44276 0 19242 0 2024-09-15T22:51:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:54 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1586423991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:51:54.785 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id a6ca8cd4 --release --await' 2024-09-15T22:51:54.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id a6ca8cd4 --release --await 2024-09-15T22:51:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:55 smithi184 ceph-mon[35203]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 934 op/s 2024-09-15T22:51:55.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:55 smithi066 ceph-mon[31185]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 934 op/s 2024-09-15T22:51:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:55 smithi087 ceph-mon[35290]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.0 MiB/s wr, 934 op/s 2024-09-15T22:51:55.721 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:56.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 -- 172.21.15.66:0/1129308642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800102790 msgr2=0x7f58001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 --2- 172.21.15.66:0/1129308642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800102790 0x7f58001067e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009900 tx=0x7f57e802a410 comp rx=0 tx=0).stop 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 -- 172.21.15.66:0/1129308642 shutdown_connections 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 --2- 172.21.15.66:0/1129308642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800106f10 0x7f580010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 --2- 172.21.15.66:0/1129308642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800102790 0x7f58001067e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 --2- 172.21.15.66:0/1129308642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800101de0 0x7f58001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 -- 172.21.15.66:0/1129308642 >> 172.21.15.66:0/1129308642 conn(0x7f58000fd8c0 msgr2=0x7f58000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 -- 172.21.15.66:0/1129308642 shutdown_connections 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.245+0000 7f58062d3640 1 -- 172.21.15.66:0/1129308642 wait complete. 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 Processor -- start 2024-09-15T22:51:56.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 -- start start 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 0x7f58001989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800106f10 0x7f580019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5800111fc0 con 0x7f5800101de0 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5800111e40 con 0x7f5800102790 2024-09-15T22:51:56.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f58062d3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5800112140 con 0x7f5800106f10 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f57fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f57fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53008/0 (socket says 172.21.15.66:53008) 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f57fffff640 1 -- 172.21.15.66:0/402492107 learned_addr learned my addr 172.21.15.66:0/402492107 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.246+0000 7f57f77fe640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 0x7f58001989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f5804870640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800106f10 0x7f580019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 -- 172.21.15.66:0/402492107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800106f10 msgr2=0x7f580019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800106f10 0x7f580019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 -- 172.21.15.66:0/402492107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 msgr2=0x7f58001989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 0x7f58001989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 -- 172.21.15.66:0/402492107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580019d410 con 0x7f5800101de0 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57f77fe640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 0x7f58001989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:56.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fffff640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f57f000ebc0 tx=0x7f57f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fdffb640 1 -- 172.21.15.66:0/402492107 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0010630 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fdffb640 1 -- 172.21.15.66:0/402492107 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0010cb0 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f57fdffb640 1 -- 172.21.15.66:0/402492107 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0018bd0 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.247+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580019d700 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.248+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58001a4fe0 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.250+0000 7f57fdffb640 1 -- 172.21.15.66:0/402492107 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f57f00107d0 con 0x7f5800101de0 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 Processor -- start 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 -- start start 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57fdffb640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 0x7f57ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9e2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9ef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55851c947620 con 0x55851c9e2980 2024-09-15T22:51:56.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55851c8eee50 con 0x55851c9ed240 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f58086ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55851c9435e0 con 0x55851c9e2060 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f5804870640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 0x7f57ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57fffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9e2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53020/0 (socket says 172.21.15.66:53020) 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57f77fe640 1 -- 172.21.15.66:0/3018297910 learned_addr learned my addr 172.21.15.66:0/3018297910 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f5804870640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.251+0000 7f57fdffb640 1 -- 172.21.15.66:0/402492107 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57f00d0850 con 0x7f5800101de0 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 -- 172.21.15.66:0/3018297910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 msgr2=0x55851c9e2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9e2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 -- 172.21.15.66:0/3018297910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 msgr2=0x55851c9ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 -- 172.21.15.66:0/3018297910 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851c8dfd40 con 0x55851c9e2980 2024-09-15T22:51:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f5804870640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57fffff640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9e2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f5804870640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 0x7f57ec0a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009460 tx=0x7f57f8009940 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f77fe640 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009230 tx=0x7f57e8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c78c42867656db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f67fc640 1 -- 172.21.15.66:0/3018297910 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8035070 con 0x55851c9e2980 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.252+0000 7f57f67fc640 1 -- 172.21.15.66:0/3018297910 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e8005520 con 0x55851c9e2980 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.253+0000 7f57f67fc640 1 -- 172.21.15.66:0/3018297910 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e803bc10 con 0x55851c9e2980 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 -- 172.21.15.66:0/3018297910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 msgr2=0x55851c9ecd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009230 tx=0x7f57e8004040 comp rx=0 tx=0).stop 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 -- 172.21.15.66:0/3018297910 shutdown_connections 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2980 0x55851c9ecd00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 --2- 172.21.15.66:0/3018297910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9e2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.254+0000 7f58086ac740 1 -- 172.21.15.66:0/3018297910 >> 172.21.15.66:0/3018297910 conn(0x55851c9de5f0 msgr2=0x55851c9de9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.255+0000 7f58086ac740 1 -- 172.21.15.66:0/3018297910 shutdown_connections 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.255+0000 7f58086ac740 1 -- 172.21.15.66:0/3018297910 wait complete. 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.255+0000 7f58086ac740 1 -- start start 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.255+0000 7f58086ac740 1 Processor -- start 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55851c9efe60 con 0x55851c9e2060 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55851c8cff10 con 0x55851c9ed240 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55851c9effe0 con 0x55851c9e2980 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f58086ac740 10 client.0 _ll_register_callbacks cb 0x55851c8f3db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53284/0 (socket says 172.21.15.66:53284) 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 -- 172.21.15.66:0/1072301800 learned_addr learned my addr 172.21.15.66:0/1072301800 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f5804870640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 -- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 msgr2=0x55851c9eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9eabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 -- 172.21.15.66:0/1072301800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 msgr2=0x55851c9ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57f77fe640 1 -- 172.21.15.66:0/1072301800 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851c656580 con 0x55851c9e2980 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.256+0000 7f57fffff640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57f77fe640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57e802a930 tx=0x7f57e802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f968765b0cc69945 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8052060 con 0x55851c9e2980 2024-09-15T22:51:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57e804a070 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e8005520 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57e8035070 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f58086ac740 10 client.26365 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55851c720960 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.257+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e8005520 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f57e80035f0 con 0x55851c9e2980 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 10 client.26365 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 10 client.26365 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 20 client.26365 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851c9fcc90 0x55851c9ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 4 client.26365 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55851c954b90 con 0x55851c9fcc90 2024-09-15T22:51:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f57fffff640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851c9fcc90 0x55851c9ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f57fffff640 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851c9fcc90 0x55851c9ff080 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2225de49bfb28412 server_cookie=b929fe6d83585f46 in_seq=0 out_seq=0 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.258+0000 7f57df7fe640 10 client.26365 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f57df7fe640 1 -- 172.21.15.66:0/1072301800 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55851c954b90 con 0x55851c9fcc90 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f57df7fe640 10 client.26365 handle_command_reply: tid=0 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 client.26365 shutdown 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 msgr2=0x55851c9ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57e802a930 tx=0x7f57e802a410 comp rx=0 tx=0).stop 2024-09-15T22:51:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 shutdown_connections 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851c9fcc90 0x55851c9ff080 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9ed240 0x55851c9eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2980 0x55851c9ea690 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 --2- 172.21.15.66:0/1072301800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f57df7fe640 0 client.26365 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 >> 172.21.15.66:0/1072301800 conn(0x55851c9de5f0 msgr2=0x55851c9e42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 shutdown_connections 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.259+0000 7f58086ac740 1 -- 172.21.15.66:0/1072301800 wait complete. 2024-09-15T22:51:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.260+0000 7f58086ac740 20 client.26365 trim_cache size 0 max 16384 2024-09-15T22:51:56.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 Processor -- start 2024-09-15T22:51:56.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 -- start start 2024-09-15T22:51:56.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9ec020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58001ace70 con 0x55851c9ed240 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58001aeb30 con 0x55851c9e2980 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f58086ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58001ad540 con 0x55851c9e2060 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53032/0 (socket says 172.21.15.66:53032) 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 -- 172.21.15.66:0/1744826416 learned_addr learned my addr 172.21.15.66:0/1744826416 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f57f77fe640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f57fffff640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 -- 172.21.15.66:0/1744826416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 msgr2=0x55851c9ec020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9ec020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 -- 172.21.15.66:0/1744826416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 msgr2=0x55851c9e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f5804870640 1 -- 172.21.15.66:0/1744826416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851c9de090 con 0x55851c9ed240 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.277+0000 7f57f77fe640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.278+0000 7f5804870640 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009dc0 tx=0x7f57f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1b7037285b4884 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.278+0000 7f57f5ffb640 1 -- 172.21.15.66:0/1744826416 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8014500 con 0x55851c9ed240 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.278+0000 7f57f5ffb640 1 -- 172.21.15.66:0/1744826416 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f8025070 con 0x55851c9ed240 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.278+0000 7f57f5ffb640 1 -- 172.21.15.66:0/1744826416 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80126b0 con 0x55851c9ed240 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.278+0000 7f58086ac740 1 -- 172.21.15.66:0/1744826416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 msgr2=0x55851ca04770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009dc0 tx=0x7f57f8004730 comp rx=0 tx=0).stop 2024-09-15T22:51:56.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 -- 172.21.15.66:0/1744826416 shutdown_connections 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9ed240 0x55851ca04770 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 --2- 172.21.15.66:0/1744826416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9e2060 0x55851c9ec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 -- 172.21.15.66:0/1744826416 >> 172.21.15.66:0/1744826416 conn(0x55851c9de5f0 msgr2=0x55851c9dd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 -- 172.21.15.66:0/1744826416 shutdown_connections 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 -- 172.21.15.66:0/1744826416 wait complete. 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 -- start start 2024-09-15T22:51:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 Processor -- start 2024-09-15T22:51:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.279+0000 7f58086ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9ed240 0x55851c9f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58001ae3a0 con 0x55851c9e2060 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58001adc10 con 0x55851c9e2980 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58001aae50 con 0x55851c9ed240 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 10 client.0 _ll_register_callbacks cb 0x7f57e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53038/0 (socket says 172.21.15.66:53038) 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 -- 172.21.15.66:0/2081489583 learned_addr learned my addr 172.21.15.66:0/2081489583 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f5804870640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9ed240 0x55851c9f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57f77fe640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 -- 172.21.15.66:0/2081489583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9ed240 msgr2=0x55851c9f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9ed240 0x55851c9f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 -- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 msgr2=0x55851c9f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 -- 172.21.15.66:0/2081489583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851c9f1f90 con 0x55851c9e2060 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57f77fe640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57fffff640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f57f0098b60 tx=0x7f57f006b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601fcbc40e78a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00bde60 con 0x55851c9e2060 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f57f00cddf0 con 0x55851c9e2060 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.280+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f8025070 con 0x55851c9e2060 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57f0010e60 con 0x55851c9e2060 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 10 client.16854 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55851ca68310 con 0x55851c9e2060 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f8025070 con 0x55851c9e2060 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f57f006e040 con 0x55851c9e2060 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 10 client.16854 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 10 client.16854 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 20 client.16854 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851ca68a10 0x55851ca6ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 4 client.16854 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a6ca8cd4", "release": true, "await": true}] 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a6ca8cd4", "release": true, "await": true}) -- 0x55851c94f0a0 con 0x55851ca68a10 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.281+0000 7f57f77fe640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851ca68a10 0x55851ca6ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.282+0000 7f57f77fe640 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851ca68a10 0x55851ca6ae50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9949dd759bafcee4 server_cookie=89612d94706c82f in_seq=0 out_seq=0 2024-09-15T22:51:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:56.282+0000 7f57df7fe640 10 client.16854 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:56.650 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:51:56.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:51:56.913 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:57.333 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:57 smithi066 ceph-mon[31185]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 1.01k op/s 2024-09-15T22:51:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:57 smithi184 ceph-mon[35203]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 1.01k op/s 2024-09-15T22:51:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:57 smithi087 ceph-mon[35290]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 1.5 MiB/s wr, 1.01k op/s 2024-09-15T22:51:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.616+0000 7f57df7fe640 1 -- 172.21.15.66:0/2081489583 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55851c94f0a0 con 0x55851ca68a10 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.616+0000 7f57df7fe640 10 client.16854 handle_command_reply: tid=0 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.616+0000 7f58086ac740 1 client.16854 shutdown 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 msgr2=0x55851c9f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f57f0098b60 tx=0x7f57f006b3f0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 shutdown_connections 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55851c9ed240 0x55851c9f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55851ca68a10 0x55851ca6ae50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55851c9e2980 0x55851c9f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 --2- 172.21.15.66:0/2081489583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55851c9e2060 0x55851c9f5390 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 >> 172.21.15.66:0/2081489583 conn(0x55851c9de5f0 msgr2=0x55851c9dcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f57df7fe640 0 client.16854 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 shutdown_connections 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 1 -- 172.21.15.66:0/2081489583 wait complete. 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.617+0000 7f58086ac740 20 client.16854 trim_cache size 0 max 16384 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 42, 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 24, 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:51:57.620 INFO:teuthology.orchestra.run.smithi066.stdout: "a6ca8cd4": { 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 24, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 145.3, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:51:57.621 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:57.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 msgr2=0x7f57ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 0x7f57ec0a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009460 tx=0x7f57f8009940 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 msgr2=0x7f5800198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f57f000ebc0 tx=0x7f57f000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 shutdown_connections 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57ec0a3430 0x7f57ec0a58f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5800106f10 0x7f580019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800102790 0x7f58001989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 --2- 172.21.15.66:0/402492107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800101de0 0x7f5800198460 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.618+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 >> 172.21.15.66:0/402492107 conn(0x7f58000fd8c0 msgr2=0x7f58000fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.619+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 shutdown_connections 2024-09-15T22:51:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.619+0000 7f58062d3640 1 -- 172.21.15.66:0/402492107 wait complete. 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 -- 172.21.15.66:0/4078919778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 msgr2=0x7fc3a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/4078919778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a810d950 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009cd0 tx=0x7fc3a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 -- 172.21.15.66:0/4078919778 shutdown_connections 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/4078919778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a810d950 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/4078919778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a80 0x7fc3a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/4078919778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a80 0x7fc3a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 -- 172.21.15.66:0/4078919778 >> 172.21.15.66:0/4078919778 conn(0x7fc3a80fc7a0 msgr2=0x7fc3a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.418+0000 7fc3b07ac640 1 -- 172.21.15.66:0/4078919778 shutdown_connections 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 -- 172.21.15.66:0/4078919778 wait complete. 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 Processor -- start 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 -- start start 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a80 0x7fc3a8197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 0x7fc3a819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8110e80 con 0x7fc3a8101420 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8110d00 con 0x7fc3a8106a80 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3b07ac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8111000 con 0x7fc3a8100a80 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53058/0 (socket says 172.21.15.66:53058) 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3add47640 1 -- 172.21.15.66:0/1566167497 learned_addr learned my addr 172.21.15.66:0/1566167497 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.419+0000 7fc3ae548640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a80 0x7fc3a8197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 0x7fc3a819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 -- 172.21.15.66:0/1566167497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a80 msgr2=0x7fc3a8197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a80 0x7fc3a8197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 -- 172.21.15.66:0/1566167497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 msgr2=0x7fc3a819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 0x7fc3a819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 -- 172.21.15.66:0/1566167497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a819c2d0 con 0x7fc3a8101420 2024-09-15T22:51:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 0x7fc3a819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3add47640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e9f0 tx=0x7fc39c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc39b7fe640 1 -- 172.21.15.66:0/1566167497 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00cd80 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc39b7fe640 1 -- 172.21.15.66:0/1566167497 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c010910 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc39b7fe640 1 -- 172.21.15.66:0/1566167497 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c018990 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a819c5c0 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.420+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81a3ea0 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc39b7fe640 1 -- 172.21.15.66:0/1566167497 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc39c010ac0 con 0x7fc3a8101420 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 Processor -- start 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 -- start start 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03aef8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 0x55e03af02a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af05340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e03ae5b280 con 0x55e03af02f50 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e03ae02b10 con 0x55e03aef8690 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.423+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e03ae57240 con 0x55e03aef7d70 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af05340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af05340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53060/0 (socket says 172.21.15.66:53060) 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3add47640 1 -- 172.21.15.66:0/3771248148 learned_addr learned my addr 172.21.15.66:0/3771248148 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 0x55e03af02a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3aed49640 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03aef8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc39b7fe640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 0x7fc3940a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 0x7fc3940a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 -- 172.21.15.66:0/3771248148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 msgr2=0x55e03aef8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03aef8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 -- 172.21.15.66:0/3771248148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 msgr2=0x55e03af05340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af05340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 -- 172.21.15.66:0/3771248148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03ae0f1f0 con 0x55e03aef8690 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc39b7fe640 1 -- 172.21.15.66:0/1566167497 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc39c0d0410 con 0x7fc3a8101420 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3ae548640 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 0x55e03af02a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009c20 tx=0x7fc3a4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed85949e83add717 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 0x7fc3940a58f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009430 tx=0x7fc3a002a8e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.424+0000 7fc398ff9640 1 -- 172.21.15.66:0/3771248148 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004050 con 0x55e03aef8690 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc398ff9640 1 -- 172.21.15.66:0/3771248148 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4005500 con 0x55e03aef8690 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc398ff9640 1 -- 172.21.15.66:0/3771248148 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004e00 con 0x55e03aef8690 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3771248148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 msgr2=0x55e03af02a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 0x55e03af02a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009c20 tx=0x7fc3a4011810 comp rx=0 tx=0).stop 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3771248148 shutdown_connections 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af05340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef8690 0x55e03af02a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3771248148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03aef8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3771248148 >> 172.21.15.66:0/3771248148 conn(0x55e03aef4300 msgr2=0x55e03aef46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3771248148 shutdown_connections 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.425+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3771248148 wait complete. 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 -- start start 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 Processor -- start 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af02a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03aeffd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e03af05b20 con 0x55e03af02f50 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e03ae15f10 con 0x55e03aef7d70 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e03af05ca0 con 0x55e03aef8690 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3b2b85740 10 client.0 _ll_register_callbacks cb 0x55e03addea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3aed49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3aed49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53074/0 (socket says 172.21.15.66:53074) 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3aed49640 1 -- 172.21.15.66:0/1364304550 learned_addr learned my addr 172.21.15.66:0/1364304550 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3add47640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03aeffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.426+0000 7fc3ae548640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af02a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 -- 172.21.15.66:0/1364304550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 msgr2=0x55e03aeffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03aeffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 -- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 msgr2=0x55e03af02a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af02a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 -- 172.21.15.66:0/1364304550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e03abcc6a0 con 0x55e03af02f50 2024-09-15T22:51:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3aed49640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79641dab52587ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a004e070 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a4005500 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc3a0004250 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc3a0004450 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3b2b85740 10 client.16866 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e03af116a0 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.427+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4005500 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7fc3a0030070 con 0x55e03af02f50 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 10 client.16866 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 20 client.16866 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af12b50 0x55e03af14f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 4 client.16866 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e03ae687f0 con 0x55e03af12b50 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3ae548640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af12b50 0x55e03af14f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc3ae548640 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af12b50 0x55e03af14f80 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd05efe26d7bb22d server_cookie=2bb502c4c2be0a6e in_seq=0 out_seq=0 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.428+0000 7fc391ffb640 10 client.16866 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc391ffb640 1 -- 172.21.15.66:0/1364304550 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e03ae687f0 con 0x55e03af12b50 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc391ffb640 10 client.16866 handle_command_reply: tid=0 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 client.16866 shutdown 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 msgr2=0x55e03af004f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a00095c0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 shutdown_connections 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af004f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03aeffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af12b50 0x55e03af14f80 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/1364304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af02a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 >> 172.21.15.66:0/1364304550 conn(0x55e03aef4300 msgr2=0x55e03aef1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc391ffb640 0 client.16866 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 shutdown_connections 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 1 -- 172.21.15.66:0/1364304550 wait complete. 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.429+0000 7fc3b2b85740 20 client.16866 trim_cache size 0 max 16384 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 Processor -- start 2024-09-15T22:51:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 -- start start 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03af1a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03af02f50 0x55e03aefcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81acfe0 con 0x55e03aef8690 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81aeca0 con 0x55e03af02f50 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ad6b0 con 0x55e03aef7d70 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53082/0 (socket says 172.21.15.66:53082) 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 -- 172.21.15.66:0/3261698236 learned_addr learned my addr 172.21.15.66:0/3261698236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3ae548640 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03af1a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3aed49640 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03af02f50 0x55e03aefcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 -- 172.21.15.66:0/3261698236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 msgr2=0x55e03af1a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03af1a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 -- 172.21.15.66:0/3261698236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03af02f50 msgr2=0x55e03aefcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03af02f50 0x55e03aefcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.447+0000 7fc3add47640 1 -- 172.21.15.66:0/3261698236 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e03aef4130 con 0x55e03aef8690 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3add47640 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c6a0 tx=0x7fc39c0b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a048c365910c798 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc393fff640 1 -- 172.21.15.66:0/3261698236 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c09be60 con 0x55e03aef8690 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc393fff640 1 -- 172.21.15.66:0/3261698236 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c09ca20 con 0x55e03aef8690 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc393fff640 1 -- 172.21.15.66:0/3261698236 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c09bc80 con 0x55e03aef8690 2024-09-15T22:51:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3261698236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 msgr2=0x55e03af1add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c6a0 tx=0x7fc39c0b5040 comp rx=0 tx=0).stop 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3261698236 shutdown_connections 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03af02f50 0x55e03aefcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03aef8690 0x55e03af1add0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/3261698236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef7d70 0x55e03af1a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.448+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3261698236 >> 172.21.15.66:0/3261698236 conn(0x55e03aef4300 msgr2=0x55e03aefe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3261698236 shutdown_connections 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- 172.21.15.66:0/3261698236 wait complete. 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- start start 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 Processor -- start 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af06fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03af074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ae510 con 0x55e03af02f50 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81add80 con 0x55e03aef7d70 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81aafc0 con 0x55e03aef8690 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3b2b85740 10 client.0 _ll_register_callbacks cb 0x7fc3a4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3aed49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3aed49640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53086/0 (socket says 172.21.15.66:53086) 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3aed49640 1 -- 172.21.15.66:0/4256569417 learned_addr learned my addr 172.21.15.66:0/4256569417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3add47640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03af074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.449+0000 7fc3ae548640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af06fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 -- 172.21.15.66:0/4256569417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 msgr2=0x55e03af074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03af074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 -- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 msgr2=0x55e03af06fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af06fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 -- 172.21.15.66:0/4256569417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e03af7cb50 con 0x55e03af02f50 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3ae548640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af06fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3aed49640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0030f40 tx=0x7fc3a0031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf0a0ea35e9f561 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0064060 con 0x55e03af02f50 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39c09ca20 con 0x55e03af02f50 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7fc3a003b990 con 0x55e03af02f50 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc3a004e070 con 0x55e03af02f50 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3b2b85740 10 client.16872 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e03af7de90 con 0x55e03af02f50 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c09ca20 con 0x55e03af02f50 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.450+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7fc3a003bd20 con 0x55e03af02f50 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 10 client.16872 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 20 client.16872 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af7e610 0x55e03af80a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 4 client.16872 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e03ae62d00 con 0x55e03af7e610 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3ae548640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af7e610 0x55e03af80a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc3ae548640 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af7e610 0x55e03af80a30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc0b260eafd9f5f server_cookie=5681054a8702065d in_seq=0 out_seq=0 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.451+0000 7fc391ffb640 10 client.16872 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc391ffb640 1 -- 172.21.15.66:0/4256569417 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e03ae62d00 con 0x55e03af7e610 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc391ffb640 10 client.16872 handle_command_reply: tid=0 2024-09-15T22:51:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 client.16872 shutdown 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 msgr2=0x55e03af07a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0030f40 tx=0x7fc3a0031660 comp rx=0 tx=0).stop 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 shutdown_connections 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e03af02f50 0x55e03af07a60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e03aef8690 0x55e03af074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e03af7e610 0x55e03af80a30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:51:57.737 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "f8d5ec59-3993-4826-b832-3cb68f945234", 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 --2- 172.21.15.66:0/4256569417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e03aef7d70 0x55e03af06fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 >> 172.21.15.66:0/4256569417 conn(0x55e03aef4300 msgr2=0x55e03aef97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc391ffb640 0 client.16872 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 shutdown_connections 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 1 -- 172.21.15.66:0/4256569417 wait complete. 2024-09-15T22:51:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.452+0000 7fc3b2b85740 20 client.16872 trim_cache size 0 max 16384 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 msgr2=0x7fc3940a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 0x7fc3940a58f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009430 tx=0x7fc3a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 msgr2=0x7fc3a8197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e9f0 tx=0x7fc39c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 shutdown_connections 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a3430 0x7fc3940a58f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a80 0x7fc3a819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101420 0x7fc3a8197860 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 --2- 172.21.15.66:0/1566167497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a80 0x7fc3a8197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 >> 172.21.15.66:0/1566167497 conn(0x7fc3a80fc7a0 msgr2=0x7fc3a80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 shutdown_connections 2024-09-15T22:51:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:57.453+0000 7fc3b07ac640 1 -- 172.21.15.66:0/1566167497 wait complete. 2024-09-15T22:51:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:58 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:51:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:58 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:58 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:58 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:58.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:58 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:58.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:58 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:51:58.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:58 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:58.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:58 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:58.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:58 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:58.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:58 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:58.526 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:51:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:58 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:51:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:58 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:51:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:58 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:58 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:58.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:58 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:58.869 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:51:59.407 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:59 smithi066 ceph-mon[31185]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:51:59.407 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:59 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:59.408 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:51:59 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:51:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:59 smithi184 ceph-mon[35203]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:51:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:59 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:51:59 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:51:59.448 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a6ca8cd4', total seconds elapsed: 32.4 2024-09-15T22:51:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:59 smithi087 ceph-mon[35290]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:51:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:59 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:51:59 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 -- 172.21.15.66:0/354051084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 msgr2=0x7f5970110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 --2- 172.21.15.66:0/354051084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970110910 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5968009be0 tx=0x7f596802a6c0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 -- 172.21.15.66:0/354051084 shutdown_connections 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 --2- 172.21.15.66:0/354051084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970110910 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 --2- 172.21.15.66:0/354051084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970101440 0x7f597010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 --2- 172.21.15.66:0/354051084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100b20 0x7f5970100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 -- 172.21.15.66:0/354051084 >> 172.21.15.66:0/354051084 conn(0x7f59700fc7d0 msgr2=0x7f59700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:59.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 -- 172.21.15.66:0/354051084 shutdown_connections 2024-09-15T22:51:59.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.928+0000 7f5976c3d640 1 -- 172.21.15.66:0/354051084 wait complete. 2024-09-15T22:51:59.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.929+0000 7f5976c3d640 1 Processor -- start 2024-09-15T22:51:59.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.929+0000 7f5976c3d640 1 -- start start 2024-09-15T22:51:59.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970100b20 0x7f5970102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59701141e0 con 0x7f597010e500 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5970114060 con 0x7f5970100b20 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f5976c3d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5970114360 con 0x7f5970101440 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f596ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f596ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53398/0 (socket says 172.21.15.66:53398) 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f596ffff640 1 -- 172.21.15.66:0/1382368415 learned_addr learned my addr 172.21.15.66:0/1382368415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f59749d9640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970100b20 0x7f5970102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.930+0000 7f59751da640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 -- 172.21.15.66:0/1382368415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970100b20 msgr2=0x7f5970102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970100b20 0x7f5970102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 -- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 msgr2=0x7f5970103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 -- 172.21.15.66:0/1382368415 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59701aada0 con 0x7f5970101440 2024-09-15T22:51:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596ffff640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ea20 tx=0x7f595c00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.931+0000 7f596dffb640 1 -- 172.21.15.66:0/1382368415 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c00ccc0 con 0x7f5970101440 2024-09-15T22:51:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.932+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59701ab090 con 0x7f5970101440 2024-09-15T22:51:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.932+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59701ab620 con 0x7f5970101440 2024-09-15T22:51:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.932+0000 7f596dffb640 1 -- 172.21.15.66:0/1382368415 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c00ce60 con 0x7f5970101440 2024-09-15T22:51:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.932+0000 7f596dffb640 1 -- 172.21.15.66:0/1382368415 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c00ccc0 con 0x7f5970101440 2024-09-15T22:51:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.935+0000 7f596dffb640 1 -- 172.21.15.66:0/1382368415 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f595c021430 con 0x7f5970101440 2024-09-15T22:51:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.936+0000 7f5979016740 1 Processor -- start 2024-09-15T22:51:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.936+0000 7f5979016740 1 -- start start 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.936+0000 7f5979016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.936+0000 7f5979016740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f5979016740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f5979016740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fdea61f2e0 con 0x55fdea6c4680 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f5979016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fdea5c6ce0 con 0x55fdea6b94a0 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f5979016740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdea61b2a0 con 0x55fdea6b9dc0 2024-09-15T22:51:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55958/0 (socket says 172.21.15.66:55958) 2024-09-15T22:51:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 -- 172.21.15.66:0/3420764969 learned_addr learned my addr 172.21.15.66:0/3420764969 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59749d9640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f596ffff640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 -- 172.21.15.66:0/3420764969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 msgr2=0x55fdea6c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 -- 172.21.15.66:0/3420764969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 msgr2=0x55fdea6c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.937+0000 7f59751da640 1 -- 172.21.15.66:0/3420764969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdea5ab440 con 0x55fdea6b94a0 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.938+0000 7f596dffb640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 0x7f59600a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.938+0000 7f596ffff640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.938+0000 7f596dffb640 1 -- 172.21.15.66:0/1382368415 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f595c0cfea0 con 0x7f5970101440 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.938+0000 7f59751da640 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5968009be0 tx=0x7f5968009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0e6fa62b524c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.938+0000 7f59749d9640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 0x7f59600a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.939+0000 7f595affd640 1 -- 172.21.15.66:0/3420764969 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968041030 con 0x55fdea6b94a0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.939+0000 7f595affd640 1 -- 172.21.15.66:0/3420764969 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5968037040 con 0x55fdea6b94a0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.939+0000 7f595affd640 1 -- 172.21.15.66:0/3420764969 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968036040 con 0x55fdea6b94a0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f59749d9640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 0x7f59600a5af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55fdea6b6890 tx=0x7f5964005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 -- 172.21.15.66:0/3420764969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 msgr2=0x55fdea6b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5968009be0 tx=0x7f5968009300 comp rx=0 tx=0).stop 2024-09-15T22:51:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 -- 172.21.15.66:0/3420764969 shutdown_connections 2024-09-15T22:51:59.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 --2- 172.21.15.66:0/3420764969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b94a0 0x55fdea6b9880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.940+0000 7f5979016740 1 -- 172.21.15.66:0/3420764969 >> 172.21.15.66:0/3420764969 conn(0x55fdea6b5a30 msgr2=0x55fdea6b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:59.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.941+0000 7f5979016740 1 -- 172.21.15.66:0/3420764969 shutdown_connections 2024-09-15T22:51:59.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.941+0000 7f5979016740 1 -- 172.21.15.66:0/3420764969 wait complete. 2024-09-15T22:51:59.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.941+0000 7f5979016740 1 -- start start 2024-09-15T22:51:59.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.941+0000 7f5979016740 1 Processor -- start 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b94a0 0x55fdea6c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fdea6c7250 con 0x55fdea6c4680 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fdea5da050 con 0x55fdea6b9dc0 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdea6c73d0 con 0x55fdea6b94a0 2024-09-15T22:51:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f5979016740 10 client.0 _ll_register_callbacks cb 0x55fdea61a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f59751da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f59751da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53112/0 (socket says 172.21.15.66:53112) 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f59751da640 1 -- 172.21.15.66:0/4105373194 learned_addr learned my addr 172.21.15.66:0/4105373194 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f59749d9640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b94a0 0x55fdea6c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.942+0000 7f596ffff640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 -- 172.21.15.66:0/4105373194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b94a0 msgr2=0x55fdea6c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b94a0 0x55fdea6c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 -- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 msgr2=0x55fdea6c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 -- 172.21.15.66:0/4105373194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdea3903c0 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f59751da640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f59680096f0 tx=0x7f5968009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2842ddd3dd4875 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.943+0000 7f594ffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968041040 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f5968031440 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5968037040 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5968058050 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f5979016740 10 client.16881 fetch_fsmap learned FSMap version 42 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.944+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fdea6d2b40 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5968037040 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f596803c040 con 0x55fdea6c4680 2024-09-15T22:51:59.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 10 client.16881 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 20 client.16881 populate_metadata read hostname 'smithi066' 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea6d3e90 0x55fdea6d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 4 client.16881 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.945+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdea62c850 con 0x55fdea6d3e90 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.946+0000 7f59749d9640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea6d3e90 0x55fdea6d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.946+0000 7f59749d9640 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea6d3e90 0x55fdea6d6280 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6df4fd67a67eef73 server_cookie=ebd77ca07113ebf2 in_seq=0 out_seq=0 2024-09-15T22:51:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.946+0000 7f594ffff640 10 client.16881 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f594ffff640 1 -- 172.21.15.66:0/4105373194 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdea62c850 con 0x55fdea6d3e90 2024-09-15T22:51:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f594ffff640 10 client.16881 handle_command_reply: tid=0 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 client.16881 shutdown 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 msgr2=0x55fdea6c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f59680096f0 tx=0x7f5968009500 comp rx=0 tx=0).stop 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 shutdown_connections 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6c4680 0x55fdea6c1710 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea6d3e90 0x55fdea6d6280 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 --2- 172.21.15.66:0/4105373194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b94a0 0x55fdea6c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 >> 172.21.15.66:0/4105373194 conn(0x55fdea6b5a30 msgr2=0x55fdea6bb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f594ffff640 0 client.16881 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 shutdown_connections 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.948+0000 7f5979016740 1 -- 172.21.15.66:0/4105373194 wait complete. 2024-09-15T22:51:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.949+0000 7f5979016740 20 client.16881 trim_cache size 0 max 16384 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.983+0000 7f5979016740 1 Processor -- start 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 -- start start 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6c4680 0x55fdea6bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:59.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59540100c0 con 0x55fdea6b94a0 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5954011d80 con 0x55fdea6b9dc0 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.984+0000 7f5979016740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5954010790 con 0x55fdea6c4680 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53120/0 (socket says 172.21.15.66:53120) 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 -- 172.21.15.66:0/3541507240 learned_addr learned my addr 172.21.15.66:0/3541507240 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 -- 172.21.15.66:0/3541507240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6c4680 msgr2=0x55fdea6bc7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6c4680 0x55fdea6bc7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 -- 172.21.15.66:0/3541507240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 msgr2=0x55fdea6b5e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6b5e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.985+0000 7f59749d9640 1 -- 172.21.15.66:0/3541507240 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdea6c0180 con 0x55fdea6b94a0 2024-09-15T22:51:59.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.986+0000 7f59749d9640 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f59640042a0 tx=0x7f5964017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c1b9a72002d88a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:59.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.987+0000 7f595a7fc640 1 -- 172.21.15.66:0/3541507240 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964004390 con 0x55fdea6b94a0 2024-09-15T22:51:59.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.987+0000 7f595a7fc640 1 -- 172.21.15.66:0/3541507240 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596402c420 con 0x55fdea6b94a0 2024-09-15T22:51:59.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.987+0000 7f595a7fc640 1 -- 172.21.15.66:0/3541507240 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964021410 con 0x55fdea6b94a0 2024-09-15T22:51:59.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.988+0000 7f5979016740 1 -- 172.21.15.66:0/3541507240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 msgr2=0x55fdea6d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:59.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.988+0000 7f5979016740 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f59640042a0 tx=0x7f5964017000 comp rx=0 tx=0).stop 2024-09-15T22:51:59.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.997+0000 7f5979016740 1 -- 172.21.15.66:0/3541507240 shutdown_connections 2024-09-15T22:51:59.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.997+0000 7f5979016740 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6c4680 0x55fdea6bc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.997+0000 7f5979016740 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6b9dc0 0x55fdea6b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.997+0000 7f5979016740 1 --2- 172.21.15.66:0/3541507240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6d0510 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:59.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:51:59.997+0000 7f5979016740 1 -- 172.21.15.66:0/3541507240 >> 172.21.15.66:0/3541507240 conn(0x55fdea6b5a30 msgr2=0x55fdea6bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:00.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.001+0000 7f5979016740 1 -- 172.21.15.66:0/3541507240 shutdown_connections 2024-09-15T22:52:00.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.006+0000 7f5979016740 1 -- 172.21.15.66:0/3541507240 wait complete. 2024-09-15T22:52:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.006+0000 7f5979016740 1 -- start start 2024-09-15T22:52:00.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.006+0000 7f5979016740 1 Processor -- start 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6c4680 0x55fdea6c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59540115f0 con 0x55fdea6b94a0 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5954010e60 con 0x55fdea6c4680 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f595400e0a0 con 0x55fdea6b9dc0 2024-09-15T22:52:00.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.007+0000 7f5979016740 10 client.0 _ll_register_callbacks cb 0x7f5964009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:00.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.011+0000 7f59749d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:00.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.011+0000 7f59749d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53126/0 (socket says 172.21.15.66:53126) 2024-09-15T22:52:00.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.011+0000 7f59749d9640 1 -- 172.21.15.66:0/1818930705 learned_addr learned my addr 172.21.15.66:0/1818930705 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:00.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.011+0000 7f596ffff640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:00.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.012+0000 7f59751da640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6c4680 0x55fdea6c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.015+0000 7f596ffff640 1 -- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6c4680 msgr2=0x55fdea6c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.015+0000 7f596ffff640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6c4680 0x55fdea6c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.015+0000 7f596ffff640 1 -- 172.21.15.66:0/1818930705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 msgr2=0x55fdea6ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.015+0000 7f596ffff640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.015+0000 7f596ffff640 1 -- 172.21.15.66:0/1818930705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdea74e8c0 con 0x55fdea6b9dc0 2024-09-15T22:52:00.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f596ffff640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c8290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f595c0cd220 tx=0x7f595c09bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=206f0991b1fedd20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:00.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f594ffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:52:00.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c09b400 con 0x55fdea6b9dc0 2024-09-15T22:52:00.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9503+0+0 (secure 0 0 0) 0x7f595c021720 con 0x55fdea6b9dc0 2024-09-15T22:52:00.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596402c420 con 0x55fdea6b9dc0 2024-09-15T22:52:00.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f595c0a0160 con 0x55fdea6b9dc0 2024-09-15T22:52:00.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f5979016740 10 client.26404 fetch_fsmap learned FSMap version 42 2024-09-15T22:52:00.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.017+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fdea74fac0 con 0x55fdea6b9dc0 2024-09-15T22:52:00.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596402c420 con 0x55fdea6b9dc0 2024-09-15T22:52:00.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 42) ==== 8410+0+0 (secure 0 0 0) 0x7f595c09adb0 con 0x55fdea6b9dc0 2024-09-15T22:52:00.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 10 client.26404 fetch_fsmap finished waiting for FSMap version 42 2024-09-15T22:52:00.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 10 client.26404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:00.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 20 client.26404 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:00.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea7503d0 0x55fdea7527f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:00.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 4 client.26404 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:52:00.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.020+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fdea626d60 con 0x55fdea7503d0 2024-09-15T22:52:00.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.023+0000 7f59749d9640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea7503d0 0x55fdea7527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:00.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.030+0000 7f594ffff640 10 client.26404 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:00.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.030+0000 7f59749d9640 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea7503d0 0x55fdea7527f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb969110c5c5761e server_cookie=3e463abff05dfead in_seq=0 out_seq=0 2024-09-15T22:52:00.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.035+0000 7f594ffff640 1 -- 172.21.15.66:0/1818930705 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55fdea626d60 con 0x55fdea7503d0 2024-09-15T22:52:00.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.035+0000 7f594ffff640 10 client.26404 handle_command_reply: tid=0 2024-09-15T22:52:00.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.035+0000 7f5979016740 1 client.26404 shutdown 2024-09-15T22:52:00.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.040+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 msgr2=0x55fdea6c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:00.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.040+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c8290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f595c0cd220 tx=0x7f595c09bc80 comp rx=0 tx=0).stop 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 shutdown_connections 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fdea7503d0 0x55fdea7527f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fdea6c4680 0x55fdea6c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdea6b9dc0 0x55fdea6c8290 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 --2- 172.21.15.66:0/1818930705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fdea6b94a0 0x55fdea6ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 >> 172.21.15.66:0/1818930705 conn(0x55fdea6b5a30 msgr2=0x55fdea6c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:00.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.044+0000 7f594ffff640 0 client.26404 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:00.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.048+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 shutdown_connections 2024-09-15T22:52:00.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.049+0000 7f5979016740 1 -- 172.21.15.66:0/1818930705 wait complete. 2024-09-15T22:52:00.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.049+0000 7f5979016740 20 client.26404 trim_cache size 0 max 16384 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (9901 inodes in the stack)", 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "f8d5ec59-3993-4826-b832-3cb68f945234": { 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "f8d5ec59-3993-4826-b832-3cb68f945234", 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:52:00.051 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 msgr2=0x7f59600a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 0x7f59600a5af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55fdea6b6890 tx=0x7f5964005f90 comp rx=0 tx=0).stop 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 msgr2=0x7f59701030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ea20 tx=0x7f595c00eee0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 shutdown_connections 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59600a3630 0x7f59600a5af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f597010e500 0x7f5970103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970101440 0x7f59701030e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 --2- 172.21.15.66:0/1382368415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970100b20 0x7f5970102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:00.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.052+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 >> 172.21.15.66:0/1382368415 conn(0x7f59700fc7d0 msgr2=0x7f59700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:00.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.055+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 shutdown_connections 2024-09-15T22:52:00.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:00.055+0000 7f5976c3d640 1 -- 172.21.15.66:0/1382368415 wait complete. 2024-09-15T22:52:01.129 INFO:tasks.cephfs.filesystem:scrub status for tag:f8d5ec59-3993-4826-b832-3cb68f945234 - {'path': '/', 'tag': 'f8d5ec59-3993-4826-b832-3cb68f945234', 'options': 'recursive,force'} 2024-09-15T22:52:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:01 smithi184 ceph-mon[35203]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:52:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:01 smithi066 ceph-mon[31185]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:52:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:01 smithi087 ceph-mon[35290]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 1.3 MiB/s wr, 1.08k op/s 2024-09-15T22:52:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:02 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:02.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:02 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:02 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:03 smithi184 ceph-mon[35203]: pgmap v203: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 932 op/s 2024-09-15T22:52:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:03 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:03 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:03 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:03 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:03 smithi066 ceph-mon[31185]: pgmap v203: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 932 op/s 2024-09-15T22:52:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:03 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:03 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:03 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:03 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:03 smithi087 ceph-mon[35290]: pgmap v203: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.6 MiB/s wr, 932 op/s 2024-09-15T22:52:03.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:03 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:03 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:03 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:03.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:03 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:05 smithi066 ceph-mon[31185]: pgmap v204: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-15T22:52:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:05 smithi066 ceph-mon[31185]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:52:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:05 smithi087 ceph-mon[35290]: pgmap v204: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-15T22:52:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:05 smithi087 ceph-mon[35290]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:52:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:05 smithi184 ceph-mon[35203]: pgmap v204: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-15T22:52:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:05 smithi184 ceph-mon[35203]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:52:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:07 smithi066 ceph-mon[31185]: pgmap v206: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.2 MiB/s wr, 688 op/s 2024-09-15T22:52:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:07 smithi087 ceph-mon[35290]: pgmap v206: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.2 MiB/s wr, 688 op/s 2024-09-15T22:52:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:07 smithi184 ceph-mon[35203]: pgmap v206: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.2 MiB/s wr, 688 op/s 2024-09-15T22:52:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:09 smithi066 ceph-mon[31185]: pgmap v207: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 568 op/s 2024-09-15T22:52:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:09 smithi087 ceph-mon[35290]: pgmap v207: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 568 op/s 2024-09-15T22:52:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:09 smithi184 ceph-mon[35203]: pgmap v207: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 568 op/s 2024-09-15T22:52:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:52:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:52:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:52:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:52:10.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:10 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:52:10.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:52:10.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:52:10.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:52:10.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:52:10.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:10 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:52:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:52:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:52:10.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:52:10.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:52:10.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:10 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:52:11.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:11 smithi066 ceph-mon[31185]: pgmap v208: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 421 op/s 2024-09-15T22:52:11.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:11 smithi184 ceph-mon[35203]: pgmap v208: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 421 op/s 2024-09-15T22:52:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:11 smithi087 ceph-mon[35290]: pgmap v208: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 421 op/s 2024-09-15T22:52:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:13 smithi066 ceph-mon[31185]: pgmap v209: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-09-15T22:52:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:13 smithi087 ceph-mon[35290]: pgmap v209: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-09-15T22:52:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:13 smithi184 ceph-mon[35203]: pgmap v209: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-09-15T22:52:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:14 smithi066 ceph-mon[31185]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T22:52:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:14 smithi066 ceph-mon[31185]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:52:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:14 smithi087 ceph-mon[35290]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T22:52:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:14 smithi087 ceph-mon[35290]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:52:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:14 smithi184 ceph-mon[35203]: pgmap v210: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T22:52:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:14 smithi184 ceph-mon[35203]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:52:17.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:16 smithi066 ceph-mon[31185]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 602 KiB/s wr, 77 op/s 2024-09-15T22:52:17.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:16 smithi087 ceph-mon[35290]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 602 KiB/s wr, 77 op/s 2024-09-15T22:52:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:16 smithi184 ceph-mon[35203]: pgmap v212: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 602 KiB/s wr, 77 op/s 2024-09-15T22:52:19.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:18 smithi066 ceph-mon[31185]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 KiB/s wr, 40 op/s 2024-09-15T22:52:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:18 smithi087 ceph-mon[35290]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 KiB/s wr, 40 op/s 2024-09-15T22:52:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:18 smithi184 ceph-mon[35203]: pgmap v213: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 274 KiB/s wr, 40 op/s 2024-09-15T22:52:21.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:20 smithi066 ceph-mon[31185]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-15T22:52:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:20 smithi087 ceph-mon[35290]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-15T22:52:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:20 smithi184 ceph-mon[35203]: pgmap v214: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-15T22:52:23.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:22 smithi066 ceph-mon[31185]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-15T22:52:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:22 smithi087 ceph-mon[35290]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-15T22:52:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:22 smithi184 ceph-mon[35203]: pgmap v215: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-09-15T22:52:25.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:24 smithi066 ceph-mon[31185]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-15T22:52:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:24 smithi087 ceph-mon[35290]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-15T22:52:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:24 smithi184 ceph-mon[35203]: pgmap v216: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-15T22:52:27.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:26 smithi066 ceph-mon[31185]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-15T22:52:27.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:26 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:26 smithi087 ceph-mon[35290]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-15T22:52:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:26 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:26 smithi184 ceph-mon[35203]: pgmap v217: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-15T22:52:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:26 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:28 smithi087 ceph-mon[35290]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-15T22:52:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:28 smithi184 ceph-mon[35203]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-15T22:52:29.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:28 smithi066 ceph-mon[31185]: pgmap v218: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 18 op/s 2024-09-15T22:52:31.130 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:52:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:30 smithi087 ceph-mon[35290]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:52:31.409 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:30 smithi184 ceph-mon[35203]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:52:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:30 smithi066 ceph-mon[31185]: pgmap v219: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:52:31.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.869+0000 7f81c1daa640 1 -- 172.21.15.66:0/3785742037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 msgr2=0x7f81bc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.869+0000 7f81c1daa640 1 --2- 172.21.15.66:0/3785742037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc1021d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009900 tx=0x7f81ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.869+0000 7f81c1daa640 1 -- 172.21.15.66:0/3785742037 shutdown_connections 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.869+0000 7f81c1daa640 1 --2- 172.21.15.66:0/3785742037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc106f20 0x7f81bc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 --2- 172.21.15.66:0/3785742037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81bc1027a0 0x7f81bc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 --2- 172.21.15.66:0/3785742037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc1021d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- 172.21.15.66:0/3785742037 >> 172.21.15.66:0/3785742037 conn(0x7f81bc0fd8f0 msgr2=0x7f81bc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- 172.21.15.66:0/3785742037 shutdown_connections 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- 172.21.15.66:0/3785742037 wait complete. 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 Processor -- start 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- start start 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 0x7f81bc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81bc106f20 0x7f81bc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc111f80 con 0x7f81bc101df0 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc111e00 con 0x7f81bc1027a0 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.870+0000 7f81c1daa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc112100 con 0x7f81bc106f20 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34160/0 (socket says 172.21.15.66:34160) 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2846337425 learned_addr learned my addr 172.21.15.66:0/2846337425 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 0x7f81bc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2846337425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81bc106f20 msgr2=0x7f81bc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81bc106f20 0x7f81bc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2846337425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 msgr2=0x7f81bc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 0x7f81bc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2846337425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc19f620 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 0x7f81bc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f81ac006010 tx=0x7f81ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81b97fa640 1 -- 172.21.15.66:0/2846337425 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac03f030 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81b97fa640 1 -- 172.21.15.66:0/2846337425 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ac003ce0 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81b97fa640 1 -- 172.21.15.66:0/2846337425 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac035070 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc19f8b0 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.871+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc19fd40 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81b97fa640 1 -- 172.21.15.66:0/2846337425 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f81ac042030 con 0x7f81bc101df0 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 Processor -- start 2024-09-15T22:52:31.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 -- start start 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84db0 0x563518c8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c8f670 0x563518c91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563518bea2e0 con 0x563518c84490 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563518b91ce0 con 0x563518c8f670 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81c4183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563518be62a0 con 0x563518c84db0 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.874+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34176/0 (socket says 172.21.15.66:34176) 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 -- 172.21.15.66:0/2476416887 learned_addr learned my addr 172.21.15.66:0/2476416887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b97fa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 0x7f81a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c8f670 0x563518c91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84db0 0x563518c8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 0x7f81a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 -- 172.21.15.66:0/2476416887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84db0 msgr2=0x563518c8f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84db0 0x563518c8f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 -- 172.21.15.66:0/2476416887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c8f670 msgr2=0x563518c91a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c8f670 0x563518c91a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 -- 172.21.15.66:0/2476416887 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563518b76440 con 0x563518c84490 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b97fa640 1 -- 172.21.15.66:0/2846337425 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f81ac0f0740 con 0x7f81bc101df0 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f81b40148f0 tx=0x7f81b4014db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be37d0bd8bf6613b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b1ffb640 1 -- 172.21.15.66:0/2476416887 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4014070 con 0x563518c84490 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b1ffb640 1 -- 172.21.15.66:0/2476416887 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4014210 con 0x563518c84490 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.875+0000 7f81b1ffb640 1 -- 172.21.15.66:0/2476416887 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b401d6c0 con 0x563518c84490 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 -- 172.21.15.66:0/2476416887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 msgr2=0x563518c84870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 0x7f81a80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b401e000 tx=0x7f81b401b000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f81b40148f0 tx=0x7f81b4014db0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 -- 172.21.15.66:0/2476416887 shutdown_connections 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c8f670 0x563518c91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84db0 0x563518c8f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 --2- 172.21.15.66:0/2476416887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84490 0x563518c84870 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 -- 172.21.15.66:0/2476416887 >> 172.21.15.66:0/2476416887 conn(0x563518c80a20 msgr2=0x563518c80e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 -- 172.21.15.66:0/2476416887 shutdown_connections 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.876+0000 7f81c4183740 1 -- 172.21.15.66:0/2476416887 wait complete. 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 -- start start 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 Processor -- start 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c8ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c8c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563518c92240 con 0x563518c8f670 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563518ba5050 con 0x563518c84db0 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563518c923c0 con 0x563518c84490 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81c4183740 10 client.0 _ll_register_callbacks cb 0x563518be5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34186/0 (socket says 172.21.15.66:34186) 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81bbfff640 1 -- 172.21.15.66:0/3176552769 learned_addr learned my addr 172.21.15.66:0/3176552769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c8ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.877+0000 7f81b3fff640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c8c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 -- 172.21.15.66:0/3176552769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 msgr2=0x563518c8ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c8ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 -- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 msgr2=0x563518c8c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c8c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 -- 172.21.15.66:0/3176552769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56351895b3c0 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81bbfff640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097d0 tx=0x7f81b4004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a992b0f394f67c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f819affd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4034060 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f81b4003e00 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4014210 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f81b403b050 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81c4183740 10 client.16899 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.878+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563518c9dbc0 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4014210 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f81b402e030 con 0x563518c8f670 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 10 client.16899 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 20 client.16899 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c9ef10 0x563518ca1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 4 client.16899 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563518bf7850 con 0x563518c9ef10 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.879+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c9ef10 0x563518ca1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f819affd640 10 client.16899 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c9ef10 0x563518ca1300 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f624021993b44b server_cookie=b7c84c5d9efcb53b in_seq=0 out_seq=0 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f819affd640 1 -- 172.21.15.66:0/3176552769 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563518bf7850 con 0x563518c9ef10 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f819affd640 10 client.16899 handle_command_reply: tid=0 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 client.16899 shutdown 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 msgr2=0x563518c8c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097d0 tx=0x7f81b4004e50 comp rx=0 tx=0).stop 2024-09-15T22:52:31.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 shutdown_connections 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c8f670 0x563518c8c770 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c9ef10 0x563518ca1300 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c8c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f81c4183740 1 --2- 172.21.15.66:0/3176552769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c8ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.880+0000 7f819affd640 0 client.16899 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.881+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 >> 172.21.15.66:0/3176552769 conn(0x563518c80a20 msgr2=0x563518c86700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.881+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 shutdown_connections 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.881+0000 7f81c4183740 1 -- 172.21.15.66:0/3176552769 wait complete. 2024-09-15T22:52:31.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.881+0000 7f81c4183740 20 client.16899 trim_cache size 0 max 16384 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 Processor -- start 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 -- start start 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c80a20 0x563518c9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 0x563518ca6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b14f0 con 0x563518c84db0 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b31b0 con 0x563518c84490 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.918+0000 7f81c4183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b1bc0 con 0x563518c80a20 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34196/0 (socket says 172.21.15.66:34196) 2024-09-15T22:52:31.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 -- 172.21.15.66:0/2529974994 learned_addr learned my addr 172.21.15.66:0/2529974994 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c80a20 0x563518c9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 0x563518ca6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 -- 172.21.15.66:0/2529974994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c80a20 msgr2=0x563518c9b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c80a20 0x563518c9b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 -- 172.21.15.66:0/2529974994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 msgr2=0x563518ca6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 0x563518ca6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 -- 172.21.15.66:0/2529974994 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563518c8f2f0 con 0x563518c84db0 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 0x563518ca6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:31.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f81b4002230 tx=0x7f81b40049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23b2fc36e8fef16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81b17fa640 1 -- 172.21.15.66:0/2529974994 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4034040 con 0x563518c84db0 2024-09-15T22:52:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81b17fa640 1 -- 172.21.15.66:0/2529974994 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4009800 con 0x563518c84db0 2024-09-15T22:52:31.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.919+0000 7f81b17fa640 1 -- 172.21.15.66:0/2529974994 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4005650 con 0x563518c84db0 2024-09-15T22:52:31.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- 172.21.15.66:0/2529974994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 msgr2=0x563518ca7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f81b4002230 tx=0x7f81b40049c0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- 172.21.15.66:0/2529974994 shutdown_connections 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c84db0 0x563518ca7100 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84490 0x563518ca6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 --2- 172.21.15.66:0/2529974994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c80a20 0x563518c9b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- 172.21.15.66:0/2529974994 >> 172.21.15.66:0/2529974994 conn(0x563518c8c8d0 msgr2=0x563518c8ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- 172.21.15.66:0/2529974994 shutdown_connections 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- 172.21.15.66:0/2529974994 wait complete. 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.920+0000 7f81c4183740 1 -- start start 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 Processor -- start 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c93180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c93770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b2a20 con 0x563518c80a20 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b2290 con 0x563518c84db0 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1af4f0 con 0x563518c84490 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81c4183740 10 client.0 _ll_register_callbacks cb 0x7f81a4009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34202/0 (socket says 172.21.15.66:34202) 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2619782501 learned_addr learned my addr 172.21.15.66:0/2619782501 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c93180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.921+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c93770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2619782501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 msgr2=0x563518c93180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c93180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 msgr2=0x563518c93770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c93770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 -- 172.21.15.66:0/2619782501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563518c93f70 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bbfff640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81bb7fe640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0ee060 tx=0x7f81ac08c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82184913886c6b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f819affd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac049040 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f81ac0b8d20 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4009800 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f81ac03b580 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81c4183740 10 client.16905 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563518d09ce0 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.922+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4009800 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f81ac0bc910 con 0x563518c80a20 2024-09-15T22:52:31.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 10 client.16905 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 20 client.16905 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c8f670 0x563518d0c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 4 client.16905 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563518bf1d60 con 0x563518c8f670 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c8f670 0x563518d0c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f819affd640 10 client.16905 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f81b3fff640 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c8f670 0x563518d0c4d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea90f27bf9ff4e96 server_cookie=d0aab2732aabd4c5 in_seq=0 out_seq=0 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f819affd640 1 -- 172.21.15.66:0/2619782501 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563518bf1d60 con 0x563518c8f670 2024-09-15T22:52:31.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.923+0000 7f819affd640 10 client.16905 handle_command_reply: tid=0 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 client.16905 shutdown 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 msgr2=0x563518c97e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0ee060 tx=0x7f81ac08c390 comp rx=0 tx=0).stop 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 shutdown_connections 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563518c8f670 0x563518d0c4d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563518c84db0 0x563518c93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563518c84490 0x563518c93180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 --2- 172.21.15.66:0/2619782501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563518c80a20 0x563518c97e50 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 >> 172.21.15.66:0/2619782501 conn(0x563518c8c8d0 msgr2=0x563518c8da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f819affd640 0 client.16905 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 shutdown_connections 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 1 -- 172.21.15.66:0/2619782501 wait complete. 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.924+0000 7f81c4183740 20 client.16905 trim_cache size 0 max 16384 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:52:31.932 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:52:31.933 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:52:31.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 msgr2=0x7f81a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 0x7f81a80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b401e000 tx=0x7f81b401b000 comp rx=0 tx=0).stop 2024-09-15T22:52:31.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 msgr2=0x7f81bc19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f81ac006010 tx=0x7f81ac0042f0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 shutdown_connections 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81a80a33b0 0x7f81a80a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81bc106f20 0x7f81bc19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81bc1027a0 0x7f81bc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 --2- 172.21.15.66:0/2846337425 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc101df0 0x7f81bc19a670 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 >> 172.21.15.66:0/2846337425 conn(0x7f81bc0fd8f0 msgr2=0x7f81bc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 shutdown_connections 2024-09-15T22:52:31.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:31.925+0000 7f81c1daa640 1 -- 172.21.15.66:0/2846337425 wait complete. 2024-09-15T22:52:32.083 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:31 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:32.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:31 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:32.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:31 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:52:32.759 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:52:32.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:52:33.022 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:33.294 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:32 smithi066 ceph-mon[31185]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-09-15T22:52:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:32 smithi087 ceph-mon[35290]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-09-15T22:52:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:32 smithi184 ceph-mon[35203]: pgmap v220: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 19 op/s 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 -- 172.21.15.66:0/923804357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 msgr2=0x7f045c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 --2- 172.21.15.66:0/923804357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c101200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f044c009900 tx=0x7f044c02a480 comp rx=0 tx=0).stop 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 -- 172.21.15.66:0/923804357 shutdown_connections 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 --2- 172.21.15.66:0/923804357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102ef0 0x7f045c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 --2- 172.21.15.66:0/923804357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c102570 0x7f045c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 --2- 172.21.15.66:0/923804357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c100e20 0x7f045c101200 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.516+0000 7f046112e640 1 -- 172.21.15.66:0/923804357 >> 172.21.15.66:0/923804357 conn(0x7f045c0fc7d0 msgr2=0x7f045c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.517+0000 7f046112e640 1 -- 172.21.15.66:0/923804357 shutdown_connections 2024-09-15T22:52:33.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.517+0000 7f046112e640 1 -- 172.21.15.66:0/923804357 wait complete. 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.517+0000 7f046112e640 1 Processor -- start 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.517+0000 7f046112e640 1 -- start start 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f045c110f80 con 0x7f045c102ef0 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f045c110e00 con 0x7f045c100e20 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f046112e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f045c111100 con 0x7f045c102570 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50574/0 (socket says 172.21.15.66:50574) 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 -- 172.21.15.66:0/2706059777 learned_addr learned my addr 172.21.15.66:0/2706059777 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045a59c640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 -- 172.21.15.66:0/2706059777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 msgr2=0x7f045c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 -- 172.21.15.66:0/2706059777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 msgr2=0x7f045c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 -- 172.21.15.66:0/2706059777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c1a69c0 con 0x7f045c102ef0 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045ad9d640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.518+0000 7f045b59e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f045400eb10 tx=0x7f045400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.519+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454004b20 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.519+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c1a6cb0 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.519+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0454004cc0 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.519+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454010760 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.519+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c1a71f0 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.520+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c101200 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.521+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0454005000 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.522+0000 7f0443fff640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 0x7f04440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.522+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f04540d0ae0 con 0x7f045c102ef0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.522+0000 7f045ad9d640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 0x7f04440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.522+0000 7f045ad9d640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 0x7f04440a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f044c009230 tx=0x7f044c0058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.525+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f045409d090 con 0x7f045c102ef0 2024-09-15T22:52:33.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.739+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f045c0fe1b0 con 0x7f045c102ef0 2024-09-15T22:52:33.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.739+0000 7f0443fff640 1 -- 172.21.15.66:0/2706059777 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11988 (secure 0 0 0) 0x7f045c0fe1b0 con 0x7f045c102ef0 2024-09-15T22:52:33.741 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:52:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":44,"btime":"2024-09-15T22:52:30:952534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:52:29.985447+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 44 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.741+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 msgr2=0x7f04440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.741+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 0x7f04440a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f044c009230 tx=0x7f044c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.741+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 msgr2=0x7f045c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f045400eb10 tx=0x7f045400c2d0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 shutdown_connections 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f04440a33b0 0x7f04440a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f045c102ef0 0x7f045c0fd700 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f045c102570 0x7f045c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 --2- 172.21.15.66:0/2706059777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f045c100e20 0x7f045c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 >> 172.21.15.66:0/2706059777 conn(0x7f045c0fc7d0 msgr2=0x7f045c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 shutdown_connections 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:33.742+0000 7f046112e640 1 -- 172.21.15.66:0/2706059777 wait complete. 2024-09-15T22:52:34.138 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:33 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2706059777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:52:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:33 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2706059777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:52:34.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:33 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2706059777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:52:34.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:52:34.741 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:35.169 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:34 smithi066 ceph-mon[31185]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-15T22:52:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 -- 172.21.15.66:0/338549883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c100e20 msgr2=0x7ff48c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 --2- 172.21.15.66:0/338549883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c100e20 0x7ff48c101200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff484009ca0 tx=0x7ff48402a950 comp rx=0 tx=0).stop 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 -- 172.21.15.66:0/338549883 shutdown_connections 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 --2- 172.21.15.66:0/338549883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102ef0 0x7ff48c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 --2- 172.21.15.66:0/338549883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c102570 0x7ff48c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 --2- 172.21.15.66:0/338549883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c100e20 0x7ff48c101200 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 -- 172.21.15.66:0/338549883 >> 172.21.15.66:0/338549883 conn(0x7ff48c0fc7d0 msgr2=0x7ff48c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 -- 172.21.15.66:0/338549883 shutdown_connections 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 -- 172.21.15.66:0/338549883 wait complete. 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.252+0000 7ff49127b640 1 Processor -- start 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 -- start start 2024-09-15T22:52:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c100e20 0x7ff48c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102570 0x7ff48c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1120a0 con 0x7ff48c102ef0 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c111f20 con 0x7ff48c102570 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff49127b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c112220 con 0x7ff48c100e20 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50586/0 (socket says 172.21.15.66:50586) 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff48b7fe640 1 -- 172.21.15.66:0/1337577166 learned_addr learned my addr 172.21.15.66:0/1337577166 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff48affd640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c100e20 0x7ff48c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.253+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102570 0x7ff48c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 -- 172.21.15.66:0/1337577166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c100e20 msgr2=0x7ff48c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c100e20 0x7ff48c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 -- 172.21.15.66:0/1337577166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102570 msgr2=0x7ff48c198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102570 0x7ff48c198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 -- 172.21.15.66:0/1337577166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c19d5b0 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d950 tx=0x7ff47c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff483fff640 1 -- 172.21.15.66:0/1337577166 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c017030 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c19d8a0 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff483fff640 1 -- 172.21.15.66:0/1337577166 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff47c004020 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff483fff640 1 -- 172.21.15.66:0/1337577166 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c003b70 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.254+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1a5180 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.256+0000 7ff483fff640 1 -- 172.21.15.66:0/1337577166 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff47c01a070 con 0x7ff48c102ef0 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.256+0000 7ff493654740 1 Processor -- start 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 -- start start 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 0x556615deea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556615d542f0 con 0x556615defb40 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556615cfbcf0 con 0x556615dfd780 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff493654740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556615d502b0 con 0x556615dee5d0 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff48a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff48a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50592/0 (socket says 172.21.15.66:50592) 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff48a7fc640 1 -- 172.21.15.66:0/1696772603 learned_addr learned my addr 172.21.15.66:0/1696772603 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff48affd640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 0x556615deea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.257+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 -- 172.21.15.66:0/1696772603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 msgr2=0x556615deea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 0x556615deea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 -- 172.21.15.66:0/1696772603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 msgr2=0x556615dffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 -- 172.21.15.66:0/1696772603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556615ce03a0 con 0x556615defb40 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48affd640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 0x556615deea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff483fff640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 0x7ff4780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48affd640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 0x7ff4780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff474006aa0 tx=0x7ff4740095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ac32b023b86455 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff483fff640 1 -- 172.21.15.66:0/1337577166 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7ff47c0cfb20 con 0x7ff48c102ef0 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff4817fa640 1 -- 172.21.15.66:0/1696772603 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474017610 con 0x556615defb40 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff4817fa640 1 -- 172.21.15.66:0/1696772603 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff47401c070 con 0x556615defb40 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.258+0000 7ff4817fa640 1 -- 172.21.15.66:0/1696772603 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4740159d0 con 0x556615defb40 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- 172.21.15.66:0/1696772603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 msgr2=0x556615dee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff48affd640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 0x7ff4780a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556615debac0 tx=0x7ff484005fa0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff474006aa0 tx=0x7ff4740095d0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- 172.21.15.66:0/1696772603 shutdown_connections 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dee5d0 0x556615deea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 --2- 172.21.15.66:0/1696772603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615defb40 0x556615dee090 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- 172.21.15.66:0/1696772603 >> 172.21.15.66:0/1696772603 conn(0x556615db7310 msgr2=0x556615deac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- 172.21.15.66:0/1696772603 shutdown_connections 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- 172.21.15.66:0/1696772603 wait complete. 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 -- start start 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.259+0000 7ff493654740 1 Processor -- start 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615dfa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dfabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556615e00420 con 0x556615dee5d0 2024-09-15T22:52:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556615d0f060 con 0x556615dfd780 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556615e005a0 con 0x556615defb40 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff493654740 10 client.0 _ll_register_callbacks cb 0x556615a628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50596/0 (socket says 172.21.15.66:50596) 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 -- 172.21.15.66:0/3872011149 learned_addr learned my addr 172.21.15.66:0/3872011149 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615dfa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dfabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 -- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 msgr2=0x556615dfa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615dfa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 -- 172.21.15.66:0/3872011149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 msgr2=0x556615dfabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dfabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 -- 172.21.15.66:0/3872011149 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556615ac53c0 con 0x556615dee5d0 2024-09-15T22:52:35.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff48affd640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff484035000 tx=0x7ff4840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63def7e3f7872ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.260+0000 7ff4727fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484055060 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7ff484004250 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff47401c070 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff484034040 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 10 client.16923 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556615e0bf00 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff47401c070 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7ff484030ac0 con 0x556615dee5d0 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 10 client.16923 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 10 client.16923 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 20 client.16923 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:35.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e0d3c0 0x556615e0f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 4 client.16923 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.261+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556615d61860 con 0x556615e0d3c0 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.262+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e0d3c0 0x556615e0f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.262+0000 7ff4727fc640 10 client.16923 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.262+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e0d3c0 0x556615e0f7d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2eaa90c34562962e server_cookie=195c3f0308e91b88 in_seq=0 out_seq=0 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff4727fc640 1 -- 172.21.15.66:0/3872011149 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556615d61860 con 0x556615e0d3c0 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff4727fc640 10 client.16923 handle_command_reply: tid=0 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 client.16923 shutdown 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 msgr2=0x556615dfd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff484035000 tx=0x7ff4840095c0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 shutdown_connections 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e0d3c0 0x556615e0f7d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615dfabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615dfa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 --2- 172.21.15.66:0/3872011149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615dfd1b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff4727fc640 0 client.16923 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 >> 172.21.15.66:0/3872011149 conn(0x556615db7310 msgr2=0x556615df0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 shutdown_connections 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 1 -- 172.21.15.66:0/3872011149 wait complete. 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.263+0000 7ff493654740 20 client.16923 trim_cache size 0 max 16384 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 Processor -- start 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 -- start start 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615e150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615e155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1ad0c0 con 0x556615dee5d0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1aed80 con 0x556615dfd780 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff493654740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1ad790 con 0x556615defb40 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50604/0 (socket says 172.21.15.66:50604) 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 -- 172.21.15.66:0/3159479444 learned_addr learned my addr 172.21.15.66:0/3159479444 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615e155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615e150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 -- 172.21.15.66:0/3159479444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 msgr2=0x556615e150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615e150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 -- 172.21.15.66:0/3159479444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 msgr2=0x556615e155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.278+0000 7ff48affd640 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615e155e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.279+0000 7ff48affd640 1 -- 172.21.15.66:0/3159479444 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556615e09ba0 con 0x556615dee5d0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.279+0000 7ff48affd640 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff48402ae70 tx=0x7ff484009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd7fa8b19a6f2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.279+0000 7ff480ff9640 1 -- 172.21.15.66:0/3159479444 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484055050 con 0x556615dee5d0 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.279+0000 7ff480ff9640 1 -- 172.21.15.66:0/3159479444 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff48402f9e0 con 0x556615dee5d0 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.279+0000 7ff480ff9640 1 -- 172.21.15.66:0/3159479444 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484030b20 con 0x556615dee5d0 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- 172.21.15.66:0/3159479444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 msgr2=0x556615deae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff48402ae70 tx=0x7ff484009630 comp rx=0 tx=0).stop 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- 172.21.15.66:0/3159479444 shutdown_connections 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615dfd780 0x556615e155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615defb40 0x556615e150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- 172.21.15.66:0/3159479444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615deae10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- 172.21.15.66:0/3159479444 >> 172.21.15.66:0/3159479444 conn(0x556615db7310 msgr2=0x556615dea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- 172.21.15.66:0/3159479444 shutdown_connections 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- 172.21.15.66:0/3159479444 wait complete. 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- start start 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 Processor -- start 2024-09-15T22:52:35.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615defb40 0x556615e01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dfd780 0x556615e01680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1ae5f0 con 0x556615dee5d0 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1ade60 con 0x556615defb40 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1ab0c0 con 0x556615dfd780 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.280+0000 7ff493654740 10 client.0 _ll_register_callbacks cb 0x7ff48402f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50616/0 (socket says 172.21.15.66:50616) 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 -- 172.21.15.66:0/2640939217 learned_addr learned my addr 172.21.15.66:0/2640939217 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615defb40 0x556615e01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48b7fe640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dfd780 0x556615e01680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 -- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dfd780 msgr2=0x556615e01680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dfd780 0x556615e01680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 -- 172.21.15.66:0/2640939217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615defb40 msgr2=0x556615e01140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615defb40 0x556615e01140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 -- 172.21.15.66:0/2640939217 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556615e01d20 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff48affd640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff48402a990 tx=0x7ff4840309b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fcc0ad8fa9dc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff4727fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.281+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48406e060 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.282+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff48402f9e0 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.282+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7ff484004250 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.282+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff484075050 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.282+0000 7ff493654740 10 client.16929 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.282+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556615e77f00 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.283+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff48402f9e0 con 0x556615dee5d0 2024-09-15T22:52:35.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.283+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7ff484060440 con 0x556615dee5d0 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.283+0000 7ff493654740 10 client.16929 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff493654740 10 client.16929 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff493654740 20 client.16929 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e78510 0x556615e7a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff493654740 4 client.16929 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556615d5bd70 con 0x556615e78510 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e78510 0x556615e7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.284+0000 7ff48a7fc640 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e78510 0x556615e7a900 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d470b935175f12b8 server_cookie=e831d7541f9bfa97 in_seq=0 out_seq=0 2024-09-15T22:52:35.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.285+0000 7ff4727fc640 10 client.16929 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:52:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.285+0000 7ff4727fc640 1 -- 172.21.15.66:0/2640939217 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556615d5bd70 con 0x556615e78510 2024-09-15T22:52:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.285+0000 7ff4727fc640 10 client.16929 handle_command_reply: tid=0 2024-09-15T22:52:35.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.285+0000 7ff493654740 1 client.16929 shutdown 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 msgr2=0x556615e05e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff48402a990 tx=0x7ff4840309b0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 shutdown_connections 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556615e78510 0x556615e7a900 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556615dfd780 0x556615e01680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556615defb40 0x556615e01140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 --2- 172.21.15.66:0/2640939217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556615dee5d0 0x556615e05e10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 >> 172.21.15.66:0/2640939217 conn(0x556615db7310 msgr2=0x556615df9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff4727fc640 0 client.16929 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 shutdown_connections 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 1 -- 172.21.15.66:0/2640939217 wait complete. 2024-09-15T22:52:35.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.286+0000 7ff493654740 20 client.16929 trim_cache size 0 max 16384 2024-09-15T22:52:35.304 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:52:35.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 msgr2=0x7ff4780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 0x7ff4780a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556615debac0 tx=0x7ff484005fa0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 msgr2=0x7ff48c19ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d950 tx=0x7ff47c00dd50 comp rx=0 tx=0).stop 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 shutdown_connections 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4780a3430 0x7ff4780a58f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff48c102ef0 0x7ff48c19ced0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff48c102570 0x7ff48c198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 --2- 172.21.15.66:0/1337577166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff48c100e20 0x7ff48c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 >> 172.21.15.66:0/1337577166 conn(0x7ff48c0fc7d0 msgr2=0x7ff48c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 shutdown_connections 2024-09-15T22:52:35.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:35.287+0000 7ff49127b640 1 -- 172.21.15.66:0/1337577166 wait complete. 2024-09-15T22:52:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:34 smithi087 ceph-mon[35290]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-15T22:52:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:34 smithi184 ceph-mon[35203]: pgmap v221: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-15T22:52:35.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:52:36.182 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:36.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 -- 172.21.15.66:0/3555377981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 msgr2=0x7f57bc106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/3555377981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc106e50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009930 tx=0x7f57b802a420 comp rx=0 tx=0).stop 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 -- 172.21.15.66:0/3555377981 shutdown_connections 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/3555377981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc101410 0x7f57bc10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/3555377981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc100a70 0x7f57bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/3555377981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc106e50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 -- 172.21.15.66:0/3555377981 >> 172.21.15.66:0/3555377981 conn(0x7f57bc0fc790 msgr2=0x7f57bc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 -- 172.21.15.66:0/3555377981 shutdown_connections 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.679+0000 7f57c3bd1640 1 -- 172.21.15.66:0/3555377981 wait complete. 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 Processor -- start 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 -- start start 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc100a70 0x7f57bc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 0x7f57bc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc111f50 con 0x7f57bc106a70 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc111dd0 con 0x7f57bc101410 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.680+0000 7f57c3bd1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1120d0 con 0x7f57bc100a70 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50622/0 (socket says 172.21.15.66:50622) 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 -- 172.21.15.66:0/2845415394 learned_addr learned my addr 172.21.15.66:0/2845415394 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c116c640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 0x7f57bc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c196d640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc100a70 0x7f57bc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 -- 172.21.15.66:0/2845415394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc100a70 msgr2=0x7f57bc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc100a70 0x7f57bc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 -- 172.21.15.66:0/2845415394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 msgr2=0x7f57bc198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 0x7f57bc198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 -- 172.21.15.66:0/2845415394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc19d3e0 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c116c640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 0x7f57bc198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c216e640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f57b400eaa0 tx=0x7f57b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57b2ffd640 1 -- 172.21.15.66:0/2845415394 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b400cdb0 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57b2ffd640 1 -- 172.21.15.66:0/2845415394 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57b4005020 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57bc19d6d0 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57b2ffd640 1 -- 172.21.15.66:0/2845415394 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b40116b0 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.681+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57bc1a4fb0 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.683+0000 7f57b2ffd640 1 -- 172.21.15.66:0/2845415394 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f57b4005560 con 0x7f57bc106a70 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 Processor -- start 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 -- start start 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b40fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b41e780 0x55e25b420b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e25b3752f0 con 0x55e25b410b40 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e25b31ccf0 con 0x55e25b40f5d0 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c5faa740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e25b3712b0 con 0x55e25b41e780 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50630/0 (socket says 172.21.15.66:50630) 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57c116c640 1 -- 172.21.15.66:0/1349812123 learned_addr learned my addr 172.21.15.66:0/1349812123 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.684+0000 7f57b2ffd640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 0x7f57a80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c196d640 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b40fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b41e780 0x55e25b420b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57b2ffd640 1 -- 172.21.15.66:0/2845415394 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f57b40d0360 con 0x7f57bc106a70 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c216e640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 0x7f57a80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 -- 172.21.15.66:0/1349812123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b41e780 msgr2=0x55e25b420b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b41e780 0x55e25b420b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 -- 172.21.15.66:0/1349812123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 msgr2=0x55e25b40fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b40fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 -- 172.21.15.66:0/1349812123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e25b3013a0 con 0x55e25b410b40 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c116c640 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f57ac008f90 tx=0x7f57ac008640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea627dd026f56a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57c216e640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 0x7f57a80a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57b409c1a0 tx=0x7f57b406df90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57a7fff640 1 -- 172.21.15.66:0/1349812123 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac018030 con 0x55e25b410b40 2024-09-15T22:52:36.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57a7fff640 1 -- 172.21.15.66:0/1349812123 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac010b20 con 0x55e25b410b40 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.685+0000 7f57a7fff640 1 -- 172.21.15.66:0/1349812123 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac01cb90 con 0x55e25b410b40 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- 172.21.15.66:0/1349812123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 msgr2=0x55e25b40f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f57ac008f90 tx=0x7f57ac008640 comp rx=0 tx=0).stop 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- 172.21.15.66:0/1349812123 shutdown_connections 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b41e780 0x55e25b420b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b40fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 --2- 172.21.15.66:0/1349812123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b40f090 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- 172.21.15.66:0/1349812123 >> 172.21.15.66:0/1349812123 conn(0x55e25b3d8310 msgr2=0x55e25b40bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- 172.21.15.66:0/1349812123 shutdown_connections 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- 172.21.15.66:0/1349812123 wait complete. 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.686+0000 7f57c5faa740 1 -- start start 2024-09-15T22:52:36.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 Processor -- start 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b40f5d0 0x55e25b41e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b41b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e25b421480 con 0x55e25b410b40 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e25b330060 con 0x55e25b41e780 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e25b421600 con 0x55e25b40f5d0 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c5faa740 10 client.0 _ll_register_callbacks cb 0x55e25b0838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50634/0 (socket says 172.21.15.66:50634) 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 -- 172.21.15.66:0/3272125808 learned_addr learned my addr 172.21.15.66:0/3272125808 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c116c640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b40f5d0 0x55e25b41e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c116c640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b41b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 -- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b40f5d0 msgr2=0x55e25b41e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b40f5d0 0x55e25b41e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 -- 172.21.15.66:0/3272125808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 msgr2=0x55e25b41b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b41b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.687+0000 7f57c196d640 1 -- 172.21.15.66:0/3272125808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e25b0e63c0 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c196d640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009930 tx=0x7f57b80319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1b3f87d164bcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b8035040 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f57b8004240 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ac010b20 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f57b804e050 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 10 client.16941 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e25b42ce90 con 0x55e25b410b40 2024-09-15T22:52:36.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac010b20 con 0x55e25b410b40 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f57b8004a90 con 0x55e25b410b40 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 10 client.16941 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 10 client.16941 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 20 client.16941 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b42e3a0 0x55e25b4307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 4 client.16941 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.688+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e25b382860 con 0x55e25b42e3a0 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.689+0000 7f57c116c640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b42e3a0 0x55e25b4307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.689+0000 7f57c116c640 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b42e3a0 0x55e25b4307c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d201db4d27c53329 server_cookie=4e32461054640914 in_seq=0 out_seq=0 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.689+0000 7f57a57fa640 10 client.16941 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57a57fa640 1 -- 172.21.15.66:0/3272125808 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e25b382860 con 0x55e25b42e3a0 2024-09-15T22:52:36.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57a57fa640 10 client.16941 handle_command_reply: tid=0 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 client.16941 shutdown 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 msgr2=0x55e25b41b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009930 tx=0x7f57b80319b0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 shutdown_connections 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b42e3a0 0x55e25b4307c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b41b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b410b40 0x55e25b41b390 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 --2- 172.21.15.66:0/3272125808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b40f5d0 0x55e25b41e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 >> 172.21.15.66:0/3272125808 conn(0x55e25b3d8310 msgr2=0x55e25b411960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57a57fa640 0 client.16941 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 shutdown_connections 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 1 -- 172.21.15.66:0/3272125808 wait complete. 2024-09-15T22:52:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.690+0000 7f57c5faa740 20 client.16941 trim_cache size 0 max 16384 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 Processor -- start 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 -- start start 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b42a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b41a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1ad020 con 0x55e25b41e780 2024-09-15T22:52:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1aece0 con 0x55e25b40f5d0 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c5faa740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1ad6f0 con 0x55e25b410b40 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50638/0 (socket says 172.21.15.66:50638) 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 -- 172.21.15.66:0/2324529943 learned_addr learned my addr 172.21.15.66:0/2324529943 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b42a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c196d640 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b41a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 -- 172.21.15.66:0/2324529943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 msgr2=0x55e25b41a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b41a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 -- 172.21.15.66:0/2324529943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 msgr2=0x55e25b42a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b42a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 -- 172.21.15.66:0/2324529943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e25b4198e0 con 0x55e25b41e780 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.704+0000 7f57c116c640 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f57ac01c840 tx=0x7f57ac01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e8b1505200e2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57a77fe640 1 -- 172.21.15.66:0/2324529943 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac018040 con 0x55e25b41e780 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57a77fe640 1 -- 172.21.15.66:0/2324529943 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac010640 con 0x55e25b41e780 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57a77fe640 1 -- 172.21.15.66:0/2324529943 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac028530 con 0x55e25b41e780 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 -- 172.21.15.66:0/2324529943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 msgr2=0x55e25b436090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f57ac01c840 tx=0x7f57ac01c730 comp rx=0 tx=0).stop 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 -- 172.21.15.66:0/2324529943 shutdown_connections 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b41e780 0x55e25b436090 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b41a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2324529943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b40f5d0 0x55e25b42a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 -- 172.21.15.66:0/2324529943 >> 172.21.15.66:0/2324529943 conn(0x55e25b3d8310 msgr2=0x55e25b419c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 -- 172.21.15.66:0/2324529943 shutdown_connections 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.705+0000 7f57c5faa740 1 -- 172.21.15.66:0/2324529943 wait complete. 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 -- start start 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 Processor -- start 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b4221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b422700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1ae550 con 0x55e25b40f5d0 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1addc0 con 0x55e25b41e780 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1ab020 con 0x55e25b410b40 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c5faa740 10 client.0 _ll_register_callbacks cb 0x7f57b80314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c116c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50642/0 (socket says 172.21.15.66:50642) 2024-09-15T22:52:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.706+0000 7f57c116c640 1 -- 172.21.15.66:0/2195734653 learned_addr learned my addr 172.21.15.66:0/2195734653 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c196d640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b4221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b422700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 -- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 msgr2=0x55e25b4221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b4221c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 -- 172.21.15.66:0/2195734653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 msgr2=0x55e25b422700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b422700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 -- 172.21.15.66:0/2195734653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e25b422df0 con 0x55e25b40f5d0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c116c640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f57ac008b80 tx=0x7f57ac005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1423304dd41b595 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac030040 con 0x55e25b40f5d0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ac010640 con 0x55e25b40f5d0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f57ac0109f0 con 0x55e25b40f5d0 2024-09-15T22:52:36.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f57ac040050 con 0x55e25b40f5d0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c5faa740 10 client.16947 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.707+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e25b498f00 con 0x55e25b40f5d0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac010640 con 0x55e25b40f5d0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f57ac036030 con 0x55e25b40f5d0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 10 client.16947 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 10 client.16947 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 20 client.16947 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b4994d0 0x55e25b49b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 4 client.16947 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e25b37cd70 con 0x55e25b4994d0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c196d640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b4994d0 0x55e25b49b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57c196d640 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b4994d0 0x55e25b49b8f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4a69cb0a257c21d1 server_cookie=12013db456ef87cc in_seq=0 out_seq=0 2024-09-15T22:52:36.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.708+0000 7f57a57fa640 10 client.16947 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57a57fa640 1 -- 172.21.15.66:0/2195734653 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e25b37cd70 con 0x55e25b4994d0 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57a57fa640 10 client.16947 handle_command_reply: tid=0 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 client.16947 shutdown 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 msgr2=0x55e25b426e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f57ac008b80 tx=0x7f57ac005f40 comp rx=0 tx=0).stop 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 shutdown_connections 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e25b4994d0 0x55e25b49b8f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e25b41e780 0x55e25b422700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57a57fa640 0 client.16947 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e25b410b40 0x55e25b4221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 --2- 172.21.15.66:0/2195734653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e25b40f5d0 0x55e25b426e90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 >> 172.21.15.66:0/2195734653 conn(0x55e25b3d8310 msgr2=0x55e25b41a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 shutdown_connections 2024-09-15T22:52:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 1 -- 172.21.15.66:0/2195734653 wait complete. 2024-09-15T22:52:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.709+0000 7f57c5faa740 20 client.16947 trim_cache size 0 max 16384 2024-09-15T22:52:36.718 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 msgr2=0x7f57a80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 0x7f57a80a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57b409c1a0 tx=0x7f57b406df90 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 msgr2=0x7f57bc19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f57b400eaa0 tx=0x7f57b400ef60 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 shutdown_connections 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57a80a3430 0x7f57a80a58f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57bc106a70 0x7f57bc19cd00 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57bc101410 0x7f57bc198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 --2- 172.21.15.66:0/2845415394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc100a70 0x7f57bc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 >> 172.21.15.66:0/2845415394 conn(0x7f57bc0fc790 msgr2=0x7f57bc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 shutdown_connections 2024-09-15T22:52:36.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:36.710+0000 7f57c3bd1640 1 -- 172.21.15.66:0/2845415394 wait complete. 2024-09-15T22:52:37.336 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:36 smithi066 ceph-mon[31185]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-09-15T22:52:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:36 smithi087 ceph-mon[35290]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-09-15T22:52:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:36 smithi184 ceph-mon[35203]: pgmap v222: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-09-15T22:52:37.567 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:52:37.829 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 -- 172.21.15.66:0/1037212416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 msgr2=0x7f973c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 --2- 172.21.15.66:0/1037212416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c10ea90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9734009900 tx=0x7f973402a410 comp rx=0 tx=0).stop 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 -- 172.21.15.66:0/1037212416 shutdown_connections 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 --2- 172.21.15.66:0/1037212416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c10ea90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 --2- 172.21.15.66:0/1037212416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 --2- 172.21.15.66:0/1037212416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 0x7f973c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 -- 172.21.15.66:0/1037212416 >> 172.21.15.66:0/1037212416 conn(0x7f973c0fd8c0 msgr2=0x7f973c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 -- 172.21.15.66:0/1037212416 shutdown_connections 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.315+0000 7f9740d18640 1 -- 172.21.15.66:0/1037212416 wait complete. 2024-09-15T22:52:38.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 Processor -- start 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 -- start start 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 0x7f973c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f973c111f90 con 0x7f973c106f10 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f973c111e10 con 0x7f973c101de0 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9740d18640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f973c112110 con 0x7f973c102790 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f973ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f973ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50658/0 (socket says 172.21.15.66:50658) 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f973ad9d640 1 -- 172.21.15.66:0/4195108556 learned_addr learned my addr 172.21.15.66:0/4195108556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f973a59c640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 0x7f973c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.316+0000 7f9739d9b640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 -- 172.21.15.66:0/4195108556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 msgr2=0x7f973c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 -- 172.21.15.66:0/4195108556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 msgr2=0x7f973c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 0x7f973c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 -- 172.21.15.66:0/4195108556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c1a6930 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f9739d9b640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f973ad9d640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9734009230 tx=0x7f97340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f972b7fe640 1 -- 172.21.15.66:0/4195108556 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973403f030 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c1a6bc0 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f972b7fe640 1 -- 172.21.15.66:0/4195108556 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9734003ce0 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f972b7fe640 1 -- 172.21.15.66:0/4195108556 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734035070 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.317+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c1a70f0 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.320+0000 7f972b7fe640 1 -- 172.21.15.66:0/4195108556 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9734042030 con 0x7f973c106f10 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.320+0000 7f97430f1740 1 Processor -- start 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 -- start start 2024-09-15T22:52:38.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb9b40 0x55ce65eb8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce65e1e2f0 con 0x55ce65ec3370 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ce65dc5cf0 con 0x55ce65eb85d0 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f97430f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ce65e1a2b0 con 0x55ce65eb9b40 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50674/0 (socket says 172.21.15.66:50674) 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 -- 172.21.15.66:0/440992614 learned_addr learned my addr 172.21.15.66:0/440992614 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f972b7fe640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 0x7f97240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f973a59c640 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb9b40 0x55ce65eb8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f973ad9d640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 0x7f97240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 -- 172.21.15.66:0/440992614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb9b40 msgr2=0x55ce65eb8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb9b40 0x55ce65eb8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 -- 172.21.15.66:0/440992614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 msgr2=0x55ce65eb8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f9739d9b640 1 -- 172.21.15.66:0/440992614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce65daa3a0 con 0x55ce65ec3370 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.321+0000 7f972b7fe640 1 -- 172.21.15.66:0/4195108556 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f97340f09f0 con 0x7f973c106f10 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.322+0000 7f9739d9b640 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9730014bb0 tx=0x7f973000a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbe0f7306da176a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.322+0000 7f973ad9d640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 0x7f97240a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97340eddc0 tx=0x7f97340058b0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.322+0000 7f9728ff9640 1 -- 172.21.15.66:0/440992614 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973001a070 con 0x55ce65ec3370 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.322+0000 7f9728ff9640 1 -- 172.21.15.66:0/440992614 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9730014050 con 0x55ce65ec3370 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.322+0000 7f9728ff9640 1 -- 172.21.15.66:0/440992614 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973000d5f0 con 0x55ce65ec3370 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- 172.21.15.66:0/440992614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 msgr2=0x55ce65ec5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9730014bb0 tx=0x7f973000a700 comp rx=0 tx=0).stop 2024-09-15T22:52:38.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- 172.21.15.66:0/440992614 shutdown_connections 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec5760 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 --2- 172.21.15.66:0/440992614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb9b40 0x55ce65eb8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- 172.21.15.66:0/440992614 >> 172.21.15.66:0/440992614 conn(0x55ce65e81310 msgr2=0x55ce65eb4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- 172.21.15.66:0/440992614 shutdown_connections 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- 172.21.15.66:0/440992614 wait complete. 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 -- start start 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.323+0000 7f97430f1740 1 Processor -- start 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ec2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 0x55ce65ebffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce65ec6070 con 0x55ce65ec3370 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ce65dd9060 con 0x55ce65eb9b40 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ce65ec61f0 con 0x55ce65eb85d0 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f97430f1740 10 client.0 _ll_register_callbacks cb 0x55ce65b2c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50680/0 (socket says 172.21.15.66:50680) 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 -- 172.21.15.66:0/3025961896 learned_addr learned my addr 172.21.15.66:0/3025961896 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f973a59c640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 0x55ce65ebffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ec2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 -- 172.21.15.66:0/3025961896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 msgr2=0x55ce65ec2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ec2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 -- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 msgr2=0x55ce65ebffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 0x55ce65ebffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 -- 172.21.15.66:0/3025961896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce65b8f3c0 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f973a59c640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 0x55ce65ebffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9730013d90 tx=0x7f9730013c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412be923ceffd835 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.324+0000 7f9721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730024020 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f97300133f0 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9730014050 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f973001a040 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 10 client.16959 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55ce65ed1b00 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9730014050 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f973000d070 con 0x55ce65ec3370 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 10 client.16959 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 10 client.16959 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:52:38.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 20 client.16959 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65ed52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 4 client.16959 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.325+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce65e2b860 con 0x55ce65ed2f00 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.326+0000 7f973a59c640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65ed52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.326+0000 7f973a59c640 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65ed52f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1dd32757ac900d server_cookie=6ef3716aa56a0256 in_seq=0 out_seq=0 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.326+0000 7f9721ffb640 10 client.16959 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f9721ffb640 1 -- 172.21.15.66:0/3025961896 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce65e2b860 con 0x55ce65ed2f00 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f9721ffb640 10 client.16959 handle_command_reply: tid=0 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 client.16959 shutdown 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 msgr2=0x55ce65ec05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9730013d90 tx=0x7f9730013c90 comp rx=0 tx=0).stop 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 shutdown_connections 2024-09-15T22:52:38.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65ed52f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f9721ffb640 0 client.16959 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65ec3370 0x55ce65ec05d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb9b40 0x55ce65ebffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 --2- 172.21.15.66:0/3025961896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ec2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 >> 172.21.15.66:0/3025961896 conn(0x55ce65e81310 msgr2=0x55ce65eba960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 shutdown_connections 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 1 -- 172.21.15.66:0/3025961896 wait complete. 2024-09-15T22:52:38.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.327+0000 7f97430f1740 20 client.16959 trim_cache size 0 max 16384 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 Processor -- start 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 -- start start 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65ec3370 0x55ce65edaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1b14d0 con 0x55ce65eb9b40 2024-09-15T22:52:38.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1b3190 con 0x55ce65eb85d0 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f97430f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1b1ba0 con 0x55ce65ec3370 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50690/0 (socket says 172.21.15.66:50690) 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 -- 172.21.15.66:0/3958546149 learned_addr learned my addr 172.21.15.66:0/3958546149 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 -- 172.21.15.66:0/3958546149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65ec3370 msgr2=0x55ce65edaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65ec3370 0x55ce65edaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 -- 172.21.15.66:0/3958546149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 msgr2=0x55ce65eb4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.341+0000 7f973a59c640 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f973a59c640 1 -- 172.21.15.66:0/3958546149 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce65ec2950 con 0x55ce65eb9b40 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f9739d9b640 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f973a59c640 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55ce65eb5ac0 tx=0x7f972c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43244ef4fce77d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f9723fff640 1 -- 172.21.15.66:0/3958546149 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c004220 con 0x55ce65eb9b40 2024-09-15T22:52:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f9723fff640 1 -- 172.21.15.66:0/3958546149 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f972c0043c0 con 0x55ce65eb9b40 2024-09-15T22:52:38.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f9723fff640 1 -- 172.21.15.66:0/3958546149 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c003850 con 0x55ce65eb9b40 2024-09-15T22:52:38.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f97430f1740 1 -- 172.21.15.66:0/3958546149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 msgr2=0x55ce65ecf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.342+0000 7f97430f1740 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55ce65eb5ac0 tx=0x7f972c00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- 172.21.15.66:0/3958546149 shutdown_connections 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65ec3370 0x55ce65edaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecf340 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- 172.21.15.66:0/3958546149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65eb85d0 0x55ce65eb4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- 172.21.15.66:0/3958546149 >> 172.21.15.66:0/3958546149 conn(0x55ce65e81310 msgr2=0x55ce65eb4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- 172.21.15.66:0/3958546149 shutdown_connections 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- 172.21.15.66:0/3958546149 wait complete. 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- start start 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 Processor -- start 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ecb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65ec3370 0x55ce65ebc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1b2a00 con 0x55ce65eb9b40 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1b2270 con 0x55ce65ec3370 2024-09-15T22:52:38.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.343+0000 7f97430f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f973c1af4d0 con 0x55ce65eb85d0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f97430f1740 10 client.0 _ll_register_callbacks cb 0x7f972c00a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50692/0 (socket says 172.21.15.66:50692) 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 -- 172.21.15.66:0/631812104 learned_addr learned my addr 172.21.15.66:0/631812104 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9739d9b640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ecb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9739d9b640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65ec3370 0x55ce65ebc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 -- 172.21.15.66:0/631812104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 msgr2=0x55ce65ecb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ecb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 -- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65ec3370 msgr2=0x55ce65ebc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65ec3370 0x55ce65ebc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 -- 172.21.15.66:0/631812104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce65ebdf60 con 0x55ce65eb9b40 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9739d9b640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ecb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f973a59c640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f972c00af70 tx=0x7f972c004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1990ae14703e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:38.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c003a00 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f972c003ba0 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.344+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c0043c0 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f972c03e050 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 10 client.16965 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55ce65f3cec0 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f972c0043c0 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f972c004d80 con 0x55ce65eb9b40 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 10 client.16965 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 10 client.16965 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 20 client.16965 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65f3f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 4 client.16965 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:52:38.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce65e25d70 con 0x55ce65ed2f00 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.345+0000 7f9739d9b640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65f3f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f9739d9b640 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65f3f650 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69eac66bc1681276 server_cookie=25512c55d3273aca in_seq=0 out_seq=0 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f9721ffb640 10 client.16965 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f9721ffb640 1 -- 172.21.15.66:0/631812104 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce65e25d70 con 0x55ce65ed2f00 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f9721ffb640 10 client.16965 handle_command_reply: tid=0 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 client.16965 shutdown 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 msgr2=0x55ce65ecb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f972c00af70 tx=0x7f972c004930 comp rx=0 tx=0).stop 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 shutdown_connections 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ce65ed2f00 0x55ce65f3f650 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce65ec3370 0x55ce65ebc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce65eb9b40 0x55ce65ecb9f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f9721ffb640 0 client.16965 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:52:38.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 --2- 172.21.15.66:0/631812104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce65eb85d0 0x55ce65ecb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 >> 172.21.15.66:0/631812104 conn(0x55ce65e81310 msgr2=0x55ce65ebe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 shutdown_connections 2024-09-15T22:52:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 1 -- 172.21.15.66:0/631812104 wait complete. 2024-09-15T22:52:38.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.346+0000 7f97430f1740 20 client.16965 trim_cache size 0 max 16384 2024-09-15T22:52:38.353 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 msgr2=0x7f97240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 0x7f97240a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97340eddc0 tx=0x7f97340058b0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 msgr2=0x7f973c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9734009230 tx=0x7f97340042f0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 shutdown_connections 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97240a33b0 0x7f97240a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f973c106f10 0x7f973c074f70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f973c102790 0x7f973c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 --2- 172.21.15.66:0/4195108556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f973c101de0 0x7f973c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 >> 172.21.15.66:0/4195108556 conn(0x7f973c0fd8c0 msgr2=0x7f973c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:38.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 shutdown_connections 2024-09-15T22:52:38.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:38.347+0000 7f9740d18640 1 -- 172.21.15.66:0/4195108556 wait complete. 2024-09-15T22:52:39.136 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:52:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:38 smithi087 ceph-mon[35290]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 65 KiB/s wr, 23 op/s 2024-09-15T22:52:39.395 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:38 smithi184 ceph-mon[35203]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 65 KiB/s wr, 23 op/s 2024-09-15T22:52:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:38 smithi066 ceph-mon[31185]: pgmap v223: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 65 KiB/s wr, 23 op/s 2024-09-15T22:52:39.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/1302161521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48100e20 msgr2=0x7f5f48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/1302161521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48100e20 0x7f5f48101200 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009900 tx=0x7f5f4002a480 comp rx=0 tx=0).stop 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/1302161521 shutdown_connections 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/1302161521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/1302161521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48102570 0x7f5f481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/1302161521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48100e20 0x7f5f48101200 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.851+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/1302161521 >> 172.21.15.66:0/1302161521 conn(0x7f5f480fc7d0 msgr2=0x7f5f480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.852+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/1302161521 shutdown_connections 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.852+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/1302161521 wait complete. 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.852+0000 7f5f4d3bc640 1 Processor -- start 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.852+0000 7f5f4d3bc640 1 -- start start 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48100e20 0x7f5f48198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481120a0 con 0x7f5f48102570 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48111f20 con 0x7f5f48102ef0 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48112220 con 0x7f5f48100e20 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50706/0 (socket says 172.21.15.66:50706) 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 -- 172.21.15.66:0/2868914185 learned_addr learned my addr 172.21.15.66:0/2868914185 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48100e20 0x7f5f48198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f477fe640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 -- 172.21.15.66:0/2868914185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48100e20 msgr2=0x7f5f48198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48100e20 0x7f5f48198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 -- 172.21.15.66:0/2868914185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 msgr2=0x7f5f4819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 -- 172.21.15.66:0/2868914185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4819d430 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f477fe640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f467fc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000c890 tx=0x7f5f3000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f3ffff640 1 -- 172.21.15.66:0/2868914185 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30004220 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f3ffff640 1 -- 172.21.15.66:0/2868914185 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f300043c0 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4819d720 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f3ffff640 1 -- 172.21.15.66:0/2868914185 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f300049e0 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.853+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a5000 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.856+0000 7f5f3ffff640 1 -- 172.21.15.66:0/2868914185 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5f30004c40 con 0x7f5f48102570 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 Processor -- start 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 -- start start 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e612ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5574e60922f0 con 0x5574e6137370 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5574e6039cf0 con 0x5574e612c5d0 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f4f795740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5574e608e2b0 con 0x5574e612db40 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f3ffff640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 0x7f5f340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50712/0 (socket says 172.21.15.66:50712) 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f477fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.857+0000 7f5f467fc640 1 -- 172.21.15.66:0/1013385816 learned_addr learned my addr 172.21.15.66:0/1013385816 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f477fe640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 0x7f5f340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e612ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f3ffff640 1 -- 172.21.15.66:0/2868914185 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f5f300cfe70 con 0x7f5f48102570 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 -- 172.21.15.66:0/1013385816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 msgr2=0x5574e612c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 -- 172.21.15.66:0/1013385816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 msgr2=0x5574e612ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e612ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 -- 172.21.15.66:0/1013385816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e601e3a0 con 0x5574e6137370 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e612ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f477fe640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f477fe640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 0x7f5f340a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005fd0 tx=0x7f5f38005f40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001a000 tx=0x7f5f300054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46626f8bb789ef9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f3d7fa640 1 -- 172.21.15.66:0/1013385816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3001d070 con 0x5574e6137370 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f3d7fa640 1 -- 172.21.15.66:0/1013385816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f3009c420 con 0x5574e6137370 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.858+0000 7f5f3d7fa640 1 -- 172.21.15.66:0/1013385816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f300cd410 con 0x5574e6137370 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- 172.21.15.66:0/1013385816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 msgr2=0x5574e6139760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001a000 tx=0x7f5f300054a0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- 172.21.15.66:0/1013385816 shutdown_connections 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6139760 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e612ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1013385816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- 172.21.15.66:0/1013385816 >> 172.21.15.66:0/1013385816 conn(0x5574e60f5310 msgr2=0x5574e6128c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- 172.21.15.66:0/1013385816 shutdown_connections 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- 172.21.15.66:0/1013385816 wait complete. 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.859+0000 7f5f4f795740 1 -- start start 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 Processor -- start 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e6137370 0x5574e61347f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5574e613a010 con 0x5574e612db40 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5574e604d060 con 0x5574e6137370 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5574e613a190 con 0x5574e612c5d0 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f4f795740 10 client.0 _ll_register_callbacks cb 0x5574e5da08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:39.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50726/0 (socket says 172.21.15.66:50726) 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 -- 172.21.15.66:0/1015598119 learned_addr learned my addr 172.21.15.66:0/1015598119 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f477fe640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e6137370 0x5574e61347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 -- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 msgr2=0x5574e6136db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 -- 172.21.15.66:0/1015598119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e6137370 msgr2=0x5574e61347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e6137370 0x5574e61347f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 -- 172.21.15.66:0/1015598119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e5e033c0 con 0x5574e612db40 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f467fc640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5f3009ba20 tx=0x7f5f300a00d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69ff2d6a383c49d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.860+0000 7f5f2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3007e020 con 0x5574e612db40 2024-09-15T22:52:39.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f3009c420 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f5f30098390 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5f3001d040 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 10 client.16977 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5574e6145b00 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f3009c420 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f5f300ba530 con 0x5574e612db40 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 10 client.16977 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 10 client.16977 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 20 client.16977 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e6146e50 0x5574e6149240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 4 client.16977 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.861+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574e609f860 con 0x5574e6146e50 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.862+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e6146e50 0x5574e6149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.862+0000 7f5f2e7fc640 10 client.16977 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:52:39.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.862+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e6146e50 0x5574e6149240 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d70f4fbf00476c1 server_cookie=4c3575036255f248 in_seq=0 out_seq=0 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/1015598119 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574e609f860 con 0x5574e6146e50 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f2e7fc640 10 client.16977 handle_command_reply: tid=0 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 client.16977 shutdown 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 msgr2=0x5574e6134060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5f3009ba20 tx=0x7f5f300a00d0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 shutdown_connections 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e6146e50 0x5574e6149240 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e6137370 0x5574e61347f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e612db40 0x5574e6134060 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f2e7fc640 0 client.16977 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 --2- 172.21.15.66:0/1015598119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 >> 172.21.15.66:0/1015598119 conn(0x5574e60f5310 msgr2=0x5574e612e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 shutdown_connections 2024-09-15T22:52:39.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 1 -- 172.21.15.66:0/1015598119 wait complete. 2024-09-15T22:52:39.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.863+0000 7f5f4f795740 20 client.16977 trim_cache size 0 max 16384 2024-09-15T22:52:39.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.876+0000 7f5f4f795740 1 Processor -- start 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.876+0000 7f5f4f795740 1 -- start start 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481af1d0 con 0x5574e6137370 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481b0e90 con 0x5574e612c5d0 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f4f795740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481af8a0 con 0x5574e612db40 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50738/0 (socket says 172.21.15.66:50738) 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 -- 172.21.15.66:0/846178918 learned_addr learned my addr 172.21.15.66:0/846178918 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f467fc640 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 -- 172.21.15.66:0/846178918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 msgr2=0x5574e612f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 -- 172.21.15.66:0/846178918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 msgr2=0x5574e6136db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 -- 172.21.15.66:0/846178918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e61325d0 con 0x5574e6137370 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f477fe640 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800a8c0 tx=0x7f5f3800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87934aba8fd36005 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.877+0000 7f5f3cff9640 1 -- 172.21.15.66:0/846178918 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800fe90 con 0x5574e6137370 2024-09-15T22:52:39.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f3cff9640 1 -- 172.21.15.66:0/846178918 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f38005020 con 0x5574e6137370 2024-09-15T22:52:39.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f3cff9640 1 -- 172.21.15.66:0/846178918 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38028690 con 0x5574e6137370 2024-09-15T22:52:39.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 -- 172.21.15.66:0/846178918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 msgr2=0x5574e612f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800a8c0 tx=0x7f5f3800a640 comp rx=0 tx=0).stop 2024-09-15T22:52:39.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 -- 172.21.15.66:0/846178918 shutdown_connections 2024-09-15T22:52:39.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e612f660 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612db40 0x5574e612f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 --2- 172.21.15.66:0/846178918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612c5d0 0x5574e6136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 -- 172.21.15.66:0/846178918 >> 172.21.15.66:0/846178918 conn(0x5574e60f5310 msgr2=0x5574e6123a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 -- 172.21.15.66:0/846178918 shutdown_connections 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.878+0000 7f5f4f795740 1 -- 172.21.15.66:0/846178918 wait complete. 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 -- start start 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 Processor -- start 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e613fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612db40 0x5574e6130f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481b0700 con 0x5574e6137370 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481aff70 con 0x5574e612db40 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f481ad1d0 con 0x5574e612c5d0 2024-09-15T22:52:39.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f4f795740 10 client.0 _ll_register_callbacks cb 0x7f5f3800add0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50742/0 (socket says 172.21.15.66:50742) 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f477fe640 1 -- 172.21.15.66:0/985316945 learned_addr learned my addr 172.21.15.66:0/985316945 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.879+0000 7f5f467fc640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612db40 0x5574e6130f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e613fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 -- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 msgr2=0x5574e613fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e613fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 -- 172.21.15.66:0/985316945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612db40 msgr2=0x5574e6130f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612db40 0x5574e6130f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 -- 172.21.15.66:0/985316945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e61b4bf0 con 0x5574e6137370 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f477fe640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005a20 tx=0x7f5f3800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedbab641437d01c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004e50 con 0x5574e6137370 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f38005020 con 0x5574e6137370 2024-09-15T22:52:39.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f5f380051d0 con 0x5574e6137370 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5f3803e050 con 0x5574e6137370 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f4f795740 10 client.16983 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.880+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5574e61b5d90 con 0x5574e6137370 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f38005020 con 0x5574e6137370 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f5f38028910 con 0x5574e6137370 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 10 client.16983 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 10 client.16983 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 20 client.16983 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e61b6510 0x5574e61b8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 4 client.16983 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574e6099d70 con 0x5574e61b6510 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e61b6510 0x5574e61b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f46ffd640 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e61b6510 0x5574e61b8930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a8fcb072276981a server_cookie=7473d6c0f062967c in_seq=0 out_seq=0 2024-09-15T22:52:39.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.881+0000 7f5f2e7fc640 10 client.16983 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f2e7fc640 1 -- 172.21.15.66:0/985316945 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574e6099d70 con 0x5574e61b6510 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f2e7fc640 10 client.16983 handle_command_reply: tid=0 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 client.16983 shutdown 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 msgr2=0x5574e6131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005a20 tx=0x7f5f3800fec0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 shutdown_connections 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5574e61b6510 0x5574e61b8930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5574e6137370 0x5574e6131670 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574e612db40 0x5574e6130f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f2e7fc640 0 client.16983 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 --2- 172.21.15.66:0/985316945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5574e612c5d0 0x5574e613fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 >> 172.21.15.66:0/985316945 conn(0x5574e60f5310 msgr2=0x5574e61274e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 shutdown_connections 2024-09-15T22:52:39.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 1 -- 172.21.15.66:0/985316945 wait complete. 2024-09-15T22:52:39.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.882+0000 7f5f4f795740 20 client.16983 trim_cache size 0 max 16384 2024-09-15T22:52:39.889 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:52:39.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 msgr2=0x7f5f340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 0x7f5f340a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005fd0 tx=0x7f5f38005f40 comp rx=0 tx=0).stop 2024-09-15T22:52:39.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 msgr2=0x7f5f481989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000c890 tx=0x7f5f3000cd50 comp rx=0 tx=0).stop 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 shutdown_connections 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5f340a33b0 0x7f5f340a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f48102ef0 0x7f5f4819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f48102570 0x7f5f481989c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 --2- 172.21.15.66:0/2868914185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f48100e20 0x7f5f48198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 >> 172.21.15.66:0/2868914185 conn(0x7f5f480fc7d0 msgr2=0x7f5f480fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 shutdown_connections 2024-09-15T22:52:39.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:39.883+0000 7f5f4d3bc640 1 -- 172.21.15.66:0/2868914185 wait complete. 2024-09-15T22:52:40.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:52:40.854 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:41.244 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:40 smithi066 ceph-mon[31185]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 23 op/s 2024-09-15T22:52:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:40 smithi087 ceph-mon[35290]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 23 op/s 2024-09-15T22:52:41.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 -- 172.21.15.66:0/2618230890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec100e20 msgr2=0x7f69ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 --2- 172.21.15.66:0/2618230890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec100e20 0x7f69ec101200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e802a480 comp rx=0 tx=0).stop 2024-09-15T22:52:41.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 -- 172.21.15.66:0/2618230890 shutdown_connections 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 --2- 172.21.15.66:0/2618230890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec102ef0 0x7f69ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 --2- 172.21.15.66:0/2618230890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102570 0x7f69ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 --2- 172.21.15.66:0/2618230890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec100e20 0x7f69ec101200 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 -- 172.21.15.66:0/2618230890 >> 172.21.15.66:0/2618230890 conn(0x7f69ec0fc7d0 msgr2=0x7f69ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 -- 172.21.15.66:0/2618230890 shutdown_connections 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.329+0000 7f69f42b8640 1 -- 172.21.15.66:0/2618230890 wait complete. 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 Processor -- start 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 -- start start 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec100e20 0x7f69ec198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102ef0 0x7f69ec19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec110f80 con 0x7f69ec102570 2024-09-15T22:52:41.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec110e00 con 0x7f69ec100e20 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f42b8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec111100 con 0x7f69ec102ef0 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50762/0 (socket says 172.21.15.66:50762) 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 -- 172.21.15.66:0/1424609265 learned_addr learned my addr 172.21.15.66:0/1424609265 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f2054640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec100e20 0x7f69ec198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f2855640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102ef0 0x7f69ec19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 -- 172.21.15.66:0/1424609265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102ef0 msgr2=0x7f69ec19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102ef0 0x7f69ec19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 -- 172.21.15.66:0/1424609265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec100e20 msgr2=0x7f69ec198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec100e20 0x7f69ec198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.330+0000 7f69f1853640 1 -- 172.21.15.66:0/1424609265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec19d4b0 con 0x7f69ec102570 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69f1853640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00d950 tx=0x7f69dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69e37fe640 1 -- 172.21.15.66:0/1424609265 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc017070 con 0x7f69ec102570 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69e37fe640 1 -- 172.21.15.66:0/1424609265 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69dc009c30 con 0x7f69ec102570 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69e37fe640 1 -- 172.21.15.66:0/1424609265 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00f6b0 con 0x7f69ec102570 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec19d7a0 con 0x7f69ec102570 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.331+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec1a5080 con 0x7f69ec102570 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 Processor -- start 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 -- start start 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bbd341d2f0 con 0x55bbd34b75d0 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bbd33c4cf0 con 0x55bbd34b8b40 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f6691740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bbd34192b0 con 0x55bbd34c6780 2024-09-15T22:52:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50778/0 (socket says 172.21.15.66:50778) 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 -- 172.21.15.66:0/4064982249 learned_addr learned my addr 172.21.15.66:0/4064982249 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2855640 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 -- 172.21.15.66:0/4064982249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 msgr2=0x55bbd34c8b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c8b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 -- 172.21.15.66:0/4064982249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 msgr2=0x55bbd34b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.334+0000 7f69f2054640 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69f2054640 1 -- 172.21.15.66:0/4064982249 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd33a93a0 con 0x55bbd34b75d0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69e37fe640 1 -- 172.21.15.66:0/1424609265 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f69dc0109d0 con 0x7f69ec102570 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69f2054640 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f69e802a9a0 tx=0x7f69e8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edce6fdc60edf14e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69e0dea640 1 -- 172.21.15.66:0/4064982249 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8035030 con 0x55bbd34b75d0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69e0dea640 1 -- 172.21.15.66:0/4064982249 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8040070 con 0x55bbd34b75d0 2024-09-15T22:52:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69e0dea640 1 -- 172.21.15.66:0/4064982249 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8031960 con 0x55bbd34b75d0 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.335+0000 7f69e37fe640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 0x7f69d80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f2855640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 0x7f69d80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69e37fe640 1 -- 172.21.15.66:0/1424609265 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f69dc0cfcf0 con 0x7f69ec102570 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- 172.21.15.66:0/4064982249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 msgr2=0x55bbd34b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f69e802a9a0 tx=0x7f69e8005e80 comp rx=0 tx=0).stop 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- 172.21.15.66:0/4064982249 shutdown_connections 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b7a10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 --2- 172.21.15.66:0/4064982249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- 172.21.15.66:0/4064982249 >> 172.21.15.66:0/4064982249 conn(0x55bbd3480310 msgr2=0x55bbd34b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f2855640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 0x7f69d80a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e4009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- 172.21.15.66:0/4064982249 shutdown_connections 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- 172.21.15.66:0/4064982249 wait complete. 2024-09-15T22:52:41.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 -- start start 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.336+0000 7f69f6691740 1 Processor -- start 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bbd34c9420 con 0x55bbd34b75d0 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bbd33d8060 con 0x55bbd34b8b40 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bbd34c95a0 con 0x55bbd34c6780 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f6691740 10 client.0 _ll_register_callbacks cb 0x55bbd312b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50780/0 (socket says 172.21.15.66:50780) 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f2054640 1 -- 172.21.15.66:0/1419652565 learned_addr learned my addr 172.21.15.66:0/1419652565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:41.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f2855640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 -- 172.21.15.66:0/1419652565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 msgr2=0x55bbd34c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 -- 172.21.15.66:0/1419652565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 msgr2=0x55bbd34c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 -- 172.21.15.66:0/1419652565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd318e3c0 con 0x55bbd34b8b40 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69f1853640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34c3490 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0ccfb0 tx=0x7f69dc09b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98a05bf22da27e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.337+0000 7f69d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc020040 con 0x55bbd34b8b40 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f69dc0860d0 con 0x55bbd34b8b40 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e8040070 con 0x55bbd34b8b40 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f69dc09fef0 con 0x55bbd34b8b40 2024-09-15T22:52:41.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 10 client.26492 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55bbd34d4f70 con 0x55bbd34b8b40 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8040070 con 0x55bbd34b8b40 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f69dc09aab0 con 0x55bbd34b8b40 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 10 client.26492 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 10 client.26492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 20 client.26492 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd34d6500 0x55bbd34d8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 4 client.26492 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.338+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbd342a860 con 0x55bbd34d6500 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.339+0000 7f69f2054640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd34d6500 0x55bbd34d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.339+0000 7f69f2054640 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd34d6500 0x55bbd34d8920 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1febc12d5e00820c server_cookie=c20d5b5f6da15dff in_seq=0 out_seq=0 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.339+0000 7f69d5ffb640 10 client.26492 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69d5ffb640 1 -- 172.21.15.66:0/1419652565 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbd342a860 con 0x55bbd34d6500 2024-09-15T22:52:41.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69d5ffb640 10 client.26492 handle_command_reply: tid=0 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 client.26492 shutdown 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 msgr2=0x55bbd34c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34c3490 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0ccfb0 tx=0x7f69dc09b550 comp rx=0 tx=0).stop 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 shutdown_connections 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd34d6500 0x55bbd34d8920 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34c3490 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 --2- 172.21.15.66:0/1419652565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69d5ffb640 0 client.26492 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 >> 172.21.15.66:0/1419652565 conn(0x55bbd3480310 msgr2=0x55bbd34b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 shutdown_connections 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 1 -- 172.21.15.66:0/1419652565 wait complete. 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.340+0000 7f69f6691740 20 client.26492 trim_cache size 0 max 16384 2024-09-15T22:52:41.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 Processor -- start 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 -- start start 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1acfb0 con 0x55bbd34b75d0 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1aec70 con 0x55bbd34b8b40 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.353+0000 7f69f6691740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1ad680 con 0x55bbd34c6780 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50782/0 (socket says 172.21.15.66:50782) 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 -- 172.21.15.66:0/581151409 learned_addr learned my addr 172.21.15.66:0/581151409 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f1853640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2855640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 -- 172.21.15.66:0/581151409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 msgr2=0x55bbd34b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 -- 172.21.15.66:0/581151409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 msgr2=0x55bbd34b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 -- 172.21.15.66:0/581151409 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd34b4180 con 0x55bbd34b75d0 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f1853640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69f2054640 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f69e8004010 tx=0x7f69e8004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d85cdb1e0f0e192 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69d7fff640 1 -- 172.21.15.66:0/581151409 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8053020 con 0x55bbd34b75d0 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69d7fff640 1 -- 172.21.15.66:0/581151409 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8040070 con 0x55bbd34b75d0 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.354+0000 7f69d7fff640 1 -- 172.21.15.66:0/581151409 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8035040 con 0x55bbd34b75d0 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- 172.21.15.66:0/581151409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 msgr2=0x55bbd34b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f69e8004010 tx=0x7f69e8004550 comp rx=0 tx=0).stop 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- 172.21.15.66:0/581151409 shutdown_connections 2024-09-15T22:52:41.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34c6780 0x55bbd34b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b8b40 0x55bbd34b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 --2- 172.21.15.66:0/581151409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34b75d0 0x55bbd34b8300 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- 172.21.15.66:0/581151409 >> 172.21.15.66:0/581151409 conn(0x55bbd3480310 msgr2=0x55bbd34aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- 172.21.15.66:0/581151409 shutdown_connections 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- 172.21.15.66:0/581151409 wait complete. 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.355+0000 7f69f6691740 1 -- start start 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 Processor -- start 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 0x55bbd34cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 0x55bbd34c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1ae4e0 con 0x55bbd34c6780 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1add50 con 0x55bbd34b75d0 2024-09-15T22:52:41.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1aafb0 con 0x55bbd34b8b40 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f6691740 10 client.0 _ll_register_callbacks cb 0x7f69dc00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f1853640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 0x55bbd34c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50794/0 (socket says 172.21.15.66:50794) 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 -- 172.21.15.66:0/135437559 learned_addr learned my addr 172.21.15.66:0/135437559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2054640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 0x55bbd34cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 -- 172.21.15.66:0/135437559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 msgr2=0x55bbd34c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 0x55bbd34c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 -- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 msgr2=0x55bbd34cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 0x55bbd34cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2855640 1 -- 172.21.15.66:0/135437559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd34c0d50 con 0x55bbd34c6780 2024-09-15T22:52:41.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f1853640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 0x55bbd34c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.356+0000 7f69f2054640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 0x55bbd34cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f2855640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f69e4004240 tx=0x7f69e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94caf31add3b3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400fc70 con 0x55bbd34c6780 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f69e4004b20 con 0x55bbd34c6780 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e8040070 con 0x55bbd34c6780 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f69e4034050 con 0x55bbd34c6780 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 10 client.17001 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:41.384 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55bbd35411a0 con 0x55bbd34c6780 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8040070 con 0x55bbd34c6780 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f69e4005800 con 0x55bbd34c6780 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 10 client.17001 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 20 client.17001 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd35419d0 0x55bbd3543df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 4 client.17001 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:52:41.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.357+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbd3424d70 con 0x55bbd35419d0 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f2054640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd35419d0 0x55bbd3543df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f2054640 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd35419d0 0x55bbd3543df0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e568616ebc74f5 server_cookie=4ca35ca4bfa24a42 in_seq=0 out_seq=0 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69d5ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69d5ffb640 1 -- 172.21.15.66:0/135437559 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbd3424d70 con 0x55bbd35419d0 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69d5ffb640 10 client.17001 handle_command_reply: tid=0 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 client.17001 shutdown 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 msgr2=0x55bbd34c0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f69e4004240 tx=0x7f69e4004a40 comp rx=0 tx=0).stop 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 shutdown_connections 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd34c6780 0x55bbd34c0640 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bbd34b8b40 0x55bbd34c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bbd35419d0 0x55bbd3543df0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69d5ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 --2- 172.21.15.66:0/135437559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbd34b75d0 0x55bbd34cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 >> 172.21.15.66:0/135437559 conn(0x55bbd3480310 msgr2=0x55bbd34b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.358+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 shutdown_connections 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f6691740 1 -- 172.21.15.66:0/135437559 wait complete. 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f6691740 20 client.17001 trim_cache size 0 max 16384 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 msgr2=0x7f69d80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 0x7f69d80a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e4009500 comp rx=0 tx=0).stop 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 msgr2=0x7f69ec198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00d950 tx=0x7f69dc00de10 comp rx=0 tx=0).stop 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 shutdown_connections 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f69d80a3430 0x7f69d80a58f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69ec102ef0 0x7f69ec19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec102570 0x7f69ec198a40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 --2- 172.21.15.66:0/1424609265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69ec100e20 0x7f69ec198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 >> 172.21.15.66:0/1424609265 conn(0x7f69ec0fc7d0 msgr2=0x7f69ec06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 shutdown_connections 2024-09-15T22:52:41.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:41.359+0000 7f69f42b8640 1 -- 172.21.15.66:0/1424609265 wait complete. 2024-09-15T22:52:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:40 smithi184 ceph-mon[35203]: pgmap v224: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 23 op/s 2024-09-15T22:52:42.252 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:41 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:52:42.252 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:41 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:52:42.252 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:41 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:52:42.252 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:41 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:52:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:41 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:52:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:41 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:52:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:41 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:52:42.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:41 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:52:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:41 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:52:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:41 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:52:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:41 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:52:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:41 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:52:43.282 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:52:43.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:52:43.311 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:42 smithi066 ceph-mon[31185]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 21 op/s 2024-09-15T22:52:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:42 smithi087 ceph-mon[35290]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 21 op/s 2024-09-15T22:52:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:42 smithi184 ceph-mon[35203]: pgmap v225: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 21 op/s 2024-09-15T22:52:43.553 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 -- 172.21.15.66:0/3750613155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8101de0 msgr2=0x7f79e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 --2- 172.21.15.66:0/3750613155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8101de0 0x7f79e81021c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d802a410 comp rx=0 tx=0).stop 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 -- 172.21.15.66:0/3750613155 shutdown_connections 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 --2- 172.21.15.66:0/3750613155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8106f10 0x7f79e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 --2- 172.21.15.66:0/3750613155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8102790 0x7f79e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 --2- 172.21.15.66:0/3750613155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8101de0 0x7f79e81021c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 -- 172.21.15.66:0/3750613155 >> 172.21.15.66:0/3750613155 conn(0x7f79e80fd8c0 msgr2=0x7f79e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.017+0000 7f79ede19640 1 -- 172.21.15.66:0/3750613155 shutdown_connections 2024-09-15T22:52:44.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.018+0000 7f79ede19640 1 -- 172.21.15.66:0/3750613155 wait complete. 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.018+0000 7f79ede19640 1 Processor -- start 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.018+0000 7f79ede19640 1 -- start start 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.018+0000 7f79ede19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8101de0 0x7f79e8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8106f10 0x7f79e819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8111f30 con 0x7f79e8102790 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8111db0 con 0x7f79e8101de0 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81120b0 con 0x7f79e8106f10 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33356/0 (socket says 172.21.15.66:33356) 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 -- 172.21.15.66:0/1887795252 learned_addr learned my addr 172.21.15.66:0/1887795252 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8101de0 0x7f79e8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8106f10 0x7f79e819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 -- 172.21.15.66:0/1887795252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8106f10 msgr2=0x7f79e819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8106f10 0x7f79e819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 -- 172.21.15.66:0/1887795252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8101de0 msgr2=0x7f79e8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8101de0 0x7f79e8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 -- 172.21.15.66:0/1887795252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e819d340 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79dffff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c920 tx=0x7f79d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79e57fa640 1 -- 172.21.15.66:0/1887795252 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0007c70 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79e57fa640 1 -- 172.21.15.66:0/1887795252 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d0007e10 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79e57fa640 1 -- 172.21.15.66:0/1887795252 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0018890 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e819d630 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.019+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81a4f10 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79e57fa640 1 -- 172.21.15.66:0/1887795252 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f79d0018a70 con 0x7f79e8102790 2024-09-15T22:52:44.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 Processor -- start 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 -- start start 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017da2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017dad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564017d08280 con 0x564017dadd40 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564017cafb10 con 0x564017da3480 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79f01f2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564017d04240 con 0x564017da2b60 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.022+0000 7f79dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e57fa640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 0x7f79d40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33362/0 (socket says 172.21.15.66:33362) 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 -- 172.21.15.66:0/917653623 learned_addr learned my addr 172.21.15.66:0/917653623 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e7fff640 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017da2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e77fe640 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017dad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 0x7f79d40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e57fa640 1 -- 172.21.15.66:0/1887795252 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f79d00d0380 con 0x7f79e8102790 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 -- 172.21.15.66:0/917653623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 msgr2=0x564017da2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017da2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 -- 172.21.15.66:0/917653623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 msgr2=0x564017dad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017dad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 -- 172.21.15.66:0/917653623 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564017cbc1f0 con 0x564017dadd40 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79dffff640 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f79d009bed0 tx=0x7f79d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643dda6fa0a9e1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 0x7f79d40a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79e0005c40 tx=0x7f79e0009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79ddffb640 1 -- 172.21.15.66:0/917653623 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d00d0160 con 0x564017dadd40 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79ddffb640 1 -- 172.21.15.66:0/917653623 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d009c1d0 con 0x564017dadd40 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.023+0000 7f79ddffb640 1 -- 172.21.15.66:0/917653623 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d000fc50 con 0x564017dadd40 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 -- 172.21.15.66:0/917653623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 msgr2=0x564017db0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f79d009bed0 tx=0x7f79d0000bc0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 -- 172.21.15.66:0/917653623 shutdown_connections 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017db0130 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017dad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 --2- 172.21.15.66:0/917653623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017da2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 -- 172.21.15.66:0/917653623 >> 172.21.15.66:0/917653623 conn(0x564017d9f0f0 msgr2=0x564017d9f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 -- 172.21.15.66:0/917653623 shutdown_connections 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.024+0000 7f79f01f2740 1 -- 172.21.15.66:0/917653623 wait complete. 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 -- start start 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 Processor -- start 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017dab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564017db0910 con 0x564017da2b60 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564017cc2f10 con 0x564017dadd40 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564017db0a90 con 0x564017da3480 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79f01f2740 10 client.0 _ll_register_callbacks cb 0x564017c8ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33366/0 (socket says 172.21.15.66:33366) 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79e77fe640 1 -- 172.21.15.66:0/2059745874 learned_addr learned my addr 172.21.15.66:0/2059745874 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79e7fff640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017dab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.025+0000 7f79dffff640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 -- 172.21.15.66:0/2059745874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 msgr2=0x564017dab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 -- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 msgr2=0x564017dab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017dab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 -- 172.21.15.66:0/2059745874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564017a796a0 con 0x564017da2b60 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79dffff640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79e77fe640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d80319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874838b60fe7dceb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8035040 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f79d8004460 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d009c1d0 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f79d804d050 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79f01f2740 10 client.17013 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x564017dbc5c0 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.026+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d009c1d0 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f79d8004be0 con 0x564017da2b60 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 10 client.17013 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 20 client.17013 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017dbdb20 0x564017dbff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 4 client.17013 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564017d157f0 con 0x564017dbdb20 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79dffff640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017dbdb20 0x564017dbff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79dffff640 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017dbdb20 0x564017dbff30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6efe3bb032045d server_cookie=5da765a8bb6a4484 in_seq=0 out_seq=0 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.027+0000 7f79c6ffd640 10 client.17013 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.028+0000 7f79c6ffd640 1 -- 172.21.15.66:0/2059745874 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564017d157f0 con 0x564017dbdb20 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.028+0000 7f79c6ffd640 10 client.17013 handle_command_reply: tid=0 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.028+0000 7f79f01f2740 1 client.17013 shutdown 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.028+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 msgr2=0x564017daacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.028+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d80319b0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 shutdown_connections 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017dbdb20 0x564017dbff30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017dab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79c6ffd640 0 client.17013 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 --2- 172.21.15.66:0/2059745874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017daacc0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 >> 172.21.15.66:0/2059745874 conn(0x564017d9f0f0 msgr2=0x564017d9e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 shutdown_connections 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 1 -- 172.21.15.66:0/2059745874 wait complete. 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.029+0000 7f79f01f2740 20 client.17013 trim_cache size 0 max 16384 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.046+0000 7f79f01f2740 1 Processor -- start 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.046+0000 7f79f01f2740 1 -- start start 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dc5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017da7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81af1c0 con 0x564017da2b60 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81b0e80 con 0x564017dadd40 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79f01f2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81af890 con 0x564017da3480 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33368/0 (socket says 172.21.15.66:33368) 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 -- 172.21.15.66:0/1037399262 learned_addr learned my addr 172.21.15.66:0/1037399262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017da7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79dffff640 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dc5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 -- 172.21.15.66:0/1037399262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 msgr2=0x564017dc5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dc5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 -- 172.21.15.66:0/1037399262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 msgr2=0x564017da7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017da7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 -- 172.21.15.66:0/1037399262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564017d99680 con 0x564017da2b60 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.047+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f79d8006010 tx=0x7f79d8031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6ce56824e24ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79dd7fa640 1 -- 172.21.15.66:0/1037399262 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8056070 con 0x564017da2b60 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79dd7fa640 1 -- 172.21.15.66:0/1037399262 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8040070 con 0x564017da2b60 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79dd7fa640 1 -- 172.21.15.66:0/1037399262 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8035050 con 0x564017da2b60 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 -- 172.21.15.66:0/1037399262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 msgr2=0x564017dc5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f79d8006010 tx=0x7f79d8031490 comp rx=0 tx=0).stop 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 -- 172.21.15.66:0/1037399262 shutdown_connections 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017dadd40 0x564017da7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da3480 0x564017dc5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1037399262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017da2b60 0x564017dc5840 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 -- 172.21.15.66:0/1037399262 >> 172.21.15.66:0/1037399262 conn(0x564017d9f0f0 msgr2=0x564017dacc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 -- 172.21.15.66:0/1037399262 shutdown_connections 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.048+0000 7f79f01f2740 1 -- 172.21.15.66:0/1037399262 wait complete. 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 -- start start 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 Processor -- start 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017db2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017db2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81b06f0 con 0x564017dadd40 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81aff60 con 0x564017da3480 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81ad1c0 con 0x564017da2b60 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79f01f2740 10 client.0 _ll_register_callbacks cb 0x7f79d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33384/0 (socket says 172.21.15.66:33384) 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.049+0000 7f79e7fff640 1 -- 172.21.15.66:0/1686913912 learned_addr learned my addr 172.21.15.66:0/1686913912 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017db2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79dffff640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017db2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 -- 172.21.15.66:0/1686913912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 msgr2=0x564017db2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017db2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 -- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 msgr2=0x564017db2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017db2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 -- 172.21.15.66:0/1686913912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564017e27e50 con 0x564017dadd40 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79dffff640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017db2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79e7fff640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f79e0003e70 tx=0x7f79e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4508b46768d6282e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:44.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000de80 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7f79e0009040 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d8040070 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f79e0035050 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79f01f2740 10 client.17019 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.050+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x564017e29150 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8040070 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f79e002b030 con 0x564017dadd40 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 10 client.17019 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 20 client.17019 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017e29990 0x564017e2bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 4 client.17019 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564017d0fd00 con 0x564017e29990 2024-09-15T22:52:44.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.051+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017e29990 0x564017e2bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.052+0000 7f79e77fe640 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017e29990 0x564017e2bdb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf381356981e3f8c server_cookie=6f3501fb4557ff84 in_seq=0 out_seq=0 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.052+0000 7f79c6ffd640 10 client.17019 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.052+0000 7f79c6ffd640 1 -- 172.21.15.66:0/1686913912 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564017d0fd00 con 0x564017e29990 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.052+0000 7f79c6ffd640 10 client.17019 handle_command_reply: tid=0 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 client.17019 shutdown 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 msgr2=0x564017e27810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f79e0003e70 tx=0x7f79e0004a40 comp rx=0 tx=0).stop 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 shutdown_connections 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564017dadd40 0x564017e27810 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564017e29990 0x564017e2bdb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564017da3480 0x564017db2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 --2- 172.21.15.66:0/1686913912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564017da2b60 0x564017db2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 >> 172.21.15.66:0/1686913912 conn(0x564017d9f0f0 msgr2=0x564017dac300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79c6ffd640 0 client.17019 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 shutdown_connections 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 1 -- 172.21.15.66:0/1686913912 wait complete. 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.053+0000 7f79f01f2740 20 client.17019 trim_cache size 0 max 16384 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "bd4707db-ec0e-421c-89fd-56679e6f3512", 2024-09-15T22:52:44.061 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 msgr2=0x7f79d40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 0x7f79d40a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f79e0005c40 tx=0x7f79e0009500 comp rx=0 tx=0).stop 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 msgr2=0x7f79e81988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f79d000c920 tx=0x7f79d000cde0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 shutdown_connections 2024-09-15T22:52:44.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79d40a3430 0x7f79d40a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e8106f10 0x7f79e819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e8102790 0x7f79e81988d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 --2- 172.21.15.66:0/1887795252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e8101de0 0x7f79e8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 >> 172.21.15.66:0/1887795252 conn(0x7f79e80fd8c0 msgr2=0x7f79e80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 shutdown_connections 2024-09-15T22:52:44.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:44.054+0000 7f79ede19640 1 -- 172.21.15.66:0/1887795252 wait complete. 2024-09-15T22:52:44.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:52:45.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:44 smithi066 ceph-mon[31185]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-15T22:52:45.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:44 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:52:45.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:44 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:52:45.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:44 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:52:45.200 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:44 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:52:45.212 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:52:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:44 smithi087 ceph-mon[35290]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-15T22:52:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:44 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:52:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:44 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:52:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:44 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:52:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:44 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:52:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:44 smithi184 ceph-mon[35203]: pgmap v226: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-15T22:52:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:44 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:52:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:44 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:52:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:44 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:52:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:44 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:52:45.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.762+0000 7fc3afb53640 1 -- 172.21.15.66:0/3527107457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 msgr2=0x7fc3a810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.762+0000 7fc3afb53640 1 --2- 172.21.15.66:0/3527107457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a810d960 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009cd0 tx=0x7fc3a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.762+0000 7fc3afb53640 1 -- 172.21.15.66:0/3527107457 shutdown_connections 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 --2- 172.21.15.66:0/3527107457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a810d960 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 --2- 172.21.15.66:0/3527107457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8100a90 0x7fc3a8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 --2- 172.21.15.66:0/3527107457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8106a90 0x7fc3a8106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 -- 172.21.15.66:0/3527107457 >> 172.21.15.66:0/3527107457 conn(0x7fc3a80fc7d0 msgr2=0x7fc3a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 -- 172.21.15.66:0/3527107457 shutdown_connections 2024-09-15T22:52:45.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.763+0000 7fc3afb53640 1 -- 172.21.15.66:0/3527107457 wait complete. 2024-09-15T22:52:45.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.764+0000 7fc3afb53640 1 Processor -- start 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.764+0000 7fc3afb53640 1 -- start start 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a8197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a90 0x7fc3a819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8110ee0 con 0x7fc3a8101430 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3ad8ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3ad8ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55562/0 (socket says 172.21.15.66:55562) 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2568762688 learned_addr learned my addr 172.21.15.66:0/2568762688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3ad0ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a8197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a90 0x7fc3a819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8110d60 con 0x7fc3a8100a90 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.765+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8111060 con 0x7fc3a8106a90 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2568762688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a90 msgr2=0x7fc3a819bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a90 0x7fc3a819bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 msgr2=0x7fc3a8197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a8197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2568762688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a819c290 con 0x7fc3a8100a90 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a8197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.766+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.767+0000 7fc39effd640 1 -- 172.21.15.66:0/2568762688 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400cd80 con 0x7fc3a8100a90 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.767+0000 7fc39effd640 1 -- 172.21.15.66:0/2568762688 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4010910 con 0x7fc3a8100a90 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.767+0000 7fc39effd640 1 -- 172.21.15.66:0/2568762688 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4018990 con 0x7fc3a8100a90 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.767+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a819c580 con 0x7fc3a8100a90 2024-09-15T22:52:45.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.767+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a806a790 con 0x7fc3a8100a90 2024-09-15T22:52:45.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 Processor -- start 2024-09-15T22:52:45.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 -- start start 2024-09-15T22:52:45.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984a4a0 0x55958984a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x559589855140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5595897b02e0 con 0x55958984adc0 2024-09-15T22:52:45.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559589757ce0 con 0x559589855680 2024-09-15T22:52:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.770+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5595897ac2a0 con 0x55958984a4a0 2024-09-15T22:52:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.771+0000 7fc3ad0ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.771+0000 7fc3ad0ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55576/0 (socket says 172.21.15.66:55576) 2024-09-15T22:52:45.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.771+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/365646413 learned_addr learned my addr 172.21.15.66:0/365646413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.771+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984a4a0 0x55958984a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.771+0000 7fc39effd640 1 -- 172.21.15.66:0/2568762688 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc3a4010ac0 con 0x7fc3a8100a90 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x559589855140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/365646413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984a4a0 msgr2=0x55958984a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984a4a0 0x55958984a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/365646413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 msgr2=0x559589855140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x559589855140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/365646413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55958973c440 con 0x559589855680 2024-09-15T22:52:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.772+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x559589855140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.773+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc39800bd30 tx=0x7fc39800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec57cde73fc27e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.773+0000 7fc39effd640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 0x7fc3940a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.773+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 0x7fc3940a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.773+0000 7fc39effd640 1 -- 172.21.15.66:0/2568762688 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7fc3a40d04f0 con 0x7fc3a8100a90 2024-09-15T22:52:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.774+0000 7fc393fff640 1 -- 172.21.15.66:0/365646413 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015070 con 0x559589855680 2024-09-15T22:52:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.774+0000 7fc393fff640 1 -- 172.21.15.66:0/365646413 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39800be20 con 0x559589855680 2024-09-15T22:52:45.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.774+0000 7fc393fff640 1 -- 172.21.15.66:0/365646413 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398011aa0 con 0x559589855680 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/365646413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 msgr2=0x559589857a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 0x7fc3940a5970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009430 tx=0x7fc3a00098a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc39800bd30 tx=0x7fc39800f730 comp rx=0 tx=0).stop 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/365646413 shutdown_connections 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589857a70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x559589855140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/365646413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984a4a0 0x55958984a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/365646413 >> 172.21.15.66:0/365646413 conn(0x559589846a30 msgr2=0x559589846e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/365646413 shutdown_connections 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.775+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/365646413 wait complete. 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.776+0000 7fc3b1f2c740 1 -- start start 2024-09-15T22:52:45.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.776+0000 7fc3b1f2c740 1 Processor -- start 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x5595898522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589852870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559589858250 con 0x55958984a4a0 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55958976b050 con 0x559589855680 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5595898583d0 con 0x55958984adc0 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3b1f2c740 10 client.0 _ll_register_callbacks cb 0x5595897ab160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3ad8ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3ad8ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33412/0 (socket says 172.21.15.66:33412) 2024-09-15T22:52:45.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.777+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2562189682 learned_addr learned my addr 172.21.15.66:0/2562189682 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2562189682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 msgr2=0x5595898522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x5595898522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 msgr2=0x559589852870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589852870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 -- 172.21.15.66:0/2562189682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595895213c0 con 0x55958984a4a0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9c0 tx=0x7fc3a409bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22bca3dc929a868 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40a4fb0 con 0x55958984a4a0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39800be20 con 0x55958984a4a0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.778+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7fc3a4018b30 con 0x55958984a4a0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.779+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc3a4018d50 con 0x55958984a4a0 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.779+0000 7fc3b1f2c740 10 client.17028 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:45.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.779+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559589863bd0 con 0x55958984a4a0 2024-09-15T22:52:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.779+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a40b5140 con 0x55958984a4a0 2024-09-15T22:52:45.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fc3a40bc0e0 con 0x55958984a4a0 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 10 client.17028 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 10 client.17028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 20 client.17028 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898650e0 0x5595898675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 4 client.17028 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc39800be20 con 0x5595898650e0 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898650e0 0x5595898675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898650e0 0x5595898675a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb6cf2934da31b1d server_cookie=21deadc0bd48612f in_seq=0 out_seq=0 2024-09-15T22:52:45.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.780+0000 7fc3917fa640 10 client.17028 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:45.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.782+0000 7fc3917fa640 1 -- 172.21.15.66:0/2562189682 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc39800be20 con 0x5595898650e0 2024-09-15T22:52:45.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.782+0000 7fc3917fa640 10 client.17028 handle_command_reply: tid=0 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.782+0000 7fc3b1f2c740 1 client.17028 shutdown 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.782+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 msgr2=0x559589855020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9c0 tx=0x7fc3a409bd90 comp rx=0 tx=0).stop 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 shutdown_connections 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898650e0 0x5595898675a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559589855680 0x559589852870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x5595898522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/2562189682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984a4a0 0x559589855020 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 >> 172.21.15.66:0/2562189682 conn(0x559589846a30 msgr2=0x55958984c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3917fa640 0 client.17028 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 shutdown_connections 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/2562189682 wait complete. 2024-09-15T22:52:45.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.783+0000 7fc3b1f2c740 20 client.17028 trim_cache size 0 max 16384 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 Processor -- start 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 -- start start 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x559589850ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x559589845a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 0x55958986ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81af300 con 0x559589855680 2024-09-15T22:52:45.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b0fc0 con 0x55958984a4a0 2024-09-15T22:52:45.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81af9d0 con 0x55958984adc0 2024-09-15T22:52:45.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.813+0000 7fc3ae0f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 0x55958986ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ae0f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 0x55958986ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33428/0 (socket says 172.21.15.66:33428) 2024-09-15T22:52:45.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ae0f0640 1 -- 172.21.15.66:0/3514027370 learned_addr learned my addr 172.21.15.66:0/3514027370 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:45.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x559589845a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x559589850ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/3514027370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 msgr2=0x559589850ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x559589850ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/3514027370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 msgr2=0x55958986ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 0x55958986ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 -- 172.21.15.66:0/3514027370 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559589851280 con 0x55958984adc0 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.814+0000 7fc3ad0ee640 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x559589845a60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559589853910 tx=0x7fc3980115e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d2d4b247cae53d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.815+0000 7fc3937fe640 1 -- 172.21.15.66:0/3514027370 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015040 con 0x55958984adc0 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.815+0000 7fc3937fe640 1 -- 172.21.15.66:0/3514027370 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39802a070 con 0x55958984adc0 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.815+0000 7fc3937fe640 1 -- 172.21.15.66:0/3514027370 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980116f0 con 0x55958984adc0 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/3514027370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 msgr2=0x559589845a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x559589845a60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559589853910 tx=0x7fc3980115e0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/3514027370 shutdown_connections 2024-09-15T22:52:45.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559589855680 0x55958986ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55958984adc0 0x559589845a60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/3514027370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x559589850ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/3514027370 >> 172.21.15.66:0/3514027370 conn(0x559589846a30 msgr2=0x559589845350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/3514027370 shutdown_connections 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.816+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/3514027370 wait complete. 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.817+0000 7fc3b1f2c740 1 -- start start 2024-09-15T22:52:45.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.817+0000 7fc3b1f2c740 1 Processor -- start 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x55958985daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x55958985ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b0830 con 0x55958984adc0 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b00a0 con 0x55958984a4a0 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ad300 con 0x559589855680 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3ae0f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3b1f2c740 10 client.0 _ll_register_callbacks cb 0x7fc3a4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3ae0f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52736/0 (socket says 172.21.15.66:52736) 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.818+0000 7fc3ae0f0640 1 -- 172.21.15.66:0/1716605436 learned_addr learned my addr 172.21.15.66:0/1716605436 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 -- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 msgr2=0x55958985daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x55958985daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 -- 172.21.15.66:0/1716605436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 msgr2=0x55958985ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x55958985ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 -- 172.21.15.66:0/1716605436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55958985b940 con 0x559589855680 2024-09-15T22:52:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3ae0f0640 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0031e70 tx=0x7fc3a002a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf1ba82a6530c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:52:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0058060 con 0x559589855680 2024-09-15T22:52:45.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.819+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39802a070 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.820+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9591+0+0 (secure 0 0 0) 0x7fc3a0004250 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.820+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc3a00044d0 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.820+0000 7fc3b1f2c740 10 client.26524 fetch_fsmap learned FSMap version 44 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.820+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5595898d8430 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.820+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39802a070 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fc3a0030070 con 0x559589855680 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 10 client.26524 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 10 client.26524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 20 client.26524 populate_metadata read hostname 'smithi066' 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898d8c50 0x5595898db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 4 client.26524 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:52:45.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595897bd850 con 0x5595898d8c50 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.821+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898d8c50 0x5595898db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.822+0000 7fc3ad8ef640 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898d8c50 0x5595898db110 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1596905cc965a9ae server_cookie=f1696768b8662778 in_seq=0 out_seq=0 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.822+0000 7fc3917fa640 10 client.26524 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3917fa640 1 -- 172.21.15.66:0/1716605436 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5595897bd850 con 0x5595898d8c50 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3917fa640 10 client.26524 handle_command_reply: tid=0 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 client.26524 shutdown 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 msgr2=0x55958985b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0031e70 tx=0x7fc3a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 shutdown_connections 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559589855680 0x55958985b380 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55958984adc0 0x55958985ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5595898d8c50 0x5595898db110 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 --2- 172.21.15.66:0/1716605436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55958984a4a0 0x55958985daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3917fa640 0 client.26524 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 >> 172.21.15.66:0/1716605436 conn(0x559589846a30 msgr2=0x559589845350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 shutdown_connections 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 1 -- 172.21.15.66:0/1716605436 wait complete. 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.823+0000 7fc3b1f2c740 20 client.26524 trim_cache size 0 max 16384 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:52:45.828 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (7725 inodes in the stack)", 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "bd4707db-ec0e-421c-89fd-56679e6f3512": { 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "bd4707db-ec0e-421c-89fd-56679e6f3512", 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:52:45.829 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 msgr2=0x7fc3940a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 0x7fc3940a5970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009430 tx=0x7fc3a00098a0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 msgr2=0x7fc3a81972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 shutdown_connections 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc3940a34b0 0x7fc3940a5970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3a8106a90 0x7fc3a819bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3a8101430 0x7fc3a8197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 --2- 172.21.15.66:0/2568762688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3a8100a90 0x7fc3a81972e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:45.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 >> 172.21.15.66:0/2568762688 conn(0x7fc3a80fc7d0 msgr2=0x7fc3a80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:45.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 shutdown_connections 2024-09-15T22:52:45.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:52:45.824+0000 7fc3afb53640 1 -- 172.21.15.66:0/2568762688 wait complete. 2024-09-15T22:52:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:46 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:52:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:46 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:46 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:52:46.370 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:46 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:52:46.370 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:46 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:46.370 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:46 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:52:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:46 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:52:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:46 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:46 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:52:46.527 INFO:tasks.cephfs.filesystem:scrub status for tag:bd4707db-ec0e-421c-89fd-56679e6f3512 - {'path': '/', 'tag': 'bd4707db-ec0e-421c-89fd-56679e6f3512', 'options': 'recursive,force'} 2024-09-15T22:52:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:47 smithi087 ceph-mon[35290]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-09-15T22:52:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:47 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:47 smithi184 ceph-mon[35203]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-09-15T22:52:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:47 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:47 smithi066 ceph-mon[31185]: pgmap v227: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 KiB/s wr, 20 op/s 2024-09-15T22:52:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:47 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:48.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:48 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:48.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:48 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:48.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:48 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:49 smithi087 ceph-mon[35290]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 KiB/s wr, 51 op/s 2024-09-15T22:52:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:49 smithi184 ceph-mon[35203]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 KiB/s wr, 51 op/s 2024-09-15T22:52:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:52:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:49 smithi066 ceph-mon[31185]: pgmap v228: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 KiB/s wr, 51 op/s 2024-09-15T22:52:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:51 smithi087 ceph-mon[35290]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 21 KiB/s wr, 117 op/s 2024-09-15T22:52:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:51 smithi184 ceph-mon[35203]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 21 KiB/s wr, 117 op/s 2024-09-15T22:52:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:51 smithi066 ceph-mon[31185]: pgmap v229: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 21 KiB/s wr, 117 op/s 2024-09-15T22:52:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:53 smithi087 ceph-mon[35290]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 KiB/s wr, 157 op/s 2024-09-15T22:52:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:53 smithi184 ceph-mon[35203]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 KiB/s wr, 157 op/s 2024-09-15T22:52:53.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:53 smithi066 ceph-mon[31185]: pgmap v230: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 KiB/s wr, 157 op/s 2024-09-15T22:52:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:55 smithi087 ceph-mon[35290]: pgmap v231: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-09-15T22:52:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:55 smithi184 ceph-mon[35203]: pgmap v231: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-09-15T22:52:55.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:55 smithi066 ceph-mon[31185]: pgmap v231: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 14 KiB/s wr, 158 op/s 2024-09-15T22:52:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:57 smithi087 ceph-mon[35290]: pgmap v232: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 15 KiB/s wr, 157 op/s 2024-09-15T22:52:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:57 smithi184 ceph-mon[35203]: pgmap v232: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 15 KiB/s wr, 157 op/s 2024-09-15T22:52:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:57 smithi066 ceph-mon[31185]: pgmap v232: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 15 KiB/s wr, 157 op/s 2024-09-15T22:52:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:52:59 smithi087 ceph-mon[35290]: pgmap v233: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 20 KiB/s wr, 156 op/s 2024-09-15T22:52:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:52:59 smithi184 ceph-mon[35203]: pgmap v233: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 20 KiB/s wr, 156 op/s 2024-09-15T22:52:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:52:59 smithi066 ceph-mon[31185]: pgmap v233: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 20 KiB/s wr, 156 op/s 2024-09-15T22:53:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:00.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:01 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:01 smithi087 ceph-mon[35290]: pgmap v234: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 21 KiB/s wr, 126 op/s 2024-09-15T22:53:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:01 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:01 smithi184 ceph-mon[35203]: pgmap v234: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 21 KiB/s wr, 126 op/s 2024-09-15T22:53:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:01 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:01 smithi066 ceph-mon[31185]: pgmap v234: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 21 KiB/s wr, 126 op/s 2024-09-15T22:53:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:03 smithi087 ceph-mon[35290]: pgmap v235: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 66 op/s 2024-09-15T22:53:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:03 smithi184 ceph-mon[35203]: pgmap v235: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 66 op/s 2024-09-15T22:53:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:03 smithi066 ceph-mon[31185]: pgmap v235: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 66 op/s 2024-09-15T22:53:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:05 smithi087 ceph-mon[35290]: pgmap v236: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-15T22:53:05.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:05 smithi184 ceph-mon[35203]: pgmap v236: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-15T22:53:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:05 smithi066 ceph-mon[31185]: pgmap v236: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 KiB/s wr, 26 op/s 2024-09-15T22:53:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:07 smithi087 ceph-mon[35290]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-15T22:53:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:07 smithi184 ceph-mon[35203]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-15T22:53:07.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:07 smithi066 ceph-mon[31185]: pgmap v237: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-15T22:53:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:09 smithi087 ceph-mon[35290]: pgmap v238: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-15T22:53:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:09 smithi184 ceph-mon[35203]: pgmap v238: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-15T22:53:09.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:09 smithi066 ceph-mon[31185]: pgmap v238: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-15T22:53:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:11 smithi087 ceph-mon[35290]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 75 KiB/s wr, 34 op/s 2024-09-15T22:53:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:11 smithi087 ceph-mon[35290]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:53:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:11 smithi184 ceph-mon[35203]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 75 KiB/s wr, 34 op/s 2024-09-15T22:53:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:11 smithi184 ceph-mon[35203]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:53:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:11 smithi066 ceph-mon[31185]: pgmap v239: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 75 KiB/s wr, 34 op/s 2024-09-15T22:53:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:11 smithi066 ceph-mon[31185]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:53:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:13 smithi087 ceph-mon[35290]: pgmap v241: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:13 smithi184 ceph-mon[35203]: pgmap v241: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:13 smithi066 ceph-mon[31185]: pgmap v241: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:15 smithi087 ceph-mon[35290]: pgmap v242: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:15 smithi184 ceph-mon[35203]: pgmap v242: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:15 smithi066 ceph-mon[31185]: pgmap v242: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 84 KiB/s wr, 29 op/s 2024-09-15T22:53:16.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:53:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:17 smithi066 ceph-mon[31185]: pgmap v243: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-15T22:53:17.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 -- 172.21.15.66:0/1339769988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8106a60 msgr2=0x7f0ec8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1339769988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8106a60 0x7f0ec8106e40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009930 tx=0x7f0eb802a420 comp rx=0 tx=0).stop 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 -- 172.21.15.66:0/1339769988 shutdown_connections 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1339769988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 0x7f0ec810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1339769988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8100a60 0x7f0ec8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1339769988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8106a60 0x7f0ec8106e40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.307+0000 7f0ece62c640 1 -- 172.21.15.66:0/1339769988 >> 172.21.15.66:0/1339769988 conn(0x7f0ec80fc780 msgr2=0x7f0ec80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- 172.21.15.66:0/1339769988 shutdown_connections 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- 172.21.15.66:0/1339769988 wait complete. 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 Processor -- start 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- start start 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 0x7f0ec81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8106a60 0x7f0ec819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8110e60 con 0x7f0ec8100a60 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8110ce0 con 0x7f0ec8106a60 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.308+0000 7f0ece62c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8110fe0 con 0x7f0ec8101400 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35688/0 (socket says 172.21.15.66:35688) 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 -- 172.21.15.66:0/1919684122 learned_addr learned my addr 172.21.15.66:0/1919684122 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ebffff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 0x7f0ec81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8106a60 0x7f0ec819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 -- 172.21.15.66:0/1919684122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 msgr2=0x7f0ec81989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 0x7f0ec81989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 -- 172.21.15.66:0/1919684122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8106a60 msgr2=0x7f0ec819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8106a60 0x7f0ec819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 -- 172.21.15.66:0/1919684122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec819d450 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009230 tx=0x7f0eb8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec5ffb640 1 -- 172.21.15.66:0/1919684122 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803f030 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec5ffb640 1 -- 172.21.15.66:0/1919684122 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eb8003ad0 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.309+0000 7f0ec5ffb640 1 -- 172.21.15.66:0/1919684122 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8035070 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.310+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec819d6e0 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.310+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec819db70 con 0x7f0ec8100a60 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 Processor -- start 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 -- start start 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d70dc0 0x557c71d7b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d7da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557c71cd62e0 con 0x557c71d704a0 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557c71c7dce0 con 0x557c71d70dc0 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557c71cd22a0 con 0x557c71d7b680 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.312+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35698/0 (socket says 172.21.15.66:35698) 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 -- 172.21.15.66:0/1836212970 learned_addr learned my addr 172.21.15.66:0/1836212970 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ec5ffb640 1 -- 172.21.15.66:0/1919684122 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0eb8042030 con 0x7f0ec8100a60 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ebffff640 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d7da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 -- 172.21.15.66:0/1836212970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 msgr2=0x557c71d7da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d7da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 -- 172.21.15.66:0/1836212970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d70dc0 msgr2=0x557c71d7b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d70dc0 0x557c71d7b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 -- 172.21.15.66:0/1836212970 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c71c62440 con 0x557c71d704a0 2024-09-15T22:53:17.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ebffff640 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d7da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009f50 tx=0x7f0ec00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fff848700ae0825 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ebe7fc640 1 -- 172.21.15.66:0/1836212970 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0004d20 con 0x557c71d704a0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ebe7fc640 1 -- 172.21.15.66:0/1836212970 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec0004050 con 0x557c71d704a0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.313+0000 7f0ebe7fc640 1 -- 172.21.15.66:0/1836212970 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0005280 con 0x557c71d704a0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ec5ffb640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 0x7f0eb40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 0x7f0eb40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ec5ffb640 1 -- 172.21.15.66:0/1919684122 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9679+0+0 (secure 0 0 0) 0x7f0eb80f0680 con 0x7f0ec8100a60 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 -- 172.21.15.66:0/1836212970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 msgr2=0x557c71d70880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ec7fff640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 0x7f0eb40a58f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x557c71d6d890 tx=0x7f0eb8087420 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009f50 tx=0x7f0ec00118d0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 -- 172.21.15.66:0/1836212970 shutdown_connections 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d7da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d70dc0 0x557c71d7b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/1836212970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d70880 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 -- 172.21.15.66:0/1836212970 >> 172.21.15.66:0/1836212970 conn(0x557c71d6ca30 msgr2=0x557c71d6ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 -- 172.21.15.66:0/1836212970 shutdown_connections 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.314+0000 7f0ed0a05740 1 -- 172.21.15.66:0/1836212970 wait complete. 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 -- start start 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 Processor -- start 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d704a0 0x557c71d7af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d78740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557c71d7e250 con 0x557c71d70dc0 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557c71c91050 con 0x557c71d704a0 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557c71d7e3d0 con 0x557c71d7b680 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ed0a05740 10 client.0 _ll_register_callbacks cb 0x557c71cd1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:17.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35710/0 (socket says 172.21.15.66:35710) 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.315+0000 7f0ebffff640 1 -- 172.21.15.66:0/2656596992 learned_addr learned my addr 172.21.15.66:0/2656596992 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d704a0 0x557c71d7af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d78740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 -- 172.21.15.66:0/2656596992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 msgr2=0x557c71d78740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d78740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 -- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d704a0 msgr2=0x557c71d7af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d704a0 0x557c71d7af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 -- 172.21.15.66:0/2656596992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c71a473c0 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d78740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ebffff640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000be30 tx=0x7f0eb0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a586ab73f9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ea77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0004220 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9679+0+0 (secure 0 0 0) 0x7f0eb00043c0 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec0004050 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0eb0005020 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ed0a05740 10 client.17043 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.316+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x557c71d89c00 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec0004050 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f0eb0019070 con 0x557c71d70dc0 2024-09-15T22:53:17.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 10 client.17043 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 20 client.17043 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71d8b640 0x557c71d8dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 4 client.17043 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c71ce3850 con 0x557c71d8b640 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.317+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71d8b640 0x557c71d8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.318+0000 7f0ea77fe640 10 client.17043 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.318+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71d8b640 0x557c71d8dae0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6208453011cd3cad server_cookie=99e20c7da7be7fd0 in_seq=0 out_seq=0 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.318+0000 7f0ea77fe640 1 -- 172.21.15.66:0/2656596992 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c71ce3850 con 0x557c71d8b640 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.318+0000 7f0ea77fe640 10 client.17043 handle_command_reply: tid=0 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 client.17043 shutdown 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 msgr2=0x557c71d78200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000be30 tx=0x7f0eb0012820 comp rx=0 tx=0).stop 2024-09-15T22:53:17.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 shutdown_connections 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d7b680 0x557c71d78740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d70dc0 0x557c71d78200 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71d8b640 0x557c71d8dae0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/2656596992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d704a0 0x557c71d7af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 >> 172.21.15.66:0/2656596992 conn(0x557c71d6ca30 msgr2=0x557c71d72760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ea77fe640 0 client.17043 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 shutdown_connections 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 1 -- 172.21.15.66:0/2656596992 wait complete. 2024-09-15T22:53:17.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.319+0000 7f0ed0a05740 20 client.17043 trim_cache size 0 max 16384 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 Processor -- start 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 -- start start 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d933b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71d938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81af400 con 0x557c71d704a0 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81b10c0 con 0x557c71d7b680 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81afad0 con 0x557c71d70dc0 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35714/0 (socket says 172.21.15.66:35714) 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.337+0000 7f0eccbc9640 1 -- 172.21.15.66:0/3802887676 learned_addr learned my addr 172.21.15.66:0/3802887676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0ebffff640 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d933b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71d938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 -- 172.21.15.66:0/3802887676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 msgr2=0x557c71d933b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d933b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 -- 172.21.15.66:0/3802887676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 msgr2=0x557c71d938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71d938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 -- 172.21.15.66:0/3802887676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c71d6c860 con 0x557c71d704a0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006010 tx=0x7f0ec0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5ce786f157c211 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0ebdffb640 1 -- 172.21.15.66:0/3802887676 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0004500 con 0x557c71d704a0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0ebdffb640 1 -- 172.21.15.66:0/3802887676 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec0004d70 con 0x557c71d704a0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.338+0000 7f0ebdffb640 1 -- 172.21.15.66:0/3802887676 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0005800 con 0x557c71d704a0 2024-09-15T22:53:17.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- 172.21.15.66:0/3802887676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 msgr2=0x557c71d874b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006010 tx=0x7f0ec0009500 comp rx=0 tx=0).stop 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- 172.21.15.66:0/3802887676 shutdown_connections 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71d938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d933b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/3802887676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d874b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- 172.21.15.66:0/3802887676 >> 172.21.15.66:0/3802887676 conn(0x557c71d6ca30 msgr2=0x557c71d772f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- 172.21.15.66:0/3802887676 shutdown_connections 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- 172.21.15.66:0/3802887676 wait complete. 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.339+0000 7f0ed0a05740 1 -- start start 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 Processor -- start 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71df4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81b0930 con 0x557c71d704a0 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81b01a0 con 0x557c71d7b680 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec81ad400 con 0x557c71d70dc0 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ed0a05740 10 client.0 _ll_register_callbacks cb 0x7f0eb000b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35730/0 (socket says 172.21.15.66:35730) 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 -- 172.21.15.66:0/776146336 learned_addr learned my addr 172.21.15.66:0/776146336 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0ebffff640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 -- 172.21.15.66:0/776146336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 msgr2=0x557c71d810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 -- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 msgr2=0x557c71df4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71df4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.340+0000 7f0eccbc9640 1 -- 172.21.15.66:0/776146336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c71d6dae0 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0eccbc9640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0011910 tx=0x7f0ec0003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d30eb9d78b71a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0004f20 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9679+0+0 (secure 0 0 0) 0x7f0ec00050c0 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec0004d70 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0ec0047050 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ed0a05740 10 client.17049 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x557c71df5a70 con 0x557c71d704a0 2024-09-15T22:53:17.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec0004d70 con 0x557c71d704a0 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.341+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f0ec00395c0 con 0x557c71d704a0 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 10 client.17049 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 20 client.17049 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71df6070 0x557c71df8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 4 client.17049 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c71cddd60 con 0x557c71df6070 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ebffff640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71df6070 0x557c71df8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ea77fe640 10 client.17049 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ebffff640 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71df6070 0x557c71df8490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ab19ff55c339cf8 server_cookie=5880480bb9f458d9 in_seq=0 out_seq=0 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.342+0000 7f0ea77fe640 1 -- 172.21.15.66:0/776146336 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557c71cddd60 con 0x557c71df6070 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ea77fe640 10 client.17049 handle_command_reply: tid=0 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 client.17049 shutdown 2024-09-15T22:53:17.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 msgr2=0x557c71d80b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0011910 tx=0x7f0ec0003d20 comp rx=0 tx=0).stop 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 shutdown_connections 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x557c71df6070 0x557c71df8490 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557c71d7b680 0x557c71df4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c71d70dc0 0x557c71d810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 --2- 172.21.15.66:0/776146336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557c71d704a0 0x557c71d80b90 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 >> 172.21.15.66:0/776146336 conn(0x557c71d6ca30 msgr2=0x557c71d79a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ea77fe640 0 client.17049 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 shutdown_connections 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 1 -- 172.21.15.66:0/776146336 wait complete. 2024-09-15T22:53:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.343+0000 7f0ed0a05740 20 client.17049 trim_cache size 0 max 16384 2024-09-15T22:53:17.360 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:53:17.360 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:53:17.360 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:53:17.360 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:53:17.361 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:17 smithi087 ceph-mon[35290]: pgmap v243: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 msgr2=0x7f0eb40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 0x7f0eb40a58f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x557c71d6d890 tx=0x7f0eb8087420 comp rx=0 tx=0).stop 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 msgr2=0x7f0ec81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009230 tx=0x7f0eb8004270 comp rx=0 tx=0).stop 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 shutdown_connections 2024-09-15T22:53:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0eb40a3430 0x7f0eb40a58f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec8106a60 0x7f0ec819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec8101400 0x7f0ec81989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 --2- 172.21.15.66:0/1919684122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ec8100a60 0x7f0ec81984a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 >> 172.21.15.66:0/1919684122 conn(0x7f0ec80fc780 msgr2=0x7f0ec806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 shutdown_connections 2024-09-15T22:53:17.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:17.344+0000 7f0ece62c640 1 -- 172.21.15.66:0/1919684122 wait complete. 2024-09-15T22:53:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:17 smithi184 ceph-mon[35203]: pgmap v243: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-15T22:53:18.132 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:53:18.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:53:18.401 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:18.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 -- 172.21.15.66:0/3790683460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528100e20 msgr2=0x7f1528101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:18.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 --2- 172.21.15.66:0/3790683460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528100e20 0x7f1528101200 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1518009900 tx=0x7f151802a480 comp rx=0 tx=0).stop 2024-09-15T22:53:18.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 -- 172.21.15.66:0/3790683460 shutdown_connections 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 --2- 172.21.15.66:0/3790683460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102ef0 0x7f152810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 --2- 172.21.15.66:0/3790683460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528102570 0x7f15281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 --2- 172.21.15.66:0/3790683460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528100e20 0x7f1528101200 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 -- 172.21.15.66:0/3790683460 >> 172.21.15.66:0/3790683460 conn(0x7f15280fc7d0 msgr2=0x7f15280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 -- 172.21.15.66:0/3790683460 shutdown_connections 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 -- 172.21.15.66:0/3790683460 wait complete. 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.896+0000 7f152f03a640 1 Processor -- start 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 -- start start 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528100e20 0x7f15281973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102570 0x7f1528197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:18.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1528110f80 con 0x7f1528102ef0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1528110e00 con 0x7f1528102570 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152f03a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1528111100 con 0x7f1528100e20 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35756/0 (socket says 172.21.15.66:35756) 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 -- 172.21.15.66:0/1190154418 learned_addr learned my addr 172.21.15.66:0/1190154418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152cdd6640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528100e20 0x7f15281973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f1527fff640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102570 0x7f1528197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 -- 172.21.15.66:0/1190154418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528100e20 msgr2=0x7f15281973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528100e20 0x7f15281973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 -- 172.21.15.66:0/1190154418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102570 msgr2=0x7f1528197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102570 0x7f1528197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.897+0000 7f152d5d7640 1 -- 172.21.15.66:0/1190154418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152819c3a0 con 0x7f1528102ef0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f152d5d7640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f152000ebb0 tx=0x7f1520007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520007ca0 con 0x7f1528102ef0 2024-09-15T22:53:18.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152819c630 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1520007e40 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200058a0 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.898+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1528069f70 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.899+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15281021b0 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.900+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1520004a40 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.901+0000 7f1525ffb640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 0x7f15100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.901+0000 7f152cdd6640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 0x7f15100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.901+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9679+0+0 (secure 0 0 0) 0x7f15200d1690 con 0x7f1528102ef0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.901+0000 7f152cdd6640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 0x7f15100a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1518009230 tx=0x7f15180058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:18.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:18.905+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f152009d5a0 con 0x7f1528102ef0 2024-09-15T22:53:19.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.121+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1528198750 con 0x7f1528102ef0 2024-09-15T22:53:19.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.122+0000 7f1525ffb640 1 -- 172.21.15.66:0/1190154418 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11988 (secure 0 0 0) 0x7f15200a18a0 con 0x7f1528102ef0 2024-09-15T22:53:19.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:53:19.124 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":44,"btime":"2024-09-15T22:52:30:952534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:52:29.985447+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:53:19.125 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 44 2024-09-15T22:53:19.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 msgr2=0x7f15100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:19.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 0x7f15100a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1518009230 tx=0x7f15180058d0 comp rx=0 tx=0).stop 2024-09-15T22:53:19.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 msgr2=0x7f152819bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f152000ebb0 tx=0x7f1520007590 comp rx=0 tx=0).stop 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 shutdown_connections 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15100a33b0 0x7f15100a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1528102ef0 0x7f152819bcc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1528102570 0x7f1528197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 --2- 172.21.15.66:0/1190154418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1528100e20 0x7f15281973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 >> 172.21.15.66:0/1190154418 conn(0x7f15280fc7d0 msgr2=0x7f15280fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 shutdown_connections 2024-09-15T22:53:19.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:19.124+0000 7f152f03a640 1 -- 172.21.15.66:0/1190154418 wait complete. 2024-09-15T22:53:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:19 smithi087 ceph-mon[35290]: pgmap v244: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-15T22:53:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:19 smithi087 ceph-mon[35290]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:53:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:19 smithi184 ceph-mon[35203]: pgmap v244: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-15T22:53:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:19 smithi184 ceph-mon[35203]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:53:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:19 smithi066 ceph-mon[31185]: pgmap v244: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-15T22:53:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:19 smithi066 ceph-mon[31185]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:53:19.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:53:20.079 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:20.331 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:20 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1190154418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:20 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1190154418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:20 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1190154418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:20.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 -- 172.21.15.66:0/3424314536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 msgr2=0x7f3ce4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 --2- 172.21.15.66:0/3424314536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce4103170 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009930 tx=0x7f3cdc02a420 comp rx=0 tx=0).stop 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 -- 172.21.15.66:0/3424314536 shutdown_connections 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 --2- 172.21.15.66:0/3424314536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4108290 0x7f3ce410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 --2- 172.21.15.66:0/3424314536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4103740 0x7f3ce4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 --2- 172.21.15.66:0/3424314536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce4103170 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 -- 172.21.15.66:0/3424314536 >> 172.21.15.66:0/3424314536 conn(0x7f3ce40fc7d0 msgr2=0x7f3ce40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 -- 172.21.15.66:0/3424314536 shutdown_connections 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.525+0000 7f3cebe54640 1 -- 172.21.15.66:0/3424314536 wait complete. 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 Processor -- start 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 -- start start 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4103740 0x7f3ce4100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 0x7f3ce4101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4112090 con 0x7f3ce4102d90 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4111f10 con 0x7f3ce4103740 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cebe54640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4112210 con 0x7f3ce4108290 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35774/0 (socket says 172.21.15.66:35774) 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/4256695825 learned_addr learned my addr 172.21.15.66:0/4256695825 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4103740 0x7f3ce4100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 0x7f3ce4101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/4256695825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 msgr2=0x7f3ce4101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 0x7f3ce4101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/4256695825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4103740 msgr2=0x7f3ce4100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4103740 0x7f3ce4100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/4256695825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce41a69e0 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.526+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 0x7f3ce4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009230 tx=0x7f3cdc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3ce2ffd640 1 -- 172.21.15.66:0/4256695825 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc03f030 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3ce2ffd640 1 -- 172.21.15.66:0/4256695825 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cdc003ad0 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce41a6c70 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3ce2ffd640 1 -- 172.21.15.66:0/4256695825 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc035070 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.527+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce41a71a0 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.529+0000 7f3ce2ffd640 1 -- 172.21.15.66:0/4256695825 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3cdc042030 con 0x7f3ce4102d90 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.529+0000 7f3cee22d740 1 Processor -- start 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 -- start start 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc21760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556b8bb7a2f0 con 0x556b8bc145d0 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556b8bb21cf0 con 0x556b8bc15b40 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cee22d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556b8bb762b0 con 0x556b8bc1f370 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35790/0 (socket says 172.21.15.66:35790) 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/388651915 learned_addr learned my addr 172.21.15.66:0/388651915 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc21760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/388651915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 msgr2=0x556b8bc21760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc21760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/388651915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 msgr2=0x556b8bc14090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc14090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce2ffd640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 0x7f3ccc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.530+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/388651915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8bb063a0 con 0x556b8bc145d0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 0x7f3ccc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3ce2ffd640 1 -- 172.21.15.66:0/4256695825 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f3cdc0f0740 con 0x7f3ce4102d90 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0ed9d0 tx=0x7f3cdc0b8890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879c71aac165716e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3ccbfff640 1 -- 172.21.15.66:0/388651915 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc049070 con 0x556b8bc145d0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3ccbfff640 1 -- 172.21.15.66:0/388651915 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cdc0bccf0 con 0x556b8bc145d0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.531+0000 7f3ccbfff640 1 -- 172.21.15.66:0/388651915 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0bc3c0 con 0x556b8bc145d0 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- 172.21.15.66:0/388651915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 msgr2=0x556b8bc14a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0ed9d0 tx=0x7f3cdc0b8890 comp rx=0 tx=0).stop 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 0x7f3ccc0a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005fd0 tx=0x7f3cd4009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- 172.21.15.66:0/388651915 shutdown_connections 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc21760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc14a10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 --2- 172.21.15.66:0/388651915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- 172.21.15.66:0/388651915 >> 172.21.15.66:0/388651915 conn(0x556b8bbdd310 msgr2=0x556b8bc10c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- 172.21.15.66:0/388651915 shutdown_connections 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- 172.21.15.66:0/388651915 wait complete. 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.532+0000 7f3cee22d740 1 -- start start 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 Processor -- start 2024-09-15T22:53:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 0x556b8bc1ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc1c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556b8bc21e30 con 0x556b8bc15b40 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556b8bb35060 con 0x556b8bc145d0 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556b8bc21fb0 con 0x556b8bc1f370 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cee22d740 10 client.0 _ll_register_callbacks cb 0x556b8b8888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35800/0 (socket says 172.21.15.66:35800) 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 -- 172.21.15.66:0/4030434160 learned_addr learned my addr 172.21.15.66:0/4030434160 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 0x556b8bc1ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc1c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 -- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 msgr2=0x556b8bc1c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc1c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 -- 172.21.15.66:0/4030434160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 msgr2=0x556b8bc1ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 0x556b8bc1ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce93ef640 1 -- 172.21.15.66:0/4030434160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8b8eb3c0 con 0x556b8bc15b40 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.533+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 0x556b8bc1ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8012750 tx=0x7f3cd8012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cba2b801218932 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd801f060 con 0x556b8bc15b40 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f3cd8010dc0 con 0x556b8bc15b40 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cdc0bccf0 con 0x556b8bc15b40 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3cd8026050 con 0x556b8bc15b40 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 10 client.17067 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556b8bc2d980 con 0x556b8bc15b40 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cdc0bccf0 con 0x556b8bc15b40 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f3cd800d5a0 con 0x556b8bc15b40 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 10 client.17067 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 10 client.17067 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 20 client.17067 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc2ee40 0x556b8bc31270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 4 client.17067 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.534+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b8bb87860 con 0x556b8bc2ee40 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.535+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc2ee40 0x556b8bc31270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.535+0000 7f3cc97fa640 10 client.17067 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.535+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc2ee40 0x556b8bc31270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=79d7328857123a2e server_cookie=bf5cbf2ac6a514e9 in_seq=0 out_seq=0 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.536+0000 7f3cc97fa640 1 -- 172.21.15.66:0/4030434160 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b8bb87860 con 0x556b8bc2ee40 2024-09-15T22:53:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.536+0000 7f3cc97fa640 10 client.17067 handle_command_reply: tid=0 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.536+0000 7f3cee22d740 1 client.17067 shutdown 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.536+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 msgr2=0x556b8bc1c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.536+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8012750 tx=0x7f3cd8012c10 comp rx=0 tx=0).stop 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 shutdown_connections 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc2ee40 0x556b8bc31270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc1c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc1c0d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 --2- 172.21.15.66:0/4030434160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc145d0 0x556b8bc1ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cc97fa640 0 client.17067 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 >> 172.21.15.66:0/4030434160 conn(0x556b8bbdd310 msgr2=0x556b8bc16930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 shutdown_connections 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 1 -- 172.21.15.66:0/4030434160 wait complete. 2024-09-15T22:53:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.537+0000 7f3cee22d740 20 client.17067 trim_cache size 0 max 16384 2024-09-15T22:53:20.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 Processor -- start 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 -- start start 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 0x556b8bc21760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc1f370 0x556b8bc17660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41b1480 con 0x556b8bc15b40 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41b3140 con 0x556b8bc1f370 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3cee22d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41b1b50 con 0x556b8bc145d0 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.550+0000 7f3ce93ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35808/0 (socket says 172.21.15.66:35808) 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 -- 172.21.15.66:0/1573458974 learned_addr learned my addr 172.21.15.66:0/1573458974 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc1f370 0x556b8bc17660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 0x556b8bc21760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 -- 172.21.15.66:0/1573458974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 msgr2=0x556b8bc21760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 0x556b8bc21760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 -- 172.21.15.66:0/1573458974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc1f370 msgr2=0x556b8bc17660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc1f370 0x556b8bc17660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 -- 172.21.15.66:0/1573458974 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8bc1cbd0 con 0x556b8bc15b40 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 0x556b8bc21760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d940 tx=0x7f3cd800aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19a40e2a5cd5bed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ccb7fe640 1 -- 172.21.15.66:0/1573458974 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8012e60 con 0x556b8bc15b40 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ccb7fe640 1 -- 172.21.15.66:0/1573458974 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd800ddb0 con 0x556b8bc15b40 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.551+0000 7f3ccb7fe640 1 -- 172.21.15.66:0/1573458974 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd802aaa0 con 0x556b8bc15b40 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- 172.21.15.66:0/1573458974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 msgr2=0x556b8bc17120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d940 tx=0x7f3cd800aef0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- 172.21.15.66:0/1573458974 shutdown_connections 2024-09-15T22:53:20.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc1f370 0x556b8bc17660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc15b40 0x556b8bc17120 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 --2- 172.21.15.66:0/1573458974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc145d0 0x556b8bc21760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- 172.21.15.66:0/1573458974 >> 172.21.15.66:0/1573458974 conn(0x556b8bbdd310 msgr2=0x556b8bc0ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- 172.21.15.66:0/1573458974 shutdown_connections 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- 172.21.15.66:0/1573458974 wait complete. 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.552+0000 7f3cee22d740 1 -- start start 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 Processor -- start 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc22d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc23360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41b29b0 con 0x556b8bc145d0 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41b2220 con 0x556b8bc15b40 2024-09-15T22:53:20.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41af480 con 0x556b8bc1f370 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cee22d740 10 client.0 _ll_register_callbacks cb 0x7f3cd800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3ce9bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35820/0 (socket says 172.21.15.66:35820) 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/974706732 learned_addr learned my addr 172.21.15.66:0/974706732 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3cea3f1640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc23360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.553+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc22d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 msgr2=0x556b8bc23360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc23360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/974706732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 msgr2=0x556b8bc22d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc22d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 -- 172.21.15.66:0/974706732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8bc23b60 con 0x556b8bc145d0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3ce9bf0640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0bc2f0 tx=0x7f3cdc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef58a35c0b3b143d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc049040 con 0x556b8bc145d0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f3cdc0ba8f0 con 0x556b8bc145d0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd800ddb0 con 0x556b8bc145d0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3cdc0b8020 con 0x556b8bc145d0 2024-09-15T22:53:20.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 10 client.17073 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556b8bc99ba0 con 0x556b8bc145d0 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cd800ddb0 con 0x556b8bc145d0 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f3cdc0edce0 con 0x556b8bc145d0 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 10 client.17073 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 10 client.17073 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.554+0000 7f3cee22d740 20 client.17073 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc9a130 0x556b8bc9c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3cee22d740 4 client.17073 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b8bb81d70 con 0x556b8bc9a130 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc9a130 0x556b8bc9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3ce93ef640 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc9a130 0x556b8bc9c520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e3cf6cf0fecfe28 server_cookie=2142cb3ccb4f5a67 in_seq=0 out_seq=0 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.555+0000 7f3cc97fa640 10 client.17073 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:53:20.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cc97fa640 1 -- 172.21.15.66:0/974706732 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3cd8038020 con 0x556b8bc9a130 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cc97fa640 10 client.17073 handle_command_reply: tid=0 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 client.17073 shutdown 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 msgr2=0x556b8bc27a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0bc2f0 tx=0x7f3cdc02a420 comp rx=0 tx=0).stop 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 shutdown_connections 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556b8bc9a130 0x556b8bc9c520 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b8bc1f370 0x556b8bc23360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556b8bc15b40 0x556b8bc22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cc97fa640 0 client.17073 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 --2- 172.21.15.66:0/974706732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556b8bc145d0 0x556b8bc27a40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 >> 172.21.15.66:0/974706732 conn(0x556b8bbdd310 msgr2=0x556b8bc0f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 shutdown_connections 2024-09-15T22:53:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 1 -- 172.21.15.66:0/974706732 wait complete. 2024-09-15T22:53:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cee22d740 20 client.17073 trim_cache size 0 max 16384 2024-09-15T22:53:20.566 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:53:20.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.556+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 msgr2=0x7f3ccc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 0x7f3ccc0a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005fd0 tx=0x7f3cd4009500 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 msgr2=0x7f3ce41009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009230 tx=0x7f3cdc004270 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 shutdown_connections 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ccc0a3430 0x7f3ccc0a58f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ce4108290 0x7f3ce4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4103740 0x7f3ce4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 --2- 172.21.15.66:0/4256695825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ce4102d90 0x7f3ce41009f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 >> 172.21.15.66:0/4256695825 conn(0x7f3ce40fc7d0 msgr2=0x7f3ce4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 shutdown_connections 2024-09-15T22:53:20.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:20.557+0000 7f3cebe54640 1 -- 172.21.15.66:0/4256695825 wait complete. 2024-09-15T22:53:21.156 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:21 smithi066 ceph-mon[31185]: pgmap v246: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-09-15T22:53:21.185 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:53:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:21 smithi087 ceph-mon[35290]: pgmap v246: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-09-15T22:53:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:21 smithi184 ceph-mon[35203]: pgmap v246: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-09-15T22:53:21.440 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 -- 172.21.15.66:0/928938765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 msgr2=0x7fe1bc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 --2- 172.21.15.66:0/928938765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc1067e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009900 tx=0x7fe1ac02a410 comp rx=0 tx=0).stop 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 -- 172.21.15.66:0/928938765 shutdown_connections 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 --2- 172.21.15.66:0/928938765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 0x7fe1bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 --2- 172.21.15.66:0/928938765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc1067e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 --2- 172.21.15.66:0/928938765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 0x7fe1bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 -- 172.21.15.66:0/928938765 >> 172.21.15.66:0/928938765 conn(0x7fe1bc0fd8c0 msgr2=0x7fe1bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 -- 172.21.15.66:0/928938765 shutdown_connections 2024-09-15T22:53:21.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.883+0000 7fe1c4513640 1 -- 172.21.15.66:0/928938765 wait complete. 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 Processor -- start 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 -- start start 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 0x7fe1bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 0x7fe1bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc112010 con 0x7fe1bc102790 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc111e90 con 0x7fe1bc106f10 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.884+0000 7fe1c4513640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc112190 con 0x7fe1bc101de0 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35832/0 (socket says 172.21.15.66:35832) 2024-09-15T22:53:21.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1630406389 learned_addr learned my addr 172.21.15.66:0/1630406389 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 0x7fe1bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 0x7fe1bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1630406389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 msgr2=0x7fe1bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 0x7fe1bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1630406389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 msgr2=0x7fe1bc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 0x7fe1bc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1630406389 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc1a6a70 con 0x7fe1bc102790 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005ab0 tx=0x7fe1ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1b37fe640 1 -- 172.21.15.66:0/1630406389 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac03f030 con 0x7fe1bc102790 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1b37fe640 1 -- 172.21.15.66:0/1630406389 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1ac003ce0 con 0x7fe1bc102790 2024-09-15T22:53:21.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc1a6d00 con 0x7fe1bc102790 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.885+0000 7fe1b37fe640 1 -- 172.21.15.66:0/1630406389 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac035070 con 0x7fe1bc102790 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.886+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc1a7190 con 0x7fe1bc102790 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1b37fe640 1 -- 172.21.15.66:0/1630406389 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe1ac042030 con 0x7fe1bc102790 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1c68ec740 1 Processor -- start 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1c68ec740 1 -- start start 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5866fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.888+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c5867c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c585d52f0 con 0x563c58670b40 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563c5857ccf0 con 0x563c5867a370 2024-09-15T22:53:21.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563c585d12b0 con 0x563c5866f5d0 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35846/0 (socket says 172.21.15.66:35846) 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/3328907426 learned_addr learned my addr 172.21.15.66:0/3328907426 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1b37fe640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 0x7fe1a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c5867c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c22af640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5866fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 0x7fe1a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1b37fe640 1 -- 172.21.15.66:0/1630406389 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fe1ac0f06c0 con 0x7fe1bc102790 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/3328907426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 msgr2=0x563c5866fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5866fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/3328907426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 msgr2=0x563c5867c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c5867c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/3328907426 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c585613a0 con 0x563c58670b40 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c22af640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5866fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.889+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a990 tx=0x7fe1b400ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2f4c6243c3f291 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1b0ff9640 1 -- 172.21.15.66:0/3328907426 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b401d030 con 0x563c58670b40 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1b0ff9640 1 -- 172.21.15.66:0/3328907426 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b4015c60 con 0x563c58670b40 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1b0ff9640 1 -- 172.21.15.66:0/3328907426 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40213c0 con 0x563c58670b40 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 -- 172.21.15.66:0/3328907426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 msgr2=0x563c5866f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 0x7fe1a80a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4020000 tx=0x7fe1b401e000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400a990 tx=0x7fe1b400ae50 comp rx=0 tx=0).stop 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 -- 172.21.15.66:0/3328907426 shutdown_connections 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c5867c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5866fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/3328907426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c5866f090 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.890+0000 7fe1c68ec740 1 -- 172.21.15.66:0/3328907426 >> 172.21.15.66:0/3328907426 conn(0x563c58638310 msgr2=0x563c5866bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- 172.21.15.66:0/3328907426 shutdown_connections 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- 172.21.15.66:0/3328907426 wait complete. 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- start start 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 Processor -- start 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c58679d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c586775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563c5867d070 con 0x563c58670b40 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563c58590060 con 0x563c5867a370 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563c5867d1f0 con 0x563c5866f5d0 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c68ec740 10 client.0 _ll_register_callbacks cb 0x563c582e38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c1aae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c1aae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35862/0 (socket says 172.21.15.66:35862) 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1961410126 learned_addr learned my addr 172.21.15.66:0/1961410126 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c58679d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.891+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c586775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 msgr2=0x563c58679d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c58679d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1961410126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 msgr2=0x563c586775d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c586775d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 -- 172.21.15.66:0/1961410126 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c583463c0 con 0x563c58670b40 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0edfe0 tx=0x7fe1ac0b1a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d8f8dada23809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac049070 con 0x563c58670b40 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fe1ac0edc60 con 0x563c58670b40 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b4015c60 con 0x563c58670b40 2024-09-15T22:53:21.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe1ac0bc0b0 con 0x563c58670b40 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c68ec740 10 client.17085 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.892+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563c58688ad0 con 0x563c58670b40 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b4015c60 con 0x563c58670b40 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fe1ac0b8be0 con 0x563c58670b40 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 10 client.17085 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 10 client.17085 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 20 client.17085 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c58689f80 0x563c5868c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 4 client.17085 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c585e2860 con 0x563c58689f80 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.893+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c58689f80 0x563c5868c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.894+0000 7fe1a5ffb640 10 client.17085 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.894+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c58689f80 0x563c5868c3b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d553e33e178bd53b server_cookie=a280aec652a48b1c in_seq=0 out_seq=0 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.894+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1961410126 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c585e2860 con 0x563c58689f80 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.894+0000 7fe1a5ffb640 10 client.17085 handle_command_reply: tid=0 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.894+0000 7fe1c68ec740 1 client.17085 shutdown 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 msgr2=0x563c58676fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0edfe0 tx=0x7fe1ac0b1a00 comp rx=0 tx=0).stop 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 shutdown_connections 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c58689f80 0x563c5868c3b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5867a370 0x563c586775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c58670b40 0x563c58676fe0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1961410126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c58679d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1a5ffb640 0 client.17085 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:53:21.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 >> 172.21.15.66:0/1961410126 conn(0x563c58638310 msgr2=0x563c58671960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 shutdown_connections 2024-09-15T22:53:21.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1961410126 wait complete. 2024-09-15T22:53:21.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.895+0000 7fe1c68ec740 20 client.17085 trim_cache size 0 max 16384 2024-09-15T22:53:21.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 Processor -- start 2024-09-15T22:53:21.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 -- start start 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5866f5d0 0x563c5866be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c58670b40 0x563c58686310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1b13f0 con 0x563c5867a370 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1b30b0 con 0x563c5866f5d0 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1b1ac0 con 0x563c58670b40 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35866/0 (socket says 172.21.15.66:35866) 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1506717646 learned_addr learned my addr 172.21.15.66:0/1506717646 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c58670b40 0x563c58686310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5866f5d0 0x563c5866be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1506717646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c58670b40 msgr2=0x563c58686310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c58670b40 0x563c58686310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1506717646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5866f5d0 msgr2=0x563c5866be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5866f5d0 0x563c5866be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1506717646 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58677940 con 0x563c5867a370 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.909+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e000 tx=0x7fe1b4025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9376b5186251a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1a7fff640 1 -- 172.21.15.66:0/1506717646 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b401d050 con 0x563c5867a370 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1a7fff640 1 -- 172.21.15.66:0/1506717646 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b402f070 con 0x563c5867a370 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1a7fff640 1 -- 172.21.15.66:0/1506717646 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4021920 con 0x563c5867a370 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1506717646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 msgr2=0x563c58691c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400e000 tx=0x7fe1b4025000 comp rx=0 tx=0).stop 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1506717646 shutdown_connections 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c58691c80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c58670b40 0x563c58686310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1506717646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c5866f5d0 0x563c5866be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1506717646 >> 172.21.15.66:0/1506717646 conn(0x563c58638310 msgr2=0x563c5866b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1506717646 shutdown_connections 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.910+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1506717646 wait complete. 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 -- start start 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 Processor -- start 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5867e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 0x563c5867ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1b2920 con 0x563c5867a370 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1b2190 con 0x563c58670b40 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc1af3f0 con 0x563c5866f5d0 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c68ec740 10 client.0 _ll_register_callbacks cb 0x7fe1ac005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c2ab0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35874/0 (socket says 172.21.15.66:35874) 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1732415427 learned_addr learned my addr 172.21.15.66:0/1732415427 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 0x563c5867ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.911+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5867e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 msgr2=0x563c5867e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5867e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1732415427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 msgr2=0x563c5867ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 0x563c5867ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 -- 172.21.15.66:0/1732415427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5867f320 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c1aae640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 0x563c5867ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c2ab0640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009f40 tx=0x7fe1b4015640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bf7a179ad60779 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40218e0 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fe1b4021a80 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b402f070 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe1b401d030 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c68ec740 10 client.17091 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563c586f5270 con 0x563c5867a370 2024-09-15T22:53:21.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.912+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b402f070 con 0x563c5867a370 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fe1b402a980 con 0x563c5867a370 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 10 client.17091 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 10 client.17091 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 20 client.17091 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c586f5730 0x563c586f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 4 client.17091 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c585dcd70 con 0x563c586f5730 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c586f5730 0x563c586f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1c22af640 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c586f5730 0x563c586f7b20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2f58609c68fcb69a server_cookie=7588a3a865404903 in_seq=0 out_seq=0 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.913+0000 7fe1a5ffb640 10 client.17091 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1a5ffb640 1 -- 172.21.15.66:0/1732415427 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c585dcd70 con 0x563c586f5730 2024-09-15T22:53:21.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1a5ffb640 10 client.17091 handle_command_reply: tid=0 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 client.17091 shutdown 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 msgr2=0x563c586f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009f40 tx=0x7fe1b4015640 comp rx=0 tx=0).stop 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 shutdown_connections 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563c586f5730 0x563c586f7b20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563c5867a370 0x563c586f3c50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563c58670b40 0x563c5867ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 --2- 172.21.15.66:0/1732415427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563c5866f5d0 0x563c5867e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1a5ffb640 0 client.17091 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 >> 172.21.15.66:0/1732415427 conn(0x563c58638310 msgr2=0x563c58671110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 shutdown_connections 2024-09-15T22:53:21.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 1 -- 172.21.15.66:0/1732415427 wait complete. 2024-09-15T22:53:21.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c68ec740 20 client.17091 trim_cache size 0 max 16384 2024-09-15T22:53:21.927 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 msgr2=0x7fe1a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 0x7fe1a80a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4020000 tx=0x7fe1b401e000 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 msgr2=0x7fe1bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.914+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005ab0 tx=0x7fe1ac0042f0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 shutdown_connections 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe1a80a33b0 0x7fe1a80a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc106f10 0x7fe1bc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1bc102790 0x7fe1bc074a30 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 --2- 172.21.15.66:0/1630406389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1bc101de0 0x7fe1bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:21.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 >> 172.21.15.66:0/1630406389 conn(0x7fe1bc0fd8c0 msgr2=0x7fe1bc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:21.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 shutdown_connections 2024-09-15T22:53:21.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:21.915+0000 7fe1c4513640 1 -- 172.21.15.66:0/1630406389 wait complete. 2024-09-15T22:53:22.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:53:22.934 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:23.346 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:23 smithi066 ceph-mon[31185]: pgmap v247: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-15T22:53:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:23 smithi087 ceph-mon[35290]: pgmap v247: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-15T22:53:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:23 smithi184 ceph-mon[35203]: pgmap v247: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 -- 172.21.15.66:0/3312244286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 msgr2=0x7f49a01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 --2- 172.21.15.66:0/3312244286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01067e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4990009900 tx=0x7f499002a410 comp rx=0 tx=0).stop 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 -- 172.21.15.66:0/3312244286 shutdown_connections 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 --2- 172.21.15.66:0/3312244286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0106f10 0x7f49a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 --2- 172.21.15.66:0/3312244286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01067e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 --2- 172.21.15.66:0/3312244286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0101de0 0x7f49a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 -- 172.21.15.66:0/3312244286 >> 172.21.15.66:0/3312244286 conn(0x7f49a00fd8c0 msgr2=0x7f49a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 -- 172.21.15.66:0/3312244286 shutdown_connections 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.428+0000 7f49a85b2640 1 -- 172.21.15.66:0/3312244286 wait complete. 2024-09-15T22:53:23.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 Processor -- start 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 -- start start 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 0x7f49a0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 0x7f49a019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0111f70 con 0x7f49a0102790 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0111df0 con 0x7f49a0106f10 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a85b2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01120f0 con 0x7f49a0101de0 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44648/0 (socket says 172.21.15.66:44648) 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.429+0000 7f49a5b4d640 1 -- 172.21.15.66:0/1240403632 learned_addr learned my addr 172.21.15.66:0/1240403632 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 0x7f49a019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a634e640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 0x7f49a0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 -- 172.21.15.66:0/1240403632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 msgr2=0x7f49a0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 0x7f49a0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 -- 172.21.15.66:0/1240403632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 msgr2=0x7f49a019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 0x7f49a019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 -- 172.21.15.66:0/1240403632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a019d310 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 0x7f49a019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a634e640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 0x7f49a0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4990006010 tx=0x7f49900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49977fe640 1 -- 172.21.15.66:0/1240403632 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499003f030 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a019d5a0 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49977fe640 1 -- 172.21.15.66:0/1240403632 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4990003ce0 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49977fe640 1 -- 172.21.15.66:0/1240403632 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990035070 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.430+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a01a4ee0 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.432+0000 7f49977fe640 1 -- 172.21.15.66:0/1240403632 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4990042030 con 0x7f49a0102790 2024-09-15T22:53:23.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 Processor -- start 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 -- start start 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49977fe640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 0x7f498c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efaea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efbb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55619ef142f0 con 0x55619efafb40 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55619eebbcf0 con 0x55619efb9370 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49aa98b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55619ef102b0 con 0x55619efae5d0 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 0x7f498c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49a634e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49977fe640 1 -- 172.21.15.66:0/1240403632 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f49900f0920 con 0x7f49a0102790 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49a634e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44652/0 (socket says 172.21.15.66:44652) 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.433+0000 7f49a634e640 1 -- 172.21.15.66:0/187705101 learned_addr learned my addr 172.21.15.66:0/187705101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:23.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efbb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efaea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 -- 172.21.15.66:0/187705101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 msgr2=0x55619efaea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efaea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 -- 172.21.15.66:0/187705101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 msgr2=0x55619efbb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efbb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 -- 172.21.15.66:0/187705101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619eea03a0 con 0x55619efafb40 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efbb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a634e640 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f499c00bc20 tx=0x7f499c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125f0f387444a454 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 0x7f498c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55619efaf070 tx=0x7f49980097a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f4994ff9640 1 -- 172.21.15.66:0/187705101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c017620 con 0x55619efafb40 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f4994ff9640 1 -- 172.21.15.66:0/187705101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499c017ca0 con 0x55619efafb40 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.434+0000 7f4994ff9640 1 -- 172.21.15.66:0/187705101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c00fc90 con 0x55619efafb40 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- 172.21.15.66:0/187705101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 msgr2=0x55619efae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f499c00bc20 tx=0x7f499c00d710 comp rx=0 tx=0).stop 2024-09-15T22:53:23.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- 172.21.15.66:0/187705101 shutdown_connections 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efbb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efaea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 --2- 172.21.15.66:0/187705101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efae090 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- 172.21.15.66:0/187705101 >> 172.21.15.66:0/187705101 conn(0x55619ef77310 msgr2=0x55619efaac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- 172.21.15.66:0/187705101 shutdown_connections 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- 172.21.15.66:0/187705101 wait complete. 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 -- start start 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.435+0000 7f49aa98b740 1 Processor -- start 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efb64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55619efbc070 con 0x55619efafb40 2024-09-15T22:53:23.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55619eecf060 con 0x55619efb9370 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55619efbc1f0 con 0x55619efae5d0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 10 client.0 _ll_register_callbacks cb 0x55619ec228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44664/0 (socket says 172.21.15.66:44664) 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 -- 172.21.15.66:0/2238553563 learned_addr learned my addr 172.21.15.66:0/2238553563 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a634e640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 -- 172.21.15.66:0/2238553563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 msgr2=0x55619efb8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efb8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efb64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 -- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 msgr2=0x55619efb64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efb64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 -- 172.21.15.66:0/2238553563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619ec853c0 con 0x55619efafb40 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a634e640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efb8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4990005ab0 tx=0x7f49900bc370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5151f725f32b3cff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f4989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990049040 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f49900ede60 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.436+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c017ca0 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f499003bcb0 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 10 client.17103 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55619efc7a80 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499c017ca0 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f49900bca90 con 0x55619efafb40 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 10 client.17103 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 10 client.17103 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 20 client.17103 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619efc8ee0 0x55619efcb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 4 client.17103 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619ef21860 con 0x55619efc8ee0 2024-09-15T22:53:23.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.437+0000 7f49a634e640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619efc8ee0 0x55619efcb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.438+0000 7f49a634e640 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619efc8ee0 0x55619efcb350 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=806edb6e5a570714 server_cookie=29a0a1043ad44527 in_seq=0 out_seq=0 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.438+0000 7f4989ffb640 10 client.17103 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.438+0000 7f4989ffb640 1 -- 172.21.15.66:0/2238553563 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55619ef21860 con 0x55619efc8ee0 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.438+0000 7f4989ffb640 10 client.17103 handle_command_reply: tid=0 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.438+0000 7f49aa98b740 1 client.17103 shutdown 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 msgr2=0x55619efb5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4990005ab0 tx=0x7f49900bc370 comp rx=0 tx=0).stop 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 shutdown_connections 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619efc8ee0 0x55619efcb350 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efb64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efb5f70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f4989ffb640 0 client.17103 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 --2- 172.21.15.66:0/2238553563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efb8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 >> 172.21.15.66:0/2238553563 conn(0x55619ef77310 msgr2=0x55619efb0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 shutdown_connections 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 1 -- 172.21.15.66:0/2238553563 wait complete. 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.439+0000 7f49aa98b740 20 client.17103 trim_cache size 0 max 16384 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 Processor -- start 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 -- start start 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efc5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efc1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01af1f0 con 0x55619efafb40 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b0eb0 con 0x55619efb9370 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49aa98b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01af8c0 con 0x55619efae5d0 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44672/0 (socket says 172.21.15.66:44672) 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 -- 172.21.15.66:0/4053106477 learned_addr learned my addr 172.21.15.66:0/4053106477 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 -- 172.21.15.66:0/4053106477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 msgr2=0x55619efc5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efc5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 -- 172.21.15.66:0/4053106477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 msgr2=0x55619efc1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efc1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 -- 172.21.15.66:0/4053106477 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619efb1120 con 0x55619efafb40 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f49900e9040 tx=0x7f49900bad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0036b7f212576a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f498bfff640 1 -- 172.21.15.66:0/4053106477 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990049040 con 0x55619efafb40 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f498bfff640 1 -- 172.21.15.66:0/4053106477 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499003b580 con 0x55619efafb40 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.452+0000 7f498bfff640 1 -- 172.21.15.66:0/4053106477 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900044e0 con 0x55619efafb40 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- 172.21.15.66:0/4053106477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 msgr2=0x55619efc1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f49900e9040 tx=0x7f49900bad40 comp rx=0 tx=0).stop 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- 172.21.15.66:0/4053106477 shutdown_connections 2024-09-15T22:53:23.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619efc1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efafb40 0x55619efc1860 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 --2- 172.21.15.66:0/4053106477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efae5d0 0x55619efc5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- 172.21.15.66:0/4053106477 >> 172.21.15.66:0/4053106477 conn(0x55619ef77310 msgr2=0x55619efb4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- 172.21.15.66:0/4053106477 shutdown_connections 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- 172.21.15.66:0/4053106477 wait complete. 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.453+0000 7f49aa98b740 1 -- start start 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 Processor -- start 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efafb40 0x55619f02c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619f02c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b0720 con 0x55619efae5d0 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01aff90 con 0x55619efb9370 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01ad1f0 con 0x55619efafb40 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49aa98b740 10 client.0 _ll_register_callbacks cb 0x7f49900b8410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44674/0 (socket says 172.21.15.66:44674) 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 -- 172.21.15.66:0/3053592358 learned_addr learned my addr 172.21.15.66:0/3053592358 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:23.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a6b4f640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619f02c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efafb40 0x55619f02c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 -- 172.21.15.66:0/3053592358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efafb40 msgr2=0x55619f02c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efafb40 0x55619f02c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 -- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 msgr2=0x55619f02c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619f02c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 -- 172.21.15.66:0/3053592358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619f036ed0 con 0x55619efae5d0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f49a634e640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a842385f85ffe3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.454+0000 7f4989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c02f060 con 0x55619efae5d0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f499c00fb00 con 0x55619efae5d0 2024-09-15T22:53:23.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55619ef1bd70 con 0x55619efae5d0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f499c036050 con 0x55619efae5d0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 10 client.17109 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55619f038210 con 0x55619efae5d0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55619ef1bd70 con 0x55619efae5d0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f499c029030 con 0x55619efae5d0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 10 client.17109 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 10 client.17109 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 20 client.17109 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619f038800 0x55619f03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 4 client.17109 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.455+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55619ee98170 con 0x55619f038800 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619f038800 0x55619f03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49a5b4d640 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619f038800 0x55619f03ac20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d94efbdcbbba5447 server_cookie=f5f0ddd15926a4d in_seq=0 out_seq=0 2024-09-15T22:53:23.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f4989ffb640 10 client.17109 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f4989ffb640 1 -- 172.21.15.66:0/3053592358 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55619ee98170 con 0x55619f038800 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f4989ffb640 10 client.17109 handle_command_reply: tid=0 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 client.17109 shutdown 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 msgr2=0x55619f02bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c005f80 comp rx=0 tx=0).stop 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 shutdown_connections 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55619f038800 0x55619f03ac20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55619efb9370 0x55619f02c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55619efafb40 0x55619f02c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f4989ffb640 0 client.17109 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 --2- 172.21.15.66:0/3053592358 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55619efae5d0 0x55619f02bbb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 >> 172.21.15.66:0/3053592358 conn(0x55619ef77310 msgr2=0x55619efb7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 shutdown_connections 2024-09-15T22:53:23.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.456+0000 7f49aa98b740 1 -- 172.21.15.66:0/3053592358 wait complete. 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49aa98b740 20 client.17109 trim_cache size 0 max 16384 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 msgr2=0x7f498c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 0x7f498c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55619efaf070 tx=0x7f49980097a0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 msgr2=0x7f49a01988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4990006010 tx=0x7f49900042f0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 shutdown_connections 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f498c0a33b0 0x7f498c0a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0106f10 0x7f49a019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a0102790 0x7f49a01988a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 --2- 172.21.15.66:0/1240403632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49a0101de0 0x7f49a0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 >> 172.21.15.66:0/1240403632 conn(0x7f49a00fd8c0 msgr2=0x7f49a00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 shutdown_connections 2024-09-15T22:53:23.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:23.457+0000 7f49a85b2640 1 -- 172.21.15.66:0/1240403632 wait complete. 2024-09-15T22:53:24.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:53:24.590 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:25.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 -- 172.21.15.66:0/4093186708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102ef0 msgr2=0x7fce6c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 --2- 172.21.15.66:0/4093186708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102ef0 0x7fce6c10da40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fce64009ca0 tx=0x7fce6402a950 comp rx=0 tx=0).stop 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 -- 172.21.15.66:0/4093186708 shutdown_connections 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 --2- 172.21.15.66:0/4093186708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102ef0 0x7fce6c10da40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 --2- 172.21.15.66:0/4093186708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102570 0x7fce6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 --2- 172.21.15.66:0/4093186708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 0x7fce6c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 -- 172.21.15.66:0/4093186708 >> 172.21.15.66:0/4093186708 conn(0x7fce6c0fc7d0 msgr2=0x7fce6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 -- 172.21.15.66:0/4093186708 shutdown_connections 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 -- 172.21.15.66:0/4093186708 wait complete. 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.073+0000 7fce740ef640 1 Processor -- start 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 -- start start 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 0x7fce6c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102ef0 0x7fce6c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c110fd0 con 0x7fce6c102570 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c110e50 con 0x7fce6c100e20 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce740ef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c111150 con 0x7fce6c102ef0 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44694/0 (socket says 172.21.15.66:44694) 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 -- 172.21.15.66:0/2080240693 learned_addr learned my addr 172.21.15.66:0/2080240693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce71e8b640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 0x7fce6c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7268c640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102ef0 0x7fce6c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 -- 172.21.15.66:0/2080240693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102ef0 msgr2=0x7fce6c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102ef0 0x7fce6c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 -- 172.21.15.66:0/2080240693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 msgr2=0x7fce6c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 0x7fce6c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.074+0000 7fce7168a640 1 -- 172.21.15.66:0/2080240693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c19f680 con 0x7fce6c102570 2024-09-15T22:53:25.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce7168a640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00e9f0 tx=0x7fce5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce62ffd640 1 -- 172.21.15.66:0/2080240693 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00cd80 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce62ffd640 1 -- 172.21.15.66:0/2080240693 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce5c005500 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c19f970 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce62ffd640 1 -- 172.21.15.66:0/2080240693 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c010690 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.075+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c1a7250 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.077+0000 7fce62ffd640 1 -- 172.21.15.66:0/2080240693 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fce5c0046c0 con 0x7fce6c102570 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.077+0000 7fce764c8740 1 Processor -- start 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 -- start start 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea8177a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8182370 0x563ea8184760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563ea80dd2f0 con 0x563ea8178b40 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563ea8084cf0 con 0x563ea8182370 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce764c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563ea80d92b0 con 0x563ea81775d0 2024-09-15T22:53:25.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce62ffd640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 0x7fce580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44702/0 (socket says 172.21.15.66:44702) 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 -- 172.21.15.66:0/521113171 learned_addr learned my addr 172.21.15.66:0/521113171 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce71e8b640 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea8177a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 0x7fce580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce62ffd640 1 -- 172.21.15.66:0/2080240693 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fce5c0d04d0 con 0x7fce6c102570 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7168a640 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8182370 0x563ea8184760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 -- 172.21.15.66:0/521113171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 msgr2=0x563ea8177a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea8177a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 -- 172.21.15.66:0/521113171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8182370 msgr2=0x563ea8184760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8182370 0x563ea8184760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.078+0000 7fce7268c640 1 -- 172.21.15.66:0/521113171 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea80693a0 con 0x563ea8178b40 2024-09-15T22:53:25.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.079+0000 7fce7268c640 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce64009430 tx=0x7fce64003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7c1a52135b557 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.079+0000 7fce7268c640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 0x7fce580a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce6402ae70 tx=0x7fce64043000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.079+0000 7fce57fff640 1 -- 172.21.15.66:0/521113171 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64034040 con 0x563ea8178b40 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.079+0000 7fce57fff640 1 -- 172.21.15.66:0/521113171 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6404e070 con 0x563ea8178b40 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.079+0000 7fce57fff640 1 -- 172.21.15.66:0/521113171 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64004760 con 0x563ea8178b40 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- 172.21.15.66:0/521113171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 msgr2=0x563ea8177090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fce64009430 tx=0x7fce64003cd0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- 172.21.15.66:0/521113171 shutdown_connections 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8182370 0x563ea8184760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea8177a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 --2- 172.21.15.66:0/521113171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8178b40 0x563ea8177090 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- 172.21.15.66:0/521113171 >> 172.21.15.66:0/521113171 conn(0x563ea8140310 msgr2=0x563ea8173c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- 172.21.15.66:0/521113171 shutdown_connections 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- 172.21.15.66:0/521113171 wait complete. 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 -- start start 2024-09-15T22:53:25.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.080+0000 7fce764c8740 1 Processor -- start 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8181da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563ea8185010 con 0x563ea8182370 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563ea8098060 con 0x563ea81775d0 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563ea8185190 con 0x563ea8178b40 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce764c8740 10 client.0 _ll_register_callbacks cb 0x563ea7deb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44708/0 (socket says 172.21.15.66:44708) 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7168a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 -- 172.21.15.66:0/1922117994 learned_addr learned my addr 172.21.15.66:0/1922117994 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce71e8b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8181da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 -- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 msgr2=0x563ea817f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 -- 172.21.15.66:0/1922117994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 msgr2=0x563ea8181da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8181da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 -- 172.21.15.66:0/1922117994 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea7e4e3c0 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.081+0000 7fce7268c640 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce640093a0 tx=0x7fce64005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40affd94c1a39360 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.082+0000 7fce557fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64056070 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fce64004240 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce6404e070 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fce64004440 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 10 client.17121 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563ea8185010 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6404e070 con 0x563ea8182370 2024-09-15T22:53:25.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fce64030440 con 0x563ea8182370 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 10 client.17121 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 10 client.17121 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 20 client.17121 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea8191c70 0x563ea8194060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 4 client.17121 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.083+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ea80ea860 con 0x563ea8191c70 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.084+0000 7fce71e8b640 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea8191c70 0x563ea8194060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.084+0000 7fce557fa640 10 client.17121 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.084+0000 7fce71e8b640 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea8191c70 0x563ea8194060 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be428aee0c5704cb server_cookie=f83ae1a1627eadf1 in_seq=0 out_seq=0 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce557fa640 1 -- 172.21.15.66:0/1922117994 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ea80ea860 con 0x563ea8191c70 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce557fa640 10 client.17121 handle_command_reply: tid=0 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 client.17121 shutdown 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 msgr2=0x563ea817f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fce640093a0 tx=0x7fce64005d80 comp rx=0 tx=0).stop 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 shutdown_connections 2024-09-15T22:53:25.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea8191c70 0x563ea8194060 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817f7e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 --2- 172.21.15.66:0/1922117994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8181da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce557fa640 0 client.17121 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 >> 172.21.15.66:0/1922117994 conn(0x563ea8140310 msgr2=0x563ea8179960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 shutdown_connections 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 1 -- 172.21.15.66:0/1922117994 wait complete. 2024-09-15T22:53:25.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.085+0000 7fce764c8740 20 client.17121 trim_cache size 0 max 16384 2024-09-15T22:53:25.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 Processor -- start 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 -- start start 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8173d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1b1400 con 0x563ea8182370 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1b30c0 con 0x563ea81775d0 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.098+0000 7fce764c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1b1ad0 con 0x563ea8178b40 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44718/0 (socket says 172.21.15.66:44718) 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 -- 172.21.15.66:0/1807284454 learned_addr learned my addr 172.21.15.66:0/1807284454 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce71e8b640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8173d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7168a640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 -- 172.21.15.66:0/1807284454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 msgr2=0x563ea817a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 -- 172.21.15.66:0/1807284454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 msgr2=0x563ea8173d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8173d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 -- 172.21.15.66:0/1807284454 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea8178780 con 0x563ea8182370 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce71e8b640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8173d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7168a640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce7268c640 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce64009a60 tx=0x7fce64009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d213cdaedc10e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce577fe640 1 -- 172.21.15.66:0/1807284454 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64056040 con 0x563ea8182370 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce577fe640 1 -- 172.21.15.66:0/1807284454 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6404e070 con 0x563ea8182370 2024-09-15T22:53:25.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.099+0000 7fce577fe640 1 -- 172.21.15.66:0/1807284454 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64030ce0 con 0x563ea8182370 2024-09-15T22:53:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- 172.21.15.66:0/1807284454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 msgr2=0x563ea817a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fce64009a60 tx=0x7fce64009c20 comp rx=0 tx=0).stop 2024-09-15T22:53:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- 172.21.15.66:0/1807284454 shutdown_connections 2024-09-15T22:53:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817a660 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea8178b40 0x563ea817a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 --2- 172.21.15.66:0/1807284454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea81775d0 0x563ea8173d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- 172.21.15.66:0/1807284454 >> 172.21.15.66:0/1807284454 conn(0x563ea8140310 msgr2=0x563ea817e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- 172.21.15.66:0/1807284454 shutdown_connections 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- 172.21.15.66:0/1807284454 wait complete. 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.100+0000 7fce764c8740 1 -- start start 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 Processor -- start 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea818a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 0x563ea818aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1b2930 con 0x563ea8182370 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1b21a0 con 0x563ea8178b40 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1af400 con 0x563ea81775d0 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce764c8740 10 client.0 _ll_register_callbacks cb 0x7fce5c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:25.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44732/0 (socket says 172.21.15.66:44732) 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 -- 172.21.15.66:0/3041769645 learned_addr learned my addr 172.21.15.66:0/3041769645 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7168a640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 0x563ea818aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce71e8b640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea818a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 -- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 msgr2=0x563ea818a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea818a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 -- 172.21.15.66:0/3041769645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 msgr2=0x563ea818aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 0x563ea818aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7268c640 1 -- 172.21.15.66:0/3041769645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea817c190 con 0x563ea8182370 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.101+0000 7fce7168a640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 0x563ea818aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce7268c640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce6402f410 tx=0x7fce64044160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5e00b1d789124b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:25.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6406c020 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fce64030c60 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce6404e070 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fce64077050 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce764c8740 10 client.17127 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563ea81fc290 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6404e070 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.102+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fce6405ba60 con 0x563ea8182370 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 10 client.17127 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 10 client.17127 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 20 client.17127 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea81fc9e0 0x563ea81fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 4 client.17127 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:53:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ea80e4d70 con 0x563ea81fc9e0 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce71e8b640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea81fc9e0 0x563ea81fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce557fa640 10 client.17127 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.103+0000 7fce71e8b640 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea81fc9e0 0x563ea81fee00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4edf21d17acf528f server_cookie=766baa16d32ab15d in_seq=0 out_seq=0 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce557fa640 1 -- 172.21.15.66:0/3041769645 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ea80e4d70 con 0x563ea81fc9e0 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce557fa640 10 client.17127 handle_command_reply: tid=0 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 client.17127 shutdown 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 msgr2=0x563ea817b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fce6402f410 tx=0x7fce64044160 comp rx=0 tx=0).stop 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 shutdown_connections 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563ea81fc9e0 0x563ea81fee00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563ea8182370 0x563ea817b960 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce557fa640 0 client.17127 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563ea8178b40 0x563ea818aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 --2- 172.21.15.66:0/3041769645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563ea81775d0 0x563ea818a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 >> 172.21.15.66:0/3041769645 conn(0x563ea8140310 msgr2=0x563ea81724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 shutdown_connections 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 1 -- 172.21.15.66:0/3041769645 wait complete. 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.104+0000 7fce764c8740 20 client.17127 trim_cache size 0 max 16384 2024-09-15T22:53:25.112 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 msgr2=0x7fce580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 0x7fce580a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce6402ae70 tx=0x7fce64043000 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 msgr2=0x7fce6c19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00e9f0 tx=0x7fce5c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 shutdown_connections 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fce580a3430 0x7fce580a58f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c102ef0 0x7fce6c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce6c102570 0x7fce6c19ac10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 --2- 172.21.15.66:0/2080240693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce6c100e20 0x7fce6c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 >> 172.21.15.66:0/2080240693 conn(0x7fce6c0fc7d0 msgr2=0x7fce6c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 shutdown_connections 2024-09-15T22:53:25.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:25.105+0000 7fce740ef640 1 -- 172.21.15.66:0/2080240693 wait complete. 2024-09-15T22:53:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:25 smithi087 ceph-mon[35290]: pgmap v248: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:25 smithi184 ceph-mon[35203]: pgmap v248: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:25.428 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:25 smithi066 ceph-mon[31185]: pgmap v248: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:25.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:53:26.108 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.595+0000 7fa109726640 1 -- 172.21.15.66:0/2942684830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074f40 msgr2=0x7fa10410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.595+0000 7fa109726640 1 --2- 172.21.15.66:0/2942684830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074f40 0x7fa10410de80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009900 tx=0x7fa0f402a480 comp rx=0 tx=0).stop 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 -- 172.21.15.66:0/2942684830 shutdown_connections 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 --2- 172.21.15.66:0/2942684830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 0x7fa104110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 --2- 172.21.15.66:0/2942684830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074f40 0x7fa10410de80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 --2- 172.21.15.66:0/2942684830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa104074620 0x7fa104074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 -- 172.21.15.66:0/2942684830 >> 172.21.15.66:0/2942684830 conn(0x7fa1040fd8c0 msgr2=0x7fa1040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 -- 172.21.15.66:0/2942684830 shutdown_connections 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 -- 172.21.15.66:0/2942684830 wait complete. 2024-09-15T22:53:26.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.596+0000 7fa109726640 1 Processor -- start 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 -- start start 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa104074f40 0x7fa10419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 0x7fa10419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041141b0 con 0x7fa104074620 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa104114030 con 0x7fa10410e3c0 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa109726640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa104114330 con 0x7fa104074f40 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44760/0 (socket says 172.21.15.66:44760) 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 -- 172.21.15.66:0/98234500 learned_addr learned my addr 172.21.15.66:0/98234500 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa1037fe640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 0x7fa10419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 -- 172.21.15.66:0/98234500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa104074f40 msgr2=0x7fa10419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa104074f40 0x7fa10419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 -- 172.21.15.66:0/98234500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 msgr2=0x7fa10419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 0x7fa10419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 -- 172.21.15.66:0/98234500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10419f660 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.597+0000 7fa102ffd640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00d770 tx=0x7fa0ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.598+0000 7fa0fbfff640 1 -- 172.21.15.66:0/98234500 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec017070 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.598+0000 7fa0fbfff640 1 -- 172.21.15.66:0/98234500 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ec005500 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.598+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10419f950 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.598+0000 7fa0fbfff640 1 -- 172.21.15.66:0/98234500 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec004e00 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.598+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041a7230 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.600+0000 7fa0fbfff640 1 -- 172.21.15.66:0/98234500 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa0ec004fa0 con 0x7fa104074620 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.600+0000 7fa10baff740 1 Processor -- start 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.600+0000 7fa10baff740 1 -- start start 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168e5d0 0x5589d168ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 0x5589d169b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589d15f42f0 con 0x5589d168e5d0 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5589d159bcf0 con 0x5589d168fb40 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa10baff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5589d15f02b0 con 0x5589d1699370 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa102ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168e5d0 0x5589d168ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55168/0 (socket says 172.21.15.66:55168) 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 -- 172.21.15.66:0/599529397 learned_addr learned my addr 172.21.15.66:0/599529397 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa0fbfff640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 0x7fa0f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1027fc640 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 0x5589d169b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 -- 172.21.15.66:0/599529397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 msgr2=0x5589d169b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 0x5589d169b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 -- 172.21.15.66:0/599529397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168e5d0 msgr2=0x5589d168ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168e5d0 0x5589d168ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 -- 172.21.15.66:0/599529397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589d15803a0 con 0x5589d168fb40 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 0x7fa0f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa0fbfff640 1 -- 172.21.15.66:0/98234500 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fa0ec0cfb20 con 0x7fa104074620 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1027fc640 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 0x5589d169b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.601+0000 7fa1037fe640 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc010440 tx=0x7fa0fc010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1416c5c0f5c7430c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa0f97fa640 1 -- 172.21.15.66:0/599529397 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc01d400 con 0x5589d168fb40 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa0f97fa640 1 -- 172.21.15.66:0/599529397 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc013520 con 0x5589d168fb40 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa0f97fa640 1 -- 172.21.15.66:0/599529397 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc011880 con 0x5589d168fb40 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa1037fe640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 0x7fa0f00a58f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc021000 tx=0x7fa0fc01e000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa10baff740 1 -- 172.21.15.66:0/599529397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 msgr2=0x5589d168e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.602+0000 7fa10baff740 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc010440 tx=0x7fa0fc010900 comp rx=0 tx=0).stop 2024-09-15T22:53:26.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- 172.21.15.66:0/599529397 shutdown_connections 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d1699370 0x5589d169b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168e5d0 0x5589d168ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- 172.21.15.66:0/599529397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d168e090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- 172.21.15.66:0/599529397 >> 172.21.15.66:0/599529397 conn(0x5589d1657310 msgr2=0x5589d168ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- 172.21.15.66:0/599529397 shutdown_connections 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- 172.21.15.66:0/599529397 wait complete. 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- start start 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 Processor -- start 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 0x5589d1698d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168fb40 0x5589d1696020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589d169c070 con 0x5589d1699370 2024-09-15T22:53:26.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5589d15af060 con 0x5589d168e5d0 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5589d169c1f0 con 0x5589d168fb40 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa10baff740 10 client.0 _ll_register_callbacks cb 0x5589d13028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.603+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44780/0 (socket says 172.21.15.66:44780) 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 -- 172.21.15.66:0/875212069 learned_addr learned my addr 172.21.15.66:0/875212069 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa102ffd640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 0x5589d1698d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1027fc640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168fb40 0x5589d1696020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 -- 172.21.15.66:0/875212069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168fb40 msgr2=0x5589d1696020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168fb40 0x5589d1696020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 -- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 msgr2=0x5589d1698d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 0x5589d1698d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 -- 172.21.15.66:0/875212069 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589d13653c0 con 0x5589d1699370 2024-09-15T22:53:26.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa102ffd640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 0x5589d1698d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa1037fe640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc011560 tx=0x7fa0fc011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391240bd56686d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa0ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc003b80 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0fc013520 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fa0fc003d20 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa0fc027480 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa10baff740 10 client.17139 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.604+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5589d16a7a80 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc013520 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fa0fc00f040 con 0x5589d1699370 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 10 client.17139 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:26.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 20 client.17139 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d16a8f40 0x5589d16ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 4 client.17139 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589d1601860 con 0x5589d16a8f40 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.605+0000 7fa102ffd640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d16a8f40 0x5589d16ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa102ffd640 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d16a8f40 0x5589d16ab330 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e77b731b15b025d server_cookie=3a07b0d0b5b4ce3d in_seq=0 out_seq=0 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa0ea7fc640 10 client.17139 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/875212069 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589d1601860 con 0x5589d16a8f40 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa0ea7fc640 10 client.17139 handle_command_reply: tid=0 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 client.17139 shutdown 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 msgr2=0x5589d1696610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc011560 tx=0x7fa0fc011df0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 shutdown_connections 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1696610 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168fb40 0x5589d1696020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d16a8f40 0x5589d16ab330 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 --2- 172.21.15.66:0/875212069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168e5d0 0x5589d1698d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 >> 172.21.15.66:0/875212069 conn(0x5589d1657310 msgr2=0x5589d1690960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.606+0000 7fa0ea7fc640 0 client.17139 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.607+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 shutdown_connections 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.607+0000 7fa10baff740 1 -- 172.21.15.66:0/875212069 wait complete. 2024-09-15T22:53:26.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.607+0000 7fa10baff740 20 client.17139 trim_cache size 0 max 16384 2024-09-15T22:53:26.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 Processor -- start 2024-09-15T22:53:26.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 -- start start 2024-09-15T22:53:26.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d168ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d16a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041b14a0 con 0x5589d1699370 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041b3160 con 0x5589d168fb40 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa10baff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041b1b70 con 0x5589d168e5d0 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa1037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44792/0 (socket says 172.21.15.66:44792) 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa1037fe640 1 -- 172.21.15.66:0/1829859481 learned_addr learned my addr 172.21.15.66:0/1829859481 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa102ffd640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d168ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.620+0000 7fa1027fc640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d16a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 -- 172.21.15.66:0/1829859481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 msgr2=0x5589d168ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d168ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 -- 172.21.15.66:0/1829859481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 msgr2=0x5589d16a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d16a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 -- 172.21.15.66:0/1829859481 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589d169bad0 con 0x5589d1699370 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1027fc640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d16a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa1037fe640 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009c60 tx=0x7fa0fc010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885ada606804d8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa0f8ff9640 1 -- 172.21.15.66:0/1829859481 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc013520 con 0x5589d1699370 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa0f8ff9640 1 -- 172.21.15.66:0/1829859481 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc009a00 con 0x5589d1699370 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.621+0000 7fa0f8ff9640 1 -- 172.21.15.66:0/1829859481 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc003de0 con 0x5589d1699370 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- 172.21.15.66:0/1829859481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 msgr2=0x5589d1691120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009c60 tx=0x7fa0fc010900 comp rx=0 tx=0).stop 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- 172.21.15.66:0/1829859481 shutdown_connections 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d1699370 0x5589d1691120 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d168fb40 0x5589d16a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- 172.21.15.66:0/1829859481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d168ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- 172.21.15.66:0/1829859481 >> 172.21.15.66:0/1829859481 conn(0x5589d1657310 msgr2=0x5589d168a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- 172.21.15.66:0/1829859481 shutdown_connections 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- 172.21.15.66:0/1829859481 wait complete. 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 -- start start 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 Processor -- start 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d169c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.622+0000 7fa10baff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 0x5589d1711b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041b29d0 con 0x5589d168fb40 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041b2240 con 0x5589d1699370 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041af4a0 con 0x5589d168e5d0 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 10 client.0 _ll_register_callbacks cb 0x7fa0fc013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:26.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44800/0 (socket says 172.21.15.66:44800) 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 -- 172.21.15.66:0/2531903303 learned_addr learned my addr 172.21.15.66:0/2531903303 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa102ffd640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d169c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1037fe640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 0x5589d1711b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 -- 172.21.15.66:0/2531903303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 msgr2=0x5589d169c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d169c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 -- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 msgr2=0x5589d1711b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 0x5589d1711b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 -- 172.21.15.66:0/2531903303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589d1712090 con 0x5589d168fb40 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1037fe640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 0x5589d1711b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa1027fc640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4031550 tx=0x7fa0f40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01ae43baa94341f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa0ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:26.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4035040 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0fc009a00 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.623+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fa0f4005450 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa0f404d050 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 10 client.17145 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5589d1713240 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc009a00 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7fa0f4003830 con 0x5589d168fb40 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 10 client.17145 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 10 client.17145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 20 client.17145 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d1713a80 0x5589d1715ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 4 client.17145 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:53:26.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589d15fbd70 con 0x5589d1713a80 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.624+0000 7fa102ffd640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d1713a80 0x5589d1715ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa102ffd640 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d1713a80 0x5589d1715ea0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12f183200fe99c55 server_cookie=6d4903f7f424c608 in_seq=0 out_seq=0 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa0ea7fc640 10 client.17145 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa0ea7fc640 1 -- 172.21.15.66:0/2531903303 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589d15fbd70 con 0x5589d1713a80 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa0ea7fc640 10 client.17145 handle_command_reply: tid=0 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 client.17145 shutdown 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 msgr2=0x5589d169cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4031550 tx=0x7fa0f40043b0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 shutdown_connections 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5589d1713a80 0x5589d1715ea0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5589d1699370 0x5589d1711b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589d168fb40 0x5589d169cf20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 --2- 172.21.15.66:0/2531903303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589d168e5d0 0x5589d169c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 >> 172.21.15.66:0/2531903303 conn(0x5589d1657310 msgr2=0x5589d1697880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa0ea7fc640 0 client.17145 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 shutdown_connections 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 1 -- 172.21.15.66:0/2531903303 wait complete. 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.625+0000 7fa10baff740 20 client.17145 trim_cache size 0 max 16384 2024-09-15T22:53:26.634 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 msgr2=0x7fa0f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 0x7fa0f00a58f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc021000 tx=0x7fa0fc01e000 comp rx=0 tx=0).stop 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 msgr2=0x7fa10419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00d770 tx=0x7fa0ec00dc30 comp rx=0 tx=0).stop 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 shutdown_connections 2024-09-15T22:53:26.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0f00a3430 0x7fa0f00a58f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10410e3c0 0x7fa10419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa104074f40 0x7fa10419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 --2- 172.21.15.66:0/98234500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa104074620 0x7fa10419a6b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 >> 172.21.15.66:0/98234500 conn(0x7fa1040fd8c0 msgr2=0x7fa1040fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 shutdown_connections 2024-09-15T22:53:26.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:26.626+0000 7fa109726640 1 -- 172.21.15.66:0/98234500 wait complete. 2024-09-15T22:53:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:27 smithi087 ceph-mon[35290]: pgmap v249: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:27.354 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:27 smithi066 ceph-mon[31185]: pgmap v249: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:27 smithi184 ceph-mon[35203]: pgmap v249: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:28.356 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:53:28.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:53:28.649 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 -- 172.21.15.66:0/3426859897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640101de0 msgr2=0x7f26401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 --2- 172.21.15.66:0/3426859897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640101de0 0x7f26401021c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2630009900 tx=0x7f263002a410 comp rx=0 tx=0).stop 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 -- 172.21.15.66:0/3426859897 shutdown_connections 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 --2- 172.21.15.66:0/3426859897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640106f10 0x7f264010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 --2- 172.21.15.66:0/3426859897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640102790 0x7f26401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 --2- 172.21.15.66:0/3426859897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640101de0 0x7f26401021c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 -- 172.21.15.66:0/3426859897 >> 172.21.15.66:0/3426859897 conn(0x7f26400fd8c0 msgr2=0x7f26400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 -- 172.21.15.66:0/3426859897 shutdown_connections 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.161+0000 7f2645c6f640 1 -- 172.21.15.66:0/3426859897 wait complete. 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 Processor -- start 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 -- start start 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640101de0 0x7f26401984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640106f10 0x7f264019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2640111f70 con 0x7f2640102790 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2640111df0 con 0x7f2640101de0 2024-09-15T22:53:29.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f2645c6f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f26401120f0 con 0x7f2640106f10 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44806/0 (socket says 172.21.15.66:44806) 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 -- 172.21.15.66:0/169034316 learned_addr learned my addr 172.21.15.66:0/169034316 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263f7fe640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640101de0 0x7f26401984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263ffff640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640106f10 0x7f264019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 -- 172.21.15.66:0/169034316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640106f10 msgr2=0x7f264019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640106f10 0x7f264019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 -- 172.21.15.66:0/169034316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640101de0 msgr2=0x7f26401984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640101de0 0x7f26401984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.162+0000 7f263effd640 1 -- 172.21.15.66:0/169034316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264019d480 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f263effd640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f263400d770 tx=0x7f263400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f263cff9640 1 -- 172.21.15.66:0/169034316 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634017070 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f263cff9640 1 -- 172.21.15.66:0/169034316 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2634005500 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264019d770 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f263cff9640 1 -- 172.21.15.66:0/169034316 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634004e00 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.163+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a5050 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.165+0000 7f263cff9640 1 -- 172.21.15.66:0/169034316 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2634004fa0 con 0x7f2640102790 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.165+0000 7f2648048740 1 Processor -- start 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 -- start start 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53155fa40 0x55f53155fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 0x55f531571540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f5314c5280 con 0x55f53156f150 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f53146cb10 con 0x55f531560360 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f2648048740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f5314c1240 con 0x55f53155fa40 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 0x55f531571540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53155fa40 0x55f53155fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 0x55f531571540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44818/0 (socket says 172.21.15.66:44818) 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263effd640 1 -- 172.21.15.66:0/2317799329 learned_addr learned my addr 172.21.15.66:0/2317799329 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263cff9640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 0x7f26280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263ffff640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 0x7f26280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263cff9640 1 -- 172.21.15.66:0/169034316 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f26340cfb20 con 0x7f2640102790 2024-09-15T22:53:29.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 -- 172.21.15.66:0/2317799329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53155fa40 msgr2=0x55f53155fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53155fa40 0x55f53155fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 -- 172.21.15.66:0/2317799329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 msgr2=0x55f531571540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 0x55f531571540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.166+0000 7f263f7fe640 1 -- 172.21.15.66:0/2317799329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5314791f0 con 0x55f531560360 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.167+0000 7f263f7fe640 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156ec10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2630005940 tx=0x7f2630005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0881c0caddbfc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.167+0000 7f263ffff640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 0x7f26280a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2638005fd0 tx=0x7f2638004ab0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.167+0000 7f2625ffb640 1 -- 172.21.15.66:0/2317799329 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630040070 con 0x55f531560360 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.167+0000 7f2625ffb640 1 -- 172.21.15.66:0/2317799329 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26300319f0 con 0x55f531560360 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.167+0000 7f2625ffb640 1 -- 172.21.15.66:0/2317799329 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630035040 con 0x55f531560360 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- 172.21.15.66:0/2317799329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 msgr2=0x55f53156ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156ec10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2630005940 tx=0x7f2630005e80 comp rx=0 tx=0).stop 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- 172.21.15.66:0/2317799329 shutdown_connections 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53156f150 0x55f531571540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156ec10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 --2- 172.21.15.66:0/2317799329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53155fa40 0x55f53155fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- 172.21.15.66:0/2317799329 >> 172.21.15.66:0/2317799329 conn(0x55f53155c0f0 msgr2=0x55f53155c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- 172.21.15.66:0/2317799329 shutdown_connections 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- 172.21.15.66:0/2317799329 wait complete. 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 -- start start 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.168+0000 7f2648048740 1 Processor -- start 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f53156cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f531571d20 con 0x55f53155fa40 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f53147ff10 con 0x55f531560360 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f531571ea0 con 0x55f53156f150 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 10 client.0 _ll_register_callbacks cb 0x55f531448a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44824/0 (socket says 172.21.15.66:44824) 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 -- 172.21.15.66:0/1993655514 learned_addr learned my addr 172.21.15.66:0/1993655514 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263ffff640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f53156cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263effd640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 -- 172.21.15.66:0/1993655514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 msgr2=0x55f53156cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f53156cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 -- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 msgr2=0x55f53156c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 -- 172.21.15.66:0/1993655514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5312366a0 con 0x55f53155fa40 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f263f7fe640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f263002a930 tx=0x7f263002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34bba0b942b1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f261effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:29.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263004b020 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f2630004040 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.169+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26300319f0 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2630056050 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 10 client.17157 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55f53157d970 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26300319f0 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f2630003780 con 0x55f53155fa40 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 10 client.17157 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 20 client.17157 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f53157ecc0 0x55f5315810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 4 client.17157 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:29.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5314d27f0 con 0x55f53157ecc0 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.170+0000 7f263effd640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f53157ecc0 0x55f5315810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.171+0000 7f261effd640 10 client.17157 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.171+0000 7f263effd640 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f53157ecc0 0x55f5315810b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53fa25814783c79 server_cookie=b817d36de81731d2 in_seq=0 out_seq=0 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.171+0000 7f261effd640 1 -- 172.21.15.66:0/1993655514 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5314d27f0 con 0x55f53157ecc0 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.171+0000 7f261effd640 10 client.17157 handle_command_reply: tid=0 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.171+0000 7f2648048740 1 client.17157 shutdown 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 msgr2=0x55f53156c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f263002a930 tx=0x7f263002ab90 comp rx=0 tx=0).stop 2024-09-15T22:53:29.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 shutdown_connections 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f53156cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f53157ecc0 0x55f5315810b0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f53156c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 --2- 172.21.15.66:0/1993655514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f53156c040 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 >> 172.21.15.66:0/1993655514 conn(0x55f53155c0f0 msgr2=0x55f531561e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f261effd640 0 client.17157 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 shutdown_connections 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 1 -- 172.21.15.66:0/1993655514 wait complete. 2024-09-15T22:53:29.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.172+0000 7f2648048740 20 client.17157 trim_cache size 0 max 16384 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.189+0000 7f2648048740 1 Processor -- start 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.189+0000 7f2648048740 1 -- start start 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.189+0000 7f2648048740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f53155fa40 0x55f53155b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.189+0000 7f2648048740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.189+0000 7f2648048740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f531586d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f2648048740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26401acf50 con 0x55f531560360 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f2648048740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f26401aec10 con 0x55f53155fa40 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f2648048740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f26401ad620 con 0x55f53156f150 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44838/0 (socket says 172.21.15.66:44838) 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 -- 172.21.15.66:0/3726010008 learned_addr learned my addr 172.21.15.66:0/3726010008 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:29.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263f7fe640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f53155fa40 0x55f53155b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 -- 172.21.15.66:0/3726010008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 msgr2=0x55f531586d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263ffff640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f531586d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f531586d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 -- 172.21.15.66:0/3726010008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f53155fa40 msgr2=0x55f53155b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f53155fa40 0x55f53155b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 -- 172.21.15.66:0/3726010008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53155bf20 con 0x55f531560360 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263ffff640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f531586d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f263effd640 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2634097ee0 tx=0x7f26340d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc7193a297a0ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f26257fa640 1 -- 172.21.15.66:0/3726010008 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634020040 con 0x55f531560360 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f26257fa640 1 -- 172.21.15.66:0/3726010008 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26340d4040 con 0x55f531560360 2024-09-15T22:53:29.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.190+0000 7f26257fa640 1 -- 172.21.15.66:0/3726010008 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634099d80 con 0x55f531560360 2024-09-15T22:53:29.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- 172.21.15.66:0/3726010008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 msgr2=0x55f531586820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2634097ee0 tx=0x7f26340d1040 comp rx=0 tx=0).stop 2024-09-15T22:53:29.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- 172.21.15.66:0/3726010008 shutdown_connections 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f531586d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f531560360 0x55f531586820 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 --2- 172.21.15.66:0/3726010008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f53155fa40 0x55f53155b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- 172.21.15.66:0/3726010008 >> 172.21.15.66:0/3726010008 conn(0x55f53155c0f0 msgr2=0x55f53155aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- 172.21.15.66:0/3726010008 shutdown_connections 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- 172.21.15.66:0/3726010008 wait complete. 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.191+0000 7f2648048740 1 -- start start 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 Processor -- start 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f531572f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f531573470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f5315739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26401ae480 con 0x55f53155fa40 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f26401adcf0 con 0x55f531560360 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f26401aaf50 con 0x55f53156f150 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f2648048740 10 client.0 _ll_register_callbacks cb 0x7f2634097d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f531572f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f531572f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44844/0 (socket says 172.21.15.66:44844) 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263f7fe640 1 -- 172.21.15.66:0/1088931367 learned_addr learned my addr 172.21.15.66:0/1088931367 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f5315739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263effd640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f531573470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 -- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 msgr2=0x55f531573470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f531573470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 -- 172.21.15.66:0/1088931367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 msgr2=0x55f531572f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:29.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f531572f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.192+0000 7f263ffff640 1 -- 172.21.15.66:0/1088931367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f531566de0 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f263ffff640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f5315739b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2638014fb0 tx=0x7f2638004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af9f439ec3a6aa4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f261effd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638028070 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f2638010780 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26340d4040 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2638034050 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f2648048740 10 client.26626 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55f5315e99c0 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.193+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26340d4040 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f2638023040 con 0x55f53156f150 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 10 client.26626 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 10 client.26626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 20 client.26626 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:29.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5315ea200 0x55f5315ec620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 4 client.26626 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f5314ccd00 con 0x55f5315ea200 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f263f7fe640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5315ea200 0x55f5315ec620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f263f7fe640 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5315ea200 0x55f5315ec620 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a54187fecd8b41c4 server_cookie=ffdadcd9744afbf3 in_seq=0 out_seq=0 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.194+0000 7f261effd640 10 client.26626 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f261effd640 1 -- 172.21.15.66:0/1088931367 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f5314ccd00 con 0x55f5315ea200 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f261effd640 10 client.26626 handle_command_reply: tid=0 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 client.26626 shutdown 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 msgr2=0x55f5315739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f5315739b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2638014fb0 tx=0x7f2638004a40 comp rx=0 tx=0).stop 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 shutdown_connections 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f53156f150 0x55f5315739b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5315ea200 0x55f5315ec620 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f531560360 0x55f531573470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.195+0000 7f2648048740 1 --2- 172.21.15.66:0/1088931367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f53155fa40 0x55f531572f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f261effd640 0 client.26626 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 >> 172.21.15.66:0/1088931367 conn(0x55f53155c0f0 msgr2=0x55f53155b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 shutdown_connections 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2648048740 1 -- 172.21.15.66:0/1088931367 wait complete. 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2648048740 20 client.26626 trim_cache size 0 max 16384 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "a7fa7375-33bf-46ab-8260-312679daa56f", 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:53:29.202 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:53:29.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 msgr2=0x7f26280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 0x7f26280a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2638005fd0 tx=0x7f2638004ab0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 msgr2=0x7f2640198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:29.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f263400d770 tx=0x7f263400dc30 comp rx=0 tx=0).stop 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 shutdown_connections 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f26280a33b0 0x7f26280a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2640106f10 0x7f264019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640102790 0x7f2640198a10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 --2- 172.21.15.66:0/169034316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2640101de0 0x7f26401984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.196+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 >> 172.21.15.66:0/169034316 conn(0x7f26400fd8c0 msgr2=0x7f26400fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.197+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 shutdown_connections 2024-09-15T22:53:29.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:29.197+0000 7f2645c6f640 1 -- 172.21.15.66:0/169034316 wait complete. 2024-09-15T22:53:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:29 smithi087 ceph-mon[35290]: pgmap v250: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:29 smithi184 ceph-mon[35203]: pgmap v250: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:29.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:29 smithi066 ceph-mon[31185]: pgmap v250: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:53:30.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:53:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:30 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:53:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:53:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:53:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:53:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:53:30.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:53:30.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:30 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:53:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:30 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:53:30.458 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:30.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 -- 172.21.15.66:0/2110300622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c102bf0 msgr2=0x7f851c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 --2- 172.21.15.66:0/2110300622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c102bf0 0x7f851c102fd0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f850c009900 tx=0x7f850c02a480 comp rx=0 tx=0).stop 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 -- 172.21.15.66:0/2110300622 shutdown_connections 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 --2- 172.21.15.66:0/2110300622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c10bfd0 0x7f851c10e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 --2- 172.21.15.66:0/2110300622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c103510 0x7f851c10ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 --2- 172.21.15.66:0/2110300622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c102bf0 0x7f851c102fd0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 -- 172.21.15.66:0/2110300622 >> 172.21.15.66:0/2110300622 conn(0x7f851c0fc610 msgr2=0x7f851c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:30.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 -- 172.21.15.66:0/2110300622 shutdown_connections 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.982+0000 7f851b59e640 1 -- 172.21.15.66:0/2110300622 wait complete. 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.983+0000 7f851b59e640 1 Processor -- start 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851b59e640 1 -- start start 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851b59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 0x7f851c0739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 0x7f851c0739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 0x7f851c0739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:41682/0 (socket says 172.21.15.66:41682) 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.984+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44860/0 (socket says 172.21.15.66:44860) 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f8519d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f8519d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55272/0 (socket says 172.21.15.66:55272) 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f851a59c640 1 -- 172.21.15.66:0/634622123 learned_addr learned my addr 172.21.15.66:0/634622123 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f851c111db0 con 0x7f851c10bfd0 2024-09-15T22:53:30.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f851c111c30 con 0x7f851c103510 2024-09-15T22:53:30.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.985+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f851c111f30 con 0x7f851c102bf0 2024-09-15T22:53:30.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 -- 172.21.15.66:0/634622123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 msgr2=0x7f851c0739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 0x7f851c0739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 -- 172.21.15.66:0/634622123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 msgr2=0x7f851c06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c06d530 con 0x7f851c10bfd0 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f851ad9d640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8514009fd0 tx=0x7f851400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.986+0000 7f8519d9b640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.987+0000 7f850b7fe640 1 -- 172.21.15.66:0/634622123 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851400ce20 con 0x7f851c10bfd0 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.987+0000 7f850b7fe640 1 -- 172.21.15.66:0/634622123 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8514005020 con 0x7f851c10bfd0 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.987+0000 7f850b7fe640 1 -- 172.21.15.66:0/634622123 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514010720 con 0x7f851c10bfd0 2024-09-15T22:53:30.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.987+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c06d820 con 0x7f851c10bfd0 2024-09-15T22:53:30.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.987+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c071760 con 0x7f851c10bfd0 2024-09-15T22:53:30.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.991+0000 7f850b7fe640 1 -- 172.21.15.66:0/634622123 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8514005540 con 0x7f851c10bfd0 2024-09-15T22:53:30.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.991+0000 7f8522fd9740 1 Processor -- start 2024-09-15T22:53:31.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.991+0000 7f850b7fe640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 0x7f85040a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 -- start start 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f850b7fe640 1 -- 172.21.15.66:0/634622123 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f85140d0740 con 0x7f851c10bfd0 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db44c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db451d0 0x55b24db3f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b24da9b2e0 con 0x55b24db3f870 2024-09-15T22:53:31.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b24da42ce0 con 0x55b24db448b0 2024-09-15T22:53:31.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8522fd9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b24da972a0 con 0x55b24db451d0 2024-09-15T22:53:31.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f851ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44868/0 (socket says 172.21.15.66:44868) 2024-09-15T22:53:31.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f851ad9d640 1 -- 172.21.15.66:0/1474371809 learned_addr learned my addr 172.21.15.66:0/1474371809 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f8519d9b640 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db451d0 0x55b24db3f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f851ad9d640 1 -- 172.21.15.66:0/1474371809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db451d0 msgr2=0x55b24db3f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.992+0000 7f851ad9d640 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db451d0 0x55b24db3f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.993+0000 7f851ad9d640 1 -- 172.21.15.66:0/1474371809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 msgr2=0x55b24db44c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.993+0000 7f851ad9d640 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db44c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.993+0000 7f851ad9d640 1 -- 172.21.15.66:0/1474371809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24da27440 con 0x55b24db3f870 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.993+0000 7f8519d9b640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 0x7f85040a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.993+0000 7f851ad9d640 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f85140a4cd0 tx=0x7f851409c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ade5eba2efc3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.994+0000 7f8508ff9640 1 -- 172.21.15.66:0/1474371809 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85140b4020 con 0x55b24db3f870 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.994+0000 7f8508ff9640 1 -- 172.21.15.66:0/1474371809 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85140a5200 con 0x55b24db3f870 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.994+0000 7f8508ff9640 1 -- 172.21.15.66:0/1474371809 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85140a4d70 con 0x55b24db3f870 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 -- 172.21.15.66:0/1474371809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 msgr2=0x55b24db3fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8519d9b640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 0x7f85040a5a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f851000bfd0 tx=0x7f851000b410 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f85140a4cd0 tx=0x7f851409c490 comp rx=0 tx=0).stop 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 -- 172.21.15.66:0/1474371809 shutdown_connections 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db3f870 0x55b24db3fcf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db451d0 0x55b24db3f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 --2- 172.21.15.66:0/1474371809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db44c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.995+0000 7f8522fd9740 1 -- 172.21.15.66:0/1474371809 >> 172.21.15.66:0/1474371809 conn(0x55b24db316b0 msgr2=0x55b24db31a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.996+0000 7f8522fd9740 1 -- 172.21.15.66:0/1474371809 shutdown_connections 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.996+0000 7f8522fd9740 1 -- 172.21.15.66:0/1474371809 wait complete. 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.996+0000 7f8522fd9740 1 -- start start 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 Processor -- start 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db3f870 0x55b24db4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db451d0 0x55b24db48890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b24db4bc90 con 0x55b24db451d0 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b24da56050 con 0x55b24db3f870 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b24db4be10 con 0x55b24db448b0 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8522fd9740 10 client.0 _ll_register_callbacks cb 0x55b24da96160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f851a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db3f870 0x55b24db4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8519d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8519d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:41694/0 (socket says 172.21.15.66:41694) 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f8519d9b640 1 -- 172.21.15.66:0/2665214173 learned_addr learned my addr 172.21.15.66:0/2665214173 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.997+0000 7f851ad9d640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db451d0 0x55b24db48890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 -- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db3f870 msgr2=0x55b24db4b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db3f870 0x55b24db4b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 -- 172.21.15.66:0/2665214173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db451d0 msgr2=0x55b24db48890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db451d0 0x55b24db48890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 -- 172.21.15.66:0/2665214173 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24d80c3c0 con 0x55b24db448b0 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.998+0000 7f8519d9b640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8510005fd0 tx=0x7f8510004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e541bc10e84cdab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.999+0000 7f8501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.999+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510022070 con 0x55b24db448b0 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.999+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f8510005220 con 0x55b24db448b0 2024-09-15T22:53:31.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:30.999+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85140a5200 con 0x55b24db448b0 2024-09-15T22:53:31.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.000+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8510005420 con 0x55b24db448b0 2024-09-15T22:53:31.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.000+0000 7f8522fd9740 10 client.26635 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:31.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.000+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b24db57730 con 0x55b24db448b0 2024-09-15T22:53:31.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85140a5200 con 0x55b24db448b0 2024-09-15T22:53:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f851001ea40 con 0x55b24db448b0 2024-09-15T22:53:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 10 client.26635 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 10 client.26635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 20 client.26635 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db58c90 0x55b24db5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 4 client.26635 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b24daa8850 con 0x55b24db58c90 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.001+0000 7f851a59c640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db58c90 0x55b24db5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.002+0000 7f851a59c640 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db58c90 0x55b24db5b080 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fee6e537d616383 server_cookie=f1a7570ffbf024a3 in_seq=0 out_seq=0 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.002+0000 7f8501ffb640 10 client.26635 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8501ffb640 1 -- 172.21.15.66:0/2665214173 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b24daa8850 con 0x55b24db58c90 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8501ffb640 10 client.26635 handle_command_reply: tid=0 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 client.26635 shutdown 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 msgr2=0x55b24db48350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8510005fd0 tx=0x7f8510004730 comp rx=0 tx=0).stop 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 shutdown_connections 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db451d0 0x55b24db48890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db448b0 0x55b24db48350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db58c90 0x55b24db5b080 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2665214173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db3f870 0x55b24db4b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 >> 172.21.15.66:0/2665214173 conn(0x55b24db316b0 msgr2=0x55b24db30d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.003+0000 7f8501ffb640 0 client.26635 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.004+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 shutdown_connections 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.004+0000 7f8522fd9740 1 -- 172.21.15.66:0/2665214173 wait complete. 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.004+0000 7f8522fd9740 20 client.26635 trim_cache size 0 max 16384 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.032+0000 7f8522fd9740 1 Processor -- start 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.032+0000 7f8522fd9740 1 -- start start 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db54f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db43d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b5770 con 0x55b24db316b0 2024-09-15T22:53:31.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b7430 con 0x55b24db448b0 2024-09-15T22:53:31.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f8522fd9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b5e40 con 0x55b24db3f870 2024-09-15T22:53:31.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f851a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f851a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44886/0 (socket says 172.21.15.66:44886) 2024-09-15T22:53:31.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f851a59c640 1 -- 172.21.15.66:0/2856066328 learned_addr learned my addr 172.21.15.66:0/2856066328 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.033+0000 7f851ad9d640 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db43d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 -- 172.21.15.66:0/2856066328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 msgr2=0x55b24db54f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db54f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 -- 172.21.15.66:0/2856066328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 msgr2=0x55b24db43d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db43d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 -- 172.21.15.66:0/2856066328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b24db4bad0 con 0x55b24db316b0 2024-09-15T22:53:31.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f851a59c640 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f850c005c40 tx=0x7f850c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506f880452d8f7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f8503fff640 1 -- 172.21.15.66:0/2856066328 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c035040 con 0x55b24db316b0 2024-09-15T22:53:31.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f8503fff640 1 -- 172.21.15.66:0/2856066328 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c049070 con 0x55b24db316b0 2024-09-15T22:53:31.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.034+0000 7f8503fff640 1 -- 172.21.15.66:0/2856066328 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c004a30 con 0x55b24db316b0 2024-09-15T22:53:31.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 -- 172.21.15.66:0/2856066328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 msgr2=0x55b24db3f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f850c005c40 tx=0x7f850c005bd0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 -- 172.21.15.66:0/2856066328 shutdown_connections 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db43d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db54f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 --2- 172.21.15.66:0/2856066328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db3f200 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 -- 172.21.15.66:0/2856066328 >> 172.21.15.66:0/2856066328 conn(0x55b24db489f0 msgr2=0x55b24db49bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 -- 172.21.15.66:0/2856066328 shutdown_connections 2024-09-15T22:53:31.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.035+0000 7f8522fd9740 1 -- 172.21.15.66:0/2856066328 wait complete. 2024-09-15T22:53:31.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.036+0000 7f8522fd9740 1 -- start start 2024-09-15T22:53:31.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.036+0000 7f8522fd9740 1 Processor -- start 2024-09-15T22:53:31.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.036+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.036+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db60a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8522fd9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db60fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8522fd9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b6ca0 con 0x55b24db316b0 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8522fd9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b6510 con 0x55b24db448b0 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8522fd9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1b3770 con 0x55b24db3f870 2024-09-15T22:53:31.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8522fd9740 10 client.0 _ll_register_callbacks cb 0x7f8510012170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44892/0 (socket says 172.21.15.66:44892) 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 -- 172.21.15.66:0/3532064325 learned_addr learned my addr 172.21.15.66:0/3532064325 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851ad9d640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db60fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f8519d9b640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db60a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 -- 172.21.15.66:0/3532064325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 msgr2=0x55b24db60a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db60a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 -- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 msgr2=0x55b24db60fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db60fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 -- 172.21.15.66:0/3532064325 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24db4f600 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.037+0000 7f851a59c640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f850c005ab0 tx=0x7f850c032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb828afa0127ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c051020 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f850c004390 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f850c049070 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f850c035070 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8522fd9740 10 client.17181 fetch_fsmap learned FSMap version 44 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b24dbc3bf0 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.038+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c049070 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 44) ==== 8402+0+0 (secure 0 0 0) 0x7f850c0315b0 con 0x55b24db316b0 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 10 client.17181 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:53:31.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 20 client.17181 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db451d0 0x55b24dbc6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 4 client.17181 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b24daa2d60 con 0x55b24db451d0 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.039+0000 7f8519d9b640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db451d0 0x55b24dbc6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.040+0000 7f8501ffb640 10 client.17181 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.040+0000 7f8519d9b640 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db451d0 0x55b24dbc6410 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8e0d7c07f8b489 server_cookie=cc52081589dcb8c9 in_seq=0 out_seq=0 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.040+0000 7f8501ffb640 1 -- 172.21.15.66:0/3532064325 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55b24daa2d60 con 0x55b24db451d0 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.040+0000 7f8501ffb640 10 client.17181 handle_command_reply: tid=0 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 client.17181 shutdown 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 msgr2=0x55b24db60540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f850c005ab0 tx=0x7f850c032d70 comp rx=0 tx=0).stop 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 shutdown_connections 2024-09-15T22:53:31.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b24db451d0 0x55b24dbc6410 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b24db448b0 0x55b24db60fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b24db3f870 0x55b24db60a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 --2- 172.21.15.66:0/3532064325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b24db316b0 0x55b24db60540 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 >> 172.21.15.66:0/3532064325 conn(0x55b24db489f0 msgr2=0x55b24db4a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8501ffb640 0 client.17181 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.041+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 shutdown_connections 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.042+0000 7f8522fd9740 1 -- 172.21.15.66:0/3532064325 wait complete. 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.042+0000 7f8522fd9740 20 client.17181 trim_cache size 0 max 16384 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:53:31.054 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (6570 inodes in the stack)", 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: "a7fa7375-33bf-46ab-8260-312679daa56f": { 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "a7fa7375-33bf-46ab-8260-312679daa56f", 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:31.055 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 msgr2=0x7f85040a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 0x7f85040a5a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f851000bfd0 tx=0x7f851000b410 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 msgr2=0x7f851c06cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8514009fd0 tx=0x7f851400ef10 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 shutdown_connections 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f85040a3580 0x7f85040a5a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c10bfd0 0x7f851c06cfa0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f851c103510 0x7f851c06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 --2- 172.21.15.66:0/634622123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f851c102bf0 0x7f851c0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 >> 172.21.15.66:0/634622123 conn(0x7f851c0fc610 msgr2=0x7f851c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 shutdown_connections 2024-09-15T22:53:31.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:31.043+0000 7f851b59e640 1 -- 172.21.15.66:0/634622123 wait complete. 2024-09-15T22:53:31.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:31 smithi066 ceph-mon[31185]: pgmap v251: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:53:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:31 smithi087 ceph-mon[35290]: pgmap v251: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:53:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:31 smithi184 ceph-mon[35203]: pgmap v251: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:53:32.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:32 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:32.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:32 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:32.512 INFO:tasks.cephfs.filesystem:scrub status for tag:a7fa7375-33bf-46ab-8260-312679daa56f - {'path': '/', 'tag': 'a7fa7375-33bf-46ab-8260-312679daa56f', 'options': 'recursive,force'} 2024-09-15T22:53:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:32 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:33 smithi184 ceph-mon[35203]: pgmap v252: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-09-15T22:53:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:33 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:33 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:33 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:33 smithi066 ceph-mon[31185]: pgmap v252: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-09-15T22:53:33.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:33 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:33 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:33 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:33 smithi087 ceph-mon[35290]: pgmap v252: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 81 KiB/s wr, 31 op/s 2024-09-15T22:53:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:33 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:33 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:33 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:33.606 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.7 2024-09-15T22:53:33.606 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:53:33.877 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:34.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:34 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:34.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:34 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:34.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:34 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:53:34.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 -- 172.21.15.66:0/3057048201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530101de0 msgr2=0x7f25301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 --2- 172.21.15.66:0/3057048201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530101de0 0x7f25301021c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2518009900 tx=0x7f251802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 -- 172.21.15.66:0/3057048201 shutdown_connections 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 --2- 172.21.15.66:0/3057048201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530106f10 0x7f253010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 --2- 172.21.15.66:0/3057048201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 0x7f25301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 --2- 172.21.15.66:0/3057048201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530101de0 0x7f25301021c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 -- 172.21.15.66:0/3057048201 >> 172.21.15.66:0/3057048201 conn(0x7f25300fd8c0 msgr2=0x7f25300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 -- 172.21.15.66:0/3057048201 shutdown_connections 2024-09-15T22:53:34.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.615+0000 7f2535f1a640 1 -- 172.21.15.66:0/3057048201 wait complete. 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 Processor -- start 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 -- start start 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530101de0 0x7f25300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 0x7f2530074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2530111f30 con 0x7f2530106f10 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2530111db0 con 0x7f2530102790 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.616+0000 7f2535f1a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25301120b0 con 0x7f2530101de0 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54908/0 (socket says 172.21.15.66:54908) 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 -- 172.21.15.66:0/797019354 learned_addr learned my addr 172.21.15.66:0/797019354 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:34.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252effd640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 0x7f2530074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252f7fe640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530101de0 0x7f25300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 -- 172.21.15.66:0/797019354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530101de0 msgr2=0x7f25300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530101de0 0x7f25300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 -- 172.21.15.66:0/797019354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 msgr2=0x7f2530074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 0x7f2530074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 -- 172.21.15.66:0/797019354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25301a68f0 con 0x7f2530106f10 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252ffff640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f252800cce0 tx=0x7f252800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252800f450 con 0x7f2530106f10 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f252800fad0 con 0x7f2530106f10 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25301a6be0 con 0x7f2530106f10 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528018c10 con 0x7f2530106f10 2024-09-15T22:53:34.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.617+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25301a7120 con 0x7f2530106f10 2024-09-15T22:53:34.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.618+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25301021c0 con 0x7f2530106f10 2024-09-15T22:53:34.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.620+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f252800f5f0 con 0x7f2530106f10 2024-09-15T22:53:34.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.621+0000 7f252cff9640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 0x7f251c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:34.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.621+0000 7f252f7fe640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 0x7f251c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:34.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.621+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f25280d0830 con 0x7f2530106f10 2024-09-15T22:53:34.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.622+0000 7f252f7fe640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 0x7f251c0a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2518005ab0 tx=0x7f2518005a20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:34.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.624+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2528014030 con 0x7f2530106f10 2024-09-15T22:53:34.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.835+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f253010a0f0 con 0x7f2530106f10 2024-09-15T22:53:34.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.836+0000 7f252cff9640 1 -- 172.21.15.66:0/797019354 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11984 (secure 0 0 0) 0x7f252809cef0 con 0x7f2530106f10 2024-09-15T22:53:34.838 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:53:34.838 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":45,"btime":"2024-09-15T22:53:34:102476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:53:34.080476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:53:34.838 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 45 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.838+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 msgr2=0x7f251c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.838+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 0x7f251c0a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2518005ab0 tx=0x7f2518005a20 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.838+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 msgr2=0x7f2530074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.838+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f252800cce0 tx=0x7f252800a620 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 shutdown_connections 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f251c0a3430 0x7f251c0a58f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2530106f10 0x7f2530074f70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2530102790 0x7f2530074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 --2- 172.21.15.66:0/797019354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2530101de0 0x7f25300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 >> 172.21.15.66:0/797019354 conn(0x7f25300fd8c0 msgr2=0x7f25300feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:34.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 shutdown_connections 2024-09-15T22:53:34.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:34.839+0000 7f2535f1a640 1 -- 172.21.15.66:0/797019354 wait complete. 2024-09-15T22:53:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:35 smithi184 ceph-mon[35203]: pgmap v253: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 118 KiB/s wr, 88 op/s 2024-09-15T22:53:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:35 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:35 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/797019354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:35 smithi066 ceph-mon[31185]: pgmap v253: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 118 KiB/s wr, 88 op/s 2024-09-15T22:53:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:35 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:35 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/797019354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:35.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 143.7 --await-for 45.0' 2024-09-15T22:53:35.592 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 143.7 --await-for 45.0 2024-09-15T22:53:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:35 smithi087 ceph-mon[35290]: pgmap v253: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 118 KiB/s wr, 88 op/s 2024-09-15T22:53:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:35 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:35 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/797019354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:35.852 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 -- 172.21.15.66:0/3274274961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba4102d30 msgr2=0x7fcba4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 --2- 172.21.15.66:0/3274274961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba4102d30 0x7fcba4103110 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009cd0 tx=0x7fcb9402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 -- 172.21.15.66:0/3274274961 shutdown_connections 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 --2- 172.21.15.66:0/3274274961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 --2- 172.21.15.66:0/3274274961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba41036e0 0x7fcba4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 --2- 172.21.15.66:0/3274274961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba4102d30 0x7fcba4103110 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 -- 172.21.15.66:0/3274274961 >> 172.21.15.66:0/3274274961 conn(0x7fcba40fc7d0 msgr2=0x7fcba40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 -- 172.21.15.66:0/3274274961 shutdown_connections 2024-09-15T22:53:36.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.310+0000 7fcba8889640 1 -- 172.21.15.66:0/3274274961 wait complete. 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.311+0000 7fcba8889640 1 Processor -- start 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.311+0000 7fcba8889640 1 -- start start 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 0x7fcba419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41120a0 con 0x7fcba41036e0 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcba4111f20 con 0x7fcba4102d30 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba8889640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcba4112220 con 0x7fcba41082a0 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54928/0 (socket says 172.21.15.66:54928) 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 -- 172.21.15.66:0/1228999742 learned_addr learned my addr 172.21.15.66:0/1228999742 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba259c640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 0x7fcba419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 -- 172.21.15.66:0/1228999742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 msgr2=0x7fcba419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 -- 172.21.15.66:0/1228999742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 msgr2=0x7fcba419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 0x7fcba419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 -- 172.21.15.66:0/1228999742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba419f700 con 0x7fcba41036e0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba259c640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 0x7fcba419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.312+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c8c0 tx=0x7fcb8c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.313+0000 7fcb9b7fe640 1 -- 172.21.15.66:0/1228999742 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c007bb0 con 0x7fcba41036e0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.313+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba419f9f0 con 0x7fcba41036e0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.313+0000 7fcb9b7fe640 1 -- 172.21.15.66:0/1228999742 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb8c007d50 con 0x7fcba41036e0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.313+0000 7fcb9b7fe640 1 -- 172.21.15.66:0/1228999742 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c018830 con 0x7fcba41036e0 2024-09-15T22:53:36.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.313+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba41a72d0 con 0x7fcba41036e0 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.315+0000 7fcbaac62740 1 Processor -- start 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 -- start start 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe63fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe64cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556cbe5a52a0 con 0x556cbe64a940 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556cbe54cb10 con 0x556cbe640080 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcbaac62740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556cbe5a1260 con 0x556cbe63f760 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcb9b7fe640 1 -- 172.21.15.66:0/1228999742 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcb8c018a10 con 0x7fcba41036e0 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcba259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcba259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48288/0 (socket says 172.21.15.66:48288) 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcba2d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe63fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcba259c640 1 -- 172.21.15.66:0/1316567441 learned_addr learned my addr 172.21.15.66:0/1316567441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.316+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe64cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 -- 172.21.15.66:0/1316567441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 msgr2=0x556cbe63fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe63fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 -- 172.21.15.66:0/1316567441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 msgr2=0x556cbe64cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe64cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 -- 172.21.15.66:0/1316567441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cbe316b90 con 0x556cbe640080 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe64cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcba259c640 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb94035000 tx=0x7fcb940315e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eacc8b408a82bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcb9b7fe640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 0x7fcb900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.317+0000 7fcb98ff9640 1 -- 172.21.15.66:0/1316567441 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94031ac0 con 0x556cbe640080 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcb98ff9640 1 -- 172.21.15.66:0/1316567441 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb94036040 con 0x556cbe640080 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcb98ff9640 1 -- 172.21.15.66:0/1316567441 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94004830 con 0x556cbe640080 2024-09-15T22:53:36.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 0x7fcb900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcb9b7fe640 1 -- 172.21.15.66:0/1228999742 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fcb8c0d0330 con 0x7fcba41036e0 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 0x7fcb900a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00cca0 tx=0x7fcb9c00c430 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcbaac62740 1 -- 172.21.15.66:0/1316567441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 msgr2=0x556cbe64a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.318+0000 7fcbaac62740 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb94035000 tx=0x7fcb940315e0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 -- 172.21.15.66:0/1316567441 shutdown_connections 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe64cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe640080 0x556cbe64a400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 --2- 172.21.15.66:0/1316567441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe63fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 -- 172.21.15.66:0/1316567441 >> 172.21.15.66:0/1316567441 conn(0x556cbe63bcf0 msgr2=0x556cbe63c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 -- 172.21.15.66:0/1316567441 shutdown_connections 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 -- 172.21.15.66:0/1316567441 wait complete. 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 -- start start 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.319+0000 7fcbaac62740 1 Processor -- start 2024-09-15T22:53:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 0x556cbe647840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 0x556cbe647d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556cbe64d510 con 0x556cbe64a940 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556cbe52d6e0 con 0x556cbe63f760 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556cbe64d690 con 0x556cbe640080 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 10 client.0 _ll_register_callbacks cb 0x556cbe551a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 0x556cbe647840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54952/0 (socket says 172.21.15.66:54952) 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 -- 172.21.15.66:0/245276061 learned_addr learned my addr 172.21.15.66:0/245276061 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 0x556cbe647d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 -- 172.21.15.66:0/245276061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 msgr2=0x556cbe647d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 0x556cbe647d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 -- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 msgr2=0x556cbe647840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 0x556cbe647840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 -- 172.21.15.66:0/245276061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cbe656a30 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 0x556cbe647d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba259c640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 0x556cbe647840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00ed60 tx=0x7fcb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c6e71ffdc8f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcb89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c01cb20 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fcb9c01ccc0 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.320+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb94036040 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fcb9c004020 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 10 client.17199 fetch_fsmap learned FSMap version 45 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x556cbe659400 con 0x556cbe64a940 2024-09-15T22:53:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb94036040 con 0x556cbe64a940 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7fcb9c01d410 con 0x556cbe64a940 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 10 client.17199 fetch_fsmap finished waiting for FSMap version 45 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 10 client.17199 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 20 client.17199 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe65a8c0 0x556cbe65cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 4 client.17199 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cbe5b29d0 con 0x556cbe65a8c0 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.321+0000 7fcba259c640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe65a8c0 0x556cbe65cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.322+0000 7fcb89ffb640 10 client.17199 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.322+0000 7fcba259c640 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe65a8c0 0x556cbe65cd60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adef3978b19205ef server_cookie=6be7c90bcce2b6c0 in_seq=0 out_seq=0 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcb89ffb640 1 -- 172.21.15.66:0/245276061 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cbe5b29d0 con 0x556cbe65a8c0 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcb89ffb640 10 client.17199 handle_command_reply: tid=0 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 client.17199 shutdown 2024-09-15T22:53:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 msgr2=0x556cbe6482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00ed60 tx=0x7fcb9c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 shutdown_connections 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe64a940 0x556cbe6482c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe640080 0x556cbe647d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe65a8c0 0x556cbe65cd60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcb89ffb640 0 client.17199 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 --2- 172.21.15.66:0/245276061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe63f760 0x556cbe647840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 >> 172.21.15.66:0/245276061 conn(0x556cbe63bcf0 msgr2=0x556cbe63ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 shutdown_connections 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 1 -- 172.21.15.66:0/245276061 wait complete. 2024-09-15T22:53:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.323+0000 7fcbaac62740 20 client.17199 trim_cache size 0 max 16384 2024-09-15T22:53:36.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 Processor -- start 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 -- start start 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe6421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe662b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41b1390 con 0x556cbe640080 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41b2ff0 con 0x556cbe64a940 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcbaac62740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41b1a60 con 0x556cbe63f760 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.354+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54964/0 (socket says 172.21.15.66:54964) 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe6421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba1d9b640 1 -- 172.21.15.66:0/2884131326 learned_addr learned my addr 172.21.15.66:0/2884131326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:36.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe662b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 -- 172.21.15.66:0/2884131326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 msgr2=0x556cbe662b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe662b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 -- 172.21.15.66:0/2884131326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 msgr2=0x556cbe662630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 -- 172.21.15.66:0/2884131326 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cbe63f590 con 0x556cbe63f760 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcba259c640 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe6421c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402ae00 tx=0x7fcb94049040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d99357b14b5b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcb8bfff640 1 -- 172.21.15.66:0/2884131326 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940043e0 con 0x556cbe63f760 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcb8bfff640 1 -- 172.21.15.66:0/2884131326 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb94036040 con 0x556cbe63f760 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.355+0000 7fcb8bfff640 1 -- 172.21.15.66:0/2884131326 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94004040 con 0x556cbe63f760 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- 172.21.15.66:0/2884131326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 msgr2=0x556cbe6421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe6421c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402ae00 tx=0x7fcb94049040 comp rx=0 tx=0).stop 2024-09-15T22:53:36.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- 172.21.15.66:0/2884131326 shutdown_connections 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe662b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe662630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 --2- 172.21.15.66:0/2884131326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe6421c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- 172.21.15.66:0/2884131326 >> 172.21.15.66:0/2884131326 conn(0x556cbe63bcf0 msgr2=0x556cbe6498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- 172.21.15.66:0/2884131326 shutdown_connections 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- 172.21.15.66:0/2884131326 wait complete. 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.356+0000 7fcbaac62740 1 -- start start 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 Processor -- start 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe653160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe644cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41b28c0 con 0x556cbe640080 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41b2130 con 0x556cbe64a940 2024-09-15T22:53:36.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcba41af390 con 0x556cbe63f760 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcbaac62740 10 client.0 _ll_register_callbacks cb 0x7fcb9c00e750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54978/0 (socket says 172.21.15.66:54978) 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba1d9b640 1 -- 172.21.15.66:0/3271390408 learned_addr learned my addr 172.21.15.66:0/3271390408 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe653160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba2d9d640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe644cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 -- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 msgr2=0x556cbe644cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe644cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 -- 172.21.15.66:0/3271390408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 msgr2=0x556cbe6446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba259c640 1 -- 172.21.15.66:0/3271390408 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cbe63c980 con 0x556cbe63f760 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.357+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcba259c640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe653160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb94000f80 tx=0x7fcb940095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8d6fb3eb0ccc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:36.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940043b0 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb94036040 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fcb94003e00 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fcb9406b050 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcbaac62740 10 client.26653 fetch_fsmap learned FSMap version 45 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x556cbe6c5550 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb94036040 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.358+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7fcb94030070 con 0x556cbe63f760 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 10 client.26653 fetch_fsmap finished waiting for FSMap version 45 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 10 client.26653 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 20 client.26653 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe6c5610 0x556cbe6c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:36.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 4 client.26653 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.7, "await_for": 45.0}] 2024-09-15T22:53:36.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.7, "await_for": 45.0}) -- 0x556cbe5acd20 con 0x556cbe6c5610 2024-09-15T22:53:36.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe6c5610 0x556cbe6c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:36.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcba1d9b640 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe6c5610 0x556cbe6c7a00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5646d900b1879c63 server_cookie=7d1982bd37488bd8 in_seq=0 out_seq=0 2024-09-15T22:53:36.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:36.359+0000 7fcb89ffb640 10 client.26653 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:37 smithi184 ceph-mon[35203]: pgmap v254: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 116 KiB/s wr, 124 op/s 2024-09-15T22:53:37.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:37 smithi066 ceph-mon[31185]: pgmap v254: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 116 KiB/s wr, 124 op/s 2024-09-15T22:53:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:37 smithi087 ceph-mon[35290]: pgmap v254: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 116 KiB/s wr, 124 op/s 2024-09-15T22:53:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:39 smithi184 ceph-mon[35203]: pgmap v255: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 141 KiB/s wr, 146 op/s 2024-09-15T22:53:39.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:39 smithi066 ceph-mon[31185]: pgmap v255: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 141 KiB/s wr, 146 op/s 2024-09-15T22:53:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:39 smithi087 ceph-mon[35290]: pgmap v255: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 141 KiB/s wr, 146 op/s 2024-09-15T22:53:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:41 smithi184 ceph-mon[35203]: pgmap v256: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 141 KiB/s wr, 145 op/s 2024-09-15T22:53:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:41 smithi066 ceph-mon[31185]: pgmap v256: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 141 KiB/s wr, 145 op/s 2024-09-15T22:53:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:41 smithi087 ceph-mon[35290]: pgmap v256: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 141 KiB/s wr, 145 op/s 2024-09-15T22:53:42.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:42 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:53:42.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:42 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:53:42.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:42 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:53:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:43 smithi184 ceph-mon[35203]: pgmap v257: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 144 KiB/s wr, 147 op/s 2024-09-15T22:53:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:43 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:53:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:43 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:53:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:43 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:53:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:43 smithi066 ceph-mon[31185]: pgmap v257: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 144 KiB/s wr, 147 op/s 2024-09-15T22:53:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:43 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:53:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:43 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:53:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:43 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:53:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:43 smithi087 ceph-mon[35290]: pgmap v257: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 144 KiB/s wr, 147 op/s 2024-09-15T22:53:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:43 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:53:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:43 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:53:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:43 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:53:45.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcb89ffb640 1 -- 172.21.15.66:0/3271390408 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556cbe5acd20 con 0x556cbe6c5610 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcb89ffb640 10 client.26653 handle_command_reply: tid=0 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 client.26653 shutdown 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 msgr2=0x556cbe653160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe653160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb94000f80 tx=0x7fcb940095d0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 shutdown_connections 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556cbe6c5610 0x556cbe6c7a00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556cbe64a940 0x556cbe644cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556cbe640080 0x556cbe6446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 --2- 172.21.15.66:0/3271390408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556cbe63f760 0x556cbe653160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcb89ffb640 0 client.26653 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:45.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.362+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 >> 172.21.15.66:0/3271390408 conn(0x556cbe63bcf0 msgr2=0x556cbe63a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.363+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 shutdown_connections 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.363+0000 7fcbaac62740 1 -- 172.21.15.66:0/3271390408 wait complete. 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.363+0000 7fcbaac62740 20 client.26653 trim_cache size 0 max 16384 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 46, 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 26, 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "7306ef18": { 2024-09-15T22:53:45.366 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 26, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 143.7, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:45.367 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 msgr2=0x7fcb900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 0x7fcb900a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00cca0 tx=0x7fcb9c00c430 comp rx=0 tx=0).stop 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 msgr2=0x7fcba419ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c8c0 tx=0x7fcb8c00cd80 comp rx=0 tx=0).stop 2024-09-15T22:53:45.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 shutdown_connections 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcb900a33b0 0x7fcb900a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcba41082a0 0x7fcba419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcba41036e0 0x7fcba419ac90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 --2- 172.21.15.66:0/1228999742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4102d30 0x7fcba419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 >> 172.21.15.66:0/1228999742 conn(0x7fcba40fc7d0 msgr2=0x7fcba410cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 shutdown_connections 2024-09-15T22:53:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:45.364+0000 7fcba8889640 1 -- 172.21.15.66:0/1228999742 wait complete. 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: pgmap v258: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 KiB/s wr, 132 op/s 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:45.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: pgmap v258: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 KiB/s wr, 132 op/s 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:45.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: pgmap v258: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 75 KiB/s wr, 132 op/s 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:53:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:53:46.138 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7306ef18', quiesce took 12.5 seconds. Will release after: 11.2 2024-09-15T22:53:47.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:47 smithi066 ceph-mon[31185]: pgmap v259: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 75 op/s 2024-09-15T22:53:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:47 smithi184 ceph-mon[35203]: pgmap v259: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 75 op/s 2024-09-15T22:53:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:47 smithi087 ceph-mon[35290]: pgmap v259: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 75 op/s 2024-09-15T22:53:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:49 smithi184 ceph-mon[35203]: pgmap v260: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-15T22:53:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:49 smithi066 ceph-mon[31185]: pgmap v260: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-15T22:53:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:49 smithi087 ceph-mon[35290]: pgmap v260: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-15T22:53:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:51 smithi184 ceph-mon[35203]: pgmap v261: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 21 op/s 2024-09-15T22:53:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:51 smithi066 ceph-mon[31185]: pgmap v261: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 21 op/s 2024-09-15T22:53:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:51 smithi087 ceph-mon[35290]: pgmap v261: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 21 op/s 2024-09-15T22:53:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:53 smithi184 ceph-mon[35203]: pgmap v262: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-15T22:53:53.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:53 smithi066 ceph-mon[31185]: pgmap v262: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-15T22:53:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:53 smithi087 ceph-mon[35290]: pgmap v262: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-15T22:53:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:55 smithi184 ceph-mon[35203]: pgmap v263: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 19 op/s 2024-09-15T22:53:55.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:55 smithi066 ceph-mon[31185]: pgmap v263: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 19 op/s 2024-09-15T22:53:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:55 smithi087 ceph-mon[35290]: pgmap v263: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 19 op/s 2024-09-15T22:53:57.338 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:53:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:57 smithi184 ceph-mon[35203]: pgmap v264: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-15T22:53:57.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:57 smithi066 ceph-mon[31185]: pgmap v264: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-15T22:53:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:57 smithi087 ceph-mon[35290]: pgmap v264: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-15T22:53:57.613 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:58.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 -- 172.21.15.66:0/60055690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac102d30 msgr2=0x7f28ac103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:58.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 --2- 172.21.15.66:0/60055690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac102d30 0x7f28ac103110 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009930 tx=0x7f28a802a420 comp rx=0 tx=0).stop 2024-09-15T22:53:58.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 -- 172.21.15.66:0/60055690 shutdown_connections 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 --2- 172.21.15.66:0/60055690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac1082a0 0x7f28ac10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 --2- 172.21.15.66:0/60055690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 --2- 172.21.15.66:0/60055690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac102d30 0x7f28ac103110 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.104+0000 7f28b47c5640 1 -- 172.21.15.66:0/60055690 >> 172.21.15.66:0/60055690 conn(0x7f28ac0fc7d0 msgr2=0x7f28ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- 172.21.15.66:0/60055690 shutdown_connections 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- 172.21.15.66:0/60055690 wait complete. 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 Processor -- start 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- start start 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 0x7f28ac1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac1120a0 con 0x7f28ac1082a0 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac111f20 con 0x7f28ac1036e0 2024-09-15T22:53:58.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.105+0000 7f28b47c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac112220 con 0x7f28ac102d30 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38494/0 (socket says 172.21.15.66:38494) 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 -- 172.21.15.66:0/2981449165 learned_addr learned my addr 172.21.15.66:0/2981449165 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2561640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 0x7f28ac1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b1d60640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 -- 172.21.15.66:0/2981449165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 msgr2=0x7f28ac1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 0x7f28ac1a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 -- 172.21.15.66:0/2981449165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 msgr2=0x7f28ac1a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac1a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 -- 172.21.15.66:0/2981449165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac19ad20 con 0x7f28ac1082a0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2561640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 0x7f28ac1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b1d60640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b2d62640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f28a400cce0 tx=0x7f28a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a400f450 con 0x7f28ac1082a0 2024-09-15T22:53:58.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28a400fad0 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac19b010 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4018c10 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.106+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac1a7300 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.107+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac06a850 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.109+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f28a400f5f0 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.110+0000 7f28a37fe640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 0x7f28980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.110+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f28a40d0860 con 0x7f28ac1082a0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.110+0000 7f28b2561640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 0x7f28980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.111+0000 7f28b2561640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 0x7f28980a58f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8032c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:58.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.114+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28a4014030 con 0x7f28ac1082a0 2024-09-15T22:53:58.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.328+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28ac103110 con 0x7f28ac1082a0 2024-09-15T22:53:58.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.329+0000 7f28a37fe640 1 -- 172.21.15.66:0/2981449165 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11982 (secure 0 0 0) 0x7f28a409cf20 con 0x7f28ac1082a0 2024-09-15T22:53:58.330 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:53:58.331 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":46,"btime":"2024-09-15T22:53:44:140910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:53:44.081961+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:53:58.331 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 46 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.331+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 msgr2=0x7f28980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.331+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 0x7f28980a58f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000c00 tx=0x7f28a8032c70 comp rx=0 tx=0).stop 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.331+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 msgr2=0x7f28ac19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.331+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f28a400cce0 tx=0x7f28a400a620 comp rx=0 tx=0).stop 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 shutdown_connections 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f28980a3430 0x7f28980a58f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28ac1082a0 0x7f28ac19a5f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac1036e0 0x7f28ac1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 --2- 172.21.15.66:0/2981449165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102d30 0x7f28ac1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:58.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 >> 172.21.15.66:0/2981449165 conn(0x7f28ac0fc7d0 msgr2=0x7f28ac0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:58.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 shutdown_connections 2024-09-15T22:53:58.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:58.332+0000 7f28b47c5640 1 -- 172.21.15.66:0/2981449165 wait complete. 2024-09-15T22:53:59.174 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 7306ef18 --release --await' 2024-09-15T22:53:59.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 7306ef18 --release --await 2024-09-15T22:53:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:59 smithi184 ceph-mon[35203]: pgmap v265: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-09-15T22:53:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:53:59 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2981449165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:53:59.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:59 smithi066 ceph-mon[31185]: pgmap v265: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-09-15T22:53:59.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:53:59 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2981449165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:59 smithi087 ceph-mon[35290]: pgmap v265: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-09-15T22:53:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:53:59 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2981449165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:53:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 -- 172.21.15.66:0/727576998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 msgr2=0x7f6a641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 --2- 172.21.15.66:0/727576998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a641021c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009ca0 tx=0x7f6a4c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 -- 172.21.15.66:0/727576998 shutdown_connections 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 --2- 172.21.15.66:0/727576998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 --2- 172.21.15.66:0/727576998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 0x7f6a641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 --2- 172.21.15.66:0/727576998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a641021c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 -- 172.21.15.66:0/727576998 >> 172.21.15.66:0/727576998 conn(0x7f6a640fd8c0 msgr2=0x7f6a640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 -- 172.21.15.66:0/727576998 shutdown_connections 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.913+0000 7f6a690aa640 1 -- 172.21.15.66:0/727576998 wait complete. 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 Processor -- start 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 -- start start 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 0x7f6a64198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a64111f70 con 0x7f6a64101de0 2024-09-15T22:53:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a64111df0 con 0x7f6a64106f10 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a690aa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641120f0 con 0x7f6a64102790 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38520/0 (socket says 172.21.15.66:38520) 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.914+0000 7f6a62d9d640 1 -- 172.21.15.66:0/3043006962 learned_addr learned my addr 172.21.15.66:0/3043006962 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a6259c640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 0x7f6a64198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a6359e640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 -- 172.21.15.66:0/3043006962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 msgr2=0x7f6a64198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 0x7f6a64198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 -- 172.21.15.66:0/3043006962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 msgr2=0x7f6a6419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 -- 172.21.15.66:0/3043006962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6419d3f0 con 0x7f6a64101de0 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a6359e640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c02ade0 tx=0x7f6a4c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a5bfff640 1 -- 172.21.15.66:0/3043006962 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c02fa20 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6419d680 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a5bfff640 1 -- 172.21.15.66:0/3043006962 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a4c02fbc0 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a5bfff640 1 -- 172.21.15.66:0/3043006962 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0467b0 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.915+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a641a4fc0 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a5bfff640 1 -- 172.21.15.66:0/3043006962 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6a4c046950 con 0x7f6a64101de0 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 Processor -- start 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 -- start start 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b82300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b91650 0x55bd40b93a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd40ae7620 con 0x55bd40b82840 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bd40a8ee50 con 0x55bd40b81f20 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.918+0000 7f6a6b483740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bd40ae35e0 con 0x55bd40b91650 2024-09-15T22:53:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38532/0 (socket says 172.21.15.66:38532) 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 -- 172.21.15.66:0/66866549 learned_addr learned my addr 172.21.15.66:0/66866549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a5bfff640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 0x7f6a500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a6359e640 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b82300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a6259c640 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b91650 0x55bd40b93a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a6359e640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 0x7f6a500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a5bfff640 1 -- 172.21.15.66:0/3043006962 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f6a4c0f1500 con 0x7f6a64101de0 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 -- 172.21.15.66:0/66866549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b91650 msgr2=0x55bd40b93a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b91650 0x55bd40b93a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 -- 172.21.15.66:0/66866549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 msgr2=0x55bd40b82300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b82300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 -- 172.21.15.66:0/66866549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd40a7fd40 con 0x55bd40b82840 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0bd4e0 tx=0x7f6a4c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bb19266ff6b0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a6359e640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 0x7f6a500a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0058c0 tx=0x7f6a5c005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.919+0000 7f6a597fa640 1 -- 172.21.15.66:0/66866549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0bdc50 con 0x55bd40b82840 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a597fa640 1 -- 172.21.15.66:0/66866549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a4c036030 con 0x55bd40b82840 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a597fa640 1 -- 172.21.15.66:0/66866549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c02fd70 con 0x55bd40b82840 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 -- 172.21.15.66:0/66866549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 msgr2=0x55bd40b91110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0bd4e0 tx=0x7f6a4c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 -- 172.21.15.66:0/66866549 shutdown_connections 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b91650 0x55bd40b93a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b91110 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 --2- 172.21.15.66:0/66866549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b82300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 -- 172.21.15.66:0/66866549 >> 172.21.15.66:0/66866549 conn(0x55bd40b7e5f0 msgr2=0x55bd40b7e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 -- 172.21.15.66:0/66866549 shutdown_connections 2024-09-15T22:53:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.920+0000 7f6a6b483740 1 -- 172.21.15.66:0/66866549 wait complete. 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 -- start start 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 Processor -- start 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b8e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b8ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd40ae7620 con 0x55bd40b91650 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bd40a6ff10 con 0x55bd40b81f20 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bd40b93fe0 con 0x55bd40b82840 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6b483740 10 client.0 _ll_register_callbacks cb 0x55bd40a93db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38542/0 (socket says 172.21.15.66:38542) 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 -- 172.21.15.66:0/1027239760 learned_addr learned my addr 172.21.15.66:0/1027239760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6259c640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b8ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b8e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 -- 172.21.15.66:0/1027239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 msgr2=0x55bd40b8ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b8ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 -- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 msgr2=0x55bd40b8e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b8e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6359e640 1 -- 172.21.15.66:0/1027239760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd407f6580 con 0x55bd40b91650 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a6259c640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b8ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.921+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b8e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c010710 tx=0x7f6a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3afe46192b941e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c024030 con 0x55bd40b91650 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f6a5c0137f0 con 0x55bd40b91650 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a4c036030 con 0x55bd40b91650 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c031050 con 0x55bd40b91650 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 10 client.17223 fetch_fsmap learned FSMap version 46 2024-09-15T22:53:59.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55bd408c0960 con 0x55bd40b91650 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a4c036030 con 0x55bd40b91650 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f6a5c01d050 con 0x55bd40b91650 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 10 client.17223 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 10 client.17223 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.922+0000 7f6a6b483740 20 client.17223 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40ba0fc0 0x55bd40ba3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a6b483740 4 client.17223 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd40af4b90 con 0x55bd40ba0fc0 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40ba0fc0 0x55bd40ba3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40ba0fc0 0x55bd40ba3440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ddf685dd529b73 server_cookie=c43f7a31b5e40099 in_seq=0 out_seq=0 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.923+0000 7f6a4a7fc640 10 client.17223 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1027239760 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd40af4b90 con 0x55bd40ba0fc0 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a4a7fc640 10 client.17223 handle_command_reply: tid=0 2024-09-15T22:53:59.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 client.17223 shutdown 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 msgr2=0x55bd40b8f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c010710 tx=0x7f6a5c0046c0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 shutdown_connections 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b8f110 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b8ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40ba0fc0 0x55bd40ba3440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1027239760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b8e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 >> 172.21.15.66:0/1027239760 conn(0x55bd40b7e5f0 msgr2=0x55bd40b84350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a4a7fc640 0 client.17223 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 shutdown_connections 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 1 -- 172.21.15.66:0/1027239760 wait complete. 2024-09-15T22:53:59.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.924+0000 7f6a6b483740 20 client.17223 trim_cache size 0 max 16384 2024-09-15T22:53:59.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.941+0000 7f6a6b483740 1 Processor -- start 2024-09-15T22:53:59.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.941+0000 7f6a6b483740 1 -- start start 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 0x55bd40b8cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 0x55bd40ba8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641acfd0 con 0x55bd40b82840 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641aec00 con 0x55bd40b91650 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6b483740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641ad6a0 con 0x55bd40b81f20 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38558/0 (socket says 172.21.15.66:38558) 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 -- 172.21.15.66:0/2824237268 learned_addr learned my addr 172.21.15.66:0/2824237268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 0x55bd40b8cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6359e640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 0x55bd40ba8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 -- 172.21.15.66:0/2824237268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 msgr2=0x55bd40b8cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 0x55bd40b8cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 -- 172.21.15.66:0/2824237268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 msgr2=0x55bd40ba8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 0x55bd40ba8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 -- 172.21.15.66:0/2824237268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd40b905d0 con 0x55bd40b82840 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 0x55bd40b8cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6359e640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 0x55bd40ba8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.942+0000 7f6a6259c640 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6a54004570 tx=0x7f6a5400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6a9eb8520dcbc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a58ff9640 1 -- 172.21.15.66:0/2824237268 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54020070 con 0x55bd40b82840 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a58ff9640 1 -- 172.21.15.66:0/2824237268 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54003d50 con 0x55bd40b82840 2024-09-15T22:53:59.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a58ff9640 1 -- 172.21.15.66:0/2824237268 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5401b650 con 0x55bd40b82840 2024-09-15T22:53:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 -- 172.21.15.66:0/2824237268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 msgr2=0x55bd40b7d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:59.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6a54004570 tx=0x7f6a5400bbf0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 -- 172.21.15.66:0/2824237268 shutdown_connections 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b91650 0x55bd40ba8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b82840 0x55bd40b7d640 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 --2- 172.21.15.66:0/2824237268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b81f20 0x55bd40b8cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.943+0000 7f6a6b483740 1 -- 172.21.15.66:0/2824237268 >> 172.21.15.66:0/2824237268 conn(0x55bd40b7e5f0 msgr2=0x55bd40b7cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- 172.21.15.66:0/2824237268 shutdown_connections 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- 172.21.15.66:0/2824237268 wait complete. 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- start start 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 Processor -- start 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b960e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641ae500 con 0x55bd40b91650 2024-09-15T22:53:59.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641add70 con 0x55bd40b81f20 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a641aafd0 con 0x55bd40b82840 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6b483740 10 client.0 _ll_register_callbacks cb 0x7f6a5c014360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38574/0 (socket says 172.21.15.66:38574) 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a6359e640 1 -- 172.21.15.66:0/1235972275 learned_addr learned my addr 172.21.15.66:0/1235972275 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.944+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6259c640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 -- 172.21.15.66:0/1235972275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 msgr2=0x55bd40b960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 -- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 msgr2=0x55bd40b995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 -- 172.21.15.66:0/1235972275 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd40b8d640 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6359e640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c010710 tx=0x7f6a5c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b150d9b1a0de57a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c024040 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f6a5c005140 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a54003d50 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c042050 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6b483740 10 client.17229 fetch_fsmap learned FSMap version 46 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55bd40c0c890 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.945+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a54003d50 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f6a5c01d040 con 0x55bd40b91650 2024-09-15T22:53:59.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 10 client.17229 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 10 client.17229 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 20 client.17229 populate_metadata read hostname 'smithi066' 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40c0cfa0 0x55bd40c0f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 4 client.17229 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7306ef18", "release": true, "await": true}] 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7306ef18", "release": true, "await": true}) -- 0x55bd40aef0a0 con 0x55bd40c0cfa0 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.946+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40c0cfa0 0x55bd40c0f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.947+0000 7f6a62d9d640 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40c0cfa0 0x55bd40c0f3c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62203bc85bea4cb5 server_cookie=6129ed9c0ab72f01 in_seq=0 out_seq=0 2024-09-15T22:53:59.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:53:59.947+0000 7f6a4a7fc640 10 client.17229 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a4a7fc640 1 -- 172.21.15.66:0/1235972275 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bd40aef0a0 con 0x55bd40c0cfa0 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a4a7fc640 10 client.17229 handle_command_reply: tid=0 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 client.17229 shutdown 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 msgr2=0x55bd40b96620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c010710 tx=0x7f6a5c00eef0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 shutdown_connections 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd40b91650 0x55bd40b96620 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd40b82840 0x55bd40b960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55bd40c0cfa0 0x55bd40c0f3c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 --2- 172.21.15.66:0/1235972275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bd40b81f20 0x55bd40b995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a4a7fc640 0 client.17229 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 >> 172.21.15.66:0/1235972275 conn(0x55bd40b7e5f0 msgr2=0x55bd40b7cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 shutdown_connections 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 1 -- 172.21.15.66:0/1235972275 wait complete. 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.723+0000 7f6a6b483740 20 client.17229 trim_cache size 0 max 16384 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 46, 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 28, 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "7306ef18": { 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 28, 2024-09-15T22:54:00.726 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 143.7, 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:00.727 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 msgr2=0x7f6a500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:00.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 0x7f6a500a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0058c0 tx=0x7f6a5c005850 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 msgr2=0x7f6a64198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c02ade0 tx=0x7f6a4c0319f0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 shutdown_connections 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6a500a33b0 0x7f6a500a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a64106f10 0x7f6a6419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a64102790 0x7f6a64198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 --2- 172.21.15.66:0/3043006962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a64101de0 0x7f6a64198440 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 >> 172.21.15.66:0/3043006962 conn(0x7f6a640fd8c0 msgr2=0x7f6a640fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 shutdown_connections 2024-09-15T22:54:00.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:00.724+0000 7f6a690aa640 1 -- 172.21.15.66:0/3043006962 wait complete. 2024-09-15T22:54:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:01 smithi184 ceph-mon[35203]: pgmap v266: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-15T22:54:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:01 smithi066 ceph-mon[31185]: pgmap v266: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-15T22:54:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:01 smithi087 ceph-mon[35290]: pgmap v266: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.3 KiB/s wr, 12 op/s 2024-09-15T22:54:01.638 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7306ef18', total seconds elapsed: 28.0 2024-09-15T22:54:02.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:54:02.791 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 -- 172.21.15.66:0/3935062568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6138102d40 msgr2=0x7f6138103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 --2- 172.21.15.66:0/3935062568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6138102d40 0x7f6138103120 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6128009900 tx=0x7f612802a480 comp rx=0 tx=0).stop 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 -- 172.21.15.66:0/3935062568 shutdown_connections 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 --2- 172.21.15.66:0/3935062568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f613810c170 0x7f613810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 --2- 172.21.15.66:0/3935062568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 0x7f613810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 --2- 172.21.15.66:0/3935062568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6138102d40 0x7f6138103120 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 -- 172.21.15.66:0/3935062568 >> 172.21.15.66:0/3935062568 conn(0x7f61380fc7a0 msgr2=0x7f61380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 -- 172.21.15.66:0/3935062568 shutdown_connections 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.303+0000 7f613cacf640 1 -- 172.21.15.66:0/3935062568 wait complete. 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 Processor -- start 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 -- start start 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6138102d40 0x7f6138198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 0x7f6138198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6138111f70 con 0x7f613810c170 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6138111df0 con 0x7f6138103660 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613cacf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61381120f0 con 0x7f6138102d40 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f6136d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f6136d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34004/0 (socket says 172.21.15.66:34004) 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f6136d9d640 1 -- 172.21.15.66:0/8996760 learned_addr learned my addr 172.21.15.66:0/8996760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.304+0000 7f613659c640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6138102d40 0x7f6138198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6135d9b640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 0x7f6138198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 -- 172.21.15.66:0/8996760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6138102d40 msgr2=0x7f6138198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6138102d40 0x7f6138198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 -- 172.21.15.66:0/8996760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 msgr2=0x7f6138198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 0x7f6138198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 -- 172.21.15.66:0/8996760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613819d3c0 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f6136d9d640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f613000cad0 tx=0x7f613000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f612f7fe640 1 -- 172.21.15.66:0/8996760 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613000ae20 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f612f7fe640 1 -- 172.21.15.66:0/8996760 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6130005020 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613819d6b0 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61381a4f90 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.305+0000 7f612f7fe640 1 -- 172.21.15.66:0/8996760 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613000f6f0 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.308+0000 7f612f7fe640 1 -- 172.21.15.66:0/8996760 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f61300051d0 con 0x7f613810c170 2024-09-15T22:54:03.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.308+0000 7f613eea8740 1 Processor -- start 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.308+0000 7f613eea8740 1 -- start start 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.308+0000 7f613eea8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a48f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.308+0000 7f613eea8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613eea8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a49a680 0x560e6a49ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613eea8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e6a3f52e0 con 0x560e6a48fdc0 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613eea8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560e6a39cce0 con 0x560e6a49a680 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613eea8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560e6a3f12a0 con 0x560e6a48f4a0 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34020/0 (socket says 172.21.15.66:34020) 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 -- 172.21.15.66:0/2093059398 learned_addr learned my addr 172.21.15.66:0/2093059398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f6135d9b640 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a49a680 0x560e6a49ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f6135d9b640 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a48f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f612f7fe640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 0x7f61240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 -- 172.21.15.66:0/2093059398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 msgr2=0x560e6a48f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a48f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 -- 172.21.15.66:0/2093059398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a49a680 msgr2=0x560e6a49ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a49a680 0x560e6a49ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 -- 172.21.15.66:0/2093059398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6a381440 con 0x560e6a48fdc0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f6136d9d640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 0x7f61240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f612f7fe640 1 -- 172.21.15.66:0/8996760 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f61300d03e0 con 0x7f613810c170 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.309+0000 7f613659c640 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6128009900 tx=0x7f61280316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a441f59b41dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f612cff9640 1 -- 172.21.15.66:0/2093059398 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128040070 con 0x560e6a48fdc0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f612cff9640 1 -- 172.21.15.66:0/2093059398 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128005020 con 0x560e6a48fdc0 2024-09-15T22:54:03.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f612cff9640 1 -- 172.21.15.66:0/2093059398 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128035040 con 0x560e6a48fdc0 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 -- 172.21.15.66:0/2093059398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 msgr2=0x560e6a49a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f6136d9d640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 0x7f61240a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f613009c270 tx=0x7f6130091770 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6128009900 tx=0x7f61280316e0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 -- 172.21.15.66:0/2093059398 shutdown_connections 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a49a680 0x560e6a49ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48fdc0 0x560e6a49a140 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 --2- 172.21.15.66:0/2093059398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a48f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 -- 172.21.15.66:0/2093059398 >> 172.21.15.66:0/2093059398 conn(0x560e6a48ba30 msgr2=0x560e6a48be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.310+0000 7f613eea8740 1 -- 172.21.15.66:0/2093059398 shutdown_connections 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 -- 172.21.15.66:0/2093059398 wait complete. 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 -- start start 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 Processor -- start 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48f4a0 0x560e6a499f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48fdc0 0x560e6a4971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e6a49d250 con 0x560e6a49a680 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560e6a3b0050 con 0x560e6a48f4a0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560e6a49d3d0 con 0x560e6a48fdc0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613eea8740 10 client.0 _ll_register_callbacks cb 0x560e6a3f0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34030/0 (socket says 172.21.15.66:34030) 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f6135d9b640 1 -- 172.21.15.66:0/3465472272 learned_addr learned my addr 172.21.15.66:0/3465472272 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f6135d9b640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48f4a0 0x560e6a499f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.311+0000 7f613659c640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48fdc0 0x560e6a4971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 -- 172.21.15.66:0/3465472272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48fdc0 msgr2=0x560e6a4971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48fdc0 0x560e6a4971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 -- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48f4a0 msgr2=0x560e6a499f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48f4a0 0x560e6a499f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 -- 172.21.15.66:0/3465472272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6a1663c0 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f6135d9b640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f612000f670 tx=0x7f6120004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e7683581392da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f611dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120011320 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6128005020 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f6120005020 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f612002c050 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f613eea8740 10 client.17241 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.312+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x560e6a4a8b70 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128005020 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f6120020040 con 0x560e6a49a680 2024-09-15T22:54:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 10 client.17241 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 20 client.17241 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a4aa030 0x560e6a4ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 4 client.17241 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e6a402850 con 0x560e6a4aa030 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613659c640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a4aa030 0x560e6a4ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f611dffb640 10 client.17241 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.313+0000 7f613659c640 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a4aa030 0x560e6a4ac490 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f5df8254757e26 server_cookie=5de948b605a58d89 in_seq=0 out_seq=0 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f611dffb640 1 -- 172.21.15.66:0/3465472272 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e6a402850 con 0x560e6a4aa030 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f611dffb640 10 client.17241 handle_command_reply: tid=0 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 client.17241 shutdown 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 msgr2=0x560e6a497710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f612000f670 tx=0x7f6120004730 comp rx=0 tx=0).stop 2024-09-15T22:54:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 shutdown_connections 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a497710 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48fdc0 0x560e6a4971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a4aa030 0x560e6a4ac490 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 --2- 172.21.15.66:0/3465472272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48f4a0 0x560e6a499f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 >> 172.21.15.66:0/3465472272 conn(0x560e6a48ba30 msgr2=0x560e6a491710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f611dffb640 0 client.17241 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 shutdown_connections 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.314+0000 7f613eea8740 1 -- 172.21.15.66:0/3465472272 wait complete. 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.315+0000 7f613eea8740 20 client.17241 trim_cache size 0 max 16384 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 Processor -- start 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 -- start start 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a499140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61381af330 con 0x560e6a49a680 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61381b0f60 con 0x560e6a48fdc0 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613eea8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61381afa00 con 0x560e6a48f4a0 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34046/0 (socket says 172.21.15.66:34046) 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 -- 172.21.15.66:0/1235339885 learned_addr learned my addr 172.21.15.66:0/1235339885 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a499140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613659c640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 -- 172.21.15.66:0/1235339885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 msgr2=0x560e6a499140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a499140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 -- 172.21.15.66:0/1235339885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 msgr2=0x560e6a4b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 -- 172.21.15.66:0/1235339885 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6a48fbf0 con 0x560e6a49a680 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f613659c640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.332+0000 7f6135d9b640 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f612000a310 tx=0x7f61200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17fd348781493d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f611ffff640 1 -- 172.21.15.66:0/1235339885 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120015030 con 0x560e6a49a680 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f611ffff640 1 -- 172.21.15.66:0/1235339885 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6120011320 con 0x560e6a49a680 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f611ffff640 1 -- 172.21.15.66:0/1235339885 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120000e60 con 0x560e6a49a680 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 -- 172.21.15.66:0/1235339885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 msgr2=0x560e6a4b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f612000a310 tx=0x7f61200046c0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 -- 172.21.15.66:0/1235339885 shutdown_connections 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a49a680 0x560e6a4b22a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 --2- 172.21.15.66:0/1235339885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a48f4a0 0x560e6a499140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 -- 172.21.15.66:0/1235339885 >> 172.21.15.66:0/1235339885 conn(0x560e6a48ba30 msgr2=0x560e6a498a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 -- 172.21.15.66:0/1235339885 shutdown_connections 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.333+0000 7f613eea8740 1 -- 172.21.15.66:0/1235339885 wait complete. 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 -- start start 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 Processor -- start 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4a0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a49a680 0x560e6a4a0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61381b0860 con 0x560e6a48f4a0 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61381b00d0 con 0x560e6a48fdc0 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61381ad330 con 0x560e6a49a680 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613eea8740 10 client.0 _ll_register_callbacks cb 0x7f61200114d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:03.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34048/0 (socket says 172.21.15.66:34048) 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 -- 172.21.15.66:0/2774910427 learned_addr learned my addr 172.21.15.66:0/2774910427 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613659c640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 -- 172.21.15.66:0/2774910427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a49a680 msgr2=0x560e6a4a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a49a680 0x560e6a4a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 -- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 msgr2=0x560e6a4a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f6135d9b640 1 -- 172.21.15.66:0/2774910427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6a4a0db0 con 0x560e6a48f4a0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.334+0000 7f613659c640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f6135d9b640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6120004e00 tx=0x7f61200116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cda161910959fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612000a850 con 0x560e6a48f4a0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f6120004b40 con 0x560e6a48f4a0 2024-09-15T22:54:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6120011320 con 0x560e6a48f4a0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f612001f960 con 0x560e6a48f4a0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 10 client.17247 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x560e6a514c50 con 0x560e6a48f4a0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6120011320 con 0x560e6a48f4a0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f6120030400 con 0x560e6a48f4a0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 10 client.17247 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 20 client.17247 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a515250 0x560e6a517670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 4 client.17247 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.335+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e6a3fcd60 con 0x560e6a515250 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613659c640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a515250 0x560e6a517670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613659c640 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a515250 0x560e6a517670 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd2a07f030392c3f server_cookie=5a17fcd651523c84 in_seq=0 out_seq=0 2024-09-15T22:54:03.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f611dffb640 10 client.17247 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f611dffb640 1 -- 172.21.15.66:0/2774910427 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560e6a3fcd60 con 0x560e6a515250 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f611dffb640 10 client.17247 handle_command_reply: tid=0 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:03.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 client.17247 shutdown 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 msgr2=0x560e6a4a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6120004e00 tx=0x7f61200116c0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 shutdown_connections 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e6a49a680 0x560e6a4a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560e6a515250 0x560e6a517670 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e6a48fdc0 0x560e6a4a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f611dffb640 0 client.17247 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 --2- 172.21.15.66:0/2774910427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e6a48f4a0 0x560e6a4a2cf0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 >> 172.21.15.66:0/2774910427 conn(0x560e6a48ba30 msgr2=0x560e6a48a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 shutdown_connections 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.336+0000 7f613eea8740 1 -- 172.21.15.66:0/2774910427 wait complete. 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613eea8740 20 client.17247 trim_cache size 0 max 16384 2024-09-15T22:54:03.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 msgr2=0x7f61240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 0x7f61240a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f613009c270 tx=0x7f6130091770 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 msgr2=0x7f613819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f613000cad0 tx=0x7f613000cf90 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 shutdown_connections 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61240a33b0 0x7f61240a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f613810c170 0x7f613819cce0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6138103660 0x7f6138198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 --2- 172.21.15.66:0/8996760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6138102d40 0x7f6138198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 >> 172.21.15.66:0/8996760 conn(0x7f61380fc7a0 msgr2=0x7f61380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 shutdown_connections 2024-09-15T22:54:03.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:03.337+0000 7f613cacf640 1 -- 172.21.15.66:0/8996760 wait complete. 2024-09-15T22:54:03.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:03 smithi066 ceph-mon[31185]: pgmap v267: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:03 smithi087 ceph-mon[35290]: pgmap v267: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:03 smithi184 ceph-mon[35203]: pgmap v267: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:04.127 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:54:04.127 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:54:04.387 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2491656090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c410c170 msgr2=0x7fe4c410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2491656090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c410c170 0x7fe4c410e610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ca0 tx=0x7fe4bc02a950 comp rx=0 tx=0).stop 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2491656090 shutdown_connections 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2491656090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c410c170 0x7fe4c410e610 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2491656090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c4103660 0x7fe4c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2491656090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4102d40 0x7fe4c4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2491656090 >> 172.21.15.66:0/2491656090 conn(0x7fe4c40fc7a0 msgr2=0x7fe4c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2491656090 shutdown_connections 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.833+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2491656090 wait complete. 2024-09-15T22:54:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 Processor -- start 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 -- start start 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4103660 0x7fe4c4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c410c170 0x7fe4c419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4111f30 con 0x7fe4c4102d40 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4111db0 con 0x7fe4c410c170 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c9d45640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c41120b0 con 0x7fe4c4103660 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.834+0000 7fe4c37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34066/0 (socket says 172.21.15.66:34066) 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 -- 172.21.15.66:0/2421531525 learned_addr learned my addr 172.21.15.66:0/2421531525 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c3fff640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c410c170 0x7fe4c419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4baffd640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4103660 0x7fe4c4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 -- 172.21.15.66:0/2421531525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4103660 msgr2=0x7fe4c4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4103660 0x7fe4c4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 -- 172.21.15.66:0/2421531525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c410c170 msgr2=0x7fe4c419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c410c170 0x7fe4c419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 -- 172.21.15.66:0/2421531525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c419d380 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c37fe640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d950 tx=0x7fe4b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4017070 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.835+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4b4009c30 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.836+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c419d670 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.836+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400f6b0 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.836+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c41008d0 con 0x7fe4c4102d40 2024-09-15T22:54:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.837+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c4103120 con 0x7fe4c4102d40 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.838+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe4b40109d0 con 0x7fe4c4102d40 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.839+0000 7fe4c17fa640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 0x7fe4b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.839+0000 7fe4baffd640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 0x7fe4b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.839+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7fe4b40cfd10 con 0x7fe4c4102d40 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.839+0000 7fe4baffd640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 0x7fe4b00a58f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40fed30 tx=0x7fe4ac005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:04.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:04.842+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4b4009de0 con 0x7fe4c4102d40 2024-09-15T22:54:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.057+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c4199730 con 0x7fe4c4102d40 2024-09-15T22:54:05.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.058+0000 7fe4c17fa640 1 -- 172.21.15.66:0/2421531525 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11982 (secure 0 0 0) 0x7fe4b409c340 con 0x7fe4c4102d40 2024-09-15T22:54:05.060 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:54:05.060 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 46 2024-09-15T22:54:05.060 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":46,"btime":"2024-09-15T22:53:44:140910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:53:44.081961+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:54:05.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 msgr2=0x7fe4b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 0x7fe4b00a58f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40fed30 tx=0x7fe4ac005f90 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 msgr2=0x7fe4c41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d950 tx=0x7fe4b400de10 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 shutdown_connections 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe4b00a3430 0x7fe4b00a58f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4c410c170 0x7fe4c419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4c4103660 0x7fe4c4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 --2- 172.21.15.66:0/2421531525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4c4102d40 0x7fe4c41983d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 >> 172.21.15.66:0/2421531525 conn(0x7fe4c40fc7a0 msgr2=0x7fe4c40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 shutdown_connections 2024-09-15T22:54:05.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:05.060+0000 7fe4c9d45640 1 -- 172.21.15.66:0/2421531525 wait complete. 2024-09-15T22:54:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:05 smithi066 ceph-mon[31185]: pgmap v268: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-15T22:54:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:05 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2421531525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:05 smithi087 ceph-mon[35290]: pgmap v268: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-15T22:54:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:05 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2421531525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:05 smithi184 ceph-mon[35203]: pgmap v268: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-15T22:54:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:05 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2421531525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:05.789 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:54:06.052 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 -- 172.21.15.66:0/3304713771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 msgr2=0x7ff94410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 --2- 172.21.15.66:0/3304713771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94410e610 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009ca0 tx=0x7ff93c02a950 comp rx=0 tx=0).stop 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 -- 172.21.15.66:0/3304713771 shutdown_connections 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 --2- 172.21.15.66:0/3304713771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94410e610 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 --2- 172.21.15.66:0/3304713771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944103660 0x7ff94410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 --2- 172.21.15.66:0/3304713771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944102d40 0x7ff944103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.511+0000 7ff94b394640 1 -- 172.21.15.66:0/3304713771 >> 172.21.15.66:0/3304713771 conn(0x7ff9440fc7a0 msgr2=0x7ff9440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- 172.21.15.66:0/3304713771 shutdown_connections 2024-09-15T22:54:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- 172.21.15.66:0/3304713771 wait complete. 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 Processor -- start 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- start start 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944102d40 0x7ff9441983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944103660 0x7ff944198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff944111fa0 con 0x7ff94410c170 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff944111e20 con 0x7ff944103660 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.512+0000 7ff94b394640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff944112120 con 0x7ff944102d40 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34086/0 (socket says 172.21.15.66:34086) 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 -- 172.21.15.66:0/3455587029 learned_addr learned my addr 172.21.15.66:0/3455587029 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff94892f640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944103660 0x7ff944198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949130640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944102d40 0x7ff9441983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 -- 172.21.15.66:0/3455587029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944102d40 msgr2=0x7ff9441983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944102d40 0x7ff9441983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 -- 172.21.15.66:0/3455587029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944103660 msgr2=0x7ff944198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944103660 0x7ff944198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 -- 172.21.15.66:0/3455587029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94419d380 con 0x7ff94410c170 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff949931640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009dc0 tx=0x7ff93c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff93a7fc640 1 -- 172.21.15.66:0/3455587029 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c034040 con 0x7ff94410c170 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94419d610 con 0x7ff94410c170 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff93a7fc640 1 -- 172.21.15.66:0/3455587029 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff93c02fe20 con 0x7ff94410c170 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff93a7fc640 1 -- 172.21.15.66:0/3455587029 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0047f0 con 0x7ff94410c170 2024-09-15T22:54:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.513+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9441a4f50 con 0x7ff94410c170 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.515+0000 7ff93a7fc640 1 -- 172.21.15.66:0/3455587029 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff93c037020 con 0x7ff94410c170 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 Processor -- start 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 -- start start 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c219415d0 0x562c21941a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c2194c370 0x562c2194e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c218a72f0 con 0x562c21942b40 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c2184ecf0 con 0x562c2194c370 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94d76d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c218a32b0 con 0x562c219415d0 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff93a7fc640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 0x7ff9300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34096/0 (socket says 172.21.15.66:34096) 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.516+0000 7ff94892f640 1 -- 172.21.15.66:0/2357675338 learned_addr learned my addr 172.21.15.66:0/2357675338 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff949130640 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c219415d0 0x562c21941a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff949931640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 0x7ff9300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff93a7fc640 1 -- 172.21.15.66:0/3455587029 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7ff93c0f1060 con 0x7ff94410c170 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c2194c370 0x562c2194e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 -- 172.21.15.66:0/2357675338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c219415d0 msgr2=0x562c21941a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c219415d0 0x562c21941a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 -- 172.21.15.66:0/2357675338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c2194c370 msgr2=0x562c2194e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c2194c370 0x562c2194e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 -- 172.21.15.66:0/2357675338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c218333a0 con 0x562c21942b40 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff949931640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 0x7ff9300a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0bcfb0 tx=0x7ff93c08bd10 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff94892f640 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff934010370 tx=0x7ff93400c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc331e6f0f5ca8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff92f7fe640 1 -- 172.21.15.66:0/2357675338 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934012660 con 0x562c21942b40 2024-09-15T22:54:06.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff92f7fe640 1 -- 172.21.15.66:0/2357675338 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934012ce0 con 0x562c21942b40 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.517+0000 7ff92f7fe640 1 -- 172.21.15.66:0/2357675338 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93400ebb0 con 0x562c21942b40 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- 172.21.15.66:0/2357675338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 msgr2=0x562c21941090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff934010370 tx=0x7ff93400c510 comp rx=0 tx=0).stop 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- 172.21.15.66:0/2357675338 shutdown_connections 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c2194c370 0x562c2194e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c219415d0 0x562c21941a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2357675338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21941090 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- 172.21.15.66:0/2357675338 >> 172.21.15.66:0/2357675338 conn(0x562c2190a310 msgr2=0x562c2193dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- 172.21.15.66:0/2357675338 shutdown_connections 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- 172.21.15.66:0/2357675338 wait complete. 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 -- start start 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.518+0000 7ff94d76d740 1 Processor -- start 2024-09-15T22:54:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c2194bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c219495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c2194f070 con 0x562c21942b40 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c21862060 con 0x562c219415d0 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c2194f1f0 con 0x562c2194c370 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94d76d740 10 client.0 _ll_register_callbacks cb 0x562c215b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34106/0 (socket says 172.21.15.66:34106) 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 -- 172.21.15.66:0/1862173135 learned_addr learned my addr 172.21.15.66:0/1862173135 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94892f640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c219495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94892f640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c2194bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 -- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 msgr2=0x562c219495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c219495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 -- 172.21.15.66:0/1862173135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 msgr2=0x562c2194bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c2194bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff949130640 1 -- 172.21.15.66:0/1862173135 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c216183c0 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.519+0000 7ff94892f640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c2194bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff949130640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff94000da10 tx=0x7ff94000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb9f381f35eab05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94001b640 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7ff940011440 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff934012ce0 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff94001b7e0 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 10 client.17265 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x562c2195ab30 con 0x562c21942b40 2024-09-15T22:54:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934012ce0 con 0x562c21942b40 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7ff940019020 con 0x562c21942b40 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 10 client.17265 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 10 client.17265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 20 client.17265 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c2195c040 0x562c2195e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 4 client.17265 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.520+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c218b4860 con 0x562c2195c040 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.521+0000 7ff94892f640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c2195c040 0x562c2195e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.521+0000 7ff92cff9640 10 client.17265 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.521+0000 7ff94892f640 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c2195c040 0x562c2195e450 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28f4ff8135949f7 server_cookie=31b212f37d2ccb29 in_seq=0 out_seq=0 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff92cff9640 1 -- 172.21.15.66:0/1862173135 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c218b4860 con 0x562c2195c040 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff92cff9640 10 client.17265 handle_command_reply: tid=0 2024-09-15T22:54:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 client.17265 shutdown 2024-09-15T22:54:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 msgr2=0x562c21948fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff94000da10 tx=0x7ff94000ded0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 shutdown_connections 2024-09-15T22:54:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c2195c040 0x562c2195e450 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c219495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c21942b40 0x562c21948fe0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 --2- 172.21.15.66:0/1862173135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c2194bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff92cff9640 0 client.17265 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 >> 172.21.15.66:0/1862173135 conn(0x562c2190a310 msgr2=0x562c21943960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 shutdown_connections 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 1 -- 172.21.15.66:0/1862173135 wait complete. 2024-09-15T22:54:06.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.522+0000 7ff94d76d740 20 client.17265 trim_cache size 0 max 16384 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.535+0000 7ff94d76d740 1 Processor -- start 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.535+0000 7ff94d76d740 1 -- start start 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c21942b40 0x562c21944120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c21944660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441af1d0 con 0x562c219415d0 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441b0e00 con 0x562c21942b40 2024-09-15T22:54:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94d76d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441af8a0 con 0x562c2194c370 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34120/0 (socket says 172.21.15.66:34120) 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 -- 172.21.15.66:0/688333527 learned_addr learned my addr 172.21.15.66:0/688333527 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff949130640 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c21942b40 0x562c21944120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c21944660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 -- 172.21.15.66:0/688333527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 msgr2=0x562c21944660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c21944660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 -- 172.21.15.66:0/688333527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c21942b40 msgr2=0x562c21944120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c21942b40 0x562c21944120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 -- 172.21.15.66:0/688333527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c21947f90 con 0x562c219415d0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.536+0000 7ff94892f640 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff934012fd0 tx=0x7ff93400e3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587293b732b6fade server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff92effd640 1 -- 172.21.15.66:0/688333527 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934004020 con 0x562c219415d0 2024-09-15T22:54:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff92effd640 1 -- 172.21.15.66:0/688333527 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff934005510 con 0x562c219415d0 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff92effd640 1 -- 172.21.15.66:0/688333527 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93400e900 con 0x562c219415d0 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 -- 172.21.15.66:0/688333527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 msgr2=0x562c219488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff934012fd0 tx=0x7ff93400e3e0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 -- 172.21.15.66:0/688333527 shutdown_connections 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c2194c370 0x562c21944660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c21942b40 0x562c21944120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 --2- 172.21.15.66:0/688333527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c219415d0 0x562c219488a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 -- 172.21.15.66:0/688333527 >> 172.21.15.66:0/688333527 conn(0x562c2190a310 msgr2=0x562c2194b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 -- 172.21.15.66:0/688333527 shutdown_connections 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.537+0000 7ff94d76d740 1 -- 172.21.15.66:0/688333527 wait complete. 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 -- start start 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 Processor -- start 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c21950570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c21942b40 0x562c21950ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441b0700 con 0x562c2194c370 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441aff70 con 0x562c219415d0 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441ad1d0 con 0x562c21942b40 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94d76d740 10 client.0 _ll_register_callbacks cb 0x7ff940004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.538+0000 7ff94892f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34128/0 (socket says 172.21.15.66:34128) 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 -- 172.21.15.66:0/2485156877 learned_addr learned my addr 172.21.15.66:0/2485156877 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c21950570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff949130640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c21942b40 0x562c21950ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 -- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c21942b40 msgr2=0x562c21950ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c21942b40 0x562c21950ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 -- 172.21.15.66:0/2485156877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 msgr2=0x562c21950570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:06.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c21950570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 -- 172.21.15.66:0/2485156877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c219513b0 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94892f640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff934005940 tx=0x7ff9340043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611a53d08a81979e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff92cff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934012660 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c218aed70 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7ff934027040 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff934012800 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94d76d740 10 client.17271 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.539+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x562c219c73a0 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562c218aed70 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7ff934003d00 con 0x562c2194c370 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 10 client.17271 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 10 client.17271 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 20 client.17271 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c219c77c0 0x562c219c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 4 client.17271 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c2182b170 con 0x562c219c77c0 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.540+0000 7ff949130640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c219c77c0 0x562c219c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff92cff9640 10 client.17271 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff949130640 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c219c77c0 0x562c219c9bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d5e85c363c5df729 server_cookie=2702b529a97d45cf in_seq=0 out_seq=0 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff92cff9640 1 -- 172.21.15.66:0/2485156877 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c2182b170 con 0x562c219c77c0 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff92cff9640 10 client.17271 handle_command_reply: tid=0 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 client.17271 shutdown 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 msgr2=0x562c219c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff934005940 tx=0x7ff9340043b0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 shutdown_connections 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x562c219c77c0 0x562c219c9bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c2194c370 0x562c219c5d30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c21942b40 0x562c21950ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 --2- 172.21.15.66:0/2485156877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c219415d0 0x562c21950570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 >> 172.21.15.66:0/2485156877 conn(0x562c2190a310 msgr2=0x562c2193c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff92cff9640 0 client.17271 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 shutdown_connections 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 1 -- 172.21.15.66:0/2485156877 wait complete. 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.541+0000 7ff94d76d740 20 client.17271 trim_cache size 0 max 16384 2024-09-15T22:54:06.552 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 msgr2=0x7ff9300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 0x7ff9300a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0bcfb0 tx=0x7ff93c08bd10 comp rx=0 tx=0).stop 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 msgr2=0x7ff94419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009dc0 tx=0x7ff93c003f10 comp rx=0 tx=0).stop 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 shutdown_connections 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9300a33b0 0x7ff9300a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff94410c170 0x7ff94419cca0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff944103660 0x7ff944198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 --2- 172.21.15.66:0/3455587029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff944102d40 0x7ff9441983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 >> 172.21.15.66:0/3455587029 conn(0x7ff9440fc7a0 msgr2=0x7ff9440fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 shutdown_connections 2024-09-15T22:54:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:06.542+0000 7ff94b394640 1 -- 172.21.15.66:0/3455587029 wait complete. 2024-09-15T22:54:07.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:54:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:07 smithi066 ceph-mon[31185]: pgmap v269: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:07.531 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:07 smithi087 ceph-mon[35290]: pgmap v269: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:07 smithi184 ceph-mon[35203]: pgmap v269: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 -- 172.21.15.66:0/1971767860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0106f10 msgr2=0x7f79e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 --2- 172.21.15.66:0/1971767860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0106f10 0x7f79e010ea90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009ca0 tx=0x7f79d802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 -- 172.21.15.66:0/1971767860 shutdown_connections 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 --2- 172.21.15.66:0/1971767860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0106f10 0x7f79e010ea90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 --2- 172.21.15.66:0/1971767860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0102790 0x7f79e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 --2- 172.21.15.66:0/1971767860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0101de0 0x7f79e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 -- 172.21.15.66:0/1971767860 >> 172.21.15.66:0/1971767860 conn(0x7f79e00fd8c0 msgr2=0x7f79e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 -- 172.21.15.66:0/1971767860 shutdown_connections 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.016+0000 7f79e73ad640 1 -- 172.21.15.66:0/1971767860 wait complete. 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 Processor -- start 2024-09-15T22:54:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 -- start start 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0102790 0x7f79e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 0x7f79e0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0111f90 con 0x7f79e0101de0 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0111e10 con 0x7f79e0106f10 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e73ad640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0112110 con 0x7f79e0102790 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e5149640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e5149640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34132/0 (socket says 172.21.15.66:34132) 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.017+0000 7f79e5149640 1 -- 172.21.15.66:0/4042198181 learned_addr learned my addr 172.21.15.66:0/4042198181 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e594a640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 0x7f79e0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e4948640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0102790 0x7f79e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 -- 172.21.15.66:0/4042198181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0102790 msgr2=0x7f79e0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0102790 0x7f79e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 -- 172.21.15.66:0/4042198181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 msgr2=0x7f79e0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 0x7f79e0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 -- 172.21.15.66:0/4042198181 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e01a68d0 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e594a640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 0x7f79e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e5149640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b4a0 tx=0x7f79dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79d67fc640 1 -- 172.21.15.66:0/4042198181 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc014070 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79d67fc640 1 -- 172.21.15.66:0/4042198181 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79dc010af0 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e01a6bc0 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79d67fc640 1 -- 172.21.15.66:0/4042198181 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc017d10 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.018+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e01a7100 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.020+0000 7f79d67fc640 1 -- 172.21.15.66:0/4042198181 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f79dc017070 con 0x7f79e0101de0 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 Processor -- start 2024-09-15T22:54:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 -- start start 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79d67fc640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 0x7f79cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04d6370 0x55b8f04d8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b8f04312f0 con 0x55b8f04ccb40 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b8f03d8cf0 con 0x55b8f04d6370 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e9786740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b8f042d2b0 con 0x55b8f04cb5d0 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e594a640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 0x7f79cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e5149640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e5149640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34142/0 (socket says 172.21.15.66:34142) 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e5149640 1 -- 172.21.15.66:0/3696562393 learned_addr learned my addr 172.21.15.66:0/3696562393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79e4948640 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.021+0000 7f79d67fc640 1 -- 172.21.15.66:0/4042198181 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f79dc0cf4b0 con 0x7f79e0101de0 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e594a640 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04d6370 0x55b8f04d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 -- 172.21.15.66:0/3696562393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 msgr2=0x55b8f04cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 -- 172.21.15.66:0/3696562393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04d6370 msgr2=0x55b8f04d8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04d6370 0x55b8f04d8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 -- 172.21.15.66:0/3696562393 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f03bd3a0 con 0x55b8f04ccb40 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e594a640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 0x7f79cc0a58f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009430 tx=0x7f79d8031d60 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79e5149640 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f79dc097870 tx=0x7f79dc0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118b615de51d92d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79cb7fe640 1 -- 172.21.15.66:0/3696562393 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc01e070 con 0x55b8f04ccb40 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79cb7fe640 1 -- 172.21.15.66:0/3696562393 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79dc09b410 con 0x55b8f04ccb40 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.022+0000 7f79cb7fe640 1 -- 172.21.15.66:0/3696562393 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc097a80 con 0x55b8f04ccb40 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- 172.21.15.66:0/3696562393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 msgr2=0x55b8f04cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f79dc097870 tx=0x7f79dc0047d0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- 172.21.15.66:0/3696562393 shutdown_connections 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04d6370 0x55b8f04d8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 --2- 172.21.15.66:0/3696562393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04ccb40 0x55b8f04cb090 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- 172.21.15.66:0/3696562393 >> 172.21.15.66:0/3696562393 conn(0x55b8f0494310 msgr2=0x55b8f04c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- 172.21.15.66:0/3696562393 shutdown_connections 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- 172.21.15.66:0/3696562393 wait complete. 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 -- start start 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.023+0000 7f79e9786740 1 Processor -- start 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04d5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b8f04d9070 con 0x55b8f04d6370 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b8f03ec060 con 0x55b8f04ccb40 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b8f04d91f0 con 0x55b8f04cb5d0 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e9786740 10 client.0 _ll_register_callbacks cb 0x55b8f013f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34154/0 (socket says 172.21.15.66:34154) 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 -- 172.21.15.66:0/1380248326 learned_addr learned my addr 172.21.15.66:0/1380248326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e4948640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e5149640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 -- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 msgr2=0x55b8f04d5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04d5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 -- 172.21.15.66:0/1380248326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 msgr2=0x55b8f04d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 -- 172.21.15.66:0/1380248326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f01a23c0 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.024+0000 7f79e594a640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f79d8003ec0 tx=0x7f79d802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f97b4bec3646bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8004d40 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f79d80044c0 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79dc09b410 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f79d805a050 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 10 client.17283 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b8f04e4b40 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79dc09b410 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f79d802fc90 con 0x55b8f04d6370 2024-09-15T22:54:08.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 10 client.17283 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 10 client.17283 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 20 client.17283 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f04e60a0 0x55b8f04e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 4 client.17283 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.025+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f043e860 con 0x55b8f04e60a0 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.026+0000 7f79e5149640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f04e60a0 0x55b8f04e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.026+0000 7f79e5149640 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f04e60a0 0x55b8f04e84e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=47dcf8a3d91cda12 server_cookie=e6d5c2bd9c750231 in_seq=0 out_seq=0 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.026+0000 7f79c8ff9640 10 client.17283 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1380248326 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8f043e860 con 0x55b8f04e60a0 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79c8ff9640 10 client.17283 handle_command_reply: tid=0 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 client.17283 shutdown 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 msgr2=0x55b8f04d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f79d8003ec0 tx=0x7f79d802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 shutdown_connections 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f04e60a0 0x55b8f04e84e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04d3600 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 --2- 172.21.15.66:0/1380248326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04d5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 >> 172.21.15.66:0/1380248326 conn(0x55b8f0494310 msgr2=0x55b8f04cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79c8ff9640 0 client.17283 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 shutdown_connections 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 1 -- 172.21.15.66:0/1380248326 wait complete. 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.027+0000 7f79e9786740 20 client.17283 trim_cache size 0 max 16384 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 Processor -- start 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 -- start start 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04e2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01b1410 con 0x55b8f04d6370 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01b3040 con 0x55b8f04ccb40 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e9786740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01b1ae0 con 0x55b8f04cb5d0 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.040+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34168/0 (socket says 172.21.15.66:34168) 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 -- 172.21.15.66:0/3216738845 learned_addr learned my addr 172.21.15.66:0/3216738845 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 -- 172.21.15.66:0/3216738845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 msgr2=0x55b8f04c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 -- 172.21.15.66:0/3216738845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 msgr2=0x55b8f04e2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04e2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 -- 172.21.15.66:0/3216738845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f04d1560 con 0x55b8f04d6370 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79e594a640 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f79d8031df0 tx=0x7f79d802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1a671a2264bba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79caffd640 1 -- 172.21.15.66:0/3216738845 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8062020 con 0x55b8f04d6370 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79caffd640 1 -- 172.21.15.66:0/3216738845 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8036050 con 0x55b8f04d6370 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.041+0000 7f79caffd640 1 -- 172.21.15.66:0/3216738845 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d802f870 con 0x55b8f04d6370 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- 172.21.15.66:0/3216738845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 msgr2=0x55b8f04ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f79d8031df0 tx=0x7f79d802f450 comp rx=0 tx=0).stop 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- 172.21.15.66:0/3216738845 shutdown_connections 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04ce180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04ccb40 0x55b8f04e2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 --2- 172.21.15.66:0/3216738845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04cb5d0 0x55b8f04c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- 172.21.15.66:0/3216738845 >> 172.21.15.66:0/3216738845 conn(0x55b8f0494310 msgr2=0x55b8f04c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- 172.21.15.66:0/3216738845 shutdown_connections 2024-09-15T22:54:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- 172.21.15.66:0/3216738845 wait complete. 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 -- start start 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 Processor -- start 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.042+0000 7f79e9786740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 0x55b8f04de690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04ccb40 0x55b8f04debd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01b2940 con 0x55b8f04d6370 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01b21b0 con 0x55b8f04cb5d0 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79e01af410 con 0x55b8f04ccb40 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 10 client.0 _ll_register_callbacks cb 0x7f79d8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34180/0 (socket says 172.21.15.66:34180) 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 -- 172.21.15.66:0/1146445229 learned_addr learned my addr 172.21.15.66:0/1146445229 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e5149640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 0x55b8f04de690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e4948640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04ccb40 0x55b8f04debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 -- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04ccb40 msgr2=0x55b8f04debd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04ccb40 0x55b8f04debd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 -- 172.21.15.66:0/1146445229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 msgr2=0x55b8f04de690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 0x55b8f04de690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 -- 172.21.15.66:0/1146445229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f04cfff0 con 0x55b8f04d6370 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e5149640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 0x55b8f04de690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e594a640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009bf0 tx=0x7f79d80048c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9536d2e6afc79060 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8062030 con 0x55b8f04d6370 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f79d8030780 con 0x55b8f04d6370 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.043+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d8036050 con 0x55b8f04d6370 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f79d8077050 con 0x55b8f04d6370 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 10 client.17289 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:08.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b8f05507c0 con 0x55b8f04d6370 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8036050 con 0x55b8f04d6370 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f79d802fa00 con 0x55b8f04d6370 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 10 client.17289 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 10 client.17289 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 20 client.17289 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f0550d70 0x55b8f0553190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 4 client.17289 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8f0438d70 con 0x55b8f0550d70 2024-09-15T22:54:08.072 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.044+0000 7f79e5149640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f0550d70 0x55b8f0553190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79c8ff9640 10 client.17289 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e5149640 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f0550d70 0x55b8f0553190 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e5f94fb50dde675a server_cookie=91ddaaad186c3e2c in_seq=0 out_seq=0 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79c8ff9640 1 -- 172.21.15.66:0/1146445229 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8f0438d70 con 0x55b8f0550d70 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79c8ff9640 10 client.17289 handle_command_reply: tid=0 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 client.17289 shutdown 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 msgr2=0x55b8f04cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009bf0 tx=0x7f79d80048c0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 shutdown_connections 2024-09-15T22:54:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55b8f0550d70 0x55b8f0553190 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b8f04d6370 0x55b8f04cf820 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8f04ccb40 0x55b8f04debd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79c8ff9640 0 client.17289 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 --2- 172.21.15.66:0/1146445229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8f04cb5d0 0x55b8f04de690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 >> 172.21.15.66:0/1146445229 conn(0x55b8f0494310 msgr2=0x55b8f04d4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 shutdown_connections 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 1 -- 172.21.15.66:0/1146445229 wait complete. 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.045+0000 7f79e9786740 20 client.17289 trim_cache size 0 max 16384 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 msgr2=0x7f79cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 0x7f79cc0a58f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009430 tx=0x7f79d8031d60 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 msgr2=0x7f79e00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b4a0 tx=0x7f79dc00b960 comp rx=0 tx=0).stop 2024-09-15T22:54:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 shutdown_connections 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79cc0a3430 0x7f79cc0a58f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e0106f10 0x7f79e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79e0102790 0x7f79e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 --2- 172.21.15.66:0/4042198181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e0101de0 0x7f79e00744f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 >> 172.21.15.66:0/4042198181 conn(0x7f79e00fd8c0 msgr2=0x7f79e00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 shutdown_connections 2024-09-15T22:54:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:08.046+0000 7f79e73ad640 1 -- 172.21.15.66:0/4042198181 wait complete. 2024-09-15T22:54:08.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:54:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:09.441 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:09 smithi066 ceph-mon[31185]: pgmap v270: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 -- 172.21.15.66:0/1128486697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794101de0 msgr2=0x7f17941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 --2- 172.21.15.66:0/1128486697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794101de0 0x7f17941021c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1788009900 tx=0x7f178802a410 comp rx=0 tx=0).stop 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 -- 172.21.15.66:0/1128486697 shutdown_connections 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 --2- 172.21.15.66:0/1128486697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794106f10 0x7f179410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 --2- 172.21.15.66:0/1128486697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794102790 0x7f17941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 --2- 172.21.15.66:0/1128486697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794101de0 0x7f17941021c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 -- 172.21.15.66:0/1128486697 >> 172.21.15.66:0/1128486697 conn(0x7f17940fd8c0 msgr2=0x7f17940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 -- 172.21.15.66:0/1128486697 shutdown_connections 2024-09-15T22:54:09.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.523+0000 7f179ad4d640 1 -- 172.21.15.66:0/1128486697 wait complete. 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 Processor -- start 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 -- start start 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794101de0 0x7f17940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794102790 0x7f1794074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1794111f90 con 0x7f1794106f10 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1794111e10 con 0x7f1794101de0 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f179ad4d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1794112110 con 0x7f1794102790 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34194/0 (socket says 172.21.15.66:34194) 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 -- 172.21.15.66:0/3652911192 learned_addr learned my addr 172.21.15.66:0/3652911192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f1798ae9640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794101de0 0x7f17940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f1793fff640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794102790 0x7f1794074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 -- 172.21.15.66:0/3652911192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794102790 msgr2=0x7f1794074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794102790 0x7f1794074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 -- 172.21.15.66:0/3652911192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794101de0 msgr2=0x7f17940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.524+0000 7f17992ea640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794101de0 0x7f17940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f17992ea640 1 -- 172.21.15.66:0/3652911192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17941a6950 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f17992ea640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b970 tx=0x7f178c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f1791ffb640 1 -- 172.21.15.66:0/3652911192 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c019070 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f1791ffb640 1 -- 172.21.15.66:0/3652911192 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178c00cb40 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17941a6c40 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f1791ffb640 1 -- 172.21.15.66:0/3652911192 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c007650 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.525+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17941a71d0 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.527+0000 7f1791ffb640 1 -- 172.21.15.66:0/3652911192 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f178c01c070 con 0x7f1794106f10 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 Processor -- start 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 -- start start 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd7fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd7fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f1791ffb640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 0x7f17840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd7632f0 con 0x55fcbd808370 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd70acf0 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f179d126740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd75f2b0 con 0x55fcbd7feb40 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f1793fff640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 0x7f17840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34198/0 (socket says 172.21.15.66:34198) 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f17992ea640 1 -- 172.21.15.66:0/2778424577 learned_addr learned my addr 172.21.15.66:0/2778424577 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f1793fff640 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd7fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f1798ae9640 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd7fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.528+0000 7f1791ffb640 1 -- 172.21.15.66:0/3652911192 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f178c0cf5b0 con 0x7f1794106f10 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 -- 172.21.15.66:0/2778424577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 msgr2=0x55fcbd7fd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd7fd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 -- 172.21.15.66:0/2778424577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 msgr2=0x55fcbd7fda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd7fda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 -- 172.21.15.66:0/2778424577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbd6ef3a0 con 0x55fcbd808370 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f1793fff640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 0x7f17840a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1794075f80 tx=0x7f178000aa50 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f17992ea640 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b940 tx=0x7f178c014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb7ba7611895886 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f177effd640 1 -- 172.21.15.66:0/2778424577 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0ae050 con 0x55fcbd808370 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f177effd640 1 -- 172.21.15.66:0/2778424577 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178c0ade20 con 0x55fcbd808370 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.529+0000 7f177effd640 1 -- 172.21.15.66:0/2778424577 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c07c0c0 con 0x55fcbd808370 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- 172.21.15.66:0/2778424577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 msgr2=0x55fcbd80a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b940 tx=0x7f178c014d00 comp rx=0 tx=0).stop 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- 172.21.15.66:0/2778424577 shutdown_connections 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80a760 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd7fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- 172.21.15.66:0/2778424577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd7fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- 172.21.15.66:0/2778424577 >> 172.21.15.66:0/2778424577 conn(0x55fcbd7c6310 msgr2=0x55fcbd7f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- 172.21.15.66:0/2778424577 shutdown_connections 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- 172.21.15.66:0/2778424577 wait complete. 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- start start 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 Processor -- start 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd805010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd808370 0x55fcbd805600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd80b010 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.530+0000 7f179d126740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd71e060 con 0x55fcbd808370 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f179d126740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fcbd80b190 con 0x55fcbd7feb40 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f179d126740 10 client.0 _ll_register_callbacks cb 0x55fcbd4718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34210/0 (socket says 172.21.15.66:34210) 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 -- 172.21.15.66:0/3074912991 learned_addr learned my addr 172.21.15.66:0/3074912991 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f17992ea640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd808370 0x55fcbd805600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1793fff640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd805010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 -- 172.21.15.66:0/3074912991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 msgr2=0x55fcbd805010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd805010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 -- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd808370 msgr2=0x55fcbd805600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd808370 0x55fcbd805600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 -- 172.21.15.66:0/3074912991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbd4d43c0 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1793fff640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd805010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1798ae9640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1788009900 tx=0x7f1788031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa1713f2f9f4c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1773fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788035040 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f1788004300 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.531+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f178c0ade20 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f178804f050 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 10 client.17301 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55fcbd816ab0 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178c0ade20 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f1788046750 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 10 client.17301 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 10 client.17301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 20 client.17301 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd817fc0 0x55fcbd81a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 4 client.17301 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcbd770860 con 0x55fcbd817fc0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.532+0000 7f1793fff640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd817fc0 0x55fcbd81a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.533+0000 7f1793fff640 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd817fc0 0x55fcbd81a400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d604d1f4d4d87bd7 server_cookie=e9d76bc8547041cf in_seq=0 out_seq=0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.533+0000 7f1773fff640 10 client.17301 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f1773fff640 1 -- 172.21.15.66:0/3074912991 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcbd770860 con 0x55fcbd817fc0 2024-09-15T22:54:09.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f1773fff640 10 client.17301 handle_command_reply: tid=0 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 client.17301 shutdown 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 msgr2=0x55fcbd807d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1788009900 tx=0x7f1788031a60 comp rx=0 tx=0).stop 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 shutdown_connections 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd817fc0 0x55fcbd81a400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd808370 0x55fcbd805600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7feb40 0x55fcbd805010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 --2- 172.21.15.66:0/3074912991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd807d60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f1773fff640 0 client.17301 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 >> 172.21.15.66:0/3074912991 conn(0x55fcbd7c6310 msgr2=0x55fcbd7ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 shutdown_connections 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 1 -- 172.21.15.66:0/3074912991 wait complete. 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.534+0000 7f179d126740 20 client.17301 trim_cache size 0 max 16384 2024-09-15T22:54:09.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 Processor -- start 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 -- start start 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd8142b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 0x55fcbd8074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f17941b14d0 con 0x55fcbd7feb40 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17941b3100 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f179d126740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f17941b1ba0 con 0x55fcbd808370 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f1793fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f1793fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34226/0 (socket says 172.21.15.66:34226) 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f1793fff640 1 -- 172.21.15.66:0/4288548581 learned_addr learned my addr 172.21.15.66:0/4288548581 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f1798ae9640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd8142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.547+0000 7f17992ea640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 0x55fcbd8074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 -- 172.21.15.66:0/4288548581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 msgr2=0x55fcbd8074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 0x55fcbd8074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 -- 172.21.15.66:0/4288548581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 msgr2=0x55fcbd8142b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd8142b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 -- 172.21.15.66:0/4288548581 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbd7fa960 con 0x55fcbd7feb40 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1798ae9640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd8142b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f17992ea640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 0x55fcbd8074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f1793fff640 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x55fcbd8048a0 tx=0x7f1780013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14b7340fbccea8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f177e7fc640 1 -- 172.21.15.66:0/4288548581 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178000ae60 con 0x55fcbd7feb40 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f177e7fc640 1 -- 172.21.15.66:0/4288548581 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178001fd40 con 0x55fcbd7feb40 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.548+0000 7f177e7fc640 1 -- 172.21.15.66:0/4288548581 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800047a0 con 0x55fcbd7feb40 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- 172.21.15.66:0/4288548581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 msgr2=0x55fcbd806f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x55fcbd8048a0 tx=0x7f1780013040 comp rx=0 tx=0).stop 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- 172.21.15.66:0/4288548581 shutdown_connections 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd808370 0x55fcbd8074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd7feb40 0x55fcbd806f80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- 172.21.15.66:0/4288548581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd8142b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- 172.21.15.66:0/4288548581 >> 172.21.15.66:0/4288548581 conn(0x55fcbd7c6310 msgr2=0x55fcbd806870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- 172.21.15.66:0/4288548581 shutdown_connections 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- 172.21.15.66:0/4288548581 wait complete. 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 -- start start 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 Processor -- start 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd810600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7feb40 0x55fcbd810b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.549+0000 7f179d126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f17941b2a00 con 0x55fcbd808370 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17941b2270 con 0x55fcbd7feb40 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f17941af4d0 con 0x55fcbd7fd5d0 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 10 client.0 _ll_register_callbacks cb 0x7f1788009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34232/0 (socket says 172.21.15.66:34232) 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 -- 172.21.15.66:0/13572743 learned_addr learned my addr 172.21.15.66:0/13572743 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1798ae9640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd810600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1793fff640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7feb40 0x55fcbd810b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 -- 172.21.15.66:0/13572743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7fd5d0 msgr2=0x55fcbd810600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd810600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 -- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7feb40 msgr2=0x55fcbd810b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7feb40 0x55fcbd810b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 -- 172.21.15.66:0/13572743 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbd80dab0 con 0x55fcbd808370 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f17992ea640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f178c09b2c0 tx=0x7f178c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cbc74ed1e826a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1773fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c079f40 con 0x55fcbd808370 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f178c0cf1b0 con 0x55fcbd808370 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f178001fd40 con 0x55fcbd808370 2024-09-15T22:54:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f178c0cf3b0 con 0x55fcbd808370 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 10 client.17307 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.550+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55fcbd883670 con 0x55fcbd808370 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178001fd40 con 0x55fcbd808370 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f178c0a3cf0 con 0x55fcbd808370 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 10 client.17307 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 10 client.17307 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 20 client.17307 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd883900 0x55fcbd885cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 4 client.17307 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcbd76ad70 con 0x55fcbd883900 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f1798ae9640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd883900 0x55fcbd885cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f1773fff640 10 client.17307 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.551+0000 7f1798ae9640 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd883900 0x55fcbd885cf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc6f24a817e644cf server_cookie=4a011cebf621796 in_seq=0 out_seq=0 2024-09-15T22:54:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f1773fff640 1 -- 172.21.15.66:0/13572743 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcbd76ad70 con 0x55fcbd883900 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f1773fff640 10 client.17307 handle_command_reply: tid=0 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 client.17307 shutdown 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 msgr2=0x55fcbd80d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f178c09b2c0 tx=0x7f178c0098b0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 shutdown_connections 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55fcbd883900 0x55fcbd885cf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcbd808370 0x55fcbd80d3f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcbd7feb40 0x55fcbd810b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f1773fff640 0 client.17307 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 --2- 172.21.15.66:0/13572743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcbd7fd5d0 0x55fcbd810600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 >> 172.21.15.66:0/13572743 conn(0x55fcbd7c6310 msgr2=0x55fcbd807090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 shutdown_connections 2024-09-15T22:54:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 1 -- 172.21.15.66:0/13572743 wait complete. 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.552+0000 7f179d126740 20 client.17307 trim_cache size 0 max 16384 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 msgr2=0x7f17840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 0x7f17840a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1794075f80 tx=0x7f178000aa50 comp rx=0 tx=0).stop 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 msgr2=0x7f1794074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b970 tx=0x7f178c00be30 comp rx=0 tx=0).stop 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 shutdown_connections 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f17840a3430 0x7f17840a58f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794106f10 0x7f1794074f70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1794102790 0x7f1794074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 --2- 172.21.15.66:0/3652911192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1794101de0 0x7f17940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 >> 172.21.15.66:0/3652911192 conn(0x7f17940fd8c0 msgr2=0x7f17940fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 shutdown_connections 2024-09-15T22:54:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:09.553+0000 7f179ad4d640 1 -- 172.21.15.66:0/3652911192 wait complete. 2024-09-15T22:54:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:09 smithi087 ceph-mon[35290]: pgmap v270: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-09-15T22:54:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:09 smithi184 ceph-mon[35203]: pgmap v270: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-09-15T22:54:10.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:54:10.523 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 -- 172.21.15.66:0/3881970352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c100a80 msgr2=0x7f1d5c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 --2- 172.21.15.66:0/3881970352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c100a80 0x7f1d5c100ee0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009930 tx=0x7f1d5002a420 comp rx=0 tx=0).stop 2024-09-15T22:54:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 -- 172.21.15.66:0/3881970352 shutdown_connections 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 --2- 172.21.15.66:0/3881970352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c101420 0x7f1d5c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 --2- 172.21.15.66:0/3881970352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c100a80 0x7f1d5c100ee0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 --2- 172.21.15.66:0/3881970352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c106a80 0x7f1d5c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 -- 172.21.15.66:0/3881970352 >> 172.21.15.66:0/3881970352 conn(0x7f1d5c0fc7a0 msgr2=0x7f1d5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 -- 172.21.15.66:0/3881970352 shutdown_connections 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.018+0000 7f1d62363640 1 -- 172.21.15.66:0/3881970352 wait complete. 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.019+0000 7f1d62363640 1 Processor -- start 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.019+0000 7f1d62363640 1 -- start start 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 0x7f1d5c10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c101420 0x7f1d5c10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 0x7f1d5c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c111f60 con 0x7f1d5c106a80 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c111de0 con 0x7f1d5c100a80 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d62363640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1120e0 con 0x7f1d5c101420 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 0x7f1d5c10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 0x7f1d5c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 0x7f1d5c10e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43898/0 (socket says 172.21.15.66:43898) 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d5bfff640 1 -- 172.21.15.66:0/4286489127 learned_addr learned my addr 172.21.15.66:0/4286489127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c101420 0x7f1d5c10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 -- 172.21.15.66:0/4286489127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c101420 msgr2=0x7f1d5c10e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c101420 0x7f1d5c10e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 -- 172.21.15.66:0/4286489127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 msgr2=0x7f1d5c10e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 0x7f1d5c10e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.020+0000 7f1d60900640 1 -- 172.21.15.66:0/4286489127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c1a6880 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d60900640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 0x7f1d5c10ee60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400e940 tx=0x7f1d5400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d597fa640 1 -- 172.21.15.66:0/4286489127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54004d20 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c1a6b70 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d597fa640 1 -- 172.21.15.66:0/4286489127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d54005020 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d597fa640 1 -- 172.21.15.66:0/4286489127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d540116b0 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.021+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c1a7080 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.024+0000 7f1d6473c740 1 Processor -- start 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.024+0000 7f1d597fa640 1 -- 172.21.15.66:0/4286489127 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1d540054d0 con 0x7f1d5c106a80 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.024+0000 7f1d6473c740 1 -- start start 2024-09-15T22:54:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 0x555a13a48a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a53370 0x555a13a55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a139ae2f0 con 0x555a13a49b40 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555a13955cf0 con 0x555a13a485d0 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d6473c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555a139aa2b0 con 0x555a13a53370 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34240/0 (socket says 172.21.15.66:34240) 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 0x555a13a48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/4535721 learned_addr learned my addr 172.21.15.66:0/4535721 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a53370 0x555a13a55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 -- 172.21.15.66:0/4535721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a53370 msgr2=0x555a13a55760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a53370 0x555a13a55760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 -- 172.21.15.66:0/4535721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 msgr2=0x555a13a48090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5bfff640 1 -- 172.21.15.66:0/4535721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a1393a3a0 con 0x555a13a485d0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d597fa640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 0x7f1d440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.025+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 0x7f1d440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d597fa640 1 -- 172.21.15.66:0/4286489127 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f1d540d0210 con 0x7f1d5c106a80 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 0x555a13a48a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00ac20 tx=0x7f1d4c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dcf83d44e7404c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d427fc640 1 -- 172.21.15.66:0/4535721 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c005220 con 0x555a13a485d0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d427fc640 1 -- 172.21.15.66:0/4535721 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c004c80 con 0x555a13a485d0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d427fc640 1 -- 172.21.15.66:0/4535721 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0187e0 con 0x555a13a485d0 2024-09-15T22:54:11.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d6473c740 1 -- 172.21.15.66:0/4535721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 msgr2=0x555a13a48a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d6473c740 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 0x555a13a48a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00ac20 tx=0x7f1d4c00f790 comp rx=0 tx=0).stop 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.026+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 0x7f1d440a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d500096c0 tx=0x7f1d50005fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 -- 172.21.15.66:0/4535721 shutdown_connections 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a53370 0x555a13a55760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a485d0 0x555a13a48a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- 172.21.15.66:0/4535721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 -- 172.21.15.66:0/4535721 >> 172.21.15.66:0/4535721 conn(0x555a13a11310 msgr2=0x555a13a44c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 -- 172.21.15.66:0/4535721 shutdown_connections 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 -- 172.21.15.66:0/4535721 wait complete. 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 -- start start 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 Processor -- start 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a52ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.027+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d6473c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a13a56070 con 0x555a13a49b40 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d6473c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555a13969060 con 0x555a13a53370 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d6473c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555a13a561f0 con 0x555a13a485d0 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d6473c740 10 client.0 _ll_register_callbacks cb 0x555a136bc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34256/0 (socket says 172.21.15.66:34256) 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/2468672400 learned_addr learned my addr 172.21.15.66:0/2468672400 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a52ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d60900640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 msgr2=0x555a13a52ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a52ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/2468672400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 msgr2=0x555a13a504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/2468672400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a1371f3c0 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005940 tx=0x7f1d500058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d715307583ef8f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.028+0000 7f1d3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50035040 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4c004c80 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f1d5003d450 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1d5005c050 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 10 client.17319 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x555a13a61ab0 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c004c80 con 0x555a13a49b40 2024-09-15T22:54:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f1d5003c610 con 0x555a13a49b40 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 10 client.17319 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 10 client.17319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 20 client.17319 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13a63030 0x555a13a65450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 4 client.17319 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.029+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a139bb860 con 0x555a13a63030 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.030+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13a63030 0x555a13a65450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.030+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13a63030 0x555a13a65450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbff5b9ea3b847f server_cookie=54435ad652f56289 in_seq=0 out_seq=0 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.030+0000 7f1d3b7fe640 10 client.17319 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/2468672400 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a139bb860 con 0x555a13a63030 2024-09-15T22:54:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d3b7fe640 10 client.17319 handle_command_reply: tid=0 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 client.17319 shutdown 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 msgr2=0x555a13a4ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005940 tx=0x7f1d500058d0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 shutdown_connections 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13a63030 0x555a13a65450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4ff90 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 --2- 172.21.15.66:0/2468672400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a52ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 >> 172.21.15.66:0/2468672400 conn(0x555a13a11310 msgr2=0x555a13a4a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d3b7fe640 0 client.17319 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 shutdown_connections 2024-09-15T22:54:11.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 1 -- 172.21.15.66:0/2468672400 wait complete. 2024-09-15T22:54:11.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.031+0000 7f1d6473c740 20 client.17319 trim_cache size 0 max 16384 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.044+0000 7f1d6473c740 1 Processor -- start 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.044+0000 7f1d6473c740 1 -- start start 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a5f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1b13f0 con 0x555a13a49b40 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1b3020 con 0x555a13a53370 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d6473c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1b1ac0 con 0x555a13a485d0 2024-09-15T22:54:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34266/0 (socket says 172.21.15.66:34266) 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/3618027417 learned_addr learned my addr 172.21.15.66:0/3618027417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d60900640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a5f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/3618027417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 msgr2=0x555a13a5f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a5f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/3618027417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 msgr2=0x555a13a4ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 -- 172.21.15.66:0/3618027417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a13a4b120 con 0x555a13a49b40 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d60900640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a5f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1d5003ca30 tx=0x7f1d50005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcd57e8fd59ff4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.045+0000 7f1d41ffb640 1 -- 172.21.15.66:0/3618027417 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50065070 con 0x555a13a49b40 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d41ffb640 1 -- 172.21.15.66:0/3618027417 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d50003cd0 con 0x555a13a49b40 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d41ffb640 1 -- 172.21.15.66:0/3618027417 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50035040 con 0x555a13a49b40 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- 172.21.15.66:0/3618027417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 msgr2=0x555a13a4f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1d5003ca30 tx=0x7f1d50005cb0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- 172.21.15.66:0/3618027417 shutdown_connections 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a49b40 0x555a13a4f850 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 --2- 172.21.15.66:0/3618027417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a485d0 0x555a13a5f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- 172.21.15.66:0/3618027417 >> 172.21.15.66:0/3618027417 conn(0x555a13a11310 msgr2=0x555a13a4e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- 172.21.15.66:0/3618027417 shutdown_connections 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- 172.21.15.66:0/3618027417 wait complete. 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.046+0000 7f1d6473c740 1 -- start start 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 Processor -- start 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a49b40 0x555a13a4cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1b2920 con 0x555a13a485d0 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1b2190 con 0x555a13a53370 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c1af3f0 con 0x555a13a49b40 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d6473c740 10 client.0 _ll_register_callbacks cb 0x7f1d50031ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34268/0 (socket says 172.21.15.66:34268) 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 -- 172.21.15.66:0/1238444413 learned_addr learned my addr 172.21.15.66:0/1238444413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a49b40 0x555a13a4cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d60900640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 -- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a49b40 msgr2=0x555a13a4cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a49b40 0x555a13a4cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.047+0000 7f1d5bfff640 1 -- 172.21.15.66:0/1238444413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 msgr2=0x555a13a4d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d5bfff640 1 -- 172.21.15.66:0/1238444413 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a13a4d9d0 con 0x555a13a485d0 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d60900640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d5bfff640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00a760 tx=0x7f1d4c00abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1862773e6f7bce3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c005210 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f1d4c004660 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d50003cd0 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1d4c03d050 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d6473c740 10 client.17325 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x555a13acdd40 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.048+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d50003cd0 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f1d4c018710 con 0x555a13a485d0 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 10 client.17325 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 10 client.17325 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 20 client.17325 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13ace230 0x555a13ad0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:11.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 4 client.17325 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:11.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a139b5d70 con 0x555a13ace230 2024-09-15T22:54:11.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13ace230 0x555a13ad0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d5b7fe640 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13ace230 0x555a13ad0620 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a64b2c7e89824fd5 server_cookie=8e9065b819ccecf7 in_seq=0 out_seq=0 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d3b7fe640 10 client.17325 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d3b7fe640 1 -- 172.21.15.66:0/1238444413 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a139b5d70 con 0x555a13ace230 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d3b7fe640 10 client.17325 handle_command_reply: tid=0 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.049+0000 7f1d6473c740 1 client.17325 shutdown 2024-09-15T22:54:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 msgr2=0x555a13a5bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00a760 tx=0x7f1d4c00abb0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 shutdown_connections 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x555a13ace230 0x555a13ad0620 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d3b7fe640 0 client.17325 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a13a53370 0x555a13a4d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a13a49b40 0x555a13a4cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 --2- 172.21.15.66:0/1238444413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a13a485d0 0x555a13a5bbc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 >> 172.21.15.66:0/1238444413 conn(0x555a13a11310 msgr2=0x555a13a52010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 shutdown_connections 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 1 -- 172.21.15.66:0/1238444413 wait complete. 2024-09-15T22:54:11.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d6473c740 20 client.17325 trim_cache size 0 max 16384 2024-09-15T22:54:11.059 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:11.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 msgr2=0x7f1d440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 0x7f1d440a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d500096c0 tx=0x7f1d50005fd0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 msgr2=0x7f1d5c10ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.050+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 0x7f1d5c10ee60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400e940 tx=0x7f1d5400ee00 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 shutdown_connections 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1d440a33b0 0x7f1d440a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d5c106a80 0x7f1d5c10ee60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d5c101420 0x7f1d5c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 --2- 172.21.15.66:0/4286489127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d5c100a80 0x7f1d5c10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 >> 172.21.15.66:0/4286489127 conn(0x7f1d5c0fc7a0 msgr2=0x7f1d5c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 shutdown_connections 2024-09-15T22:54:11.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:11.051+0000 7f1d62363640 1 -- 172.21.15.66:0/4286489127 wait complete. 2024-09-15T22:54:11.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:11 smithi066 ceph-mon[31185]: pgmap v271: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 28 op/s 2024-09-15T22:54:11.475 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:11 smithi184 ceph-mon[35203]: pgmap v271: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 28 op/s 2024-09-15T22:54:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:11 smithi087 ceph-mon[35290]: pgmap v271: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 28 op/s 2024-09-15T22:54:11.739 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:54:11.998 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 -- 172.21.15.66:0/3374272205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 msgr2=0x7f2200101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 --2- 172.21.15.66:0/3374272205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200101200 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009900 tx=0x7f21f802a480 comp rx=0 tx=0).stop 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 -- 172.21.15.66:0/3374272205 shutdown_connections 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 --2- 172.21.15.66:0/3374272205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102ef0 0x7f220010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 --2- 172.21.15.66:0/3374272205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102570 0x7f22001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 --2- 172.21.15.66:0/3374272205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200101200 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 -- 172.21.15.66:0/3374272205 >> 172.21.15.66:0/3374272205 conn(0x7f22000fc7d0 msgr2=0x7f22000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 -- 172.21.15.66:0/3374272205 shutdown_connections 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.487+0000 7f22082a2640 1 -- 172.21.15.66:0/3374272205 wait complete. 2024-09-15T22:54:12.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 Processor -- start 2024-09-15T22:54:12.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 -- start start 2024-09-15T22:54:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 0x7f2200198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102ef0 0x7f220019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2200110f80 con 0x7f2200100e20 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2200110e00 con 0x7f2200102570 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f22082a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2200111100 con 0x7f2200102ef0 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47632/0 (socket says 172.21.15.66:47632) 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 -- 172.21.15.66:0/3458197976 learned_addr learned my addr 172.21.15.66:0/3458197976 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220683f640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102ef0 0x7f220019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220583d640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 0x7f2200198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 -- 172.21.15.66:0/3458197976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102ef0 msgr2=0x7f220019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102ef0 0x7f220019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 -- 172.21.15.66:0/3458197976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 msgr2=0x7f2200198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 0x7f2200198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220603e640 1 -- 172.21.15.66:0/3458197976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220019d4d0 con 0x7f2200100e20 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.488+0000 7f220583d640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 0x7f2200198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f220603e640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f21ff7fe640 1 -- 172.21.15.66:0/3458197976 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f803f070 con 0x7f2200100e20 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f21ff7fe640 1 -- 172.21.15.66:0/3458197976 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f8031c30 con 0x7f2200100e20 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220019d760 con 0x7f2200100e20 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f21ff7fe640 1 -- 172.21.15.66:0/3458197976 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8035030 con 0x7f2200100e20 2024-09-15T22:54:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.489+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22001a50a0 con 0x7f2200100e20 2024-09-15T22:54:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.491+0000 7f21ff7fe640 1 -- 172.21.15.66:0/3458197976 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f21f8042070 con 0x7f2200100e20 2024-09-15T22:54:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 Processor -- start 2024-09-15T22:54:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 -- start start 2024-09-15T22:54:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037eca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2037522f0 con 0x55a2037f7370 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a2036f9cf0 con 0x55a2037edb40 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220a67b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a20374e2b0 con 0x55a2037ec5d0 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f21ff7fe640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 0x7f21e80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220583d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220583d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47642/0 (socket says 172.21.15.66:47642) 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220583d640 1 -- 172.21.15.66:0/4000064995 learned_addr learned my addr 172.21.15.66:0/4000064995 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220683f640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.492+0000 7f220683f640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 0x7f21e80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f21ff7fe640 1 -- 172.21.15.66:0/3458197976 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f21f80f08f0 con 0x7f2200100e20 2024-09-15T22:54:12.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220603e640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 -- 172.21.15.66:0/4000064995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 msgr2=0x55a2037eca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037eca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 -- 172.21.15.66:0/4000064995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 msgr2=0x55a2037ec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037ec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 -- 172.21.15.66:0/4000064995 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2036de3a0 con 0x55a2037f7370 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220603e640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220583d640 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009c00 tx=0x7f21f4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92f7b53f3d90123 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f220683f640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 0x7f21e80a58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21f0005fd0 tx=0x7f21f0009b30 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f21fcdea640 1 -- 172.21.15.66:0/4000064995 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4004030 con 0x55a2037f7370 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f21fcdea640 1 -- 172.21.15.66:0/4000064995 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f40041d0 con 0x55a2037f7370 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.493+0000 7f21fcdea640 1 -- 172.21.15.66:0/4000064995 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f40126b0 con 0x55a2037f7370 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- 172.21.15.66:0/4000064995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 msgr2=0x55a2037f9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009c00 tx=0x7f21f4010740 comp rx=0 tx=0).stop 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- 172.21.15.66:0/4000064995 shutdown_connections 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f9760 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 --2- 172.21.15.66:0/4000064995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037ec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- 172.21.15.66:0/4000064995 >> 172.21.15.66:0/4000064995 conn(0x55a2037b5310 msgr2=0x55a2037e8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- 172.21.15.66:0/4000064995 shutdown_connections 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- 172.21.15.66:0/4000064995 wait complete. 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.494+0000 7f220a67b740 1 -- start start 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 Processor -- start 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2037fa070 con 0x55a2037f7370 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a20370d060 con 0x55a2037edb40 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a2037fa1f0 con 0x55a2037ec5d0 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220a67b740 10 client.0 _ll_register_callbacks cb 0x55a2034608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47646/0 (socket says 172.21.15.66:47646) 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 -- 172.21.15.66:0/2321930210 learned_addr learned my addr 172.21.15.66:0/2321930210 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220583d640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220603e640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 -- 172.21.15.66:0/2321930210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 msgr2=0x55a2037f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 -- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 msgr2=0x55a2037f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.495+0000 7f220683f640 1 -- 172.21.15.66:0/2321930210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2034c33c0 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220683f640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e80 tx=0x7f21f0009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e923e8924467b17b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0004b20 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f21f0004cc0 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21f40041d0 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f21f0037050 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 10 client.17337 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a203805a80 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f40041d0 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f21f000f540 con 0x55a2037f7370 2024-09-15T22:54:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 10 client.17337 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 20 client.17337 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203806ee0 0x55a203809350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 4 client.17337 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.496+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a20375f860 con 0x55a203806ee0 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.497+0000 7f220603e640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203806ee0 0x55a203809350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.497+0000 7f21e5ffb640 10 client.17337 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:12.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.497+0000 7f220603e640 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203806ee0 0x55a203809350 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b537dbc4779ddb60 server_cookie=ef0d8f148a26a0c5 in_seq=0 out_seq=0 2024-09-15T22:54:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f21e5ffb640 1 -- 172.21.15.66:0/2321930210 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a20375f860 con 0x55a203806ee0 2024-09-15T22:54:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f21e5ffb640 10 client.17337 handle_command_reply: tid=0 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 client.17337 shutdown 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 msgr2=0x55a2037f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e80 tx=0x7f21f0009a00 comp rx=0 tx=0).stop 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 shutdown_connections 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a2037f44e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203806ee0 0x55a203809350 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037edb40 0x55a2037f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 --2- 172.21.15.66:0/2321930210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a2037f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 >> 172.21.15.66:0/2321930210 conn(0x55a2037b5310 msgr2=0x55a2037ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f21e5ffb640 0 client.17337 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 shutdown_connections 2024-09-15T22:54:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 1 -- 172.21.15.66:0/2321930210 wait complete. 2024-09-15T22:54:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.498+0000 7f220a67b740 20 client.17337 trim_cache size 0 max 16384 2024-09-15T22:54:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 Processor -- start 2024-09-15T22:54:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 -- start start 2024-09-15T22:54:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a203803310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037f7370 0x55a2037f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22001acfc0 con 0x55a2037edb40 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f22001aebf0 con 0x55a2037f7370 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.511+0000 7f220a67b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f22001ad690 con 0x55a2037ec5d0 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47658/0 (socket says 172.21.15.66:47658) 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 -- 172.21.15.66:0/1949484006 learned_addr learned my addr 172.21.15.66:0/1949484006 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 -- 172.21.15.66:0/1949484006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 msgr2=0x55a203803310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a203803310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 -- 172.21.15.66:0/1949484006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037f7370 msgr2=0x55a2037f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220683f640 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037f7370 0x55a2037f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037f7370 0x55a2037f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 -- 172.21.15.66:0/1949484006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2037f4650 con 0x55a2037edb40 2024-09-15T22:54:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f220583d640 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009780 tx=0x7f21f4005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6337c095b5abd9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f21e7fff640 1 -- 172.21.15.66:0/1949484006 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f40035f0 con 0x55a2037edb40 2024-09-15T22:54:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f21e7fff640 1 -- 172.21.15.66:0/1949484006 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f40055a0 con 0x55a2037edb40 2024-09-15T22:54:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.512+0000 7f21e7fff640 1 -- 172.21.15.66:0/1949484006 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f40129e0 con 0x55a2037edb40 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- 172.21.15.66:0/1949484006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 msgr2=0x55a2037ebc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009780 tx=0x7f21f4005900 comp rx=0 tx=0).stop 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- 172.21.15.66:0/1949484006 shutdown_connections 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037f7370 0x55a2037f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037edb40 0x55a2037ebc40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 --2- 172.21.15.66:0/1949484006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037ec5d0 0x55a203803310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- 172.21.15.66:0/1949484006 >> 172.21.15.66:0/1949484006 conn(0x55a2037b5310 msgr2=0x55a2037f3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- 172.21.15.66:0/1949484006 shutdown_connections 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- 172.21.15.66:0/1949484006 wait complete. 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 -- start start 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.513+0000 7f220a67b740 1 Processor -- start 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 0x55a2037ff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037edb40 0x55a20380e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22001ae4f0 con 0x55a2037f7370 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f22001add60 con 0x55a2037ec5d0 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f22001aafc0 con 0x55a2037edb40 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220a67b740 10 client.0 _ll_register_callbacks cb 0x7f21f0019d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47668/0 (socket says 172.21.15.66:47668) 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 -- 172.21.15.66:0/1130560092 learned_addr learned my addr 172.21.15.66:0/1130560092 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220603e640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 0x55a2037ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220583d640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037edb40 0x55a20380e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 -- 172.21.15.66:0/1130560092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037edb40 msgr2=0x55a20380e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037edb40 0x55a20380e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 -- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 msgr2=0x55a2037ff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 0x55a2037ff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 -- 172.21.15.66:0/1130560092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a20380ec70 con 0x55a2037f7370 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220603e640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 0x55a2037ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f220683f640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f21f000fad0 tx=0x7f21f00049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b81066459aecff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.514+0000 7f21e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0041020 con 0x55a2037f7370 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9591+0+0 (secure 0 0 0) 0x7f21f000f620 con 0x55a2037f7370 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21f40055a0 con 0x55a2037f7370 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f21f004c050 con 0x55a2037f7370 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 10 client.17343 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a2037fe140 con 0x55a2037f7370 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f40055a0 con 0x55a2037f7370 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f21f003d4d0 con 0x55a2037f7370 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 10 client.17343 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 20 client.17343 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203872030 0x55a203874450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 4 client.17343 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.515+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a203759d70 con 0x55a203872030 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220603e640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203872030 0x55a203874450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f21e5ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220603e640 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203872030 0x55a203874450 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9457259179963f5 server_cookie=a1844f1ee4be2d2e in_seq=0 out_seq=0 2024-09-15T22:54:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f21e5ffb640 1 -- 172.21.15.66:0/1130560092 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a203759d70 con 0x55a203872030 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f21e5ffb640 10 client.17343 handle_command_reply: tid=0 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 client.17343 shutdown 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 msgr2=0x55a20380e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f21f000fad0 tx=0x7f21f00049d0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 shutdown_connections 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2037f7370 0x55a20380e730 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2037edb40 0x55a20380e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a203872030 0x55a203874450 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 --2- 172.21.15.66:0/1130560092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2037ec5d0 0x55a2037ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 >> 172.21.15.66:0/1130560092 conn(0x55a2037b5310 msgr2=0x55a2037f26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f21e5ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 shutdown_connections 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 1 -- 172.21.15.66:0/1130560092 wait complete. 2024-09-15T22:54:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.516+0000 7f220a67b740 20 client.17343 trim_cache size 0 max 16384 2024-09-15T22:54:12.524 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:12.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 msgr2=0x7f21e80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 0x7f21e80a58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21f0005fd0 tx=0x7f21f0009b30 comp rx=0 tx=0).stop 2024-09-15T22:54:12.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 msgr2=0x7f2200198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f21f8006010 tx=0x7f21f8003c10 comp rx=0 tx=0).stop 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 shutdown_connections 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f21e80a3430 0x7f21e80a58f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2200102ef0 0x7f220019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2200102570 0x7f2200198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 --2- 172.21.15.66:0/3458197976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2200100e20 0x7f2200198520 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 >> 172.21.15.66:0/3458197976 conn(0x7f22000fc7d0 msgr2=0x7f220006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 shutdown_connections 2024-09-15T22:54:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:12.517+0000 7f22082a2640 1 -- 172.21.15.66:0/3458197976 wait complete. 2024-09-15T22:54:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:13 smithi066 ceph-mon[31185]: pgmap v272: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 32 op/s 2024-09-15T22:54:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:13 smithi087 ceph-mon[35290]: pgmap v272: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 32 op/s 2024-09-15T22:54:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:13 smithi184 ceph-mon[35203]: pgmap v272: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 32 op/s 2024-09-15T22:54:14.222 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:54:14.222 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:54:14.494 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:15.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 -- 172.21.15.66:0/2503273060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c2011b140 msgr2=0x7f5c2011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/2503273060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c2011b140 0x7f5c2011d530 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009ca0 tx=0x7f5c1802a8f0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 -- 172.21.15.66:0/2503273060 shutdown_connections 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/2503273060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c2011b140 0x7f5c2011d530 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/2503273060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109830 0x7f5c20109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/2503273060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c20109450 0x7f5c20110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.008+0000 7f5c26d5b640 1 -- 172.21.15.66:0/2503273060 >> 172.21.15.66:0/2503273060 conn(0x7f5c2006e140 msgr2=0x7f5c2006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.009+0000 7f5c26d5b640 1 -- 172.21.15.66:0/2503273060 shutdown_connections 2024-09-15T22:54:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.009+0000 7f5c26d5b640 1 -- 172.21.15.66:0/2503273060 wait complete. 2024-09-15T22:54:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.010+0000 7f5c26d5b640 1 Processor -- start 2024-09-15T22:54:15.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.010+0000 7f5c26d5b640 1 -- start start 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.010+0000 7f5c26d5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 0x7f5c2011a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c26d5b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 0x7f5c20114790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c26d5b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c2011b140 0x7f5c20114cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c26d5b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20111370 con 0x7f5c20109830 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c26d5b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c201111f0 con 0x7f5c20109450 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c26d5b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5c201114f0 con 0x7f5c2011b140 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c24af7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 0x7f5c2011a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c24af7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 0x7f5c2011a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:51682/0 (socket says 172.21.15.66:51682) 2024-09-15T22:54:15.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 0x7f5c20114790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.011+0000 7f5c24af7640 1 -- 172.21.15.66:0/723347553 learned_addr learned my addr 172.21.15.66:0/723347553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 -- 172.21.15.66:0/723347553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c2011b140 msgr2=0x7f5c20114cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c2011b140 0x7f5c20114cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 -- 172.21.15.66:0/723347553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 msgr2=0x7f5c2011a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 0x7f5c2011a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 -- 172.21.15.66:0/723347553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c20115290 con 0x7f5c20109830 2024-09-15T22:54:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c17fff640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 0x7f5c20114790 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000b360 tx=0x7f5c1000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c15ffb640 1 -- 172.21.15.66:0/723347553 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10015020 con 0x7f5c20109830 2024-09-15T22:54:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.012+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c20115580 con 0x7f5c20109830 2024-09-15T22:54:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.013+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c201bc4c0 con 0x7f5c20109830 2024-09-15T22:54:15.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.013+0000 7f5c15ffb640 1 -- 172.21.15.66:0/723347553 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c10011d10 con 0x7f5c20109830 2024-09-15T22:54:15.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.014+0000 7f5c15ffb640 1 -- 172.21.15.66:0/723347553 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100193b0 con 0x7f5c20109830 2024-09-15T22:54:15.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.017+0000 7f5c15ffb640 1 -- 172.21.15.66:0/723347553 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5c10018020 con 0x7f5c20109830 2024-09-15T22:54:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 Processor -- start 2024-09-15T22:54:15.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 -- start start 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c258480 0x55ac5c262800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c265130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c1bd280 con 0x55ac5c257b60 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c164b10 con 0x55ac5c262d40 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.018+0000 7f5c29134740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c1b9240 con 0x55ac5c258480 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47682/0 (socket says 172.21.15.66:47682) 2024-09-15T22:54:15.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 -- 172.21.15.66:0/1907457356 learned_addr learned my addr 172.21.15.66:0/1907457356 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 -- 172.21.15.66:0/1907457356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c258480 msgr2=0x55ac5c262800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c258480 0x55ac5c262800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 -- 172.21.15.66:0/1907457356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 msgr2=0x55ac5c265130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c265130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.019+0000 7f5c252f8640 1 -- 172.21.15.66:0/1907457356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5c1711f0 con 0x55ac5c257b60 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.020+0000 7f5c15ffb640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 0x7f5c080a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.020+0000 7f5c252f8640 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5c1802aee0 tx=0x7f5c180010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e4b7a6461a1580 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.020+0000 7f5c15ffb640 1 -- 172.21.15.66:0/723347553 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7f5c100cf890 con 0x7f5c20109830 2024-09-15T22:54:15.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.020+0000 7f5c24af7640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 0x7f5c080a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.021+0000 7f5c06ffd640 1 -- 172.21.15.66:0/1907457356 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c180307f0 con 0x55ac5c257b60 2024-09-15T22:54:15.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.021+0000 7f5c06ffd640 1 -- 172.21.15.66:0/1907457356 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c1803f070 con 0x55ac5c257b60 2024-09-15T22:54:15.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 -- 172.21.15.66:0/1907457356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 msgr2=0x55ac5c257f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5c1802aee0 tx=0x7f5c180010b0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 -- 172.21.15.66:0/1907457356 shutdown_connections 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c265130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c258480 0x55ac5c262800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 --2- 172.21.15.66:0/1907457356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c257b60 0x55ac5c257f40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.022+0000 7f5c29134740 1 -- 172.21.15.66:0/1907457356 >> 172.21.15.66:0/1907457356 conn(0x55ac5c2540f0 msgr2=0x55ac5c2544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.023+0000 7f5c24af7640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 0x7f5c080a58a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.024+0000 7f5c29134740 1 -- 172.21.15.66:0/1907457356 shutdown_connections 2024-09-15T22:54:15.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.024+0000 7f5c29134740 1 -- 172.21.15.66:0/1907457356 wait complete. 2024-09-15T22:54:15.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.024+0000 7f5c29134740 1 -- start start 2024-09-15T22:54:15.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.024+0000 7f5c29134740 1 Processor -- start 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 0x55ac5c2626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c260310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c265960 con 0x55ac5c258480 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c177f10 con 0x55ac5c262d40 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac5c265ae0 con 0x55ac5c25fed0 2024-09-15T22:54:15.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.025+0000 7f5c29134740 10 client.0 _ll_register_callbacks cb 0x55ac5c140a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:15.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.026+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.026+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:51706/0 (socket says 172.21.15.66:51706) 2024-09-15T22:54:15.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.026+0000 7f5c17fff640 1 -- 172.21.15.66:0/3740932955 learned_addr learned my addr 172.21.15.66:0/3740932955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:15.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.026+0000 7f5c252f8640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c260310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.027+0000 7f5c24af7640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 0x55ac5c2626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 -- 172.21.15.66:0/3740932955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 msgr2=0x55ac5c260310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c260310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 -- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 msgr2=0x55ac5c25f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 -- 172.21.15.66:0/3740932955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5bf2e6a0 con 0x55ac5c258480 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5c24af7640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 0x55ac5c2626e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00dde0 tx=0x7f5c1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4dd24a771ebcf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.028+0000 7f5bfffff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.029+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c024060 con 0x55ac5c258480 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.029+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ac5c1ca7f0 con 0x55ac5c258480 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.029+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7f5c1c01f400 con 0x55ac5c258480 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.030+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5c1c02b050 con 0x55ac5c258480 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.030+0000 7f5c29134740 10 client.17355 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:15.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.030+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ac5c271930 con 0x55ac5c258480 2024-09-15T22:54:15.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.030+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ac5c1ca7f0 con 0x55ac5c258480 2024-09-15T22:54:15.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f5c1c013070 con 0x55ac5c258480 2024-09-15T22:54:15.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 10 client.17355 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 20 client.17355 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c273290 0x55ac5c2756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 4 client.17355 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.031+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac5c1c4d00 con 0x55ac5c273290 2024-09-15T22:54:15.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.032+0000 7f5c17fff640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c273290 0x55ac5c2756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.034+0000 7f5c17fff640 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c273290 0x55ac5c2756b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17deb0435a91d826 server_cookie=ca06c2d75babf883 in_seq=0 out_seq=0 2024-09-15T22:54:15.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.034+0000 7f5bfffff640 10 client.17355 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:15.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5bfffff640 1 -- 172.21.15.66:0/3740932955 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac5c1c4d00 con 0x55ac5c273290 2024-09-15T22:54:15.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5bfffff640 10 client.17355 handle_command_reply: tid=0 2024-09-15T22:54:15.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 client.17355 shutdown 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 msgr2=0x55ac5c2626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 0x55ac5c2626e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00dde0 tx=0x7f5c1c004770 comp rx=0 tx=0).stop 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 shutdown_connections 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c260310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c273290 0x55ac5c2756b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 --2- 172.21.15.66:0/3740932955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c258480 0x55ac5c2626e0 secure :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00dde0 tx=0x7f5c1c004770 comp rx=0 tx=0).stop 2024-09-15T22:54:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.036+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 >> 172.21.15.66:0/3740932955 conn(0x55ac5c2540f0 msgr2=0x55ac5c259630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.037+0000 7f5bfffff640 0 client.17355 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.037+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 shutdown_connections 2024-09-15T22:54:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.038+0000 7f5c29134740 1 -- 172.21.15.66:0/3740932955 wait complete. 2024-09-15T22:54:15.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.040+0000 7f5c29134740 20 client.17355 trim_cache size 0 max 16384 2024-09-15T22:54:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.078+0000 7f5c29134740 1 Processor -- start 2024-09-15T22:54:15.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 -- start start 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c25fed0 0x55ac5c25f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25e990 0x55ac5c2595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c010390 con 0x55ac5c25fed0 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c011fc0 con 0x55ac5c262d40 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c29134740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c010a60 con 0x55ac5c25e990 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.079+0000 7f5c252f8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25e990 0x55ac5c2595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:51716/0 (socket says 172.21.15.66:51716) 2024-09-15T22:54:15.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 -- 172.21.15.66:0/3611320901 learned_addr learned my addr 172.21.15.66:0/3611320901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:15.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c24af7640 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c25fed0 0x55ac5c25f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 -- 172.21.15.66:0/3611320901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25e990 msgr2=0x55ac5c2595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25e990 0x55ac5c2595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 -- 172.21.15.66:0/3611320901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c25fed0 msgr2=0x55ac5c25f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c25fed0 0x55ac5c25f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 -- 172.21.15.66:0/3611320901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5c24f830 con 0x55ac5c262d40 2024-09-15T22:54:15.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.080+0000 7f5c17fff640 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5c10098170 tx=0x7f5c10006d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee59ae4eca56a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.081+0000 7f5c067fc640 1 -- 172.21.15.66:0/3611320901 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100a4410 con 0x55ac5c262d40 2024-09-15T22:54:15.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.081+0000 7f5c067fc640 1 -- 172.21.15.66:0/3611320901 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c10099840 con 0x55ac5c262d40 2024-09-15T22:54:15.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.082+0000 7f5c067fc640 1 -- 172.21.15.66:0/3611320901 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1001a660 con 0x55ac5c262d40 2024-09-15T22:54:15.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.082+0000 7f5c29134740 1 -- 172.21.15.66:0/3611320901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 msgr2=0x55ac5c25f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.082+0000 7f5c29134740 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5c10098170 tx=0x7f5c10006d30 comp rx=0 tx=0).stop 2024-09-15T22:54:15.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.083+0000 7f5c29134740 1 -- 172.21.15.66:0/3611320901 shutdown_connections 2024-09-15T22:54:15.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.083+0000 7f5c29134740 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25e990 0x55ac5c2595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.083+0000 7f5c29134740 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c262d40 0x55ac5c25f790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.083+0000 7f5c29134740 1 --2- 172.21.15.66:0/3611320901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c25fed0 0x55ac5c25f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.083+0000 7f5c29134740 1 -- 172.21.15.66:0/3611320901 >> 172.21.15.66:0/3611320901 conn(0x55ac5c2540f0 msgr2=0x55ac5c25e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.086+0000 7f5c29134740 1 -- 172.21.15.66:0/3611320901 shutdown_connections 2024-09-15T22:54:15.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.089+0000 7f5c29134740 1 -- 172.21.15.66:0/3611320901 wait complete. 2024-09-15T22:54:15.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.089+0000 7f5c29134740 1 -- start start 2024-09-15T22:54:15.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.089+0000 7f5c29134740 1 Processor -- start 2024-09-15T22:54:15.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c25e990 0x55ac5c26ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c262d40 0x55ac5c25bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0118c0 con 0x55ac5c262d40 2024-09-15T22:54:15.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c011130 con 0x55ac5c25e990 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c00e390 con 0x55ac5c25fed0 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c29134740 10 client.0 _ll_register_callbacks cb 0x7f5c1c0095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c252f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c262d40 0x55ac5c25bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.090+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.091+0000 7f5c17fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:58822/0 (socket says 172.21.15.66:58822) 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.091+0000 7f5c17fff640 1 -- 172.21.15.66:0/1895151807 learned_addr learned my addr 172.21.15.66:0/1895151807 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.091+0000 7f5c24af7640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c25e990 0x55ac5c26ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.092+0000 7f5c17fff640 1 -- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c25e990 msgr2=0x55ac5c26ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.092+0000 7f5c17fff640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c25e990 0x55ac5c26ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.092+0000 7f5c17fff640 1 -- 172.21.15.66:0/1895151807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c262d40 msgr2=0x55ac5c25bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.092+0000 7f5c17fff640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c262d40 0x55ac5c25bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.092+0000 7f5c17fff640 1 -- 172.21.15.66:0/1895151807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5c262a50 con 0x55ac5c25fed0 2024-09-15T22:54:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.093+0000 7f5c17fff640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c1001a9c0 tx=0x7f5c1009fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5396746fa7141311 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.093+0000 7f5bfffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.093+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10097e10 con 0x55ac5c25fed0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.093+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c10099840 con 0x55ac5c25fed0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.093+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7f5c1001a400 con 0x55ac5c25fed0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.094+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5c10097fb0 con 0x55ac5c25fed0 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.094+0000 7f5c29134740 10 client.26758 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.094+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ac5c260680 con 0x55ac5c25fed0 2024-09-15T22:54:15.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.095+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c10099840 con 0x55ac5c25fed0 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7f5c100cf370 con 0x55ac5c25fed0 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 10 client.26758 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 10 client.26758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 20 client.26758 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c25d750 0x55ac5c2e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 4 client.26758 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:54:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac5c141110 con 0x55ac5c25d750 2024-09-15T22:54:15.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.097+0000 7f5c24af7640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c25d750 0x55ac5c2e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:15.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.098+0000 7f5c24af7640 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c25d750 0x55ac5c2e0f90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3580025bf85f014 server_cookie=769123350afa0e2f in_seq=0 out_seq=0 2024-09-15T22:54:15.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.098+0000 7f5bfffff640 10 client.26758 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:15.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.101+0000 7f5bfffff640 1 -- 172.21.15.66:0/1895151807 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac5c141110 con 0x55ac5c25d750 2024-09-15T22:54:15.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.101+0000 7f5bfffff640 10 client.26758 handle_command_reply: tid=0 2024-09-15T22:54:15.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.101+0000 7f5c29134740 1 client.26758 shutdown 2024-09-15T22:54:15.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.101+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 msgr2=0x55ac5c26b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.101+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c1001a9c0 tx=0x7f5c1009fca0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 shutdown_connections 2024-09-15T22:54:15.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ac5c262d40 0x55ac5c25bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac5c25fed0 0x55ac5c26b350 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ac5c25d750 0x55ac5c2e0f90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 --2- 172.21.15.66:0/1895151807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ac5c25e990 0x55ac5c26ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 >> 172.21.15.66:0/1895151807 conn(0x55ac5c2540f0 msgr2=0x55ac5c25f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5bfffff640 0 client.26758 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 shutdown_connections 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 1 -- 172.21.15.66:0/1895151807 wait complete. 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.102+0000 7f5c29134740 20 client.26758 trim_cache size 0 max 16384 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "c72c7698-d515-4961-90f4-d93ace632ecc", 2024-09-15T22:54:15.104 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:54:15.105 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 msgr2=0x7f5c080a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 0x7f5c080a58a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c008040 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 msgr2=0x7f5c20114790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 0x7f5c20114790 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000b360 tx=0x7f5c1000b820 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 shutdown_connections 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5c080a33e0 0x7f5c080a58a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c2011b140 0x7f5c20114cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c20109830 0x7f5c20114790 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 --2- 172.21.15.66:0/723347553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c20109450 0x7f5c2011a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:15.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.104+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 >> 172.21.15.66:0/723347553 conn(0x7f5c2006e140 msgr2=0x7f5c20070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:15.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.106+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 shutdown_connections 2024-09-15T22:54:15.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:15.107+0000 7f5c26d5b640 1 -- 172.21.15.66:0/723347553 wait complete. 2024-09-15T22:54:15.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:15 smithi066 ceph-mon[31185]: pgmap v273: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-09-15T22:54:15.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:15 smithi066 ceph-mon[31185]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:54:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:15 smithi087 ceph-mon[35290]: pgmap v273: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-09-15T22:54:15.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:15 smithi087 ceph-mon[35290]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:54:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:15 smithi184 ceph-mon[35203]: pgmap v273: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 44 KiB/s wr, 33 op/s 2024-09-15T22:54:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:15 smithi184 ceph-mon[35203]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:54:16.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:54:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:16 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:54:16.461 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:54:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:54:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:54:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:54:16.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:54:16.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:16 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:54:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:54:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:54:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:54:16.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:54:16.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:54:16.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:16 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:54:16.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 -- 172.21.15.66:0/38653415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 msgr2=0x7ff094106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 --2- 172.21.15.66:0/38653415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff094106340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009ca0 tx=0x7ff08c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 -- 172.21.15.66:0/38653415 shutdown_connections 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 --2- 172.21.15.66:0/38653415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff094106340 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 --2- 172.21.15.66:0/38653415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff094105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 --2- 172.21.15.66:0/38653415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff094100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.976+0000 7ff09921b640 1 -- 172.21.15.66:0/38653415 >> 172.21.15.66:0/38653415 conn(0x7ff0940fc7d0 msgr2=0x7ff0940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.977+0000 7ff09921b640 1 -- 172.21.15.66:0/38653415 shutdown_connections 2024-09-15T22:54:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.977+0000 7ff09921b640 1 -- 172.21.15.66:0/38653415 wait complete. 2024-09-15T22:54:16.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.978+0000 7ff09921b640 1 Processor -- start 2024-09-15T22:54:16.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.978+0000 7ff09921b640 1 -- start start 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.978+0000 7ff09921b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff0941a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09921b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff0941a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09921b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09921b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff094118680 con 0x7ff094105ec0 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09921b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff094118500 con 0x7ff0941008c0 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09921b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff094118800 con 0x7ff0941011e0 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47726/0 (socket says 172.21.15.66:47726) 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 -- 172.21.15.66:0/680723802 learned_addr learned my addr 172.21.15.66:0/680723802 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09259c640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff0941a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 -- 172.21.15.66:0/680723802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 msgr2=0x7ff0941a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff0941a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff0941a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 -- 172.21.15.66:0/680723802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 msgr2=0x7ff0941a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff0941a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09359e640 1 -- 172.21.15.66:0/680723802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09419f060 con 0x7ff094105ec0 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff09259c640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff0941a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.979+0000 7ff092d9d640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff0941a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:16.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.980+0000 7ff09359e640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff08c003f10 tx=0x7ff08c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:16.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.980+0000 7ff07bfff640 1 -- 172.21.15.66:0/680723802 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c031710 con 0x7ff094105ec0 2024-09-15T22:54:16.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.981+0000 7ff07bfff640 1 -- 172.21.15.66:0/680723802 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff08c0318b0 con 0x7ff094105ec0 2024-09-15T22:54:16.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.981+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09419f2f0 con 0x7ff094105ec0 2024-09-15T22:54:16.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.981+0000 7ff07bfff640 1 -- 172.21.15.66:0/680723802 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c02fb20 con 0x7ff094105ec0 2024-09-15T22:54:16.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.981+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0941ab640 con 0x7ff094105ec0 2024-09-15T22:54:16.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.984+0000 7ff07bfff640 1 -- 172.21.15.66:0/680723802 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff08c02fd60 con 0x7ff094105ec0 2024-09-15T22:54:16.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.984+0000 7ff09b5f4740 1 Processor -- start 2024-09-15T22:54:16.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.985+0000 7ff09b5f4740 1 -- start start 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.985+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.985+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563dc92372e0 con 0x563dc92d1dc0 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563dc91dece0 con 0x563dc92d14a0 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563dc92332a0 con 0x563dc92dc680 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92dc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47738/0 (socket says 172.21.15.66:47738) 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff092d9d640 1 -- 172.21.15.66:0/2355930327 learned_addr learned my addr 172.21.15.66:0/2355930327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 -- 172.21.15.66:0/2355930327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 msgr2=0x563dc92dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:16.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92dea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 -- 172.21.15.66:0/2355930327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 msgr2=0x563dc92dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:16.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.986+0000 7ff09259c640 1 -- 172.21.15.66:0/2355930327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc91c3440 con 0x563dc92d14a0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.987+0000 7ff07bfff640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 0x7ff07c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.987+0000 7ff07bfff640 1 -- 172.21.15.66:0/680723802 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7ff08c0f1720 con 0x7ff094105ec0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.987+0000 7ff09259c640 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92d1880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ffdc0 tx=0x7ff08800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f34f3225dbaba33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.987+0000 7ff092d9d640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 0x7ff07c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.987+0000 7ff0797fa640 1 -- 172.21.15.66:0/2355930327 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08800b830 con 0x563dc92d14a0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.988+0000 7ff0797fa640 1 -- 172.21.15.66:0/2355930327 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff088013e10 con 0x563dc92d14a0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.988+0000 7ff0797fa640 1 -- 172.21.15.66:0/2355930327 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08801ecf0 con 0x563dc92d14a0 2024-09-15T22:54:16.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2355930327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 msgr2=0x563dc92d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92d1880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ffdc0 tx=0x7ff08800ef90 comp rx=0 tx=0).stop 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff092d9d640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 0x7ff07c0a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x563dc92ce890 tx=0x7ff084009540 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2355930327 shutdown_connections 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2355930327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92d1880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2355930327 >> 172.21.15.66:0/2355930327 conn(0x563dc92cda30 msgr2=0x563dc92cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2355930327 shutdown_connections 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.989+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2355930327 wait complete. 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.990+0000 7ff09b5f4740 1 -- start start 2024-09-15T22:54:16.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.990+0000 7ff09b5f4740 1 Processor -- start 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.990+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92dc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.990+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47754/0 (socket says 172.21.15.66:47754) 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92d9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 -- 172.21.15.66:0/3296535634 learned_addr learned my addr 172.21.15.66:0/3296535634 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:16.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563dc92df250 con 0x563dc92d1dc0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563dc91f2050 con 0x563dc92d14a0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563dc92df3d0 con 0x563dc92dc680 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff092d9d640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09359e640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92d9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09b5f4740 10 client.0 _ll_register_callbacks cb 0x563dc9232160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 -- 172.21.15.66:0/3296535634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 msgr2=0x563dc92d9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92d9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 -- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 msgr2=0x563dc92dc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92dc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.991+0000 7ff09259c640 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dc8fa83c0 con 0x563dc92d1dc0 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.992+0000 7ff092d9d640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:16.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.992+0000 7ff09259c640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff08800e3f0 tx=0x7ff08801e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5323dbfde1f1ed4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.992+0000 7ff076ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.992+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08801ec70 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.992+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7ff088005040 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff088013e10 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff08801ee10 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 10 client.17373 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x563dc92eac70 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0880046c0 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7ff08800f040 con 0x563dc92d1dc0 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 10 client.17373 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.993+0000 7ff09b5f4740 20 client.17373 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc92ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:16.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff09b5f4740 4 client.17373 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:16.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff088013e10 con 0x563dc92ebfc0 2024-09-15T22:54:16.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff092d9d640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc92ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:16.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff092d9d640 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc92ee3b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3bd9773d96183e server_cookie=f0ab36e92e9ae35a in_seq=0 out_seq=0 2024-09-15T22:54:16.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.994+0000 7ff076ff5640 10 client.17373 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:17.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.996+0000 7ff076ff5640 1 -- 172.21.15.66:0/3296535634 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff088013e10 con 0x563dc92ebfc0 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.996+0000 7ff076ff5640 10 client.17373 handle_command_reply: tid=0 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.996+0000 7ff09b5f4740 1 client.17373 shutdown 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 msgr2=0x563dc92d9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff08800e3f0 tx=0x7ff08801e740 comp rx=0 tx=0).stop 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 shutdown_connections 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92d9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d1dc0 0x563dc92d9330 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc92ee3b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff076ff5640 0 client.17373 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/3296535634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d14a0 0x563dc92dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 >> 172.21.15.66:0/3296535634 conn(0x563dc92cda30 msgr2=0x563dc92ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 shutdown_connections 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 1 -- 172.21.15.66:0/3296535634 wait complete. 2024-09-15T22:54:17.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:16.997+0000 7ff09b5f4740 20 client.17373 trim_cache size 0 max 16384 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.028+0000 7ff09b5f4740 1 Processor -- start 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.028+0000 7ff09b5f4740 1 -- start start 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.028+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92d1dc0 0x563dc92f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92dc680 0x563dc92f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b5a10 con 0x563dc92d14a0 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b7640 con 0x563dc92dc680 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b60e0 con 0x563dc92d1dc0 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47760/0 (socket says 172.21.15.66:47760) 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 -- 172.21.15.66:0/2521945327 learned_addr learned my addr 172.21.15.66:0/2521945327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09259c640 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92d1dc0 0x563dc92f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff09359e640 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92dc680 0x563dc92f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 -- 172.21.15.66:0/2521945327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92d1dc0 msgr2=0x563dc92f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92d1dc0 0x563dc92f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 -- 172.21.15.66:0/2521945327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92dc680 msgr2=0x563dc92f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92dc680 0x563dc92f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 -- 172.21.15.66:0/2521945327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc92ce6c0 con 0x563dc92d14a0 2024-09-15T22:54:17.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.029+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff084005e50 tx=0x7ff084014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbea38992caebd69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.030+0000 7ff078ff9640 1 -- 172.21.15.66:0/2521945327 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08402e070 con 0x563dc92d14a0 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.030+0000 7ff078ff9640 1 -- 172.21.15.66:0/2521945327 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0840211d0 con 0x563dc92d14a0 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.030+0000 7ff078ff9640 1 -- 172.21.15.66:0/2521945327 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084028830 con 0x563dc92d14a0 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2521945327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 msgr2=0x563dc92e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff084005e50 tx=0x7ff084014000 comp rx=0 tx=0).stop 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2521945327 shutdown_connections 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92dc680 0x563dc92f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92d1dc0 0x563dc92f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2521945327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e84b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.031+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2521945327 >> 172.21.15.66:0/2521945327 conn(0x563dc92cda30 msgr2=0x563dc92d8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.032+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2521945327 shutdown_connections 2024-09-15T22:54:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.032+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2521945327 wait complete. 2024-09-15T22:54:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 -- start start 2024-09-15T22:54:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 Processor -- start 2024-09-15T22:54:17.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d1dc0 0x563dc92e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b6f40 con 0x563dc92d14a0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b67b0 con 0x563dc92d1dc0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff09b5f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0941b3a10 con 0x563dc92dc680 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.033+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47770/0 (socket says 172.21.15.66:47770) 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 -- 172.21.15.66:0/2516889552 learned_addr learned my addr 172.21.15.66:0/2516889552 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff09b5f4740 10 client.0 _ll_register_callbacks cb 0x7ff0840093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff09359e640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff09259c640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d1dc0 0x563dc92e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 -- 172.21.15.66:0/2516889552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 msgr2=0x563dc92e2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92e2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 -- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d1dc0 msgr2=0x563dc92e2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d1dc0 0x563dc92e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 -- 172.21.15.66:0/2516889552 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dc92e2f50 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff092d9d640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff084011c40 tx=0x7ff084005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a0e77c5efa5aad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff076ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.034+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084037060 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0840211d0 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9679+0+0 (secure 0 0 0) 0x7ff084005460 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff08403e050 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 10 client.17379 fetch_fsmap learned FSMap version 46 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x563dc9356b10 con 0x563dc92d14a0 2024-09-15T22:54:17.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0840211d0 con 0x563dc92d14a0 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 46) ==== 8390+0+0 (secure 0 0 0) 0x7ff084031070 con 0x563dc92d14a0 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 10 client.17379 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 20 client.17379 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc9359180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 4 client.17379 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.035+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563dc9244850 con 0x563dc92ebfc0 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.036+0000 7ff09259c640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc9359180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.036+0000 7ff076ff5640 10 client.17379 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:17.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.037+0000 7ff09259c640 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc9359180 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5407ae8738892676 server_cookie=74611121cfd51973 in_seq=0 out_seq=0 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.037+0000 7ff076ff5640 1 -- 172.21.15.66:0/2516889552 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x563dc9244850 con 0x563dc92ebfc0 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.037+0000 7ff076ff5640 10 client.17379 handle_command_reply: tid=0 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.037+0000 7ff09b5f4740 1 client.17379 shutdown 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 msgr2=0x563dc92e4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff084011c40 tx=0x7ff084005270 comp rx=0 tx=0).stop 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 shutdown_connections 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563dc92dc680 0x563dc92e2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563dc92ebfc0 0x563dc9359180 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff076ff5640 0 client.17379 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563dc92d1dc0 0x563dc92e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 --2- 172.21.15.66:0/2516889552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563dc92d14a0 0x563dc92e4e30 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 >> 172.21.15.66:0/2516889552 conn(0x563dc92cda30 msgr2=0x563dc92cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 shutdown_connections 2024-09-15T22:54:17.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 1 -- 172.21.15.66:0/2516889552 wait complete. 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.038+0000 7ff09b5f4740 20 client.17379 trim_cache size 0 max 16384 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (11186 inodes in the stack)", 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "c72c7698-d515-4961-90f4-d93ace632ecc": { 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "c72c7698-d515-4961-90f4-d93ace632ecc", 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:17.043 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:17.044 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:17.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.039+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 msgr2=0x7ff07c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:17.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.039+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 0x7ff07c0a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x563dc92ce890 tx=0x7ff084009540 comp rx=0 tx=0).stop 2024-09-15T22:54:17.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.039+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 msgr2=0x7ff09419e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.039+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff08c003f10 tx=0x7ff08c003f40 comp rx=0 tx=0).stop 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 shutdown_connections 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff07c0a33b0 0x7ff07c0a5870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff094105ec0 0x7ff09419e930 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0941011e0 0x7ff0941a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 --2- 172.21.15.66:0/680723802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0941008c0 0x7ff0941a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 >> 172.21.15.66:0/680723802 conn(0x7ff0940fc7d0 msgr2=0x7ff094103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 shutdown_connections 2024-09-15T22:54:17.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:17.040+0000 7ff09921b640 1 -- 172.21.15.66:0/680723802 wait complete. 2024-09-15T22:54:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:17 smithi087 ceph-mon[35290]: pgmap v275: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 KiB/s wr, 36 op/s 2024-09-15T22:54:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:17 smithi184 ceph-mon[35203]: pgmap v275: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 KiB/s wr, 36 op/s 2024-09-15T22:54:17.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:17 smithi066 ceph-mon[31185]: pgmap v275: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 KiB/s wr, 36 op/s 2024-09-15T22:54:17.768 INFO:tasks.cephfs.filesystem:scrub status for tag:c72c7698-d515-4961-90f4-d93ace632ecc - {'path': '/', 'tag': 'c72c7698-d515-4961-90f4-d93ace632ecc', 'options': 'recursive,force'} 2024-09-15T22:54:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:19 smithi087 ceph-mon[35290]: pgmap v276: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 26 op/s 2024-09-15T22:54:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:19 smithi184 ceph-mon[35203]: pgmap v276: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 26 op/s 2024-09-15T22:54:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:19.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:19 smithi066 ceph-mon[31185]: pgmap v276: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 26 op/s 2024-09-15T22:54:19.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:19.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:20 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:20 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:20.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:20 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:54:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:21 smithi087 ceph-mon[35290]: pgmap v277: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 33 KiB/s wr, 86 op/s 2024-09-15T22:54:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:21 smithi184 ceph-mon[35203]: pgmap v277: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 33 KiB/s wr, 86 op/s 2024-09-15T22:54:21.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:21 smithi066 ceph-mon[31185]: pgmap v277: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 33 KiB/s wr, 86 op/s 2024-09-15T22:54:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:23 smithi087 ceph-mon[35290]: pgmap v278: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 19 KiB/s wr, 151 op/s 2024-09-15T22:54:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:23 smithi184 ceph-mon[35203]: pgmap v278: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 19 KiB/s wr, 151 op/s 2024-09-15T22:54:23.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:23 smithi066 ceph-mon[31185]: pgmap v278: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 19 KiB/s wr, 151 op/s 2024-09-15T22:54:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:24 smithi087 ceph-mon[35290]: pgmap v279: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 KiB/s wr, 171 op/s 2024-09-15T22:54:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:24 smithi087 ceph-mon[35290]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:54:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:24 smithi184 ceph-mon[35203]: pgmap v279: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 KiB/s wr, 171 op/s 2024-09-15T22:54:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:24 smithi184 ceph-mon[35203]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:54:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:24 smithi066 ceph-mon[31185]: pgmap v279: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 KiB/s wr, 171 op/s 2024-09-15T22:54:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:24 smithi066 ceph-mon[31185]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:54:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:26 smithi087 ceph-mon[35290]: pgmap v281: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 19 KiB/s wr, 172 op/s 2024-09-15T22:54:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:26 smithi184 ceph-mon[35203]: pgmap v281: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 19 KiB/s wr, 172 op/s 2024-09-15T22:54:27.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:26 smithi066 ceph-mon[31185]: pgmap v281: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 19 KiB/s wr, 172 op/s 2024-09-15T22:54:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:28 smithi087 ceph-mon[35290]: pgmap v282: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 KiB/s wr, 165 op/s 2024-09-15T22:54:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:28 smithi184 ceph-mon[35203]: pgmap v282: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 KiB/s wr, 165 op/s 2024-09-15T22:54:29.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:28 smithi066 ceph-mon[31185]: pgmap v282: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 24 KiB/s wr, 165 op/s 2024-09-15T22:54:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:54:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:54:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:29 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:54:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:54:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:54:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:29 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:54:30.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:54:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:54:30.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:29 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:54:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:54:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:30 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:54:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:30 smithi087 ceph-mon[35290]: pgmap v283: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 KiB/s wr, 107 op/s 2024-09-15T22:54:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:54:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:30 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:54:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:30 smithi184 ceph-mon[35203]: pgmap v283: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 KiB/s wr, 107 op/s 2024-09-15T22:54:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:54:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:30 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:54:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:30 smithi066 ceph-mon[31185]: pgmap v283: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 KiB/s wr, 107 op/s 2024-09-15T22:54:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:32 smithi087 ceph-mon[35290]: pgmap v284: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 KiB/s wr, 39 op/s 2024-09-15T22:54:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:32 smithi184 ceph-mon[35203]: pgmap v284: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 KiB/s wr, 39 op/s 2024-09-15T22:54:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:32 smithi066 ceph-mon[31185]: pgmap v284: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 24 KiB/s wr, 39 op/s 2024-09-15T22:54:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:34 smithi087 ceph-mon[35290]: pgmap v285: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-15T22:54:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:34 smithi184 ceph-mon[35203]: pgmap v285: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-15T22:54:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:34 smithi066 ceph-mon[31185]: pgmap v285: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-15T22:54:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:36 smithi087 ceph-mon[35290]: pgmap v286: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-15T22:54:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:36 smithi184 ceph-mon[35203]: pgmap v286: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-15T22:54:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:36 smithi066 ceph-mon[31185]: pgmap v286: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-15T22:54:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:38 smithi087 ceph-mon[35290]: pgmap v287: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-15T22:54:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:38 smithi184 ceph-mon[35203]: pgmap v287: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-15T22:54:39.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:38 smithi066 ceph-mon[31185]: pgmap v287: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-15T22:54:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:40 smithi087 ceph-mon[35290]: pgmap v288: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-15T22:54:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:40 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:40 smithi184 ceph-mon[35203]: pgmap v288: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-15T22:54:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:40 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:40 smithi066 ceph-mon[31185]: pgmap v288: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-15T22:54:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:40 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:42 smithi087 ceph-mon[35290]: pgmap v289: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-15T22:54:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:42 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:54:43.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:42 smithi184 ceph-mon[35203]: pgmap v289: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-15T22:54:43.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:42 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:54:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:42 smithi066 ceph-mon[31185]: pgmap v289: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-15T22:54:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:42 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:54:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:43 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:54:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:43 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:54:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:43 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:54:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:43 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:54:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:43 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:54:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:43 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:54:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:43 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:54:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:43 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:54:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:43 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:54:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:45 smithi087 ceph-mon[35290]: pgmap v290: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-15T22:54:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:45 smithi184 ceph-mon[35203]: pgmap v290: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-15T22:54:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:45 smithi066 ceph-mon[31185]: pgmap v290: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-15T22:54:45.653 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T22:54:45.653 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.35 2024-09-15T22:54:45.653 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:54:45.928 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 -- 172.21.15.66:0/3352661357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff464102d40 msgr2=0x7ff464103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 --2- 172.21.15.66:0/3352661357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff464102d40 0x7ff464103120 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009900 tx=0x7ff44c02a480 comp rx=0 tx=0).stop 2024-09-15T22:54:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 -- 172.21.15.66:0/3352661357 shutdown_connections 2024-09-15T22:54:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 --2- 172.21.15.66:0/3352661357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff46410c170 0x7ff46410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 --2- 172.21.15.66:0/3352661357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 0x7ff46410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 --2- 172.21.15.66:0/3352661357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff464102d40 0x7ff464103120 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 -- 172.21.15.66:0/3352661357 >> 172.21.15.66:0/3352661357 conn(0x7ff4640fc7a0 msgr2=0x7ff4640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 -- 172.21.15.66:0/3352661357 shutdown_connections 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.403+0000 7ff469314640 1 -- 172.21.15.66:0/3352661357 wait complete. 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 Processor -- start 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 -- start start 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff464102d40 0x7ff4641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 0x7ff464100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff464111f70 con 0x7ff46410c170 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff464111df0 con 0x7ff464102d40 2024-09-15T22:54:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff469314640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641120f0 con 0x7ff464103660 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54866/0 (socket says 172.21.15.66:54866) 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 -- 172.21.15.66:0/3339688785 learned_addr learned my addr 172.21.15.66:0/3339688785 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff462ffd640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff464102d40 0x7ff4641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4627fc640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 0x7ff464100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 -- 172.21.15.66:0/3339688785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 msgr2=0x7ff464100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 0x7ff464100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 -- 172.21.15.66:0/3339688785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff464102d40 msgr2=0x7ff4641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.404+0000 7ff4637fe640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff464102d40 0x7ff4641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff4637fe640 1 -- 172.21.15.66:0/3339688785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641a69c0 con 0x7ff46410c170 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff4637fe640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00cad0 tx=0x7ff45c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00ae20 con 0x7ff46410c170 2024-09-15T22:54:46.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641a6cb0 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff45c005020 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00f6f0 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.405+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641a71f0 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.406+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff464103120 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.407+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff45c0051d0 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.408+0000 7ff45bfff640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 0x7ff4500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.408+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7ff45c0d0510 con 0x7ff46410c170 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.408+0000 7ff462ffd640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 0x7ff4500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.408+0000 7ff462ffd640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 0x7ff4500a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0096c0 tx=0x7ff44c031490 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:46.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.411+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff45c014030 con 0x7ff46410c170 2024-09-15T22:54:46.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.624+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4641071e0 con 0x7ff46410c170 2024-09-15T22:54:46.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.625+0000 7ff45bfff640 1 -- 172.21.15.66:0/3339688785 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11981 (secure 0 0 0) 0x7ff45c09cb60 con 0x7ff46410c170 2024-09-15T22:54:46.626 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:54:46.626 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":47,"btime":"2024-09-15T22:54:39:983489+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:54:39.081606+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:54:46.626 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 47 2024-09-15T22:54:46.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 msgr2=0x7ff4500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 0x7ff4500a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0096c0 tx=0x7ff44c031490 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 msgr2=0x7ff464101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00cad0 tx=0x7ff45c00cf90 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 shutdown_connections 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff4500a33b0 0x7ff4500a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff46410c170 0x7ff464101420 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff464103660 0x7ff464100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 --2- 172.21.15.66:0/3339688785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff464102d40 0x7ff4641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 >> 172.21.15.66:0/3339688785 conn(0x7ff4640fc7a0 msgr2=0x7ff4640fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 shutdown_connections 2024-09-15T22:54:46.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:46.627+0000 7ff469314640 1 -- 172.21.15.66:0/3339688785 wait complete. 2024-09-15T22:54:47.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:47 smithi066 ceph-mon[31185]: pgmap v291: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-15T22:54:47.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:47 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3339688785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:47.349 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 142.35 --await-for 45.0' 2024-09-15T22:54:47.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 142.35 --await-for 45.0 2024-09-15T22:54:47.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:47 smithi087 ceph-mon[35290]: pgmap v291: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-15T22:54:47.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:47 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3339688785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:47 smithi184 ceph-mon[35203]: pgmap v291: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-15T22:54:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:47 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3339688785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:47.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 -- 172.21.15.66:0/1353659157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 msgr2=0x7f5da010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 --2- 172.21.15.66:0/1353659157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da010ea90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009ca0 tx=0x7f5d9802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 -- 172.21.15.66:0/1353659157 shutdown_connections 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 --2- 172.21.15.66:0/1353659157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da010ea90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 --2- 172.21.15.66:0/1353659157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0102790 0x7f5da01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 --2- 172.21.15.66:0/1353659157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0101de0 0x7f5da01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 -- 172.21.15.66:0/1353659157 >> 172.21.15.66:0/1353659157 conn(0x7f5da00fd8c0 msgr2=0x7f5da00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 -- 172.21.15.66:0/1353659157 shutdown_connections 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.122+0000 7f5da64a7640 1 -- 172.21.15.66:0/1353659157 wait complete. 2024-09-15T22:54:48.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 Processor -- start 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 -- start start 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 0x7f5da0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0102790 0x7f5da01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0111f90 con 0x7f5da0106f10 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0111e10 con 0x7f5da0102790 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da64a7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0112110 con 0x7f5da0101de0 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da4a44640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da4a44640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54874/0 (socket says 172.21.15.66:54874) 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.123+0000 7f5da4a44640 1 -- 172.21.15.66:0/382262439 learned_addr learned my addr 172.21.15.66:0/382262439 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0102790 0x7f5da01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 0x7f5da0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 -- 172.21.15.66:0/382262439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 msgr2=0x7f5da0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 0x7f5da0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 -- 172.21.15.66:0/382262439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0102790 msgr2=0x7f5da01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0102790 0x7f5da01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 -- 172.21.15.66:0/382262439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da019d420 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 0x7f5da0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da4a44640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5d98031a60 tx=0x7f5d98031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9d7fa640 1 -- 172.21.15.66:0/382262439 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98003c30 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da019d6b0 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9d7fa640 1 -- 172.21.15.66:0/382262439 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d98003dd0 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5d9d7fa640 1 -- 172.21.15.66:0/382262439 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d980047e0 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.124+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da01a4ff0 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.127+0000 7f5d9d7fa640 1 -- 172.21.15.66:0/382262439 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5d9802f790 con 0x7f5da0106f10 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.127+0000 7f5da8880740 1 Processor -- start 2024-09-15T22:54:48.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.127+0000 7f5da8880740 1 -- start start 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7149900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb7149e40 0x55ebb714c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ebb709f160 con 0x55ebb713a710 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7046720 con 0x55ebb7149e40 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da8880740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ebb709b120 con 0x55ebb713b030 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54888/0 (socket says 172.21.15.66:54888) 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/178543155 learned_addr learned my addr 172.21.15.66:0/178543155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9d7fa640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb7149e40 0x55ebb714c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/178543155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 msgr2=0x55ebb7149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/178543155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb7149e40 msgr2=0x55ebb714c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb7149e40 0x55ebb714c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/178543155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb6e10ba0 con 0x55ebb713a710 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9d7fa640 1 -- 172.21.15.66:0/382262439 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f5d980f14d0 con 0x7f5da0106f10 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5da4a44640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009f10 tx=0x7f5d94009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc1f4fec6744a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.128+0000 7f5d867fc640 1 -- 172.21.15.66:0/178543155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9401c070 con 0x55ebb713a710 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5d867fc640 1 -- 172.21.15.66:0/178543155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d94010040 con 0x55ebb713a710 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5d867fc640 1 -- 172.21.15.66:0/178543155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94014730 con 0x55ebb713a710 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da4a44640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 0x7f5d880a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d980c5bd0 tx=0x7f5d980f17d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 -- 172.21.15.66:0/178543155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 msgr2=0x55ebb713aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009f10 tx=0x7f5d94009420 comp rx=0 tx=0).stop 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 -- 172.21.15.66:0/178543155 shutdown_connections 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb7149e40 0x55ebb714c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 --2- 172.21.15.66:0/178543155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb713a710 0x55ebb713aaf0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.129+0000 7f5da8880740 1 -- 172.21.15.66:0/178543155 >> 172.21.15.66:0/178543155 conn(0x55ebb7136de0 msgr2=0x55ebb71371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.130+0000 7f5da8880740 1 -- 172.21.15.66:0/178543155 shutdown_connections 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.130+0000 7f5da8880740 1 -- 172.21.15.66:0/178543155 wait complete. 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.130+0000 7f5da8880740 1 -- start start 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.130+0000 7f5da8880740 1 Processor -- start 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.130+0000 7f5da8880740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7147840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ebb714ca10 con 0x55ebb7149e40 2024-09-15T22:54:48.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7027900 con 0x55ebb713a710 2024-09-15T22:54:48.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ebb714cb90 con 0x55ebb713b030 2024-09-15T22:54:48.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5da8880740 10 client.0 _ll_register_callbacks cb 0x55ebb7025780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:48.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35658/0 (socket says 172.21.15.66:35658) 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 -- 172.21.15.66:0/2687789051 learned_addr learned my addr 172.21.15.66:0/2687789051 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54890/0 (socket says 172.21.15.66:54890) 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 -- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 msgr2=0x55ebb7146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 -- 172.21.15.66:0/2687789051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 msgr2=0x55ebb7147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9ffff640 1 -- 172.21.15.66:0/2687789051 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb7067c50 con 0x55ebb713b030 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.131+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:48.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e750 tx=0x7f5d9000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278b0b4514f63cce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9001c060 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d94010040 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f5d90009c90 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5d90023050 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5da8880740 10 client.26779 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ebb71587a0 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d94010040 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.132+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f5d9000f420 con 0x55ebb713b030 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 10 client.26779 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 10 client.26779 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 20 client.26779 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb7159c00 0x55ebb715c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 4 client.26779 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebb70ac890 con 0x55ebb7159c00 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb7159c00 0x55ebb715c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb7159c00 0x55ebb715c020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa80e64a5f54e1a server_cookie=7f98d04094bf40eb in_seq=0 out_seq=0 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.133+0000 7f5d7f7fe640 10 client.26779 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/2687789051 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebb70ac890 con 0x55ebb7159c00 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5d7f7fe640 10 client.26779 handle_command_reply: tid=0 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 client.26779 shutdown 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 msgr2=0x55ebb7147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e750 tx=0x7f5d9000ec10 comp rx=0 tx=0).stop 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 shutdown_connections 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb7147300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb7159c00 0x55ebb715c020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 --2- 172.21.15.66:0/2687789051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 >> 172.21.15.66:0/2687789051 conn(0x55ebb7136de0 msgr2=0x55ebb713cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5d7f7fe640 0 client.26779 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 shutdown_connections 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 1 -- 172.21.15.66:0/2687789051 wait complete. 2024-09-15T22:54:48.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.134+0000 7f5da8880740 20 client.26779 trim_cache size 0 max 16384 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.151+0000 7f5da8880740 1 Processor -- start 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.151+0000 7f5da8880740 1 -- start start 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7145d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb71618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ad0a0 con 0x55ebb7149e40 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01aec10 con 0x55ebb713a710 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5da8880740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ad770 con 0x55ebb713b030 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54898/0 (socket says 172.21.15.66:54898) 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/2780267816 learned_addr learned my addr 172.21.15.66:0/2780267816 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/2780267816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 msgr2=0x55ebb71618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb71618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb71618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/2780267816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 msgr2=0x55ebb7145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/2780267816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb7141ad0 con 0x55ebb7149e40 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.152+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5d94006cd0 tx=0x7f5d94009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7706441c9cac0812 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5d85ffb640 1 -- 172.21.15.66:0/2780267816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9401c040 con 0x55ebb7149e40 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5d85ffb640 1 -- 172.21.15.66:0/2780267816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9401d040 con 0x55ebb7149e40 2024-09-15T22:54:48.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5d85ffb640 1 -- 172.21.15.66:0/2780267816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94014aa0 con 0x55ebb7149e40 2024-09-15T22:54:48.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5da8880740 1 -- 172.21.15.66:0/2780267816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 msgr2=0x55ebb7161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5da8880740 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5d94006cd0 tx=0x7f5d94009ce0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5da8880740 1 -- 172.21.15.66:0/2780267816 shutdown_connections 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.153+0000 7f5da8880740 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb7161df0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713b030 0x55ebb71618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 --2- 172.21.15.66:0/2780267816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713a710 0x55ebb7145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 -- 172.21.15.66:0/2780267816 >> 172.21.15.66:0/2780267816 conn(0x55ebb7136de0 msgr2=0x55ebb7135ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 -- 172.21.15.66:0/2780267816 shutdown_connections 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 -- 172.21.15.66:0/2780267816 wait complete. 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 -- start start 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.154+0000 7f5da8880740 1 Processor -- start 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713a710 0x55ebb714db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 0x55ebb714e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ae540 con 0x55ebb7149e40 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ade40 con 0x55ebb713b030 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ab0a0 con 0x55ebb713a710 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5da8880740 10 client.0 _ll_register_callbacks cb 0x7f5d9000c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54906/0 (socket says 172.21.15.66:54906) 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/3356692026 learned_addr learned my addr 172.21.15.66:0/3356692026 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713a710 0x55ebb714db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 0x55ebb714e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/3356692026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713a710 msgr2=0x55ebb714db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713a710 0x55ebb714db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 msgr2=0x55ebb714e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 0x55ebb714e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 -- 172.21.15.66:0/3356692026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb71c3880 con 0x55ebb7149e40 2024-09-15T22:54:48.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 0x55ebb714e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d9f7fe640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5d94001eb0 tx=0x7f5d94014680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b15cd3cfc8d17b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.155+0000 7f5d7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9401c030 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f5d94031050 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d9401d040 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5d94009aa0 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 10 client.17403 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ebb71c4af0 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9401d040 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f5d94017930 con 0x55ebb7149e40 2024-09-15T22:54:48.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 10 client.17403 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 10 client.17403 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:54:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 20 client.17403 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb71c4f80 0x55ebb71c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 4 client.17403 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.35, "await_for": 45.0}] 2024-09-15T22:54:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.156+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.35, "await_for": 45.0}) -- 0x55ebb70a6be0 con 0x55ebb71c4f80 2024-09-15T22:54:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.157+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb71c4f80 0x55ebb71c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.157+0000 7f5d7f7fe640 10 client.17403 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.157+0000 7f5d9ffff640 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb71c4f80 0x55ebb71c7370 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5a9cf9da85ae07 server_cookie=a520182d27a8ba93 in_seq=0 out_seq=0 2024-09-15T22:54:48.220 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:48.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 -- 172.21.15.66:0/1887510579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 msgr2=0x7f3b3010dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 --2- 172.21.15.66:0/1887510579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3010dfb0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009900 tx=0x7f3b2402a410 comp rx=0 tx=0).stop 2024-09-15T22:54:48.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 -- 172.21.15.66:0/1887510579 shutdown_connections 2024-09-15T22:54:48.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 --2- 172.21.15.66:0/1887510579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3010e4f0 0x7f3b30110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 --2- 172.21.15.66:0/1887510579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3010dfb0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 --2- 172.21.15.66:0/1887510579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b301009d0 0x7f3b30100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 -- 172.21.15.66:0/1887510579 >> 172.21.15.66:0/1887510579 conn(0x7f3b300fc7d0 msgr2=0x7f3b300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 -- 172.21.15.66:0/1887510579 shutdown_connections 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.751+0000 7f3b36285640 1 -- 172.21.15.66:0/1887510579 wait complete. 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 Processor -- start 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 -- start start 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b301009d0 0x7f3b3019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b3010e4f0 0x7f3b3019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b30114240 con 0x7f3b30101380 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301140c0 con 0x7f3b3010e4f0 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.752+0000 7f3b36285640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301143c0 con 0x7f3b301009d0 2024-09-15T22:54:48.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54924/0 (socket says 172.21.15.66:54924) 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/3464651788 learned_addr learned my addr 172.21.15.66:0/3464651788 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b34822640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b3010e4f0 0x7f3b3019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b301009d0 0x7f3b3019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/3464651788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b301009d0 msgr2=0x7f3b3019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b301009d0 0x7f3b3019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/3464651788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b3010e4f0 msgr2=0x7f3b3019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b3010e4f0 0x7f3b3019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/3464651788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3019f6d0 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3b24006010 tx=0x7f3b24004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2d7fa640 1 -- 172.21.15.66:0/3464651788 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2403f030 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3019f960 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2d7fa640 1 -- 172.21.15.66:0/3464651788 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b24004440 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b2d7fa640 1 -- 172.21.15.66:0/3464651788 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24035070 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.753+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b301a72a0 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b2d7fa640 1 -- 172.21.15.66:0/3464651788 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3b24042030 con 0x7f3b30101380 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 Processor -- start 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 -- start start 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e512b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 0x55e0e512da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e0e50862e0 con 0x55e0e5120dc0 2024-09-15T22:54:48.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e0e502dce0 con 0x55e0e512b680 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b3865e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e0e50822a0 con 0x55e0e51204a0 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e512b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b34822640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 0x55e0e512da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b34822640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35680/0 (socket says 172.21.15.66:35680) 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b34822640 1 -- 172.21.15.66:0/2904477462 learned_addr learned my addr 172.21.15.66:0/2904477462 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.756+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e512b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54938/0 (socket says 172.21.15.66:54938) 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b2d7fa640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 0x7f3b180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 -- 172.21.15.66:0/2904477462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 msgr2=0x55e0e512da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 0x55e0e512da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 -- 172.21.15.66:0/2904477462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 msgr2=0x55e0e512b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e512b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 -- 172.21.15.66:0/2904477462 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e5012440 con 0x55e0e51204a0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 0x55e0e512da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b2d7fa640 1 -- 172.21.15.66:0/3464651788 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f3b240f04b0 con 0x7f3b30101380 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 0x7f3b180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b34822640 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009f30 tx=0x7f3b280118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c8a66261264523 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b167fc640 1 -- 172.21.15.66:0/2904477462 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28004250 con 0x55e0e51204a0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b167fc640 1 -- 172.21.15.66:0/2904477462 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2800fe80 con 0x55e0e51204a0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.757+0000 7f3b167fc640 1 -- 172.21.15.66:0/2904477462 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2801bbc0 con 0x55e0e51204a0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- 172.21.15.66:0/2904477462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 msgr2=0x55e0e5120880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009f30 tx=0x7f3b280118d0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b34822640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 0x7f3b180a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b28020000 tx=0x7f3b28021000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- 172.21.15.66:0/2904477462 shutdown_connections 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e512b680 0x55e0e512da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e512b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 --2- 172.21.15.66:0/2904477462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e51204a0 0x55e0e5120880 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- 172.21.15.66:0/2904477462 >> 172.21.15.66:0/2904477462 conn(0x55e0e511ca30 msgr2=0x55e0e511ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- 172.21.15.66:0/2904477462 shutdown_connections 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- 172.21.15.66:0/2904477462 wait complete. 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.758+0000 7f3b3865e740 1 -- start start 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 Processor -- start 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 0x55e0e5128240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 0x55e0e5128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e0e512e250 con 0x55e0e512b680 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e0e5041050 con 0x55e0e51204a0 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e0e512e3d0 con 0x55e0e5120dc0 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b3865e740 10 client.0 _ll_register_callbacks cb 0x55e0e5081160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:48.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b34822640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 0x55e0e5128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 0x55e0e5128240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40396/0 (socket says 172.21.15.66:40396) 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 -- 172.21.15.66:0/771043872 learned_addr learned my addr 172.21.15.66:0/771043872 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 -- 172.21.15.66:0/771043872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 msgr2=0x55e0e5128240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 0x55e0e5128240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 -- 172.21.15.66:0/771043872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 msgr2=0x55e0e5128780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 0x55e0e5128780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2ffff640 1 -- 172.21.15.66:0/771043872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e4df73c0 con 0x55e0e51204a0 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 0x55e0e5128240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.759+0000 7f3b34822640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 0x55e0e5128780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b200126e0 tx=0x7f3b20012ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4710bbfe1c613c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000f670 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f3b2000f810 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0e5093850 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3b2000fa10 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b3865e740 10 client.26822 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e0e5139c30 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.760+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e0e5093850 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f3b2001c420 con 0x55e0e51204a0 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 10 client.26822 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 10 client.26822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 20 client.26822 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e513b0f0 0x55e0e513d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 4 client.26822 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:48.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0e508dd60 con 0x55e0e513b0f0 2024-09-15T22:54:48.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e513b0f0 0x55e0e513d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e513b0f0 0x55e0e513d590 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85fc51be58c62fe6 server_cookie=fdf949107a7666eb in_seq=0 out_seq=0 2024-09-15T22:54:48.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.761+0000 7f3b0f7fe640 10 client.26822 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/771043872 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0e508dd60 con 0x55e0e513b0f0 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b0f7fe640 10 client.26822 handle_command_reply: tid=0 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 client.26822 shutdown 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 msgr2=0x55e0e512af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b200126e0 tx=0x7f3b20012ae0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 shutdown_connections 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e512b680 0x55e0e5128780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e5120dc0 0x55e0e5128240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e513b0f0 0x55e0e513d590 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 --2- 172.21.15.66:0/771043872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e512af90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 >> 172.21.15.66:0/771043872 conn(0x55e0e511ca30 msgr2=0x55e0e5122710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b0f7fe640 0 client.26822 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 shutdown_connections 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 1 -- 172.21.15.66:0/771043872 wait complete. 2024-09-15T22:54:48.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.762+0000 7f3b3865e740 20 client.26822 trim_cache size 0 max 16384 2024-09-15T22:54:48.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.779+0000 7f3b3865e740 1 Processor -- start 2024-09-15T22:54:48.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.779+0000 7f3b3865e740 1 -- start start 2024-09-15T22:54:48.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e51374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e5142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301b1490 con 0x55e0e5120dc0 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301b3000 con 0x55e0e51204a0 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b3865e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301b1b60 con 0x55e0e512b680 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e51374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54962/0 (socket says 172.21.15.66:54962) 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/1756330923 learned_addr learned my addr 172.21.15.66:0/1756330923 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b34822640 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e5142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/1756330923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 msgr2=0x55e0e5142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e5142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/1756330923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 msgr2=0x55e0e51374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e51374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/1756330923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e51271f0 con 0x55e0e5120dc0 2024-09-15T22:54:48.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e51374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:48.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.780+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3b240bc3a0 tx=0x7f3b240f2a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd45b245006239fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b15ffb640 1 -- 172.21.15.66:0/1756330923 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24049040 con 0x55e0e5120dc0 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b15ffb640 1 -- 172.21.15.66:0/1756330923 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b240bc410 con 0x55e0e5120dc0 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b15ffb640 1 -- 172.21.15.66:0/1756330923 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003cd0 con 0x55e0e5120dc0 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 -- 172.21.15.66:0/1756330923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 msgr2=0x55e0e5126b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3b240bc3a0 tx=0x7f3b240f2a30 comp rx=0 tx=0).stop 2024-09-15T22:54:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 -- 172.21.15.66:0/1756330923 shutdown_connections 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e5142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5126b10 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 --2- 172.21.15.66:0/1756330923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e51374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 -- 172.21.15.66:0/1756330923 >> 172.21.15.66:0/1756330923 conn(0x55e0e511ca30 msgr2=0x55e0e5123850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 -- 172.21.15.66:0/1756330923 shutdown_connections 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.781+0000 7f3b3865e740 1 -- 172.21.15.66:0/1756330923 wait complete. 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 -- start start 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 Processor -- start 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e5133990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e512ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301b2930 con 0x55e0e5120dc0 2024-09-15T22:54:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301b2230 con 0x55e0e51204a0 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301af490 con 0x55e0e512b680 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b3865e740 10 client.0 _ll_register_callbacks cb 0x7f3b20009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54976/0 (socket says 172.21.15.66:54976) 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/855690356 learned_addr learned my addr 172.21.15.66:0/855690356 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e5133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.782+0000 7f3b34822640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e512ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/855690356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 msgr2=0x55e0e512ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e512ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 msgr2=0x55e0e5133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e5133990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 -- 172.21.15.66:0/855690356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e512f740 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e5133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b2f7fe640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000c00 tx=0x7f3b240ba8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af48aef0dc92572 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24049070 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f3b240eda50 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b240bc410 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3b240d5050 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b3865e740 10 client.17421 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e0e51a5ad0 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.783+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b240bc410 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f3b240b8a80 con 0x55e0e5120dc0 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 10 client.17421 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:48.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 20 client.17421 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e51a6130 0x55e0e51a8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 4 client.17421 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0e500a210 con 0x55e0e51a6130 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e51a6130 0x55e0e51a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b2ffff640 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e51a6130 0x55e0e51a8520 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=901c48bb2167166b server_cookie=c40b23cdde8ddb7b in_seq=0 out_seq=0 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b0f7fe640 10 client.17421 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b0f7fe640 1 -- 172.21.15.66:0/855690356 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e0e500a210 con 0x55e0e51a6130 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b0f7fe640 10 client.17421 handle_command_reply: tid=0 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.784+0000 7f3b3865e740 1 client.17421 shutdown 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 msgr2=0x55e0e5133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000c00 tx=0x7f3b240ba8f0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 shutdown_connections 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e0e512b680 0x55e0e512ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e0e5120dc0 0x55e0e5133ed0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e0e51a6130 0x55e0e51a8520 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 --2- 172.21.15.66:0/855690356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0e51204a0 0x55e0e5133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b0f7fe640 0 client.17421 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 >> 172.21.15.66:0/855690356 conn(0x55e0e511ca30 msgr2=0x55e0e5121ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 shutdown_connections 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 1 -- 172.21.15.66:0/855690356 wait complete. 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b3865e740 20 client.17421 trim_cache size 0 max 16384 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:48.794 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:54:48.795 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:54:48.795 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:48.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 msgr2=0x7f3b180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 0x7f3b180a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b28020000 tx=0x7f3b28021000 comp rx=0 tx=0).stop 2024-09-15T22:54:48.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 msgr2=0x7f3b3019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.785+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3b24006010 tx=0x7f3b24004040 comp rx=0 tx=0).stop 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 shutdown_connections 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3b180a33b0 0x7f3b180a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b3010e4f0 0x7f3b3019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b30101380 0x7f3b3019ac60 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 --2- 172.21.15.66:0/3464651788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b301009d0 0x7f3b3019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 >> 172.21.15.66:0/3464651788 conn(0x7f3b300fc7d0 msgr2=0x7f3b300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 shutdown_connections 2024-09-15T22:54:48.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:48.786+0000 7f3b36285640 1 -- 172.21.15.66:0/3464651788 wait complete. 2024-09-15T22:54:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:49 smithi087 ceph-mon[35290]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-15T22:54:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:49 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:49.385 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:49 smithi066 ceph-mon[31185]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-15T22:54:49.385 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:49 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:49 smithi184 ceph-mon[35203]: pgmap v292: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-15T22:54:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:49 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:54:49.439 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:54:49.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:54:49.696 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- 172.21.15.66:0/1146734239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac106a60 msgr2=0x7efdac106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 --2- 172.21.15.66:0/1146734239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac106a60 0x7efdac106e40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efda8009930 tx=0x7efda802a420 comp rx=0 tx=0).stop 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- 172.21.15.66:0/1146734239 shutdown_connections 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 --2- 172.21.15.66:0/1146734239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 0x7efdac10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 --2- 172.21.15.66:0/1146734239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac100a60 0x7efdac100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 --2- 172.21.15.66:0/1146734239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac106a60 0x7efdac106e40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- 172.21.15.66:0/1146734239 >> 172.21.15.66:0/1146734239 conn(0x7efdac0fc780 msgr2=0x7efdac0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:50.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- 172.21.15.66:0/1146734239 shutdown_connections 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- 172.21.15.66:0/1146734239 wait complete. 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 Processor -- start 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.168+0000 7efdb4020640 1 -- start start 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 0x7efdac10e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 0x7efdac10ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efdac111f80 con 0x7efdac100a60 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efdac111e00 con 0x7efdac106a60 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb4020640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efdac112100 con 0x7efdac101400 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54982/0 (socket says 172.21.15.66:54982) 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 -- 172.21.15.66:0/2858780363 learned_addr learned my addr 172.21.15.66:0/2858780363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb25bd640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 0x7efdac10ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:50.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb15bb640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 0x7efdac10e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 -- 172.21.15.66:0/2858780363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 msgr2=0x7efdac10e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 0x7efdac10e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 -- 172.21.15.66:0/2858780363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 msgr2=0x7efdac10ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 0x7efdac10ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 -- 172.21.15.66:0/2858780363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdac1a6940 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb25bd640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 0x7efdac10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efdb1dbc640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7efda8009230 tx=0x7efda8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.169+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda803f030 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.170+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efda8004440 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.170+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdac1a6bd0 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.170+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8035070 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.170+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdac1a70b0 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.171+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdac100ec0 con 0x7efdac100a60 2024-09-15T22:54:50.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.172+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efda8042030 con 0x7efdac100a60 2024-09-15T22:54:50.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.172+0000 7efda2ffd640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 0x7efd980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:50.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.173+0000 7efdb15bb640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 0x7efd980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:50.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.173+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7efda80f0440 con 0x7efdac100a60 2024-09-15T22:54:50.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.173+0000 7efdb15bb640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 0x7efd980a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdac10fe50 tx=0x7efd9c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:50.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.177+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efda80bc3a0 con 0x7efdac100a60 2024-09-15T22:54:50.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.388+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdac02d7c0 con 0x7efdac100a60 2024-09-15T22:54:50.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.389+0000 7efda2ffd640 1 -- 172.21.15.66:0/2858780363 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11975 (secure 0 0 0) 0x7efda80c06a0 con 0x7efdac100a60 2024-09-15T22:54:50.390 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:54:50.390 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":48,"btime":"2024-09-15T22:54:48:075825+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:54:47.617086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:54:50.390 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 48 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 msgr2=0x7efd980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 0x7efd980a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdac10fe50 tx=0x7efd9c005f90 comp rx=0 tx=0).stop 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 msgr2=0x7efdac10e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7efda8009230 tx=0x7efda8004040 comp rx=0 tx=0).stop 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 shutdown_connections 2024-09-15T22:54:50.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efd980a33b0 0x7efd980a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdac106a60 0x7efdac10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdac101400 0x7efdac10e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 --2- 172.21.15.66:0/2858780363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdac100a60 0x7efdac10e3c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 >> 172.21.15.66:0/2858780363 conn(0x7efdac0fc780 msgr2=0x7efdac0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 shutdown_connections 2024-09-15T22:54:50.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:50.391+0000 7efdb4020640 1 -- 172.21.15.66:0/2858780363 wait complete. 2024-09-15T22:54:51.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:54:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:51 smithi087 ceph-mon[35290]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-15T22:54:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2858780363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:51 smithi184 ceph-mon[35203]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-15T22:54:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2858780363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:51.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:51 smithi066 ceph-mon[31185]: pgmap v293: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-15T22:54:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2858780363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 -- 172.21.15.66:0/2362731157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c106a60 msgr2=0x7f828c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 --2- 172.21.15.66:0/2362731157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c106a60 0x7f828c106e40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f8288009cd0 tx=0x7f828802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 -- 172.21.15.66:0/2362731157 shutdown_connections 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 --2- 172.21.15.66:0/2362731157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c101400 0x7f828c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 --2- 172.21.15.66:0/2362731157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c100a60 0x7f828c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 --2- 172.21.15.66:0/2362731157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c106a60 0x7f828c106e40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 -- 172.21.15.66:0/2362731157 >> 172.21.15.66:0/2362731157 conn(0x7f828c0fc780 msgr2=0x7f828c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 -- 172.21.15.66:0/2362731157 shutdown_connections 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.866+0000 7f8294645640 1 -- 172.21.15.66:0/2362731157 wait complete. 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 Processor -- start 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 -- start start 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c101400 0x7f828c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c106a60 0x7f828c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f828c110e60 con 0x7f828c100a60 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f828c110ce0 con 0x7f828c106a60 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8294645640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f828c110fe0 con 0x7f828c101400 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55000/0 (socket says 172.21.15.66:55000) 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 -- 172.21.15.66:0/863521771 learned_addr learned my addr 172.21.15.66:0/863521771 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8291be0640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c101400 0x7f828c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f8292be2640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c106a60 0x7f828c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 -- 172.21.15.66:0/863521771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c101400 msgr2=0x7f828c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c101400 0x7f828c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 -- 172.21.15.66:0/863521771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c106a60 msgr2=0x7f828c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c106a60 0x7f828c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.867+0000 7f82923e1640 1 -- 172.21.15.66:0/863521771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c19d450 con 0x7f828c100a60 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f82923e1640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f828802ae00 tx=0x7f8288003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f827f7fe640 1 -- 172.21.15.66:0/863521771 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288004040 con 0x7f828c100a60 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f827f7fe640 1 -- 172.21.15.66:0/863521771 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82880046c0 con 0x7f828c100a60 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c19d6e0 con 0x7f828c100a60 2024-09-15T22:54:51.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f827f7fe640 1 -- 172.21.15.66:0/863521771 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288046480 con 0x7f828c100a60 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.868+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c1a5020 con 0x7f828c100a60 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.870+0000 7f827f7fe640 1 -- 172.21.15.66:0/863521771 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f82880305a0 con 0x7f828c100a60 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.870+0000 7f8296a1e740 1 Processor -- start 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 -- start start 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8ec1370 0x55f1b8ec3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8e1c2f0 con 0x55f1b8eb7b40 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8dc3cf0 con 0x55f1b8ec1370 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8296a1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8e182b0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8292be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8292be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55012/0 (socket says 172.21.15.66:55012) 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8292be2640 1 -- 172.21.15.66:0/3956262234 learned_addr learned my addr 172.21.15.66:0/3956262234 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f8291be0640 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8ec1370 0x55f1b8ec3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f827f7fe640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 0x7f82780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 -- 172.21.15.66:0/3956262234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8ec1370 msgr2=0x55f1b8ec3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8ec1370 0x55f1b8ec3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 -- 172.21.15.66:0/3956262234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 msgr2=0x55f1b8eb6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.871+0000 7f82923e1640 1 -- 172.21.15.66:0/3956262234 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b8da83a0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f8292be2640 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f8292be2640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 0x7f82780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f827f7fe640 1 -- 172.21.15.66:0/863521771 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f828802e030 con 0x7f828c100a60 2024-09-15T22:54:51.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f82923e1640 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb6a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f82880eebf0 tx=0x7f82880880c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f662a099b4f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f827cff9640 1 -- 172.21.15.66:0/3956262234 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880bd550 con 0x55f1b8eb65d0 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f8292be2640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 0x7f82780a58f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f828400df40 tx=0x7f82840046c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f827cff9640 1 -- 172.21.15.66:0/3956262234 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288030890 con 0x55f1b8eb65d0 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.872+0000 7f827cff9640 1 -- 172.21.15.66:0/3956262234 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288088860 con 0x55f1b8eb65d0 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- 172.21.15.66:0/3956262234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 msgr2=0x55f1b8eb6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb6a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f82880eebf0 tx=0x7f82880880c0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- 172.21.15.66:0/3956262234 shutdown_connections 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8ec1370 0x55f1b8ec3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb6a10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 --2- 172.21.15.66:0/3956262234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb7b40 0x55f1b8eb6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- 172.21.15.66:0/3956262234 >> 172.21.15.66:0/3956262234 conn(0x55f1b8e7f310 msgr2=0x55f1b8eb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- 172.21.15.66:0/3956262234 shutdown_connections 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- 172.21.15.66:0/3956262234 wait complete. 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 -- start start 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.873+0000 7f8296a1e740 1 Processor -- start 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8ec3e30 con 0x55f1b8eb65d0 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8dd7060 con 0x55f1b8eb7b40 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f1b8ec3fb0 con 0x55f1b8ec1370 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 10 client.0 _ll_register_callbacks cb 0x55f1b8b2a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55024/0 (socket says 172.21.15.66:55024) 2024-09-15T22:54:51.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 -- 172.21.15.66:0/2119975785 learned_addr learned my addr 172.21.15.66:0/2119975785 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8292be2640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8291be0640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 -- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 msgr2=0x55f1b8ebe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebe610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 -- 172.21.15.66:0/2119975785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 msgr2=0x55f1b8ebe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 -- 172.21.15.66:0/2119975785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b8b8d3c0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f82923e1640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f82880ef0e0 tx=0x7f82880f1930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31d43e3c03610d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880bd0e0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f82880f7170 con 0x55f1b8eb65d0 2024-09-15T22:54:51.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.874+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8288030890 con 0x55f1b8eb65d0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f82880bd2c0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 10 client.17439 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f1b8ec3e30 con 0x55f1b8eb65d0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288030890 con 0x55f1b8eb65d0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f82880b9040 con 0x55f1b8eb65d0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 10 client.17439 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 10 client.17439 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 20 client.17439 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8ed0b40 0x55f1b8ed2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 4 client.17439 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1b8e29860 con 0x55f1b8ed0b40 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.875+0000 7f8291be0640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8ed0b40 0x55f1b8ed2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.876+0000 7f8275ffb640 10 client.17439 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.876+0000 7f8291be0640 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8ed0b40 0x55f1b8ed2f60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6845e9adeacb4980 server_cookie=4acc784840a8f022 in_seq=0 out_seq=0 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.876+0000 7f8275ffb640 1 -- 172.21.15.66:0/2119975785 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1b8e29860 con 0x55f1b8ed0b40 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.876+0000 7f8275ffb640 10 client.17439 handle_command_reply: tid=0 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.876+0000 7f8296a1e740 1 client.17439 shutdown 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 msgr2=0x55f1b8ec0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f82880ef0e0 tx=0x7f82880f1930 comp rx=0 tx=0).stop 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 shutdown_connections 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8ed0b40 0x55f1b8ed2f60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 --2- 172.21.15.66:0/2119975785 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ec0d70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8275ffb640 0 client.17439 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 >> 172.21.15.66:0/2119975785 conn(0x55f1b8e7f310 msgr2=0x55f1b8eb8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 shutdown_connections 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 1 -- 172.21.15.66:0/2119975785 wait complete. 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.877+0000 7f8296a1e740 20 client.17439 trim_cache size 0 max 16384 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 Processor -- start 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 -- start start 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ecd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8eb8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1af1e0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1b0d50 con 0x55f1b8eb7b40 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f8296a1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1af8b0 con 0x55f1b8ec1370 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f82923e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55032/0 (socket says 172.21.15.66:55032) 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.890+0000 7f82923e1640 1 -- 172.21.15.66:0/979414981 learned_addr learned my addr 172.21.15.66:0/979414981 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8292be2640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8eb8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8291be0640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ecd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 -- 172.21.15.66:0/979414981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 msgr2=0x55f1b8eb8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8eb8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 -- 172.21.15.66:0/979414981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 msgr2=0x55f1b8ecd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ecd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 -- 172.21.15.66:0/979414981 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b8eb24f0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8291be0640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ecd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f82923e1640 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f80 tx=0x7f82880b9420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9589b9a6b3fd578 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8277fff640 1 -- 172.21.15.66:0/979414981 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880bd0e0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8277fff640 1 -- 172.21.15.66:0/979414981 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288036040 con 0x55f1b8eb65d0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.891+0000 7f8277fff640 1 -- 172.21.15.66:0/979414981 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82880bd550 con 0x55f1b8eb65d0 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- 172.21.15.66:0/979414981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 msgr2=0x55f1b8eb2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f80 tx=0x7f82880b9420 comp rx=0 tx=0).stop 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- 172.21.15.66:0/979414981 shutdown_connections 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8ec1370 0x55f1b8eb8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ecd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- 172.21.15.66:0/979414981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8eb65d0 0x55f1b8eb2d70 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- 172.21.15.66:0/979414981 >> 172.21.15.66:0/979414981 conn(0x55f1b8e7f310 msgr2=0x55f1b8eb8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- 172.21.15.66:0/979414981 shutdown_connections 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- 172.21.15.66:0/979414981 wait complete. 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- start start 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 Processor -- start 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ebb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1b0680 con 0x55f1b8ec1370 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1aff80 con 0x55f1b8eb7b40 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1ad1e0 con 0x55f1b8eb65d0 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8296a1e740 10 client.0 _ll_register_callbacks cb 0x7f828400d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:51.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8292be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8292be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55038/0 (socket says 172.21.15.66:55038) 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f8292be2640 1 -- 172.21.15.66:0/4107185039 learned_addr learned my addr 172.21.15.66:0/4107185039 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.892+0000 7f82923e1640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ebb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8291be0640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 -- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 msgr2=0x55f1b8ebb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ebb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 -- 172.21.15.66:0/4107185039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 msgr2=0x55f1b8ebb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 -- 172.21.15.66:0/4107185039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b8f3a7e0 con 0x55f1b8ec1370 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8291be0640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8292be2640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f828401e6b0 tx=0x7f8284004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccef8203ccdc0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:51.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840035f0 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f8284003790 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8288036040 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8284035050 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8296a1e740 10 client.17445 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f1b8f3ba30 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.893+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8288036040 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f82840273f0 con 0x55f1b8ec1370 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 10 client.17445 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 10 client.17445 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 20 client.17445 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8f3c230 0x55f1b8f3e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 4 client.17445 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1b8e23d70 con 0x55f1b8f3c230 2024-09-15T22:54:51.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f82923e1640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8f3c230 0x55f1b8f3e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8275ffb640 10 client.17445 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f82923e1640 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8f3c230 0x55f1b8f3e650 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=74fea94da2415927 server_cookie=7bd5a8fa213ccf2e in_seq=0 out_seq=0 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8275ffb640 1 -- 172.21.15.66:0/4107185039 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1b8e23d70 con 0x55f1b8f3c230 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8275ffb640 10 client.17445 handle_command_reply: tid=0 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 1 client.17445 shutdown 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 msgr2=0x55f1b8ebbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.894+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f828401e6b0 tx=0x7f8284004730 comp rx=0 tx=0).stop 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 shutdown_connections 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55f1b8f3c230 0x55f1b8f3e650 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f1b8ec1370 0x55f1b8ebbb60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f1b8eb7b40 0x55f1b8ebb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 --2- 172.21.15.66:0/4107185039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f1b8eb65d0 0x55f1b8ebb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 >> 172.21.15.66:0/4107185039 conn(0x55f1b8e7f310 msgr2=0x55f1b8eb8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8275ffb640 0 client.17445 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 shutdown_connections 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 1 -- 172.21.15.66:0/4107185039 wait complete. 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8296a1e740 20 client.17445 trim_cache size 0 max 16384 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 msgr2=0x7f82780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 0x7f82780a58f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f828400df40 tx=0x7f82840046c0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 msgr2=0x7f828c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f828802ae00 tx=0x7f8288003970 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 shutdown_connections 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f82780a3430 0x7f82780a58f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f828c106a60 0x7f828c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f828c101400 0x7f828c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 --2- 172.21.15.66:0/863521771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c100a60 0x7f828c1984a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 >> 172.21.15.66:0/863521771 conn(0x7f828c0fc780 msgr2=0x7f828c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 shutdown_connections 2024-09-15T22:54:51.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:51.895+0000 7f8294645640 1 -- 172.21.15.66:0/863521771 wait complete. 2024-09-15T22:54:52.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:54:52.977 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:53 smithi087 ceph-mon[35290]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:54:53.384 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:53 smithi066 ceph-mon[31185]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:54:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:53 smithi184 ceph-mon[35203]: pgmap v294: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 -- 172.21.15.66:0/3343622837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014102dd0 msgr2=0x7f40141031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 --2- 172.21.15.66:0/3343622837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014102dd0 0x7f40141031b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4004009cd0 tx=0x7f400402a8d0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 -- 172.21.15.66:0/3343622837 shutdown_connections 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 --2- 172.21.15.66:0/3343622837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014108300 0x7f401410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 --2- 172.21.15.66:0/3343622837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014103780 0x7f4014107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 --2- 172.21.15.66:0/3343622837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014102dd0 0x7f40141031b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 -- 172.21.15.66:0/3343622837 >> 172.21.15.66:0/3343622837 conn(0x7f40140fc7d0 msgr2=0x7f40140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 -- 172.21.15.66:0/3343622837 shutdown_connections 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 -- 172.21.15.66:0/3343622837 wait complete. 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.467+0000 7f401937b640 1 Processor -- start 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 -- start start 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014102dd0 0x7f4014198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 0x7f4014198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112090 con 0x7f4014108300 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111f10 con 0x7f4014103780 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f401937b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112210 con 0x7f4014102dd0 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 0x7f4014198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47826/0 (socket says 172.21.15.66:47826) 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 -- 172.21.15.66:0/59345234 learned_addr learned my addr 172.21.15.66:0/59345234 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:53.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 0x7f4014198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59826/0 (socket says 172.21.15.66:59826) 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f4012ffd640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014102dd0 0x7f4014198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 -- 172.21.15.66:0/59345234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014102dd0 msgr2=0x7f4014198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014102dd0 0x7f4014198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 -- 172.21.15.66:0/59345234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 msgr2=0x7f4014198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 0x7f4014198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 -- 172.21.15.66:0/59345234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401419d600 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.468+0000 7f40137fe640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f400c00e970 tx=0x7f400c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.469+0000 7f3ffbfff640 1 -- 172.21.15.66:0/59345234 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00ccc0 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.469+0000 7f3ffbfff640 1 -- 172.21.15.66:0/59345234 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c00ce60 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.469+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401419d8f0 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.469+0000 7f3ffbfff640 1 -- 172.21.15.66:0/59345234 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c010490 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.469+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a51d0 con 0x7f4014108300 2024-09-15T22:54:53.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.471+0000 7f3ffbfff640 1 -- 172.21.15.66:0/59345234 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f400c005020 con 0x7f4014108300 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.471+0000 7f401b754740 1 Processor -- start 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 -- start start 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5849812f0 con 0x55a584a1b5d0 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a584928cf0 con 0x55a584a1cb40 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f401b754740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a58497d2b0 con 0x55a584a26370 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59838/0 (socket says 172.21.15.66:59838) 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40127fc640 1 -- 172.21.15.66:0/3142205555 learned_addr learned my addr 172.21.15.66:0/3142205555 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f3ffbfff640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 0x7f3ffc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40127fc640 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40137fe640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 0x7f3ffc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 -- 172.21.15.66:0/3142205555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 msgr2=0x55a584a28760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a28760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 -- 172.21.15.66:0/3142205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 msgr2=0x55a584a1b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f4012ffd640 1 -- 172.21.15.66:0/3142205555 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58490d3a0 con 0x55a584a1b5d0 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f40127fc640 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.472+0000 7f3ffbfff640 1 -- 172.21.15.66:0/59345234 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f400c0d0520 con 0x7f4014108300 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a1ba10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4004006010 tx=0x7f4004005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d271d4671770b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f40137fe640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 0x7f3ffc0a58f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f400c09c070 tx=0x7f400c004a50 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f3ff97fa640 1 -- 172.21.15.66:0/3142205555 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004031cb0 con 0x55a584a1b5d0 2024-09-15T22:54:53.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f3ff97fa640 1 -- 172.21.15.66:0/3142205555 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4004036030 con 0x55a584a1b5d0 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f3ff97fa640 1 -- 172.21.15.66:0/3142205555 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40040042a0 con 0x55a584a1b5d0 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 -- 172.21.15.66:0/3142205555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 msgr2=0x55a584a1ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a1ba10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4004006010 tx=0x7f4004005f70 comp rx=0 tx=0).stop 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 -- 172.21.15.66:0/3142205555 shutdown_connections 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a28760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a1ba10 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.473+0000 7f401b754740 1 --2- 172.21.15.66:0/3142205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a1b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- 172.21.15.66:0/3142205555 >> 172.21.15.66:0/3142205555 conn(0x55a5849e4310 msgr2=0x55a584a17c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- 172.21.15.66:0/3142205555 shutdown_connections 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- 172.21.15.66:0/3142205555 wait complete. 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- start start 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 Processor -- start 2024-09-15T22:54:53.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 0x55a584a2a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a2ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a584a29010 con 0x55a584a1cb40 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a58493c060 con 0x55a584a1b5d0 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a584a29190 con 0x55a584a26370 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f401b754740 10 client.0 _ll_register_callbacks cb 0x55a58468f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f40127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 0x55a584a2a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47844/0 (socket says 172.21.15.66:47844) 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.474+0000 7f4012ffd640 1 -- 172.21.15.66:0/3838526098 learned_addr learned my addr 172.21.15.66:0/3838526098 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f40127fc640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a2ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 -- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 msgr2=0x55a584a2ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a2ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 -- 172.21.15.66:0/3838526098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 msgr2=0x55a584a2a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 0x55a584a2a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 -- 172.21.15.66:0/3838526098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5846f23c0 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f40127fc640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 0x55a584a2a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f400402b060 tx=0x7f4004003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949df6c9caf51861 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004052020 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f4004031cb0 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4004036030 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f400405d050 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f401b754740 10 client.17457 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a584a29010 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4004036030 con 0x55a584a1cb40 2024-09-15T22:54:53.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.475+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f400404d030 con 0x55a584a1cb40 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 10 client.17457 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 10 client.17457 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 20 client.17457 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584a39fe0 0x55a584a3c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 4 client.17457 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a58498e860 con 0x55a584a39fe0 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f40127fc640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584a39fe0 0x55a584a3c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f40127fc640 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584a39fe0 0x55a584a3c3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b642a06dc75d71f1 server_cookie=75f755812a41bd2f in_seq=0 out_seq=0 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.476+0000 7f3ff6ff5640 10 client.17457 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3838526098 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a58498e860 con 0x55a584a39fe0 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f3ff6ff5640 10 client.17457 handle_command_reply: tid=0 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 client.17457 shutdown 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 msgr2=0x55a584a2abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f400402b060 tx=0x7f4004003c20 comp rx=0 tx=0).stop 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 shutdown_connections 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584a39fe0 0x55a584a3c3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a26370 0x55a584a2ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1cb40 0x55a584a2abf0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 --2- 172.21.15.66:0/3838526098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1b5d0 0x55a584a2a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 >> 172.21.15.66:0/3838526098 conn(0x55a5849e4310 msgr2=0x55a584a1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f3ff6ff5640 0 client.17457 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 shutdown_connections 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 1 -- 172.21.15.66:0/3838526098 wait complete. 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.477+0000 7f401b754740 20 client.17457 trim_cache size 0 max 16384 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 Processor -- start 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 -- start start 2024-09-15T22:54:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1b5d0 0x55a584a2ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a17e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40141acfc0 con 0x55a584a26370 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40141aeb30 con 0x55a584a1cb40 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f401b754740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ad690 con 0x55a584a1b5d0 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f40127fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f40127fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47860/0 (socket says 172.21.15.66:47860) 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.490+0000 7f40127fc640 1 -- 172.21.15.66:0/3697269229 learned_addr learned my addr 172.21.15.66:0/3697269229 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a17e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1b5d0 0x55a584a2ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 -- 172.21.15.66:0/3697269229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1b5d0 msgr2=0x55a584a2ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1b5d0 0x55a584a2ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 -- 172.21.15.66:0/3697269229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 msgr2=0x55a584a17e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a17e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 -- 172.21.15.66:0/3697269229 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a584a1ae70 con 0x55a584a26370 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f40127fc640 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x55a584a1c070 tx=0x7f4008014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6884a1d41527f6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f3ff8ff9640 1 -- 172.21.15.66:0/3697269229 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008012d70 con 0x55a584a26370 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f3ff8ff9640 1 -- 172.21.15.66:0/3697269229 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4008026070 con 0x55a584a26370 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.491+0000 7f3ff8ff9640 1 -- 172.21.15.66:0/3697269229 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008004e10 con 0x55a584a26370 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- 172.21.15.66:0/3697269229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 msgr2=0x55a584a41b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x55a584a1c070 tx=0x7f4008014040 comp rx=0 tx=0).stop 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- 172.21.15.66:0/3697269229 shutdown_connections 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a26370 0x55a584a41b40 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a1cb40 0x55a584a17e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 --2- 172.21.15.66:0/3697269229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1b5d0 0x55a584a2ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- 172.21.15.66:0/3697269229 >> 172.21.15.66:0/3697269229 conn(0x55a5849e4310 msgr2=0x55a584a17700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- 172.21.15.66:0/3697269229 shutdown_connections 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- 172.21.15.66:0/3697269229 wait complete. 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 -- start start 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.492+0000 7f401b754740 1 Processor -- start 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 0x55a584a31f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a26370 0x55a584a9cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ae460 con 0x55a584a1b5d0 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40141add60 con 0x55a584a26370 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40141aafc0 con 0x55a584a1cb40 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f401b754740 10 client.0 _ll_register_callbacks cb 0x7f400800b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47866/0 (socket says 172.21.15.66:47866) 2024-09-15T22:54:53.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 -- 172.21.15.66:0/3669337765 learned_addr learned my addr 172.21.15.66:0/3669337765 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 0x55a584a31f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a26370 0x55a584a9cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 -- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 msgr2=0x55a584a31f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 0x55a584a31f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 -- 172.21.15.66:0/3669337765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a26370 msgr2=0x55a584a9cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a26370 0x55a584a9cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 -- 172.21.15.66:0/3669337765 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a584a9d170 con 0x55a584a1b5d0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 0x55a584a31f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f40127fc640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4008005970 tx=0x7f4008004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7158b4d4a82ebf6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.493+0000 7f3ff6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008036070 con 0x55a584a1b5d0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4008026070 con 0x55a584a1b5d0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f4008004730 con 0x55a584a1b5d0 2024-09-15T22:54:53.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4008045050 con 0x55a584a1b5d0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 10 client.17463 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a584aa4500 con 0x55a584a1b5d0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4008026070 con 0x55a584a1b5d0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f4008021040 con 0x55a584a1b5d0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 10 client.17463 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 10 client.17463 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 20 client.17463 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584aa4ac0 0x55a584aa6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 4 client.17463 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a584988d70 con 0x55a584aa4ac0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.494+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584aa4ac0 0x55a584aa6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f3ff6ff5640 10 client.17463 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f4012ffd640 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584aa4ac0 0x55a584aa6eb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4c7c42cf321c91e3 server_cookie=a69af3eaf39e7b04 in_seq=0 out_seq=0 2024-09-15T22:54:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f3ff6ff5640 1 -- 172.21.15.66:0/3669337765 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a584988d70 con 0x55a584aa4ac0 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f3ff6ff5640 10 client.17463 handle_command_reply: tid=0 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 client.17463 shutdown 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 msgr2=0x55a584a31a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4008005970 tx=0x7f4008004ad0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 shutdown_connections 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a584aa4ac0 0x55a584aa6eb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a584a26370 0x55a584a9cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a584a1cb40 0x55a584a31f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 --2- 172.21.15.66:0/3669337765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a584a1b5d0 0x55a584a31a00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 >> 172.21.15.66:0/3669337765 conn(0x55a5849e4310 msgr2=0x55a584a164e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f3ff6ff5640 0 client.17463 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 shutdown_connections 2024-09-15T22:54:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 1 -- 172.21.15.66:0/3669337765 wait complete. 2024-09-15T22:54:53.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.495+0000 7f401b754740 20 client.17463 trim_cache size 0 max 16384 2024-09-15T22:54:53.516 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:53.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 msgr2=0x7f3ffc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 0x7f3ffc0a58f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f400c09c070 tx=0x7f400c004a50 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 msgr2=0x7f401419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f400c00e970 tx=0x7f400c00ed70 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 shutdown_connections 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3ffc0a3430 0x7f3ffc0a58f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4014108300 0x7f401419cf20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4014103780 0x7f4014198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 --2- 172.21.15.66:0/59345234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4014102dd0 0x7f4014198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 >> 172.21.15.66:0/59345234 conn(0x7f40140fc7d0 msgr2=0x7f4014105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 shutdown_connections 2024-09-15T22:54:53.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:53.496+0000 7f401937b640 1 -- 172.21.15.66:0/59345234 wait complete. 2024-09-15T22:54:54.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:54:54.451 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 -- 172.21.15.66:0/183066518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688101410 msgr2=0x7ff68810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 --2- 172.21.15.66:0/183066518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688101410 0x7ff68810d940 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff680009cd0 tx=0x7ff68002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 -- 172.21.15.66:0/183066518 shutdown_connections 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 --2- 172.21.15.66:0/183066518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688101410 0x7ff68810d940 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 --2- 172.21.15.66:0/183066518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff688100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 --2- 172.21.15.66:0/183066518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688106a70 0x7ff688106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 -- 172.21.15.66:0/183066518 >> 172.21.15.66:0/183066518 conn(0x7ff6880fc7d0 msgr2=0x7ff6880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 -- 172.21.15.66:0/183066518 shutdown_connections 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.944+0000 7ff68ecca640 1 -- 172.21.15.66:0/183066518 wait complete. 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 Processor -- start 2024-09-15T22:54:54.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 -- start start 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 0x7ff688198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688106a70 0x7ff68819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff688110e70 con 0x7ff688106a70 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff688110cf0 con 0x7ff688100a70 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ecca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff688110ff0 con 0x7ff688101410 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59874/0 (socket says 172.21.15.66:59874) 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68d267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688106a70 0x7ff68819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 -- 172.21.15.66:0/1156390406 learned_addr learned my addr 172.21.15.66:0/1156390406 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff687fff640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 0x7ff688198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 -- 172.21.15.66:0/1156390406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 msgr2=0x7ff688198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 0x7ff688198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 -- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688106a70 msgr2=0x7ff68819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688106a70 0x7ff68819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff68ca66640 1 -- 172.21.15.66:0/1156390406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68819d390 con 0x7ff688100a70 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.945+0000 7ff687fff640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 0x7ff688198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff68ca66640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d950 tx=0x7ff67800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff685ffb640 1 -- 172.21.15.66:0/1156390406 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678017070 con 0x7ff688100a70 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68819d680 con 0x7ff688100a70 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff685ffb640 1 -- 172.21.15.66:0/1156390406 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff678009c30 con 0x7ff688100a70 2024-09-15T22:54:54.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff685ffb640 1 -- 172.21.15.66:0/1156390406 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67800f6b0 con 0x7ff688100a70 2024-09-15T22:54:54.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.946+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6881a4f60 con 0x7ff688100a70 2024-09-15T22:54:54.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.948+0000 7ff685ffb640 1 -- 172.21.15.66:0/1156390406 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff6780109d0 con 0x7ff688100a70 2024-09-15T22:54:54.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 Processor -- start 2024-09-15T22:54:54.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 -- start start 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff685ffb640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 0x7ff6740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bd4780 0x5610e5bd6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5610e5b2b2f0 con 0x5610e5bc6b40 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5610e5ad2cf0 con 0x5610e5bc55d0 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff6910a3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5610e5b272b0 con 0x5610e5bd4780 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff685ffb640 1 -- 172.21.15.66:0/1156390406 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7ff6780cfdb0 con 0x7ff688100a70 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff68d267640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 0x7ff6740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59888/0 (socket says 172.21.15.66:59888) 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 -- 172.21.15.66:0/1458680506 learned_addr learned my addr 172.21.15.66:0/1458680506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff68ca66640 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff68d267640 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bd4780 0x5610e5bd6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 -- 172.21.15.66:0/1458680506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bd4780 msgr2=0x5610e5bd6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bd4780 0x5610e5bd6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 -- 172.21.15.66:0/1458680506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 msgr2=0x5610e5bc5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.949+0000 7ff687fff640 1 -- 172.21.15.66:0/1458680506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e5ab73a0 con 0x5610e5bc55d0 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.950+0000 7ff68d267640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 0x7ff6740a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff680004ab0 tx=0x7ff6800314a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.950+0000 7ff687fff640 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff670009cf0 tx=0x7ff6700117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f517b920fc9b3414 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.950+0000 7ff67effd640 1 -- 172.21.15.66:0/1458680506 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670012450 con 0x5610e5bc55d0 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.950+0000 7ff67effd640 1 -- 172.21.15.66:0/1458680506 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff670012ad0 con 0x5610e5bc55d0 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.950+0000 7ff67effd640 1 -- 172.21.15.66:0/1458680506 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67000fb10 con 0x5610e5bc55d0 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- 172.21.15.66:0/1458680506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 msgr2=0x5610e5bc5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff670009cf0 tx=0x7ff6700117b0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- 172.21.15.66:0/1458680506 shutdown_connections 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bd4780 0x5610e5bd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bc5a10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 --2- 172.21.15.66:0/1458680506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- 172.21.15.66:0/1458680506 >> 172.21.15.66:0/1458680506 conn(0x5610e5b8e310 msgr2=0x5610e5bc1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- 172.21.15.66:0/1458680506 shutdown_connections 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- 172.21.15.66:0/1458680506 wait complete. 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 -- start start 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.951+0000 7ff6910a3740 1 Processor -- start 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bd40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5610e5bd7480 con 0x5610e5bd4780 2024-09-15T22:54:54.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5610e5ae6060 con 0x5610e5bc6b40 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5610e5bd7600 con 0x5610e5bc55d0 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff6910a3740 10 client.0 _ll_register_callbacks cb 0x5610e58398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59902/0 (socket says 172.21.15.66:59902) 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47898/0 (socket says 172.21.15.66:47898) 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff687fff640 1 -- 172.21.15.66:0/964065828 learned_addr learned my addr 172.21.15.66:0/964065828 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68ca66640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bd40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 -- 172.21.15.66:0/964065828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 msgr2=0x5610e5bd40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bd40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 -- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 msgr2=0x5610e5bd1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 -- 172.21.15.66:0/964065828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e589c3c0 con 0x5610e5bd4780 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff687fff640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff68d267640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff680009ca0 tx=0x7ff68002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce003f87ac9ae9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.952+0000 7ff667fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68004c030 con 0x5610e5bd4780 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7ff680004720 con 0x5610e5bd4780 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff670012ad0 con 0x5610e5bd4780 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff680059050 con 0x5610e5bd4780 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 10 client.17475 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:54.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5610e5be2f10 con 0x5610e5bd4780 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff670012ad0 con 0x5610e5bd4780 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7ff680030070 con 0x5610e5bd4780 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 10 client.17475 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 10 client.17475 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 20 client.17475 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5be6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 4 client.17475 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.953+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610e5b38860 con 0x5610e5be43d0 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.954+0000 7ff68ca66640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5be6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.954+0000 7ff68ca66640 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5be6840 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f467f175569eb94d server_cookie=d61ddce3acadf207 in_seq=0 out_seq=0 2024-09-15T22:54:54.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.954+0000 7ff667fff640 10 client.17475 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff667fff640 1 -- 172.21.15.66:0/964065828 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610e5b38860 con 0x5610e5be43d0 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff667fff640 10 client.17475 handle_command_reply: tid=0 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 client.17475 shutdown 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 msgr2=0x5610e5bd18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff680009ca0 tx=0x7ff68002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 shutdown_connections 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5be6840 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff667fff640 0 client.17475 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd18e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc6b40 0x5610e5bd1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 --2- 172.21.15.66:0/964065828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bd40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 >> 172.21.15.66:0/964065828 conn(0x5610e5b8e310 msgr2=0x5610e5bc7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 shutdown_connections 2024-09-15T22:54:54.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 1 -- 172.21.15.66:0/964065828 wait complete. 2024-09-15T22:54:54.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.955+0000 7ff6910a3740 20 client.17475 trim_cache size 0 max 16384 2024-09-15T22:54:54.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 Processor -- start 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 -- start start 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bbcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 0x5610e5be0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ad000 con 0x5610e5bc6b40 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881aeb70 con 0x5610e5bd4780 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff6910a3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ad6d0 con 0x5610e5bc55d0 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff687fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff687fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47914/0 (socket says 172.21.15.66:47914) 2024-09-15T22:54:54.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff687fff640 1 -- 172.21.15.66:0/106363914 learned_addr learned my addr 172.21.15.66:0/106363914 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:54.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.968+0000 7ff68d267640 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 0x5610e5be0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68ca66640 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bbcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 -- 172.21.15.66:0/106363914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 msgr2=0x5610e5bbcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bbcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 -- 172.21.15.66:0/106363914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 msgr2=0x5610e5bc1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 -- 172.21.15.66:0/106363914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e5bcf8d0 con 0x5610e5bd4780 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff68d267640 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 0x5610e5be0750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff680048790 tx=0x7ff680004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c8db13fe2a9ad80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff67e7fc640 1 -- 172.21.15.66:0/106363914 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68004c070 con 0x5610e5bd4780 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff67e7fc640 1 -- 172.21.15.66:0/106363914 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff680004720 con 0x5610e5bd4780 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.969+0000 7ff67e7fc640 1 -- 172.21.15.66:0/106363914 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680030a20 con 0x5610e5bd4780 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- 172.21.15.66:0/106363914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 msgr2=0x5610e5be0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 0x5610e5be0750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff680048790 tx=0x7ff680004410 comp rx=0 tx=0).stop 2024-09-15T22:54:54.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- 172.21.15.66:0/106363914 shutdown_connections 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bd4780 0x5610e5be0750 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bc6b40 0x5610e5bc1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 --2- 172.21.15.66:0/106363914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc55d0 0x5610e5bbcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- 172.21.15.66:0/106363914 >> 172.21.15.66:0/106363914 conn(0x5610e5b8e310 msgr2=0x5610e5bc1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- 172.21.15.66:0/106363914 shutdown_connections 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- 172.21.15.66:0/106363914 wait complete. 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.970+0000 7ff6910a3740 1 -- start start 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 Processor -- start 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 0x5610e5bd8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ae4a0 con 0x5610e5bd4780 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881adda0 con 0x5610e5bc55d0 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881ab000 con 0x5610e5bc6b40 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff6910a3740 10 client.0 _ll_register_callbacks cb 0x7ff680009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff68ca66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff68ca66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:59914/0 (socket says 172.21.15.66:59914) 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff68ca66640 1 -- 172.21.15.66:0/4191547889 learned_addr learned my addr 172.21.15.66:0/4191547889 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff68d267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.971+0000 7ff687fff640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 0x5610e5bd8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 -- 172.21.15.66:0/4191547889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 msgr2=0x5610e5bd8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 0x5610e5bd8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 -- 172.21.15.66:0/4191547889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 msgr2=0x5610e5bd8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:54.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 -- 172.21.15.66:0/4191547889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e5c4e130 con 0x5610e5bc55d0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff687fff640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 0x5610e5bd8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68d267640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff68ca66640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff678009610 tx=0x7ff678005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473d3986ec2405b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff667fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678020040 con 0x5610e5bc55d0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7ff678098270 con 0x5610e5bc55d0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff680004720 con 0x5610e5bc55d0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff67809bc00 con 0x5610e5bc55d0 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff6910a3740 10 client.26882 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:54.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5610e5c4f370 con 0x5610e5bc55d0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.972+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff680004720 con 0x5610e5bc55d0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7ff6780860b0 con 0x5610e5bc55d0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 10 client.26882 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 10 client.26882 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 20 client.26882 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5c51aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 4 client.26882 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5610e5b32d70 con 0x5610e5be43d0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff687fff640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5c51aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff687fff640 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5c51aa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70c4bf9946ecaaca server_cookie=fc1572fe580f4dc7 in_seq=0 out_seq=0 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.973+0000 7ff667fff640 10 client.26882 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:54.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff667fff640 1 -- 172.21.15.66:0/4191547889 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5610e5b32d70 con 0x5610e5be43d0 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff667fff640 10 client.26882 handle_command_reply: tid=0 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 client.26882 shutdown 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 msgr2=0x5610e5bd8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff678009610 tx=0x7ff678005880 comp rx=0 tx=0).stop 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 shutdown_connections 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5610e5be43d0 0x5610e5c51aa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff667fff640 0 client.26882 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610e5bd4780 0x5610e5bd8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610e5bc6b40 0x5610e5bd8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 --2- 172.21.15.66:0/4191547889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610e5bc55d0 0x5610e5bd8570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 >> 172.21.15.66:0/4191547889 conn(0x5610e5b8e310 msgr2=0x5610e5bd2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 shutdown_connections 2024-09-15T22:54:54.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 1 -- 172.21.15.66:0/4191547889 wait complete. 2024-09-15T22:54:54.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.974+0000 7ff6910a3740 20 client.26882 trim_cache size 0 max 16384 2024-09-15T22:54:54.982 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:54.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 msgr2=0x7ff6740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 0x7ff6740a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff680004ab0 tx=0x7ff6800314a0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 msgr2=0x7ff6881983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d950 tx=0x7ff67800de10 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 shutdown_connections 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff6740a33b0 0x7ff6740a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff688106a70 0x7ff68819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff688101410 0x7ff688198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 --2- 172.21.15.66:0/1156390406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff688100a70 0x7ff6881983e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 >> 172.21.15.66:0/1156390406 conn(0x7ff6880fc7d0 msgr2=0x7ff688104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 shutdown_connections 2024-09-15T22:54:54.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:54.975+0000 7ff68ecca640 1 -- 172.21.15.66:0/1156390406 wait complete. 2024-09-15T22:54:55.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:55 smithi066 ceph-mon[31185]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-15T22:54:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:55 smithi087 ceph-mon[35290]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-15T22:54:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:55 smithi184 ceph-mon[35203]: pgmap v295: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-15T22:54:55.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.506+0000 7f5d7f7fe640 1 -- 172.21.15.66:0/3356692026 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ebb70a6be0 con 0x55ebb71c4f80 2024-09-15T22:54:55.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.506+0000 7f5d7f7fe640 10 client.17403 handle_command_reply: tid=0 2024-09-15T22:54:55.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 client.17403 shutdown 2024-09-15T22:54:55.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 msgr2=0x55ebb714e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:55.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5d94001eb0 tx=0x7f5d94014680 comp rx=0 tx=0).stop 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 shutdown_connections 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ebb7149e40 0x55ebb714e5b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ebb71c4f80 0x55ebb71c7370 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ebb713b030 0x55ebb714e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 --2- 172.21.15.66:0/3356692026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ebb713a710 0x55ebb714db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5d7f7fe640 0 client.17403 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 >> 172.21.15.66:0/3356692026 conn(0x55ebb7136de0 msgr2=0x55ebb7154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 shutdown_connections 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 1 -- 172.21.15.66:0/3356692026 wait complete. 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.507+0000 7f5da8880740 20 client.17403 trim_cache size 0 max 16384 2024-09-15T22:54:55.509 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 48, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 30, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "449690e5": { 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 30, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.3, 2024-09-15T22:54:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:54:55.511 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 msgr2=0x7f5d880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 0x7f5d880a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d980c5bd0 tx=0x7f5d980f17d0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 msgr2=0x7f5da019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5d98031a60 tx=0x7f5d98031a90 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 shutdown_connections 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5da0106f10 0x7f5da019cd40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5da0102790 0x7f5da01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 --2- 172.21.15.66:0/382262439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5da0101de0 0x7f5da0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 >> 172.21.15.66:0/382262439 conn(0x7f5da00fd8c0 msgr2=0x7f5da00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 shutdown_connections 2024-09-15T22:54:55.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:55.508+0000 7f5da64a7640 1 -- 172.21.15.66:0/382262439 wait complete. 2024-09-15T22:54:55.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:54:56.705 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '449690e5', quiesce took 11.1 seconds. Will release after: 11.250000000000002 2024-09-15T22:54:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 -- 172.21.15.66:0/3629157257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138106a70 msgr2=0x7f0138106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 --2- 172.21.15.66:0/3629157257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138106a70 0x7f0138106e50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0128009930 tx=0x7f012802a420 comp rx=0 tx=0).stop 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 -- 172.21.15.66:0/3629157257 shutdown_connections 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 --2- 172.21.15.66:0/3629157257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138101410 0x7f013810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 --2- 172.21.15.66:0/3629157257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138100a70 0x7f0138100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 --2- 172.21.15.66:0/3629157257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138106a70 0x7f0138106e50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 -- 172.21.15.66:0/3629157257 >> 172.21.15.66:0/3629157257 conn(0x7f01380fc790 msgr2=0x7f01380febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 -- 172.21.15.66:0/3629157257 shutdown_connections 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.204+0000 7f013e651640 1 -- 172.21.15.66:0/3629157257 wait complete. 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 Processor -- start 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 -- start start 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138100a70 0x7f0138198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138106a70 0x7f013819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0138111f90 con 0x7f0138101410 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0138111e10 con 0x7f0138106a70 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013e651640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0138112110 con 0x7f0138100a70 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47950/0 (socket says 172.21.15.66:47950) 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 -- 172.21.15.66:0/440474759 learned_addr learned my addr 172.21.15.66:0/440474759 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f0137fff640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138100a70 0x7f0138198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f013cbee640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138106a70 0x7f013819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 -- 172.21.15.66:0/440474759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138100a70 msgr2=0x7f0138198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138100a70 0x7f0138198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 -- 172.21.15.66:0/440474759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138106a70 msgr2=0x7f013819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138106a70 0x7f013819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.205+0000 7f01377fe640 1 -- 172.21.15.66:0/440474759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013819d440 con 0x7f0138101410 2024-09-15T22:54:57.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f01377fe640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f012c00d950 tx=0x7f012c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f01357fa640 1 -- 172.21.15.66:0/440474759 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c017070 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f01357fa640 1 -- 172.21.15.66:0/440474759 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c009c30 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013819d730 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f01357fa640 1 -- 172.21.15.66:0/440474759 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00f6b0 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.206+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01381a5010 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.208+0000 7f01357fa640 1 -- 172.21.15.66:0/440474759 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f012c0109d0 con 0x7f0138101410 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.208+0000 7f0140a2a740 1 Processor -- start 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.208+0000 7f0140a2a740 1 -- start start 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 0x55779391aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 0x557793927760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5577938802f0 con 0x55779391bb40 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x557793827cf0 con 0x55779391a5d0 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0140a2a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55779387c2b0 con 0x557793925370 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f01357fa640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 0x7f01200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47960/0 (socket says 172.21.15.66:47960) 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 -- 172.21.15.66:0/3557446217 learned_addr learned my addr 172.21.15.66:0/3557446217 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0137fff640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 0x55779391aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f01377fe640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 0x557793927760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 0x7f01200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 -- 172.21.15.66:0/3557446217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 msgr2=0x557793927760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f01357fa640 1 -- 172.21.15.66:0/440474759 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f012c0cfc90 con 0x7f0138101410 2024-09-15T22:54:57.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 0x557793927760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 -- 172.21.15.66:0/3557446217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 msgr2=0x55779391aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 0x55779391aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 -- 172.21.15.66:0/3557446217 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779380c3a0 con 0x55779391bb40 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f01377fe640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 0x557793927760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f0137fff640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 0x55779391aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.209+0000 7f013cbee640 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0130014a60 tx=0x7f0130014e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffd72b970f87896 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f011e7fc640 1 -- 172.21.15.66:0/3557446217 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130004d20 con 0x55779391bb40 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f011e7fc640 1 -- 172.21.15.66:0/3557446217 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0130023070 con 0x55779391bb40 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f011e7fc640 1 -- 172.21.15.66:0/3557446217 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130005550 con 0x55779391bb40 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f0140a2a740 1 -- 172.21.15.66:0/3557446217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 msgr2=0x55779391a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f013cbee640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 0x7f01200a58f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0130022000 tx=0x7f013001e000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.210+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0130014a60 tx=0x7f0130014e60 comp rx=0 tx=0).stop 2024-09-15T22:54:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 -- 172.21.15.66:0/3557446217 shutdown_connections 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557793925370 0x557793927760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391a5d0 0x55779391aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3557446217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x55779391a090 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 -- 172.21.15.66:0/3557446217 >> 172.21.15.66:0/3557446217 conn(0x5577938e3310 msgr2=0x557793916c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 -- 172.21.15.66:0/3557446217 shutdown_connections 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 -- 172.21.15.66:0/3557446217 wait complete. 2024-09-15T22:54:57.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 -- start start 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 Processor -- start 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793924d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.211+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793922650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557793928070 con 0x55779391bb40 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55779383b060 con 0x557793925370 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5577939281f0 con 0x55779391a5d0 2024-09-15T22:54:57.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 10 client.0 _ll_register_callbacks cb 0x55779358e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47976/0 (socket says 172.21.15.66:47976) 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 -- 172.21.15.66:0/1451975003 learned_addr learned my addr 172.21.15.66:0/1451975003 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0137fff640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793924d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f013cbee640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793922650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 -- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 msgr2=0x557793924d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793924d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 -- 172.21.15.66:0/1451975003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 msgr2=0x557793922650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793922650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 -- 172.21.15.66:0/1451975003 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577935f13c0 con 0x55779391bb40 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01377fe640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f012c0cd5b0 tx=0x7f012c06b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae662027abfc41ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01177fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:57.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c020040 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f012c09b040 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.212+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0130023070 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f012c0a47b0 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 10 client.17493 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557793933b00 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0130023070 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f012c066af0 con 0x55779391bb40 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 10 client.17493 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 10 client.17493 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 20 client.17493 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x557793934fc0 0x5577939373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 4 client.17493 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55779388d860 con 0x557793934fc0 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.213+0000 7f0137fff640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x557793934fc0 0x5577939373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.214+0000 7f0137fff640 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x557793934fc0 0x5577939373d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1511c2032d6a36c7 server_cookie=118195315ecdc86b in_seq=0 out_seq=0 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.214+0000 7f01177fe640 10 client.17493 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.214+0000 7f01177fe640 1 -- 172.21.15.66:0/1451975003 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55779388d860 con 0x557793934fc0 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.214+0000 7f01177fe640 10 client.17493 handle_command_reply: tid=0 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 client.17493 shutdown 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 msgr2=0x557793922040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f012c0cd5b0 tx=0x7f012c06b810 comp rx=0 tx=0).stop 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 shutdown_connections 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x557793934fc0 0x5577939373d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793922650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793922040 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1451975003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793924d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 >> 172.21.15.66:0/1451975003 conn(0x5577938e3310 msgr2=0x55779391c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f01177fe640 0 client.17493 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 shutdown_connections 2024-09-15T22:54:57.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 1 -- 172.21.15.66:0/1451975003 wait complete. 2024-09-15T22:54:57.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.215+0000 7f0140a2a740 20 client.17493 trim_cache size 0 max 16384 2024-09-15T22:54:57.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 Processor -- start 2024-09-15T22:54:57.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 -- start start 2024-09-15T22:54:57.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793931310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793921020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01381af1c0 con 0x55779391bb40 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b0d30 con 0x557793925370 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.228+0000 7f0140a2a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01381af890 con 0x55779391a5d0 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47984/0 (socket says 172.21.15.66:47984) 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 -- 172.21.15.66:0/3589974373 learned_addr learned my addr 172.21.15.66:0/3589974373 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f0137fff640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793931310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 -- 172.21.15.66:0/3589974373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 msgr2=0x557793931310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f013cbee640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793921020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793931310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 -- 172.21.15.66:0/3589974373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 msgr2=0x557793921020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793921020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 -- 172.21.15.66:0/3589974373 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779391d120 con 0x55779391bb40 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f013cbee640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793921020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:54:57.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f01377fe640 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f012c0a4280 tx=0x7f012c0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062dae0f296d819 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f011dffb640 1 -- 172.21.15.66:0/3589974373 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c020070 con 0x55779391bb40 2024-09-15T22:54:57.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f011dffb640 1 -- 172.21.15.66:0/3589974373 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c09bbf0 con 0x55779391bb40 2024-09-15T22:54:57.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.229+0000 7f011dffb640 1 -- 172.21.15.66:0/3589974373 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c09b040 con 0x55779391bb40 2024-09-15T22:54:57.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- 172.21.15.66:0/3589974373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 msgr2=0x557793919c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f012c0a4280 tx=0x7f012c0d0040 comp rx=0 tx=0).stop 2024-09-15T22:54:57.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- 172.21.15.66:0/3589974373 shutdown_connections 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557793925370 0x557793921020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55779391bb40 0x557793919c80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 --2- 172.21.15.66:0/3589974373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x557793931310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- 172.21.15.66:0/3589974373 >> 172.21.15.66:0/3589974373 conn(0x5577938e3310 msgr2=0x557793920910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- 172.21.15.66:0/3589974373 shutdown_connections 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- 172.21.15.66:0/3589974373 wait complete. 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.230+0000 7f0140a2a740 1 -- start start 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 Processor -- start 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x55779399b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391bb40 0x55779392d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b0660 con 0x557793925370 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01381aff60 con 0x55779391bb40 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01381ad1c0 con 0x55779391a5d0 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0140a2a740 10 client.0 _ll_register_callbacks cb 0x7f012c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47994/0 (socket says 172.21.15.66:47994) 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 -- 172.21.15.66:0/1487974761 learned_addr learned my addr 172.21.15.66:0/1487974761 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f0137fff640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x55779399b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f01377fe640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391bb40 0x55779392d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 -- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 msgr2=0x55779399b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x55779399b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 -- 172.21.15.66:0/1487974761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391bb40 msgr2=0x55779392d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:57.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391bb40 0x55779392d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.231+0000 7f013cbee640 1 -- 172.21.15.66:0/1487974761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779392df30 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f013cbee640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0130005fd0 tx=0x7f0130005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fae3cb7d1711dee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130005a30 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f0130014020 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c09bbf0 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0130014220 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 10 client.17499 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5577939a4080 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c09bbf0 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f013000f040 con 0x557793925370 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 10 client.17499 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 10 client.17499 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:54:57.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 20 client.17499 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5577939a4360 0x5577939a6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 4 client.17499 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.232+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557793887d70 con 0x5577939a4360 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f0137fff640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5577939a4360 0x5577939a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f01177fe640 10 client.17499 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f0137fff640 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5577939a4360 0x5577939a6750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95cbfe6430275bc0 server_cookie=db0d5e27a90f20bf in_seq=0 out_seq=0 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f01177fe640 1 -- 172.21.15.66:0/1487974761 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557793887d70 con 0x5577939a4360 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f01177fe640 10 client.17499 handle_command_reply: tid=0 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.233+0000 7f0140a2a740 1 client.17499 shutdown 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 msgr2=0x55779392d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0130005fd0 tx=0x7f0130005050 comp rx=0 tx=0).stop 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 shutdown_connections 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5577939a4360 0x5577939a6750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557793925370 0x55779392d9c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55779391bb40 0x55779392d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f01177fe640 0 client.17499 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 --2- 172.21.15.66:0/1487974761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55779391a5d0 0x55779399b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 >> 172.21.15.66:0/1487974761 conn(0x5577938e3310 msgr2=0x557793921130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 shutdown_connections 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 1 -- 172.21.15.66:0/1487974761 wait complete. 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f0140a2a740 20 client.17499 trim_cache size 0 max 16384 2024-09-15T22:54:57.240 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:57.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 msgr2=0x7f01200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 0x7f01200a58f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0130022000 tx=0x7f013001e000 comp rx=0 tx=0).stop 2024-09-15T22:54:57.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 msgr2=0x7f01381989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:57.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f012c00d950 tx=0x7f012c00de10 comp rx=0 tx=0).stop 2024-09-15T22:54:57.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 shutdown_connections 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01200a3430 0x7f01200a58f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0138106a70 0x7f013819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138101410 0x7f01381989d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.234+0000 7f013e651640 1 --2- 172.21.15.66:0/440474759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0138100a70 0x7f0138198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.235+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 >> 172.21.15.66:0/440474759 conn(0x7f01380fc790 msgr2=0x7f01380fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.235+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 shutdown_connections 2024-09-15T22:54:57.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:57.235+0000 7f013e651640 1 -- 172.21.15.66:0/440474759 wait complete. 2024-09-15T22:54:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:57 smithi087 ceph-mon[35290]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:54:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:57 smithi184 ceph-mon[35203]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:54:57.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:57 smithi066 ceph-mon[31185]: pgmap v296: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-15T22:54:57.959 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:54:58.223 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:54:58.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2118776378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4101420 msgr2=0x7fe5c410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2118776378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4101420 0x7fe5c410d950 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009cd0 tx=0x7fe5bc02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2118776378 shutdown_connections 2024-09-15T22:54:58.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2118776378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4101420 0x7fe5c410d950 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2118776378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4100a80 0x7fe5c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2118776378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4106a80 0x7fe5c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2118776378 >> 172.21.15.66:0/2118776378 conn(0x7fe5c40fc7a0 msgr2=0x7fe5c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2118776378 shutdown_connections 2024-09-15T22:54:58.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.697+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2118776378 wait complete. 2024-09-15T22:54:58.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 Processor -- start 2024-09-15T22:54:58.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 -- start start 2024-09-15T22:54:58.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4100a80 0x7fe5c41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 0x7fe5c4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4110ea0 con 0x7fe5c4106a80 2024-09-15T22:54:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4110d20 con 0x7fe5c4101420 2024-09-15T22:54:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5cbd2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4111020 con 0x7fe5c4100a80 2024-09-15T22:54:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48004/0 (socket says 172.21.15.66:48004) 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 -- 172.21.15.66:0/2153754908 learned_addr learned my addr 172.21.15.66:0/2153754908 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 0x7fe5c4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4100a80 0x7fe5c41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 -- 172.21.15.66:0/2153754908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4100a80 msgr2=0x7fe5c41983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4100a80 0x7fe5c41983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 -- 172.21.15.66:0/2153754908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 msgr2=0x7fe5c4198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 0x7fe5c4198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5ca2c7640 1 -- 172.21.15.66:0/2153754908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c419d380 con 0x7fe5c4106a80 2024-09-15T22:54:58.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.698+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 0x7fe5c4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:54:58.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5ca2c7640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc006010 tx=0x7fe5bc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5baffd640 1 -- 172.21.15.66:0/2153754908 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc004450 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5baffd640 1 -- 172.21.15.66:0/2153754908 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5bc003e10 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c419d610 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5baffd640 1 -- 172.21.15.66:0/2153754908 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0466e0 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.699+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41a4f50 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.701+0000 7fe5baffd640 1 -- 172.21.15.66:0/2153754908 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe5bc0305a0 con 0x7fe5c4106a80 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 Processor -- start 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 -- start start 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cbf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5637c6c182f0 con 0x5637c6cb25d0 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5637c6bbfcf0 con 0x5637c6cbd370 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5ce103740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5637c6c142b0 con 0x5637c6cb3b40 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5c9ac6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5c9ac6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48008/0 (socket says 172.21.15.66:48008) 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5c9ac6640 1 -- 172.21.15.66:0/6176924 learned_addr learned my addr 172.21.15.66:0/6176924 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cbf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.702+0000 7fe5baffd640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 0x7fe5b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5ca2c7640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 0x7fe5b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 -- 172.21.15.66:0/6176924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 msgr2=0x5637c6cb2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 -- 172.21.15.66:0/6176924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 msgr2=0x5637c6cbf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cbf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 -- 172.21.15.66:0/6176924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c6ba43a0 con 0x5637c6cb25d0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5baffd640 1 -- 172.21.15.66:0/2153754908 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fe5bc02e030 con 0x7fe5c4106a80 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000b820 tx=0x7fe5c000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c2366bdfff76d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5affff640 1 -- 172.21.15.66:0/6176924 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000d950 con 0x5637c6cb25d0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5ca2c7640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 0x7fe5b00a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0bd760 tx=0x7fe5bc090890 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5affff640 1 -- 172.21.15.66:0/6176924 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c0019070 con 0x5637c6cb25d0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.703+0000 7fe5affff640 1 -- 172.21.15.66:0/6176924 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0014e00 con 0x5637c6cb25d0 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- 172.21.15.66:0/6176924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 msgr2=0x5637c6cb2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000b820 tx=0x7fe5c000bce0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- 172.21.15.66:0/6176924 shutdown_connections 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cbf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cb2a10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 --2- 172.21.15.66:0/6176924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- 172.21.15.66:0/6176924 >> 172.21.15.66:0/6176924 conn(0x5637c6c7b310 msgr2=0x5637c6caec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- 172.21.15.66:0/6176924 shutdown_connections 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- 172.21.15.66:0/6176924 wait complete. 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 -- start start 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.704+0000 7fe5ce103740 1 Processor -- start 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5637c6cc0070 con 0x5637c6cb25d0 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5637c6bd3060 con 0x5637c6cbd370 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5637c6cc01f0 con 0x5637c6cb3b40 2024-09-15T22:54:58.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5ce103740 10 client.0 _ll_register_callbacks cb 0x5637c69268c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48018/0 (socket says 172.21.15.66:48018) 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 -- 172.21.15.66:0/3585547055 learned_addr learned my addr 172.21.15.66:0/3585547055 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 -- 172.21.15.66:0/3585547055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 msgr2=0x5637c6cb9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 -- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 msgr2=0x5637c6cba570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cba570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 -- 172.21.15.66:0/3585547055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c69893c0 con 0x5637c6cb25d0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.705+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4013190 tx=0x7fe5b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c19c54dcf6b579e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:58.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4005020 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c0019070 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fe5b40051c0 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fe5b4027050 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 10 client.17511 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5637c6ccbb10 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c0019070 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fe5b4010640 con 0x5637c6cb25d0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 10 client.17511 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 20 client.17511 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6cccf20 0x5637c6ccf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 4 client.17511 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.706+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637c6c25860 con 0x5637c6cccf20 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.707+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6cccf20 0x5637c6ccf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.707+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6cccf20 0x5637c6ccf350 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8effa29aa61c6e62 server_cookie=70417288f088f1fe in_seq=0 out_seq=0 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.707+0000 7fe5ad7fa640 10 client.17511 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/3585547055 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637c6c25860 con 0x5637c6cccf20 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ad7fa640 10 client.17511 handle_command_reply: tid=0 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 client.17511 shutdown 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 msgr2=0x5637c6cbcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4013190 tx=0x7fe5b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 shutdown_connections 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6cccf20 0x5637c6ccf350 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cbd370 0x5637c6cba570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ad7fa640 0 client.17511 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb3b40 0x5637c6cb9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 --2- 172.21.15.66:0/3585547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cbcd20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 >> 172.21.15.66:0/3585547055 conn(0x5637c6c7b310 msgr2=0x5637c6cb4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 shutdown_connections 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 1 -- 172.21.15.66:0/3585547055 wait complete. 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.708+0000 7fe5ce103740 20 client.17511 trim_cache size 0 max 16384 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 Processor -- start 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 -- start start 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb25d0 0x5637c6cc9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cbe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41af0c0 con 0x5637c6cbd370 2024-09-15T22:54:58.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41b0c30 con 0x5637c6cb3b40 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.721+0000 7fe5ce103740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41af790 con 0x5637c6cb25d0 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48026/0 (socket says 172.21.15.66:48026) 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 -- 172.21.15.66:0/868974299 learned_addr learned my addr 172.21.15.66:0/868974299 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cbe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb25d0 0x5637c6cc9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 -- 172.21.15.66:0/868974299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb25d0 msgr2=0x5637c6cc9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb25d0 0x5637c6cc9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 -- 172.21.15.66:0/868974299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 msgr2=0x5637c6cbe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cbe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 -- 172.21.15.66:0/868974299 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c6cb8520 con 0x5637c6cbd370 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005b90 tx=0x7fe5b400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da32d8439760bff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5af7fe640 1 -- 172.21.15.66:0/868974299 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4010840 con 0x5637c6cbd370 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5af7fe640 1 -- 172.21.15.66:0/868974299 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b4005030 con 0x5637c6cbd370 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.722+0000 7fe5af7fe640 1 -- 172.21.15.66:0/868974299 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4004970 con 0x5637c6cbd370 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- 172.21.15.66:0/868974299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 msgr2=0x5637c6cbeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005b90 tx=0x7fe5b400b460 comp rx=0 tx=0).stop 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- 172.21.15.66:0/868974299 shutdown_connections 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cbd370 0x5637c6cbeca0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cbe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 --2- 172.21.15.66:0/868974299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cb25d0 0x5637c6cc9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- 172.21.15.66:0/868974299 >> 172.21.15.66:0/868974299 conn(0x5637c6c7b310 msgr2=0x5637c6cae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- 172.21.15.66:0/868974299 shutdown_connections 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- 172.21.15.66:0/868974299 wait complete. 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 -- start start 2024-09-15T22:54:58.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.723+0000 7fe5ce103740 1 Processor -- start 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cd4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cbd370 0x5637c6cd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41b0560 con 0x5637c6cb25d0 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41afe60 con 0x5637c6cb3b40 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41ad0c0 con 0x5637c6cbd370 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ce103740 10 client.0 _ll_register_callbacks cb 0x7fe5b4013c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48030/0 (socket says 172.21.15.66:48030) 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 -- 172.21.15.66:0/2421586510 learned_addr learned my addr 172.21.15.66:0/2421586510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cd4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cbd370 0x5637c6cd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 -- 172.21.15.66:0/2421586510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cbd370 msgr2=0x5637c6cd5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cbd370 0x5637c6cd5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 -- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 msgr2=0x5637c6cd4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cd4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 -- 172.21.15.66:0/2421586510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c6cc3a50 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5c92c5640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4010b30 tx=0x7fe5b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8163f1a98b8fe7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.724+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4010850 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fe5b40053e0 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b4005030 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fe5b40055e0 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 10 client.17517 fetch_fsmap learned FSMap version 48 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5637c6d37f10 con 0x5637c6cb25d0 2024-09-15T22:54:58.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b4005030 con 0x5637c6cb25d0 2024-09-15T22:54:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fe5b401c070 con 0x5637c6cb25d0 2024-09-15T22:54:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 10 client.17517 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:54:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:54:58.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 20 client.17517 populate_metadata read hostname 'smithi066' 2024-09-15T22:54:58.750 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6d386e0 0x5637c6d3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 4 client.17517 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.725+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637c6c1fd70 con 0x5637c6d386e0 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6d386e0 0x5637c6d3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5c9ac6640 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6d386e0 0x5637c6d3ab00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec17875649360da server_cookie=26fa7d4f728892c3 in_seq=0 out_seq=0 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ad7fa640 10 client.17517 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ad7fa640 1 -- 172.21.15.66:0/2421586510 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637c6c1fd70 con 0x5637c6d386e0 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ad7fa640 10 client.17517 handle_command_reply: tid=0 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 client.17517 shutdown 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 msgr2=0x5637c6cd4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4010b30 tx=0x7fe5b400b8e0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 shutdown_connections 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5637c6cbd370 0x5637c6cd5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5637c6d386e0 0x5637c6d3ab00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5637c6cb3b40 0x5637c6cd4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 --2- 172.21.15.66:0/2421586510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5637c6cb25d0 0x5637c6cd4890 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ad7fa640 0 client.17517 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 >> 172.21.15.66:0/2421586510 conn(0x5637c6c7b310 msgr2=0x5637c6cad4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.726+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 shutdown_connections 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5ce103740 1 -- 172.21.15.66:0/2421586510 wait complete. 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5ce103740 20 client.17517 trim_cache size 0 max 16384 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 msgr2=0x7fe5b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 0x7fe5b00a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0bd760 tx=0x7fe5bc090890 comp rx=0 tx=0).stop 2024-09-15T22:54:58.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 msgr2=0x7fe5c419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc006010 tx=0x7fe5bc003c20 comp rx=0 tx=0).stop 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 shutdown_connections 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5b00a33b0 0x7fe5b00a5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5c4106a80 0x7fe5c419cca0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c4101420 0x7fe5c4198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 --2- 172.21.15.66:0/2153754908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c4100a80 0x7fe5c41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 >> 172.21.15.66:0/2153754908 conn(0x7fe5c40fc7a0 msgr2=0x7fe5c4104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 shutdown_connections 2024-09-15T22:54:58.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:54:58.727+0000 7fe5cbd2a640 1 -- 172.21.15.66:0/2153754908 wait complete. 2024-09-15T22:54:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:54:59 smithi087 ceph-mon[35290]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-15T22:54:59.363 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:54:59 smithi066 ceph-mon[31185]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-15T22:54:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:54:59 smithi184 ceph-mon[35203]: pgmap v297: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-15T22:55:00.543 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:55:00.543 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:55:00.809 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:01 smithi066 ceph-mon[31185]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 -- 172.21.15.66:0/1859891587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81036e0 msgr2=0x7fa0a8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 --2- 172.21.15.66:0/1859891587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81036e0 0x7fa0a8107b90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009930 tx=0x7fa09c02a420 comp rx=0 tx=0).stop 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 -- 172.21.15.66:0/1859891587 shutdown_connections 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 --2- 172.21.15.66:0/1859891587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a81082a0 0x7fa0a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 --2- 172.21.15.66:0/1859891587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81036e0 0x7fa0a8107b90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 --2- 172.21.15.66:0/1859891587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a8102d30 0x7fa0a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 -- 172.21.15.66:0/1859891587 >> 172.21.15.66:0/1859891587 conn(0x7fa0a80fc7d0 msgr2=0x7fa0a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 -- 172.21.15.66:0/1859891587 shutdown_connections 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.287+0000 7fa0b0573640 1 -- 172.21.15.66:0/1859891587 wait complete. 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 Processor -- start 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 -- start start 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 0x7fa0a81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 0x7fa0a8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81120a0 con 0x7fa0a81082a0 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8111f20 con 0x7fa0a81036e0 2024-09-15T22:55:01.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0b0573640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8112220 con 0x7fa0a8102d30 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0aeb10640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0aeb10640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48054/0 (socket says 172.21.15.66:48054) 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0aeb10640 1 -- 172.21.15.66:0/2715476250 learned_addr learned my addr 172.21.15.66:0/2715476250 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 0x7fa0a81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.288+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 0x7fa0a8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 -- 172.21.15.66:0/2715476250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 msgr2=0x7fa0a81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 0x7fa0a81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 -- 172.21.15.66:0/2715476250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 msgr2=0x7fa0a8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 0x7fa0a8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 -- 172.21.15.66:0/2715476250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a819d570 con 0x7fa0a81082a0 2024-09-15T22:55:01.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 0x7fa0a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 0x7fa0a81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0aeb10640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa09800eaa0 tx=0x7fa09800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0a77fe640 1 -- 172.21.15.66:0/2715476250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09800cdb0 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0a77fe640 1 -- 172.21.15.66:0/2715476250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa098005020 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a819d860 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0a77fe640 1 -- 172.21.15.66:0/2715476250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0980116b0 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.289+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a81a5140 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.291+0000 7fa0a77fe640 1 -- 172.21.15.66:0/2715476250 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa098005560 con 0x7fa0a81082a0 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 Processor -- start 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 -- start start 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bc4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bc4d40 0x55a294bc7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a294b1f280 con 0x55a294bb9b60 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a294ac6b10 con 0x55a294bc4d40 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0b294c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a294b1b240 con 0x55a294bba480 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0adb0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0adb0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48066/0 (socket says 172.21.15.66:48066) 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.292+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2581466431 learned_addr learned my addr 172.21.15.66:0/2581466431 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bc4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bc4d40 0x55a294bc7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0a77fe640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 0x7fa0900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2581466431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 msgr2=0x55a294bc4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bc4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2581466431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bc4d40 msgr2=0x55a294bc7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bc4d40 0x55a294bc7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2581466431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a294ad31f0 con 0x55a294bb9b60 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0aeb10640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 0x7fa0900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa09c006010 tx=0x7fa09c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5c1e180a0ac192 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0a77fe640 1 -- 172.21.15.66:0/2715476250 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fa0980d0440 con 0x7fa0a81082a0 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0a4ff9640 1 -- 172.21.15.66:0/2581466431 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c035050 con 0x55a294bb9b60 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0a4ff9640 1 -- 172.21.15.66:0/2581466431 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa09c031980 con 0x55a294bb9b60 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.293+0000 7fa0a4ff9640 1 -- 172.21.15.66:0/2581466431 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0046c0 con 0x55a294bb9b60 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- 172.21.15.66:0/2581466431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 msgr2=0x55a294bb9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa09c006010 tx=0x7fa09c005bb0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0aeb10640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 0x7fa0900a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa09809c220 tx=0x7fa0980054d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- 172.21.15.66:0/2581466431 shutdown_connections 2024-09-15T22:55:01.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bc4d40 0x55a294bc7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bc4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2581466431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bb9f40 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- 172.21.15.66:0/2581466431 >> 172.21.15.66:0/2581466431 conn(0x55a294bb60f0 msgr2=0x55a294bb64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- 172.21.15.66:0/2581466431 shutdown_connections 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- 172.21.15.66:0/2581466431 wait complete. 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.294+0000 7fa0b294c740 1 -- start start 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 Processor -- start 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb9b60 0x55a294bc1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bc21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a294bc7910 con 0x55a294bc4d40 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a294ad9f10 con 0x55a294bba480 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a294bc7a90 con 0x55a294bb9b60 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0b294c740 10 client.0 _ll_register_callbacks cb 0x55a294aa2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:01.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48082/0 (socket says 172.21.15.66:48082) 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2146374382 learned_addr learned my addr 172.21.15.66:0/2146374382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bc21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb9b60 0x55a294bc1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2146374382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb9b60 msgr2=0x55a294bc1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb9b60 0x55a294bc1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 msgr2=0x55a294bc21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bc21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.295+0000 7fa0adb0e640 1 -- 172.21.15.66:0/2146374382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2948906a0 con 0x55a294bc4d40 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005400 tx=0x7fa09c041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a8d269fa79cd08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09c04e070 con 0x55a294bc4d40 2024-09-15T22:55:01.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fa09c004ad0 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa09c031980 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa09c035070 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 10 client.17529 fetch_fsmap learned FSMap version 48 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a294bd3580 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa09c031980 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fa09c039410 con 0x55a294bc4d40 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 10 client.17529 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 20 client.17529 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bd48d0 0x55a294bd6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 4 client.17529 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.296+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a294b2c7f0 con 0x55a294bd48d0 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.297+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bd48d0 0x55a294bd6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.297+0000 7fa08dffb640 10 client.17529 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:01.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.297+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bd48d0 0x55a294bd6cc0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=602c56057cd71756 server_cookie=38859bf935707fe6 in_seq=0 out_seq=0 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa08dffb640 1 -- 172.21.15.66:0/2146374382 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a294b2c7f0 con 0x55a294bd48d0 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa08dffb640 10 client.17529 handle_command_reply: tid=0 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 client.17529 shutdown 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 msgr2=0x55a294bc2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005400 tx=0x7fa09c041040 comp rx=0 tx=0).stop 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 shutdown_connections 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bc4d40 0x55a294bc2730 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bd48d0 0x55a294bd6cc0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bc21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 --2- 172.21.15.66:0/2146374382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb9b60 0x55a294bc1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa08dffb640 0 client.17529 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 >> 172.21.15.66:0/2146374382 conn(0x55a294bb60f0 msgr2=0x55a294bbbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 shutdown_connections 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 1 -- 172.21.15.66:0/2146374382 wait complete. 2024-09-15T22:55:01.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.298+0000 7fa0b294c740 20 client.17529 trim_cache size 0 max 16384 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 Processor -- start 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 -- start start 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 0x55a294bbc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bda220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81af270 con 0x55a294bb9b60 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81b0de0 con 0x55a294bb60f0 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0b294c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81af940 con 0x55a294bba480 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48096/0 (socket says 172.21.15.66:48096) 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 -- 172.21.15.66:0/3203295427 learned_addr learned my addr 172.21.15.66:0/3203295427 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:01.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 0x55a294bbc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 -- 172.21.15.66:0/3203295427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 msgr2=0x55a294bda220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 -- 172.21.15.66:0/3203295427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 msgr2=0x55a294bbc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 0x55a294bbc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 -- 172.21.15.66:0/3203295427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a294bc42b0 con 0x55a294bb9b60 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 0x55a294bbc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.316+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000be40 tx=0x7fa0a0013b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf21721cfd133856 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa08ffff640 1 -- 172.21.15.66:0/3203295427 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0004030 con 0x55a294bb9b60 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa08ffff640 1 -- 172.21.15.66:0/3203295427 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a00041d0 con 0x55a294bb9b60 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa08ffff640 1 -- 172.21.15.66:0/3203295427 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0010810 con 0x55a294bb9b60 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 -- 172.21.15.66:0/3203295427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 msgr2=0x55a294bd9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000be40 tx=0x7fa0a0013b00 comp rx=0 tx=0).stop 2024-09-15T22:55:01.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 -- 172.21.15.66:0/3203295427 shutdown_connections 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bba480 0x55a294bda220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bd9ce0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 --2- 172.21.15.66:0/3203295427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bb60f0 0x55a294bbc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 -- 172.21.15.66:0/3203295427 >> 172.21.15.66:0/3203295427 conn(0x55a294bbd6a0 msgr2=0x55a294bc0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 -- 172.21.15.66:0/3203295427 shutdown_connections 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.317+0000 7fa0b294c740 1 -- 172.21.15.66:0/3203295427 wait complete. 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 -- start start 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 Processor -- start 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb60f0 0x55a294bd9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bd82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81b0710 con 0x55a294bb9b60 2024-09-15T22:55:01.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81b0010 con 0x55a294bba480 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81ad270 con 0x55a294bb60f0 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0b294c740 10 client.0 _ll_register_callbacks cb 0x7fa0a000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0ae30f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0ae30f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48104/0 (socket says 172.21.15.66:48104) 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0ae30f640 1 -- 172.21.15.66:0/1343760037 learned_addr learned my addr 172.21.15.66:0/1343760037 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.318+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bd82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb60f0 0x55a294bd9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 -- 172.21.15.66:0/1343760037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb60f0 msgr2=0x55a294bd9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb60f0 0x55a294bd9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 -- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 msgr2=0x55a294bd82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bd82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 -- 172.21.15.66:0/1343760037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a294bd89d0 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0ae30f640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x55a294ac1cd0 tx=0x7fa0a0004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81398a694c780d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa08dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00035f0 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a00041d0 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7fa0a0003790 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa0a0037050 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0b294c740 10 client.17535 fetch_fsmap learned FSMap version 48 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a294c3fd00 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.319+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a00041d0 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7fa0a0033500 con 0x55a294bb9b60 2024-09-15T22:55:01.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 10 client.17535 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 20 client.17535 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bc4d40 0x55a294c42540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 4 client.17535 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a294b26d00 con 0x55a294bc4d40 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bc4d40 0x55a294c42540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa08dffb640 10 client.17535 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.320+0000 7fa0adb0e640 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bc4d40 0x55a294c42540 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dc56aaac0a6c708 server_cookie=48d455a8b5374d82 in_seq=0 out_seq=0 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.321+0000 7fa08dffb640 1 -- 172.21.15.66:0/1343760037 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a294b26d00 con 0x55a294bc4d40 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.321+0000 7fa08dffb640 10 client.17535 handle_command_reply: tid=0 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.321+0000 7fa0b294c740 1 client.17535 shutdown 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 msgr2=0x55a294bda2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x55a294ac1cd0 tx=0x7fa0a0004380 comp rx=0 tx=0).stop 2024-09-15T22:55:01.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 shutdown_connections 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a294bc4d40 0x55a294c42540 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a294bba480 0x55a294bd82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a294bb9b60 0x55a294bda2a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 --2- 172.21.15.66:0/1343760037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a294bb60f0 0x55a294bd9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa08dffb640 0 client.17535 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 >> 172.21.15.66:0/1343760037 conn(0x55a294bbd6a0 msgr2=0x55a294bc1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 shutdown_connections 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 1 -- 172.21.15.66:0/1343760037 wait complete. 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.322+0000 7fa0b294c740 20 client.17535 trim_cache size 0 max 16384 2024-09-15T22:55:01.331 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:01.332 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:55:01.332 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "b4c48695-77f9-4ca3-b48d-4909e7ed9efd", 2024-09-15T22:55:01.332 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:55:01.332 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:01.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 msgr2=0x7fa0900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 0x7fa0900a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa09809c220 tx=0x7fa0980054d0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 msgr2=0x7fa0a819ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa09800eaa0 tx=0x7fa09800ef60 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 shutdown_connections 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0900a33b0 0x7fa0900a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0a81082a0 0x7fa0a819ce90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0a81036e0 0x7fa0a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 --2- 172.21.15.66:0/2715476250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0a8102d30 0x7fa0a81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 >> 172.21.15.66:0/2715476250 conn(0x7fa0a80fc7d0 msgr2=0x7fa0a8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 shutdown_connections 2024-09-15T22:55:01.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:01.323+0000 7fa0b0573640 1 -- 172.21.15.66:0/2715476250 wait complete. 2024-09-15T22:55:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:01 smithi184 ceph-mon[35203]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-15T22:55:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:01 smithi087 ceph-mon[35290]: pgmap v298: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-15T22:55:02.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:55:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:55:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:02.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:02 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:02.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:02.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:02 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:02.585 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:02.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:02 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:03.263 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:03 smithi066 ceph-mon[31185]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 -- 172.21.15.66:0/3279818377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 msgr2=0x7f054c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 --2- 172.21.15.66:0/3279818377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c100ee0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0540009930 tx=0x7f054002a420 comp rx=0 tx=0).stop 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 -- 172.21.15.66:0/3279818377 shutdown_connections 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 --2- 172.21.15.66:0/3279818377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 --2- 172.21.15.66:0/3279818377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c100ee0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 --2- 172.21.15.66:0/3279818377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 0x7f054c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.274+0000 7f0552861640 1 -- 172.21.15.66:0/3279818377 >> 172.21.15.66:0/3279818377 conn(0x7f054c0fc7a0 msgr2=0x7f054c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.275+0000 7f0552861640 1 -- 172.21.15.66:0/3279818377 shutdown_connections 2024-09-15T22:55:03.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.275+0000 7f0552861640 1 -- 172.21.15.66:0/3279818377 wait complete. 2024-09-15T22:55:03.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 Processor -- start 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 -- start start 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 0x7f054c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c110e80 con 0x7f054c100a80 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f054c110d00 con 0x7f054c101420 2024-09-15T22:55:03.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.276+0000 7f0552861640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f054c111000 con 0x7f054c106a80 2024-09-15T22:55:03.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39778/0 (socket says 172.21.15.66:39778) 2024-09-15T22:55:03.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054b7fe640 1 -- 172.21.15.66:0/2348304565 learned_addr learned my addr 172.21.15.66:0/2348304565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f0550dfe640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 0x7f054c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 -- 172.21.15.66:0/2348304565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 msgr2=0x7f054c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 0x7f054c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 -- 172.21.15.66:0/2348304565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 msgr2=0x7f054c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 -- 172.21.15.66:0/2348304565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c19f5d0 con 0x7f054c100a80 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.277+0000 7f054bfff640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c19a620 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9f0 tx=0x7f053c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.278+0000 7f05497fa640 1 -- 172.21.15.66:0/2348304565 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c00ccc0 con 0x7f054c100a80 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.278+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c19f8c0 con 0x7f054c100a80 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.278+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c107900 con 0x7f054c100a80 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.278+0000 7f05497fa640 1 -- 172.21.15.66:0/2348304565 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f053c005020 con 0x7f054c100a80 2024-09-15T22:55:03.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.278+0000 7f05497fa640 1 -- 172.21.15.66:0/2348304565 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0049e0 con 0x7f054c100a80 2024-09-15T22:55:03.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.281+0000 7f05497fa640 1 -- 172.21.15.66:0/2348304565 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f053c005560 con 0x7f054c100a80 2024-09-15T22:55:03.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.282+0000 7f0554c3a740 1 Processor -- start 2024-09-15T22:55:03.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.282+0000 7f05497fa640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 0x7f05340a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.282+0000 7f05497fa640 1 -- 172.21.15.66:0/2348304565 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f053c0d00e0 con 0x7f054c100a80 2024-09-15T22:55:03.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 -- start start 2024-09-15T22:55:03.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 0x55ce01152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce010ad2e0 con 0x55ce011474a0 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ce01054ce0 con 0x55ce01152680 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f0554c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ce010a92a0 con 0x55ce01147dc0 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f054bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f054bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59274/0 (socket says 172.21.15.66:59274) 2024-09-15T22:55:03.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f054bfff640 1 -- 172.21.15.66:0/2845879573 learned_addr learned my addr 172.21.15.66:0/2845879573 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.283+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 0x55ce01152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f0550dfe640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 0x7f05340a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054b7fe640 1 -- 172.21.15.66:0/2845879573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 msgr2=0x55ce01154a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01154a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054b7fe640 1 -- 172.21.15.66:0/2845879573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 msgr2=0x55ce01147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054b7fe640 1 -- 172.21.15.66:0/2845879573 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce01039440 con 0x55ce01147dc0 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.284+0000 7f054bfff640 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.285+0000 7f0550dfe640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 0x7f05340a5970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ce01144db0 tx=0x7f0544016040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.285+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 0x55ce01152140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ea47e0ec83a378 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.286+0000 7f05327fc640 1 -- 172.21.15.66:0/2845879573 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540035050 con 0x55ce01147dc0 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.286+0000 7f05327fc640 1 -- 172.21.15.66:0/2845879573 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0540032e20 con 0x55ce01147dc0 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.286+0000 7f05327fc640 1 -- 172.21.15.66:0/2845879573 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540005600 con 0x55ce01147dc0 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 -- 172.21.15.66:0/2845879573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 msgr2=0x55ce01152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 0x55ce01152140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540032c30 comp rx=0 tx=0).stop 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 -- 172.21.15.66:0/2845879573 shutdown_connections 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01147dc0 0x55ce01152140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2845879573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce011474a0 0x55ce01147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.287+0000 7f0554c3a740 1 -- 172.21.15.66:0/2845879573 >> 172.21.15.66:0/2845879573 conn(0x55ce01143a30 msgr2=0x55ce01143e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.288+0000 7f0554c3a740 1 -- 172.21.15.66:0/2845879573 shutdown_connections 2024-09-15T22:55:03.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.288+0000 7f0554c3a740 1 -- 172.21.15.66:0/2845879573 wait complete. 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.288+0000 7f0554c3a740 1 -- start start 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 Processor -- start 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 0x55ce01152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce0114f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01152680 0x55ce0114f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce01155250 con 0x55ce01147dc0 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ce01068050 con 0x55ce011474a0 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f0554c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ce011553d0 con 0x55ce01152680 2024-09-15T22:55:03.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f054bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 0x55ce01152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f054bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 0x55ce01152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39806/0 (socket says 172.21.15.66:39806) 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.289+0000 7f054bfff640 1 -- 172.21.15.66:0/3522057885 learned_addr learned my addr 172.21.15.66:0/3522057885 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce0114f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f0554c3a740 10 client.0 _ll_register_callbacks cb 0x55ce010a8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f0550dfe640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01152680 0x55ce0114f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 -- 172.21.15.66:0/3522057885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01152680 msgr2=0x55ce0114f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01152680 0x55ce0114f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 -- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 msgr2=0x55ce01152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 0x55ce01152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 -- 172.21.15.66:0/3522057885 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce00e1e3c0 con 0x55ce01147dc0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f054b7fe640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce0114f2e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540031aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0636a989c4c3fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.290+0000 7f052b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:03.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054005d070 con 0x55ce01147dc0 2024-09-15T22:55:03.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f0540004450 con 0x55ce01147dc0 2024-09-15T22:55:03.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0540032e20 con 0x55ce01147dc0 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0540067050 con 0x55ce01147dc0 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f0554c3a740 10 client.17547 fetch_fsmap learned FSMap version 48 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.291+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ce01160c40 con 0x55ce01147dc0 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0540032e20 con 0x55ce01147dc0 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f05400049a0 con 0x55ce01147dc0 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 10 client.17547 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 20 client.17547 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce01164380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 4 client.17547 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:03.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.292+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce010ba850 con 0x55ce01161f90 2024-09-15T22:55:03.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.293+0000 7f054bfff640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce01164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.293+0000 7f054bfff640 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce01164380 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61279cdcdab9d923 server_cookie=e96e786a81910fdd in_seq=0 out_seq=0 2024-09-15T22:55:03.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.293+0000 7f052b7fe640 10 client.17547 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.294+0000 7f052b7fe640 1 -- 172.21.15.66:0/3522057885 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce010ba850 con 0x55ce01161f90 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.294+0000 7f052b7fe640 10 client.17547 handle_command_reply: tid=0 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.294+0000 7f0554c3a740 1 client.17547 shutdown 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 msgr2=0x55ce0114f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce0114f2e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f0540031aa0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 shutdown_connections 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce01152680 0x55ce0114f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce0114f2e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce01164380 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f052b7fe640 0 client.17547 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:03.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 --2- 172.21.15.66:0/3522057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce011474a0 0x55ce01152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 >> 172.21.15.66:0/3522057885 conn(0x55ce01143a30 msgr2=0x55ce01149760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 shutdown_connections 2024-09-15T22:55:03.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 1 -- 172.21.15.66:0/3522057885 wait complete. 2024-09-15T22:55:03.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.295+0000 7f0554c3a740 20 client.17547 trim_cache size 0 max 16384 2024-09-15T22:55:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.326+0000 7f0554c3a740 1 Processor -- start 2024-09-15T22:55:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.326+0000 7f0554c3a740 1 -- start start 2024-09-15T22:55:03.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.326+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.326+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 0x55ce011673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.326+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 0x55ce011678e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f0554c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ad0a0 con 0x55ce01152680 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f0554c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1aec10 con 0x55ce01147dc0 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f0554c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ad770 con 0x55ce011474a0 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54974/0 (socket says 172.21.15.66:54974) 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054bfff640 1 -- 172.21.15.66:0/2018934651 learned_addr learned my addr 172.21.15.66:0/2018934651 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 0x55ce011673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f0550dfe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 0x55ce011678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 -- 172.21.15.66:0/2018934651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 msgr2=0x55ce0114dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 -- 172.21.15.66:0/2018934651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 msgr2=0x55ce011678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 0x55ce011678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054b7fe640 1 -- 172.21.15.66:0/2018934651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0114e290 con 0x55ce01147dc0 2024-09-15T22:55:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f054bfff640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.327+0000 7f0550dfe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 0x55ce011678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:03.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.328+0000 7f054b7fe640 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 0x55ce011673a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55ce01150890 tx=0x7f0540005600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc752339aafc5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.328+0000 7f0531ffb640 1 -- 172.21.15.66:0/2018934651 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540035070 con 0x55ce01147dc0 2024-09-15T22:55:03.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.328+0000 7f0531ffb640 1 -- 172.21.15.66:0/2018934651 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0540031bd0 con 0x55ce01147dc0 2024-09-15T22:55:03.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.328+0000 7f0531ffb640 1 -- 172.21.15.66:0/2018934651 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054005d070 con 0x55ce01147dc0 2024-09-15T22:55:03.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 -- 172.21.15.66:0/2018934651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 msgr2=0x55ce011673a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 0x55ce011673a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55ce01150890 tx=0x7f0540005600 comp rx=0 tx=0).stop 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 -- 172.21.15.66:0/2018934651 shutdown_connections 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01152680 0x55ce011678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01147dc0 0x55ce011673a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 --2- 172.21.15.66:0/2018934651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce0114dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.329+0000 7f0554c3a740 1 -- 172.21.15.66:0/2018934651 >> 172.21.15.66:0/2018934651 conn(0x55ce01143a30 msgr2=0x55ce0114a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.330+0000 7f0554c3a740 1 -- 172.21.15.66:0/2018934651 shutdown_connections 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.330+0000 7f0554c3a740 1 -- 172.21.15.66:0/2018934651 wait complete. 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.330+0000 7f0554c3a740 1 -- start start 2024-09-15T22:55:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.330+0000 7f0554c3a740 1 Processor -- start 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce01167b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce01164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01165420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ae540 con 0x55ce01147dc0 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ade40 con 0x55ce01152680 2024-09-15T22:55:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ab0e0 con 0x55ce011474a0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0554c3a740 10 client.0 _ll_register_callbacks cb 0x7f0540050070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0550dfe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f054bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce01167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0550dfe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01165420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39828/0 (socket says 172.21.15.66:39828) 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f0550dfe640 1 -- 172.21.15.66:0/995224526 learned_addr learned my addr 172.21.15.66:0/995224526 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f054b7fe640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce01164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f054bfff640 1 -- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 msgr2=0x55ce01165420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.331+0000 7f054bfff640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01165420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.332+0000 7f054bfff640 1 -- 172.21.15.66:0/995224526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 msgr2=0x55ce01164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.332+0000 7f054bfff640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce01164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.332+0000 7f054bfff640 1 -- 172.21.15.66:0/995224526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0114fbf0 con 0x55ce011474a0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.332+0000 7f054bfff640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce01167b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f053c098900 tx=0x7f053c0981d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d731d618b53287 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:03.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.332+0000 7f052b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:55:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.333+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c07e070 con 0x55ce011474a0 2024-09-15T22:55:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.333+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9591+0+0 (secure 0 0 0) 0x7f053c09a230 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.333+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0540031bd0 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.333+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f053c01c040 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 10 client.26923 fetch_fsmap learned FSMap version 48 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ce011cc7f0 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f053c0a02e0 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 48) ==== 8374+0+0 (secure 0 0 0) 0x7f053c081020 con 0x55ce011474a0 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 10 client.26923 fetch_fsmap finished waiting for FSMap version 48 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 10 client.26923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 20 client.26923 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce011cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 4 client.26923 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:55:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.334+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f0540031bd0 con 0x55ce01161f90 2024-09-15T22:55:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.335+0000 7f054b7fe640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce011cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f054b7fe640 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce011cef70 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a986d5c88062208a server_cookie=6001286ad805d901 in_seq=0 out_seq=0 2024-09-15T22:55:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f052b7fe640 10 client.26923 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f052b7fe640 1 -- 172.21.15.66:0/995224526 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x7f0540031bd0 con 0x55ce01161f90 2024-09-15T22:55:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f052b7fe640 10 client.26923 handle_command_reply: tid=0 2024-09-15T22:55:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f0554c3a740 1 client.26923 shutdown 2024-09-15T22:55:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 msgr2=0x55ce01167b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce01167b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f053c098900 tx=0x7f053c0981d0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 shutdown_connections 2024-09-15T22:55:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ce01161f90 0x55ce011cef70 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.336+0000 7f052b7fe640 0 client.26923 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce01152680 0x55ce01165420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce01147dc0 0x55ce01164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 --2- 172.21.15.66:0/995224526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ce011474a0 0x55ce01167b70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 >> 172.21.15.66:0/995224526 conn(0x55ce01143a30 msgr2=0x55ce01142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 shutdown_connections 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 1 -- 172.21.15.66:0/995224526 wait complete. 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.337+0000 7f0554c3a740 20 client.26923 trim_cache size 0 max 16384 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:03.340 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (4887 inodes in the stack)", 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: "b4c48695-77f9-4ca3-b48d-4909e7ed9efd": { 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "b4c48695-77f9-4ca3-b48d-4909e7ed9efd", 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:03.341 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 msgr2=0x7f05340a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 0x7f05340a5970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ce01144db0 tx=0x7f0544016040 comp rx=0 tx=0).stop 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 msgr2=0x7f054c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c19a620 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9f0 tx=0x7f053c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 shutdown_connections 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f05340a34b0 0x7f05340a5970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054c106a80 0x7f054c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c101420 0x7f054c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 --2- 172.21.15.66:0/2348304565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c100a80 0x7f054c19a620 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.338+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 >> 172.21.15.66:0/2348304565 conn(0x7f054c0fc7a0 msgr2=0x7f054c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.339+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 shutdown_connections 2024-09-15T22:55:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:03.339+0000 7f0552861640 1 -- 172.21.15.66:0/2348304565 wait complete. 2024-09-15T22:55:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:03 smithi184 ceph-mon[35203]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-09-15T22:55:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:03 smithi087 ceph-mon[35290]: pgmap v299: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-09-15T22:55:04.062 INFO:tasks.cephfs.filesystem:scrub status for tag:b4c48695-77f9-4ca3-b48d-4909e7ed9efd - {'path': '/', 'tag': 'b4c48695-77f9-4ca3-b48d-4909e7ed9efd', 'options': 'recursive,force'} 2024-09-15T22:55:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:04 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:04 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:04 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:04 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:04 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:04 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:04 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:04 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:04 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:05 smithi184 ceph-mon[35203]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 60 op/s 2024-09-15T22:55:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:05 smithi184 ceph-mon[35203]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:55:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:05 smithi066 ceph-mon[31185]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 60 op/s 2024-09-15T22:55:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:05 smithi066 ceph-mon[31185]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:55:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:05 smithi087 ceph-mon[35290]: pgmap v300: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 60 op/s 2024-09-15T22:55:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:05 smithi087 ceph-mon[35290]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:55:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:06.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:06.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:07 smithi184 ceph-mon[35203]: pgmap v302: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 63 KiB/s wr, 95 op/s 2024-09-15T22:55:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:07 smithi066 ceph-mon[31185]: pgmap v302: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 63 KiB/s wr, 95 op/s 2024-09-15T22:55:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:07 smithi087 ceph-mon[35290]: pgmap v302: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 63 KiB/s wr, 95 op/s 2024-09-15T22:55:07.956 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:55:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:08.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 -- 172.21.15.66:0/340717360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 msgr2=0x7f20ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:08.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 --2- 172.21.15.66:0/340717360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec10ea90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009ca0 tx=0x7f20e402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 -- 172.21.15.66:0/340717360 shutdown_connections 2024-09-15T22:55:08.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 --2- 172.21.15.66:0/340717360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec10ea90 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 --2- 172.21.15.66:0/340717360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec102790 0x7f20ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 --2- 172.21.15.66:0/340717360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec101de0 0x7f20ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 -- 172.21.15.66:0/340717360 >> 172.21.15.66:0/340717360 conn(0x7f20ec0fd8c0 msgr2=0x7f20ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 -- 172.21.15.66:0/340717360 shutdown_connections 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.865+0000 7f20f46b4640 1 -- 172.21.15.66:0/340717360 wait complete. 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.866+0000 7f20f46b4640 1 Processor -- start 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.866+0000 7f20f46b4640 1 -- start start 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 0x7f20ec198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec102790 0x7f20ec1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec111fc0 con 0x7f20ec106f10 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec111e40 con 0x7f20ec101de0 2024-09-15T22:55:08.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f46b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec112140 con 0x7f20ec102790 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59336/0 (socket says 172.21.15.66:59336) 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2450640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 0x7f20ec198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 -- 172.21.15.66:0/3793788 learned_addr learned my addr 172.21.15.66:0/3793788 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f1c4f640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec102790 0x7f20ec1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 -- 172.21.15.66:0/3793788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec102790 msgr2=0x7f20ec1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec102790 0x7f20ec1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 -- 172.21.15.66:0/3793788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 msgr2=0x7f20ec198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 0x7f20ec198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2c51640 1 -- 172.21.15.66:0/3793788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec19d330 con 0x7f20ec106f10 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.867+0000 7f20f2450640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 0x7f20ec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20f2c51640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f20e4033040 tx=0x7f20e4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4031650 con 0x7f20ec106f10 2024-09-15T22:55:08.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e40317f0 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec19d5c0 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e402fa40 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.868+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec1a4f00 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.869+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ec1021c0 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.870+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f20e402fbe0 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.871+0000 7f20e37fe640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 0x7f20d80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.871+0000 7f20f2450640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 0x7f20d80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.871+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9679+0+0 (secure 0 0 0) 0x7f20e40f1590 con 0x7f20ec106f10 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.871+0000 7f20f2450640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 0x7f20d80a58f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f20e80058c0 tx=0x7f20e800a2d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:08.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:08.874+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20e40bdc90 con 0x7f20ec106f10 2024-09-15T22:55:09.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.087+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20ec1996e0 con 0x7f20ec106f10 2024-09-15T22:55:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.088+0000 7f20e37fe640 1 -- 172.21.15.66:0/3793788 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11974 (secure 0 0 0) 0x7f20ec1996e0 con 0x7f20ec106f10 2024-09-15T22:55:09.089 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:55:09.089 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"btime":"2024-09-15T22:55:08:140078+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:55:07.663373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:55:09.089 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-09-15T22:55:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 msgr2=0x7f20d80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 0x7f20d80a58f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f20e80058c0 tx=0x7f20e800a2d0 comp rx=0 tx=0).stop 2024-09-15T22:55:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 msgr2=0x7f20ec19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f20e4033040 tx=0x7f20e4003f10 comp rx=0 tx=0).stop 2024-09-15T22:55:09.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 shutdown_connections 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f20d80a3430 0x7f20d80a58f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ec106f10 0x7f20ec19cc50 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec102790 0x7f20ec1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 --2- 172.21.15.66:0/3793788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec101de0 0x7f20ec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 >> 172.21.15.66:0/3793788 conn(0x7f20ec0fd8c0 msgr2=0x7f20ec0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 shutdown_connections 2024-09-15T22:55:09.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:09.090+0000 7f20f46b4640 1 -- 172.21.15.66:0/3793788 wait complete. 2024-09-15T22:55:09.388 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:09 smithi066 ceph-mon[31185]: pgmap v303: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 63 KiB/s wr, 143 op/s 2024-09-15T22:55:09.388 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:09 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:55:09.388 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:09 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3793788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:09 smithi184 ceph-mon[35203]: pgmap v303: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 63 KiB/s wr, 143 op/s 2024-09-15T22:55:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:09 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:55:09.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:09 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3793788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:09 smithi087 ceph-mon[35290]: pgmap v303: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 63 KiB/s wr, 143 op/s 2024-09-15T22:55:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:09 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:55:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:09 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3793788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:09.724 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 449690e5 --release --await' 2024-09-15T22:55:09.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 449690e5 --release --await 2024-09-15T22:55:09.980 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 -- 172.21.15.66:0/2289417564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc100e20 msgr2=0x7fefcc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 --2- 172.21.15.66:0/2289417564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc100e20 0x7fefcc101200 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009900 tx=0x7fefc002a480 comp rx=0 tx=0).stop 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 -- 172.21.15.66:0/2289417564 shutdown_connections 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 --2- 172.21.15.66:0/2289417564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102ef0 0x7fefcc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 --2- 172.21.15.66:0/2289417564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc102570 0x7fefcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 --2- 172.21.15.66:0/2289417564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc100e20 0x7fefcc101200 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 -- 172.21.15.66:0/2289417564 >> 172.21.15.66:0/2289417564 conn(0x7fefcc0fc7d0 msgr2=0x7fefcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 -- 172.21.15.66:0/2289417564 shutdown_connections 2024-09-15T22:55:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.448+0000 7fefd3861640 1 -- 172.21.15.66:0/2289417564 wait complete. 2024-09-15T22:55:10.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 Processor -- start 2024-09-15T22:55:10.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 -- start start 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc100e20 0x7fefcc1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 0x7fefcc1976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc110fa0 con 0x7fefcc102ef0 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc110e20 con 0x7fefcc100e20 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.449+0000 7fefd3861640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc111120 con 0x7fefcc102570 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59354/0 (socket says 172.21.15.66:59354) 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 -- 172.21.15.66:0/1184457860 learned_addr learned my addr 172.21.15.66:0/1184457860 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc100e20 0x7fefcc1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 0x7fefcc1976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 -- 172.21.15.66:0/1184457860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 msgr2=0x7fefcc1976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 0x7fefcc1976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 -- 172.21.15.66:0/1184457860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc100e20 msgr2=0x7fefcc1971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc100e20 0x7fefcc1971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 -- 172.21.15.66:0/1184457860 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc1a6a10 con 0x7fefcc102ef0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 0x7fefcc1976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd1dfe640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b970 tx=0x7fefc400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefbe7fc640 1 -- 172.21.15.66:0/1184457860 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4019070 con 0x7fefcc102ef0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefbe7fc640 1 -- 172.21.15.66:0/1184457860 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc400cb40 con 0x7fefcc102ef0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefcc1a6d00 con 0x7fefcc102ef0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefbe7fc640 1 -- 172.21.15.66:0/1184457860 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4007650 con 0x7fefcc102ef0 2024-09-15T22:55:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.450+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefcc1a7270 con 0x7fefcc102ef0 2024-09-15T22:55:10.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefbe7fc640 1 -- 172.21.15.66:0/1184457860 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fefc401c070 con 0x7fefcc102ef0 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 Processor -- start 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 -- start start 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb35440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.453+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55662ea9a620 con 0x55662eb35980 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55662ea41e50 con 0x55662eb40240 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55662ea965e0 con 0x55662eb35060 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefbe7fc640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 0x7fefb80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59360/0 (socket says 172.21.15.66:59360) 2024-09-15T22:55:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 -- 172.21.15.66:0/1272581195 learned_addr learned my addr 172.21.15.66:0/1272581195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd1dfe640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 0x7fefb80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb35440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefbe7fc640 1 -- 172.21.15.66:0/1184457860 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9679+0+0 (secure 0 0 0) 0x7fefc40cf590 con 0x7fefcc102ef0 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 -- 172.21.15.66:0/1272581195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 msgr2=0x55662eb35440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb35440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 -- 172.21.15.66:0/1272581195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 msgr2=0x55662eb42630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb42630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 -- 172.21.15.66:0/1272581195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ea32d40 con 0x55662eb35980 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb42630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.454+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009900 tx=0x7fefc0004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef0f5f87f860731 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd1dfe640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 0x7fefb80a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ccac0 tx=0x7fefc400e040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefb77fe640 1 -- 172.21.15.66:0/1272581195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0035030 con 0x55662eb35980 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefb77fe640 1 -- 172.21.15.66:0/1272581195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc0040070 con 0x55662eb35980 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefb77fe640 1 -- 172.21.15.66:0/1272581195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0031ad0 con 0x55662eb35980 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1272581195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 msgr2=0x55662eb3fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009900 tx=0x7fefc0004170 comp rx=0 tx=0).stop 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1272581195 shutdown_connections 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb42630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3fd00 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1272581195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb35440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1272581195 >> 172.21.15.66:0/1272581195 conn(0x55662eb315f0 msgr2=0x55662eb319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.455+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1272581195 shutdown_connections 2024-09-15T22:55:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1272581195 wait complete. 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 -- start start 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 Processor -- start 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb3d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb3db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55662eb42e10 con 0x55662eb35980 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55662ea22f10 con 0x55662eb40240 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55662eb42f90 con 0x55662eb35060 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.456+0000 7fefd5c3a740 10 client.0 _ll_register_callbacks cb 0x55662ea46db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59374/0 (socket says 172.21.15.66:59374) 2024-09-15T22:55:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 -- 172.21.15.66:0/2815914107 learned_addr learned my addr 172.21.15.66:0/2815914107 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb3db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb3d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 -- 172.21.15.66:0/2815914107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 msgr2=0x55662eb3d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb3d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 -- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 msgr2=0x55662eb3db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb3db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 -- 172.21.15.66:0/2815914107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662e7a9580 con 0x55662eb35980 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fefc00096c0 tx=0x7fefc0032a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f957b69375cc1309 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:10.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc004d070 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9679+0+0 (secure 0 0 0) 0x7fefc00037f0 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefc0040070 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fefc0059050 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd5c3a740 10 client.17571 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.457+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55662e873960 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc0040070 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fefc0045b10 con 0x55662eb35980 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 10 client.17571 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 10 client.17571 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 20 client.17571 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662eb4fb90 0x55662eb51f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 4 client.17571 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55662eaa7b90 con 0x55662eb4fb90 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.458+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662eb4fb90 0x55662eb51f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.459+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662eb4fb90 0x55662eb51f80 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e89a98edd8f57de1 server_cookie=369a2201a7f595e3 in_seq=0 out_seq=0 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.459+0000 7fefb4ff9640 10 client.17571 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.459+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2815914107 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55662eaa7b90 con 0x55662eb4fb90 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.459+0000 7fefb4ff9640 10 client.17571 handle_command_reply: tid=0 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 client.17571 shutdown 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 msgr2=0x55662eb3d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fefc00096c0 tx=0x7fefc0032a90 comp rx=0 tx=0).stop 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 shutdown_connections 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662eb4fb90 0x55662eb51f80 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb40240 0x55662eb3db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb35980 0x55662eb3d620 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefb4ff9640 0 client.17571 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2815914107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb3d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 >> 172.21.15.66:0/2815914107 conn(0x55662eb315f0 msgr2=0x55662eb372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 shutdown_connections 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2815914107 wait complete. 2024-09-15T22:55:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.460+0000 7fefd5c3a740 20 client.17571 trim_cache size 0 max 16384 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 Processor -- start 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 -- start start 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35060 0x55662eb3b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 0x55662eb4b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1b15e0 con 0x55662eb40240 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1b3120 con 0x55662eb35060 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1b1cb0 con 0x55662eb35980 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd0dfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd0dfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59378/0 (socket says 172.21.15.66:59378) 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd0dfc640 1 -- 172.21.15.66:0/1726656345 learned_addr learned my addr 172.21.15.66:0/1726656345 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35060 0x55662eb3b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.477+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 0x55662eb4b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 -- 172.21.15.66:0/1726656345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 msgr2=0x55662eb4b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 0x55662eb4b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 -- 172.21.15.66:0/1726656345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35060 msgr2=0x55662eb3b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35060 0x55662eb3b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 -- 172.21.15.66:0/1726656345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662eb357b0 con 0x55662eb40240 2024-09-15T22:55:10.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd15fd640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 0x55662eb4b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fefc8012550 tx=0x7fefc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31356ebd111d6f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefb6ffd640 1 -- 172.21.15.66:0/1726656345 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8004020 con 0x55662eb40240 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefb6ffd640 1 -- 172.21.15.66:0/1726656345 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc8026070 con 0x55662eb40240 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.478+0000 7fefb6ffd640 1 -- 172.21.15.66:0/1726656345 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80047a0 con 0x55662eb40240 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1726656345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 msgr2=0x55662eb3a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fefc8012550 tx=0x7fefc80046c0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1726656345 shutdown_connections 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662eb3a340 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35980 0x55662eb4b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/1726656345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35060 0x55662eb3b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1726656345 >> 172.21.15.66:0/1726656345 conn(0x55662eb315f0 msgr2=0x55662eb4b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1726656345 shutdown_connections 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- 172.21.15.66:0/1726656345 wait complete. 2024-09-15T22:55:10.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 -- start start 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.479+0000 7fefd5c3a740 1 Processor -- start 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb53620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 0x55662eb53b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1b2a50 con 0x55662eb40240 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1b2380 con 0x55662eb35980 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc1af5e0 con 0x55662eb35060 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd5c3a740 10 client.0 _ll_register_callbacks cb 0x7fefc0004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd0dfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd0dfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59386/0 (socket says 172.21.15.66:59386) 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd0dfc640 1 -- 172.21.15.66:0/2374680633 learned_addr learned my addr 172.21.15.66:0/2374680633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 0x55662eb53b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb53620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 -- 172.21.15.66:0/2374680633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 msgr2=0x55662eb53620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb53620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 -- 172.21.15.66:0/2374680633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 msgr2=0x55662ebb3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 -- 172.21.15.66:0/2374680633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662ebb3b50 con 0x55662eb35980 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefd15fd640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 0x55662eb53b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefc0045f10 tx=0x7fefc0032b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8337bbe1737cfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.480+0000 7fefb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc004d070 con 0x55662eb35980 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefc8026070 con 0x55662eb35980 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9679+0+0 (secure 0 0 0) 0x7fefc003cac0 con 0x55662eb35980 2024-09-15T22:55:10.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fefc0035050 con 0x55662eb35980 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 10 client.26960 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55662ebbaf00 con 0x55662eb35980 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc8026070 con 0x55662eb35980 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fefc0003680 con 0x55662eb35980 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 10 client.26960 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 10 client.26960 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 20 client.26960 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662ebbb480 0x55662ebbd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 4 client.26960 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "449690e5", "release": true, "await": true}] 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.481+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "449690e5", "release": true, "await": true}) -- 0x55662eb2c950 con 0x55662ebbb480 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.482+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662ebbb480 0x55662ebbd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.482+0000 7fefd0dfc640 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662ebbb480 0x55662ebbd8a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66adb50a91dc661a server_cookie=143f81dfd9d1812c in_seq=0 out_seq=0 2024-09-15T22:55:10.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:10.482+0000 7fefb4ff9640 10 client.26960 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefb4ff9640 1 -- 172.21.15.66:0/2374680633 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55662eb2c950 con 0x55662ebbb480 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefb4ff9640 10 client.26960 handle_command_reply: tid=0 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 client.26960 shutdown 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 msgr2=0x55662eb53b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 0x55662eb53b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefc0045f10 tx=0x7fefc0032b80 comp rx=0 tx=0).stop 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 shutdown_connections 2024-09-15T22:55:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55662eb40240 0x55662ebb3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55662ebbb480 0x55662ebbd8a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55662eb35980 0x55662eb53b60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 --2- 172.21.15.66:0/2374680633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55662eb35060 0x55662eb53620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefb4ff9640 0 client.26960 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.295+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 >> 172.21.15.66:0/2374680633 conn(0x55662eb315f0 msgr2=0x55662eb4ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 shutdown_connections 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd5c3a740 1 -- 172.21.15.66:0/2374680633 wait complete. 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd5c3a740 20 client.26960 trim_cache size 0 max 16384 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:11.298 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 49, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 32, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "449690e5": { 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 32, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.3, 2024-09-15T22:55:11.299 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:11.300 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 msgr2=0x7fefb80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 0x7fefb80a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ccac0 tx=0x7fefc400e040 comp rx=0 tx=0).stop 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 msgr2=0x7fefcc197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b970 tx=0x7fefc400be30 comp rx=0 tx=0).stop 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 shutdown_connections 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefb80a33b0 0x7fefb80a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefcc102ef0 0x7fefcc197c20 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefcc102570 0x7fefcc1976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 --2- 172.21.15.66:0/1184457860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefcc100e20 0x7fefcc1971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:11.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.296+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 >> 172.21.15.66:0/1184457860 conn(0x7fefcc0fc7d0 msgr2=0x7fefcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:11.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.297+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 shutdown_connections 2024-09-15T22:55:11.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:11.297+0000 7fefd3861640 1 -- 172.21.15.66:0/1184457860 wait complete. 2024-09-15T22:55:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:11 smithi184 ceph-mon[35203]: pgmap v304: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 61 KiB/s wr, 188 op/s 2024-09-15T22:55:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:11 smithi066 ceph-mon[31185]: pgmap v304: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 61 KiB/s wr, 188 op/s 2024-09-15T22:55:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:11 smithi087 ceph-mon[35290]: pgmap v304: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 61 KiB/s wr, 188 op/s 2024-09-15T22:55:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:13 smithi184 ceph-mon[35203]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 2.0 KiB/s wr, 166 op/s 2024-09-15T22:55:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:13 smithi066 ceph-mon[31185]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 2.0 KiB/s wr, 166 op/s 2024-09-15T22:55:13.521 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '449690e5', total seconds elapsed: 27.9 2024-09-15T22:55:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.35 2024-09-15T22:55:13.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:55:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:13 smithi087 ceph-mon[35290]: pgmap v305: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 2.0 KiB/s wr, 166 op/s 2024-09-15T22:55:13.783 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 -- 172.21.15.66:0/3695967491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 msgr2=0x7f0210100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 --2- 172.21.15.66:0/3695967491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f0210100ee0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0204009930 tx=0x7f020402a420 comp rx=0 tx=0).stop 2024-09-15T22:55:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 -- 172.21.15.66:0/3695967491 shutdown_connections 2024-09-15T22:55:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 --2- 172.21.15.66:0/3695967491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 0x7f021010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 --2- 172.21.15.66:0/3695967491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f0210100ee0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 --2- 172.21.15.66:0/3695967491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 0x7f0210106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 -- 172.21.15.66:0/3695967491 >> 172.21.15.66:0/3695967491 conn(0x7f02100fc7a0 msgr2=0x7f02100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 -- 172.21.15.66:0/3695967491 shutdown_connections 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.268+0000 7f0214c51640 1 -- 172.21.15.66:0/3695967491 wait complete. 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 Processor -- start 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 -- start start 2024-09-15T22:55:14.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 0x7f021019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 0x7f021019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0210111fa0 con 0x7f0210100a80 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0210111e20 con 0x7f0210106a80 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f0214c51640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0210112120 con 0x7f0210101420 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60180/0 (socket says 172.21.15.66:60180) 2024-09-15T22:55:14.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 -- 172.21.15.66:0/3896783013 learned_addr learned my addr 172.21.15.66:0/3896783013 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020dd9b640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 0x7f021019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020ed9d640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 0x7f021019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 -- 172.21.15.66:0/3896783013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 msgr2=0x7f021019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 0x7f021019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 -- 172.21.15.66:0/3896783013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 msgr2=0x7f021019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 0x7f021019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.269+0000 7f020e59c640 1 -- 172.21.15.66:0/3896783013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021019f680 con 0x7f0210100a80 2024-09-15T22:55:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f020e59c640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f020000e9f0 tx=0x7f020000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020000cd80 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021019f970 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0200010910 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000188f0 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.270+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02101a7250 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.271+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0210100ee0 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.272+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0200010ac0 con 0x7f0210100a80 2024-09-15T22:55:14.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.273+0000 7f01ff7fe640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 0x7f01f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:14.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.273+0000 7f020dd9b640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 0x7f01f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:14.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.273+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f02000d0860 con 0x7f0210100a80 2024-09-15T22:55:14.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.273+0000 7f020dd9b640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 0x7f01f80a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0204009900 tx=0x7f02040058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:14.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.276+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f020009c7c0 con 0x7f0210100a80 2024-09-15T22:55:14.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.491+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02101a7420 con 0x7f0210100a80 2024-09-15T22:55:14.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.491+0000 7f01ff7fe640 1 -- 172.21.15.66:0/3896783013 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11974 (secure 0 0 0) 0x7f02000a0ac0 con 0x7f0210100a80 2024-09-15T22:55:14.493 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:55:14.493 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"btime":"2024-09-15T22:55:08:140078+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:55:07.663373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:55:14.493 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.493+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 msgr2=0x7f01f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.493+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 0x7f01f80a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0204009900 tx=0x7f02040058d0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.493+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 msgr2=0x7f021019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.493+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f020000e9f0 tx=0x7f020000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.493+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 shutdown_connections 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01f80a33b0 0x7f01f80a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0210106a80 0x7f021019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0210101420 0x7f021019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 --2- 172.21.15.66:0/3896783013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0210100a80 0x7f021019a6d0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 >> 172.21.15.66:0/3896783013 conn(0x7f02100fc7a0 msgr2=0x7f021010c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 shutdown_connections 2024-09-15T22:55:14.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:14.494+0000 7f0214c51640 1 -- 172.21.15.66:0/3896783013 wait complete. 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: pgmap v306: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 132 op/s 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:55:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:14 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3896783013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:15.300 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 142.35 --await-for 45.0' 2024-09-15T22:55:15.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 142.35 --await-for 45.0 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: pgmap v306: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 132 op/s 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:55:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:14 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3896783013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: pgmap v306: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 2.2 KiB/s wr, 132 op/s 2024-09-15T22:55:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:55:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:55:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:55:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:55:15.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:14 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3896783013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:15.562 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:16.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.072+0000 7f98cb2a6640 1 -- 172.21.15.66:0/4118014340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 msgr2=0x7f98c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/4118014340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c410da40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009900 tx=0x7f98bc02a480 comp rx=0 tx=0).stop 2024-09-15T22:55:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 -- 172.21.15.66:0/4118014340 shutdown_connections 2024-09-15T22:55:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/4118014340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c410da40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/4118014340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4102570 0x7f98c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/4118014340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4100e20 0x7f98c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 -- 172.21.15.66:0/4118014340 >> 172.21.15.66:0/4118014340 conn(0x7f98c40fc7d0 msgr2=0x7f98c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 -- 172.21.15.66:0/4118014340 shutdown_connections 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 -- 172.21.15.66:0/4118014340 wait complete. 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 Processor -- start 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.073+0000 7f98cb2a6640 1 -- start start 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4100e20 0x7f98c40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4102570 0x7f98c40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4110f80 con 0x7f98c4102ef0 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4110e00 con 0x7f98c4100e20 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4111100 con 0x7f98c4102570 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60194/0 (socket says 172.21.15.66:60194) 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9042640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4100e20 0x7f98c40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 -- 172.21.15.66:0/240954629 learned_addr learned my addr 172.21.15.66:0/240954629 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c8841640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4102570 0x7f98c40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 -- 172.21.15.66:0/240954629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4102570 msgr2=0x7f98c40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4102570 0x7f98c40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 -- 172.21.15.66:0/240954629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4100e20 msgr2=0x7f98c40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4100e20 0x7f98c40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 -- 172.21.15.66:0/240954629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c41a6910 con 0x7f98c4102ef0 2024-09-15T22:55:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98c9843640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f98bc004770 tx=0x7f98bc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98b67fc640 1 -- 172.21.15.66:0/240954629 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc03f070 con 0x7f98c4102ef0 2024-09-15T22:55:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98b67fc640 1 -- 172.21.15.66:0/240954629 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98bc031c30 con 0x7f98c4102ef0 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c41a6ba0 con 0x7f98c4102ef0 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.074+0000 7f98b67fc640 1 -- 172.21.15.66:0/240954629 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc035030 con 0x7f98c4102ef0 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.075+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c41a70d0 con 0x7f98c4102ef0 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.077+0000 7f98b67fc640 1 -- 172.21.15.66:0/240954629 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f98bc042070 con 0x7f98c4102ef0 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.077+0000 7f98cd67f740 1 Processor -- start 2024-09-15T22:55:16.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.077+0000 7f98cd67f740 1 -- start start 2024-09-15T22:55:16.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fcce211160 con 0x55fcce2ad170 2024-09-15T22:55:16.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fcce1b8720 con 0x55fcce2b7a30 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98cd67f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fcce20d120 con 0x55fcce2ac850 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98b67fc640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 0x7f98b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60196/0 (socket says 172.21.15.66:60196) 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 -- 172.21.15.66:0/1984928890 learned_addr learned my addr 172.21.15.66:0/1984928890 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:16.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9843640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 0x7f98b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c8841640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c8841640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98b67fc640 1 -- 172.21.15.66:0/240954629 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f98bc0f08c0 con 0x7f98c4102ef0 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 -- 172.21.15.66:0/1984928890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 msgr2=0x55fcce2acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 -- 172.21.15.66:0/1984928890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 msgr2=0x55fcce2b9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2b9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 -- 172.21.15.66:0/1984928890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fccdf82ba0 con 0x55fcce2ad170 2024-09-15T22:55:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c8841640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9042640 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f98c0003a20 tx=0x7f98c0003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac81f0bcdbc30bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.078+0000 7f98c9843640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 0x7f98b00a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0edc90 tx=0x7f98bc02a480 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98af7fe640 1 -- 172.21.15.66:0/1984928890 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0004860 con 0x55fcce2ad170 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98af7fe640 1 -- 172.21.15.66:0/1984928890 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c0015030 con 0x55fcce2ad170 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98af7fe640 1 -- 172.21.15.66:0/1984928890 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c00109d0 con 0x55fcce2ad170 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 -- 172.21.15.66:0/1984928890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 msgr2=0x55fcce2b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f98c0003a20 tx=0x7f98c0003ee0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 -- 172.21.15.66:0/1984928890 shutdown_connections 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2b9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b74f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1984928890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 -- 172.21.15.66:0/1984928890 >> 172.21.15.66:0/1984928890 conn(0x55fcce2a8de0 msgr2=0x55fcce2a91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 -- 172.21.15.66:0/1984928890 shutdown_connections 2024-09-15T22:55:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.079+0000 7f98cd67f740 1 -- 172.21.15.66:0/1984928890 wait complete. 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.080+0000 7f98cd67f740 1 -- start start 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.080+0000 7f98cd67f740 1 Processor -- start 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.080+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.080+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60198/0 (socket says 172.21.15.66:60198) 2024-09-15T22:55:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 -- 172.21.15.66:0/4142598466 learned_addr learned my addr 172.21.15.66:0/4142598466 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fcce2ba600 con 0x55fcce2ad170 2024-09-15T22:55:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fcce199900 con 0x55fcce2ac850 2024-09-15T22:55:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fcce2ba780 con 0x55fcce2b7a30 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 -- 172.21.15.66:0/4142598466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 msgr2=0x55fcce2b5320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 10 client.0 _ll_register_callbacks cb 0x55fcce197780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 -- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 msgr2=0x55fcce2b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcce1d9c50 con 0x55fcce2ad170 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c0015030 con 0x55fcce2ad170 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98c9042640 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f98c0010590 tx=0x7f98c0024ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a224a42b9e9c6a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.081+0000 7f98acff9640 10 client.17595 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98acff9640 1 -- 172.21.15.66:0/4142598466 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0032060 con 0x55fcce2ad170 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98acff9640 1 -- 172.21.15.66:0/4142598466 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f98c0024bd0 con 0x55fcce2ad170 2024-09-15T22:55:16.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98acff9640 1 -- 172.21.15.66:0/4142598466 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f98c0004860 con 0x55fcce2ad170 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 10 client.17595 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=49}) -- 0x55fcce2c61c0 con 0x55fcce2ad170 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98acff9640 1 -- 172.21.15.66:0/4142598466 <== mon.0 v2:172.21.15.66:3300/0 4 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f98c0004a40 con 0x55fcce2ad170 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 10 client.17595 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 10 client.17595 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 20 client.17595 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:16.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce2c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 4 client.17595 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcce21e890 con 0x55fcce2c7570 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.082+0000 7f98c8841640 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce2c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.083+0000 7f98acff9640 10 client.17595 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.083+0000 7f98c8841640 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce2c9960 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcff55eb8ac9cbc0 server_cookie=6be01cd4dd8b0b78 in_seq=0 out_seq=0 2024-09-15T22:55:16.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.083+0000 7f98acff9640 1 -- 172.21.15.66:0/4142598466 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcce21e890 con 0x55fcce2c7570 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98acff9640 10 client.17595 handle_command_reply: tid=0 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 client.17595 shutdown 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 msgr2=0x55fcce2b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f98c0010590 tx=0x7f98c0024ae0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 shutdown_connections 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b4de0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce2c9960 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 --2- 172.21.15.66:0/4142598466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98acff9640 0 client.17595 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:16.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 >> 172.21.15.66:0/4142598466 conn(0x55fcce2a8de0 msgr2=0x55fcce2aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:16.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 shutdown_connections 2024-09-15T22:55:16.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 1 -- 172.21.15.66:0/4142598466 wait complete. 2024-09-15T22:55:16.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.084+0000 7f98cd67f740 20 client.17595 trim_cache size 0 max 16384 2024-09-15T22:55:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 Processor -- start 2024-09-15T22:55:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 -- start start 2024-09-15T22:55:16.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41ad040 con 0x55fcce2ad170 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41aeb80 con 0x55fcce2b7a30 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98cd67f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41ad710 con 0x55fcce2ac850 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60204/0 (socket says 172.21.15.66:60204) 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.101+0000 7f98c9042640 1 -- 172.21.15.66:0/2920071896 learned_addr learned my addr 172.21.15.66:0/2920071896 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c8841640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c8841640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 -- 172.21.15.66:0/2920071896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 msgr2=0x55fcce2af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 -- 172.21.15.66:0/2920071896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 msgr2=0x55fcce2a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 -- 172.21.15.66:0/2920071896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcce2acfa0 con 0x55fcce2ad170 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c8841640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98c9042640 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f98c0010560 tx=0x7f98c0029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b211f54ea9bad809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98aeffd640 1 -- 172.21.15.66:0/2920071896 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c00044d0 con 0x55fcce2ad170 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98aeffd640 1 -- 172.21.15.66:0/2920071896 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c0015030 con 0x55fcce2ad170 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.102+0000 7f98aeffd640 1 -- 172.21.15.66:0/2920071896 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0010be0 con 0x55fcce2ad170 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- 172.21.15.66:0/2920071896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 msgr2=0x55fcce2b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f98c0010560 tx=0x7f98c0029000 comp rx=0 tx=0).stop 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- 172.21.15.66:0/2920071896 shutdown_connections 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2b7a30 0x55fcce2a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2b6770 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 --2- 172.21.15.66:0/2920071896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2ac850 0x55fcce2af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- 172.21.15.66:0/2920071896 >> 172.21.15.66:0/2920071896 conn(0x55fcce2a8de0 msgr2=0x55fcce2b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- 172.21.15.66:0/2920071896 shutdown_connections 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- 172.21.15.66:0/2920071896 wait complete. 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 -- start start 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.103+0000 7f98cd67f740 1 Processor -- start 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41ae4b0 con 0x55fcce2ad170 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41adde0 con 0x55fcce2ac850 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98c41ab040 con 0x55fcce2b7a30 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98cd67f740 10 client.0 _ll_register_callbacks cb 0x7f98b800c930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:16.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60220/0 (socket says 172.21.15.66:60220) 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 -- 172.21.15.66:0/1594458714 learned_addr learned my addr 172.21.15.66:0/1594458714 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c8841640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c8841640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 -- 172.21.15.66:0/1594458714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 msgr2=0x55fcce2bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 -- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 msgr2=0x55fcce2c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 -- 172.21.15.66:0/1594458714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcce2bc3b0 con 0x55fcce2ad170 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c8841640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98c9042640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f98c0002230 tx=0x7f98c0004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dc605216fe25c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.104+0000 7f98acff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0024dd0 con 0x55fcce2ad170 2024-09-15T22:55:16.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98c0015030 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f98c002a040 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f98c0005bd0 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 10 client.17601 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55fcce331fb0 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c0015030 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f98c0011c80 con 0x55fcce2ad170 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 10 client.17601 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 10 client.17601 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 20 client.17601 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce3347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 4 client.17601 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.35, "await_for": 45.0}] 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.105+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.35, "await_for": 45.0}) -- 0x55fcce218be0 con 0x55fcce2c7570 2024-09-15T22:55:16.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.106+0000 7f98c8841640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce3347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.106+0000 7f98c8841640 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce3347e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b0a16485a56f87 server_cookie=b92527af880f1255 in_seq=0 out_seq=0 2024-09-15T22:55:16.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:16.106+0000 7f98acff9640 10 client.17601 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:15 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:55:16.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:15 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:55:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:15 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:55:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:15 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:55:16.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:15 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:55:16.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:15 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:55:17.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:16 smithi087 ceph-mon[35290]: pgmap v308: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 104 op/s 2024-09-15T22:55:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:16 smithi184 ceph-mon[35203]: pgmap v308: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 104 op/s 2024-09-15T22:55:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:16 smithi066 ceph-mon[31185]: pgmap v308: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 104 op/s 2024-09-15T22:55:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:18 smithi087 ceph-mon[35290]: pgmap v309: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 KiB/s wr, 56 op/s 2024-09-15T22:55:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:18 smithi184 ceph-mon[35203]: pgmap v309: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 KiB/s wr, 56 op/s 2024-09-15T22:55:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:18 smithi066 ceph-mon[31185]: pgmap v309: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.1 KiB/s wr, 56 op/s 2024-09-15T22:55:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:20 smithi087 ceph-mon[35290]: pgmap v310: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-15T22:55:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:20 smithi184 ceph-mon[35203]: pgmap v310: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-15T22:55:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:20 smithi066 ceph-mon[31185]: pgmap v310: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-15T22:55:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:22 smithi087 ceph-mon[35290]: pgmap v311: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-15T22:55:23.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98acff9640 1 -- 172.21.15.66:0/1594458714 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fcce218be0 con 0x55fcce2c7570 2024-09-15T22:55:23.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98acff9640 10 client.17601 handle_command_reply: tid=0 2024-09-15T22:55:23.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 client.17601 shutdown 2024-09-15T22:55:23.377 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:22 smithi066 ceph-mon[31185]: pgmap v311: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-15T22:55:23.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 msgr2=0x55fcce2bb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:23.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f98c0002230 tx=0x7f98c0004a00 comp rx=0 tx=0).stop 2024-09-15T22:55:23.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 shutdown_connections 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fcce2b7a30 0x55fcce2bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fcce2ad170 0x55fcce2bb5b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fcce2c7570 0x55fcce3347e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 --2- 172.21.15.66:0/1594458714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fcce2ac850 0x55fcce2c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 >> 172.21.15.66:0/1594458714 conn(0x55fcce2a8de0 msgr2=0x55fcce2b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.375+0000 7f98acff9640 0 client.17601 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.376+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 shutdown_connections 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.376+0000 7f98cd67f740 1 -- 172.21.15.66:0/1594458714 wait complete. 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.376+0000 7f98cd67f740 20 client.17601 trim_cache size 0 max 16384 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:23.378 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 49, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 34, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "fd46570b": { 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 34, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.3, 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:55:23.379 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:23.380 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 msgr2=0x7f98b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 0x7f98b00a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0edc90 tx=0x7f98bc02a480 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 msgr2=0x7f98c40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f98bc004770 tx=0x7f98bc003c10 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 shutdown_connections 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98b00a3430 0x7f98b00a58f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98c4102ef0 0x7f98c40fd700 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98c4102570 0x7f98c40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 --2- 172.21.15.66:0/240954629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98c4100e20 0x7f98c40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:23.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 >> 172.21.15.66:0/240954629 conn(0x7f98c40fc7d0 msgr2=0x7f98c406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:23.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 shutdown_connections 2024-09-15T22:55:23.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:23.377+0000 7f98cb2a6640 1 -- 172.21.15.66:0/240954629 wait complete. 2024-09-15T22:55:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:22 smithi184 ceph-mon[35203]: pgmap v311: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-15T22:55:24.350 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd46570b', quiesce took 10.8 seconds. Will release after: 11.55 2024-09-15T22:55:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:24 smithi087 ceph-mon[35290]: pgmap v312: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-15T22:55:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:24 smithi184 ceph-mon[35203]: pgmap v312: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-15T22:55:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:24 smithi066 ceph-mon[31185]: pgmap v312: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-15T22:55:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:26 smithi087 ceph-mon[35290]: pgmap v313: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-15T22:55:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:26 smithi184 ceph-mon[35203]: pgmap v313: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-15T22:55:27.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:26 smithi066 ceph-mon[31185]: pgmap v313: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-15T22:55:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:28 smithi087 ceph-mon[35290]: pgmap v314: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-15T22:55:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:28 smithi184 ceph-mon[35203]: pgmap v314: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-15T22:55:29.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:28 smithi066 ceph-mon[31185]: pgmap v314: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-15T22:55:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:31 smithi087 ceph-mon[35290]: pgmap v315: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-15T22:55:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:31 smithi184 ceph-mon[35203]: pgmap v315: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-15T22:55:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:31 smithi066 ceph-mon[31185]: pgmap v315: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-15T22:55:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:33 smithi087 ceph-mon[35290]: pgmap v316: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-15T22:55:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:33 smithi184 ceph-mon[35203]: pgmap v316: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-15T22:55:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:33 smithi066 ceph-mon[31185]: pgmap v316: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-15T22:55:34.063 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:55:34.334 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:34.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- 172.21.15.66:0/1578801556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 msgr2=0x7f3c901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/1578801556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c901029b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009900 tx=0x7f3c8002a480 comp rx=0 tx=0).stop 2024-09-15T22:55:34.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- 172.21.15.66:0/1578801556 shutdown_connections 2024-09-15T22:55:34.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/1578801556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 0x7f3c9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/1578801556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c901029b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/1578801556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 0x7f3c90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- 172.21.15.66:0/1578801556 >> 172.21.15.66:0/1578801556 conn(0x7f3c900fc7d0 msgr2=0x7f3c900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- 172.21.15.66:0/1578801556 shutdown_connections 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- 172.21.15.66:0/1578801556 wait complete. 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 Processor -- start 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.959+0000 7f3c95fb6640 1 -- start start 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 0x7f3c90199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 0x7f3c901a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c90110f80 con 0x7f3c90102570 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3c90110e00 con 0x7f3c90100e20 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c95fb6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c90111100 con 0x7f3c90102ef0 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54938/0 (socket says 172.21.15.66:54938) 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 -- 172.21.15.66:0/3918997208 learned_addr learned my addr 172.21.15.66:0/3918997208 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 0x7f3c901a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 0x7f3c90199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 -- 172.21.15.66:0/3918997208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 msgr2=0x7f3c901a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 0x7f3c901a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 -- 172.21.15.66:0/3918997208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 msgr2=0x7f3c90199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 0x7f3c90199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 -- 172.21.15.66:0/3918997208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c901a4910 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.960+0000 7f3c8effd640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3c80006010 tx=0x7f3c80003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.961+0000 7f3c8cff9640 1 -- 172.21.15.66:0/3918997208 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8003f070 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.961+0000 7f3c8cff9640 1 -- 172.21.15.66:0/3918997208 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c80031c30 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.961+0000 7f3c8cff9640 1 -- 172.21.15.66:0/3918997208 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80035030 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.961+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c901a4ae0 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.961+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c901a4f30 con 0x7f3c90102570 2024-09-15T22:55:34.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c8cff9640 1 -- 172.21.15.66:0/3918997208 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3c80042070 con 0x7f3c90102570 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 Processor -- start 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 -- start start 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a2e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a39140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5819942e0 con 0x55e581a39680 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e58193bce0 con 0x55e581a2edc0 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.963+0000 7f3c9838f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5819902a0 con 0x55e581a2e4a0 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a39140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54942/0 (socket says 172.21.15.66:54942) 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 -- 172.21.15.66:0/16322888 learned_addr learned my addr 172.21.15.66:0/16322888 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8cff9640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 0x7f3c7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 -- 172.21.15.66:0/16322888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 msgr2=0x55e581a2e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a2e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 -- 172.21.15.66:0/16322888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 msgr2=0x55e581a39140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a39140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 -- 172.21.15.66:0/16322888 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e581920440 con 0x55e581a39680 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a2e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 0x7f3c7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8cff9640 1 -- 172.21.15.66:0/3918997208 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f3c800f0900 con 0x7f3c90102570 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c8effd640 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3c800edb90 tx=0x7f3c8004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9924a45004e9914 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 0x7f3c7c0a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005fd0 tx=0x7f3c88004a40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.964+0000 7f3c85ffb640 1 -- 172.21.15.66:0/16322888 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80049020 con 0x55e581a39680 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c85ffb640 1 -- 172.21.15.66:0/16322888 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c80031de0 con 0x55e581a39680 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c85ffb640 1 -- 172.21.15.66:0/16322888 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c800c0b60 con 0x55e581a39680 2024-09-15T22:55:34.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 -- 172.21.15.66:0/16322888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 msgr2=0x55e581a3ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3c800edb90 tx=0x7f3c8004b000 comp rx=0 tx=0).stop 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 -- 172.21.15.66:0/16322888 shutdown_connections 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a3ba70 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a39140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 --2- 172.21.15.66:0/16322888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a2e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 -- 172.21.15.66:0/16322888 >> 172.21.15.66:0/16322888 conn(0x55e581a2aa30 msgr2=0x55e581a2ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 -- 172.21.15.66:0/16322888 shutdown_connections 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.965+0000 7f3c9838f740 1 -- 172.21.15.66:0/16322888 wait complete. 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 -- start start 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 Processor -- start 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a38f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e581a3c010 con 0x55e581a39680 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e58194f050 con 0x55e581a2edc0 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e581a3c190 con 0x55e581a2e4a0 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c9838f740 10 client.0 _ll_register_callbacks cb 0x55e58198f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54952/0 (socket says 172.21.15.66:54952) 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c8ffff640 1 -- 172.21.15.66:0/480014691 learned_addr learned my addr 172.21.15.66:0/480014691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.966+0000 7f3c8effd640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 -- 172.21.15.66:0/480014691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 msgr2=0x55e581a38f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a38f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 -- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 msgr2=0x55e581a361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 -- 172.21.15.66:0/480014691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5817053c0 con 0x55e581a39680 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a38f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009ed0 tx=0x7f3c88004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568b547f50850aba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c6effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8801ed70 con 0x55e581a39680 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f3c88028470 con 0x55e581a39680 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c80031de0 con 0x55e581a39680 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c88013e50 con 0x55e581a39680 2024-09-15T22:55:34.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c9838f740 10 client.17613 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e581a47940 con 0x55e581a39680 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.967+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c80031de0 con 0x55e581a39680 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f3c8800f040 con 0x55e581a39680 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 10 client.17613 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 20 client.17613 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581a48e00 0x55e581a4b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 4 client.17613 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5819a1850 con 0x55e581a48e00 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581a48e00 0x55e581a4b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c6effd640 10 client.17613 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.968+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581a48e00 0x55e581a4b1f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4bb455692b9b9f server_cookie=fe3ea05f8a2f52ae in_seq=0 out_seq=0 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.969+0000 7f3c6effd640 1 -- 172.21.15.66:0/480014691 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5819a1850 con 0x55e581a48e00 2024-09-15T22:55:34.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.969+0000 7f3c6effd640 10 client.17613 handle_command_reply: tid=0 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.969+0000 7f3c9838f740 1 client.17613 shutdown 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.969+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 msgr2=0x55e581a366f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.969+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009ed0 tx=0x7f3c88004ab0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 shutdown_connections 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a366f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581a48e00 0x55e581a4b1f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 --2- 172.21.15.66:0/480014691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a38f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c6effd640 0 client.17613 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 >> 172.21.15.66:0/480014691 conn(0x55e581a2aa30 msgr2=0x55e581a30760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:34.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 shutdown_connections 2024-09-15T22:55:34.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 1 -- 172.21.15.66:0/480014691 wait complete. 2024-09-15T22:55:34.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.970+0000 7f3c9838f740 20 client.17613 trim_cache size 0 max 16384 2024-09-15T22:55:34.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 Processor -- start 2024-09-15T22:55:34.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 -- start start 2024-09-15T22:55:34.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a451e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901af210 con 0x55e581a39680 2024-09-15T22:55:34.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901b0d50 con 0x55e581a2edc0 2024-09-15T22:55:34.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c9838f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901af8e0 con 0x55e581a2e4a0 2024-09-15T22:55:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.987+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54958/0 (socket says 172.21.15.66:54958) 2024-09-15T22:55:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 -- 172.21.15.66:0/3067755833 learned_addr learned my addr 172.21.15.66:0/3067755833 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8effd640 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 -- 172.21.15.66:0/3067755833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 msgr2=0x55e581a451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 -- 172.21.15.66:0/3067755833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 msgr2=0x55e581a318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 -- 172.21.15.66:0/3067755833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e581a35160 con 0x55e581a39680 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c88012d50 tx=0x7f3c88009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acc691918e03414 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c857fa640 1 -- 172.21.15.66:0/3067755833 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88039070 con 0x55e581a39680 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c857fa640 1 -- 172.21.15.66:0/3067755833 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c88013e50 con 0x55e581a39680 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.988+0000 7f3c857fa640 1 -- 172.21.15.66:0/3067755833 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88035450 con 0x55e581a39680 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- 172.21.15.66:0/3067755833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 msgr2=0x55e581a38120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c88012d50 tx=0x7f3c88009770 comp rx=0 tx=0).stop 2024-09-15T22:55:34.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- 172.21.15.66:0/3067755833 shutdown_connections 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581a38120 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2edc0 0x55e581a318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 --2- 172.21.15.66:0/3067755833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2e4a0 0x55e581a451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- 172.21.15.66:0/3067755833 >> 172.21.15.66:0/3067755833 conn(0x55e581a2aa30 msgr2=0x55e581a37a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- 172.21.15.66:0/3067755833 shutdown_connections 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- 172.21.15.66:0/3067755833 wait complete. 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.989+0000 7f3c9838f740 1 -- start start 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 Processor -- start 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 0x55e581a3d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 0x55e581a3d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901b0680 con 0x55e581a39680 2024-09-15T22:55:34.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901affb0 con 0x55e581a2e4a0 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c901ad210 con 0x55e581a2edc0 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c9838f740 10 client.0 _ll_register_callbacks cb 0x7f3c88005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54964/0 (socket says 172.21.15.66:54964) 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 -- 172.21.15.66:0/688097341 learned_addr learned my addr 172.21.15.66:0/688097341 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 0x55e581a3d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8effd640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 0x55e581a3d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 -- 172.21.15.66:0/688097341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 msgr2=0x55e581a3d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 0x55e581a3d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 -- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 msgr2=0x55e581a3d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.990+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 0x55e581a3d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c8ffff640 1 -- 172.21.15.66:0/688097341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e581a3e260 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c8effd640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 0x55e581a3d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 0x55e581a3d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c8ffff640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c88012ed0 tx=0x7f3c8801f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bf4056693541cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c6effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88042070 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f3c88028680 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c88013e50 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c88039040 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c9838f740 10 client.17619 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e581ab40a0 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.991+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c88013e50 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f3c88035450 con 0x55e581a39680 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 10 client.17619 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 20 client.17619 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581ab46b0 0x55e581ab6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 4 client.17619 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e58199bd60 con 0x55e581ab46b0 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581ab46b0 0x55e581ab6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c8f7fe640 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581ab46b0 0x55e581ab6aa0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d66fc8312fd5cdc server_cookie=4f847530c4434b54 in_seq=0 out_seq=0 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.992+0000 7f3c6effd640 10 client.17619 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c6effd640 1 -- 172.21.15.66:0/688097341 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e58199bd60 con 0x55e581ab46b0 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c6effd640 10 client.17619 handle_command_reply: tid=0 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 client.17619 shutdown 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 msgr2=0x55e581ab2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c88012ed0 tx=0x7f3c8801f680 comp rx=0 tx=0).stop 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 shutdown_connections 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e581a39680 0x55e581ab2a70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e581a2edc0 0x55e581a3d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e581ab46b0 0x55e581ab6aa0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 --2- 172.21.15.66:0/688097341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e581a2e4a0 0x55e581a3d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 >> 172.21.15.66:0/688097341 conn(0x55e581a2aa30 msgr2=0x55e581a29370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c6effd640 0 client.17619 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 shutdown_connections 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 1 -- 172.21.15.66:0/688097341 wait complete. 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.993+0000 7f3c9838f740 20 client.17619 trim_cache size 0 max 16384 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:55:35.000 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:35.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 msgr2=0x7f3c7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:35.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 0x7f3c7c0a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005fd0 tx=0x7f3c88004a40 comp rx=0 tx=0).stop 2024-09-15T22:55:35.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 msgr2=0x7f3c90199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:35.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3c80006010 tx=0x7f3c80003c10 comp rx=0 tx=0).stop 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 shutdown_connections 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3c7c0a33b0 0x7f3c7c0a5870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c90102ef0 0x7f3c901a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c90102570 0x7f3c90199890 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 --2- 172.21.15.66:0/3918997208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c90100e20 0x7f3c90199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 >> 172.21.15.66:0/3918997208 conn(0x7f3c900fc7d0 msgr2=0x7f3c901068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 shutdown_connections 2024-09-15T22:55:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:34.994+0000 7f3c95fb6640 1 -- 172.21.15.66:0/3918997208 wait complete. 2024-09-15T22:55:35.346 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:35 smithi066 ceph-mon[31185]: pgmap v317: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-15T22:55:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:35 smithi087 ceph-mon[35290]: pgmap v317: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-15T22:55:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:35 smithi184 ceph-mon[35203]: pgmap v317: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2024-09-15T22:55:35.687 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:55:35.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:55:35.901 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:55:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:36.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/3418134821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58103720 msgr2=0x7f7d5810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:36.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/3418134821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58103720 0x7f7d5810bc10 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009900 tx=0x7f7d4802a480 comp rx=0 tx=0).stop 2024-09-15T22:55:36.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/3418134821 shutdown_connections 2024-09-15T22:55:36.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/3418134821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/3418134821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58103720 0x7f7d5810bc10 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/3418134821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58102e00 0x7f7d581031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/3418134821 >> 172.21.15.66:0/3418134821 conn(0x7f7d580fc7a0 msgr2=0x7f7d580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/3418134821 shutdown_connections 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.465+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/3418134821 wait complete. 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 Processor -- start 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 -- start start 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58103720 0x7f7d58198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58111f70 con 0x7f7d58102e00 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58111df0 con 0x7f7d58103720 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5f8bc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581120f0 con 0x7f7d5810c1a0 2024-09-15T22:55:36.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54980/0 (socket says 172.21.15.66:54980) 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 -- 172.21.15.66:0/1418420176 learned_addr learned my addr 172.21.15.66:0/1418420176 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5ce57640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58103720 0x7f7d58198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5de59640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 -- 172.21.15.66:0/1418420176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 msgr2=0x7f7d5819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 -- 172.21.15.66:0/1418420176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58103720 msgr2=0x7f7d58198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58103720 0x7f7d58198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5d658640 1 -- 172.21.15.66:0/1418420176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5819d380 con 0x7f7d58102e00 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.466+0000 7f7d5de59640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d5d658640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54017070 con 0x7f7d58102e00 2024-09-15T22:55:36.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d54009c30 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5819d670 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400f6b0 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.467+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581a4f50 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.468+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d581031e0 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.469+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7d540109d0 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.470+0000 7f7d4e7fc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 0x7f7d440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.470+0000 7f7d5ce57640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 0x7f7d440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.470+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f7d540cfd90 con 0x7f7d58102e00 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.470+0000 7f7d5ce57640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 0x7f7d440a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d5810d6b0 tx=0x7f7d48005a20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:36.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.474+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d54009de0 con 0x7f7d58102e00 2024-09-15T22:55:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:36.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.704+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d58199730 con 0x7f7d58102e00 2024-09-15T22:55:36.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.705+0000 7f7d4e7fc640 1 -- 172.21.15.66:0/1418420176 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11974 (secure 0 0 0) 0x7f7d5409c340 con 0x7f7d58102e00 2024-09-15T22:55:36.707 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:55:36.707 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"btime":"2024-09-15T22:55:08:140078+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:55:07.663373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:55:36.708 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 msgr2=0x7f7d440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 0x7f7d440a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d5810d6b0 tx=0x7f7d48005a20 comp rx=0 tx=0).stop 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 msgr2=0x7f7d581983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400d950 tx=0x7f7d5400de10 comp rx=0 tx=0).stop 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 shutdown_connections 2024-09-15T22:55:36.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7d440a3430 0x7f7d440a58f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d5810c1a0 0x7f7d5819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d58103720 0x7f7d58198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 --2- 172.21.15.66:0/1418420176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d58102e00 0x7f7d581983d0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 >> 172.21.15.66:0/1418420176 conn(0x7f7d580fc7a0 msgr2=0x7f7d580fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 shutdown_connections 2024-09-15T22:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:36.707+0000 7f7d5f8bc640 1 -- 172.21.15.66:0/1418420176 wait complete. 2024-09-15T22:55:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:37 smithi087 ceph-mon[35290]: pgmap v318: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:55:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:37 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1418420176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:37 smithi184 ceph-mon[35203]: pgmap v318: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:55:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:37 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1418420176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:37 smithi066 ceph-mon[31185]: pgmap v318: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-15T22:55:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:37 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1418420176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:37.534 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 -- 172.21.15.66:0/2323372042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 msgr2=0x7f72b010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 --2- 172.21.15.66:0/2323372042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b010ec40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009cd0 tx=0x7f72a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 -- 172.21.15.66:0/2323372042 shutdown_connections 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 --2- 172.21.15.66:0/2323372042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b010ec40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 --2- 172.21.15.66:0/2323372042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 0x7f72b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 --2- 172.21.15.66:0/2323372042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 -- 172.21.15.66:0/2323372042 >> 172.21.15.66:0/2323372042 conn(0x7f72b00fc7d0 msgr2=0x7f72b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 -- 172.21.15.66:0/2323372042 shutdown_connections 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.753+0000 7f72b853c640 1 -- 172.21.15.66:0/2323372042 wait complete. 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.754+0000 7f72b853c640 1 Processor -- start 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.754+0000 7f72b853c640 1 -- start start 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 0x7f72b0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01120a0 con 0x7f72b01082a0 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0111f20 con 0x7f72b01036e0 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b853c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0112220 con 0x7f72b0102d30 2024-09-15T22:55:37.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55010/0 (socket says 172.21.15.66:55010) 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 -- 172.21.15.66:0/182761644 learned_addr learned my addr 172.21.15.66:0/182761644 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b62d8640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b5ad7640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 0x7f72b0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 -- 172.21.15.66:0/182761644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 msgr2=0x7f72b01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 -- 172.21.15.66:0/182761644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 msgr2=0x7f72b0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 0x7f72b0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 -- 172.21.15.66:0/182761644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b019d4a0 con 0x7f72b01082a0 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b62d8640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:37.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.755+0000 7f72b6ad9640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005cc0 tx=0x7f72a0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.756+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0004040 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.756+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b019d730 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.756+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a00046c0 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.756+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0046480 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.756+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b01a5070 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.757+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0103110 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.758+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f72a00305a0 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.759+0000 7f72af7fe640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 0x7f72980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.759+0000 7f72b62d8640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 0x7f72980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.759+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f72a002e030 con 0x7f72b01082a0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.759+0000 7f72b62d8640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 0x7f72980a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:37.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.763+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72a004b060 con 0x7f72b01082a0 2024-09-15T22:55:37.856 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:37.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.982+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72b010a2b0 con 0x7f72b01082a0 2024-09-15T22:55:37.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.983+0000 7f72af7fe640 1 -- 172.21.15.66:0/182761644 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11974 (secure 0 0 0) 0x7f72a0039380 con 0x7f72b01082a0 2024-09-15T22:55:37.985 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:55:37.986 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"btime":"2024-09-15T22:55:08:140078+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:55:07.663373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:55:37.986 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-09-15T22:55:37.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 msgr2=0x7f72980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 0x7f72980a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8005850 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 msgr2=0x7f72b019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005cc0 tx=0x7f72a0003970 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 shutdown_connections 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72980a33b0 0x7f72980a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b01082a0 0x7f72b019cdc0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72b01036e0 0x7f72b0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 --2- 172.21.15.66:0/182761644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72b0102d30 0x7f72b01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 >> 172.21.15.66:0/182761644 conn(0x7f72b00fc7d0 msgr2=0x7f72b0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 shutdown_connections 2024-09-15T22:55:37.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:37.985+0000 7f72b853c640 1 -- 172.21.15.66:0/182761644 wait complete. 2024-09-15T22:55:38.278 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/182761644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:38.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/182761644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:38.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/182761644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:55:38.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id fd46570b --release --await' 2024-09-15T22:55:38.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id fd46570b --release --await 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- 172.21.15.66:0/452037319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100e30 msgr2=0x7f6fac104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 --2- 172.21.15.66:0/452037319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100e30 0x7f6fac104e80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009900 tx=0x7f6f9c02a410 comp rx=0 tx=0).stop 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- 172.21.15.66:0/452037319 shutdown_connections 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 --2- 172.21.15.66:0/452037319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac1055b0 0x7f6fac10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 --2- 172.21.15.66:0/452037319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100e30 0x7f6fac104e80 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 --2- 172.21.15.66:0/452037319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac100480 0x7f6fac100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- 172.21.15.66:0/452037319 >> 172.21.15.66:0/452037319 conn(0x7f6fac077210 msgr2=0x7f6fac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- 172.21.15.66:0/452037319 shutdown_connections 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- 172.21.15.66:0/452037319 wait complete. 2024-09-15T22:55:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 Processor -- start 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.906+0000 7f6fb426c640 1 -- start start 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac100e30 0x7f6fac19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac1055b0 0x7f6fac19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac10fd90 con 0x7f6fac100480 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac10fc10 con 0x7f6fac100e30 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb426c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac10ff10 con 0x7f6fac1055b0 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55028/0 (socket says 172.21.15.66:55028) 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 -- 172.21.15.66:0/620939327 learned_addr learned my addr 172.21.15.66:0/620939327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb1807640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac100e30 0x7f6fac19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2809640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac1055b0 0x7f6fac19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 -- 172.21.15.66:0/620939327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac1055b0 msgr2=0x7f6fac19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac1055b0 0x7f6fac19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 -- 172.21.15.66:0/620939327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac100e30 msgr2=0x7f6fac19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac100e30 0x7f6fac19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.907+0000 7f6fb2008640 1 -- 172.21.15.66:0/620939327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fac19f600 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fb2008640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800de30 tx=0x7f6fa800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fa37fe640 1 -- 172.21.15.66:0/620939327 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8004d20 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fa37fe640 1 -- 172.21.15.66:0/620939327 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa800eb40 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fac19f8f0 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fa37fe640 1 -- 172.21.15.66:0/620939327 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8005760 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.908+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fac1a71d0 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.910+0000 7f6fa37fe640 1 -- 172.21.15.66:0/620939327 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6fa800e660 con 0x7f6fac100480 2024-09-15T22:55:38.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fa37fe640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 0x7f6f980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 Processor -- start 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb1807640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 0x7f6f980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fa37fe640 1 -- 172.21.15.66:0/620939327 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f6fa80d0640 con 0x7f6fac100480 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 -- start start 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576bb40 0x55a5a576a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a5777760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.911+0000 7f6fb6645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5a56d02f0 con 0x55a5a576a5d0 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb6645740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a5a5677cf0 con 0x55a5a5775370 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb6645740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a5a56cc2b0 con 0x55a5a576bb40 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55034/0 (socket says 172.21.15.66:55034) 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb2809640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a5777760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 -- 172.21.15.66:0/3113954933 learned_addr learned my addr 172.21.15.66:0/3113954933 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 0x7f6f980a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009230 tx=0x7f6f9c0058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb2008640 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576bb40 0x55a5a576a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 -- 172.21.15.66:0/3113954933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576bb40 msgr2=0x55a5a576a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576bb40 0x55a5a576a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 -- 172.21.15.66:0/3113954933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 msgr2=0x55a5a5777760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a5777760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 -- 172.21.15.66:0/3113954933 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5a565c3a0 con 0x55a5a576a5d0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb2809640 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a5777760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c033000 tx=0x7f6f9c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf5baa5dd8ba7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fa0dea640 1 -- 172.21.15.66:0/3113954933 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c04d070 con 0x55a5a576a5d0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fa0dea640 1 -- 172.21.15.66:0/3113954933 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c0043c0 con 0x55a5a576a5d0 2024-09-15T22:55:38.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.912+0000 7f6fa0dea640 1 -- 172.21.15.66:0/3113954933 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c035040 con 0x55a5a576a5d0 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 -- 172.21.15.66:0/3113954933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 msgr2=0x55a5a576aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c033000 tx=0x7f6f9c03d000 comp rx=0 tx=0).stop 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 -- 172.21.15.66:0/3113954933 shutdown_connections 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a5777760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576a5d0 0x55a5a576aa10 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3113954933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576bb40 0x55a5a576a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 -- 172.21.15.66:0/3113954933 >> 172.21.15.66:0/3113954933 conn(0x55a5a5733310 msgr2=0x55a5a5766c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 -- 172.21.15.66:0/3113954933 shutdown_connections 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.913+0000 7f6fb6645740 1 -- 172.21.15.66:0/3113954933 wait complete. 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 -- start start 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 Processor -- start 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5774d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a57725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5a5778010 con 0x55a5a576bb40 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a5a568b060 con 0x55a5a5775370 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a5a5778190 con 0x55a5a576a5d0 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb6645740 10 client.0 _ll_register_callbacks cb 0x55a5a53de8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55042/0 (socket says 172.21.15.66:55042) 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 -- 172.21.15.66:0/2493316250 learned_addr learned my addr 172.21.15.66:0/2493316250 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5774d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb2809640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a57725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 -- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 msgr2=0x55a5a5774d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5774d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 -- 172.21.15.66:0/2493316250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 msgr2=0x55a5a57725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a57725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.914+0000 7f6fb1807640 1 -- 172.21.15.66:0/2493316250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5a54413c0 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6fb2809640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a57725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6fb1807640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000c00 tx=0x7f6f9c031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522f0d0055425e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c05a070 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f6f9c049c80 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9c0043c0 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f6f9c066050 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6fb6645740 10 client.17643 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a5a5783a90 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c0043c0 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.915+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f6f9c0524e0 con 0x55a5a576bb40 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 10 client.17643 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:38.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 10 client.17643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 20 client.17643 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a5784de0 0x55a5a57871d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 4 client.17643 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5a56dd860 con 0x55a5a5784de0 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a5784de0 0x55a5a57871d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6f95ffb640 10 client.17643 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.916+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a5784de0 0x55a5a57871d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe06638332c8e537 server_cookie=90132bdf75006c6f in_seq=0 out_seq=0 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2493316250 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5a56dd860 con 0x55a5a5784de0 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6f95ffb640 10 client.17643 handle_command_reply: tid=0 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 client.17643 shutdown 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 msgr2=0x55a5a5772000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000c00 tx=0x7f6f9c031b30 comp rx=0 tx=0).stop 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 shutdown_connections 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a5784de0 0x55a5a57871d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a5775370 0x55a5a57725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6f95ffb640 0 client.17643 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a576bb40 0x55a5a5772000 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2493316250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5774d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 >> 172.21.15.66:0/2493316250 conn(0x55a5a5733310 msgr2=0x55a5a576c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 shutdown_connections 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 1 -- 172.21.15.66:0/2493316250 wait complete. 2024-09-15T22:55:38.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.917+0000 7f6fb6645740 20 client.17643 trim_cache size 0 max 16384 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 Processor -- start 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 -- start start 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5771000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a578a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1b1400 con 0x55a5a5775370 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1b2f40 con 0x55a5a576bb40 2024-09-15T22:55:38.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb6645740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1b1ad0 con 0x55a5a576a5d0 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.937+0000 7f6fb2809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a578a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb2809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a578a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55050/0 (socket says 172.21.15.66:55050) 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58582/0 (socket says 172.21.15.66:58582) 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb2809640 1 -- 172.21.15.66:0/3992835230 learned_addr learned my addr 172.21.15.66:0/3992835230 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb2008640 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5771000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 -- 172.21.15.66:0/3992835230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 msgr2=0x55a5a5771000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5771000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 -- 172.21.15.66:0/3992835230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 msgr2=0x55a5a578a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a578a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 -- 172.21.15.66:0/3992835230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5a5767960 con 0x55a5a576bb40 2024-09-15T22:55:38.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6fb1807640 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c031ba0 tx=0x7f6f9c0494f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe3fc725a1954b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6f97fff640 1 -- 172.21.15.66:0/3992835230 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c05a070 con 0x55a5a576bb40 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6f97fff640 1 -- 172.21.15.66:0/3992835230 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c0041c0 con 0x55a5a576bb40 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.938+0000 7f6f97fff640 1 -- 172.21.15.66:0/3992835230 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c040040 con 0x55a5a576bb40 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 -- 172.21.15.66:0/3992835230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 msgr2=0x55a5a578a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c031ba0 tx=0x7f6f9c0494f0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 -- 172.21.15.66:0/3992835230 shutdown_connections 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a578a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a578a1f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 --2- 172.21.15.66:0/3992835230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5771000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 -- 172.21.15.66:0/3992835230 >> 172.21.15.66:0/3992835230 conn(0x55a5a5733310 msgr2=0x55a5a57708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 -- 172.21.15.66:0/3992835230 shutdown_connections 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.939+0000 7f6fb6645740 1 -- 172.21.15.66:0/3992835230 wait complete. 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 -- start start 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 Processor -- start 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5788000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a5788540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1b2870 con 0x55a5a5775370 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1b21a0 con 0x55a5a576bb40 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1af400 con 0x55a5a576a5d0 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb6645740 10 client.0 _ll_register_callbacks cb 0x7f6fa4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb2809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb2809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55060/0 (socket says 172.21.15.66:55060) 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb2809640 1 -- 172.21.15.66:0/2510437669 learned_addr learned my addr 172.21.15.66:0/2510437669 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb1807640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a5788540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5788000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.940+0000 7f6fb2809640 1 -- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 msgr2=0x55a5a5788000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb2809640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5788000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb2809640 1 -- 172.21.15.66:0/2510437669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 msgr2=0x55a5a5788540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb2809640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a5788540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb2809640 1 -- 172.21.15.66:0/2510437669 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5a57ee720 con 0x55a5a5775370 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb1807640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a5788540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb2809640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400bb60 tx=0x7f6fa40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2be1d0593fc5fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6f95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4022060 con 0x55a5a5775370 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f6fa401d670 con 0x55a5a5775370 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9c0041c0 con 0x55a5a5775370 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f6fa4029050 con 0x55a5a5775370 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb6645740 10 client.17649 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:38.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.941+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a5a57efa40 con 0x55a5a5775370 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa401dd90 con 0x55a5a5775370 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f6fa4011c30 con 0x55a5a5775370 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 10 client.17649 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 10 client.17649 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 20 client.17649 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a57f0160 0x55a5a57f2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 4 client.17649 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6f9c0041c0 con 0x55a5a57f0160 2024-09-15T22:55:38.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a57f0160 0x55a5a57f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:38.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6f95ffb640 10 client.17649 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:55:38.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.942+0000 7f6fb2008640 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a57f0160 0x55a5a57f2550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=48f48a12b958b247 server_cookie=edded6454a1346b9 in_seq=0 out_seq=0 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6f95ffb640 1 -- 172.21.15.66:0/2510437669 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6f9c0041c0 con 0x55a5a57f0160 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6f95ffb640 10 client.17649 handle_command_reply: tid=0 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 client.17649 shutdown 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 msgr2=0x55a5a5788a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400bb60 tx=0x7f6fa40039c0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 shutdown_connections 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55a5a57f0160 0x55a5a57f2550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a5a5775370 0x55a5a5788a80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a5a576bb40 0x55a5a5788540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 --2- 172.21.15.66:0/2510437669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5a576a5d0 0x55a5a5788000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6f95ffb640 0 client.17649 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:55:38.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 >> 172.21.15.66:0/2510437669 conn(0x55a5a5733310 msgr2=0x55a5a576c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 shutdown_connections 2024-09-15T22:55:38.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 1 -- 172.21.15.66:0/2510437669 wait complete. 2024-09-15T22:55:38.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.943+0000 7f6fb6645740 20 client.17649 trim_cache size 0 max 16384 2024-09-15T22:55:38.951 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 msgr2=0x7f6f980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 0x7f6f980a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009230 tx=0x7f6f9c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 msgr2=0x7f6fac19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800de30 tx=0x7f6fa800b730 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 shutdown_connections 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6f980a3430 0x7f6f980a58f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac1055b0 0x7f6fac19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fac100e30 0x7f6fac19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 --2- 172.21.15.66:0/620939327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fac100480 0x7f6fac19a650 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 >> 172.21.15.66:0/620939327 conn(0x7f6fac077210 msgr2=0x7f6fac102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 shutdown_connections 2024-09-15T22:55:38.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:38.944+0000 7f6fb426c640 1 -- 172.21.15.66:0/620939327 wait complete. 2024-09-15T22:55:39.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:39 smithi066 ceph-mon[31185]: pgmap v319: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-15T22:55:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:39 smithi087 ceph-mon[35290]: pgmap v319: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-15T22:55:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:39 smithi184 ceph-mon[35203]: pgmap v319: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-15T22:55:39.680 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:55:39.758 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:40.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 -- 172.21.15.66:0/2519267933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101bc0 msgr2=0x7f96a010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 --2- 172.21.15.66:0/2519267933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101bc0 0x7f96a010d910 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9698009ca0 tx=0x7f969802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 -- 172.21.15.66:0/2519267933 shutdown_connections 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 --2- 172.21.15.66:0/2519267933 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101bc0 0x7f96a010d910 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 --2- 172.21.15.66:0/2519267933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0101240 0x7f96a0101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 --2- 172.21.15.66:0/2519267933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0105a90 0x7f96a0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 -- 172.21.15.66:0/2519267933 >> 172.21.15.66:0/2519267933 conn(0x7f96a0077210 msgr2=0x7f96a00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 -- 172.21.15.66:0/2519267933 shutdown_connections 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.251+0000 7f96a4db0640 1 -- 172.21.15.66:0/2519267933 wait complete. 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 Processor -- start 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 -- start start 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0101bc0 0x7f96a0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0105a90 0x7f96a01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110fb0 con 0x7f96a0101240 2024-09-15T22:55:40.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110e30 con 0x7f96a0101bc0 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f96a4db0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0111130 con 0x7f96a0105a90 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f969e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f969e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55080/0 (socket says 172.21.15.66:55080) 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.252+0000 7f969e59c640 1 -- 172.21.15.66:0/1977495565 learned_addr learned my addr 172.21.15.66:0/1977495565 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969dd9b640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0101bc0 0x7f96a0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0105a90 0x7f96a01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 -- 172.21.15.66:0/1977495565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0105a90 msgr2=0x7f96a01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0105a90 0x7f96a01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 -- 172.21.15.66:0/1977495565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0101bc0 msgr2=0x7f96a0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0101bc0 0x7f96a0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 -- 172.21.15.66:0/1977495565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01a4910 con 0x7f96a0101240 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f969e59c640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f969000d950 tx=0x7f969000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f96977fe640 1 -- 172.21.15.66:0/1977495565 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690017070 con 0x7f96a0101240 2024-09-15T22:55:40.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a01a4ae0 con 0x7f96a0101240 2024-09-15T22:55:40.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f96977fe640 1 -- 172.21.15.66:0/1977495565 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f969000de80 con 0x7f96a0101240 2024-09-15T22:55:40.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f96977fe640 1 -- 172.21.15.66:0/1977495565 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969000f620 con 0x7f96a0101240 2024-09-15T22:55:40.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.253+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01a5020 con 0x7f96a0101240 2024-09-15T22:55:40.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.256+0000 7f96977fe640 1 -- 172.21.15.66:0/1977495565 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9690009c30 con 0x7f96a0101240 2024-09-15T22:55:40.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.256+0000 7f96a7189740 1 Processor -- start 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 -- start start 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c3728d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c3729240 0x5641c372b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5641c3683620 con 0x5641c371e060 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5641c362ae50 con 0x5641c371e980 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96a7189740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5641c367f5e0 con 0x5641c3729240 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55092/0 (socket says 172.21.15.66:55092) 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f969ed9d640 1 -- 172.21.15.66:0/696576505 learned_addr learned my addr 172.21.15.66:0/696576505 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f969dd9b640 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c3729240 0x5641c372b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f969e59c640 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c3728d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.257+0000 7f96977fe640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 0x7f968c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 -- 172.21.15.66:0/696576505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c3729240 msgr2=0x5641c372b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c3729240 0x5641c372b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 -- 172.21.15.66:0/696576505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 msgr2=0x5641c3728d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c3728d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 -- 172.21.15.66:0/696576505 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c361bd40 con 0x5641c371e060 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f96977fe640 1 -- 172.21.15.66:0/1977495565 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f96900cfdc0 con 0x7f96a0101240 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 0x7f968c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f969ed9d640 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9698005cc0 tx=0x7f96980099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1121d2054278440 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f9694ff9640 1 -- 172.21.15.66:0/696576505 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969804a070 con 0x5641c371e060 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f9694ff9640 1 -- 172.21.15.66:0/696576505 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698036040 con 0x5641c371e060 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.258+0000 7f9694ff9640 1 -- 172.21.15.66:0/696576505 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698004830 con 0x5641c371e060 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- 172.21.15.66:0/696576505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 msgr2=0x5641c371e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 0x7f968c0a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f969802f540 tx=0x7f9698030700 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9698005cc0 tx=0x7f96980099c0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- 172.21.15.66:0/696576505 shutdown_connections 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c3729240 0x5641c372b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c3728d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 --2- 172.21.15.66:0/696576505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c371e440 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- 172.21.15.66:0/696576505 >> 172.21.15.66:0/696576505 conn(0x5641c371a5f0 msgr2=0x5641c371a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- 172.21.15.66:0/696576505 shutdown_connections 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- 172.21.15.66:0/696576505 wait complete. 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.259+0000 7f96a7189740 1 -- start start 2024-09-15T22:55:40.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 Processor -- start 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e980 0x5641c37265c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5641c3730220 con 0x5641c371e060 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5641c360bf10 con 0x5641c3729240 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5641c37303a0 con 0x5641c371e980 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f96a7189740 10 client.0 _ll_register_callbacks cb 0x5641c362fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:40.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58626/0 (socket says 172.21.15.66:58626) 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55104/0 (socket says 172.21.15.66:55104) 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 -- 172.21.15.66:0/1465242800 learned_addr learned my addr 172.21.15.66:0/1465242800 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969dd9b640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e980 0x5641c37265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 -- 172.21.15.66:0/1465242800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e980 msgr2=0x5641c37265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e980 0x5641c37265c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 -- 172.21.15.66:0/1465242800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 msgr2=0x5641c3726080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969ed9d640 1 -- 172.21.15.66:0/1465242800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c3392580 con 0x5641c3729240 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.260+0000 7f969e59c640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f969802ade0 tx=0x7f9698041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d21b836ed0426e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969804a040 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9698036040 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f9698003970 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f96980319b0 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 10 client.27038 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5641c345c960 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698036040 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f9698043030 con 0x5641c3729240 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 10 client.27038 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 10 client.27038 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.261+0000 7f96a7189740 20 client.27038 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c373cfa0 0x5641c373f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f96a7189740 4 client.27038 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c3690b90 con 0x5641c373cfa0 2024-09-15T22:55:40.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f969e59c640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c373cfa0 0x5641c373f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f969e59c640 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c373cfa0 0x5641c373f390 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6276ecb95184c5b8 server_cookie=49900edf7b41fd29 in_seq=0 out_seq=0 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.262+0000 7f9685ffb640 10 client.27038 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f9685ffb640 1 -- 172.21.15.66:0/1465242800 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641c3690b90 con 0x5641c373cfa0 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f9685ffb640 10 client.27038 handle_command_reply: tid=0 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 client.27038 shutdown 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 msgr2=0x5641c3726b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f969802ade0 tx=0x7f9698041000 comp rx=0 tx=0).stop 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 shutdown_connections 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c373cfa0 0x5641c373f390 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c3726b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e980 0x5641c37265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 --2- 172.21.15.66:0/1465242800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e060 0x5641c3726080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f9685ffb640 0 client.27038 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:40.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 >> 172.21.15.66:0/1465242800 conn(0x5641c371a5f0 msgr2=0x5641c3720320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 shutdown_connections 2024-09-15T22:55:40.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 1 -- 172.21.15.66:0/1465242800 wait complete. 2024-09-15T22:55:40.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.263+0000 7f96a7189740 20 client.27038 trim_cache size 0 max 16384 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 Processor -- start 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 -- start start 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3720b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c37449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ad070 con 0x5641c3729240 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01aebb0 con 0x5641c371e980 2024-09-15T22:55:40.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f96a7189740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ad740 con 0x5641c371e060 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f969ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55116/0 (socket says 172.21.15.66:55116) 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f969ed9d640 1 -- 172.21.15.66:0/3796960476 learned_addr learned my addr 172.21.15.66:0/3796960476 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.280+0000 7f969dd9b640 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c37449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969e59c640 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3720b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 -- 172.21.15.66:0/3796960476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 msgr2=0x5641c3720b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3720b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 -- 172.21.15.66:0/3796960476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 msgr2=0x5641c37449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c37449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 -- 172.21.15.66:0/3796960476 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c3718bb0 con 0x5641c3729240 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f969ed9d640 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9698002230 tx=0x7f96980099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f08f75d2f2ccb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f9687fff640 1 -- 172.21.15.66:0/3796960476 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969804a040 con 0x5641c3729240 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f9687fff640 1 -- 172.21.15.66:0/3796960476 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698036040 con 0x5641c3729240 2024-09-15T22:55:40.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.281+0000 7f9687fff640 1 -- 172.21.15.66:0/3796960476 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980040c0 con 0x5641c3729240 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- 172.21.15.66:0/3796960476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 msgr2=0x5641c3744f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9698002230 tx=0x7f96980099c0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- 172.21.15.66:0/3796960476 shutdown_connections 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c3729240 0x5641c3744f30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c371e980 0x5641c37449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- 172.21.15.66:0/3796960476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3720b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- 172.21.15.66:0/3796960476 >> 172.21.15.66:0/3796960476 conn(0x5641c371a5f0 msgr2=0x5641c3724950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- 172.21.15.66:0/3796960476 shutdown_connections 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- 172.21.15.66:0/3796960476 wait complete. 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- start start 2024-09-15T22:55:40.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 Processor -- start 2024-09-15T22:55:40.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3731700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c37a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ae4e0 con 0x5641c371e980 2024-09-15T22:55:40.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ade10 con 0x5641c3729240 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01ab090 con 0x5641c371e060 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f96a7189740 10 client.0 _ll_register_callbacks cb 0x7f96880093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.282+0000 7f969dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55120/0 (socket says 172.21.15.66:55120) 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 -- 172.21.15.66:0/1798387104 learned_addr learned my addr 172.21.15.66:0/1798387104 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969ed9d640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c37a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969e59c640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3731700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 -- 172.21.15.66:0/1798387104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 msgr2=0x5641c3731700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3731700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 -- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 msgr2=0x5641c37a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c37a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 -- 172.21.15.66:0/1798387104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c37a6f00 con 0x5641c371e980 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f969dd9b640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x5641c371b970 tx=0x7f96880158c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbd0c5cc1f987fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f9685ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:40.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688023060 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f968800f040 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9698036040 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f968802a050 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f96a7189740 10 client.17667 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.283+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5641c37a80f0 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698036040 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f9688013890 con 0x5641c371e980 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 10 client.17667 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 10 client.17667 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 20 client.17667 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c37a8870 0x5641c37aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 4 client.17667 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd46570b", "release": true, "await": true}] 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd46570b", "release": true, "await": true}) -- 0x5641c368b0a0 con 0x5641c37a8870 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.284+0000 7f969e59c640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c37a8870 0x5641c37aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.285+0000 7f969e59c640 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c37a8870 0x5641c37aac90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=724ba1763d7e0d3d server_cookie=7c255b8400a2c7be in_seq=0 out_seq=0 2024-09-15T22:55:40.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.285+0000 7f9685ffb640 10 client.17667 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:40.346 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:40.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 -- 172.21.15.66:0/4277549463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 msgr2=0x7f76e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 --2- 172.21.15.66:0/4277549463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e81029b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009900 tx=0x7f76d802a480 comp rx=0 tx=0).stop 2024-09-15T22:55:40.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 -- 172.21.15.66:0/4277549463 shutdown_connections 2024-09-15T22:55:40.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 --2- 172.21.15.66:0/4277549463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8102ef0 0x7f76e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 --2- 172.21.15.66:0/4277549463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e81029b0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 --2- 172.21.15.66:0/4277549463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8100e20 0x7f76e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 -- 172.21.15.66:0/4277549463 >> 172.21.15.66:0/4277549463 conn(0x7f76e80fc7d0 msgr2=0x7f76e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 -- 172.21.15.66:0/4277549463 shutdown_connections 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.918+0000 7f76effe3640 1 -- 172.21.15.66:0/4277549463 wait complete. 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 Processor -- start 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 -- start start 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 0x7f76e810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8102ef0 0x7f76e810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81120a0 con 0x7f76e8102570 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111f20 con 0x7f76e8100e20 2024-09-15T22:55:40.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76effe3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8112220 con 0x7f76e8102ef0 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 0x7f76e810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55144/0 (socket says 172.21.15.66:55144) 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.919+0000 7f76ed57e640 1 -- 172.21.15.66:0/3996953545 learned_addr learned my addr 172.21.15.66:0/3996953545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ee580640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8102ef0 0x7f76e810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 -- 172.21.15.66:0/3996953545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8102ef0 msgr2=0x7f76e810ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8102ef0 0x7f76e810ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 -- 172.21.15.66:0/3996953545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 msgr2=0x7f76e810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 0x7f76e810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 -- 172.21.15.66:0/3996953545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e81a6a50 con 0x7f76e8102570 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76edd7f640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 0x7f76e810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76ed57e640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f76d8006010 tx=0x7f76d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76deffd640 1 -- 172.21.15.66:0/3996953545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d803f070 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76deffd640 1 -- 172.21.15.66:0/3996953545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d8031c30 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e81a6ce0 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76deffd640 1 -- 172.21.15.66:0/3996953545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8035030 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.920+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e81a71c0 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.923+0000 7f76deffd640 1 -- 172.21.15.66:0/3996953545 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f76d8042070 con 0x7f76e8102570 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.923+0000 7f76f23bc740 1 Processor -- start 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 -- start start 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e44e7392f0 con 0x55e44e7de370 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e44e6e0cf0 con 0x55e44e7d4b40 2024-09-15T22:55:40.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76f23bc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e44e7352b0 con 0x55e44e7d35d0 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58674/0 (socket says 172.21.15.66:58674) 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 -- 172.21.15.66:0/1485366736 learned_addr learned my addr 172.21.15.66:0/1485366736 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76deffd640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 -- 172.21.15.66:0/1485366736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 msgr2=0x55e44e7d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 -- 172.21.15.66:0/1485366736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 msgr2=0x55e44e7e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.924+0000 7f76ee580640 1 -- 172.21.15.66:0/1485366736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44e6c53a0 con 0x55e44e7d4b40 2024-09-15T22:55:40.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76deffd640 1 -- 172.21.15.66:0/3996953545 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f76d80f07b0 con 0x7f76e8102570 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76ee580640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76ee580640 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009f50 tx=0x7f76e00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5bcfe309eb702b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76d3fff640 1 -- 172.21.15.66:0/1485366736 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0004250 con 0x55e44e7d4b40 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76d3fff640 1 -- 172.21.15.66:0/1485366736 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e000fe80 con 0x55e44e7d4b40 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.925+0000 7f76d3fff640 1 -- 172.21.15.66:0/1485366736 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e001bb20 con 0x55e44e7d4b40 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- 172.21.15.66:0/1485366736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 msgr2=0x55e44e7d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76ee580640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 0x7f76d40a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f76e0012fd0 tx=0x7f76e0021000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009f50 tx=0x7f76e00118d0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- 172.21.15.66:0/1485366736 shutdown_connections 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7d3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1485366736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d4b40 0x55e44e7d3090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- 172.21.15.66:0/1485366736 >> 172.21.15.66:0/1485366736 conn(0x55e44e79c310 msgr2=0x55e44e7cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- 172.21.15.66:0/1485366736 shutdown_connections 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- 172.21.15.66:0/1485366736 wait complete. 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 -- start start 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.926+0000 7f76f23bc740 1 Processor -- start 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7db4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e44e7e1070 con 0x55e44e7d4b40 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e44e6f4060 con 0x55e44e7de370 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e44e7e11f0 con 0x55e44e7d35d0 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76f23bc740 10 client.0 _ll_register_callbacks cb 0x55e44e4478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55166/0 (socket says 172.21.15.66:55166) 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 -- 172.21.15.66:0/1239123070 learned_addr learned my addr 172.21.15.66:0/1239123070 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ee580640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7db4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 -- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 msgr2=0x55e44e7ddcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7ddcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 -- 172.21.15.66:0/1239123070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 msgr2=0x55e44e7db4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7db4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.927+0000 7f76ed57e640 1 -- 172.21.15.66:0/1239123070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44e4aa3c0 con 0x55e44e7d4b40 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ee0d0 tx=0x7f76d8009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24747587a1cef85c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8049070 con 0x55e44e7d4b40 2024-09-15T22:55:40.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f76d80b8d80 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e44e746860 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f76d80d5070 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 10 client.17679 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e44e7eca80 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e44e746860 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f76d80c4e40 con 0x55e44e7d4b40 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 10 client.17679 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 10 client.17679 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 20 client.17679 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e7edee0 0x55e44e7f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 4 client.17679 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.928+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e44e740d70 con 0x55e44e7edee0 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.929+0000 7f76edd7f640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e7edee0 0x55e44e7f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:40.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.929+0000 7f76edd7f640 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e7edee0 0x55e44e7f02f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36b22a277b132152 server_cookie=92f9a309ba99a132 in_seq=0 out_seq=0 2024-09-15T22:55:40.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:40.929+0000 7f76d17fa640 10 client.17679 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:55:41.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.113+0000 7f9685ffb640 1 -- 172.21.15.66:0/1798387104 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5641c368b0a0 con 0x5641c37a8870 2024-09-15T22:55:41.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.113+0000 7f9685ffb640 10 client.17667 handle_command_reply: tid=0 2024-09-15T22:55:41.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.113+0000 7f96a7189740 1 client.17667 shutdown 2024-09-15T22:55:41.116 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:41 smithi066 ceph-mon[31185]: pgmap v320: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-15T22:55:41.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 msgr2=0x5641c3731c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x5641c371b970 tx=0x7f96880158c0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 shutdown_connections 2024-09-15T22:55:41.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5641c37a8870 0x5641c37aac90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5641c3729240 0x5641c37a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f9685ffb640 0 client.17667 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641c371e980 0x5641c3731c40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 --2- 172.21.15.66:0/1798387104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641c371e060 0x5641c3731700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 >> 172.21.15.66:0/1798387104 conn(0x5641c371a5f0 msgr2=0x5641c3718f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 shutdown_connections 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 1 -- 172.21.15.66:0/1798387104 wait complete. 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f96a7189740 20 client.17667 trim_cache size 0 max 16384 2024-09-15T22:55:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f76d17fa640 1 -- 172.21.15.66:0/1239123070 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e44e740d70 con 0x55e44e7edee0 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f76d17fa640 10 client.17679 handle_command_reply: tid=0 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f76f23bc740 1 client.17679 shutdown 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 49, 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 36, 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "fd46570b": { 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 36, 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:55:41.119 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.3, 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:41.120 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 msgr2=0x55e44e7daf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.114+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ee0d0 tx=0x7f76d8009230 comp rx=0 tx=0).stop 2024-09-15T22:55:41.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 shutdown_connections 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e7edee0 0x55e44e7f02f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7db4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7daf80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1239123070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7ddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 >> 172.21.15.66:0/1239123070 conn(0x55e44e79c310 msgr2=0x55e44e7d5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76d17fa640 0 client.17679 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:55:41.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 msgr2=0x7f968c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 0x7f968c0a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f969802f540 tx=0x7f9698030700 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 msgr2=0x7f96a0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f969000d950 tx=0x7f969000dd50 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 shutdown_connections 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f968c0a33b0 0x7f968c0a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a0105a90 0x7f96a01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0101bc0 0x7f96a0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 --2- 172.21.15.66:0/1977495565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96a0101240 0x7f96a0199350 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 >> 172.21.15.66:0/1977495565 conn(0x7f96a0077210 msgr2=0x7f96a01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 shutdown_connections 2024-09-15T22:55:41.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 1 -- 172.21.15.66:0/1239123070 wait complete. 2024-09-15T22:55:41.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 shutdown_connections 2024-09-15T22:55:41.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f96a4db0640 1 -- 172.21.15.66:0/1977495565 wait complete. 2024-09-15T22:55:41.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.115+0000 7f76f23bc740 20 client.17679 trim_cache size 0 max 16384 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 Processor -- start 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 -- start start 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b1480 con 0x55e44e7d4b40 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b2fc0 con 0x55e44e7de370 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.129+0000 7f76f23bc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b1b50 con 0x55e44e7d35d0 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:43672/0 (socket says 172.21.15.66:43672) 2024-09-15T22:55:41.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55176/0 (socket says 172.21.15.66:55176) 2024-09-15T22:55:41.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76edd7f640 1 -- 172.21.15.66:0/1554304696 learned_addr learned my addr 172.21.15.66:0/1554304696 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:41.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ee580640 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 -- 172.21.15.66:0/1554304696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 msgr2=0x55e44e7cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:41.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 -- 172.21.15.66:0/1554304696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 msgr2=0x55e44e7f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 -- 172.21.15.66:0/1554304696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44e7dd8f0 con 0x55e44e7d4b40 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.130+0000 7f76ed57e640 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d803b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e407d1bbeaae55f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76d37fe640 1 -- 172.21.15.66:0/1554304696 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8049070 con 0x55e44e7d4b40 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76d37fe640 1 -- 172.21.15.66:0/1554304696 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d8031de0 con 0x55e44e7d4b40 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76d37fe640 1 -- 172.21.15.66:0/1554304696 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80b8d80 con 0x55e44e7d4b40 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 -- 172.21.15.66:0/1554304696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 msgr2=0x55e44e7ea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000c00 tx=0x7f76d803b790 comp rx=0 tx=0).stop 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 -- 172.21.15.66:0/1554304696 shutdown_connections 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7de370 0x55e44e7f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7d4b40 0x55e44e7ea310 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 --2- 172.21.15.66:0/1554304696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d35d0 0x55e44e7cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.131+0000 7f76f23bc740 1 -- 172.21.15.66:0/1554304696 >> 172.21.15.66:0/1554304696 conn(0x55e44e79c310 msgr2=0x55e44e7cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.132+0000 7f76f23bc740 1 -- 172.21.15.66:0/1554304696 shutdown_connections 2024-09-15T22:55:41.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.132+0000 7f76f23bc740 1 -- 172.21.15.66:0/1554304696 wait complete. 2024-09-15T22:55:41.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.132+0000 7f76f23bc740 1 -- start start 2024-09-15T22:55:41.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.132+0000 7f76f23bc740 1 Processor -- start 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d4b40 0x55e44e7e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b28f0 con 0x55e44e7de370 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76ee580640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81b2220 con 0x55e44e7d35d0 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81af480 con 0x55e44e7d4b40 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58696/0 (socket says 172.21.15.66:58696) 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 -- 172.21.15.66:0/2695759523 learned_addr learned my addr 172.21.15.66:0/2695759523 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76ee580640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55188/0 (socket says 172.21.15.66:55188) 2024-09-15T22:55:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76ed57e640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d4b40 0x55e44e7e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76f23bc740 10 client.0 _ll_register_callbacks cb 0x7f76d8005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 -- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d4b40 msgr2=0x55e44e7e1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d4b40 0x55e44e7e1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 -- 172.21.15.66:0/2695759523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 msgr2=0x55e44e7e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.133+0000 7f76edd7f640 1 -- 172.21.15.66:0/2695759523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44e7e2650 con 0x55e44e7d35d0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76edd7f640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76e4012570 tx=0x7f76e4012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c5f001e9092316 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4022070 con 0x55e44e7d35d0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d8031de0 con 0x55e44e7d35d0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f76e4004460 con 0x55e44e7d35d0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f76e4030050 con 0x55e44e7d35d0 2024-09-15T22:55:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76f23bc740 10 client.27062 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e44e8588b0 con 0x55e44e7d35d0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.134+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d8031de0 con 0x55e44e7d35d0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f76e4003bd0 con 0x55e44e7d35d0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 10 client.27062 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 10 client.27062 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 20 client.27062 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e858fe0 0x55e44e85b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 4 client.27062 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e44e6bd170 con 0x55e44e858fe0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76ed57e640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e858fe0 0x55e44e85b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76ed57e640 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e858fe0 0x55e44e85b420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=584472eb0a98da11 server_cookie=9cdcea1763a81dbd in_seq=0 out_seq=0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.135+0000 7f76d17fa640 10 client.27062 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76d17fa640 1 -- 172.21.15.66:0/2695759523 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e44e6bd170 con 0x55e44e858fe0 2024-09-15T22:55:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76d17fa640 10 client.27062 handle_command_reply: tid=0 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 client.27062 shutdown 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 msgr2=0x55e44e7e68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f76e4012570 tx=0x7f76e4012bc0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 shutdown_connections 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e44e858fe0 0x55e44e85b420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e44e7de370 0x55e44e7e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e44e7d4b40 0x55e44e7e1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 --2- 172.21.15.66:0/2695759523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e44e7d35d0 0x55e44e7e68a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76d17fa640 0 client.27062 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 >> 172.21.15.66:0/2695759523 conn(0x55e44e79c310 msgr2=0x55e44e7dc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 shutdown_connections 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 1 -- 172.21.15.66:0/2695759523 wait complete. 2024-09-15T22:55:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.136+0000 7f76f23bc740 20 client.27062 trim_cache size 0 max 16384 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 msgr2=0x7f76d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 0x7f76d40a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f76e0012fd0 tx=0x7f76e0021000 comp rx=0 tx=0).stop 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 msgr2=0x7f76e810ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f76d8006010 tx=0x7f76d8003c10 comp rx=0 tx=0).stop 2024-09-15T22:55:41.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 shutdown_connections 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f76d40a33b0 0x7f76d40a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76e8102ef0 0x7f76e810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76e8102570 0x7f76e810ea10 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 --2- 172.21.15.66:0/3996953545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e8100e20 0x7f76e810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 >> 172.21.15.66:0/3996953545 conn(0x7f76e80fc7d0 msgr2=0x7f76e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 shutdown_connections 2024-09-15T22:55:41.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:41.137+0000 7f76effe3640 1 -- 172.21.15.66:0/3996953545 wait complete. 2024-09-15T22:55:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:41 smithi087 ceph-mon[35290]: pgmap v320: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-15T22:55:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:41 smithi184 ceph-mon[35203]: pgmap v320: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-15T22:55:41.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd46570b', total seconds elapsed: 28.4 2024-09-15T22:55:42.565 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:55:42.828 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:43.294 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:43 smithi066 ceph-mon[31185]: pgmap v321: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-15T22:55:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:43 smithi087 ceph-mon[35290]: pgmap v321: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 -- 172.21.15.66:0/2665039238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb001027c0 msgr2=0x7fbb00106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/2665039238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb001027c0 0x7fbb00106810 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009900 tx=0x7fbaec02a410 comp rx=0 tx=0).stop 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 -- 172.21.15.66:0/2665039238 shutdown_connections 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/2665039238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb00106f40 0x7fbb0010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/2665039238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb001027c0 0x7fbb00106810 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/2665039238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00101e10 0x7fbb001021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 -- 172.21.15.66:0/2665039238 >> 172.21.15.66:0/2665039238 conn(0x7fbb000fd8d0 msgr2=0x7fbb000ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 -- 172.21.15.66:0/2665039238 shutdown_connections 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.377+0000 7fbb06c7b640 1 -- 172.21.15.66:0/2665039238 wait complete. 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 Processor -- start 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 -- start start 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb001027c0 0x7fbb00198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00106f40 0x7fbb0019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00111fa0 con 0x7fbb00101e10 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00111e20 con 0x7fbb00106f40 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb06c7b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00112120 con 0x7fbb001027c0 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34934/0 (socket says 172.21.15.66:34934) 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.378+0000 7fbb04a17640 1 -- 172.21.15.66:0/1932771273 learned_addr learned my addr 172.21.15.66:0/1932771273 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:43.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbafffff640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb001027c0 0x7fbb00198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb05218640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00106f40 0x7fbb0019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 -- 172.21.15.66:0/1932771273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb001027c0 msgr2=0x7fbb00198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb001027c0 0x7fbb00198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 -- 172.21.15.66:0/1932771273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00106f40 msgr2=0x7fbb0019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00106f40 0x7fbb0019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 -- 172.21.15.66:0/1932771273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0019d3f0 con 0x7fbb00101e10 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e9f0 tx=0x7fbaf400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbafdffb640 1 -- 172.21.15.66:0/1932771273 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400cd80 con 0x7fbb00101e10 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbafdffb640 1 -- 172.21.15.66:0/1932771273 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf4010910 con 0x7fbb00101e10 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0019d6e0 con 0x7fbb00101e10 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbafdffb640 1 -- 172.21.15.66:0/1932771273 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4018990 con 0x7fbb00101e10 2024-09-15T22:55:43.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.379+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb001a4fc0 con 0x7fbb00101e10 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbafdffb640 1 -- 172.21.15.66:0/1932771273 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbaf4010ac0 con 0x7fbb00101e10 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 Processor -- start 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 -- start start 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e66b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562505dbb2f0 con 0x562505e56b40 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562505d62cf0 con 0x562505e64780 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb09054740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562505db72b0 con 0x562505e555d0 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34950/0 (socket says 172.21.15.66:34950) 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.382+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbafffff640 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e66b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 -- 172.21.15.66:0/4000689089 learned_addr learned my addr 172.21.15.66:0/4000689089 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:43.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbafdffb640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 0x7fbaf00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 0x7fbaf00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 -- 172.21.15.66:0/4000689089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 msgr2=0x562505e55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 -- 172.21.15.66:0/4000689089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 msgr2=0x562505e66b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbafdffb640 1 -- 172.21.15.66:0/1932771273 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fbaf40d03c0 con 0x7fbb00101e10 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e66b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 -- 172.21.15.66:0/4000689089 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562505d473a0 con 0x562505e56b40 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbb05218640 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8005c40 tx=0x7fbaf8013f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca3822b72e148b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbaeaffd640 1 -- 172.21.15.66:0/4000689089 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8022020 con 0x562505e56b40 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbaeaffd640 1 -- 172.21.15.66:0/4000689089 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf80134e0 con 0x562505e56b40 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.383+0000 7fbaeaffd640 1 -- 172.21.15.66:0/4000689089 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8010a30 con 0x562505e56b40 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 -- 172.21.15.66:0/4000689089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 msgr2=0x562505e55090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb05218640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 0x7fbaf00a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8023000 tx=0x7fbaf8021000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8005c40 tx=0x7fbaf8013f50 comp rx=0 tx=0).stop 2024-09-15T22:55:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 -- 172.21.15.66:0/4000689089 shutdown_connections 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e66b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 --2- 172.21.15.66:0/4000689089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e56b40 0x562505e55090 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 -- 172.21.15.66:0/4000689089 >> 172.21.15.66:0/4000689089 conn(0x562505e1e310 msgr2=0x562505e51c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 -- 172.21.15.66:0/4000689089 shutdown_connections 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.384+0000 7fbb09054740 1 -- 172.21.15.66:0/4000689089 wait complete. 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 -- start start 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 Processor -- start 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e61420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562505e67480 con 0x562505e555d0 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562505d76060 con 0x562505e64780 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562505e67600 con 0x562505e56b40 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb09054740 10 client.0 _ll_register_callbacks cb 0x562505ac98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbafffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e61420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34954/0 (socket says 172.21.15.66:34954) 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb04a17640 1 -- 172.21.15.66:0/1684358226 learned_addr learned my addr 172.21.15.66:0/1684358226 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.385+0000 7fbb05218640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 -- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 msgr2=0x562505e61a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e61a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 -- 172.21.15.66:0/1684358226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 msgr2=0x562505e64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 -- 172.21.15.66:0/1684358226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562505b2c3c0 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbb05218640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbafffff640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e61420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbaec005940 tx=0x7fbaec0317e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f33db5e4e408f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbadffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec035040 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fbaec004240 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562505dc8860 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fbaec04f050 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbb09054740 10 client.27037 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.386+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562505e72f70 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562505dc8860 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fbaec004a10 con 0x562505e56b40 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 10 client.27037 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 10 client.27037 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:55:43.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 20 client.27037 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505e74430 0x562505e76860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 4 client.27037 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562505dc2d70 con 0x562505e74430 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505e74430 0x562505e76860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbadffff640 10 client.27037 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.387+0000 7fbb04a17640 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505e74430 0x562505e76860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38c958adf29569d8 server_cookie=cdcaffb45d8aab42 in_seq=0 out_seq=0 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.388+0000 7fbadffff640 1 -- 172.21.15.66:0/1684358226 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562505dc2d70 con 0x562505e74430 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.388+0000 7fbadffff640 10 client.27037 handle_command_reply: tid=0 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.388+0000 7fbb09054740 1 client.27037 shutdown 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.388+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 msgr2=0x562505e61420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.388+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e61420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbaec005940 tx=0x7fbaec0317e0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 shutdown_connections 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505e74430 0x562505e76860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e64780 0x562505e61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e61420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbadffff640 0 client.27037 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 --2- 172.21.15.66:0/1684358226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e555d0 0x562505e64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 >> 172.21.15.66:0/1684358226 conn(0x562505e1e310 msgr2=0x562505e57960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 shutdown_connections 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 1 -- 172.21.15.66:0/1684358226 wait complete. 2024-09-15T22:55:43.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.389+0000 7fbb09054740 20 client.27037 trim_cache size 0 max 16384 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.411+0000 7fbb09054740 1 Processor -- start 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.411+0000 7fbb09054740 1 -- start start 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 0x562505e51e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e70720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001acfc0 con 0x562505e64780 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001aeb00 con 0x562505e555d0 2024-09-15T22:55:43.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb09054740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001ad690 con 0x562505e56b40 2024-09-15T22:55:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 0x562505e51e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34968/0 (socket says 172.21.15.66:34968) 2024-09-15T22:55:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 -- 172.21.15.66:0/581018847 learned_addr learned my addr 172.21.15.66:0/581018847 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:43.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbafffff640 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e70720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 -- 172.21.15.66:0/581018847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 msgr2=0x562505e70720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e70720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 -- 172.21.15.66:0/581018847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 msgr2=0x562505e51e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 0x562505e51e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb05218640 1 -- 172.21.15.66:0/581018847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562505e58120 con 0x562505e64780 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.412+0000 7fbb04a17640 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 0x562505e51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.413+0000 7fbb05218640 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009c40 tx=0x7fbaf8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5714a7e63de4dc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.413+0000 7fbaea7fc640 1 -- 172.21.15.66:0/581018847 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8036070 con 0x562505e64780 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.413+0000 7fbaea7fc640 1 -- 172.21.15.66:0/581018847 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf8010e10 con 0x562505e64780 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.413+0000 7fbaea7fc640 1 -- 172.21.15.66:0/581018847 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8022050 con 0x562505e64780 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- 172.21.15.66:0/581018847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 msgr2=0x562505e7c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009c40 tx=0x7fbaf8000f40 comp rx=0 tx=0).stop 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- 172.21.15.66:0/581018847 shutdown_connections 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e7c130 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e56b40 0x562505e70720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 --2- 172.21.15.66:0/581018847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e555d0 0x562505e51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- 172.21.15.66:0/581018847 >> 172.21.15.66:0/581018847 conn(0x562505e1e310 msgr2=0x562505e51700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- 172.21.15.66:0/581018847 shutdown_connections 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- 172.21.15.66:0/581018847 wait complete. 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 -- start start 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.414+0000 7fbb09054740 1 Processor -- start 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001ae430 con 0x562505e64780 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001add60 con 0x562505e56b40 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001aafc0 con 0x562505e555d0 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb09054740 10 client.0 _ll_register_callbacks cb 0x7fbaec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbafffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbafffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42182/0 (socket says 172.21.15.66:42182) 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb05218640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34970/0 (socket says 172.21.15.66:34970) 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:50456/0 (socket says 172.21.15.66:50456) 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbafffff640 1 -- 172.21.15.66:0/3339744635 learned_addr learned my addr 172.21.15.66:0/3339744635 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 -- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 msgr2=0x562505e5e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 -- 172.21.15.66:0/3339744635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 msgr2=0x562505e5ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 -- 172.21.15.66:0/3339744635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562505ede100 con 0x562505e555d0 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb05218640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:43.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbafffff640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbb04a17640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c6a0 tx=0x7fbaf40984a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2aa8191659ab39c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.415+0000 7fbadffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40a4ee0 con 0x562505e555d0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fbaf4098990 con 0x562505e555d0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaf8010e10 con 0x562505e555d0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fbaf4098070 con 0x562505e555d0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 10 client.27043 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562505edf320 con 0x562505e555d0 2024-09-15T22:55:43.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf8010e10 con 0x562505e555d0 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fbaf40bc0b0 con 0x562505e555d0 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 10 client.27043 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 10 client.27043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 20 client.27043 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505edfa40 0x562505ee1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 4 client.27043 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.416+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562505d3f170 con 0x562505edfa40 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbafffff640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505edfa40 0x562505ee1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbadffff640 10 client.27043 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbafffff640 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505edfa40 0x562505ee1e30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f954bc2b6ecc78f6 server_cookie=cdfd7422bdb49d41 in_seq=0 out_seq=0 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbadffff640 1 -- 172.21.15.66:0/3339744635 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562505d3f170 con 0x562505edfa40 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbadffff640 10 client.27043 handle_command_reply: tid=0 2024-09-15T22:55:43.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 client.27043 shutdown 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 msgr2=0x562505e5e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400c6a0 tx=0x7fbaf40984a0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 shutdown_connections 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562505edfa40 0x562505ee1e30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562505e64780 0x562505e5ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562505e56b40 0x562505e5e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbadffff640 0 client.27043 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 --2- 172.21.15.66:0/3339744635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562505e555d0 0x562505e5e3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.417+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 >> 172.21.15.66:0/3339744635 conn(0x562505e1e310 msgr2=0x562505e62c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 shutdown_connections 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb09054740 1 -- 172.21.15.66:0/3339744635 wait complete. 2024-09-15T22:55:43.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb09054740 20 client.27043 trim_cache size 0 max 16384 2024-09-15T22:55:43.426 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:55:43.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 msgr2=0x7fbaf00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 0x7fbaf00a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8023000 tx=0x7fbaf8021000 comp rx=0 tx=0).stop 2024-09-15T22:55:43.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 msgr2=0x7fbb00198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.418+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e9f0 tx=0x7fbaf400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 shutdown_connections 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbaf00a3430 0x7fbaf00a58f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb00106f40 0x7fbb0019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb001027c0 0x7fbb00198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 --2- 172.21.15.66:0/1932771273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb00101e10 0x7fbb00198440 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 >> 172.21.15.66:0/1932771273 conn(0x7fbb000fd8d0 msgr2=0x7fbb000fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 shutdown_connections 2024-09-15T22:55:43.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:43.419+0000 7fbb06c7b640 1 -- 172.21.15.66:0/1932771273 wait complete. 2024-09-15T22:55:43.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:43 smithi184 ceph-mon[35203]: pgmap v321: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-15T22:55:44.100 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:44 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:55:44.143 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:55:44.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:44 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:55:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:44 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:45.334 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:45 smithi066 ceph-mon[31185]: pgmap v322: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-09-15T22:55:45.334 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:45 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.334 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:45 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:45 smithi087 ceph-mon[35290]: pgmap v322: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-09-15T22:55:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:45 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:45 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:45 smithi184 ceph-mon[35203]: pgmap v322: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 11 op/s 2024-09-15T22:55:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:45 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:45 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 -- 172.21.15.66:0/3593883482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8106f10 msgr2=0x7f0ce810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 --2- 172.21.15.66:0/3593883482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8106f10 0x7f0ce810ea90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009ca0 tx=0x7f0ce002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 -- 172.21.15.66:0/3593883482 shutdown_connections 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 --2- 172.21.15.66:0/3593883482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8106f10 0x7f0ce810ea90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 --2- 172.21.15.66:0/3593883482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 0x7f0ce81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 --2- 172.21.15.66:0/3593883482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8101de0 0x7f0ce81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 -- 172.21.15.66:0/3593883482 >> 172.21.15.66:0/3593883482 conn(0x7f0ce80fd8e0 msgr2=0x7f0ce80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 -- 172.21.15.66:0/3593883482 shutdown_connections 2024-09-15T22:55:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.417+0000 7f0ced451640 1 -- 172.21.15.66:0/3593883482 wait complete. 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 Processor -- start 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 -- start start 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 0x7f0ce8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8106f10 0x7f0ce8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8111f70 con 0x7f0ce8101de0 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8111df0 con 0x7f0ce8106f10 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ced451640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81120f0 con 0x7f0ce8102790 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ce6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ce6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34986/0 (socket says 172.21.15.66:34986) 2024-09-15T22:55:45.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.418+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/651064056 learned_addr learned my addr 172.21.15.66:0/651064056 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 0x7f0ce8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8106f10 0x7f0ce8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/651064056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 msgr2=0x7f0ce8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 0x7f0ce8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/651064056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8106f10 msgr2=0x7f0ce8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8106f10 0x7f0ce8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/651064056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81a6870 con 0x7f0ce8101de0 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800d950 tx=0x7f0cd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ccffff640 1 -- 172.21.15.66:0/651064056 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8017030 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ccffff640 1 -- 172.21.15.66:0/651064056 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd8004020 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce81a6b60 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ccffff640 1 -- 172.21.15.66:0/651064056 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80047a0 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.419+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81a70a0 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.421+0000 7f0ccffff640 1 -- 172.21.15.66:0/651064056 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0cd80041d0 con 0x7f0ce8101de0 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 Processor -- start 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 -- start start 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 0x558cdd526090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd526a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558cdd48c2f0 con 0x558cdd531370 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558cdd433cf0 con 0x558cdd527b40 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0cef82a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558cdd4882b0 con 0x558cdd5265d0 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 0x558cdd526090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35000/0 (socket says 172.21.15.66:35000) 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce67fc640 1 -- 172.21.15.66:0/435397684 learned_addr learned my addr 172.21.15.66:0/435397684 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ccffff640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 0x7f0cd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd526a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.422+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 0x7f0cd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 -- 172.21.15.66:0/435397684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 msgr2=0x558cdd526a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd526a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 -- 172.21.15.66:0/435397684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 msgr2=0x558cdd526090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 0x558cdd526090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 -- 172.21.15.66:0/435397684 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdd4183a0 con 0x558cdd531370 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ccffff640 1 -- 172.21.15.66:0/651064056 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0cd80cfb10 con 0x7f0ce8101de0 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 0x558cdd526090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009c20 tx=0x7f0cdc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d5b96b4baa592c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 0x7f0cd00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0004af0 tx=0x7f0ce002a8c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ccd7fa640 1 -- 172.21.15.66:0/435397684 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004230 con 0x558cdd531370 2024-09-15T22:55:45.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ccd7fa640 1 -- 172.21.15.66:0/435397684 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc0043d0 con 0x558cdd531370 2024-09-15T22:55:45.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.423+0000 7f0ccd7fa640 1 -- 172.21.15.66:0/435397684 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004db0 con 0x558cdd531370 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- 172.21.15.66:0/435397684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 msgr2=0x558cdd533760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009c20 tx=0x7f0cdc011810 comp rx=0 tx=0).stop 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- 172.21.15.66:0/435397684 shutdown_connections 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd531370 0x558cdd533760 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd526a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 --2- 172.21.15.66:0/435397684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd527b40 0x558cdd526090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- 172.21.15.66:0/435397684 >> 172.21.15.66:0/435397684 conn(0x558cdd4ef310 msgr2=0x558cdd522c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- 172.21.15.66:0/435397684 shutdown_connections 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- 172.21.15.66:0/435397684 wait complete. 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.424+0000 7f0cef82a740 1 -- start start 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 Processor -- start 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd527b40 0x558cdd52dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd52e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558cdd534070 con 0x558cdd5265d0 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558cdd447060 con 0x558cdd531370 2024-09-15T22:55:45.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558cdd5341f0 con 0x558cdd527b40 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0cef82a740 10 client.0 _ll_register_callbacks cb 0x558cdd19a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35008/0 (socket says 172.21.15.66:35008) 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/3272259680 learned_addr learned my addr 172.21.15.66:0/3272259680 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd527b40 0x558cdd52dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd52e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd527b40 msgr2=0x558cdd52dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd527b40 0x558cdd52dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/3272259680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 msgr2=0x558cdd52e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd52e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.425+0000 7f0ce6ffd640 1 -- 172.21.15.66:0/3272259680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdd1fd3c0 con 0x558cdd5265d0 2024-09-15T22:55:45.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009610 tx=0x7f0cd8005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26e5aa6cc4d119d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd809c0c0 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0cd80cd0b0 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cdc0043d0 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0cd809fd70 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 10 client.17715 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558cdd53faa0 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc0043d0 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0cd809ae10 con 0x558cdd5265d0 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 10 client.17715 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 10 client.17715 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:55:45.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 20 client.17715 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd540eb0 0x558cdd543320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 4 client.17715 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.426+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cdd499860 con 0x558cdd540eb0 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.427+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd540eb0 0x558cdd543320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.427+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd540eb0 0x558cdd543320 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df369582f44cb651 server_cookie=814a6badf49f38d0 in_seq=0 out_seq=0 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.427+0000 7f0ccaff5640 10 client.17715 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0ccaff5640 1 -- 172.21.15.66:0/3272259680 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cdd499860 con 0x558cdd540eb0 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0ccaff5640 10 client.17715 handle_command_reply: tid=0 2024-09-15T22:55:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 client.17715 shutdown 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 msgr2=0x558cdd530d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009610 tx=0x7f0cd8005bf0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 shutdown_connections 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd540eb0 0x558cdd543320 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd52e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd527b40 0x558cdd52dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 --2- 172.21.15.66:0/3272259680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd5265d0 0x558cdd530d00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0ccaff5640 0 client.17715 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 >> 172.21.15.66:0/3272259680 conn(0x558cdd4ef310 msgr2=0x558cdd528960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 shutdown_connections 2024-09-15T22:55:45.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 1 -- 172.21.15.66:0/3272259680 wait complete. 2024-09-15T22:55:45.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.428+0000 7f0cef82a740 20 client.17715 trim_cache size 0 max 16384 2024-09-15T22:55:45.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 Processor -- start 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 -- start start 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd53d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd548be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81b1440 con 0x558cdd527b40 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81b2f80 con 0x558cdd531370 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.441+0000 7f0cef82a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81b1b10 con 0x558cdd5265d0 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35018/0 (socket says 172.21.15.66:35018) 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 -- 172.21.15.66:0/1123089006 learned_addr learned my addr 172.21.15.66:0/1123089006 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd53d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd548be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 -- 172.21.15.66:0/1123089006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 msgr2=0x558cdd53d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd53d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 -- 172.21.15.66:0/1123089006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 msgr2=0x558cdd548be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd548be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 -- 172.21.15.66:0/1123089006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cdd523960 con 0x558cdd527b40 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0099b0 tx=0x7f0cdc004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700a8707462599d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0cccff9640 1 -- 172.21.15.66:0/1123089006 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc01e040 con 0x558cdd527b40 2024-09-15T22:55:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0cccff9640 1 -- 172.21.15.66:0/1123089006 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc01f040 con 0x558cdd527b40 2024-09-15T22:55:45.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.442+0000 7f0cccff9640 1 -- 172.21.15.66:0/1123089006 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0269a0 con 0x558cdd527b40 2024-09-15T22:55:45.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- 172.21.15.66:0/1123089006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 msgr2=0x558cdd521bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0099b0 tx=0x7f0cdc004580 comp rx=0 tx=0).stop 2024-09-15T22:55:45.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- 172.21.15.66:0/1123089006 shutdown_connections 2024-09-15T22:55:45.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd531370 0x558cdd548be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd521bf0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 --2- 172.21.15.66:0/1123089006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd5265d0 0x558cdd53d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- 172.21.15.66:0/1123089006 >> 172.21.15.66:0/1123089006 conn(0x558cdd4ef310 msgr2=0x558cdd5214e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- 172.21.15.66:0/1123089006 shutdown_connections 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- 172.21.15.66:0/1123089006 wait complete. 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 -- start start 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.443+0000 7f0cef82a740 1 Processor -- start 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 0x558cdd535400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd531370 0x558cdd535e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81b28b0 con 0x558cdd527b40 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81b21e0 con 0x558cdd5265d0 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce81af440 con 0x558cdd531370 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 10 client.0 _ll_register_callbacks cb 0x7f0cd809b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35034/0 (socket says 172.21.15.66:35034) 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 -- 172.21.15.66:0/2204940920 learned_addr learned my addr 172.21.15.66:0/2204940920 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 0x558cdd535400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce77fe640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd531370 0x558cdd535e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 -- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd531370 msgr2=0x558cdd535e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd531370 0x558cdd535e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 -- 172.21.15.66:0/2204940920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 msgr2=0x558cdd535400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 0x558cdd535400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 -- 172.21.15.66:0/2204940920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cdd5aae00 con 0x558cdd527b40 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 0x558cdd535400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ce67fc640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc011850 tx=0x7f0cdc005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fc5152a0906b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ccaff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc005ab0 con 0x558cdd527b40 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0cdc026780 con 0x558cdd527b40 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.444+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cdc01f040 con 0x558cdd527b40 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc041050 con 0x558cdd527b40 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 10 client.17721 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:45.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558cdd5ac0c0 con 0x558cdd527b40 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc01f040 con 0x558cdd527b40 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0cdc024040 con 0x558cdd527b40 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 10 client.17721 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 10 client.17721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 20 client.17721 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd5ac560 0x558cdd5ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 4 client.17721 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cdd493d70 con 0x558cdd5ac560 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.445+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd5ac560 0x558cdd5ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:45.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0ce6ffd640 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd5ac560 0x558cdd5ae980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ed75aa75da5b545 server_cookie=c088f7eb3e7840e9 in_seq=0 out_seq=0 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0ccaff5640 10 client.17721 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0ccaff5640 1 -- 172.21.15.66:0/2204940920 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cdd493d70 con 0x558cdd5ac560 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0ccaff5640 10 client.17721 handle_command_reply: tid=0 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 client.17721 shutdown 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 msgr2=0x558cdd535940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc011850 tx=0x7f0cdc005d30 comp rx=0 tx=0).stop 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 shutdown_connections 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558cdd5ac560 0x558cdd5ae980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558cdd531370 0x558cdd535e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cdd527b40 0x558cdd535940 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 --2- 172.21.15.66:0/2204940920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558cdd5265d0 0x558cdd535400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0ccaff5640 0 client.17721 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:55:45.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 >> 172.21.15.66:0/2204940920 conn(0x558cdd4ef310 msgr2=0x558cdd528930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 shutdown_connections 2024-09-15T22:55:45.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 1 -- 172.21.15.66:0/2204940920 wait complete. 2024-09-15T22:55:45.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.446+0000 7f0cef82a740 20 client.17721 trim_cache size 0 max 16384 2024-09-15T22:55:45.456 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 msgr2=0x7f0cd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 0x7f0cd00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0004af0 tx=0x7f0ce002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 msgr2=0x7f0ce80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800d950 tx=0x7f0cd800de10 comp rx=0 tx=0).stop 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 shutdown_connections 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0cd00a33b0 0x7f0cd00a5870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ce8106f10 0x7f0ce8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce8102790 0x7f0ce8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 --2- 172.21.15.66:0/651064056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ce8101de0 0x7f0ce80744f0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:45.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 >> 172.21.15.66:0/651064056 conn(0x7f0ce80fd8e0 msgr2=0x7f0ce80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:45.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 shutdown_connections 2024-09-15T22:55:45.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:45.447+0000 7f0ced451640 1 -- 172.21.15.66:0/651064056 wait complete. 2024-09-15T22:55:46.139 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.140 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.141 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.142 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.142 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.142 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.142 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:55:46.142 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:46 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:55:46.172 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:55:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:55:46.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:46 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:55:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T22:55:46.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:46 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T22:55:46.462 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:46.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/1952679078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 msgr2=0x7f0e481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:46.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/1952679078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e481029b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009900 tx=0x7f0e3c02a480 comp rx=0 tx=0).stop 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/1952679078 shutdown_connections 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/1952679078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/1952679078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e481029b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/1952679078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 0x7f0e48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/1952679078 >> 172.21.15.66:0/1952679078 conn(0x7f0e480fc7d0 msgr2=0x7f0e480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/1952679078 shutdown_connections 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/1952679078 wait complete. 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 Processor -- start 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.965+0000 7f0e4e9fa640 1 -- start start 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 0x7f0e480fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:46.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e480fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48110f80 con 0x7f0e48102570 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48110e00 con 0x7f0e48102ef0 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4e9fa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e48111100 con 0x7f0e48100e20 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35040/0 (socket says 172.21.15.66:35040) 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 -- 172.21.15.66:0/638266315 learned_addr learned my addr 172.21.15.66:0/638266315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e480fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e47fff640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 0x7f0e480fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 -- 172.21.15.66:0/638266315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 msgr2=0x7f0e480fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 0x7f0e480fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 -- 172.21.15.66:0/638266315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 msgr2=0x7f0e480fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e480fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 -- 172.21.15.66:0/638266315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e481a6a70 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e480fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.966+0000 7f0e477fe640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006010 tx=0x7f0e3c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.967+0000 7f0e457fa640 1 -- 172.21.15.66:0/638266315 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c03f070 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.967+0000 7f0e457fa640 1 -- 172.21.15.66:0/638266315 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e3c031c30 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.967+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e481a6d00 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.967+0000 7f0e457fa640 1 -- 172.21.15.66:0/638266315 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c035030 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.967+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e481a7190 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.969+0000 7f0e457fa640 1 -- 172.21.15.66:0/638266315 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0e3c042070 con 0x7f0e48102570 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.969+0000 7f0e50dd3740 1 Processor -- start 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 -- start start 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addb6370 0x55e5addb8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5add112f0 con 0x55e5addab5d0 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5adcb8cf0 con 0x55e5addb6370 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5add0d2b0 con 0x55e5addacb40 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35048/0 (socket says 172.21.15.66:35048) 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 -- 172.21.15.66:0/1177257077 learned_addr learned my addr 172.21.15.66:0/1177257077 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e477fe640 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addb6370 0x55e5addb8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e457fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 0x7f0e300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 -- 172.21.15.66:0/1177257077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 msgr2=0x55e5addab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 0x7f0e300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 -- 172.21.15.66:0/1177257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addb6370 msgr2=0x55e5addb8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addb6370 0x55e5addb8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e47fff640 1 -- 172.21.15.66:0/1177257077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5adc9d3a0 con 0x55e5addab5d0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.970+0000 7f0e457fa640 1 -- 172.21.15.66:0/638266315 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0e3c0f0860 con 0x7f0e48102570 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.971+0000 7f0e47fff640 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009c90 tx=0x7f0e380117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f9c72d73239dca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.971+0000 7f0e2e7fc640 1 -- 172.21.15.66:0/1177257077 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38012450 con 0x55e5addab5d0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.971+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 0x7f0e300a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e400099e0 tx=0x7f0e40004ab0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.971+0000 7f0e2e7fc640 1 -- 172.21.15.66:0/1177257077 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e38012ad0 con 0x55e5addab5d0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.971+0000 7f0e2e7fc640 1 -- 172.21.15.66:0/1177257077 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800fc30 con 0x55e5addab5d0 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1177257077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 msgr2=0x55e5addaba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009c90 tx=0x7f0e380117b0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1177257077 shutdown_connections 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addb6370 0x55e5addb8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addab5d0 0x55e5addaba10 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1177257077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1177257077 >> 172.21.15.66:0/1177257077 conn(0x55e5add74310 msgr2=0x55e5adda7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1177257077 shutdown_connections 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1177257077 wait complete. 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 -- start start 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.972+0000 7f0e50dd3740 1 Processor -- start 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addb2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5addb9070 con 0x55e5addb6370 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e5adccc060 con 0x55e5addacb40 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e5addb91f0 con 0x55e5addab5d0 2024-09-15T22:55:47.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e50dd3740 10 client.0 _ll_register_callbacks cb 0x55e5ada1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35060/0 (socket says 172.21.15.66:35060) 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3139100116 learned_addr learned my addr 172.21.15.66:0/3139100116 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e477fe640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addb2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3139100116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 msgr2=0x55e5addb5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 msgr2=0x55e5addb2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addb2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3139100116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ada823c0 con 0x55e5addb6370 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0e40010430 tx=0x7f0e40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855f5fe05ba3ab19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e277fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:47.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.973+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40019070 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0e40020850 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e38012ad0 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0e40032050 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 10 client.17733 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e5addc4ae0 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e38012ad0 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0e40021cb0 con 0x55e5addb6370 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 10 client.17733 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 10 client.17733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 20 client.17733 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5addc5fa0 0x55e5addc8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 4 client.17733 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.974+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5add1e860 con 0x55e5addc5fa0 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.975+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5addc5fa0 0x55e5addc8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.975+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5addc5fa0 0x55e5addc8440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3132390a6bb5924c server_cookie=501c9cb2cc763d84 in_seq=0 out_seq=0 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.975+0000 7f0e277fe640 10 client.17733 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e277fe640 1 -- 172.21.15.66:0/3139100116 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5add1e860 con 0x55e5addc5fa0 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e277fe640 10 client.17733 handle_command_reply: tid=0 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 client.17733 shutdown 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 msgr2=0x55e5addb34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0e40010430 tx=0x7f0e40004a40 comp rx=0 tx=0).stop 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 shutdown_connections 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb34d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5addc5fa0 0x55e5addc8440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addb2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3139100116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e277fe640 0 client.17733 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:47.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 >> 172.21.15.66:0/3139100116 conn(0x55e5add74310 msgr2=0x55e5addad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 shutdown_connections 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3139100116 wait complete. 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.976+0000 7f0e50dd3740 20 client.17733 trim_cache size 0 max 16384 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 Processor -- start 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 -- start start 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addab5d0 0x55e5addc2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addaac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481b1410 con 0x55e5addb6370 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481b2f50 con 0x55e5addab5d0 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.989+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481b1ae0 con 0x55e5addacb40 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35076/0 (socket says 172.21.15.66:35076) 2024-09-15T22:55:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 -- 172.21.15.66:0/1935098223 learned_addr learned my addr 172.21.15.66:0/1935098223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e47fff640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addab5d0 0x55e5addc2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e477fe640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addaac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 -- 172.21.15.66:0/1935098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 msgr2=0x55e5addaac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addaac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 -- 172.21.15.66:0/1935098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addab5d0 msgr2=0x55e5addc2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addab5d0 0x55e5addc2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 -- 172.21.15.66:0/1935098223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5addb14c0 con 0x55e5addb6370 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e477fe640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addaac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0e40030040 tx=0x7f0e40009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0c5ea9fa0830d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e2dffb640 1 -- 172.21.15.66:0/1935098223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4002f070 con 0x55e5addb6370 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e2dffb640 1 -- 172.21.15.66:0/1935098223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e40025030 con 0x55e5addb6370 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.990+0000 7f0e2dffb640 1 -- 172.21.15.66:0/1935098223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40019070 con 0x55e5addb6370 2024-09-15T22:55:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1935098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 msgr2=0x55e5addb7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0e40030040 tx=0x7f0e40009f20 comp rx=0 tx=0).stop 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1935098223 shutdown_connections 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addb7760 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addacb40 0x55e5addaac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/1935098223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addab5d0 0x55e5addc2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1935098223 >> 172.21.15.66:0/1935098223 conn(0x55e5add74310 msgr2=0x55e5addb1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1935098223 shutdown_connections 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- 172.21.15.66:0/1935098223 wait complete. 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.991+0000 7f0e50dd3740 1 -- start start 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 Processor -- start 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addbe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481b2880 con 0x55e5addb6370 2024-09-15T22:55:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481b21b0 con 0x55e5addacb40 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e481af410 con 0x55e5addab5d0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e50dd3740 10 client.0 _ll_register_callbacks cb 0x7f0e4000fcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e477fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addbe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35088/0 (socket says 172.21.15.66:35088) 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3845297245 learned_addr learned my addr 172.21.15.66:0/3845297245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3845297245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 msgr2=0x55e5addb0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 msgr2=0x55e5addbe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addbe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e4cf97640 1 -- 172.21.15.66:0/3845297245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5addcd790 con 0x55e5addb6370 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.992+0000 7f0e477fe640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addbe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e4cf97640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0e40020ab0 tx=0x7f0e40010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd0ade6d351e525 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:47.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4002f070 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f0e40020650 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e40025030 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0e4004a050 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 10 client.17739 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e5ade30df0 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e40025030 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0e40021440 con 0x55e5addb6370 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 10 client.17739 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 20 client.17739 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5ade31400 0x55e5ade337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:47.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 4 client.17739 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.993+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5add18d70 con 0x55e5ade31400 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5ade31400 0x55e5ade337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e47fff640 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5ade31400 0x55e5ade337f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=198546ed93d264fb server_cookie=375dc0b4fab8161 in_seq=0 out_seq=0 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e277fe640 10 client.17739 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e277fe640 1 -- 172.21.15.66:0/3845297245 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5add18d70 con 0x55e5ade31400 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e277fe640 10 client.17739 handle_command_reply: tid=0 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e50dd3740 1 client.17739 shutdown 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 msgr2=0x55e5addbe990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.994+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0e40020ab0 tx=0x7f0e40010cc0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 shutdown_connections 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5addb6370 0x55e5addbe990 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55e5ade31400 0x55e5ade337f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5addacb40 0x55e5addbe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 --2- 172.21.15.66:0/3845297245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5addab5d0 0x55e5addb0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 >> 172.21.15.66:0/3845297245 conn(0x55e5add74310 msgr2=0x55e5addb47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e277fe640 0 client.17739 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 shutdown_connections 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 1 -- 172.21.15.66:0/3845297245 wait complete. 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e50dd3740 20 client.17739 trim_cache size 0 max 16384 2024-09-15T22:55:47.014 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 msgr2=0x7f0e300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 0x7f0e300a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e400099e0 tx=0x7f0e40004ab0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 msgr2=0x7f0e480fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006010 tx=0x7f0e3c003c10 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 shutdown_connections 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e300a33b0 0x7f0e300a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e48102ef0 0x7f0e480fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e48102570 0x7f0e480fd1c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 --2- 172.21.15.66:0/638266315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e48100e20 0x7f0e480fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:47.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.995+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 >> 172.21.15.66:0/638266315 conn(0x7f0e480fc7d0 msgr2=0x7f0e4806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:47.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.996+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 shutdown_connections 2024-09-15T22:55:47.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:46.996+0000 7f0e4e9fa640 1 -- 172.21.15.66:0/638266315 wait complete. 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: pgmap v323: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:55:47.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:55:47.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:47 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: pgmap v323: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:55:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:55:47.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:55:47.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:47 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: pgmap v323: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:55:47.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:47 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:55:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:48 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:55:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:48 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:55:48.787 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:55:48.787 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:55:48.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:48 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:55:48.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:48 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:55:48.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:48 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-15T22:55:48.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:48 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi066 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T22:55:49.055 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 -- 172.21.15.66:0/984426642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 msgr2=0x7f68f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/984426642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4101200 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009900 tx=0x7f68f002a480 comp rx=0 tx=0).stop 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 -- 172.21.15.66:0/984426642 shutdown_connections 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/984426642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 0x7f68f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/984426642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 0x7f68f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/984426642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4101200 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 -- 172.21.15.66:0/984426642 >> 172.21.15.66:0/984426642 conn(0x7f68f40fc7d0 msgr2=0x7f68f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 -- 172.21.15.66:0/984426642 shutdown_connections 2024-09-15T22:55:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.573+0000 7f68fbd1d640 1 -- 172.21.15.66:0/984426642 wait complete. 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 Processor -- start 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 -- start start 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 0x7f68f4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 0x7f68f419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4110f80 con 0x7f68f4100e20 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4110e00 con 0x7f68f4102570 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fbd1d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4111100 con 0x7f68f4102ef0 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35108/0 (socket says 172.21.15.66:35108) 2024-09-15T22:55:49.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 -- 172.21.15.66:0/537255983 learned_addr learned my addr 172.21.15.66:0/537255983 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f92b8640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 0x7f68f4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 0x7f68f419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 -- 172.21.15.66:0/537255983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 msgr2=0x7f68f419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 0x7f68f419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 -- 172.21.15.66:0/537255983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 msgr2=0x7f68f4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.574+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 0x7f68f4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68f9ab9640 1 -- 172.21.15.66:0/537255983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f419d400 con 0x7f68f4100e20 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f68f0006010 tx=0x7f68f0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68eaffd640 1 -- 172.21.15.66:0/537255983 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f003f070 con 0x7f68f4100e20 2024-09-15T22:55:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68eaffd640 1 -- 172.21.15.66:0/537255983 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f0031c30 con 0x7f68f4100e20 2024-09-15T22:55:49.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f419d690 con 0x7f68f4100e20 2024-09-15T22:55:49.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68eaffd640 1 -- 172.21.15.66:0/537255983 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0035030 con 0x7f68f4100e20 2024-09-15T22:55:49.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.575+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f41a4fd0 con 0x7f68f4100e20 2024-09-15T22:55:49.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.577+0000 7f68eaffd640 1 -- 172.21.15.66:0/537255983 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f68f0042070 con 0x7f68f4100e20 2024-09-15T22:55:49.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 Processor -- start 2024-09-15T22:55:49.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 -- start start 2024-09-15T22:55:49.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839d7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c98392f280 con 0x55c9839ca480 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c9838d6b10 con 0x55c9839d4d40 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.578+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c98392b240 con 0x55c9839c9b60 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68fa2ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68fa2ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:50620/0 (socket says 172.21.15.66:50620) 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35122/0 (socket says 172.21.15.66:35122) 2024-09-15T22:55:49.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68fa2ba640 1 -- 172.21.15.66:0/435505388 learned_addr learned my addr 172.21.15.66:0/435505388 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68eaffd640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 0x7f68e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 0x7f68e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68eaffd640 1 -- 172.21.15.66:0/537255983 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f68f00f0520 con 0x7f68f4100e20 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 -- 172.21.15.66:0/435505388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 msgr2=0x55c9839c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 -- 172.21.15.66:0/435505388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 msgr2=0x55c9839d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 -- 172.21.15.66:0/435505388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9838e31f0 con 0x55c9839d4d40 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.579+0000 7f68f92b8640 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839d7130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005d00 tx=0x7f68e40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a922da76b9e0846f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 0x7f68e00a58f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec004ab0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68dffff640 1 -- 172.21.15.66:0/435505388 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e401c480 con 0x55c9839d4d40 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68dffff640 1 -- 172.21.15.66:0/435505388 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e401cb00 con 0x55c9839d4d40 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68dffff640 1 -- 172.21.15.66:0/435505388 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011be0 con 0x55c9839d4d40 2024-09-15T22:55:49.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 -- 172.21.15.66:0/435505388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 msgr2=0x55c9839d7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839d7130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005d00 tx=0x7f68e40107a0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 -- 172.21.15.66:0/435505388 shutdown_connections 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839d7130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/435505388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c9839c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.580+0000 7f68fe0f6740 1 -- 172.21.15.66:0/435505388 >> 172.21.15.66:0/435505388 conn(0x55c9839c60f0 msgr2=0x55c9839c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- 172.21.15.66:0/435505388 shutdown_connections 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- 172.21.15.66:0/435505388 wait complete. 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- start start 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 Processor -- start 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839d4d40 0x55c9839d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9839d7910 con 0x55c9839ca480 2024-09-15T22:55:49.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c9838e9f10 con 0x55c9839c9b60 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c9839d7a90 con 0x55c9839d4d40 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.581+0000 7f68fe0f6740 10 client.0 _ll_register_callbacks cb 0x55c9838b2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42340/0 (socket says 172.21.15.66:42340) 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35134/0 (socket says 172.21.15.66:35134) 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f9ab9640 1 -- 172.21.15.66:0/3234544839 learned_addr learned my addr 172.21.15.66:0/3234544839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839d4d40 0x55c9839d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 -- 172.21.15.66:0/3234544839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839d4d40 msgr2=0x55c9839d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839d4d40 0x55c9839d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 -- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 msgr2=0x55c9839d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 -- 172.21.15.66:0/3234544839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9836a06a0 con 0x55c9839ca480 2024-09-15T22:55:49.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68f92b8640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005d00 tx=0x7f68e40058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f6c246ecc246d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e402b060 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f68e401c480 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68e401cb00 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.582+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f68e4032050 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 10 client.17751 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c9839e34f0 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e401cb00 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f68e40266a0 con 0x55c9839ca480 2024-09-15T22:55:49.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 10 client.17751 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 20 client.17751 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9839e49b0 0x55c9839e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 4 client.17751 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c98393c7f0 con 0x55c9839e49b0 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.583+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9839e49b0 0x55c9839e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.584+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9839e49b0 0x55c9839e6da0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844ef7a7a790a02d server_cookie=bd951bef1a687163 in_seq=0 out_seq=0 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.584+0000 7f68dd7fa640 10 client.17751 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.584+0000 7f68dd7fa640 1 -- 172.21.15.66:0/3234544839 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c98393c7f0 con 0x55c9839e49b0 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.584+0000 7f68dd7fa640 10 client.17751 handle_command_reply: tid=0 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.584+0000 7f68fe0f6740 1 client.17751 shutdown 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 msgr2=0x55c9839d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005d00 tx=0x7f68e40058c0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 shutdown_connections 2024-09-15T22:55:49.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839d4d40 0x55c9839d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839d2140 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9839e49b0 0x55c9839e6da0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/3234544839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839c9b60 0x55c9839d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 >> 172.21.15.66:0/3234544839 conn(0x55c9839c60f0 msgr2=0x55c9839cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68dd7fa640 0 client.17751 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 shutdown_connections 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 1 -- 172.21.15.66:0/3234544839 wait complete. 2024-09-15T22:55:49.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.585+0000 7f68fe0f6740 20 client.17751 trim_cache size 0 max 16384 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 Processor -- start 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 -- start start 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839ca480 0x55c9839ec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839ec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41af0e0 con 0x55c9839c9b60 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41b0c20 con 0x55c9839d4d40 2024-09-15T22:55:49.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41af7b0 con 0x55c9839ca480 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35144/0 (socket says 172.21.15.66:35144) 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 -- 172.21.15.66:0/1205850634 learned_addr learned my addr 172.21.15.66:0/1205850634 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f92b8640 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839ca480 0x55c9839ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 -- 172.21.15.66:0/1205850634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839ca480 msgr2=0x55c9839ec340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839ca480 0x55c9839ec340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 -- 172.21.15.66:0/1205850634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 msgr2=0x55c9839ec880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839ec880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.603+0000 7f68f9ab9640 1 -- 172.21.15.66:0/1205850634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9839c1830 con 0x55c9839c9b60 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f68f00bc4d0 tx=0x7f68f003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d17252340e5900 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68df7fe640 1 -- 172.21.15.66:0/1205850634 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0049040 con 0x55c9839c9b60 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68df7fe640 1 -- 172.21.15.66:0/1205850634 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f0031de0 con 0x55c9839c9b60 2024-09-15T22:55:49.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68df7fe640 1 -- 172.21.15.66:0/1205850634 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00ba8d0 con 0x55c9839c9b60 2024-09-15T22:55:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68fe0f6740 1 -- 172.21.15.66:0/1205850634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 msgr2=0x55c9839d3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f68f00bc4d0 tx=0x7f68f003d040 comp rx=0 tx=0).stop 2024-09-15T22:55:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.604+0000 7f68fe0f6740 1 -- 172.21.15.66:0/1205850634 shutdown_connections 2024-09-15T22:55:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839ec880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839ca480 0x55c9839ec340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/1205850634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839c9b60 0x55c9839d3a60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- 172.21.15.66:0/1205850634 >> 172.21.15.66:0/1205850634 conn(0x55c9839c60f0 msgr2=0x55c9839d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- 172.21.15.66:0/1205850634 shutdown_connections 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- 172.21.15.66:0/1205850634 wait complete. 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- start start 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 Processor -- start 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c983a4ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41b0550 con 0x55c9839ca480 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41afe80 con 0x55c9839d4d40 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41ad0e0 con 0x55c9839c9b60 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68fe0f6740 10 client.0 _ll_register_callbacks cb 0x7f68ec0078e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.605+0000 7f68f92b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35160/0 (socket says 172.21.15.66:35160) 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 -- 172.21.15.66:0/2768156158 learned_addr learned my addr 172.21.15.66:0/2768156158 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c983a4ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 -- 172.21.15.66:0/2768156158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 msgr2=0x55c983a4ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c983a4ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 -- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 msgr2=0x55c9839dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839dd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 -- 172.21.15.66:0/2768156158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c983a47ed0 con 0x55c9839ca480 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c983a4ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68fa2ba640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68f92b8640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f68e40107e0 tx=0x7f68e4005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cad2b29872839d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:55:49.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4026680 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f0031de0 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.606+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7f68e4026820 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f68e4004020 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 10 client.17757 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c983a53890 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f0031de0 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f68e40117b0 con 0x55c9839ca480 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 10 client.17757 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 20 client.17757 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c983a54000 0x55c983a56420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:49.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 4 client.17757 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:55:49.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c983936d00 con 0x55c983a54000 2024-09-15T22:55:49.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.607+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c983a54000 0x55c983a56420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:49.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.608+0000 7f68f9ab9640 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c983a54000 0x55c983a56420 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23799c12fc057e2e server_cookie=fc7cab8747d3c0cb in_seq=0 out_seq=0 2024-09-15T22:55:49.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.608+0000 7f68dd7fa640 10 client.17757 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68dd7fa640 1 -- 172.21.15.66:0/2768156158 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c983936d00 con 0x55c983a54000 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68dd7fa640 10 client.17757 handle_command_reply: tid=0 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 client.17757 shutdown 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 msgr2=0x55c9839dcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f68e40107e0 tx=0x7f68e4005ed0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 shutdown_connections 2024-09-15T22:55:49.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c983a54000 0x55c983a56420 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c9839d4d40 0x55c9839dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9839ca480 0x55c9839dcce0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68dd7fa640 0 client.17757 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 --2- 172.21.15.66:0/2768156158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c9839c9b60 0x55c983a4ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 >> 172.21.15.66:0/2768156158 conn(0x55c9839c60f0 msgr2=0x55c9839cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 shutdown_connections 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 1 -- 172.21.15.66:0/2768156158 wait complete. 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.609+0000 7f68fe0f6740 20 client.17757 trim_cache size 0 max 16384 2024-09-15T22:55:49.616 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:55:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "b71c2e9b-2fd0-4a17-afcf-7716cec3c0b9", 2024-09-15T22:55:49.617 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:55:49.617 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:49.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 msgr2=0x7f68e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 0x7f68e00a58f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f68ec007fd0 tx=0x7f68ec004ab0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 msgr2=0x7f68f4198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f68f0006010 tx=0x7f68f0003c10 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 shutdown_connections 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f68e00a3430 0x7f68e00a58f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68f4102ef0 0x7f68f419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68f4102570 0x7f68f4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 --2- 172.21.15.66:0/537255983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68f4100e20 0x7f68f4198450 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 >> 172.21.15.66:0/537255983 conn(0x7f68f40fc7d0 msgr2=0x7f68f406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 shutdown_connections 2024-09-15T22:55:49.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:49.610+0000 7f68fbd1d640 1 -- 172.21.15.66:0/537255983 wait complete. 2024-09-15T22:55:49.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:49 smithi066 ceph-mon[31185]: pgmap v324: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 KiB/s wr, 13 op/s 2024-09-15T22:55:49.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:49 smithi087 ceph-mon[35290]: pgmap v324: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 KiB/s wr, 13 op/s 2024-09-15T22:55:49.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:49 smithi184 ceph-mon[35203]: pgmap v324: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 KiB/s wr, 13 op/s 2024-09-15T22:55:50.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:50.467 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:50 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:55:50.810 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:50 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:50.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:50 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:55:51.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/3185287918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102ef0 msgr2=0x7fb3c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/3185287918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102ef0 0x7fb3c810da40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009ca0 tx=0x7fb3c002a950 comp rx=0 tx=0).stop 2024-09-15T22:55:51.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/3185287918 shutdown_connections 2024-09-15T22:55:51.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/3185287918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102ef0 0x7fb3c810da40 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/3185287918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8102570 0x7fb3c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/3185287918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8100e20 0x7fb3c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/3185287918 >> 172.21.15.66:0/3185287918 conn(0x7fb3c80fc7d0 msgr2=0x7fb3c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/3185287918 shutdown_connections 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.362+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/3185287918 wait complete. 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 Processor -- start 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 -- start start 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 0x7fb3c8107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 0x7fb3c8108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8110f80 con 0x7fb3c8102570 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8110e00 con 0x7fb3c8102ef0 2024-09-15T22:55:51.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cfe4b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c8111100 con 0x7fb3c8100e20 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cdbe7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 0x7fb3c8107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35176/0 (socket says 172.21.15.66:35176) 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/1234331935 learned_addr learned my addr 172.21.15.66:0/1234331935 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 0x7fb3c8108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/1234331935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 msgr2=0x7fb3c8107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 0x7fb3c8107ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/1234331935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 msgr2=0x7fb3c8108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 0x7fb3c8108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/1234331935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c81a6980 con 0x7fb3c8102570 2024-09-15T22:55:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 0x7fb3c8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:55:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.363+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 0x7fb3c8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800e9f0 tx=0x7fb3b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3beffd640 1 -- 172.21.15.66:0/1234331935 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800cd80 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3beffd640 1 -- 172.21.15.66:0/1234331935 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8005500 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3beffd640 1 -- 172.21.15.66:0/1234331935 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8010690 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c81a6c70 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.364+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c81a7160 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.366+0000 7fb3beffd640 1 -- 172.21.15.66:0/1234331935 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb3b80046c0 con 0x7fb3c8102570 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3d2224740 1 Processor -- start 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3d2224740 1 -- start start 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3beffd640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 0x7fb3b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x56375372b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.367+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753738a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3d2224740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5637536912e0 con 0x56375372bdc0 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3d2224740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563753638ce0 con 0x56375372b4a0 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3d2224740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56375368d2a0 con 0x563753736680 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 0x7fb3b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cdbe7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x56375372b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35192/0 (socket says 172.21.15.66:35192) 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4133698640 learned_addr learned my addr 172.21.15.66:0/4133698640 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3beffd640 1 -- 172.21.15.66:0/1234331935 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fb3b80d0550 con 0x7fb3c8102570 2024-09-15T22:55:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4133698640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 msgr2=0x563753738a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753738a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4133698640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 msgr2=0x56375372b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x56375372b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4133698640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375361d440 con 0x56375372bdc0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x56375372b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097d0 tx=0x7fb3b800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c56daa8c3001efc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.368+0000 7fb3b3fff640 1 -- 172.21.15.66:0/4133698640 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b805b040 con 0x56375372bdc0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.369+0000 7fb3b3fff640 1 -- 172.21.15.66:0/4133698640 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b809cb00 con 0x56375372bdc0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.369+0000 7fb3b3fff640 1 -- 172.21.15.66:0/4133698640 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8098a70 con 0x56375372bdc0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 0x7fb3b40a58f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x563753728db0 tx=0x7fb3c0005c30 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 -- 172.21.15.66:0/4133698640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 msgr2=0x563753736140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80097d0 tx=0x7fb3b800cf20 comp rx=0 tx=0).stop 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 -- 172.21.15.66:0/4133698640 shutdown_connections 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753738a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x563753736140 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4133698640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x56375372b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.370+0000 7fb3d2224740 1 -- 172.21.15.66:0/4133698640 >> 172.21.15.66:0/4133698640 conn(0x563753727a30 msgr2=0x563753727e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.371+0000 7fb3d2224740 1 -- 172.21.15.66:0/4133698640 shutdown_connections 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.371+0000 7fb3d2224740 1 -- 172.21.15.66:0/4133698640 wait complete. 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.371+0000 7fb3d2224740 1 -- start start 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.372+0000 7fb3d2224740 1 Processor -- start 2024-09-15T22:55:51.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.372+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x563753735f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.372+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.372+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x563753733780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.372+0000 7fb3d2224740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563753739250 con 0x563753736680 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3d2224740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56375364c050 con 0x56375372b4a0 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3d2224740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5637537393d0 con 0x56375372bdc0 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:50670/0 (socket says 172.21.15.66:50670) 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cdbe7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x563753735f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4131778732 learned_addr learned my addr 172.21.15.66:0/4131778732 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3d2224740 10 client.0 _ll_register_callbacks cb 0x56375368c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 msgr2=0x563753735f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x563753735f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4131778732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 msgr2=0x563753733780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x563753733780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 -- 172.21.15.66:0/4131778732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637534023c0 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b809cb00 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3b809c100 tx=0x7fb3b8098ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dbd8b19f6f9d9db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.373+0000 7fb3b17fa640 10 client.27100 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3b17fa640 1 -- 172.21.15.66:0/4131778732 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b809bd60 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3b17fa640 1 -- 172.21.15.66:0/4131778732 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fb3b808b2b0 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3b17fa640 1 -- 172.21.15.66:0/4131778732 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb3b80b5400 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 10 client.27100 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=49}) -- 0x563753739250 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3b17fa640 1 -- 172.21.15.66:0/4131778732 <== mon.1 v2:172.21.15.184:3300/0 4 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fb3b8092ce0 con 0x56375372bdc0 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 10 client.27100 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 10 client.27100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:51.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 20 client.27100 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:51.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x563753750860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.374+0000 7fb3d2224740 4 client.27100 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:55:51.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.375+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56375369e850 con 0x56375374e470 2024-09-15T22:55:51.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.375+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x563753750860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.375+0000 7fb3b17fa640 10 client.27100 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:51.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.375+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x563753750860 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27547cdc9a5198e1 server_cookie=982f660c3eee4cd in_seq=0 out_seq=0 2024-09-15T22:55:51.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3b17fa640 1 -- 172.21.15.66:0/4131778732 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56375369e850 con 0x56375374e470 2024-09-15T22:55:51.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3b17fa640 10 client.27100 handle_command_reply: tid=0 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 client.27100 shutdown 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 msgr2=0x563753733240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3b809c100 tx=0x7fb3b8098ca0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 shutdown_connections 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x563753733780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372bdc0 0x563753733240 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x563753750860 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4131778732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x563753735f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.376+0000 7fb3b17fa640 0 client.27100 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.377+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 >> 172.21.15.66:0/4131778732 conn(0x563753727a30 msgr2=0x56375372d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.377+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 shutdown_connections 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.377+0000 7fb3d2224740 1 -- 172.21.15.66:0/4131778732 wait complete. 2024-09-15T22:55:51.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.377+0000 7fb3d2224740 20 client.27100 trim_cache size 0 max 16384 2024-09-15T22:55:51.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.403+0000 7fb3d2224740 1 Processor -- start 2024-09-15T22:55:51.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.403+0000 7fb3d2224740 1 -- start start 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.403+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372b4a0 0x563753755e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.403+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372bdc0 0x5637537563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.403+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3d2224740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81ad0b0 con 0x563753736680 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3d2224740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81aebf0 con 0x56375372bdc0 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3d2224740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81ad780 con 0x56375372b4a0 2024-09-15T22:55:51.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35210/0 (socket says 172.21.15.66:35210) 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 -- 172.21.15.66:0/4218048688 learned_addr learned my addr 172.21.15.66:0/4218048688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372b4a0 0x563753755e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372bdc0 0x5637537563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 -- 172.21.15.66:0/4218048688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372b4a0 msgr2=0x563753755e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372b4a0 0x563753755e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 -- 172.21.15.66:0/4218048688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372bdc0 msgr2=0x5637537563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372bdc0 0x5637537563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.404+0000 7fb3ce3e8640 1 -- 172.21.15.66:0/4218048688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563753728bc0 con 0x563753736680 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.405+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009ca0 tx=0x7fb3c003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1407104c676231cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.406+0000 7fb3b37fe640 1 -- 172.21.15.66:0/4218048688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0034040 con 0x563753736680 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.406+0000 7fb3b37fe640 1 -- 172.21.15.66:0/4218048688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c004a070 con 0x563753736680 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.406+0000 7fb3b37fe640 1 -- 172.21.15.66:0/4218048688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0030440 con 0x563753736680 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- 172.21.15.66:0/4218048688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 msgr2=0x5637537319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009ca0 tx=0x7fb3c003d040 comp rx=0 tx=0).stop 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- 172.21.15.66:0/4218048688 shutdown_connections 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563753736680 0x5637537319e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372bdc0 0x5637537563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 --2- 172.21.15.66:0/4218048688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56375372b4a0 0x563753755e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- 172.21.15.66:0/4218048688 >> 172.21.15.66:0/4218048688 conn(0x563753727a30 msgr2=0x56375372e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- 172.21.15.66:0/4218048688 shutdown_connections 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- 172.21.15.66:0/4218048688 wait complete. 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.407+0000 7fb3d2224740 1 -- start start 2024-09-15T22:55:51.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 Processor -- start 2024-09-15T22:55:51.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x5637537427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753742d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81ae520 con 0x56375372bdc0 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81ade50 con 0x56375372b4a0 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.408+0000 7fb3d2224740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c81ab0f0 con 0x563753736680 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42408/0 (socket says 172.21.15.66:42408) 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 -- 172.21.15.66:0/1329117660 learned_addr learned my addr 172.21.15.66:0/1329117660 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3ce3e8640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753742d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3d2224740 10 client.0 _ll_register_callbacks cb 0x7fb3c4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:55:51.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x5637537427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 -- 172.21.15.66:0/1329117660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 msgr2=0x563753742d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753742d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 -- 172.21.15.66:0/1329117660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 msgr2=0x5637537427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x5637537427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.409+0000 7fb3cdbe7640 1 -- 172.21.15.66:0/1329117660 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637537433d0 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.410+0000 7fb3cdbe7640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x563753750dd0 tx=0x7fb3c4012c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2721ec9e2be3eb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.410+0000 7fb3b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.410+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402b060 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.410+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9591+0+0 (secure 0 0 0) 0x7fb3c4004050 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.410+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c004a070 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb3c4032050 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 10 client.27152 fetch_fsmap learned FSMap version 49 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5637537b8d40 con 0x56375372b4a0 2024-09-15T22:55:51.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3c004a070 con 0x56375372b4a0 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fb3c4025030 con 0x56375372b4a0 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 10 client.27152 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 20 client.27152 populate_metadata read hostname 'smithi066' 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x5637537bb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 4 client.27152 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.411+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563753698d60 con 0x56375374e470 2024-09-15T22:55:51.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.412+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x5637537bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:55:51.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.412+0000 7fb3b17fa640 10 client.27152 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.412+0000 7fb3cd3e6640 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x5637537bb470 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c91c353792916c server_cookie=d412e30f77a9fb01 in_seq=0 out_seq=0 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3b17fa640 1 -- 172.21.15.66:0/1329117660 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x563753698d60 con 0x56375374e470 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3b17fa640 10 client.27152 handle_command_reply: tid=0 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 client.27152 shutdown 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 msgr2=0x5637537474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x563753750dd0 tx=0x7fb3c4012c40 comp rx=0 tx=0).stop 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 shutdown_connections 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563753736680 0x563753742d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56375372bdc0 0x5637537427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56375374e470 0x5637537bb470 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 --2- 172.21.15.66:0/1329117660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56375372b4a0 0x5637537474c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.413+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 >> 172.21.15.66:0/1329117660 conn(0x563753727a30 msgr2=0x5637537319e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.414+0000 7fb3b17fa640 0 client.27152 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.414+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 shutdown_connections 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.414+0000 7fb3d2224740 1 -- 172.21.15.66:0/1329117660 wait complete. 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.414+0000 7fb3d2224740 20 client.27152 trim_cache size 0 max 16384 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (6147 inodes in the stack)", 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stdout: "b71c2e9b-2fd0-4a17-afcf-7716cec3c0b9": { 2024-09-15T22:55:51.419 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:55:51.420 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "b71c2e9b-2fd0-4a17-afcf-7716cec3c0b9", 2024-09-15T22:55:51.420 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:55:51.420 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:51.420 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:55:51.420 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 msgr2=0x7fb3b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 0x7fb3b40a58f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x563753728db0 tx=0x7fb3c0005c30 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 msgr2=0x7fb3c8108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800e9f0 tx=0x7fb3b800edf0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 shutdown_connections 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb3b40a3430 0x7fb3b40a58f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c8102ef0 0x7fb3c8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8102570 0x7fb3c8108020 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 --2- 172.21.15.66:0/1234331935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c8100e20 0x7fb3c8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:55:51.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.415+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 >> 172.21.15.66:0/1234331935 conn(0x7fb3c80fc7d0 msgr2=0x7fb3c8103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:55:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.416+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 shutdown_connections 2024-09-15T22:55:51.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:55:51.416+0000 7fb3cfe4b640 1 -- 172.21.15.66:0/1234331935 wait complete. 2024-09-15T22:55:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:51 smithi066 ceph-mon[31185]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-15T22:55:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:51 smithi087 ceph-mon[35290]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-15T22:55:51.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:51 smithi184 ceph-mon[35203]: pgmap v325: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-15T22:55:52.177 INFO:tasks.cephfs.filesystem:scrub status for tag:b71c2e9b-2fd0-4a17-afcf-7716cec3c0b9 - {'path': '/', 'tag': 'b71c2e9b-2fd0-4a17-afcf-7716cec3c0b9', 'options': 'recursive,force'} 2024-09-15T22:55:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:55:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:53 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:55:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:53 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: pgmap v326: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-15T22:55:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:53.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:53 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:55:54.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:54 smithi087 ceph-mon[35290]: pgmap v327: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 29 KiB/s wr, 102 op/s 2024-09-15T22:55:54.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:54 smithi184 ceph-mon[35203]: pgmap v327: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 29 KiB/s wr, 102 op/s 2024-09-15T22:55:54.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:54 smithi066 ceph-mon[31185]: pgmap v327: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 29 KiB/s wr, 102 op/s 2024-09-15T22:55:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:56 smithi087 ceph-mon[35290]: pgmap v328: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 29 KiB/s wr, 122 op/s 2024-09-15T22:55:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:56 smithi184 ceph-mon[35203]: pgmap v328: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 29 KiB/s wr, 122 op/s 2024-09-15T22:55:57.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:56 smithi066 ceph-mon[31185]: pgmap v328: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 29 KiB/s wr, 122 op/s 2024-09-15T22:55:59.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:55:58 smithi087 ceph-mon[35290]: pgmap v329: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 32 KiB/s wr, 150 op/s 2024-09-15T22:55:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:55:58 smithi184 ceph-mon[35203]: pgmap v329: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 32 KiB/s wr, 150 op/s 2024-09-15T22:55:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:55:58 smithi066 ceph-mon[31185]: pgmap v329: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 32 KiB/s wr, 150 op/s 2024-09-15T22:56:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:00 smithi087 ceph-mon[35290]: pgmap v330: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 34 KiB/s wr, 149 op/s 2024-09-15T22:56:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:00 smithi184 ceph-mon[35203]: pgmap v330: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 34 KiB/s wr, 149 op/s 2024-09-15T22:56:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:00 smithi066 ceph-mon[31185]: pgmap v330: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 34 KiB/s wr, 149 op/s 2024-09-15T22:56:03.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:02 smithi087 ceph-mon[35290]: pgmap v331: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 58 KiB/s wr, 164 op/s 2024-09-15T22:56:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:02 smithi184 ceph-mon[35203]: pgmap v331: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 58 KiB/s wr, 164 op/s 2024-09-15T22:56:03.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:02 smithi066 ceph-mon[31185]: pgmap v331: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 58 KiB/s wr, 164 op/s 2024-09-15T22:56:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:04 smithi087 ceph-mon[35290]: pgmap v332: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 49 KiB/s wr, 153 op/s 2024-09-15T22:56:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:05.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:05.100 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:04 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:04 smithi184 ceph-mon[35203]: pgmap v332: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 49 KiB/s wr, 153 op/s 2024-09-15T22:56:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:05.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:04 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:05.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:04 smithi066 ceph-mon[31185]: pgmap v332: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 49 KiB/s wr, 153 op/s 2024-09-15T22:56:05.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:05.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:04 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:06.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:06.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:06.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:07.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:06 smithi087 ceph-mon[35290]: pgmap v333: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 42 KiB/s wr, 77 op/s 2024-09-15T22:56:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:06 smithi184 ceph-mon[35203]: pgmap v333: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 42 KiB/s wr, 77 op/s 2024-09-15T22:56:07.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:06 smithi066 ceph-mon[31185]: pgmap v333: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 42 KiB/s wr, 77 op/s 2024-09-15T22:56:09.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:08 smithi087 ceph-mon[35290]: pgmap v334: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 60 op/s 2024-09-15T22:56:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:08 smithi184 ceph-mon[35203]: pgmap v334: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 60 op/s 2024-09-15T22:56:09.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:08 smithi066 ceph-mon[31185]: pgmap v334: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 67 KiB/s wr, 60 op/s 2024-09-15T22:56:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:10 smithi087 ceph-mon[35290]: pgmap v335: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 34 op/s 2024-09-15T22:56:11.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:10 smithi087 ceph-mon[35290]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:56:11.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:10 smithi184 ceph-mon[35203]: pgmap v335: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 34 op/s 2024-09-15T22:56:11.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:10 smithi184 ceph-mon[35203]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:56:11.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:10 smithi066 ceph-mon[31185]: pgmap v335: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 KiB/s wr, 34 op/s 2024-09-15T22:56:11.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:10 smithi066 ceph-mon[31185]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:56:13.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:12 smithi087 ceph-mon[35290]: pgmap v337: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-15T22:56:13.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:12 smithi184 ceph-mon[35203]: pgmap v337: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-15T22:56:13.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:12 smithi066 ceph-mon[31185]: pgmap v337: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-15T22:56:15.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:14 smithi087 ceph-mon[35290]: pgmap v338: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-15T22:56:15.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:14 smithi184 ceph-mon[35203]: pgmap v338: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-15T22:56:15.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:14 smithi066 ceph-mon[31185]: pgmap v338: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 19 op/s 2024-09-15T22:56:17.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:16 smithi087 ceph-mon[35290]: pgmap v339: 129 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 121 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-09-15T22:56:17.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:16 smithi184 ceph-mon[35203]: pgmap v339: 129 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 121 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-09-15T22:56:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:16 smithi066 ceph-mon[31185]: pgmap v339: 129 pgs: 3 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 121 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-09-15T22:56:19.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:18 smithi087 ceph-mon[35290]: pgmap v340: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-15T22:56:19.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:18 smithi184 ceph-mon[35203]: pgmap v340: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-15T22:56:19.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:18 smithi066 ceph-mon[31185]: pgmap v340: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-15T22:56:20.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:19 smithi087 ceph-mon[35290]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:56:20.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:19 smithi184 ceph-mon[35203]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:56:20.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:19 smithi066 ceph-mon[31185]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:56:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:20 smithi087 ceph-mon[35290]: pgmap v342: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-15T22:56:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:20 smithi184 ceph-mon[35203]: pgmap v342: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-15T22:56:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:20 smithi066 ceph-mon[31185]: pgmap v342: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-15T22:56:22.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:56:22.452 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:23.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 -- 172.21.15.66:0/2632796577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c102ef0 msgr2=0x7f197c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 --2- 172.21.15.66:0/2632796577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c102ef0 0x7f197c10da40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f196c009ca0 tx=0x7f196c02a950 comp rx=0 tx=0).stop 2024-09-15T22:56:23.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 -- 172.21.15.66:0/2632796577 shutdown_connections 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 --2- 172.21.15.66:0/2632796577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c102ef0 0x7f197c10da40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 --2- 172.21.15.66:0/2632796577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f197c102570 0x7f197c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 --2- 172.21.15.66:0/2632796577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c100e20 0x7f197c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 -- 172.21.15.66:0/2632796577 >> 172.21.15.66:0/2632796577 conn(0x7f197c0fc7d0 msgr2=0x7f197c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 -- 172.21.15.66:0/2632796577 shutdown_connections 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.036+0000 7f1984407640 1 -- 172.21.15.66:0/2632796577 wait complete. 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 Processor -- start 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 -- start start 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f197c102570 0x7f197c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c102ef0 0x7f197c1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f197c110f80 con 0x7f197c100e20 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f197c110e00 con 0x7f197c102ef0 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f1984407640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f197c111100 con 0x7f197c102570 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55562/0 (socket says 172.21.15.66:55562) 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 -- 172.21.15.66:0/3302323354 learned_addr learned my addr 172.21.15.66:0/3302323354 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19829a4640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c102ef0 0x7f197c1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 -- 172.21.15.66:0/3302323354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f197c102570 msgr2=0x7f197c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f197c102570 0x7f197c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 -- 172.21.15.66:0/3302323354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c102ef0 msgr2=0x7f197c1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c102ef0 0x7f197c1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.037+0000 7f19821a3640 1 -- 172.21.15.66:0/3302323354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c1a48f0 con 0x7f197c100e20 2024-09-15T22:56:23.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f19821a3640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f197400d950 tx=0x7f197400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f197b7fe640 1 -- 172.21.15.66:0/3302323354 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974017030 con 0x7f197c100e20 2024-09-15T22:56:23.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f197b7fe640 1 -- 172.21.15.66:0/3302323354 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1974004020 con 0x7f197c100e20 2024-09-15T22:56:23.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c1a4ac0 con 0x7f197c100e20 2024-09-15T22:56:23.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f197b7fe640 1 -- 172.21.15.66:0/3302323354 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740047a0 con 0x7f197c100e20 2024-09-15T22:56:23.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.038+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c1a5050 con 0x7f197c100e20 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f197b7fe640 1 -- 172.21.15.66:0/3302323354 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f19740041d0 con 0x7f197c100e20 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 Processor -- start 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 -- start start 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee797a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee88550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56122eddf2e0 con 0x56122ee88a90 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56122ed86ce0 con 0x56122ee79ce0 2024-09-15T22:56:23.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.041+0000 7f19867e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56122eddb2a0 con 0x56122ee793c0 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55568/0 (socket says 172.21.15.66:55568) 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 -- 172.21.15.66:0/93251839 learned_addr learned my addr 172.21.15.66:0/93251839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19821a3640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee88550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19829a4640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 -- 172.21.15.66:0/93251839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 msgr2=0x56122ee797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee797a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 -- 172.21.15.66:0/93251839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 msgr2=0x56122ee88550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee88550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 -- 172.21.15.66:0/93251839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56122ed6b440 con 0x56122ee88a90 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19821a3640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee88550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19829a4640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee797a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:23.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f197b7fe640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 0x7f19640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19829a4640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 0x7f19640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f19819a2640 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1970009b60 tx=0x7f197000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ea49517140fbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f197b7fe640 1 -- 172.21.15.66:0/3302323354 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f19740cfb70 con 0x7f197c100e20 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.042+0000 7f1978dea640 1 -- 172.21.15.66:0/93251839 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970009e50 con 0x56122ee88a90 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f1978dea640 1 -- 172.21.15.66:0/93251839 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1970005500 con 0x56122ee88a90 2024-09-15T22:56:23.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f1978dea640 1 -- 172.21.15.66:0/93251839 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970010690 con 0x56122ee88a90 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 -- 172.21.15.66:0/93251839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 msgr2=0x56122ee8ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19829a4640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 0x7f19640a58f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f196c030040 tx=0x7f196c005c30 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1970009b60 tx=0x7f197000e720 comp rx=0 tx=0).stop 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 -- 172.21.15.66:0/93251839 shutdown_connections 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee8ae80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee88550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 --2- 172.21.15.66:0/93251839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee797a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 -- 172.21.15.66:0/93251839 >> 172.21.15.66:0/93251839 conn(0x56122ee75a30 msgr2=0x56122ee75e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 -- 172.21.15.66:0/93251839 shutdown_connections 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.043+0000 7f19867e0740 1 -- 172.21.15.66:0/93251839 wait complete. 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 -- start start 2024-09-15T22:56:23.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 Processor -- start 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee85660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56122ee8b600 con 0x56122ee88a90 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56122ed9a050 con 0x56122ee79ce0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56122ee8b780 con 0x56122ee793c0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19867e0740 10 client.0 _ll_register_callbacks cb 0x56122edda160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19829a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19829a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55570/0 (socket says 172.21.15.66:55570) 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19829a4640 1 -- 172.21.15.66:0/2211919287 learned_addr learned my addr 172.21.15.66:0/2211919287 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19819a2640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee85660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.044+0000 7f19821a3640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 -- 172.21.15.66:0/2211919287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 msgr2=0x56122ee883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 -- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 msgr2=0x56122ee85660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee85660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 -- 172.21.15.66:0/2211919287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56122eb503c0 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19829a4640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f196c035000 tx=0x7f196c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc30569122494f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f1961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c034040 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f196c052470 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1970005500 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f196c052670 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19867e0740 10 client.17784 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56122ee97020 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.045+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1970005500 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f196c0495f0 con 0x56122ee88a90 2024-09-15T22:56:23.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 10 client.17784 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 10 client.17784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 20 client.17784 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee984e0 0x56122ee9a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 4 client.17784 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56122edec850 con 0x56122ee984e0 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19821a3640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee984e0 0x56122ee9a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f19821a3640 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee984e0 0x56122ee9a950 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5804673bb3a1bd server_cookie=987a3e0da11981ff in_seq=0 out_seq=0 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.046+0000 7f1961ffb640 10 client.17784 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f1961ffb640 1 -- 172.21.15.66:0/2211919287 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56122edec850 con 0x56122ee984e0 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f1961ffb640 10 client.17784 handle_command_reply: tid=0 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 client.17784 shutdown 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 msgr2=0x56122ee85ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f196c035000 tx=0x7f196c02a950 comp rx=0 tx=0).stop 2024-09-15T22:56:23.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 shutdown_connections 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee88a90 0x56122ee85ba0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee984e0 0x56122ee9a950 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee79ce0 0x56122ee85660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 --2- 172.21.15.66:0/2211919287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 >> 172.21.15.66:0/2211919287 conn(0x56122ee75a30 msgr2=0x56122ee7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.047+0000 7f1961ffb640 0 client.17784 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.048+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 shutdown_connections 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.048+0000 7f19867e0740 1 -- 172.21.15.66:0/2211919287 wait complete. 2024-09-15T22:56:23.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.048+0000 7f19867e0740 20 client.17784 trim_cache size 0 max 16384 2024-09-15T22:56:23.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 Processor -- start 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 -- start start 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 0x56122ee94900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee80c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1ad0a0 con 0x56122ee79ce0 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1aebe0 con 0x56122ee75a30 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19867e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1ad770 con 0x56122ee793c0 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55582/0 (socket says 172.21.15.66:55582) 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 -- 172.21.15.66:0/2028445754 learned_addr learned my addr 172.21.15.66:0/2028445754 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19821a3640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 0x56122ee94900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19819a2640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee80c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 -- 172.21.15.66:0/2028445754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 msgr2=0x56122ee80c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee80c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 -- 172.21.15.66:0/2028445754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 msgr2=0x56122ee94900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 0x56122ee94900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 -- 172.21.15.66:0/2028445754 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56122ee861a0 con 0x56122ee79ce0 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19821a3640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 0x56122ee94900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.065+0000 7f19829a4640 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f196c042040 tx=0x7f196c005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724250367638d0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f1963fff640 1 -- 172.21.15.66:0/2028445754 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c034030 con 0x56122ee79ce0 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f1963fff640 1 -- 172.21.15.66:0/2028445754 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f196c04d070 con 0x56122ee79ce0 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f1963fff640 1 -- 172.21.15.66:0/2028445754 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c0306a0 con 0x56122ee79ce0 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 -- 172.21.15.66:0/2028445754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 msgr2=0x56122eea0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f196c042040 tx=0x7f196c005cc0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 -- 172.21.15.66:0/2028445754 shutdown_connections 2024-09-15T22:56:23.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee79ce0 0x56122eea0220 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee793c0 0x56122ee80c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 --2- 172.21.15.66:0/2028445754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee75a30 0x56122ee94900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 -- 172.21.15.66:0/2028445754 >> 172.21.15.66:0/2028445754 conn(0x56122ee85d00 msgr2=0x56122ee804f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 -- 172.21.15.66:0/2028445754 shutdown_connections 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.066+0000 7f19867e0740 1 -- 172.21.15.66:0/2028445754 wait complete. 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 -- start start 2024-09-15T22:56:23.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 Processor -- start 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee793c0 0x56122ee8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee79ce0 0x56122ee8ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1ae510 con 0x56122ee75a30 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1ade40 con 0x56122ee793c0 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1ab0a0 con 0x56122ee79ce0 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19867e0740 10 client.0 _ll_register_callbacks cb 0x7f1970005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:23.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55598/0 (socket says 172.21.15.66:55598) 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 -- 172.21.15.66:0/2661808450 learned_addr learned my addr 172.21.15.66:0/2661808450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19819a2640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee793c0 0x56122ee8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 -- 172.21.15.66:0/2661808450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee79ce0 msgr2=0x56122ee8ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19829a4640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee79ce0 0x56122ee8ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee79ce0 0x56122ee8ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 -- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee793c0 msgr2=0x56122ee8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee793c0 0x56122ee8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.067+0000 7f19821a3640 1 -- 172.21.15.66:0/2661808450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56122ef021f0 con 0x56122ee75a30 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19821a3640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1974009fd0 tx=0x7f19740d31d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505334164bb5eaff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197409c120 con 0x56122ee75a30 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f19740860b0 con 0x56122ee75a30 2024-09-15T22:56:23.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196c04d070 con 0x56122ee75a30 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f197409ba20 con 0x56122ee75a30 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 10 client.17790 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56122ef033a0 con 0x56122ee75a30 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f196c04d070 con 0x56122ee75a30 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f1974098090 con 0x56122ee75a30 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 10 client.17790 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 20 client.17790 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee88a90 0x56122ef05b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 4 client.17790 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.068+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56122ede6d60 con 0x56122ee88a90 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f19819a2640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee88a90 0x56122ef05b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f19819a2640 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee88a90 0x56122ef05b00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc68868e1314f135 server_cookie=30b5a0eb05db877 in_seq=0 out_seq=0 2024-09-15T22:56:23.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f1961ffb640 10 client.17790 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f1961ffb640 1 -- 172.21.15.66:0/2661808450 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56122ede6d60 con 0x56122ee88a90 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f1961ffb640 10 client.17790 handle_command_reply: tid=0 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.069+0000 7f19867e0740 1 client.17790 shutdown 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 msgr2=0x56122ee91360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f1974009fd0 tx=0x7f19740d31d0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 shutdown_connections 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56122ee79ce0 0x56122ee8ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56122ee88a90 0x56122ef05b00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56122ee793c0 0x56122ee8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 --2- 172.21.15.66:0/2661808450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56122ee75a30 0x56122ee91360 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1961ffb640 0 client.17790 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 >> 172.21.15.66:0/2661808450 conn(0x56122ee85d00 msgr2=0x56122ee74350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 shutdown_connections 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 1 -- 172.21.15.66:0/2661808450 wait complete. 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f19867e0740 20 client.17790 trim_cache size 0 max 16384 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:56:23.077 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 msgr2=0x7f19640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 0x7f19640a58f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f196c030040 tx=0x7f196c005c30 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 msgr2=0x7f197c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f197400d950 tx=0x7f197400de10 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 shutdown_connections 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f19640a3430 0x7f19640a58f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f197c102ef0 0x7f197c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f197c102570 0x7f197c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 --2- 172.21.15.66:0/3302323354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f197c100e20 0x7f197c199330 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 >> 172.21.15.66:0/3302323354 conn(0x7f197c0fc7d0 msgr2=0x7f197c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:23.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 shutdown_connections 2024-09-15T22:56:23.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:23.070+0000 7f1984407640 1 -- 172.21.15.66:0/3302323354 wait complete. 2024-09-15T22:56:23.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:22 smithi066 ceph-mon[31185]: pgmap v343: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-09-15T22:56:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:22 smithi087 ceph-mon[35290]: pgmap v343: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-09-15T22:56:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:22 smithi184 ceph-mon[35203]: pgmap v343: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-09-15T22:56:24.092 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:56:24.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:56:24.355 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 -- 172.21.15.66:0/692637736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 msgr2=0x7fae30100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 --2- 172.21.15.66:0/692637736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae30100730 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fae20009930 tx=0x7fae2002a420 comp rx=0 tx=0).stop 2024-09-15T22:56:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 -- 172.21.15.66:0/692637736 shutdown_connections 2024-09-15T22:56:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 --2- 172.21.15.66:0/692637736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae3010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 --2- 172.21.15.66:0/692637736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 --2- 172.21.15.66:0/692637736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae30100730 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 -- 172.21.15.66:0/692637736 >> 172.21.15.66:0/692637736 conn(0x7fae30077210 msgr2=0x7fae300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 -- 172.21.15.66:0/692637736 shutdown_connections 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.167+0000 7fae36021640 1 -- 172.21.15.66:0/692637736 wait complete. 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 Processor -- start 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 -- start start 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae30101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae30112000 con 0x7fae30100350 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae30111e80 con 0x7fae30100d00 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae36021640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae30112180 con 0x7fae30106f50 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae2f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55620/0 (socket says 172.21.15.66:55620) 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae2f7fe640 1 -- 172.21.15.66:0/4024965189 learned_addr learned my addr 172.21.15.66:0/4024965189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.168+0000 7fae26ffd640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 -- 172.21.15.66:0/4024965189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 msgr2=0x7fae30101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2ffff640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae30101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae30101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 -- 172.21.15.66:0/4024965189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 msgr2=0x7fae30101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 -- 172.21.15.66:0/4024965189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae301a69e0 con 0x7fae30100350 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae26ffd640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2ffff640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae30101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2f7fe640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fae20009230 tx=0x7fae20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2003f030 con 0x7fae30100350 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae20003ad0 con 0x7fae30100350 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae301a6c70 con 0x7fae30100350 2024-09-15T22:56:25.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20035070 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.169+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae301a71a0 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.170+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae30100730 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.171+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fae20042030 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.173+0000 7fae2d7fa640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 0x7fae1c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.173+0000 7fae26ffd640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 0x7fae1c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.173+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fae200f0680 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.173+0000 7fae26ffd640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 0x7fae1c0a58f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae30102d60 tx=0x7fae1800b5f0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:25.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.177+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae200bcc30 con 0x7fae30100350 2024-09-15T22:56:25.192 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:24 smithi066 ceph-mon[31185]: pgmap v344: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:24 smithi087 ceph-mon[35290]: pgmap v344: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:25.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.391+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae30102800 con 0x7fae30100350 2024-09-15T22:56:25.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.392+0000 7fae2d7fa640 1 -- 172.21.15.66:0/4024965189 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11974 (secure 0 0 0) 0x7fae200bc530 con 0x7fae30100350 2024-09-15T22:56:25.393 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:56:25.393 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":49,"btime":"2024-09-15T22:55:08:140078+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:55:07.663373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:56:25.394 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 49 2024-09-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 msgr2=0x7fae1c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 0x7fae1c0a58f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae30102d60 tx=0x7fae1800b5f0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 msgr2=0x7fae301012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fae20009230 tx=0x7fae20004270 comp rx=0 tx=0).stop 2024-09-15T22:56:25.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 shutdown_connections 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fae1c0a3430 0x7fae1c0a58f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae30106f50 0x7fae30101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae30100d00 0x7fae30101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 --2- 172.21.15.66:0/4024965189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae30100350 0x7fae301012d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 >> 172.21.15.66:0/4024965189 conn(0x7fae30077210 msgr2=0x7fae300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 shutdown_connections 2024-09-15T22:56:25.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:25.394+0000 7fae36021640 1 -- 172.21.15.66:0/4024965189 wait complete. 2024-09-15T22:56:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:24 smithi184 ceph-mon[35203]: pgmap v344: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:26.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:56:26.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:26 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/4024965189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:56:26.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:26 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/4024965189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:56:26.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:26 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/4024965189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:56:26.433 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- 172.21.15.66:0/3875282642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 msgr2=0x7fd674103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 --2- 172.21.15.66:0/3875282642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd674103100 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd664009900 tx=0x7fd66402a480 comp rx=0 tx=0).stop 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- 172.21.15.66:0/3875282642 shutdown_connections 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 --2- 172.21.15.66:0/3875282642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd67410c150 0x7fd67410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 --2- 172.21.15.66:0/3875282642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd674103640 0x7fd67410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 --2- 172.21.15.66:0/3875282642 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd674103100 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- 172.21.15.66:0/3875282642 >> 172.21.15.66:0/3875282642 conn(0x7fd6740fc780 msgr2=0x7fd6740feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- 172.21.15.66:0/3875282642 shutdown_connections 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- 172.21.15.66:0/3875282642 wait complete. 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 Processor -- start 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.947+0000 7fd67b11b640 1 -- start start 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd674103640 0x7fd6741989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 0x7fd67419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111f90 con 0x7fd674102d20 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111e10 con 0x7fd67410c150 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd674112110 con 0x7fd674103640 2024-09-15T22:56:26.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55640/0 (socket says 172.21.15.66:55640) 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 -- 172.21.15.66:0/34343321 learned_addr learned my addr 172.21.15.66:0/34343321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd6796b8640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 0x7fd67419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 -- 172.21.15.66:0/34343321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd674103640 msgr2=0x7fd6741989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd673fff640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd674103640 0x7fd6741989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd674103640 0x7fd6741989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 -- 172.21.15.66:0/34343321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 msgr2=0x7fd67419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 0x7fd67419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 -- 172.21.15.66:0/34343321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67419d450 con 0x7fd674102d20 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd6796b8640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 0x7fd67419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd678eb7640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd664005ab0 tx=0x7fd6640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd671ffb640 1 -- 172.21.15.66:0/34343321 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66403f030 con 0x7fd674102d20 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd671ffb640 1 -- 172.21.15.66:0/34343321 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd664003ce0 con 0x7fd674102d20 2024-09-15T22:56:26.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.948+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67419d6e0 con 0x7fd674102d20 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.949+0000 7fd671ffb640 1 -- 172.21.15.66:0/34343321 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664035070 con 0x7fd674102d20 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.949+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741a5020 con 0x7fd674102d20 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.951+0000 7fd671ffb640 1 -- 172.21.15.66:0/34343321 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd664042030 con 0x7fd674102d20 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.951+0000 7fd67d4f4740 1 Processor -- start 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.951+0000 7fd67d4f4740 1 -- start start 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66b5d0 0x564e0c66ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c67cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e0c5d12f0 con 0x564e0c66cb40 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564e0c578cf0 con 0x564e0c66b5d0 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564e0c5cd2b0 con 0x564e0c67a780 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd671ffb640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 0x7fd65c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55656/0 (socket says 172.21.15.66:55656) 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 -- 172.21.15.66:0/2931548537 learned_addr learned my addr 172.21.15.66:0/2931548537 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd678eb7640 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66b5d0 0x564e0c66ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd673fff640 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c67cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 0x7fd65c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd671ffb640 1 -- 172.21.15.66:0/34343321 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd6640f0b50 con 0x7fd674102d20 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 -- 172.21.15.66:0/2931548537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 msgr2=0x564e0c67cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c67cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 -- 172.21.15.66:0/2931548537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66b5d0 msgr2=0x564e0c66ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66b5d0 0x564e0c66ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 -- 172.21.15.66:0/2931548537 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0c55d3a0 con 0x564e0c66cb40 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.952+0000 7fd6796b8640 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd66c010a30 tx=0x7fd66c010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f136a1bf708 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd65affd640 1 -- 172.21.15.66:0/2931548537 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c020070 con 0x564e0c66cb40 2024-09-15T22:56:26.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd65affd640 1 -- 172.21.15.66:0/2931548537 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c01bbd0 con 0x564e0c66cb40 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd65affd640 1 -- 172.21.15.66:0/2931548537 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0235e0 con 0x564e0c66cb40 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2931548537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 msgr2=0x564e0c66b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd6796b8640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 0x7fd65c0a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd66c01d000 tx=0x7fd66c019000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.953+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd66c010a30 tx=0x7fd66c010ef0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2931548537 shutdown_connections 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c67cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66b5d0 0x564e0c66ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2931548537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c66b090 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2931548537 >> 172.21.15.66:0/2931548537 conn(0x564e0c634310 msgr2=0x564e0c667c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2931548537 shutdown_connections 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2931548537 wait complete. 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- start start 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 Processor -- start 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c67a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c677a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e0c67d480 con 0x564e0c66cb40 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564e0c58c060 con 0x564e0c67a780 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.954+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564e0c67d600 con 0x564e0c66b5d0 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd67d4f4740 10 client.0 _ll_register_callbacks cb 0x564e0c2df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55658/0 (socket says 172.21.15.66:55658) 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 -- 172.21.15.66:0/540712290 learned_addr learned my addr 172.21.15.66:0/540712290 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd678eb7640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c67a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd6796b8640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c677a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 -- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 msgr2=0x564e0c67a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c67a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 -- 172.21.15.66:0/540712290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 msgr2=0x564e0c677a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c677a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 -- 172.21.15.66:0/540712290 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0c3423c0 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd673fff640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd6680106e0 tx=0x7fd668010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907095a8dd231d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd653fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66801d060 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd66800e8f0 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.955+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd66c01bbd0 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd668024050 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 10 client.17808 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564e0c688f80 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c01bbd0 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fd66800d3a0 con 0x564e0c66cb40 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 10 client.17808 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 10 client.17808 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 20 client.17808 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:26.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c68a490 0x564e0c68c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 4 client.17808 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e0c5de860 con 0x564e0c68a490 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.956+0000 7fd678eb7640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c68a490 0x564e0c68c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.957+0000 7fd653fff640 10 client.17808 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.957+0000 7fd678eb7640 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c68a490 0x564e0c68c8d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31ed10ec3e30a060 server_cookie=9d378014d89831e1 in_seq=0 out_seq=0 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.957+0000 7fd653fff640 1 -- 172.21.15.66:0/540712290 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e0c5de860 con 0x564e0c68a490 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.957+0000 7fd653fff640 10 client.17808 handle_command_reply: tid=0 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.957+0000 7fd67d4f4740 1 client.17808 shutdown 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 msgr2=0x564e0c677430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd6680106e0 tx=0x7fd668010ae0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 shutdown_connections 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c68a490 0x564e0c68c8d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c677a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c677430 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd653fff640 0 client.17808 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/540712290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c67a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 >> 172.21.15.66:0/540712290 conn(0x564e0c634310 msgr2=0x564e0c66d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 shutdown_connections 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 1 -- 172.21.15.66:0/540712290 wait complete. 2024-09-15T22:56:26.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.958+0000 7fd67d4f4740 20 client.17808 trim_cache size 0 max 16384 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 Processor -- start 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 -- start start 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 0x564e0c676430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c6921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ad0c0 con 0x564e0c66b5d0 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741aec00 con 0x564e0c66cb40 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ad790 con 0x564e0c67a780 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd678eb7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd678eb7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55668/0 (socket says 172.21.15.66:55668) 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd678eb7640 1 -- 172.21.15.66:0/2743185005 learned_addr learned my addr 172.21.15.66:0/2743185005 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd6796b8640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c6921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd673fff640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 0x564e0c676430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd678eb7640 1 -- 172.21.15.66:0/2743185005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 msgr2=0x564e0c6921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.971+0000 7fd678eb7640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c6921a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd678eb7640 1 -- 172.21.15.66:0/2743185005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 msgr2=0x564e0c676430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd678eb7640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 0x564e0c676430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd678eb7640 1 -- 172.21.15.66:0/2743185005 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0c68cf50 con 0x564e0c66b5d0 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd673fff640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 0x564e0c676430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd678eb7640 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd6640b8e00 tx=0x7fd6640e7770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2742896e664ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd65a7fc640 1 -- 172.21.15.66:0/2743185005 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664049040 con 0x564e0c66b5d0 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd65a7fc640 1 -- 172.21.15.66:0/2743185005 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6640a70b0 con 0x564e0c66b5d0 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.972+0000 7fd65a7fc640 1 -- 172.21.15.66:0/2743185005 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66403b460 con 0x564e0c66b5d0 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2743185005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 msgr2=0x564e0c686720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd6640b8e00 tx=0x7fd6640e7770 comp rx=0 tx=0).stop 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2743185005 shutdown_connections 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c67a780 0x564e0c6921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c66cb40 0x564e0c676430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/2743185005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66b5d0 0x564e0c686720 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2743185005 >> 172.21.15.66:0/2743185005 conn(0x564e0c634310 msgr2=0x564e0c675d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2743185005 shutdown_connections 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- 172.21.15.66:0/2743185005 wait complete. 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- start start 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 Processor -- start 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c682fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c674750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ae530 con 0x564e0c66cb40 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ade60 con 0x564e0c67a780 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.973+0000 7fd67d4f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741ab0c0 con 0x564e0c66b5d0 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd67d4f4740 10 client.0 _ll_register_callbacks cb 0x7fd66800b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55676/0 (socket says 172.21.15.66:55676) 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 -- 172.21.15.66:0/449960113 learned_addr learned my addr 172.21.15.66:0/449960113 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd678eb7640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c682fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd6796b8640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c674750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 -- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 msgr2=0x564e0c682fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c682fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 -- 172.21.15.66:0/449960113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 msgr2=0x564e0c674750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c674750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 -- 172.21.15.66:0/449960113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0c674f80 con 0x564e0c66cb40 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd6796b8640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c674750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd678eb7640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c682fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd673fff640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd66800b310 tx=0x7fd66800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d542ae64c4a22ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd653fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66802c070 con 0x564e0c66cb40 2024-09-15T22:56:26.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd66800e8f0 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.974+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6640a70b0 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd66801d020 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 10 client.17814 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564e0c6f51a0 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6640a70b0 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fd6680054d0 con 0x564e0c66cb40 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 10 client.17814 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 10 client.17814 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 20 client.17814 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c6f58c0 0x564e0c6f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 4 client.17814 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e0c5d8d70 con 0x564e0c6f58c0 2024-09-15T22:56:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.975+0000 7fd678eb7640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c6f58c0 0x564e0c6f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd653fff640 10 client.17814 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd678eb7640 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c6f58c0 0x564e0c6f7cb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3dda1bdc7d76e8d server_cookie=66ac47d7d694d03 in_seq=0 out_seq=0 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd653fff640 1 -- 172.21.15.66:0/449960113 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e0c5d8d70 con 0x564e0c6f58c0 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd653fff640 10 client.17814 handle_command_reply: tid=0 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 client.17814 shutdown 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 msgr2=0x564e0c674210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd66800b310 tx=0x7fd66800bf90 comp rx=0 tx=0).stop 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 shutdown_connections 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564e0c6f58c0 0x564e0c6f7cb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564e0c67a780 0x564e0c674750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e0c66cb40 0x564e0c674210 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd653fff640 0 client.17814 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 --2- 172.21.15.66:0/449960113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e0c66b5d0 0x564e0c682fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 >> 172.21.15.66:0/449960113 conn(0x564e0c634310 msgr2=0x564e0c676540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 shutdown_connections 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.976+0000 7fd67d4f4740 1 -- 172.21.15.66:0/449960113 wait complete. 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67d4f4740 20 client.17814 trim_cache size 0 max 16384 2024-09-15T22:56:26.986 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 msgr2=0x7fd65c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 0x7fd65c0a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd66c01d000 tx=0x7fd66c019000 comp rx=0 tx=0).stop 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 msgr2=0x7fd6741984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd664005ab0 tx=0x7fd6640042f0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 shutdown_connections 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd65c0a3430 0x7fd65c0a58f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67410c150 0x7fd67419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd674103640 0x7fd6741989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 --2- 172.21.15.66:0/34343321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd674102d20 0x7fd6741984a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 >> 172.21.15.66:0/34343321 conn(0x7fd6740fc780 msgr2=0x7fd6740fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 shutdown_connections 2024-09-15T22:56:26.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:26.977+0000 7fd67b11b640 1 -- 172.21.15.66:0/34343321 wait complete. 2024-09-15T22:56:27.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:27 smithi066 ceph-mon[31185]: pgmap v345: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:27 smithi087 ceph-mon[35290]: pgmap v345: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:27 smithi184 ceph-mon[35203]: pgmap v345: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:56:27.776 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:56:28.073 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 -- 172.21.15.66:0/435811261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401036e0 msgr2=0x7fd940107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 --2- 172.21.15.66:0/435811261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401036e0 0x7fd940107b90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd928009930 tx=0x7fd92802a420 comp rx=0 tx=0).stop 2024-09-15T22:56:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 -- 172.21.15.66:0/435811261 shutdown_connections 2024-09-15T22:56:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 --2- 172.21.15.66:0/435811261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9401082a0 0x7fd94010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 --2- 172.21.15.66:0/435811261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401036e0 0x7fd940107b90 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 --2- 172.21.15.66:0/435811261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd940102d30 0x7fd940103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 -- 172.21.15.66:0/435811261 >> 172.21.15.66:0/435811261 conn(0x7fd9400fc7d0 msgr2=0x7fd9400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 -- 172.21.15.66:0/435811261 shutdown_connections 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 -- 172.21.15.66:0/435811261 wait complete. 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.567+0000 7fd94564f640 1 Processor -- start 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 -- start start 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd940102d30 0x7fd940198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9401036e0 0x7fd940198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd940112110 con 0x7fd9401082a0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd940111f90 con 0x7fd9401036e0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd94564f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd940112290 con 0x7fd940102d30 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55694/0 (socket says 172.21.15.66:55694) 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 -- 172.21.15.66:0/1134995365 learned_addr learned my addr 172.21.15.66:0/1134995365 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9401036e0 0x7fd940198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93effd640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd940102d30 0x7fd940198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 -- 172.21.15.66:0/1134995365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd940102d30 msgr2=0x7fd940198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd940102d30 0x7fd940198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 -- 172.21.15.66:0/1134995365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9401036e0 msgr2=0x7fd940198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9401036e0 0x7fd940198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.568+0000 7fd93f7fe640 1 -- 172.21.15.66:0/1134995365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94019d5c0 con 0x7fd9401082a0 2024-09-15T22:56:28.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd93f7fe640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd930009fd0 tx=0x7fd93000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd937fff640 1 -- 172.21.15.66:0/1134995365 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930011830 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd937fff640 1 -- 172.21.15.66:0/1134995365 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd930016070 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94019d8b0 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd937fff640 1 -- 172.21.15.66:0/1134995365 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93000f2e0 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.569+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9401a5190 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.571+0000 7fd937fff640 1 -- 172.21.15.66:0/1134995365 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd9300119d0 con 0x7fd9401082a0 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.571+0000 7fd947a28740 1 Processor -- start 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.571+0000 7fd947a28740 1 -- start start 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563be49ca2f0 con 0x563be4a6f370 2024-09-15T22:56:28.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563be4971cf0 con 0x563be4a645d0 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd947a28740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563be49c62b0 con 0x563be4a65b40 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55708/0 (socket says 172.21.15.66:55708) 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 -- 172.21.15.66:0/2851321569 learned_addr learned my addr 172.21.15.66:0/2851321569 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93effd640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd937fff640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93f7fe640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 -- 172.21.15.66:0/2851321569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 msgr2=0x563be4a64090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.572+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a64090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93e7fc640 1 -- 172.21.15.66:0/2851321569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 msgr2=0x563be4a64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93e7fc640 1 -- 172.21.15.66:0/2851321569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be49563a0 con 0x563be4a6f370 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93effd640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd937fff640 1 -- 172.21.15.66:0/1134995365 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd9300cf6f0 con 0x7fd9401082a0 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd9400697d0 tx=0x7fd928000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4d8f5b0ac7c068 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd9357fa640 1 -- 172.21.15.66:0/2851321569 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928035030 con 0x563be4a6f370 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd9357fa640 1 -- 172.21.15.66:0/2851321569 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928005020 con 0x563be4a6f370 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd9357fa640 1 -- 172.21.15.66:0/2851321569 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928004a00 con 0x563be4a6f370 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.573+0000 7fd93f7fe640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 0x7fd92c0a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd93009b640 tx=0x7fd93006e4e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- 172.21.15.66:0/2851321569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 msgr2=0x563be4a71760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd9400697d0 tx=0x7fd928000bc0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- 172.21.15.66:0/2851321569 shutdown_connections 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a71760 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 --2- 172.21.15.66:0/2851321569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- 172.21.15.66:0/2851321569 >> 172.21.15.66:0/2851321569 conn(0x563be4a2d310 msgr2=0x563be4a60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- 172.21.15.66:0/2851321569 shutdown_connections 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- 172.21.15.66:0/2851321569 wait complete. 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 -- start start 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.574+0000 7fd947a28740 1 Processor -- start 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a6edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a6c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563be4a72010 con 0x563be4a6f370 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563be4985060 con 0x563be4a645d0 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563be4a72190 con 0x563be4a65b40 2024-09-15T22:56:28.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd947a28740 10 client.0 _ll_register_callbacks cb 0x563be46d88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55716/0 (socket says 172.21.15.66:55716) 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93e7fc640 1 -- 172.21.15.66:0/3348091723 learned_addr learned my addr 172.21.15.66:0/3348091723 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a6edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93effd640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a6c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.575+0000 7fd93e7fc640 1 -- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 msgr2=0x563be4a6c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a6c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93e7fc640 1 -- 172.21.15.66:0/3348091723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 msgr2=0x563be4a6edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a6edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93e7fc640 1 -- 172.21.15.66:0/3348091723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be473b3c0 con 0x563be4a6f370 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93effd640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a6c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd928004190 tx=0x7fd928004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38d4a2613cb95f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd9267fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92804e070 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd928003cd0 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd928005020 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd92805e050 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd947a28740 10 client.17826 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.576+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x563be4a7db20 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd928005020 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fd9280317e0 con 0x563be4a6f370 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 10 client.17826 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 10 client.17826 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 20 client.17826 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4a7ee70 0x563be4a81260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 4 client.17826 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563be49d7860 con 0x563be4a7ee70 2024-09-15T22:56:28.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.577+0000 7fd93effd640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4a7ee70 0x563be4a81260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.578+0000 7fd93effd640 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4a7ee70 0x563be4a81260 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49ed4d11cd0bdce server_cookie=d4605c1ab2ffdb24 in_seq=0 out_seq=0 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.578+0000 7fd9267fc640 10 client.17826 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.578+0000 7fd9267fc640 1 -- 172.21.15.66:0/3348091723 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563be49d7860 con 0x563be4a7ee70 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.578+0000 7fd9267fc640 10 client.17826 handle_command_reply: tid=0 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.578+0000 7fd947a28740 1 client.17826 shutdown 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 msgr2=0x563be4a6c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd928004190 tx=0x7fd928004480 comp rx=0 tx=0).stop 2024-09-15T22:56:28.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 shutdown_connections 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4a7ee70 0x563be4a81260 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a6f370 0x563be4a6c800 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a65b40 0x563be4a6c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 --2- 172.21.15.66:0/3348091723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a645d0 0x563be4a6edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd9267fc640 0 client.17826 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 >> 172.21.15.66:0/3348091723 conn(0x563be4a2d310 msgr2=0x563be4a66960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 shutdown_connections 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 1 -- 172.21.15.66:0/3348091723 wait complete. 2024-09-15T22:56:28.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.579+0000 7fd947a28740 20 client.17826 trim_cache size 0 max 16384 2024-09-15T22:56:28.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 Processor -- start 2024-09-15T22:56:28.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 -- start start 2024-09-15T22:56:28.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4a6b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a83ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401af2a0 con 0x563be4a65b40 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401b0de0 con 0x563be4a6f370 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd947a28740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401af970 con 0x563be4a645d0 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd93effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd93effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55730/0 (socket says 172.21.15.66:55730) 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.592+0000 7fd93effd640 1 -- 172.21.15.66:0/1295194233 learned_addr learned my addr 172.21.15.66:0/1295194233 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4a6b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 -- 172.21.15.66:0/1295194233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 msgr2=0x563be4a6b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a83ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4a6b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 -- 172.21.15.66:0/1295194233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 msgr2=0x563be4a83ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a83ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 -- 172.21.15.66:0/1295194233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be4a60de0 con 0x563be4a65b40 2024-09-15T22:56:28.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd93effd640 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x563be4a6b900 tx=0x7fd938009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ca8910dcb33f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd934ff9640 1 -- 172.21.15.66:0/1295194233 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380141d0 con 0x563be4a65b40 2024-09-15T22:56:28.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd934ff9640 1 -- 172.21.15.66:0/1295194233 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938011980 con 0x563be4a65b40 2024-09-15T22:56:28.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.593+0000 7fd934ff9640 1 -- 172.21.15.66:0/1295194233 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380129f0 con 0x563be4a65b40 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- 172.21.15.66:0/1295194233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 msgr2=0x563be4a6b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x563be4a6b900 tx=0x7fd938009570 comp rx=0 tx=0).stop 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- 172.21.15.66:0/1295194233 shutdown_connections 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a83ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4a6b050 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 --2- 172.21.15.66:0/1295194233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4a6b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- 172.21.15.66:0/1295194233 >> 172.21.15.66:0/1295194233 conn(0x563be4a2d310 msgr2=0x563be4a6a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- 172.21.15.66:0/1295194233 shutdown_connections 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- 172.21.15.66:0/1295194233 wait complete. 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 -- start start 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.594+0000 7fd947a28740 1 Processor -- start 2024-09-15T22:56:28.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4ae0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a81540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401b0710 con 0x563be4a65b40 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401b0040 con 0x563be4a6f370 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd9401ad2a0 con 0x563be4a645d0 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd947a28740 10 client.0 _ll_register_callbacks cb 0x7fd938009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55736/0 (socket says 172.21.15.66:55736) 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 -- 172.21.15.66:0/2475274321 learned_addr learned my addr 172.21.15.66:0/2475274321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a81540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4ae0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 -- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 msgr2=0x563be4ae0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4ae0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 -- 172.21.15.66:0/2475274321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 msgr2=0x563be4a81540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a81540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 -- 172.21.15.66:0/2475274321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be4a81d70 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd93effd640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd938000f80 tx=0x7fd938014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7e255013926e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.595+0000 7fd9267fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380117b0 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7fd938011b30 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd938011980 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd938011d50 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 10 client.17832 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x563be4ae9340 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938011980 con 0x563be4a65b40 2024-09-15T22:56:28.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7fd93800f040 con 0x563be4a65b40 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 10 client.17832 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 10 client.17832 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 20 client.17832 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4ae9a80 0x563be4aebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 4 client.17832 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.596+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563be49d1d70 con 0x563be4ae9a80 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4ae9a80 0x563be4aebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd9267fc640 10 client.17832 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd93e7fc640 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4ae9a80 0x563be4aebea0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2841ee95e02665f4 server_cookie=beec9cc0c49ee3d2 in_seq=0 out_seq=0 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd9267fc640 1 -- 172.21.15.66:0/2475274321 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563be49d1d70 con 0x563be4ae9a80 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd9267fc640 10 client.17832 handle_command_reply: tid=0 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 client.17832 shutdown 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 msgr2=0x563be4ae10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd938000f80 tx=0x7fd938014330 comp rx=0 tx=0).stop 2024-09-15T22:56:28.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 shutdown_connections 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x563be4ae9a80 0x563be4aebea0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563be4a6f370 0x563be4a81540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563be4a65b40 0x563be4ae10a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd9267fc640 0 client.17832 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 --2- 172.21.15.66:0/2475274321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563be4a645d0 0x563be4ae0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 >> 172.21.15.66:0/2475274321 conn(0x563be4a2d310 msgr2=0x563be4a6b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.597+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 shutdown_connections 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd947a28740 1 -- 172.21.15.66:0/2475274321 wait complete. 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd947a28740 20 client.17832 trim_cache size 0 max 16384 2024-09-15T22:56:28.604 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 msgr2=0x7fd92c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 0x7fd92c0a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd93009b640 tx=0x7fd93006e4e0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 msgr2=0x7fd94019cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd930009fd0 tx=0x7fd93000b8e0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 shutdown_connections 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd92c0a33b0 0x7fd92c0a5870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9401082a0 0x7fd94019cee0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9401036e0 0x7fd940198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 --2- 172.21.15.66:0/1134995365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd940102d30 0x7fd940198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:28.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 >> 172.21.15.66:0/1134995365 conn(0x7fd9400fc7d0 msgr2=0x7fd940106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 shutdown_connections 2024-09-15T22:56:28.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:28.598+0000 7fd94564f640 1 -- 172.21.15.66:0/1134995365 wait complete. 2024-09-15T22:56:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:29 smithi087 ceph-mon[35290]: pgmap v346: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-15T22:56:29.399 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:29 smithi066 ceph-mon[31185]: pgmap v346: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-15T22:56:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:29 smithi184 ceph-mon[35203]: pgmap v346: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-15T22:56:29.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:56:29.688 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 -- 172.21.15.66:0/3577927432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c106f10 msgr2=0x7f0d8c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3577927432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c106f10 0x7f0d8c10ea90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d8402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 -- 172.21.15.66:0/3577927432 shutdown_connections 2024-09-15T22:56:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3577927432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c106f10 0x7f0d8c10ea90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3577927432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c102790 0x7f0d8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3577927432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 0x7f0d8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 -- 172.21.15.66:0/3577927432 >> 172.21.15.66:0/3577927432 conn(0x7f0d8c0fd8c0 msgr2=0x7f0d8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 -- 172.21.15.66:0/3577927432 shutdown_connections 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.162+0000 7f0d935e5640 1 -- 172.21.15.66:0/3577927432 wait complete. 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 Processor -- start 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 -- start start 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 0x7f0d8c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 0x7f0d8c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c111f70 con 0x7f0d8c102790 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c111df0 con 0x7f0d8c106f10 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d935e5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1120f0 con 0x7f0d8c101de0 2024-09-15T22:56:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d90b80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d90b80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55758/0 (socket says 172.21.15.66:55758) 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d90b80640 1 -- 172.21.15.66:0/3678055398 learned_addr learned my addr 172.21.15.66:0/3678055398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.163+0000 7f0d91381640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 0x7f0d8c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d91b82640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 0x7f0d8c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 -- 172.21.15.66:0/3678055398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 msgr2=0x7f0d8c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 0x7f0d8c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 -- 172.21.15.66:0/3678055398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 msgr2=0x7f0d8c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 0x7f0d8c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 -- 172.21.15.66:0/3678055398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c19d440 con 0x7f0d8c102790 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d91b82640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 0x7f0d8c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d90b80640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c890 tx=0x7f0d7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d827fc640 1 -- 172.21.15.66:0/3678055398 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c004220 con 0x7f0d8c102790 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d827fc640 1 -- 172.21.15.66:0/3678055398 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c0043c0 con 0x7f0d8c102790 2024-09-15T22:56:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c19d730 con 0x7f0d8c102790 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d827fc640 1 -- 172.21.15.66:0/3678055398 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0049e0 con 0x7f0d8c102790 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.164+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c1a5010 con 0x7f0d8c102790 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d827fc640 1 -- 172.21.15.66:0/3678055398 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0d7c0079b0 con 0x7f0d8c102790 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 Processor -- start 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 -- start start 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc55f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 0x560cc5604b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560cc55592f0 con 0x560cc55f4b40 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560cc5500cf0 con 0x560cc55f35d0 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d959be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560cc55552b0 con 0x560cc5602780 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d91b82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d91b82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55768/0 (socket says 172.21.15.66:55768) 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.167+0000 7f0d91b82640 1 -- 172.21.15.66:0/2096746497 learned_addr learned my addr 172.21.15.66:0/2096746497 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d90b80640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 0x560cc5604b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91381640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc55f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d827fc640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 -- 172.21.15.66:0/2096746497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 msgr2=0x560cc5604b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 0x560cc5604b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 -- 172.21.15.66:0/2096746497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 msgr2=0x560cc55f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc55f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 -- 172.21.15.66:0/2096746497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc54e53a0 con 0x560cc55f4b40 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d90b80640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 0x560cc5604b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d827fc640 1 -- 172.21.15.66:0/3678055398 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f0d7c0d0150 con 0x7f0d8c102790 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009940 tx=0x7f0d84009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6693c00943abe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d91b82640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.168+0000 7f0d777fe640 1 -- 172.21.15.66:0/2096746497 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84003b50 con 0x560cc55f4b40 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d777fe640 1 -- 172.21.15.66:0/2096746497 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d84036050 con 0x560cc55f4b40 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d777fe640 1 -- 172.21.15.66:0/2096746497 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8402fcf0 con 0x560cc55f4b40 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 -- 172.21.15.66:0/2096746497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 msgr2=0x560cc55f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009940 tx=0x7f0d84009970 comp rx=0 tx=0).stop 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d91b82640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 0x7f0d780a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d84049000 tx=0x7f0d8404a000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 -- 172.21.15.66:0/2096746497 shutdown_connections 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc5602780 0x560cc5604b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc55f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 --2- 172.21.15.66:0/2096746497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc55f3090 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 -- 172.21.15.66:0/2096746497 >> 172.21.15.66:0/2096746497 conn(0x560cc55bc310 msgr2=0x560cc55efc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 -- 172.21.15.66:0/2096746497 shutdown_connections 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.169+0000 7f0d959be740 1 -- 172.21.15.66:0/2096746497 wait complete. 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 -- start start 2024-09-15T22:56:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 Processor -- start 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc55ff410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc55ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560cc5605300 con 0x560cc55f35d0 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560cc5514060 con 0x560cc5602780 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560cc5605480 con 0x560cc55f4b40 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d959be740 10 client.0 _ll_register_callbacks cb 0x560cc52678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d91381640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d91381640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55772/0 (socket says 172.21.15.66:55772) 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d91381640 1 -- 172.21.15.66:0/1966626068 learned_addr learned my addr 172.21.15.66:0/1966626068 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d91b82640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc55ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.170+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc55ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 -- 172.21.15.66:0/1966626068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 msgr2=0x560cc55ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc55ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 -- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 msgr2=0x560cc55ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc55ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 -- 172.21.15.66:0/1966626068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc52ca3c0 con 0x560cc55f35d0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc55ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d91381640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0d88012700 tx=0x7f0d8800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a24ebc513747f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88010dc0 con 0x560cc55f35d0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f0d88005020 con 0x560cc55f35d0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d84036050 con 0x560cc55f35d0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0d88025050 con 0x560cc55f35d0 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d959be740 10 client.17844 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:30.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x560cc5610de0 con 0x560cc55f35d0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.171+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d84036050 con 0x560cc55f35d0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0d8801a430 con 0x560cc55f35d0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 10 client.17844 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 10 client.17844 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 20 client.17844 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc56122a0 0x560cc5614720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 4 client.17844 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cc5566860 con 0x560cc56122a0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc56122a0 0x560cc5614720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc56122a0 0x560cc5614720 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=528d02708503a14b server_cookie=19c42d1f55cc85b0 in_seq=0 out_seq=0 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.172+0000 7f0d74ff9640 10 client.17844 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:56:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d74ff9640 1 -- 172.21.15.66:0/1966626068 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cc5566860 con 0x560cc56122a0 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d74ff9640 10 client.17844 handle_command_reply: tid=0 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 client.17844 shutdown 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 msgr2=0x560cc5602160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0d88012700 tx=0x7f0d8800af90 comp rx=0 tx=0).stop 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 shutdown_connections 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc56122a0 0x560cc5614720 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc55ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc55ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d74ff9640 0 client.17844 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 --2- 172.21.15.66:0/1966626068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f35d0 0x560cc5602160 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 >> 172.21.15.66:0/1966626068 conn(0x560cc55bc310 msgr2=0x560cc55f5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 shutdown_connections 2024-09-15T22:56:30.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 1 -- 172.21.15.66:0/1966626068 wait complete. 2024-09-15T22:56:30.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.173+0000 7f0d959be740 20 client.17844 trim_cache size 0 max 16384 2024-09-15T22:56:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 Processor -- start 2024-09-15T22:56:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 -- start start 2024-09-15T22:56:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f35d0 0x560cc55efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc561a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1ad010 con 0x560cc55f4b40 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1aeb50 con 0x560cc5602780 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d959be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1ad6e0 con 0x560cc55f35d0 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55778/0 (socket says 172.21.15.66:55778) 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 -- 172.21.15.66:0/1033960471 learned_addr learned my addr 172.21.15.66:0/1033960471 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d91b82640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc561a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 -- 172.21.15.66:0/1033960471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f35d0 msgr2=0x560cc55efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d91381640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f35d0 0x560cc55efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f35d0 0x560cc55efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 -- 172.21.15.66:0/1033960471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 msgr2=0x560cc561a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc561a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 -- 172.21.15.66:0/1033960471 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc55ee310 con 0x560cc55f4b40 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d91b82640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc561a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.187+0000 7f0d90b80640 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0989d0 tx=0x7f0d7c0d26d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3901aeb0d6e1cff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d76ffd640 1 -- 172.21.15.66:0/1033960471 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c01d040 con 0x560cc55f4b40 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d76ffd640 1 -- 172.21.15.66:0/1033960471 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c09c700 con 0x560cc55f4b40 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d76ffd640 1 -- 172.21.15.66:0/1033960471 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0cd6f0 con 0x560cc55f4b40 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 -- 172.21.15.66:0/1033960471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 msgr2=0x560cc560e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0989d0 tx=0x7f0d7c0d26d0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 -- 172.21.15.66:0/1033960471 shutdown_connections 2024-09-15T22:56:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc5602780 0x560cc561a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc55f4b40 0x560cc560e5a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 --2- 172.21.15.66:0/1033960471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f35d0 0x560cc55efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 -- 172.21.15.66:0/1033960471 >> 172.21.15.66:0/1033960471 conn(0x560cc55bc310 msgr2=0x560cc55ef700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 -- 172.21.15.66:0/1033960471 shutdown_connections 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.188+0000 7f0d959be740 1 -- 172.21.15.66:0/1033960471 wait complete. 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 -- start start 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 Processor -- start 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc560a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc560ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1ae480 con 0x560cc5602780 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1addb0 con 0x560cc55f35d0 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c1ab010 con 0x560cc55f4b40 2024-09-15T22:56:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d959be740 10 client.0 _ll_register_callbacks cb 0x7f0d8800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d91b82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d91b82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55790/0 (socket says 172.21.15.66:55790) 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d91b82640 1 -- 172.21.15.66:0/8620273 learned_addr learned my addr 172.21.15.66:0/8620273 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d90b80640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc560ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.189+0000 7f0d91381640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc560a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 -- 172.21.15.66:0/8620273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 msgr2=0x560cc560ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc560ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 -- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 msgr2=0x560cc560a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc560a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 -- 172.21.15.66:0/8620273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc560b2c0 con 0x560cc5602780 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d91b82640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d84004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830a71b33935c8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:30.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84009540 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d7c09c700 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f0d84057040 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f0d84068050 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d959be740 10 client.17850 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x560cc567d5e0 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.190+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c09c700 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f0d840305c0 con 0x560cc5602780 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 10 client.17850 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 10 client.17850 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 20 client.17850 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc567da80 0x560cc567fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 4 client.17850 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cc5560d70 con 0x560cc567da80 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d91381640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc567da80 0x560cc567fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d91381640 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc567da80 0x560cc567fea0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=12cf418afe736820 server_cookie=faf3db3453ad0e3a in_seq=0 out_seq=0 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.191+0000 7f0d74ff9640 10 client.17850 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d74ff9640 1 -- 172.21.15.66:0/8620273 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cc5560d70 con 0x560cc567da80 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d74ff9640 10 client.17850 handle_command_reply: tid=0 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 client.17850 shutdown 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 msgr2=0x560cc56076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d84004830 comp rx=0 tx=0).stop 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 shutdown_connections 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x560cc567da80 0x560cc567fea0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560cc5602780 0x560cc56076e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560cc55f4b40 0x560cc560ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d74ff9640 0 client.17850 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 --2- 172.21.15.66:0/8620273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc55f35d0 0x560cc560a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 >> 172.21.15.66:0/8620273 conn(0x560cc55bc310 msgr2=0x560cc55ee500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 shutdown_connections 2024-09-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 1 -- 172.21.15.66:0/8620273 wait complete. 2024-09-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.192+0000 7f0d959be740 20 client.17850 trim_cache size 0 max 16384 2024-09-15T22:56:30.200 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 msgr2=0x7f0d780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 0x7f0d780a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d84049000 tx=0x7f0d8404a000 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 msgr2=0x7f0d8c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c890 tx=0x7f0d7c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 shutdown_connections 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d8c106f10 0x7f0d8c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d8c102790 0x7f0d8c1989d0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 --2- 172.21.15.66:0/3678055398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d8c101de0 0x7f0d8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 >> 172.21.15.66:0/3678055398 conn(0x7f0d8c0fd8c0 msgr2=0x7f0d8c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 shutdown_connections 2024-09-15T22:56:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:30.193+0000 7f0d935e5640 1 -- 172.21.15.66:0/3678055398 wait complete. 2024-09-15T22:56:30.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:56:31.243 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:31 smithi087 ceph-mon[35290]: pgmap v347: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-15T22:56:31.364 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:31 smithi066 ceph-mon[31185]: pgmap v347: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-15T22:56:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:31 smithi184 ceph-mon[35203]: pgmap v347: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-15T22:56:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 -- 172.21.15.66:0/1582350400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894102790 msgr2=0x7f48941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 --2- 172.21.15.66:0/1582350400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894102790 0x7f48941067e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f487c009900 tx=0x7f487c02a410 comp rx=0 tx=0).stop 2024-09-15T22:56:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 -- 172.21.15.66:0/1582350400 shutdown_connections 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 --2- 172.21.15.66:0/1582350400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 --2- 172.21.15.66:0/1582350400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894102790 0x7f48941067e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 --2- 172.21.15.66:0/1582350400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894101de0 0x7f48941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 -- 172.21.15.66:0/1582350400 >> 172.21.15.66:0/1582350400 conn(0x7f48940fd8c0 msgr2=0x7f48940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 -- 172.21.15.66:0/1582350400 shutdown_connections 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.722+0000 7f489a078640 1 -- 172.21.15.66:0/1582350400 wait complete. 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 Processor -- start 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 -- start start 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 0x7f4894198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4894111f30 con 0x7f4894101de0 2024-09-15T22:56:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4894111db0 con 0x7f4894102790 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f489a078640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48941120b0 con 0x7f4894106f10 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55818/0 (socket says 172.21.15.66:55818) 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f48937fe640 1 -- 172.21.15.66:0/2756956210 learned_addr learned my addr 172.21.15.66:0/2756956210 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.723+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 0x7f4894198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 -- 172.21.15.66:0/2756956210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 msgr2=0x7f489419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4893fff640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 -- 172.21.15.66:0/2756956210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 msgr2=0x7f4894198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 0x7f4894198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 -- 172.21.15.66:0/2756956210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489419d3e0 con 0x7f4894101de0 2024-09-15T22:56:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 0x7f4894198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4893fff640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f48937fe640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f488400d950 tx=0x7f488400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4890ff9640 1 -- 172.21.15.66:0/2756956210 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884017070 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489419d6d0 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4890ff9640 1 -- 172.21.15.66:0/2756956210 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4884009c30 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f4890ff9640 1 -- 172.21.15.66:0/2756956210 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488400f6b0 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.724+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48941a4fb0 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.726+0000 7f4890ff9640 1 -- 172.21.15.66:0/2756956210 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f48840109d0 con 0x7f4894101de0 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.726+0000 7f489c451740 1 Processor -- start 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 -- start start 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b64760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4abd2f0 con 0x55a2c4b575d0 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4a64cf0 con 0x55a2c4b62370 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f489c451740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4ab92b0 con 0x55a2c4b58b40 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55830/0 (socket says 172.21.15.66:55830) 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 -- 172.21.15.66:0/2040170364 learned_addr learned my addr 172.21.15.66:0/2040170364 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4893fff640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4890ff9640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 0x7f48800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b64760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4890ff9640 1 -- 172.21.15.66:0/2756956210 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f48840cfed0 con 0x7f4894101de0 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 -- 172.21.15.66:0/2040170364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 msgr2=0x55a2c4b57090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b57090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 -- 172.21.15.66:0/2040170364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 msgr2=0x55a2c4b64760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b64760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f48937fe640 1 -- 172.21.15.66:0/2040170364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c4a493a0 con 0x55a2c4b575d0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b64760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4893fff640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b57090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.727+0000 7f4893fff640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 0x7f48800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f48937fe640 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f48840cd0d0 tx=0x7f488400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738f88a95a6dfc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f4889ffb640 1 -- 172.21.15.66:0/2040170364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884020070 con 0x55a2c4b575d0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f4889ffb640 1 -- 172.21.15.66:0/2040170364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4884009de0 con 0x55a2c4b575d0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f4889ffb640 1 -- 172.21.15.66:0/2040170364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488409a020 con 0x55a2c4b575d0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f489c451740 1 -- 172.21.15.66:0/2040170364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 msgr2=0x55a2c4b57a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f4893fff640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 0x7f48800a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c004a40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.728+0000 7f489c451740 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f48840cd0d0 tx=0x7f488400bf60 comp rx=0 tx=0).stop 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 -- 172.21.15.66:0/2040170364 shutdown_connections 2024-09-15T22:56:31.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b64760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b57a10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 --2- 172.21.15.66:0/2040170364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b57090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 -- 172.21.15.66:0/2040170364 >> 172.21.15.66:0/2040170364 conn(0x55a2c4b20310 msgr2=0x55a2c4b53c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 -- 172.21.15.66:0/2040170364 shutdown_connections 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 -- 172.21.15.66:0/2040170364 wait complete. 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 -- start start 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.729+0000 7f489c451740 1 Processor -- start 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b5fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4b64fb0 con 0x55a2c4b575d0 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4a78060 con 0x55a2c4b62370 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a2c4b65130 con 0x55a2c4b58b40 2024-09-15T22:56:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 10 client.0 _ll_register_callbacks cb 0x55a2c47cb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55844/0 (socket says 172.21.15.66:55844) 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 -- 172.21.15.66:0/981907158 learned_addr learned my addr 172.21.15.66:0/981907158 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4893fff640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b5fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4892ffd640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 -- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 msgr2=0x55a2c4b5f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 -- 172.21.15.66:0/981907158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 msgr2=0x55a2c4b5fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b5fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 -- 172.21.15.66:0/981907158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c482e3c0 con 0x55a2c4b575d0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4893fff640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b5fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4892ffd640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f48937fe640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f48840d36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdad48030019e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884020070 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f4884097a70 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.730+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4884009de0 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f48840a00d0 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 10 client.17862 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a2c4b70b60 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4884009de0 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f48840a4500 con 0x55a2c4b575d0 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 10 client.17862 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 10 client.17862 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 20 client.17862 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4b71eb0 0x55a2c4b742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 4 client.17862 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2c4aca860 con 0x55a2c4b71eb0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.731+0000 7f4892ffd640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4b71eb0 0x55a2c4b742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.732+0000 7f4892ffd640 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4b71eb0 0x55a2c4b742a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c53ca8060d86fe8a server_cookie=88ba6c316b42f29a in_seq=0 out_seq=0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.732+0000 7f4872ffd640 10 client.17862 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.732+0000 7f4872ffd640 1 -- 172.21.15.66:0/981907158 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2c4aca860 con 0x55a2c4b71eb0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.732+0000 7f4872ffd640 10 client.17862 handle_command_reply: tid=0 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 client.17862 shutdown 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 msgr2=0x55a2c4b5f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f48840d36e0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 shutdown_connections 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4b71eb0 0x55a2c4b742a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b5fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f4872ffd640 0 client.17862 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 --2- 172.21.15.66:0/981907158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5f110 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 >> 172.21.15.66:0/981907158 conn(0x55a2c4b20310 msgr2=0x55a2c4b59990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 shutdown_connections 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 1 -- 172.21.15.66:0/981907158 wait complete. 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.733+0000 7f489c451740 20 client.17862 trim_cache size 0 max 16384 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 Processor -- start 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 -- start start 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 0x55a2c4b772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f48941af340 con 0x55a2c4b58b40 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f48941b0e80 con 0x55a2c4b575d0 2024-09-15T22:56:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f489c451740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48941afa10 con 0x55a2c4b62370 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f4892ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f4892ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55856/0 (socket says 172.21.15.66:55856) 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.746+0000 7f4892ffd640 1 -- 172.21.15.66:0/2570456633 learned_addr learned my addr 172.21.15.66:0/2570456633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4893fff640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 0x55a2c4b772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f48937fe640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 -- 172.21.15.66:0/2570456633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 msgr2=0x55a2c4b772c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 0x55a2c4b772c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 -- 172.21.15.66:0/2570456633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 msgr2=0x55a2c4b5a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 -- 172.21.15.66:0/2570456633 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c4b52310 con 0x55a2c4b58b40 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4893fff640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 0x55a2c4b772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f48937fe640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f4892ffd640 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f487c02a930 tx=0x7f487c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee7b51900aaa00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f48897fa640 1 -- 172.21.15.66:0/2570456633 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c035040 con 0x55a2c4b58b40 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f48897fa640 1 -- 172.21.15.66:0/2570456633 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487c047070 con 0x55a2c4b58b40 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.747+0000 7f48897fa640 1 -- 172.21.15.66:0/2570456633 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c004c50 con 0x55a2c4b58b40 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- 172.21.15.66:0/2570456633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 msgr2=0x55a2c4b5a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f487c02a930 tx=0x7f487c005a20 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- 172.21.15.66:0/2570456633 shutdown_connections 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b62370 0x55a2c4b772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b58b40 0x55a2c4b5a660 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 --2- 172.21.15.66:0/2570456633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b575d0 0x55a2c4b5a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- 172.21.15.66:0/2570456633 >> 172.21.15.66:0/2570456633 conn(0x55a2c4b20310 msgr2=0x55a2c4b52d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- 172.21.15.66:0/2570456633 shutdown_connections 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- 172.21.15.66:0/2570456633 wait complete. 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 -- start start 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.748+0000 7f489c451740 1 Processor -- start 2024-09-15T22:56:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b74a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b74fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f48941b07b0 con 0x55a2c4b575d0 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f48941b00e0 con 0x55a2c4b62370 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48941ad340 con 0x55a2c4b58b40 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 10 client.0 _ll_register_callbacks cb 0x7f488400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55860/0 (socket says 172.21.15.66:55860) 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 -- 172.21.15.66:0/1788195357 learned_addr learned my addr 172.21.15.66:0/1788195357 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 -- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 msgr2=0x55a2c4b74a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b74a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 -- 172.21.15.66:0/1788195357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 msgr2=0x55a2c4b74fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b74fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 -- 172.21.15.66:0/1788195357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c4b75500 con 0x55a2c4b575d0 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f48937fe640 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4884010fd0 tx=0x7f4884097990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca06dd12e9200036 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f4872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884020070 con 0x55a2c4b575d0 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:56:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f4884097a70 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f487c047070 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.749+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f4884009de0 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 10 client.17868 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a2c4bdc470 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487c047070 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f488409b170 con 0x55a2c4b575d0 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 10 client.17868 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 10 client.17868 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 20 client.17868 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4bdca30 0x55a2c4bdeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 4 client.17868 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2c4ac4d70 con 0x55a2c4bdca30 2024-09-15T22:56:31.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f4892ffd640 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4bdca30 0x55a2c4bdeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f4892ffd640 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4bdca30 0x55a2c4bdeef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc267abe13f1c4c1 server_cookie=7ec593e3bfccfb3 in_seq=0 out_seq=0 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.750+0000 7f4872ffd640 10 client.17868 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f4872ffd640 1 -- 172.21.15.66:0/1788195357 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2c4ac4d70 con 0x55a2c4bdca30 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f4872ffd640 10 client.17868 handle_command_reply: tid=0 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 client.17868 shutdown 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 msgr2=0x55a2c4b77730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4884010fd0 tx=0x7f4884097990 comp rx=0 tx=0).stop 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 shutdown_connections 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a2c4bdca30 0x55a2c4bdeef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2c4b62370 0x55a2c4b74fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2c4b58b40 0x55a2c4b74a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f4872ffd640 0 client.17868 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 --2- 172.21.15.66:0/1788195357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2c4b575d0 0x55a2c4b77730 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 >> 172.21.15.66:0/1788195357 conn(0x55a2c4b20310 msgr2=0x55a2c4b524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 shutdown_connections 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 1 -- 172.21.15.66:0/1788195357 wait complete. 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.751+0000 7f489c451740 20 client.17868 trim_cache size 0 max 16384 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 msgr2=0x7f48800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 0x7f48800a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c004a40 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 msgr2=0x7f4894198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f488400d950 tx=0x7f488400de10 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 shutdown_connections 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f48800a33b0 0x7f48800a5870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894106f10 0x7f489419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4894102790 0x7f4894198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 --2- 172.21.15.66:0/2756956210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4894101de0 0x7f4894198430 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 >> 172.21.15.66:0/2756956210 conn(0x7f48940fd8c0 msgr2=0x7f48940fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 shutdown_connections 2024-09-15T22:56:31.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:31.752+0000 7f489a078640 1 -- 172.21.15.66:0/2756956210 wait complete. 2024-09-15T22:56:31.836 INFO:tasks.workunit.client.0.smithi066.stdout: 2024-09-15T22:56:31.836 INFO:tasks.workunit.client.0.smithi066.stdout:Final score for writes: 439 2024-09-15T22:56:31.836 INFO:tasks.workunit.client.0.smithi066.stdout:Final score for reads : 381060 2024-09-15T22:56:31.836 INFO:tasks.workunit.client.0.smithi066.stdout: 2024-09-15T22:56:31.837 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:56:31.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:56:32.395 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:56:32.657 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:33.057 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:33 smithi066 ceph-mon[31185]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:56:33.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 -- 172.21.15.66:0/472219305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774101420 msgr2=0x7f677410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 --2- 172.21.15.66:0/472219305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774101420 0x7f677410d950 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f676c009cd0 tx=0x7f676c02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 -- 172.21.15.66:0/472219305 shutdown_connections 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 --2- 172.21.15.66:0/472219305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774101420 0x7f677410d950 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 --2- 172.21.15.66:0/472219305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774100a80 0x7f6774100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 --2- 172.21.15.66:0/472219305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774106a80 0x7f6774106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 -- 172.21.15.66:0/472219305 >> 172.21.15.66:0/472219305 conn(0x7f67740fc7a0 msgr2=0x7f67740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 -- 172.21.15.66:0/472219305 shutdown_connections 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.142+0000 7f67796d4640 1 -- 172.21.15.66:0/472219305 wait complete. 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.143+0000 7f67796d4640 1 Processor -- start 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.143+0000 7f67796d4640 1 -- start start 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774100a80 0x7f6774199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 0x7f67741997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6774110e80 con 0x7f6774106a80 2024-09-15T22:56:33.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6774110d00 con 0x7f6774101420 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67796d4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6774111000 con 0x7f6774100a80 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57118/0 (socket says 172.21.15.66:57118) 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 -- 172.21.15.66:0/3939394898 learned_addr learned my addr 172.21.15.66:0/3939394898 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67727fc640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 0x7f67741997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774100a80 0x7f6774199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 -- 172.21.15.66:0/3939394898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774100a80 msgr2=0x7f6774199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774100a80 0x7f6774199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 -- 172.21.15.66:0/3939394898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 msgr2=0x7f67741997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 0x7f67741997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 -- 172.21.15.66:0/3939394898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67741a4840 con 0x7f6774106a80 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67727fc640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 0x7f67741997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:33.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.144+0000 7f67737fe640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f676c005cc0 tx=0x7f676c032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.145+0000 7f675bfff640 1 -- 172.21.15.66:0/3939394898 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c004040 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.145+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67741a4a10 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.145+0000 7f675bfff640 1 -- 172.21.15.66:0/3939394898 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676c0046c0 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.145+0000 7f675bfff640 1 -- 172.21.15.66:0/3939394898 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c030e00 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.145+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741a4ec0 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f675bfff640 1 -- 172.21.15.66:0/3939394898 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f676c0305a0 con 0x7f6774106a80 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f677baad740 1 Processor -- start 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f677baad740 1 -- start start 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f677baad740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f677baad740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.147+0000 7f677baad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa35370 0x5628afa37760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f677baad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628af9902f0 con 0x5628afa35370 2024-09-15T22:56:33.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f677baad740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5628af937cf0 con 0x5628afa2bb40 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f677baad740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5628af98c2b0 con 0x5628afa2a5d0 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:35276/0 (socket says 172.21.15.66:35276) 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 -- 172.21.15.66:0/2963935096 learned_addr learned my addr 172.21.15.66:0/2963935096 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa35370 0x5628afa37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f6772ffd640 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f675bfff640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 0x7f675c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 -- 172.21.15.66:0/2963935096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 msgr2=0x5628afa2aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa2aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 -- 172.21.15.66:0/2963935096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa35370 msgr2=0x5628afa37760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa35370 0x5628afa37760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 -- 172.21.15.66:0/2963935096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628af91c3a0 con 0x5628afa2bb40 2024-09-15T22:56:33.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67737fe640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 0x7f675c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67727fc640 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6768009fd0 tx=0x7f6768009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75aad76defa150bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f675bfff640 1 -- 172.21.15.66:0/3939394898 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f676c02e030 con 0x7f6774106a80 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67597fa640 1 -- 172.21.15.66:0/2963935096 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800fc50 con 0x5628afa2bb40 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67597fa640 1 -- 172.21.15.66:0/2963935096 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676800fdf0 con 0x5628afa2bb40 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.148+0000 7f67597fa640 1 -- 172.21.15.66:0/2963935096 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800e6f0 con 0x5628afa2bb40 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 -- 172.21.15.66:0/2963935096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 msgr2=0x5628afa2a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f67737fe640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 0x7f675c0a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f676c009ca0 tx=0x7f676c08f4f0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6768009fd0 tx=0x7f6768009ba0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 -- 172.21.15.66:0/2963935096 shutdown_connections 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa35370 0x5628afa37760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 --2- 172.21.15.66:0/2963935096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2bb40 0x5628afa2a090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 -- 172.21.15.66:0/2963935096 >> 172.21.15.66:0/2963935096 conn(0x5628af9f3310 msgr2=0x5628afa26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 -- 172.21.15.66:0/2963935096 shutdown_connections 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.149+0000 7f677baad740 1 -- 172.21.15.66:0/2963935096 wait complete. 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 -- start start 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 Processor -- start 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa32000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa35370 0x5628afa325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5628afa38070 con 0x5628afa2bb40 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5628af94b060 con 0x5628afa2a5d0 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5628afa381f0 con 0x5628afa35370 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f677baad740 10 client.0 _ll_register_callbacks cb 0x5628af69e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:33.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:35280/0 (socket says 172.21.15.66:35280) 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 -- 172.21.15.66:0/3797372039 learned_addr learned my addr 172.21.15.66:0/3797372039 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa32000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa35370 0x5628afa325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 -- 172.21.15.66:0/3797372039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa35370 msgr2=0x5628afa325d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa35370 0x5628afa325d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 -- 172.21.15.66:0/3797372039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 msgr2=0x5628afa32000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa32000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.150+0000 7f67727fc640 1 -- 172.21.15.66:0/3797372039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628af7013c0 con 0x5628afa2a5d0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f67727fc640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f676800fdc0 tx=0x7f676801fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a5e2e6cf10d931 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676801fa20 con 0x5628afa2a5d0 2024-09-15T22:56:33.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f676800fdf0 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f676801fbc0 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f6768037050 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 10 client.27233 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5628afa43af0 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676800fdf0 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f676802c020 con 0x5628afa2a5d0 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 10 client.27233 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 10 client.27233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 20 client.27233 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afa44e40 0x5628afa47230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 4 client.27233 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.151+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628af99d860 con 0x5628afa44e40 2024-09-15T22:56:33.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.152+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afa44e40 0x5628afa47230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.152+0000 7f6756ff5640 10 client.27233 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.152+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afa44e40 0x5628afa47230 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf7f90dfa208663 server_cookie=f8274c91d78ea8e2 in_seq=0 out_seq=0 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f6756ff5640 1 -- 172.21.15.66:0/3797372039 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628af99d860 con 0x5628afa44e40 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f6756ff5640 10 client.27233 handle_command_reply: tid=0 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 client.27233 shutdown 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 msgr2=0x5628afa34d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f676800fdc0 tx=0x7f676801fe90 comp rx=0 tx=0).stop 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 shutdown_connections 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa35370 0x5628afa325d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa32000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afa44e40 0x5628afa47230 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 --2- 172.21.15.66:0/3797372039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa2a5d0 0x5628afa34d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 >> 172.21.15.66:0/3797372039 conn(0x5628af9f3310 msgr2=0x5628afa2c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f6756ff5640 0 client.27233 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:33.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 shutdown_connections 2024-09-15T22:56:33.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 1 -- 172.21.15.66:0/3797372039 wait complete. 2024-09-15T22:56:33.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.153+0000 7f677baad740 20 client.27233 trim_cache size 0 max 16384 2024-09-15T22:56:33.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 Processor -- start 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 -- start start 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2bb40 0x5628afa33f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afa344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f67741af0f0 con 0x5628afa2a5d0 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f67741b0c30 con 0x5628afa35370 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.166+0000 7f677baad740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f67741af7c0 con 0x5628afa2bb40 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57140/0 (socket says 172.21.15.66:57140) 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 -- 172.21.15.66:0/3626939789 learned_addr learned my addr 172.21.15.66:0/3626939789 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afa344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2bb40 0x5628afa33f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 -- 172.21.15.66:0/3626939789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2bb40 msgr2=0x5628afa33f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2bb40 0x5628afa33f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 -- 172.21.15.66:0/3626939789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 msgr2=0x5628afa344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afa344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 -- 172.21.15.66:0/3626939789 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628afa32940 con 0x5628afa2a5d0 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f67727fc640 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5628afa27a90 tx=0x7f676802c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc23fc994ce4467 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f6758ff9640 1 -- 172.21.15.66:0/3626939789 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676802c740 con 0x5628afa2a5d0 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f6758ff9640 1 -- 172.21.15.66:0/3626939789 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676800fdf0 con 0x5628afa2a5d0 2024-09-15T22:56:33.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.167+0000 7f6758ff9640 1 -- 172.21.15.66:0/3626939789 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676802c9d0 con 0x5628afa2a5d0 2024-09-15T22:56:33.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- 172.21.15.66:0/3626939789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 msgr2=0x5628afa41310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x5628afa27a90 tx=0x7f676802c6d0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- 172.21.15.66:0/3626939789 shutdown_connections 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afa344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2bb40 0x5628afa33f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 --2- 172.21.15.66:0/3626939789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2a5d0 0x5628afa41310 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- 172.21.15.66:0/3626939789 >> 172.21.15.66:0/3626939789 conn(0x5628af9f3310 msgr2=0x5628afa33860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- 172.21.15.66:0/3626939789 shutdown_connections 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- 172.21.15.66:0/3626939789 wait complete. 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 -- start start 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.168+0000 7f677baad740 1 Processor -- start 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afaae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f67741b0560 con 0x5628afa2bb40 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f67741afe90 con 0x5628afa35370 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ad0f0 con 0x5628afa2a5d0 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f677baad740 10 client.0 _ll_register_callbacks cb 0x7f67680116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57148/0 (socket says 172.21.15.66:57148) 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 -- 172.21.15.66:0/3350275446 learned_addr learned my addr 172.21.15.66:0/3350275446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f67727fc640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afaae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f67727fc640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 -- 172.21.15.66:0/3350275446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 msgr2=0x5628afa395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 -- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 msgr2=0x5628afaae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afaae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 -- 172.21.15.66:0/3350275446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628afaaef20 con 0x5628afa2bb40 2024-09-15T22:56:33.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6772ffd640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f676400b820 tx=0x7f67640039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9559e36e2ecbae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.169+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764005220 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f67640053c0 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f676800fdf0 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f67640055c0 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 10 client.17886 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5628afab0130 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f676800fdf0 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f67640118c0 con 0x5628afa2bb40 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 10 client.17886 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 10 client.17886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 20 client.17886 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:33.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afab0930 0x5628afab2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 4 client.17886 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628af997d70 con 0x5628afab0930 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.170+0000 7f67727fc640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afab0930 0x5628afab2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f6756ff5640 10 client.17886 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f67727fc640 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afab0930 0x5628afab2d50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d0a546d4e32283f server_cookie=8c93c72341a0d4db in_seq=0 out_seq=0 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f6756ff5640 1 -- 172.21.15.66:0/3350275446 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628af997d70 con 0x5628afab0930 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f6756ff5640 10 client.17886 handle_command_reply: tid=0 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 client.17886 shutdown 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 msgr2=0x5628afa39af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f676400b820 tx=0x7f67640039c0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 shutdown_connections 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5628afab0930 0x5628afab2d50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628afa35370 0x5628afaae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5628afa2bb40 0x5628afa39af0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 --2- 172.21.15.66:0/3350275446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5628afa2a5d0 0x5628afa395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 >> 172.21.15.66:0/3350275446 conn(0x5628af9f3310 msgr2=0x5628afa34080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f6756ff5640 0 client.17886 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 shutdown_connections 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 1 -- 172.21.15.66:0/3350275446 wait complete. 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.171+0000 7f677baad740 20 client.17886 trim_cache size 0 max 16384 2024-09-15T22:56:33.178 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 msgr2=0x7f675c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 0x7f675c0a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f676c009ca0 tx=0x7f676c08f4f0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 msgr2=0x7f67741a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f676c005cc0 tx=0x7f676c032f40 comp rx=0 tx=0).stop 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 shutdown_connections 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f675c0a33b0 0x7f675c0a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6774106a80 0x7f67741a4300 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6774101420 0x7f67741997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 --2- 172.21.15.66:0/3939394898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6774100a80 0x7f6774199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:33.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 >> 172.21.15.66:0/3939394898 conn(0x7f67740fc7a0 msgr2=0x7f67740fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:33.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 shutdown_connections 2024-09-15T22:56:33.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:33.172+0000 7f67796d4640 1 -- 172.21.15.66:0/3939394898 wait complete. 2024-09-15T22:56:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:33 smithi087 ceph-mon[35290]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:56:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:33 smithi184 ceph-mon[35203]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-15T22:56:34.900 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:56:34.900 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:56:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:35.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:35 smithi066 ceph-mon[31185]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 294 KiB/s wr, 20 op/s 2024-09-15T22:56:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:35 smithi087 ceph-mon[35290]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 294 KiB/s wr, 20 op/s 2024-09-15T22:56:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:35 smithi184 ceph-mon[35203]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 294 KiB/s wr, 20 op/s 2024-09-15T22:56:35.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.721+0000 7f5bff828640 1 -- 172.21.15.66:0/3952748698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf8102df0 msgr2=0x7f5bf81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.721+0000 7f5bff828640 1 --2- 172.21.15.66:0/3952748698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf8102df0 0x7f5bf81031d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009900 tx=0x7f5bf402a410 comp rx=0 tx=0).stop 2024-09-15T22:56:35.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 -- 172.21.15.66:0/3952748698 shutdown_connections 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 --2- 172.21.15.66:0/3952748698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf810c2f0 0x7f5bf810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 --2- 172.21.15.66:0/3952748698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 0x7f5bf810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 --2- 172.21.15.66:0/3952748698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf8102df0 0x7f5bf81031d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 -- 172.21.15.66:0/3952748698 >> 172.21.15.66:0/3952748698 conn(0x7f5bf80fc7d0 msgr2=0x7f5bf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 -- 172.21.15.66:0/3952748698 shutdown_connections 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 -- 172.21.15.66:0/3952748698 wait complete. 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 Processor -- start 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 -- start start 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.722+0000 7f5bff828640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bff828640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 0x7f5bf8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bff828640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 0x7f5bf819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bff828640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81120f0 con 0x7f5bf810c2f0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bff828640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8111f70 con 0x7f5bf8102df0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bff828640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8112270 con 0x7f5bf81037a0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:35322/0 (socket says 172.21.15.66:35322) 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfddc5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 0x7f5bf819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/3046426610 learned_addr learned my addr 172.21.15.66:0/3046426610 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 0x7f5bf8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/3046426610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 msgr2=0x7f5bf8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 0x7f5bf8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 msgr2=0x7f5bf819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 0x7f5bf819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/3046426610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf819d5a0 con 0x7f5bf8102df0 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 0x7f5bf819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:35.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.723+0000 7f5bee7fc640 1 -- 172.21.15.66:0/3046426610 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf403f030 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.724+0000 7f5bee7fc640 1 -- 172.21.15.66:0/3046426610 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf4003ce0 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.724+0000 7f5bee7fc640 1 -- 172.21.15.66:0/3046426610 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4035070 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.724+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf819d830 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.724+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a5170 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.726+0000 7f5bee7fc640 1 -- 172.21.15.66:0/3046426610 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5bf4042030 con 0x7f5bf8102df0 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 Processor -- start 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 -- start start 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bee7fc640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 0x7f5be40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28acbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28ad9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c28a31280 con 0x556c28acc480 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556c289d8b10 con 0x556c28acbb60 2024-09-15T22:56:35.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5c01c01740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556c28a2d240 con 0x556c28ad6d40 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 0x7f5be40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bee7fc640 1 -- 172.21.15.66:0/3046426610 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f5bf40f05e0 con 0x7f5bf8102df0 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfd5c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28acbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57166/0 (socket says 172.21.15.66:57166) 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/118685545 learned_addr learned my addr 172.21.15.66:0/118685545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28ad9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/118685545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 msgr2=0x556c28ad9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28ad9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/118685545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 msgr2=0x556c28acbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28acbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/118685545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c289e51f0 con 0x556c28acc480 2024-09-15T22:56:35.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.727+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28acbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 0x7f5be40a58f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00099e0 tx=0x7f5bf000fe70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5be800bc30 tx=0x7f5be80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8b4fef402d07a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5be37fe640 1 -- 172.21.15.66:0/118685545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be801c480 con 0x556c28acc480 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5be37fe640 1 -- 172.21.15.66:0/118685545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be801cb00 con 0x556c28acc480 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5be37fe640 1 -- 172.21.15.66:0/118685545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8011bf0 con 0x556c28acc480 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5c01c01740 1 -- 172.21.15.66:0/118685545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 msgr2=0x556c28ad6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.728+0000 7f5c01c01740 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f5be800bc30 tx=0x7f5be80107a0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 -- 172.21.15.66:0/118685545 shutdown_connections 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28ad9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ad6800 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 --2- 172.21.15.66:0/118685545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28acbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 -- 172.21.15.66:0/118685545 >> 172.21.15.66:0/118685545 conn(0x556c28ac80f0 msgr2=0x556c28ac84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 -- 172.21.15.66:0/118685545 shutdown_connections 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 -- 172.21.15.66:0/118685545 wait complete. 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 -- start start 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.729+0000 7f5c01c01740 1 Processor -- start 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acc480 0x556c28ad4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ad4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c28addd20 con 0x556c28acbb60 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556c289ebf10 con 0x556c28ad6d40 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556c28addea0 con 0x556c28acc480 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 10 client.0 _ll_register_callbacks cb 0x556c289b4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfddc5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ad4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57172/0 (socket says 172.21.15.66:57172) 2024-09-15T22:56:35.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/431723744 learned_addr learned my addr 172.21.15.66:0/431723744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acc480 0x556c28ad4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/431723744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acc480 msgr2=0x556c28ad4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acc480 0x556c28ad4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 msgr2=0x556c28ad4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ad4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 -- 172.21.15.66:0/431723744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c287a26a0 con 0x556c28acbb60 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ad4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40bc530 tx=0x7f5bf40095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f663598412dee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5be0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4049040 con 0x556c28acbb60 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f5bf40b8c10 con 0x556c28acbb60 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.730+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be801cb00 con 0x556c28acbb60 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f5bf40bc0e0 con 0x556c28acbb60 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 10 client.17898 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:35.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556c28ae98d0 con 0x556c28acbb60 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be801cb00 con 0x556c28acbb60 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f5bf40edb20 con 0x556c28acbb60 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 10 client.17898 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 10 client.17898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 20 client.17898 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28aeac70 0x556c28aed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 4 client.17898 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c28a3e7f0 con 0x556c28aeac70 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.731+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28aeac70 0x556c28aed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28aeac70 0x556c28aed0a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c2c04bf4b28d369 server_cookie=29cfbc1a634e9d59 in_seq=0 out_seq=0 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5be0ff9640 10 client.17898 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5be0ff9640 1 -- 172.21.15.66:0/431723744 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c28a3e7f0 con 0x556c28aeac70 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5be0ff9640 10 client.17898 handle_command_reply: tid=0 2024-09-15T22:56:35.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 client.17898 shutdown 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 msgr2=0x556c28ad3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40bc530 tx=0x7f5bf40095e0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 shutdown_connections 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28aeac70 0x556c28aed0a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ad4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5be0ff9640 0 client.17898 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acc480 0x556c28ad4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 --2- 172.21.15.66:0/431723744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acbb60 0x556c28ad3bc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 >> 172.21.15.66:0/431723744 conn(0x556c28ac80f0 msgr2=0x556c28acde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.732+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 shutdown_connections 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.733+0000 7f5c01c01740 1 -- 172.21.15.66:0/431723744 wait complete. 2024-09-15T22:56:35.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.733+0000 7f5c01c01740 20 client.17898 trim_cache size 0 max 16384 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 Processor -- start 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 -- start start 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28ad5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28af2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81ad050 con 0x556c28acc480 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81aeb90 con 0x556c28acbb60 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5c01c01740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81ad720 con 0x556c28ad6d40 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57178/0 (socket says 172.21.15.66:57178) 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2471182686 learned_addr learned my addr 172.21.15.66:0/2471182686 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.750+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28ad5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2471182686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 msgr2=0x556c28af2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28af2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28af2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2471182686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 msgr2=0x556c28ad5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28ad5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2471182686 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c28ad6490 con 0x556c28acc480 2024-09-15T22:56:35.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28ad5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:35.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5be801b000 tx=0x7f5be8013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca8ea23b8a78d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5be2ffd640 1 -- 172.21.15.66:0/2471182686 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8005040 con 0x556c28acc480 2024-09-15T22:56:35.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5be2ffd640 1 -- 172.21.15.66:0/2471182686 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be801c480 con 0x556c28acc480 2024-09-15T22:56:35.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.751+0000 7f5be2ffd640 1 -- 172.21.15.66:0/2471182686 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be80118b0 con 0x556c28acc480 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- 172.21.15.66:0/2471182686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 msgr2=0x556c28af2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5be801b000 tx=0x7f5be8013040 comp rx=0 tx=0).stop 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- 172.21.15.66:0/2471182686 shutdown_connections 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28ad6d40 0x556c28af2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28af2920 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2471182686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28acbb60 0x556c28ad5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- 172.21.15.66:0/2471182686 >> 172.21.15.66:0/2471182686 conn(0x556c28ac80f0 msgr2=0x556c28ad5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- 172.21.15.66:0/2471182686 shutdown_connections 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- 172.21.15.66:0/2471182686 wait complete. 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 -- start start 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.752+0000 7f5c01c01740 1 Processor -- start 2024-09-15T22:56:35.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acbb60 0x556c28ae3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ade0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81ae4c0 con 0x556c28acc480 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81addf0 con 0x556c28ad6d40 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81ab050 con 0x556c28acbb60 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5c01c01740 10 client.0 _ll_register_callbacks cb 0x7f5bf40b8180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57184/0 (socket says 172.21.15.66:57184) 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2987153324 learned_addr learned my addr 172.21.15.66:0/2987153324 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acbb60 0x556c28ae3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfddc5640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ade0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2987153324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acbb60 msgr2=0x556c28ae3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acbb60 0x556c28ae3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 msgr2=0x556c28ade0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ade0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 -- 172.21.15.66:0/2987153324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c28ade5f0 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5bfcdc3640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058c0 tx=0x7f5be800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fadbd9b1068cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.753+0000 7f5be0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be80052d0 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f5be8005470 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be801c480 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f5be801c630 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 10 client.17904 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556c28b56040 con 0x556c28acc480 2024-09-15T22:56:35.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5be801c480 con 0x556c28acc480 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f5be8029450 con 0x556c28acc480 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 10 client.17904 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 10 client.17904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 20 client.17904 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28b56500 0x556c28b588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 4 client.17904 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556c28a38d00 con 0x556c28b56500 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.754+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28b56500 0x556c28b588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.755+0000 7f5be0ff9640 10 client.17904 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.755+0000 7f5bfd5c4640 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28b56500 0x556c28b588f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9733348ee8de91b server_cookie=eab939d22224ef9b in_seq=0 out_seq=0 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5be0ff9640 1 -- 172.21.15.66:0/2987153324 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556c28a38d00 con 0x556c28b56500 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5be0ff9640 10 client.17904 handle_command_reply: tid=0 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 client.17904 shutdown 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 msgr2=0x556c28ae3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058c0 tx=0x7f5be800bbc0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 shutdown_connections 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x556c28b56500 0x556c28b588f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c28ad6d40 0x556c28ade0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c28acc480 0x556c28ae3640 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 --2- 172.21.15.66:0/2987153324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c28acbb60 0x556c28ae3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 >> 172.21.15.66:0/2987153324 conn(0x556c28ac80f0 msgr2=0x556c28ac7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5be0ff9640 0 client.17904 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 shutdown_connections 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 1 -- 172.21.15.66:0/2987153324 wait complete. 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.756+0000 7f5c01c01740 20 client.17904 trim_cache size 0 max 16384 2024-09-15T22:56:35.762 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:56:35.763 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:56:35.763 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "afd32cb2-14a7-4444-a931-dd766106d2d7", 2024-09-15T22:56:35.763 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:56:35.763 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:56:35.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 msgr2=0x7f5be40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 0x7f5be40a58f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00099e0 tx=0x7f5bf000fe70 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 msgr2=0x7f5bf81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40042f0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 shutdown_connections 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5be40a3430 0x7f5be40a58f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bf810c2f0 0x7f5bf819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf81037a0 0x7f5bf8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 --2- 172.21.15.66:0/3046426610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf8102df0 0x7f5bf81985f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 >> 172.21.15.66:0/3046426610 conn(0x7f5bf80fc7d0 msgr2=0x7f5bf80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 shutdown_connections 2024-09-15T22:56:35.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:35.757+0000 7f5bff828640 1 -- 172.21.15.66:0/3046426610 wait complete. 2024-09-15T22:56:36.346 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:36 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:56:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:36 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:56:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:36 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:56:36.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:56:36.908 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:56:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:56:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:56:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:56:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:56:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: pgmap v350: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 293 KiB/s wr, 30 op/s 2024-09-15T22:56:37.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:56:37.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: pgmap v350: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 293 KiB/s wr, 30 op/s 2024-09-15T22:56:37.366 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: pgmap v350: 129 pgs: 129 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 293 KiB/s wr, 30 op/s 2024-09-15T22:56:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 -- 172.21.15.66:0/2998074774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f98102db0 msgr2=0x7f1f98103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/2998074774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f98102db0 0x7f1f98103190 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009930 tx=0x7f1f8802a420 comp rx=0 tx=0).stop 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 -- 172.21.15.66:0/2998074774 shutdown_connections 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/2998074774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f981082e0 0x7f1f9810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/2998074774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f98107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/2998074774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f98102db0 0x7f1f98103190 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 -- 172.21.15.66:0/2998074774 >> 172.21.15.66:0/2998074774 conn(0x7f1f980fc7d0 msgr2=0x7f1f980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 -- 172.21.15.66:0/2998074774 shutdown_connections 2024-09-15T22:56:37.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.639+0000 7f1f9e67e640 1 -- 172.21.15.66:0/2998074774 wait complete. 2024-09-15T22:56:37.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 Processor -- start 2024-09-15T22:56:37.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 -- start start 2024-09-15T22:56:37.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f981a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 0x7f1f9819ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98101df0 con 0x7f1f981082e0 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98101c70 con 0x7f1f9819a830 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f9e67e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98101f70 con 0x7f1f98103760 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f981a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57200/0 (socket says 172.21.15.66:57200) 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.640+0000 7f1f8ffff640 1 -- 172.21.15.66:0/4283364266 learned_addr learned my addr 172.21.15.66:0/4283364266 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 0x7f1f9819ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 -- 172.21.15.66:0/4283364266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 msgr2=0x7f1f981a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f981a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 -- 172.21.15.66:0/4283364266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 msgr2=0x7f1f9819ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 0x7f1f9819ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 -- 172.21.15.66:0/4283364266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9819b410 con 0x7f1f981082e0 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 0x7f1f9819ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f97fff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f981a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.641+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e9f0 tx=0x7f1f8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.642+0000 7f1f95ffb640 1 -- 172.21.15.66:0/4283364266 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000ccc0 con 0x7f1f981082e0 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.642+0000 7f1f95ffb640 1 -- 172.21.15.66:0/4283364266 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f80010910 con 0x7f1f981082e0 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.642+0000 7f1f95ffb640 1 -- 172.21.15.66:0/4283364266 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80018920 con 0x7f1f981082e0 2024-09-15T22:56:37.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.642+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9819b6a0 con 0x7f1f981082e0 2024-09-15T22:56:37.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.643+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981a7830 con 0x7f1f981082e0 2024-09-15T22:56:37.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.646+0000 7f1f95ffb640 1 -- 172.21.15.66:0/4283364266 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1f80010430 con 0x7f1f981082e0 2024-09-15T22:56:37.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.646+0000 7f1fa0a57740 1 Processor -- start 2024-09-15T22:56:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.646+0000 7f1fa0a57740 1 -- start start 2024-09-15T22:56:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 0x555fb11cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fb111b2e0 con 0x555fb11c8e90 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555fb10c2ce0 con 0x555fb11b5ce0 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555fb11172a0 con 0x555fb11b53c0 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1f9cc1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1f9cc1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:46582/0 (socket says 172.21.15.66:46582) 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/3459371361 learned_addr learned my addr 172.21.15.66:0/3459371361 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1f97fff640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.647+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 0x555fb11cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/3459371361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 msgr2=0x555fb11c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/3459371361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 msgr2=0x555fb11cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 0x555fb11cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/3459371361 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb10a7440 con 0x555fb11b53c0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 0x555fb11cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009fd0 tx=0x7f1f90010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88013c25f2252c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.648+0000 7f1f95ffb640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 0x7f1f840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.649+0000 7f1f97fff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 0x7f1f840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.649+0000 7f1f8e7fc640 1 -- 172.21.15.66:0/3459371361 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90011700 con 0x555fb11b53c0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.649+0000 7f1f8e7fc640 1 -- 172.21.15.66:0/3459371361 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f90011d80 con 0x555fb11b53c0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.649+0000 7f1f8e7fc640 1 -- 172.21.15.66:0/3459371361 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000e3c0 con 0x555fb11b53c0 2024-09-15T22:56:37.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.649+0000 7f1f95ffb640 1 -- 172.21.15.66:0/4283364266 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f1f800d0510 con 0x7f1f981082e0 2024-09-15T22:56:37.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1f97fff640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 0x7f1f840a58f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f88005ab0 tx=0x7f1f88005bd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3459371361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 msgr2=0x555fb11b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009fd0 tx=0x7f1f90010860 comp rx=0 tx=0).stop 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3459371361 shutdown_connections 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11c8e90 0x555fb11cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3459371361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b53c0 0x555fb11b57a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3459371361 >> 172.21.15.66:0/3459371361 conn(0x555fb11b1a30 msgr2=0x555fb11b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3459371361 shutdown_connections 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3459371361 wait complete. 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.650+0000 7f1fa0a57740 1 -- start start 2024-09-15T22:56:37.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 Processor -- start 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fb11cba00 con 0x555fb11b53c0 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555fb10d6050 con 0x555fb11b5ce0 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555fb11cbb80 con 0x555fb11c8e90 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57228/0 (socket says 172.21.15.66:57228) 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1f97fff640 1 -- 172.21.15.66:0/3192440108 learned_addr learned my addr 172.21.15.66:0/3192440108 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.651+0000 7f1fa0a57740 10 client.0 _ll_register_callbacks cb 0x555fb1116160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 -- 172.21.15.66:0/3192440108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 msgr2=0x555fb11c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 -- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 msgr2=0x555fb11c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 -- 172.21.15.66:0/3192440108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb0e8c3c0 con 0x555fb11b53c0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f97fff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009930 tx=0x7f1f8802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9f16354e5d90d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.652+0000 7f1f777fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8804d020 con 0x555fb11b53c0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f1f880048c0 con 0x555fb11b53c0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f90011d80 con 0x555fb11b53c0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1f88058050 con 0x555fb11b53c0 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1fa0a57740 10 client.17916 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:37.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.653+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x555fb11d7510 con 0x555fb11b53c0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f88032550 con 0x555fb11b53c0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f1f880544c0 con 0x555fb11b53c0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 10 client.17916 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 10 client.17916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 20 client.17916 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb11d89d0 0x555fb11dae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 4 client.17916 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1f90011d80 con 0x555fb11d89d0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.654+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb11d89d0 0x555fb11dae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.655+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb11d89d0 0x555fb11dae30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d324440e98fa66 server_cookie=84470ed19921d049 in_seq=0 out_seq=0 2024-09-15T22:56:37.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.655+0000 7f1f777fe640 10 client.17916 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:37.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.656+0000 7f1f777fe640 1 -- 172.21.15.66:0/3192440108 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1f90011d80 con 0x555fb11d89d0 2024-09-15T22:56:37.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.656+0000 7f1f777fe640 10 client.17916 handle_command_reply: tid=0 2024-09-15T22:56:37.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 client.17916 shutdown 2024-09-15T22:56:37.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 msgr2=0x555fb11c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009930 tx=0x7f1f8802a420 comp rx=0 tx=0).stop 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 shutdown_connections 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb11d89d0 0x555fb11dae30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b5ce0 0x555fb11c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/3192440108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c8910 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1f777fe640 0 client.17916 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 >> 172.21.15.66:0/3192440108 conn(0x555fb11b1a30 msgr2=0x555fb11b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 shutdown_connections 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.657+0000 7f1fa0a57740 1 -- 172.21.15.66:0/3192440108 wait complete. 2024-09-15T22:56:37.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.658+0000 7f1fa0a57740 20 client.17916 trim_cache size 0 max 16384 2024-09-15T22:56:37.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 Processor -- start 2024-09-15T22:56:37.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 -- start start 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 0x555fb11d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b5ce0 0x555fb11c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981ad820 con 0x555fb11b5ce0 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981af360 con 0x555fb11b53c0 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.684+0000 7f1fa0a57740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981adef0 con 0x555fb11c8e90 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 0x555fb11d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:46602/0 (socket says 172.21.15.66:46602) 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 0x555fb11d4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:35404/0 (socket says 172.21.15.66:35404) 2024-09-15T22:56:37.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/2419936421 learned_addr learned my addr 172.21.15.66:0/2419936421 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b5ce0 0x555fb11c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/2419936421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 msgr2=0x555fb11d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 0x555fb11d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/2419936421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b5ce0 msgr2=0x555fb11c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b5ce0 0x555fb11c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.685+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/2419936421 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb11d51e0 con 0x555fb11c8e90 2024-09-15T22:56:37.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.686+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f90005cc0 tx=0x7f1f90009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ef2e519bd72e8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.686+0000 7f1f8dffb640 1 -- 172.21.15.66:0/2419936421 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90022070 con 0x555fb11c8e90 2024-09-15T22:56:37.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.686+0000 7f1f8dffb640 1 -- 172.21.15.66:0/2419936421 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f90004ce0 con 0x555fb11c8e90 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.686+0000 7f1f8dffb640 1 -- 172.21.15.66:0/2419936421 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90005440 con 0x555fb11c8e90 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 -- 172.21.15.66:0/2419936421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 msgr2=0x555fb11e0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f90005cc0 tx=0x7f1f90009d40 comp rx=0 tx=0).stop 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 -- 172.21.15.66:0/2419936421 shutdown_connections 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11c8e90 0x555fb11e0700 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b5ce0 0x555fb11c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/2419936421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11b53c0 0x555fb11d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 -- 172.21.15.66:0/2419936421 >> 172.21.15.66:0/2419936421 conn(0x555fb11b1a30 msgr2=0x555fb11c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 -- 172.21.15.66:0/2419936421 shutdown_connections 2024-09-15T22:56:37.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.687+0000 7f1fa0a57740 1 -- 172.21.15.66:0/2419936421 wait complete. 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1fa0a57740 1 -- start start 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1fa0a57740 1 Processor -- start 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b5ce0 0x555fb11c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1fa0a57740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 0x555fb11c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.688+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57254/0 (socket says 172.21.15.66:57254) 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f97fff640 1 -- 172.21.15.66:0/1700728278 learned_addr learned my addr 172.21.15.66:0/1700728278 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 0x555fb11c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f8ffff640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b5ce0 0x555fb11c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981aec90 con 0x555fb11b53c0 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981ae5c0 con 0x555fb11c8e90 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981ab860 con 0x555fb11b5ce0 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1fa0a57740 10 client.0 _ll_register_callbacks cb 0x7f1f88040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/1700728278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b5ce0 msgr2=0x555fb11c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b5ce0 0x555fb11c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/1700728278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 msgr2=0x555fb11c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.689+0000 7f1f9cc1b640 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb12428d0 con 0x555fb11c8e90 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1f9cc1b640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 0x555fb11c3810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f90005cc0 tx=0x7f1f90009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5041581822f917db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1f777fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:56:37.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90033060 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f90004ce0 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9591+0+0 (secure 0 0 0) 0x7f1f90005040 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1f9003a050 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1fa0a57740 10 client.27275 fetch_fsmap learned FSMap version 49 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.690+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x555fb1243b20 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f90004ce0 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 49) ==== 8370+0+0 (secure 0 0 0) 0x7f1f9002e600 con 0x555fb11c8e90 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 10 client.27275 fetch_fsmap finished waiting for FSMap version 49 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 10 client.27275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:56:37.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 20 client.27275 populate_metadata read hostname 'smithi066' 2024-09-15T22:56:37.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb1243fa0 0x555fb1246390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:56:37.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 4 client.27275 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:56:37.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555fb1128850 con 0x555fb1243fa0 2024-09-15T22:56:37.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.691+0000 7f1f97fff640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb1243fa0 0x555fb1246390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.692+0000 7f1f97fff640 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb1243fa0 0x555fb1246390 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7516bd227f1164 server_cookie=fc68c9dc959a45ee in_seq=0 out_seq=0 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.692+0000 7f1f777fe640 10 client.27275 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1f777fe640 1 -- 172.21.15.66:0/1700728278 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x555fb1128850 con 0x555fb1243fa0 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1f777fe640 10 client.27275 handle_command_reply: tid=0 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 client.27275 shutdown 2024-09-15T22:56:37.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 msgr2=0x555fb11c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 0x555fb11c3810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f90005cc0 tx=0x7f1f90009280 comp rx=0 tx=0).stop 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 shutdown_connections 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x555fb1243fa0 0x555fb1246390 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1f777fe640 0 client.27275 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555fb11c8e90 0x555fb11c3810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555fb11b5ce0 0x555fb11c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 --2- 172.21.15.66:0/1700728278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fb11b53c0 0x555fb11c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 >> 172.21.15.66:0/1700728278 conn(0x555fb11b1a30 msgr2=0x555fb11c1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 shutdown_connections 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.693+0000 7f1fa0a57740 1 -- 172.21.15.66:0/1700728278 wait complete. 2024-09-15T22:56:37.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.694+0000 7f1fa0a57740 20 client.27275 trim_cache size 0 max 16384 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (7601 inodes in the stack)", 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "afd32cb2-14a7-4444-a931-dd766106d2d7": { 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "afd32cb2-14a7-4444-a931-dd766106d2d7", 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:56:37.700 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:56:37.701 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:56:37.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 msgr2=0x7f1f840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 0x7f1f840a58f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f88005ab0 tx=0x7f1f88005bd0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 msgr2=0x7f1f981a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:56:37.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e9f0 tx=0x7f1f8000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 shutdown_connections 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1f840a3430 0x7f1f840a58f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f9819a830 0x7f1f9819ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f981082e0 0x7f1f981a0bf0 secure :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e9f0 tx=0x7f1f8000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 --2- 172.21.15.66:0/4283364266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f98103760 0x7f1f981a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 >> 172.21.15.66:0/4283364266 conn(0x7f1f980fc7d0 msgr2=0x7f1f980fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 shutdown_connections 2024-09-15T22:56:37.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:56:37.695+0000 7f1f9e67e640 1 -- 172.21.15.66:0/4283364266 wait complete. 2024-09-15T22:56:38.463 INFO:tasks.cephfs.filesystem:scrub status for tag:afd32cb2-14a7-4444-a931-dd766106d2d7 - {'path': '/', 'tag': 'afd32cb2-14a7-4444-a931-dd766106d2d7', 'options': 'recursive,force'} 2024-09-15T22:56:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:39 smithi087 ceph-mon[35290]: pgmap v351: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 884 KiB/s wr, 66 op/s 2024-09-15T22:56:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:39 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:39 smithi184 ceph-mon[35203]: pgmap v351: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 884 KiB/s wr, 66 op/s 2024-09-15T22:56:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:39 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:39 smithi066 ceph-mon[31185]: pgmap v351: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 884 KiB/s wr, 66 op/s 2024-09-15T22:56:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:39 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:40.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:40 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:40 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:40.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:40 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:41 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:41 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:41 smithi087 ceph-mon[35290]: pgmap v352: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 879 KiB/s wr, 143 op/s 2024-09-15T22:56:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:41 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:41 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:41 smithi184 ceph-mon[35203]: pgmap v352: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 879 KiB/s wr, 143 op/s 2024-09-15T22:56:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:41 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:41 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:41 smithi066 ceph-mon[31185]: pgmap v352: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 879 KiB/s wr, 143 op/s 2024-09-15T22:56:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:43 smithi087 ceph-mon[35290]: pgmap v353: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 236 op/s 2024-09-15T22:56:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:43 smithi184 ceph-mon[35203]: pgmap v353: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 236 op/s 2024-09-15T22:56:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:43 smithi066 ceph-mon[31185]: pgmap v353: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 236 op/s 2024-09-15T22:56:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:44 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:44.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:44 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:44 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:44.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:44 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:44.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:44 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:44.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:44 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:56:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:45 smithi087 ceph-mon[35290]: pgmap v354: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-15T22:56:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:45 smithi184 ceph-mon[35203]: pgmap v354: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-15T22:56:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:45 smithi066 ceph-mon[31185]: pgmap v354: 129 pgs: 129 active+clean; 2.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 341 op/s 2024-09-15T22:56:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:47 smithi087 ceph-mon[35290]: pgmap v355: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-15T22:56:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:47 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:56:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:47 smithi184 ceph-mon[35203]: pgmap v355: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-15T22:56:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:47 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:56:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:47 smithi066 ceph-mon[31185]: pgmap v355: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-09-15T22:56:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:47 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:56:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:56:48.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:56:48.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:48 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:56:48.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:48 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:48.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:56:48.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:56:48.851 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:48 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:56:49.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:49 smithi087 ceph-mon[35290]: pgmap v356: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-15T22:56:49.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:49 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:49.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:49 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:49.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:49 smithi184 ceph-mon[35203]: pgmap v356: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-15T22:56:49.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:49 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:49.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:49 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:49.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:49 smithi066 ceph-mon[31185]: pgmap v356: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-15T22:56:49.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:49 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:49.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:49 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:50.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:56:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:50.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:56:50.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:50.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:50.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:50.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:56:51.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:51 smithi087 ceph-mon[35290]: pgmap v357: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:56:51.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:51 smithi184 ceph-mon[35203]: pgmap v357: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:56:51.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:51 smithi066 ceph-mon[31185]: pgmap v357: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 425 op/s 2024-09-15T22:56:52.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:52 smithi087 ceph-mon[35290]: pgmap v358: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 404 op/s 2024-09-15T22:56:52.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:52 smithi184 ceph-mon[35203]: pgmap v358: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 404 op/s 2024-09-15T22:56:52.948 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:52 smithi066 ceph-mon[31185]: pgmap v358: 129 pgs: 129 active+clean; 2.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 404 op/s 2024-09-15T22:56:55.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:54 smithi087 ceph-mon[35290]: pgmap v359: 129 pgs: 129 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 388 op/s 2024-09-15T22:56:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:54 smithi184 ceph-mon[35203]: pgmap v359: 129 pgs: 129 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 388 op/s 2024-09-15T22:56:55.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:54 smithi066 ceph-mon[31185]: pgmap v359: 129 pgs: 129 active+clean; 2.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 388 op/s 2024-09-15T22:56:57.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:56 smithi087 ceph-mon[35290]: pgmap v360: 129 pgs: 129 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 299 op/s 2024-09-15T22:56:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:56 smithi184 ceph-mon[35203]: pgmap v360: 129 pgs: 129 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 299 op/s 2024-09-15T22:56:57.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:56 smithi066 ceph-mon[31185]: pgmap v360: 129 pgs: 129 active+clean; 2.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 299 op/s 2024-09-15T22:56:59.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:58 smithi087 ceph-mon[35290]: pgmap v361: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 318 op/s 2024-09-15T22:56:59.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:56:58 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:58 smithi184 ceph-mon[35203]: pgmap v361: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 318 op/s 2024-09-15T22:56:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:56:58 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:56:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:58 smithi066 ceph-mon[31185]: pgmap v361: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 318 op/s 2024-09-15T22:56:59.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:56:58 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:01.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:00 smithi087 ceph-mon[35290]: pgmap v362: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 331 op/s 2024-09-15T22:57:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:00 smithi184 ceph-mon[35203]: pgmap v362: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 331 op/s 2024-09-15T22:57:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:00 smithi066 ceph-mon[31185]: pgmap v362: 129 pgs: 129 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 331 op/s 2024-09-15T22:57:03.099 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:02 smithi087 ceph-mon[35290]: pgmap v363: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 356 op/s 2024-09-15T22:57:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:02 smithi184 ceph-mon[35203]: pgmap v363: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 356 op/s 2024-09-15T22:57:03.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:02 smithi066 ceph-mon[31185]: pgmap v363: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 356 op/s 2024-09-15T22:57:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:03 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:04.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:03 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:04.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:03 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:04.896 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T22:57:04.896 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.85 2024-09-15T22:57:04.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:57:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:04 smithi184 ceph-mon[35203]: pgmap v364: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 372 op/s 2024-09-15T22:57:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:04 smithi066 ceph-mon[31185]: pgmap v364: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 372 op/s 2024-09-15T22:57:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:04 smithi087 ceph-mon[35290]: pgmap v364: 129 pgs: 129 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 372 op/s 2024-09-15T22:57:05.403 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:06.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.028+0000 7f1ed69d0640 1 -- 172.21.15.66:0/3928552228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 msgr2=0x7f1ed01021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.028+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/3928552228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed01021b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009860 tx=0x7f1ec002a380 comp rx=0 tx=0).stop 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 -- 172.21.15.66:0/3928552228 shutdown_connections 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/3928552228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/3928552228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/3928552228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed01021b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 -- 172.21.15.66:0/3928552228 >> 172.21.15.66:0/3928552228 conn(0x7f1ed00fd8b0 msgr2=0x7f1ed00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 -- 172.21.15.66:0/3928552228 shutdown_connections 2024-09-15T22:57:06.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.029+0000 7f1ed69d0640 1 -- 172.21.15.66:0/3928552228 wait complete. 2024-09-15T22:57:06.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.030+0000 7f1ed69d0640 1 Processor -- start 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.030+0000 7f1ed69d0640 1 -- start start 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed0111ff0 con 0x7f1ed0101dd0 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed0111e70 con 0x7f1ed0102780 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed69d0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed0112170 con 0x7f1ed0106f00 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ecf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ecf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60210/0 (socket says 172.21.15.66:60210) 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ecf7fe640 1 -- 172.21.15.66:0/1998645365 learned_addr learned my addr 172.21.15.66:0/1998645365 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:06.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ed4f6d640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.031+0000 7f1ecffff640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.032+0000 7f1ed4f6d640 1 -- 172.21.15.66:0/1998645365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 msgr2=0x7f1ed0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.032+0000 7f1ed4f6d640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.032+0000 7f1ed4f6d640 1 -- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 msgr2=0x7f1ed00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.032+0000 7f1ed4f6d640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.032+0000 7f1ed4f6d640 1 -- 172.21.15.66:0/1998645365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed01aaed0 con 0x7f1ed0106f00 2024-09-15T22:57:06.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.035+0000 7f1ed4f6d640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed0074f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ef00 tx=0x7f1ec800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:06.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.035+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8004b20 con 0x7f1ed0106f00 2024-09-15T22:57:06.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.036+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec8003e50 con 0x7f1ed0106f00 2024-09-15T22:57:06.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.036+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800b570 con 0x7f1ed0106f00 2024-09-15T22:57:06.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.036+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed01ab100 con 0x7f1ed0106f00 2024-09-15T22:57:06.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.036+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed01ab5f0 con 0x7f1ed0106f00 2024-09-15T22:57:06.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.042+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1ec801d020 con 0x7f1ed0106f00 2024-09-15T22:57:06.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.044+0000 7f1ecd7fa640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 0x7f1eb80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:06.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.044+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc005290 con 0x7f1ed0106f00 2024-09-15T22:57:06.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.044+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f1ec80cfec0 con 0x7f1ed0106f00 2024-09-15T22:57:06.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.053+0000 7f1ecffff640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 0x7f1eb80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:06.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.053+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ec809c3c0 con 0x7f1ed0106f00 2024-09-15T22:57:06.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.064+0000 7f1ecffff640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 0x7f1eb80a5a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009830 tx=0x7f1ec0009520 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:06.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:05 smithi184 ceph-mon[35203]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:57:06.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:05 smithi066 ceph-mon[31185]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:57:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:05 smithi087 ceph-mon[35290]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:57:06.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.490+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ebc005850 con 0x7f1ed0106f00 2024-09-15T22:57:06.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.495+0000 7f1ecd7fa640 1 -- 172.21.15.66:0/1998645365 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11986 (secure 0 0 0) 0x7f1ec809bcc0 con 0x7f1ed0106f00 2024-09-15T22:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":53,"btime":"2024-09-15T22:57:02:835371+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:02.677063+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:57:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 53 2024-09-15T22:57:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.499+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 msgr2=0x7f1eb80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.499+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 0x7f1eb80a5a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009830 tx=0x7f1ec0009520 comp rx=0 tx=0).stop 2024-09-15T22:57:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.499+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 msgr2=0x7f1ed0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.499+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed0074f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ef00 tx=0x7f1ec800c740 comp rx=0 tx=0).stop 2024-09-15T22:57:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 shutdown_connections 2024-09-15T22:57:06.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1eb80a35c0 0x7f1eb80a5a80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ed0106f00 0x7f1ed0074f70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0102780 0x7f1ed0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 --2- 172.21.15.66:0/1998645365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ed0101dd0 0x7f1ed00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.502+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 >> 172.21.15.66:0/1998645365 conn(0x7f1ed00fd8b0 msgr2=0x7f1ed00fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.505+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 shutdown_connections 2024-09-15T22:57:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:06.507+0000 7f1ed69d0640 1 -- 172.21.15.66:0/1998645365 wait complete. 2024-09-15T22:57:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:06 smithi184 ceph-mon[35203]: pgmap v366: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 384 op/s 2024-09-15T22:57:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:06 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1998645365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:07.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:06 smithi066 ceph-mon[31185]: pgmap v366: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 384 op/s 2024-09-15T22:57:07.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:06 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1998645365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 141.85 --await-for 45.0' 2024-09-15T22:57:07.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 141.85 --await-for 45.0 2024-09-15T22:57:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:06 smithi087 ceph-mon[35290]: pgmap v366: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 384 op/s 2024-09-15T22:57:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:06 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1998645365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:08.464 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:57:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:08 smithi184 ceph-mon[35203]: pgmap v367: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-15T22:57:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:08 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:09.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:08 smithi066 ceph-mon[31185]: pgmap v367: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-15T22:57:09.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:08 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:08 smithi087 ceph-mon[35290]: pgmap v367: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-15T22:57:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:08 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:57:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 -- 172.21.15.66:0/91672749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8101de0 msgr2=0x7f65f81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/91672749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8101de0 0x7f65f81021c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009900 tx=0x7f65e802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 -- 172.21.15.66:0/91672749 shutdown_connections 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/91672749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8106f10 0x7f65f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/91672749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/91672749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8101de0 0x7f65f81021c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 -- 172.21.15.66:0/91672749 >> 172.21.15.66:0/91672749 conn(0x7f65f80fd8c0 msgr2=0x7f65f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 -- 172.21.15.66:0/91672749 shutdown_connections 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.370+0000 7f65fdb9e640 1 -- 172.21.15.66:0/91672749 wait complete. 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 Processor -- start 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 -- start start 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8111f70 con 0x7f65f8106f10 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8111df0 con 0x7f65f8102790 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65fdb9e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81120f0 con 0x7f65f8101de0 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.371+0000 7f65f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35218/0 (socket says 172.21.15.66:35218) 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51384/0 (socket says 172.21.15.66:51384) 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f77fe640 1 -- 172.21.15.66:0/2768201113 learned_addr learned my addr 172.21.15.66:0/2768201113 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 -- 172.21.15.66:0/2768201113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 msgr2=0x7f65f80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 -- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 msgr2=0x7f65f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 -- 172.21.15.66:0/2768201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f81a6910 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f77fe640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f8074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00d6d0 tx=0x7f65ec00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f4ff9640 1 -- 172.21.15.66:0/2768201113 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec017070 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f4ff9640 1 -- 172.21.15.66:0/2768201113 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ec009820 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f81a6c00 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65f4ff9640 1 -- 172.21.15.66:0/2768201113 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec004d00 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.372+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81a7140 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65f4ff9640 1 -- 172.21.15.66:0/2768201113 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f65ec0099d0 con 0x7f65f8102790 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 Processor -- start 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 -- start start 2024-09-15T22:57:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 0x55eb29576c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29577170 0x55eb295814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb29583e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eb294db160 con 0x55eb29576850 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eb29482720 con 0x55eb29581a30 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65fff77740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55eb294d7120 con 0x55eb29577170 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65f4ff9640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 0x7f65e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb29583e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb29583e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60228/0 (socket says 172.21.15.66:60228) 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.375+0000 7f65f6ffd640 1 -- 172.21.15.66:0/2134710406 learned_addr learned my addr 172.21.15.66:0/2134710406 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 0x7f65e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 0x55eb29576c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 -- 172.21.15.66:0/2134710406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29577170 msgr2=0x55eb295814f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29577170 0x55eb295814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 -- 172.21.15.66:0/2134710406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 msgr2=0x55eb29583e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb29583e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 -- 172.21.15.66:0/2134710406 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb2924cba0 con 0x55eb29576850 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.376+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 0x55eb29576c30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005fd0 tx=0x7f65f000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40cfe0431c080ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.377+0000 7f65f4ff9640 1 -- 172.21.15.66:0/2768201113 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f65ec0cfc70 con 0x7f65f8102790 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.377+0000 7f65ddffb640 1 -- 172.21.15.66:0/2134710406 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0012c10 con 0x55eb29576850 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.378+0000 7f65ddffb640 1 -- 172.21.15.66:0/2134710406 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0023070 con 0x55eb29576850 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.378+0000 7f65ddffb640 1 -- 172.21.15.66:0/2134710406 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0027e10 con 0x55eb29576850 2024-09-15T22:57:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.378+0000 7f65fff77740 1 -- 172.21.15.66:0/2134710406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 msgr2=0x55eb29576c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 0x55eb29576c30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005fd0 tx=0x7f65f000f870 comp rx=0 tx=0).stop 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 0x7f65e00a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65f0022000 tx=0x7f65f0020000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 -- 172.21.15.66:0/2134710406 shutdown_connections 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb29583e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29577170 0x55eb295814f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 --2- 172.21.15.66:0/2134710406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29576850 0x55eb29576c30 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.379+0000 7f65fff77740 1 -- 172.21.15.66:0/2134710406 >> 172.21.15.66:0/2134710406 conn(0x55eb29572de0 msgr2=0x55eb295731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.380+0000 7f65fff77740 1 -- 172.21.15.66:0/2134710406 shutdown_connections 2024-09-15T22:57:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.383+0000 7f65fff77740 1 -- 172.21.15.66:0/2134710406 wait complete. 2024-09-15T22:57:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.384+0000 7f65fff77740 1 -- start start 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.384+0000 7f65fff77740 1 Processor -- start 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb2957ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2957f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eb29584600 con 0x55eb29577170 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eb29463900 con 0x55eb29576850 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55eb29584780 con 0x55eb29581a30 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65fff77740 10 client.0 _ll_register_callbacks cb 0x55eb29461780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60236/0 (socket says 172.21.15.66:60236) 2024-09-15T22:57:09.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65f77fe640 1 -- 172.21.15.66:0/1837616382 learned_addr learned my addr 172.21.15.66:0/1837616382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.385+0000 7f65f7fff640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2957f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb2957ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 -- 172.21.15.66:0/1837616382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 msgr2=0x55eb2957f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2957f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 -- 172.21.15.66:0/1837616382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 msgr2=0x55eb2957ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb2957ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 -- 172.21.15.66:0/1837616382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb294a3c50 con 0x55eb29576850 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.386+0000 7f65f77fe640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65e8031830 tx=0x7f65e8031860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ac1fb61ffd013f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.387+0000 7f65d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.387+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8035040 con 0x55eb29576850 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.387+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f65e8004450 con 0x55eb29576850 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0023070 con 0x55eb29576850 2024-09-15T22:57:09.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.389+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f65e8005050 con 0x55eb29576850 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.389+0000 7f65fff77740 10 client.27290 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.389+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55eb295a9b30 con 0x55eb29576850 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.389+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65e8004760 con 0x55eb29576850 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.389+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f65e8003670 con 0x55eb29576850 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 10 client.27290 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 10 client.27290 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 20 client.27290 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb295aaff0 0x55eb295ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 4 client.27290 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f65f0023070 con 0x55eb295aaff0 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.390+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb295aaff0 0x55eb295ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.392+0000 7f65f6ffd640 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb295aaff0 0x55eb295ad3e0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3356756a18e5f6 server_cookie=dc19990c38bb155f in_seq=0 out_seq=0 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.392+0000 7f65d6ffd640 10 client.27290 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:09.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.394+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1837616382 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f65f0023070 con 0x55eb295aaff0 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.394+0000 7f65d6ffd640 10 client.27290 handle_command_reply: tid=0 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.395+0000 7f65fff77740 1 client.27290 shutdown 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 msgr2=0x55eb2957e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65e8031830 tx=0x7f65e8031860 comp rx=0 tx=0).stop 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 shutdown_connections 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2957f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb2957ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.396+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb295aaff0 0x55eb295ad3e0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65fff77740 1 --2- 172.21.15.66:0/1837616382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb2957e950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 >> 172.21.15.66:0/1837616382 conn(0x55eb29572de0 msgr2=0x55eb29578b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65d6ffd640 0 client.27290 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 shutdown_connections 2024-09-15T22:57:09.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65fff77740 1 -- 172.21.15.66:0/1837616382 wait complete. 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.397+0000 7f65fff77740 20 client.27290 trim_cache size 0 max 16384 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.433+0000 7f65fff77740 1 Processor -- start 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 -- start start 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29576850 0x55eb2957f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8071bd0 con 0x55eb29577170 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8073890 con 0x55eb29581a30 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65fff77740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8072360 con 0x55eb29576850 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60242/0 (socket says 172.21.15.66:60242) 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65f7fff640 1 -- 172.21.15.66:0/2286816734 learned_addr learned my addr 172.21.15.66:0/2286816734 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:09.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.434+0000 7f65f77fe640 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29576850 0x55eb2957f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 -- 172.21.15.66:0/2286816734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29576850 msgr2=0x55eb2957f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29576850 0x55eb2957f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 -- 172.21.15.66:0/2286816734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 msgr2=0x55eb295b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 -- 172.21.15.66:0/2286816734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb2957cee0 con 0x55eb29581a30 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.435+0000 7f65f7fff640 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65f0012fa0 tx=0x7f65f0027ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4abb3873683543f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.436+0000 7f65dd7fa640 1 -- 172.21.15.66:0/2286816734 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f002b040 con 0x55eb29581a30 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.436+0000 7f65dd7fa640 1 -- 172.21.15.66:0/2286816734 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0034070 con 0x55eb29581a30 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.436+0000 7f65dd7fa640 1 -- 172.21.15.66:0/2286816734 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004c00 con 0x55eb29581a30 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.437+0000 7f65fff77740 1 -- 172.21.15.66:0/2286816734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 msgr2=0x55eb295b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.437+0000 7f65fff77740 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f65f0012fa0 tx=0x7f65f0027ab0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 -- 172.21.15.66:0/2286816734 shutdown_connections 2024-09-15T22:57:09.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29581a30 0x55eb295b3110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 --2- 172.21.15.66:0/2286816734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29576850 0x55eb2957f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 -- 172.21.15.66:0/2286816734 >> 172.21.15.66:0/2286816734 conn(0x55eb29572de0 msgr2=0x55eb29578ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.447+0000 7f65fff77740 1 -- 172.21.15.66:0/2286816734 shutdown_connections 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.450+0000 7f65fff77740 1 -- 172.21.15.66:0/2286816734 wait complete. 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.450+0000 7f65fff77740 1 -- start start 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.451+0000 7f65fff77740 1 Processor -- start 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.451+0000 7f65fff77740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb29592290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.451+0000 7f65fff77740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295927d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.451+0000 7f65fff77740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.452+0000 7f65fff77740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80731c0 con 0x55eb29577170 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.452+0000 7f65fff77740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8072af0 con 0x55eb29576850 2024-09-15T22:57:09.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.452+0000 7f65fff77740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65f806fbf0 con 0x55eb29581a30 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.452+0000 7f65fff77740 10 client.0 _ll_register_callbacks cb 0x7f65e8009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.454+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.454+0000 7f65f7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35260/0 (socket says 172.21.15.66:35260) 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.454+0000 7f65f7fff640 1 -- 172.21.15.66:0/1730498898 learned_addr learned my addr 172.21.15.66:0/1730498898 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.455+0000 7f65f7fff640 1 -- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 msgr2=0x55eb29592290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.455+0000 7f65f7fff640 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb29592290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.455+0000 7f65f7fff640 1 -- 172.21.15.66:0/1730498898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 msgr2=0x55eb295927d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.455+0000 7f65f7fff640 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.455+0000 7f65f7fff640 1 -- 172.21.15.66:0/1730498898 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb29592e90 con 0x55eb29581a30 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.456+0000 7f65f7fff640 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005fd0 tx=0x7f65f0005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156b58141f1a0967 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.458+0000 7f65d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:57:09.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.458+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f002b040 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.458+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f65f0027b20 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.460+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0034070 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.461+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f65f0027d20 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.461+0000 7f65fff77740 10 client.27217 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.461+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55eb29616150 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0034070 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f65f002e070 con 0x55eb29581a30 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 10 client.27217 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 10 client.27217 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 20 client.27217 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb29616640 0x55eb29618a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:09.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 4 client.27217 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.85, "await_for": 45.0}] 2024-09-15T22:57:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.462+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.85, "await_for": 45.0}) -- 0x55eb294e8890 con 0x55eb29616640 2024-09-15T22:57:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.463+0000 7f65f77fe640 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb29616640 0x55eb29618a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.464+0000 7f65f77fe640 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb29616640 0x55eb29618a30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24f234c31f03b290 server_cookie=e65c0a6d2ff488ef in_seq=0 out_seq=0 2024-09-15T22:57:09.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:09.464+0000 7f65d6ffd640 10 client.27217 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:09.748 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.344+0000 7f9437626640 1 -- 172.21.15.66:0/2600585572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9430105ec0 msgr2=0x7f9430106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.344+0000 7f9437626640 1 --2- 172.21.15.66:0/2600585572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9430105ec0 0x7f9430106340 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9428009ca0 tx=0x7f942802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.345+0000 7f9437626640 1 -- 172.21.15.66:0/2600585572 shutdown_connections 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.345+0000 7f9437626640 1 --2- 172.21.15.66:0/2600585572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9430105ec0 0x7f9430106340 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.345+0000 7f9437626640 1 --2- 172.21.15.66:0/2600585572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 0x7f9430105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.345+0000 7f9437626640 1 --2- 172.21.15.66:0/2600585572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94301008c0 0x7f9430100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.345+0000 7f9437626640 1 -- 172.21.15.66:0/2600585572 >> 172.21.15.66:0/2600585572 conn(0x7f94300fc7d0 msgr2=0x7f94300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.348+0000 7f9437626640 1 -- 172.21.15.66:0/2600585572 shutdown_connections 2024-09-15T22:57:10.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.349+0000 7f9437626640 1 -- 172.21.15.66:0/2600585572 wait complete. 2024-09-15T22:57:10.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.350+0000 7f9437626640 1 Processor -- start 2024-09-15T22:57:10.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 -- start start 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 0x7f943006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9430105ec0 0x7f943006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9430118630 con 0x7f94301008c0 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94301184b0 con 0x7f94301011e0 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.351+0000 7f9437626640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f94301187b0 con 0x7f9430105ec0 2024-09-15T22:57:10.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.352+0000 7f9434bc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 0x7f943006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.353+0000 7f94353c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.353+0000 7f94353c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51438/0 (socket says 172.21.15.66:51438) 2024-09-15T22:57:10.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.353+0000 7f94353c2640 1 -- 172.21.15.66:0/1535786336 learned_addr learned my addr 172.21.15.66:0/1535786336 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:10.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.354+0000 7f94353c2640 1 -- 172.21.15.66:0/1535786336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9430105ec0 msgr2=0x7f943006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.354+0000 7f94353c2640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9430105ec0 0x7f943006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.354+0000 7f94353c2640 1 -- 172.21.15.66:0/1535786336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 msgr2=0x7f943006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.354+0000 7f94353c2640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 0x7f943006ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.354+0000 7f94353c2640 1 -- 172.21.15.66:0/1535786336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943006d550 con 0x7f94301008c0 2024-09-15T22:57:10.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.355+0000 7f94353c2640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f942000e9f0 tx=0x7f942000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.356+0000 7f942e7fc640 1 -- 172.21.15.66:0/1535786336 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942000cd80 con 0x7f94301008c0 2024-09-15T22:57:10.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.356+0000 7f942e7fc640 1 -- 172.21.15.66:0/1535786336 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9420005500 con 0x7f94301008c0 2024-09-15T22:57:10.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.356+0000 7f942e7fc640 1 -- 172.21.15.66:0/1535786336 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420010690 con 0x7f94301008c0 2024-09-15T22:57:10.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.357+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943006d840 con 0x7f94301008c0 2024-09-15T22:57:10.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.357+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9430071810 con 0x7f94301008c0 2024-09-15T22:57:10.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.362+0000 7f94399ff740 1 Processor -- start 2024-09-15T22:57:10.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.362+0000 7f94399ff740 1 -- start start 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.362+0000 7f94399ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f94399ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420752140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f94399ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420752680 0x55f420754a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f94399ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f4206ad2e0 con 0x55f4207474a0 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f94399ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f420654ce0 con 0x55f420747dc0 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f94399ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f4206a92a0 con 0x55f420752680 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51444/0 (socket says 172.21.15.66:51444) 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 -- 172.21.15.66:0/958428443 learned_addr learned my addr 172.21.15.66:0/958428443 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9434bc1640 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420752680 0x55f420754a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 -- 172.21.15.66:0/958428443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420752680 msgr2=0x55f420754a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420752680 0x55f420754a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 -- 172.21.15.66:0/958428443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 msgr2=0x55f420752140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:57:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420752140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.363+0000 7f9435bc3640 1 -- 172.21.15.66:0/958428443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420639440 con 0x55f4207474a0 2024-09-15T22:57:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.364+0000 7f9435bc3640 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f94280097b0 tx=0x7f9428005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c2e5c2e5ec4d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.364+0000 7f94277fe640 1 -- 172.21.15.66:0/958428443 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428031ba0 con 0x55f4207474a0 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.365+0000 7f942e7fc640 1 -- 172.21.15.66:0/1535786336 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9420010830 con 0x7f94301008c0 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.365+0000 7f94277fe640 1 -- 172.21.15.66:0/958428443 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942803f070 con 0x55f4207474a0 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.366+0000 7f94399ff740 1 -- 172.21.15.66:0/958428443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 msgr2=0x55f420747880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.366+0000 7f94399ff740 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f94280097b0 tx=0x7f9428005ef0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.366+0000 7f942e7fc640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 0x7f941c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.366+0000 7f942e7fc640 1 -- 172.21.15.66:0/1535786336 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f94200d0510 con 0x7f94301008c0 2024-09-15T22:57:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.367+0000 7f9435bc3640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 0x7f941c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.370+0000 7f94399ff740 1 -- 172.21.15.66:0/958428443 shutdown_connections 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.370+0000 7f94399ff740 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420752680 0x55f420754a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.370+0000 7f94399ff740 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420752140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.370+0000 7f94399ff740 1 --2- 172.21.15.66:0/958428443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420747880 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.370+0000 7f94399ff740 1 -- 172.21.15.66:0/958428443 >> 172.21.15.66:0/958428443 conn(0x55f420743a30 msgr2=0x55f420743e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.371+0000 7f9435bc3640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 0x7f941c0a5a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94280097b0 tx=0x7f9428009800 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.371+0000 7f94399ff740 1 -- 172.21.15.66:0/958428443 shutdown_connections 2024-09-15T22:57:10.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.372+0000 7f94399ff740 1 -- 172.21.15.66:0/958428443 wait complete. 2024-09-15T22:57:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.372+0000 7f94399ff740 1 -- start start 2024-09-15T22:57:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.372+0000 7f94399ff740 1 Processor -- start 2024-09-15T22:57:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420751f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42074f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f4207552a0 con 0x55f4207474a0 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f420668050 con 0x55f420752680 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f420755420 con 0x55f420747dc0 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f94399ff740 10 client.0 _ll_register_callbacks cb 0x55f4206a8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42074f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42074f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60276/0 (socket says 172.21.15.66:60276) 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.373+0000 7f9435bc3640 1 -- 172.21.15.66:0/2495892457 learned_addr learned my addr 172.21.15.66:0/2495892457 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:10.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f94353c2640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420751f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 -- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 msgr2=0x55f42074f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42074f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 -- 172.21.15.66:0/2495892457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 msgr2=0x55f420751f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420751f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f9434bc1640 1 -- 172.21.15.66:0/2495892457 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42041e3c0 con 0x55f420747dc0 2024-09-15T22:57:10.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.374+0000 7f94353c2640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420751f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:10.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.375+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074f1e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f943006e210 tx=0x7f9418012880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a70b1a24fb9761 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.375+0000 7f9424ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:57:10.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.375+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800e8b0 con 0x55f420747dc0 2024-09-15T22:57:10.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.375+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f941800ea50 con 0x55f420747dc0 2024-09-15T22:57:10.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.376+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f942803f070 con 0x55f420747dc0 2024-09-15T22:57:10.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.380+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f941800ec50 con 0x55f420747dc0 2024-09-15T22:57:10.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.380+0000 7f94399ff740 10 client.27226 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:10.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.380+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f420771d30 con 0x55f420747dc0 2024-09-15T22:57:10.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.381+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942803f070 con 0x55f420747dc0 2024-09-15T22:57:10.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.381+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f9418019070 con 0x55f420747dc0 2024-09-15T22:57:10.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 10 client.27226 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 10 client.27226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 20 client.27226 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207731e0 0x55f4207755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 4 client.27226 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4206ba850 con 0x55f4207731e0 2024-09-15T22:57:10.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.382+0000 7f94353c2640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207731e0 0x55f4207755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.384+0000 7f9424ff9640 10 client.27226 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:10.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.384+0000 7f94353c2640 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207731e0 0x55f4207755d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d20385908260f52e server_cookie=91df6f578094e78 in_seq=0 out_seq=0 2024-09-15T22:57:10.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.384+0000 7f9424ff9640 1 -- 172.21.15.66:0/2495892457 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4206ba850 con 0x55f4207731e0 2024-09-15T22:57:10.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.384+0000 7f9424ff9640 10 client.27226 handle_command_reply: tid=0 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.384+0000 7f94399ff740 1 client.27226 shutdown 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 msgr2=0x55f42074f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074f1e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f943006e210 tx=0x7f9418012880 comp rx=0 tx=0).stop 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 shutdown_connections 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207731e0 0x55f4207755d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42074f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f9424ff9640 0 client.27226 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:10.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074f1e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 --2- 172.21.15.66:0/2495892457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f420751f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 >> 172.21.15.66:0/2495892457 conn(0x55f420743a30 msgr2=0x55f420749760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 shutdown_connections 2024-09-15T22:57:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 1 -- 172.21.15.66:0/2495892457 wait complete. 2024-09-15T22:57:10.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.385+0000 7f94399ff740 20 client.27226 trim_cache size 0 max 16384 2024-09-15T22:57:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.413+0000 7f94399ff740 1 Processor -- start 2024-09-15T22:57:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.413+0000 7f94399ff740 1 -- start start 2024-09-15T22:57:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f42074a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9410010340 con 0x55f4207474a0 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9410012000 con 0x55f420752680 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94399ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9410010ad0 con 0x55f420747dc0 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f94353c2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f42074a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f9435bc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60284/0 (socket says 172.21.15.66:60284) 2024-09-15T22:57:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.414+0000 7f9435bc3640 1 -- 172.21.15.66:0/3488431443 learned_addr learned my addr 172.21.15.66:0/3488431443 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:10.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.416+0000 7f9435bc3640 1 -- 172.21.15.66:0/3488431443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 msgr2=0x55f42074e1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:57:10.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.416+0000 7f9435bc3640 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.416+0000 7f9435bc3640 1 -- 172.21.15.66:0/3488431443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 msgr2=0x55f42074a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.416+0000 7f9435bc3640 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f42074a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.416+0000 7f9435bc3640 1 -- 172.21.15.66:0/3488431443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4207522a0 con 0x55f420752680 2024-09-15T22:57:10.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.418+0000 7f9435bc3640 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9428006010 tx=0x7f9428050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea367a5f9495cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.419+0000 7f9426ffd640 1 -- 172.21.15.66:0/3488431443 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428003da0 con 0x55f420752680 2024-09-15T22:57:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.420+0000 7f9426ffd640 1 -- 172.21.15.66:0/3488431443 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942803f040 con 0x55f420752680 2024-09-15T22:57:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.420+0000 7f9426ffd640 1 -- 172.21.15.66:0/3488431443 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94280446d0 con 0x55f420752680 2024-09-15T22:57:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 -- 172.21.15.66:0/3488431443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 msgr2=0x55f42077aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9428006010 tx=0x7f9428050000 comp rx=0 tx=0).stop 2024-09-15T22:57:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 -- 172.21.15.66:0/3488431443 shutdown_connections 2024-09-15T22:57:10.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420752680 0x55f42077aea0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f420747dc0 0x55f42074e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 --2- 172.21.15.66:0/3488431443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f4207474a0 0x55f42074a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.421+0000 7f94399ff740 1 -- 172.21.15.66:0/3488431443 >> 172.21.15.66:0/3488431443 conn(0x55f420743a30 msgr2=0x55f42074dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.424+0000 7f94399ff740 1 -- 172.21.15.66:0/3488431443 shutdown_connections 2024-09-15T22:57:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.424+0000 7f94399ff740 1 -- 172.21.15.66:0/3488431443 wait complete. 2024-09-15T22:57:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.424+0000 7f94399ff740 1 -- start start 2024-09-15T22:57:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.425+0000 7f94399ff740 1 Processor -- start 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4207474a0 0x55f4207566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f420752680 0x55f420757150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9410011930 con 0x55f420752680 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9410011260 con 0x55f420747dc0 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f941000e340 con 0x55f4207474a0 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94399ff740 10 client.0 _ll_register_callbacks cb 0x7f9418009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f9434bc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f94353c2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4207474a0 0x55f4207566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f9434bc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60288/0 (socket says 172.21.15.66:60288) 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f9434bc1640 1 -- 172.21.15.66:0/2382031515 learned_addr learned my addr 172.21.15.66:0/2382031515 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.426+0000 7f9435bc3640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f420752680 0x55f420757150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 -- 172.21.15.66:0/2382031515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4207474a0 msgr2=0x55f4207566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4207474a0 0x55f4207566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 -- 172.21.15.66:0/2382031515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f420752680 msgr2=0x55f420757150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f420752680 0x55f420757150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 -- 172.21.15.66:0/2382031515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4207dd0c0 con 0x55f420747dc0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9434bc1640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55f420750820 tx=0x7f941800e8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4363d9f813683569 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9424ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418029030 con 0x55f420747dc0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f942803f040 con 0x55f420747dc0 2024-09-15T22:57:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.427+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f9418005250 con 0x55f420747dc0 2024-09-15T22:57:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.428+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f9418005d30 con 0x55f420747dc0 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.428+0000 7f94399ff740 10 client.27305 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.428+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f4207de390 con 0x55f420747dc0 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942803f040 con 0x55f420747dc0 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f9418019040 con 0x55f420747dc0 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 10 client.27305 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 10 client.27305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 20 client.27305 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207deb40 0x55f4207e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 4 client.27305 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f4206b4d60 con 0x55f4207deb40 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.429+0000 7f94353c2640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207deb40 0x55f4207e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.430+0000 7f9424ff9640 10 client.27305 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.430+0000 7f94353c2640 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207deb40 0x55f4207e0f60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3104469b5b5eb107 server_cookie=ed112cddd0f0577b in_seq=0 out_seq=0 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f9424ff9640 1 -- 172.21.15.66:0/2382031515 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f4206b4d60 con 0x55f4207deb40 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f9424ff9640 10 client.27305 handle_command_reply: tid=0 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 client.27305 shutdown 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 msgr2=0x55f420756c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55f420750820 tx=0x7f941800e8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 shutdown_connections 2024-09-15T22:57:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f420752680 0x55f420757150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f4207deb40 0x55f4207e0f60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f420747dc0 0x55f420756c10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 --2- 172.21.15.66:0/2382031515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4207474a0 0x55f4207566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 >> 172.21.15.66:0/2382031515 conn(0x55f420743a30 msgr2=0x55f42074e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f9424ff9640 0 client.27305 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 shutdown_connections 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.431+0000 7f94399ff740 1 -- 172.21.15.66:0/2382031515 wait complete. 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f94399ff740 20 client.27305 trim_cache size 0 max 16384 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:57:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:57:10.436 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 msgr2=0x7f941c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 0x7f941c0a5a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94280097b0 tx=0x7f9428009800 comp rx=0 tx=0).stop 2024-09-15T22:57:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 msgr2=0x7f94300739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f942000e9f0 tx=0x7f942000edf0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 shutdown_connections 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f941c0a3580 0x7f941c0a5a40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9430105ec0 0x7f943006cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94301011e0 0x7f943006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 --2- 172.21.15.66:0/1535786336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94301008c0 0x7f94300739c0 secure :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f942000e9f0 tx=0x7f942000edf0 comp rx=0 tx=0).stop 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.432+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 >> 172.21.15.66:0/1535786336 conn(0x7f94300fc7d0 msgr2=0x7f9430103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.433+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 shutdown_connections 2024-09-15T22:57:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:10.433+0000 7f9437626640 1 -- 172.21.15.66:0/1535786336 wait complete. 2024-09-15T22:57:11.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:10 smithi184 ceph-mon[35203]: pgmap v368: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 343 op/s 2024-09-15T22:57:11.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:10 smithi066 ceph-mon[31185]: pgmap v368: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 343 op/s 2024-09-15T22:57:11.250 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:57:11.251 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:57:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:10 smithi087 ceph-mon[35290]: pgmap v368: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 343 op/s 2024-09-15T22:57:11.707 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 -- 172.21.15.66:0/542690702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102ef0 msgr2=0x7fc6ec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 --2- 172.21.15.66:0/542690702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec10da40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009c10 tx=0x7fc6e402a770 comp rx=0 tx=0).stop 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 -- 172.21.15.66:0/542690702 shutdown_connections 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 --2- 172.21.15.66:0/542690702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec10da40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 --2- 172.21.15.66:0/542690702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec102570 0x7fc6ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 --2- 172.21.15.66:0/542690702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec100e20 0x7fc6ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 -- 172.21.15.66:0/542690702 >> 172.21.15.66:0/542690702 conn(0x7fc6ec0fc7d0 msgr2=0x7fc6ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 -- 172.21.15.66:0/542690702 shutdown_connections 2024-09-15T22:57:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.264+0000 7fc6f294d640 1 -- 172.21.15.66:0/542690702 wait complete. 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 Processor -- start 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 -- start start 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec100e20 0x7fc6ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102570 0x7fc6ec198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec110f30 con 0x7fc6ec102ef0 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec110db0 con 0x7fc6ec102570 2024-09-15T22:57:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.265+0000 7fc6f294d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec1110b0 con 0x7fc6ec100e20 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59676/0 (socket says 172.21.15.66:59676) 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 -- 172.21.15.66:0/865175920 learned_addr learned my addr 172.21.15.66:0/865175920 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6eb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102570 0x7fc6ec198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6ebfff640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec100e20 0x7fc6ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 -- 172.21.15.66:0/865175920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec100e20 msgr2=0x7fc6ec198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec100e20 0x7fc6ec198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 -- 172.21.15.66:0/865175920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102570 msgr2=0x7fc6ec198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102570 0x7fc6ec198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 -- 172.21.15.66:0/865175920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec19d4d0 con 0x7fc6ec102ef0 2024-09-15T22:57:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f0eea640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40305d0 tx=0x7fc6e4030600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4041020 con 0x7fc6ec102ef0 2024-09-15T22:57:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec19d760 con 0x7fc6ec102ef0 2024-09-15T22:57:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.266+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e4037040 con 0x7fc6ec102ef0 2024-09-15T22:57:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.267+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4036070 con 0x7fc6ec102ef0 2024-09-15T22:57:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.267+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1a50a0 con 0x7fc6ec102ef0 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.267+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec101200 con 0x7fc6ec102ef0 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.269+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc6e4044020 con 0x7fc6ec102ef0 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.269+0000 7fc6e97fa640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 0x7fc6d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.269+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7fc6e40f0f20 con 0x7fc6ec102ef0 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.269+0000 7fc6ebfff640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 0x7fc6d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.270+0000 7fc6ebfff640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 0x7fc6d40a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005fd0 tx=0x7fc6dc009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:12.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.273+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6e404b020 con 0x7fc6ec102ef0 2024-09-15T22:57:12.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.586+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ec199880 con 0x7fc6ec102ef0 2024-09-15T22:57:12.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.587+0000 7fc6e97fa640 1 -- 172.21.15.66:0/865175920 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11988 (secure 0 0 0) 0x7fc6ec199880 con 0x7fc6ec102ef0 2024-09-15T22:57:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:57:12.588 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"btime":"2024-09-15T22:57:07:882300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:07.497310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:57:12.589 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-09-15T22:57:12.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 msgr2=0x7fc6d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 0x7fc6d40a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc005fd0 tx=0x7fc6dc009260 comp rx=0 tx=0).stop 2024-09-15T22:57:12.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 msgr2=0x7fc6ec19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:12.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40305d0 tx=0x7fc6e4030600 comp rx=0 tx=0).stop 2024-09-15T22:57:12.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 shutdown_connections 2024-09-15T22:57:12.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc6d40a33b0 0x7fc6d40a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6ec102ef0 0x7fc6ec19cdf0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6ec102570 0x7fc6ec198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 --2- 172.21.15.66:0/865175920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6ec100e20 0x7fc6ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:12.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 >> 172.21.15.66:0/865175920 conn(0x7fc6ec0fc7d0 msgr2=0x7fc6ec06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:12.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.590+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 shutdown_connections 2024-09-15T22:57:12.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:12.591+0000 7fc6f294d640 1 -- 172.21.15.66:0/865175920 wait complete. 2024-09-15T22:57:13.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:12 smithi184 ceph-mon[35203]: pgmap v369: 129 pgs: 16 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 278 op/s 2024-09-15T22:57:13.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:12 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/865175920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:13.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:12 smithi066 ceph-mon[31185]: pgmap v369: 129 pgs: 16 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 278 op/s 2024-09-15T22:57:13.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:12 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/865175920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:13.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:57:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:12 smithi087 ceph-mon[35290]: pgmap v369: 129 pgs: 16 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 278 op/s 2024-09-15T22:57:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:12 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/865175920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:13.606 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:15.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:14 smithi066 ceph-mon[31185]: pgmap v370: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-15T22:57:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:14 smithi087 ceph-mon[35290]: pgmap v370: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-15T22:57:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:14 smithi184 ceph-mon[35203]: pgmap v370: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 -- 172.21.15.66:0/549665409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450101de0 msgr2=0x7f24501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 --2- 172.21.15.66:0/549665409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450101de0 0x7f24501021c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2448009860 tx=0x7f244802a340 comp rx=0 tx=0).stop 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 -- 172.21.15.66:0/549665409 shutdown_connections 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 --2- 172.21.15.66:0/549665409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 0x7f245010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 --2- 172.21.15.66:0/549665409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450102790 0x7f24501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 --2- 172.21.15.66:0/549665409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450101de0 0x7f24501021c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 -- 172.21.15.66:0/549665409 >> 172.21.15.66:0/549665409 conn(0x7f24500fd8c0 msgr2=0x7f24500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 -- 172.21.15.66:0/549665409 shutdown_connections 2024-09-15T22:57:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.576+0000 7f2457e0b640 1 -- 172.21.15.66:0/549665409 wait complete. 2024-09-15T22:57:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 Processor -- start 2024-09-15T22:57:16.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 -- start start 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450101de0 0x7f24501984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 0x7f245019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111f70 con 0x7f2450106f10 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111df0 con 0x7f2450102790 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2457e0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24501120f0 con 0x7f2450101de0 2024-09-15T22:57:16.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24563a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 0x7f245019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58528/0 (socket says 172.21.15.66:58528) 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 -- 172.21.15.66:0/4151682433 learned_addr learned my addr 172.21.15.66:0/4151682433 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f2455ba7640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450101de0 0x7f24501984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 -- 172.21.15.66:0/4151682433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450101de0 msgr2=0x7f24501984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450101de0 0x7f24501984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 -- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 msgr2=0x7f245019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 0x7f245019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.577+0000 7f24553a6640 1 -- 172.21.15.66:0/4151682433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245019d480 con 0x7f2450102790 2024-09-15T22:57:16.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f24553a6640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9f0 tx=0x7f244400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f244effd640 1 -- 172.21.15.66:0/4151682433 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244400cd80 con 0x7f2450102790 2024-09-15T22:57:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f244effd640 1 -- 172.21.15.66:0/4151682433 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2444010910 con 0x7f2450102790 2024-09-15T22:57:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245019d770 con 0x7f2450102790 2024-09-15T22:57:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f244effd640 1 -- 172.21.15.66:0/4151682433 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444018990 con 0x7f2450102790 2024-09-15T22:57:16.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.578+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a5050 con 0x7f2450102790 2024-09-15T22:57:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.580+0000 7f244effd640 1 -- 172.21.15.66:0/4151682433 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2444010ac0 con 0x7f2450102790 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 Processor -- start 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 -- start start 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c3818090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3818a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c3829b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5567c377e2f0 con 0x5567c38185d0 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5567c3725cf0 con 0x5567c3819b40 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f245a1e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5567c377a2b0 con 0x5567c3827780 2024-09-15T22:57:16.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3818a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3818a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59698/0 (socket says 172.21.15.66:59698) 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f2455ba7640 1 -- 172.21.15.66:0/820778957 learned_addr learned my addr 172.21.15.66:0/820778957 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f24563a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c3818090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f24553a6640 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c3829b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.581+0000 7f244effd640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 0x7f24380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 -- 172.21.15.66:0/820778957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 msgr2=0x5567c3829b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c3829b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 -- 172.21.15.66:0/820778957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 msgr2=0x5567c3818a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3818a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 -- 172.21.15.66:0/820778957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c370a3a0 con 0x5567c3819b40 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f244effd640 1 -- 172.21.15.66:0/4151682433 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f24440d04b0 con 0x7f2450102790 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 0x7f24380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f24563a8640 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c3818090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244000e450 tx=0x7f244000e850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d5af0ad658a41b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f2437fff640 1 -- 172.21.15.66:0/820778957 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244001b950 con 0x5567c3819b40 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f2437fff640 1 -- 172.21.15.66:0/820778957 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2440026440 con 0x5567c3819b40 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.582+0000 7f2437fff640 1 -- 172.21.15.66:0/820778957 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244001a5e0 con 0x5567c3819b40 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 -- 172.21.15.66:0/820778957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 msgr2=0x5567c3818090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f24563a8640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 0x7f24380a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2440023000 tx=0x7f2440024000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c3818090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244000e450 tx=0x7f244000e850 comp rx=0 tx=0).stop 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 -- 172.21.15.66:0/820778957 shutdown_connections 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c3829b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3818a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 --2- 172.21.15.66:0/820778957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c3818090 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 -- 172.21.15.66:0/820778957 >> 172.21.15.66:0/820778957 conn(0x5567c37e1310 msgr2=0x5567c3814c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 -- 172.21.15.66:0/820778957 shutdown_connections 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.583+0000 7f245a1e4740 1 -- 172.21.15.66:0/820778957 wait complete. 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 -- start start 2024-09-15T22:57:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 Processor -- start 2024-09-15T22:57:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c38243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c38249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5567c382a480 con 0x5567c38185d0 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5567c3739060 con 0x5567c3819b40 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5567c382a600 con 0x5567c3827780 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f245a1e4740 10 client.0 _ll_register_callbacks cb 0x5567c348c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59710/0 (socket says 172.21.15.66:59710) 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.584+0000 7f24553a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c38243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 -- 172.21.15.66:0/1072202094 learned_addr learned my addr 172.21.15.66:0/1072202094 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24563a8640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c38249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 -- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 msgr2=0x5567c38249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c38249e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 -- 172.21.15.66:0/1072202094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 msgr2=0x5567c38243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c38243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 -- 172.21.15.66:0/1072202094 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c34ef3c0 con 0x5567c38185d0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24553a6640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c38243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f2455ba7640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f244802a930 tx=0x7f24480303d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2747bbd9100711b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24357fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448037040 con 0x5567c38185d0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f2448030550 con 0x5567c38185d0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2440026440 con 0x5567c38185d0 2024-09-15T22:57:16.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f244804c050 con 0x5567c38185d0 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f245a1e4740 10 client.17976 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.585+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5567c3835f30 con 0x5567c38185d0 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2440026440 con 0x5567c38185d0 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f244803d450 con 0x5567c38185d0 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 10 client.17976 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 10 client.17976 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 20 client.17976 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c3837490 0x5567c38398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 4 client.17976 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567c378b860 con 0x5567c3837490 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.586+0000 7f24553a6640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c3837490 0x5567c38398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.587+0000 7f24553a6640 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c3837490 0x5567c38398f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb0942e1cde9c85f server_cookie=a7707f7677c134b2 in_seq=0 out_seq=0 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.587+0000 7f24357fa640 10 client.17976 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.587+0000 7f24357fa640 1 -- 172.21.15.66:0/1072202094 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567c378b860 con 0x5567c3837490 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.587+0000 7f24357fa640 10 client.17976 handle_command_reply: tid=0 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.587+0000 7f245a1e4740 1 client.17976 shutdown 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 msgr2=0x5567c3827140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f244802a930 tx=0x7f24480303d0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 shutdown_connections 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c3837490 0x5567c38398f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c38249e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c38243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f24357fa640 0 client.17976 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 --2- 172.21.15.66:0/1072202094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3827140 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 >> 172.21.15.66:0/1072202094 conn(0x5567c37e1310 msgr2=0x5567c381a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 shutdown_connections 2024-09-15T22:57:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 1 -- 172.21.15.66:0/1072202094 wait complete. 2024-09-15T22:57:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.588+0000 7f245a1e4740 20 client.17976 trim_cache size 0 max 16384 2024-09-15T22:57:16.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 Processor -- start 2024-09-15T22:57:16.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 -- start start 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 0x5567c3833720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c383f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ad100 con 0x5567c3827780 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24501aedc0 con 0x5567c3819b40 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.601+0000 7f245a1e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ad890 con 0x5567c38185d0 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24563a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24563a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59724/0 (socket says 172.21.15.66:59724) 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24563a8640 1 -- 172.21.15.66:0/775197519 learned_addr learned my addr 172.21.15.66:0/775197519 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:16.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 0x5567c3833720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24553a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c383f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 -- 172.21.15.66:0/775197519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 msgr2=0x5567c383f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c383f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 -- 172.21.15.66:0/775197519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 msgr2=0x5567c383f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 -- 172.21.15.66:0/775197519 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c38144f0 con 0x5567c38185d0 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24563a8640 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f2455ba7640 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 0x5567c3833720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f244802a860 tx=0x7f244802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4146b4f40d0a7416 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24377fe640 1 -- 172.21.15.66:0/775197519 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448037030 con 0x5567c38185d0 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24377fe640 1 -- 172.21.15.66:0/775197519 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448055070 con 0x5567c38185d0 2024-09-15T22:57:16.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.602+0000 7f24377fe640 1 -- 172.21.15.66:0/775197519 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448005040 con 0x5567c38185d0 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- 172.21.15.66:0/775197519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 msgr2=0x5567c3833720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 0x5567c3833720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f244802a860 tx=0x7f244802a340 comp rx=0 tx=0).stop 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- 172.21.15.66:0/775197519 shutdown_connections 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c3827780 0x5567c383f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c383f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 --2- 172.21.15.66:0/775197519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c38185d0 0x5567c3833720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- 172.21.15.66:0/775197519 >> 172.21.15.66:0/775197519 conn(0x5567c37e1310 msgr2=0x5567c381f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- 172.21.15.66:0/775197519 shutdown_connections 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- 172.21.15.66:0/775197519 wait complete. 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 -- start start 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.603+0000 7f245a1e4740 1 Processor -- start 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c382b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c382b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ae6f0 con 0x5567c38185d0 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ae020 con 0x5567c3819b40 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ab100 con 0x5567c3827780 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f245a1e4740 10 client.0 _ll_register_callbacks cb 0x7f2444005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f24553a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c382b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59726/0 (socket says 172.21.15.66:59726) 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 -- 172.21.15.66:0/3859300529 learned_addr learned my addr 172.21.15.66:0/3859300529 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:16.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f24563a8640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c382b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 -- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 msgr2=0x5567c382b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c382b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 -- 172.21.15.66:0/3859300529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 msgr2=0x5567c382b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c382b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f2455ba7640 1 -- 172.21.15.66:0/3859300529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c382c110 con 0x5567c38185d0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.604+0000 7f24553a6640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c382b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f2455ba7640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f244802a900 tx=0x7f244802aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6965d2a5923b48b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f24357fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244805e060 con 0x5567c38185d0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f2448030550 con 0x5567c38185d0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448055070 con 0x5567c38185d0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2448065050 con 0x5567c38185d0 2024-09-15T22:57:16.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f245a1e4740 10 client.17982 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5567c38a2220 con 0x5567c38185d0 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.605+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448055070 con 0x5567c38185d0 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f24480046c0 con 0x5567c38185d0 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 10 client.17982 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 10 client.17982 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 20 client.17982 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c38a2910 0x5567c38a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 4 client.17982 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5567c3785d70 con 0x5567c38a2910 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24553a6640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c38a2910 0x5567c38a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24553a6640 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c38a2910 0x5567c38a4d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2a144dc88dacc3eb server_cookie=d318815e0f4be831 in_seq=0 out_seq=0 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24357fa640 10 client.17982 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24357fa640 1 -- 172.21.15.66:0/3859300529 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5567c3785d70 con 0x5567c38a2910 2024-09-15T22:57:16.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f24357fa640 10 client.17982 handle_command_reply: tid=0 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.606+0000 7f245a1e4740 1 client.17982 shutdown 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 msgr2=0x5567c3830050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f244802a900 tx=0x7f244802aa40 comp rx=0 tx=0).stop 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 shutdown_connections 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x5567c38a2910 0x5567c38a4d50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567c3827780 0x5567c382b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5567c3819b40 0x5567c382b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f24357fa640 0 client.17982 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 --2- 172.21.15.66:0/3859300529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5567c38185d0 0x5567c3830050 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 >> 172.21.15.66:0/3859300529 conn(0x5567c37e1310 msgr2=0x5567c3825c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 shutdown_connections 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 1 -- 172.21.15.66:0/3859300529 wait complete. 2024-09-15T22:57:16.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f245a1e4740 20 client.17982 trim_cache size 0 max 16384 2024-09-15T22:57:16.617 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 msgr2=0x7f24380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 0x7f24380a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2440023000 tx=0x7f2440024000 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 msgr2=0x7f2450198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.607+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9f0 tx=0x7f244400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 shutdown_connections 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f24380a33b0 0x7f24380a5870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450106f10 0x7f245019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2450102790 0x7f2450198a10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 --2- 172.21.15.66:0/4151682433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2450101de0 0x7f24501984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 >> 172.21.15.66:0/4151682433 conn(0x7f24500fd8c0 msgr2=0x7f24500fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 shutdown_connections 2024-09-15T22:57:16.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:16.608+0000 7f2457e0b640 1 -- 172.21.15.66:0/4151682433 wait complete. 2024-09-15T22:57:17.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:17 smithi066 ceph-mon[31185]: pgmap v371: 129 pgs: 7 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 104 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-09-15T22:57:17.330 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:57:17.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:17 smithi087 ceph-mon[35290]: pgmap v371: 129 pgs: 7 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 104 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-09-15T22:57:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:17 smithi184 ceph-mon[35203]: pgmap v371: 129 pgs: 7 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 104 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-09-15T22:57:17.593 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:18.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 -- 172.21.15.66:0/1635075797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 msgr2=0x7f620c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 --2- 172.21.15.66:0/1635075797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c10ec40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6204009930 tx=0x7f620402a420 comp rx=0 tx=0).stop 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 -- 172.21.15.66:0/1635075797 shutdown_connections 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 --2- 172.21.15.66:0/1635075797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c10ec40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 --2- 172.21.15.66:0/1635075797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c1036e0 0x7f620c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 --2- 172.21.15.66:0/1635075797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c102d30 0x7f620c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 -- 172.21.15.66:0/1635075797 >> 172.21.15.66:0/1635075797 conn(0x7f620c0fc7d0 msgr2=0x7f620c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 -- 172.21.15.66:0/1635075797 shutdown_connections 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 -- 172.21.15.66:0/1635075797 wait complete. 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.077+0000 7f6211cb2640 1 Processor -- start 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 -- start start 2024-09-15T22:57:18.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c102d30 0x7f620c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 0x7f620c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1120a0 con 0x7f620c1082a0 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111f20 con 0x7f620c1036e0 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f6211cb2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f620c112220 con 0x7f620c102d30 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59744/0 (socket says 172.21.15.66:59744) 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 -- 172.21.15.66:0/2445274732 learned_addr learned my addr 172.21.15.66:0/2445274732 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620affd640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 0x7f620c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620b7fe640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c102d30 0x7f620c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 -- 172.21.15.66:0/2445274732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c102d30 msgr2=0x7f620c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c102d30 0x7f620c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 -- 172.21.15.66:0/2445274732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 msgr2=0x7f620c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 0x7f620c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 -- 172.21.15.66:0/2445274732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c1a6a30 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620affd640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 0x7f620c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.078+0000 7f620bfff640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6204005ab0 tx=0x7f62040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.079+0000 7f6208ff9640 1 -- 172.21.15.66:0/2445274732 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620403f030 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.079+0000 7f6208ff9640 1 -- 172.21.15.66:0/2445274732 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62040044c0 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.079+0000 7f6208ff9640 1 -- 172.21.15.66:0/2445274732 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204035070 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.079+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c1a6cc0 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.079+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c1a71a0 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.081+0000 7f6208ff9640 1 -- 172.21.15.66:0/2445274732 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6204042030 con 0x7f620c1082a0 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.081+0000 7f621408b740 1 Processor -- start 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.081+0000 7f621408b740 1 -- start start 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d859090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d866760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e39d7bf2f0 con 0x55e39d8595d0 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e39d766cf0 con 0x55e39d864370 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f621408b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e39d7bb2b0 con 0x55e39d85ab40 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59754/0 (socket says 172.21.15.66:59754) 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 -- 172.21.15.66:0/3434381889 learned_addr learned my addr 172.21.15.66:0/3434381889 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620affd640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d866760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620affd640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d859090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 -- 172.21.15.66:0/3434381889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 msgr2=0x55e39d859090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d859090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 -- 172.21.15.66:0/3434381889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 msgr2=0x55e39d866760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d866760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 -- 172.21.15.66:0/3434381889 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39d74b3a0 con 0x55e39d8595d0 2024-09-15T22:57:18.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620affd640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d866760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f6208ff9640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 0x7f61f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620affd640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 0x7f61f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.082+0000 7f620b7fe640 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0114f0 tx=0x7f61fc0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a9222787606676 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.083+0000 7f6208ff9640 1 -- 172.21.15.66:0/2445274732 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f62040f0540 con 0x7f620c1082a0 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.083+0000 7f6201ffb640 1 -- 172.21.15.66:0/3434381889 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc01e070 con 0x55e39d8595d0 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.083+0000 7f6201ffb640 1 -- 172.21.15.66:0/3434381889 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61fc011310 con 0x55e39d8595d0 2024-09-15T22:57:18.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.083+0000 7f6201ffb640 1 -- 172.21.15.66:0/3434381889 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc019940 con 0x55e39d8595d0 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- 172.21.15.66:0/3434381889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 msgr2=0x55e39d859a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f620affd640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 0x7f61f80a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55e39d85a070 tx=0x7f61f400ba90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0114f0 tx=0x7f61fc0119b0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- 172.21.15.66:0/3434381889 shutdown_connections 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d866760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d859a10 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 --2- 172.21.15.66:0/3434381889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d859090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- 172.21.15.66:0/3434381889 >> 172.21.15.66:0/3434381889 conn(0x55e39d822310 msgr2=0x55e39d855c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- 172.21.15.66:0/3434381889 shutdown_connections 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- 172.21.15.66:0/3434381889 wait complete. 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 -- start start 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.084+0000 7f621408b740 1 Processor -- start 2024-09-15T22:57:18.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d863d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d861030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d861640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e39d867070 con 0x55e39d8595d0 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e39d77a060 con 0x55e39d864370 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e39d8671f0 con 0x55e39d85ab40 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 10 client.0 _ll_register_callbacks cb 0x55e39d4cd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d863d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d863d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59770/0 (socket says 172.21.15.66:59770) 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620b7fe640 1 -- 172.21.15.66:0/3626985404 learned_addr learned my addr 172.21.15.66:0/3626985404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d861640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620affd640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d861030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 -- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 msgr2=0x55e39d861030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d861030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 -- 172.21.15.66:0/3626985404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 msgr2=0x55e39d863d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d863d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 -- 172.21.15.66:0/3626985404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39d5303c0 con 0x55e39d864370 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f620bfff640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d861640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62040ed810 tx=0x7f62040bc050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c4f7472178f01c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f61eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204049050 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.085+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61fc011310 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f62040b8ac0 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f62040c5010 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 10 client.27341 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e39d872ba0 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61fc011310 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f62040d5140 con 0x55e39d864370 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 10 client.27341 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 10 client.27341 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 20 client.27341 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:18.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d873ef0 0x55e39d876300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 4 client.27341 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e39d7cc860 con 0x55e39d873ef0 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.086+0000 7f620b7fe640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d873ef0 0x55e39d876300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.087+0000 7f620b7fe640 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d873ef0 0x55e39d876300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f2800f4ea0dd6312 server_cookie=50fbaca9321bbd84 in_seq=0 out_seq=0 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.087+0000 7f61eaffd640 10 client.27341 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.087+0000 7f61eaffd640 1 -- 172.21.15.66:0/3626985404 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e39d7cc860 con 0x55e39d873ef0 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.087+0000 7f61eaffd640 10 client.27341 handle_command_reply: tid=0 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.087+0000 7f621408b740 1 client.27341 shutdown 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 msgr2=0x55e39d861640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d861640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62040ed810 tx=0x7f62040bc050 comp rx=0 tx=0).stop 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 shutdown_connections 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d873ef0 0x55e39d876300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d861640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d861030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 --2- 172.21.15.66:0/3626985404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d863d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f61eaffd640 0 client.27341 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 >> 172.21.15.66:0/3626985404 conn(0x55e39d822310 msgr2=0x55e39d85b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 shutdown_connections 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 1 -- 172.21.15.66:0/3626985404 wait complete. 2024-09-15T22:57:18.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.088+0000 7f621408b740 20 client.27341 trim_cache size 0 max 16384 2024-09-15T22:57:18.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 Processor -- start 2024-09-15T22:57:18.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 -- start start 2024-09-15T22:57:18.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d864370 0x55e39d87bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1b1540 con 0x55e39d85ab40 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1b3200 con 0x55e39d8595d0 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.101+0000 7f621408b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1b1cd0 con 0x55e39d864370 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58592/0 (socket says 172.21.15.66:58592) 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59780/0 (socket says 172.21.15.66:59780) 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 -- 172.21.15.66:0/970711841 learned_addr learned my addr 172.21.15.66:0/970711841 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620bfff640 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d864370 0x55e39d87bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 -- 172.21.15.66:0/970711841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d864370 msgr2=0x55e39d87bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d864370 0x55e39d87bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 -- 172.21.15.66:0/970711841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 msgr2=0x55e39d870370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 -- 172.21.15.66:0/970711841 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39d85c910 con 0x55e39d8595d0 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620affd640 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f620b7fe640 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0099d0 tx=0x7f61fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13bb6b9c9c6c2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f62017fa640 1 -- 172.21.15.66:0/970711841 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc01e040 con 0x55e39d8595d0 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f62017fa640 1 -- 172.21.15.66:0/970711841 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61fc01f040 con 0x55e39d8595d0 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.102+0000 7f62017fa640 1 -- 172.21.15.66:0/970711841 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0197b0 con 0x55e39d8595d0 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- 172.21.15.66:0/970711841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 msgr2=0x55e39d855e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0099d0 tx=0x7f61fc009b50 comp rx=0 tx=0).stop 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- 172.21.15.66:0/970711841 shutdown_connections 2024-09-15T22:57:18.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d864370 0x55e39d87bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d85ab40 0x55e39d870370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 --2- 172.21.15.66:0/970711841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d8595d0 0x55e39d855e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- 172.21.15.66:0/970711841 >> 172.21.15.66:0/970711841 conn(0x55e39d822310 msgr2=0x55e39d855700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- 172.21.15.66:0/970711841 shutdown_connections 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- 172.21.15.66:0/970711841 wait complete. 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.103+0000 7f621408b740 1 -- start start 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 Processor -- start 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d85dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d85e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1b2b30 con 0x55e39d8595d0 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1b2460 con 0x55e39d864370 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f620c1af540 con 0x55e39d85ab40 2024-09-15T22:57:18.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f621408b740 10 client.0 _ll_register_callbacks cb 0x7f6204005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59794/0 (socket says 172.21.15.66:59794) 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 -- 172.21.15.66:0/1673918832 learned_addr learned my addr 172.21.15.66:0/1673918832 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d85e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620affd640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d85dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 -- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 msgr2=0x55e39d85dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d85dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 -- 172.21.15.66:0/1673918832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 msgr2=0x55e39d85e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d85e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620b7fe640 1 -- 172.21.15.66:0/1673918832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39d85ea70 con 0x55e39d8595d0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.104+0000 7f620bfff640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d85e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f620b7fe640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61fc005c40 tx=0x7f61fc011390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7871e24d17bad6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:18.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc01e040 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f61fc003b70 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61fc01f040 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f61fc041050 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 10 client.18000 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e39d8debe0 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61fc01f040 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f61fc02e070 con 0x55e39d8595d0 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 10 client.18000 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 10 client.18000 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.105+0000 7f621408b740 20 client.18000 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d8df060 0x55e39d8e1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:18.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f621408b740 4 client.18000 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e39d7c6d70 con 0x55e39d8df060 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f620affd640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d8df060 0x55e39d8e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f620affd640 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d8df060 0x55e39d8e1450 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c0aa8769f499771c server_cookie=48c6379d77c2fd46 in_seq=0 out_seq=0 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f61eaffd640 10 client.18000 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f61eaffd640 1 -- 172.21.15.66:0/1673918832 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e39d7c6d70 con 0x55e39d8df060 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f61eaffd640 10 client.18000 handle_command_reply: tid=0 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.106+0000 7f621408b740 1 client.18000 shutdown 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 msgr2=0x55e39d86cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f61fc005c40 tx=0x7f61fc011390 comp rx=0 tx=0).stop 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 shutdown_connections 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e39d8df060 0x55e39d8e1450 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e39d864370 0x55e39d85e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e39d85ab40 0x55e39d85dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 --2- 172.21.15.66:0/1673918832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e39d8595d0 0x55e39d86cbf0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 >> 172.21.15.66:0/1673918832 conn(0x55e39d822310 msgr2=0x55e39d8630b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f61eaffd640 0 client.18000 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 shutdown_connections 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 1 -- 172.21.15.66:0/1673918832 wait complete. 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f621408b740 20 client.18000 trim_cache size 0 max 16384 2024-09-15T22:57:18.117 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 msgr2=0x7f61f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 0x7f61f80a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55e39d85a070 tx=0x7f61f400ba90 comp rx=0 tx=0).stop 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 msgr2=0x7f620c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.107+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6204005ab0 tx=0x7f62040040c0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 shutdown_connections 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f61f80a33b0 0x7f61f80a5870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f620c1082a0 0x7f620c101410 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f620c1036e0 0x7f620c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 --2- 172.21.15.66:0/2445274732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f620c102d30 0x7f620c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 >> 172.21.15.66:0/2445274732 conn(0x7f620c0fc7d0 msgr2=0x7f620c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 shutdown_connections 2024-09-15T22:57:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:18.108+0000 7f6211cb2640 1 -- 172.21.15.66:0/2445274732 wait complete. 2024-09-15T22:57:18.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:57:19.038 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:19.290 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:19 smithi066 ceph-mon[31185]: pgmap v372: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1006 KiB/s wr, 169 op/s 2024-09-15T22:57:19.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:19 smithi087 ceph-mon[35290]: pgmap v372: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1006 KiB/s wr, 169 op/s 2024-09-15T22:57:19.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.387+0000 7f65d6ffd640 1 -- 172.21.15.66:0/1730498898 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eb294e8890 con 0x55eb29616640 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.387+0000 7f65d6ffd640 10 client.27217 handle_command_reply: tid=0 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.387+0000 7f65fff77740 1 client.27217 shutdown 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 msgr2=0x55eb2958f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65f0005fd0 tx=0x7f65f0005e10 comp rx=0 tx=0).stop 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 shutdown_connections 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb29581a30 0x55eb2958f260 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb29577170 0x55eb295927d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55eb29616640 0x55eb29618a30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 --2- 172.21.15.66:0/1730498898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb29576850 0x55eb29592290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65d6ffd640 0 client.27217 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:19.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 >> 172.21.15.66:0/1730498898 conn(0x55eb29572de0 msgr2=0x55eb295716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:19.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 shutdown_connections 2024-09-15T22:57:19.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 1 -- 172.21.15.66:0/1730498898 wait complete. 2024-09-15T22:57:19.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.388+0000 7f65fff77740 20 client.27217 trim_cache size 0 max 16384 2024-09-15T22:57:19.392 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:19.392 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 54, 2024-09-15T22:57:19.392 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:57:19.392 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 38, 2024-09-15T22:57:19.392 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "477159e6": { 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 38, 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:57:19.393 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 141.8, 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:57:19.394 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:19.395 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:19.396 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:19.396 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:19.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 msgr2=0x7f65e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:19.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 0x7f65e00a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f65f0022000 tx=0x7f65f0020000 comp rx=0 tx=0).stop 2024-09-15T22:57:19.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 msgr2=0x7f65f8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:19.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f8074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00d6d0 tx=0x7f65ec00db90 comp rx=0 tx=0).stop 2024-09-15T22:57:19.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 shutdown_connections 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65e00a33b0 0x7f65e00a5870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65f8106f10 0x7f65f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f8102790 0x7f65f8074a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 --2- 172.21.15.66:0/2768201113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f8101de0 0x7f65f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 >> 172.21.15.66:0/2768201113 conn(0x7f65f80fd8c0 msgr2=0x7f65f80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:19.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 shutdown_connections 2024-09-15T22:57:19.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.389+0000 7f65fdb9e640 1 -- 172.21.15.66:0/2768201113 wait complete. 2024-09-15T22:57:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:19 smithi184 ceph-mon[35203]: pgmap v372: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1006 KiB/s wr, 169 op/s 2024-09-15T22:57:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/3460873909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec1036e0 msgr2=0x7fc4ec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/3460873909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec107b90 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009cd0 tx=0x7fc4e002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/3460873909 shutdown_connections 2024-09-15T22:57:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/3460873909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1082a0 0x7fc4ec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/3460873909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec107b90 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/3460873909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec102d30 0x7fc4ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/3460873909 >> 172.21.15.66:0/3460873909 conn(0x7fc4ec0fc7d0 msgr2=0x7fc4ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/3460873909 shutdown_connections 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.489+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/3460873909 wait complete. 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 Processor -- start 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 -- start start 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec1082a0 0x7fc4ec19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1120c0 con 0x7fc4ec102d30 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec111f40 con 0x7fc4ec1036e0 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f3cf4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec112240 con 0x7fc4ec1082a0 2024-09-15T22:57:20.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f128f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59824/0 (socket says 172.21.15.66:59824) 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 -- 172.21.15.66:0/1186908146 learned_addr learned my addr 172.21.15.66:0/1186908146 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f2291640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec1082a0 0x7fc4ec19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 -- 172.21.15.66:0/1186908146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec1082a0 msgr2=0x7fc4ec19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec1082a0 0x7fc4ec19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 -- 172.21.15.66:0/1186908146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 msgr2=0x7fc4ec198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f1a90640 1 -- 172.21.15.66:0/1186908146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec19d5f0 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.490+0000 7fc4f128f640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400b4a0 tx=0x7fc4e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4eaffd640 1 -- 172.21.15.66:0/1186908146 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4014070 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec19d8e0 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4eaffd640 1 -- 172.21.15.66:0/1186908146 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e4010af0 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4eaffd640 1 -- 172.21.15.66:0/1186908146 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4017d10 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.491+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1a51c0 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.493+0000 7fc4eaffd640 1 -- 172.21.15.66:0/1186908146 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc4e4017070 con 0x7fc4ec102d30 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.493+0000 7fc4f60cd740 1 Processor -- start 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 -- start start 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fc812f0 con 0x55ea4fd26370 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fc28cf0 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fc7d2b0 con 0x55ea4fd1cb40 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59830/0 (socket says 172.21.15.66:59830) 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 -- 172.21.15.66:0/3193848873 learned_addr learned my addr 172.21.15.66:0/3193848873 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f2291640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4eaffd640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 0x7fc4d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 -- 172.21.15.66:0/3193848873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 msgr2=0x55ea4fd1b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd1b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f2291640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 0x7fc4d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 -- 172.21.15.66:0/3193848873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 msgr2=0x55ea4fd1ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd1ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f128f640 1 -- 172.21.15.66:0/3193848873 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4fc0d3a0 con 0x55ea4fd26370 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.494+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4eaffd640 1 -- 172.21.15.66:0/1186908146 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7fc4e40cf4c0 con 0x7fc4ec102d30 2024-09-15T22:57:20.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0697d0 tx=0x7fc4e00318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28d1a48b1406cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4f2291640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 0x7fc4d40a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009ed0 tx=0x7fc4dc004730 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4d3fff640 1 -- 172.21.15.66:0/3193848873 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0048070 con 0x55ea4fd26370 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4d3fff640 1 -- 172.21.15.66:0/3193848873 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0036070 con 0x55ea4fd26370 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.495+0000 7fc4d3fff640 1 -- 172.21.15.66:0/3193848873 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0004860 con 0x55ea4fd26370 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3193848873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 msgr2=0x55ea4fd28760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0697d0 tx=0x7fc4e00318c0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3193848873 shutdown_connections 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd28760 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3193848873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd1b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3193848873 >> 172.21.15.66:0/3193848873 conn(0x55ea4fce4310 msgr2=0x55ea4fd17c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3193848873 shutdown_connections 2024-09-15T22:57:20.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3193848873 wait complete. 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 -- start start 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.496+0000 7fc4f60cd740 1 Processor -- start 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd25d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd22fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fd29010 con 0x55ea4fd26370 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fc3c060 con 0x55ea4fd1cb40 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ea4fd29190 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f60cd740 10 client.0 _ll_register_callbacks cb 0x55ea4f98f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:20.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59842/0 (socket says 172.21.15.66:59842) 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 -- 172.21.15.66:0/3259970821 learned_addr learned my addr 172.21.15.66:0/3259970821 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd22fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd25d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 -- 172.21.15.66:0/3259970821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 msgr2=0x55ea4fd25d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd25d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 -- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 msgr2=0x55ea4fd22fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd22fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 -- 172.21.15.66:0/3259970821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4f9f23c0 con 0x55ea4fd26370 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd22fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4f2291640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc003870 tx=0x7fc4dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f90080ad3ffad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc025070 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.497+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7fc4dc011640 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e0036070 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc4dc031050 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 10 client.18012 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ea4fd34ad0 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0036070 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc4dc01d070 con 0x55ea4fd26370 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 10 client.18012 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 10 client.18012 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 20 client.18012 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fd35fa0 0x55ea4fd38460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 4 client.18012 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:20.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea4fc8e860 con 0x55ea4fd35fa0 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.498+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fd35fa0 0x55ea4fd38460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4d17fa640 10 client.18012 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fd35fa0 0x55ea4fd38460 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc518cc1ca9d1680 server_cookie=414cc1b527516a4 in_seq=0 out_seq=0 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3259970821 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea4fc8e860 con 0x55ea4fd35fa0 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4d17fa640 10 client.18012 handle_command_reply: tid=0 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4f60cd740 1 client.18012 shutdown 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 msgr2=0x55ea4fd235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.499+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc003870 tx=0x7fc4dc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 shutdown_connections 2024-09-15T22:57:20.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fd35fa0 0x55ea4fd38460 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd26370 0x55ea4fd235d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd22fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4d17fa640 0 client.18012 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3259970821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd25d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 >> 172.21.15.66:0/3259970821 conn(0x55ea4fce4310 msgr2=0x55ea4fd1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 shutdown_connections 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3259970821 wait complete. 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.500+0000 7fc4f60cd740 20 client.18012 trim_cache size 0 max 16384 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 Processor -- start 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 -- start start 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd27ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1af390 con 0x55ea4fd1cb40 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1b1050 con 0x55ea4fd26370 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1afb20 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59844/0 (socket says 172.21.15.66:59844) 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 -- 172.21.15.66:0/1769903219 learned_addr learned my addr 172.21.15.66:0/1769903219 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f2291640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd27ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 -- 172.21.15.66:0/1769903219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 msgr2=0x55ea4fd322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 -- 172.21.15.66:0/1769903219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 msgr2=0x55ea4fd27ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd27ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f128f640 1 -- 172.21.15.66:0/1769903219 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4fd260a0 con 0x55ea4fd1cb40 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.513+0000 7fc4f2291640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd27ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f128f640 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0697d0 tx=0x7fc4e00317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a78a8ee655443d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4d37fe640 1 -- 172.21.15.66:0/1769903219 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0048040 con 0x55ea4fd1cb40 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4d37fe640 1 -- 172.21.15.66:0/1769903219 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0036040 con 0x55ea4fd1cb40 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4d37fe640 1 -- 172.21.15.66:0/1769903219 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0004760 con 0x55ea4fd1cb40 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 -- 172.21.15.66:0/1769903219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 msgr2=0x55ea4fd27760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0697d0 tx=0x7fc4e00317e0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 -- 172.21.15.66:0/1769903219 shutdown_connections 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd27ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd27760 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/1769903219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 -- 172.21.15.66:0/1769903219 >> 172.21.15.66:0/1769903219 conn(0x55ea4fce4310 msgr2=0x55ea4fd220d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 -- 172.21.15.66:0/1769903219 shutdown_connections 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.514+0000 7fc4f60cd740 1 -- 172.21.15.66:0/1769903219 wait complete. 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 -- start start 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 Processor -- start 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd3cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd3d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1b0980 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1b02b0 con 0x55ea4fd26370 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1ad390 con 0x55ea4fd1cb40 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f60cd740 10 client.0 _ll_register_callbacks cb 0x7fc4dc009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.515+0000 7fc4f1a90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59860/0 (socket says 172.21.15.66:59860) 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 -- 172.21.15.66:0/3297054861 learned_addr learned my addr 172.21.15.66:0/3297054861 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd3cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f2291640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd3d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 -- 172.21.15.66:0/3297054861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 msgr2=0x55ea4fd3cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd3cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 -- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 msgr2=0x55ea4fd3d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:20.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd3d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 -- 172.21.15.66:0/3297054861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4fd3d7e0 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f1a90640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40970b0 tx=0x7fc4e4017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ebbb516f025249 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e401e040 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7fc4e4010ca0 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e0036040 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc4e40a4040 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f60cd740 10 client.18018 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ea4fda5a80 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.516+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0036040 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc4e40cc9b0 con 0x55ea4fd1b5d0 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 10 client.18018 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:20.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 10 client.18018 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 20 client.18018 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fda6230 0x55ea4fda8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 4 client.18018 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea4fc88d70 con 0x55ea4fda6230 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fda6230 0x55ea4fda8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f128f640 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fda6230 0x55ea4fda8650 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8593061f58a3f684 server_cookie=a981719dbc912b16 in_seq=0 out_seq=0 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4d17fa640 10 client.18018 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4d17fa640 1 -- 172.21.15.66:0/3297054861 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea4fc88d70 con 0x55ea4fda6230 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4d17fa640 10 client.18018 handle_command_reply: tid=0 2024-09-15T22:57:20.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.517+0000 7fc4f60cd740 1 client.18018 shutdown 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 msgr2=0x55ea4fd3e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40970b0 tx=0x7fc4e4017730 comp rx=0 tx=0).stop 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 shutdown_connections 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ea4fda6230 0x55ea4fda8650 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ea4fd26370 0x55ea4fd3d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ea4fd1cb40 0x55ea4fd3cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 --2- 172.21.15.66:0/3297054861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ea4fd1b5d0 0x55ea4fd3e170 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4d17fa640 0 client.18018 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 >> 172.21.15.66:0/3297054861 conn(0x55ea4fce4310 msgr2=0x55ea4fd164e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 shutdown_connections 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 1 -- 172.21.15.66:0/3297054861 wait complete. 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f60cd740 20 client.18018 trim_cache size 0 max 16384 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 msgr2=0x7fc4d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 0x7fc4d40a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009ed0 tx=0x7fc4dc004730 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 msgr2=0x7fc4ec198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.518+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400b4a0 tx=0x7fc4e400b960 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 shutdown_connections 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4d40a33b0 0x7fc4d40a5870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4ec1082a0 0x7fc4ec19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4ec1036e0 0x7fc4ec198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 --2- 172.21.15.66:0/1186908146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4ec102d30 0x7fc4ec198640 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:20.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 >> 172.21.15.66:0/1186908146 conn(0x7fc4ec0fc7d0 msgr2=0x7fc4ec105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:20.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 shutdown_connections 2024-09-15T22:57:20.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:19.519+0000 7fc4f3cf4640 1 -- 172.21.15.66:0/1186908146 wait complete. 2024-09-15T22:57:20.875 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:57:21.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:21 smithi066 ceph-mon[31185]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 633 KiB/s wr, 125 op/s 2024-09-15T22:57:21.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:21 smithi087 ceph-mon[35290]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 633 KiB/s wr, 125 op/s 2024-09-15T22:57:21.377 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '477159e6', quiesce took 16.5 seconds. Will release after: 5.350000000000001 2024-09-15T22:57:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:21 smithi184 ceph-mon[35203]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 633 KiB/s wr, 125 op/s 2024-09-15T22:57:21.471 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.682+0000 7f4058f97640 1 -- 172.21.15.66:0/952765392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054102790 msgr2=0x7f40541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.682+0000 7f4058f97640 1 --2- 172.21.15.66:0/952765392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054102790 0x7f40541067e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f4048009900 tx=0x7f404802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 -- 172.21.15.66:0/952765392 shutdown_connections 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 --2- 172.21.15.66:0/952765392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054106f10 0x7f405410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 --2- 172.21.15.66:0/952765392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054102790 0x7f40541067e0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 --2- 172.21.15.66:0/952765392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 0x7f40541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 -- 172.21.15.66:0/952765392 >> 172.21.15.66:0/952765392 conn(0x7f40540fd8c0 msgr2=0x7f40540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 -- 172.21.15.66:0/952765392 shutdown_connections 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.683+0000 7f4058f97640 1 -- 172.21.15.66:0/952765392 wait complete. 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 Processor -- start 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 -- start start 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 0x7f4054198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054102790 0x7f4054198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.684+0000 7f4058f97640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4054111f30 con 0x7f4054106f10 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4058f97640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4054111db0 con 0x7f4054101de0 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4058f97640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40541120b0 con 0x7f4054102790 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55816/0 (socket says 172.21.15.66:55816) 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 -- 172.21.15.66:0/3878900750 learned_addr learned my addr 172.21.15.66:0/3878900750 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4051d9b640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054102790 0x7f4054198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f405259c640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 0x7f4054198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 -- 172.21.15.66:0/3878900750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054102790 msgr2=0x7f4054198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054102790 0x7f4054198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 -- 172.21.15.66:0/3878900750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 msgr2=0x7f4054198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 0x7f4054198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 -- 172.21.15.66:0/3878900750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405419d2c0 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f4052d9d640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f404c00cce0 tx=0x7f404c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f40437fe640 1 -- 172.21.15.66:0/3878900750 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c00f450 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.686+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405419d5b0 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.685+0000 7f40437fe640 1 -- 172.21.15.66:0/3878900750 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f404c00fad0 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.686+0000 7f40437fe640 1 -- 172.21.15.66:0/3878900750 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c018b60 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.686+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40541a4e90 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.688+0000 7f40437fe640 1 -- 172.21.15.66:0/3878900750 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f404c00fc80 con 0x7f4054106f10 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.688+0000 7f405b370740 1 Processor -- start 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.688+0000 7f405b370740 1 -- start start 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 0x55e9fb204b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb1592f0 con 0x55e9fb1f79e0 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb100cf0 con 0x55e9fb202780 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405b370740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb1552b0 con 0x55e9fb1f8f50 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55832/0 (socket says 172.21.15.66:55832) 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 -- 172.21.15.66:0/645535491 learned_addr learned my addr 172.21.15.66:0/645535491 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f40437fe640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 0x7f403c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f4051d9b640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f4051d9b640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 0x55e9fb204b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f4052d9d640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 0x7f403c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 -- 172.21.15.66:0/645535491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f8f50 msgr2=0x55e9fb1f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 -- 172.21.15.66:0/645535491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 msgr2=0x55e9fb204b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 0x55e9fb204b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f405259c640 1 -- 172.21.15.66:0/645535491 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fb0e53a0 con 0x55e9fb1f79e0 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f4051d9b640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 0x55e9fb204b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.689+0000 7f40437fe640 1 -- 172.21.15.66:0/3878900750 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f404c0d05b0 con 0x7f4054106f10 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f405259c640 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f404400ad00 tx=0x7f404400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49959c8c545c368b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f4040ff9640 1 -- 172.21.15.66:0/645535491 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404401d070 con 0x55e9fb1f79e0 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f4052d9d640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 0x7f403c0a58f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f404c09c0b0 tx=0x7f404c01baf0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f4040ff9640 1 -- 172.21.15.66:0/645535491 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044018b20 con 0x55e9fb1f79e0 2024-09-15T22:57:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f4040ff9640 1 -- 172.21.15.66:0/645535491 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044010bc0 con 0x55e9fb1f79e0 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f405b370740 1 -- 172.21.15.66:0/645535491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 msgr2=0x55e9fb1f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.690+0000 7f405b370740 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f404400ad00 tx=0x7f404400f790 comp rx=0 tx=0).stop 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- 172.21.15.66:0/645535491 shutdown_connections 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb202780 0x55e9fb204b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb1f79e0 0x55e9fb1f7e20 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- 172.21.15.66:0/645535491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- 172.21.15.66:0/645535491 >> 172.21.15.66:0/645535491 conn(0x55e9fb1bc310 msgr2=0x55e9fb1f4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- 172.21.15.66:0/645535491 shutdown_connections 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- 172.21.15.66:0/645535491 wait complete. 2024-09-15T22:57:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- start start 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 Processor -- start 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb205480 con 0x55e9fb202780 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb114060 con 0x55e9fb1f8f50 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e9fb205600 con 0x55e9fb1f79e0 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f405b370740 10 client.0 _ll_register_callbacks cb 0x55e9fae678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:22.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55840/0 (socket says 172.21.15.66:55840) 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.691+0000 7f4051d9b640 1 -- 172.21.15.66:0/3956770374 learned_addr learned my addr 172.21.15.66:0/3956770374 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f405259c640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 -- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 msgr2=0x55e9fb2021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 -- 172.21.15.66:0/3956770374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 msgr2=0x55e9fb1ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 -- 172.21.15.66:0/3956770374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9faeca3c0 con 0x55e9fb202780 2024-09-15T22:57:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4051d9b640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4048009900 tx=0x7f4048009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b1152e77084b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048035040 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f4048005020 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044018b20 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4048053050 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f405b370740 10 client.18030 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.692+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e9fb210f60 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044018b20 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f404804b020 con 0x55e9fb202780 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 10 client.18030 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:22.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 10 client.18030 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 20 client.18030 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb212420 0x55e9fb214850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 4 client.18030 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9fb166860 con 0x55e9fb212420 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405259c640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb212420 0x55e9fb214850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f4039ffb640 10 client.18030 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.693+0000 7f405259c640 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb212420 0x55e9fb214850 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67451209323383c6 server_cookie=4f7c583b9b1a942 in_seq=0 out_seq=0 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f4039ffb640 1 -- 172.21.15.66:0/3956770374 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9fb166860 con 0x55e9fb212420 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f4039ffb640 10 client.18030 handle_command_reply: tid=0 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 client.18030 shutdown 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 msgr2=0x55e9fb1ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4048009900 tx=0x7f4048009260 comp rx=0 tx=0).stop 2024-09-15T22:57:22.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 shutdown_connections 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb212420 0x55e9fb214850 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1ffbf0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 --2- 172.21.15.66:0/3956770374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 >> 172.21.15.66:0/3956770374 conn(0x55e9fb1bc310 msgr2=0x55e9fb1f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.694+0000 7f4039ffb640 0 client.18030 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.695+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 shutdown_connections 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.695+0000 7f405b370740 1 -- 172.21.15.66:0/3956770374 wait complete. 2024-09-15T22:57:22.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.695+0000 7f405b370740 20 client.18030 trim_cache size 0 max 16384 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 Processor -- start 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 -- start start 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1fa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40541acf60 con 0x55e9fb202780 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40541aec20 con 0x55e9fb1f8f50 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405b370740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40541ad6f0 con 0x55e9fb1f79e0 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55858/0 (socket says 172.21.15.66:55858) 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 -- 172.21.15.66:0/2166370496 learned_addr learned my addr 172.21.15.66:0/2166370496 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405259c640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 -- 172.21.15.66:0/2166370496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 msgr2=0x55e9fb2013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 -- 172.21.15.66:0/2166370496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 msgr2=0x55e9fb1fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f4051d9b640 1 -- 172.21.15.66:0/2166370496 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fb1fd9d0 con 0x55e9fb202780 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.708+0000 7f405259c640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.709+0000 7f4051d9b640 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4048032ea0 tx=0x7f404802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365c1e82da3e95ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.709+0000 7f403bfff640 1 -- 172.21.15.66:0/2166370496 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048035070 con 0x55e9fb202780 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.709+0000 7f403bfff640 1 -- 172.21.15.66:0/2166370496 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4048003640 con 0x55e9fb202780 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.709+0000 7f403bfff640 1 -- 172.21.15.66:0/2166370496 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048004b80 con 0x55e9fb202780 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 -- 172.21.15.66:0/2166370496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 msgr2=0x55e9fb1faa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4048032ea0 tx=0x7f404802a3f0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 -- 172.21.15.66:0/2166370496 shutdown_connections 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb1faa70 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb1fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 --2- 172.21.15.66:0/2166370496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb2013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 -- 172.21.15.66:0/2166370496 >> 172.21.15.66:0/2166370496 conn(0x55e9fb1bc310 msgr2=0x55e9fb200cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 -- 172.21.15.66:0/2166370496 shutdown_connections 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.710+0000 7f405b370740 1 -- 172.21.15.66:0/2166370496 wait complete. 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 -- start start 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 Processor -- start 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb20a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb20add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40541ae550 con 0x55e9fb202780 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40541ade80 con 0x55e9fb1f8f50 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40541aaf60 con 0x55e9fb1f79e0 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405b370740 10 client.0 _ll_register_callbacks cb 0x7f4048032ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55862/0 (socket says 172.21.15.66:55862) 2024-09-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f4051d9b640 1 -- 172.21.15.66:0/97537497 learned_addr learned my addr 172.21.15.66:0/97537497 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f4051d9b640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb20a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.711+0000 7f405259c640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb20add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 -- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 msgr2=0x55e9fb20a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb20a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 -- 172.21.15.66:0/97537497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 msgr2=0x55e9fb20add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb20add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 -- 172.21.15.66:0/97537497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9fb1fd410 con 0x55e9fb202780 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f405259c640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb20add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4051d9b640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f404802a910 tx=0x7f40480047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1015aac5bcd3e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048035040 con 0x55e9fb202780 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9679+0+0 (secure 0 0 0) 0x7f4048003a90 con 0x55e9fb202780 2024-09-15T22:57:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4048003640 con 0x55e9fb202780 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4048003c90 con 0x55e9fb202780 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f405b370740 10 client.18036 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.712+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e9fb27d5e0 con 0x55e9fb202780 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4048003640 con 0x55e9fb202780 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f404804b050 con 0x55e9fb202780 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 10 client.18036 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 10 client.18036 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 20 client.18036 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb27dcd0 0x55e9fb2800f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 4 client.18036 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9fb160d70 con 0x55e9fb27dcd0 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405259c640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb27dcd0 0x55e9fb2800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f405259c640 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb27dcd0 0x55e9fb2800f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a771b25595220629 server_cookie=e3d811f1eda78027 in_seq=0 out_seq=0 2024-09-15T22:57:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.713+0000 7f4039ffb640 10 client.18036 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f4039ffb640 1 -- 172.21.15.66:0/97537497 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9fb160d70 con 0x55e9fb27dcd0 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f4039ffb640 10 client.18036 handle_command_reply: tid=0 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 client.18036 shutdown 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 msgr2=0x55e9fb207860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f404802a910 tx=0x7f40480047a0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 shutdown_connections 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55e9fb27dcd0 0x55e9fb2800f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e9fb202780 0x55e9fb207860 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9fb1f8f50 0x55e9fb20add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 --2- 172.21.15.66:0/97537497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e9fb1f79e0 0x55e9fb20a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 >> 172.21.15.66:0/97537497 conn(0x55e9fb1bc310 msgr2=0x55e9fb2014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f4039ffb640 0 client.18036 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:57:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 shutdown_connections 2024-09-15T22:57:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 1 -- 172.21.15.66:0/97537497 wait complete. 2024-09-15T22:57:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.714+0000 7f405b370740 20 client.18036 trim_cache size 0 max 16384 2024-09-15T22:57:22.728 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 msgr2=0x7f403c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 0x7f403c0a58f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f404c09c0b0 tx=0x7f404c01baf0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 msgr2=0x7f405419cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f404c00cce0 tx=0x7f404c00a620 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 shutdown_connections 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f403c0a3430 0x7f403c0a58f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4054106f10 0x7f405419cbe0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4054102790 0x7f4054198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 --2- 172.21.15.66:0/3878900750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4054101de0 0x7f4054198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 >> 172.21.15.66:0/3878900750 conn(0x7f40540fd8c0 msgr2=0x7f40540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 shutdown_connections 2024-09-15T22:57:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:22.715+0000 7f4058f97640 1 -- 172.21.15.66:0/3878900750 wait complete. 2024-09-15T22:57:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:23 smithi087 ceph-mon[35290]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 291 KiB/s wr, 97 op/s 2024-09-15T22:57:23.355 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:23 smithi066 ceph-mon[31185]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 291 KiB/s wr, 97 op/s 2024-09-15T22:57:23.415 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:57:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:23 smithi184 ceph-mon[35203]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 291 KiB/s wr, 97 op/s 2024-09-15T22:57:23.674 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 -- 172.21.15.66:0/4008243596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 msgr2=0x7fe8e410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 --2- 172.21.15.66:0/4008243596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e410eac0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009ca0 tx=0x7fe8dc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 -- 172.21.15.66:0/4008243596 shutdown_connections 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 --2- 172.21.15.66:0/4008243596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e410eac0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 --2- 172.21.15.66:0/4008243596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 0x7fe8e4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 --2- 172.21.15.66:0/4008243596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 0x7fe8e41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 -- 172.21.15.66:0/4008243596 >> 172.21.15.66:0/4008243596 conn(0x7fe8e40fd8d0 msgr2=0x7fe8e40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 -- 172.21.15.66:0/4008243596 shutdown_connections 2024-09-15T22:57:24.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.173+0000 7fe8e9170640 1 -- 172.21.15.66:0/4008243596 wait complete. 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.174+0000 7fe8e9170640 1 Processor -- start 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.174+0000 7fe8e9170640 1 -- start start 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 0x7fe8e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 0x7fe8e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4112040 con 0x7fe8e4106f40 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4111ec0 con 0x7fe8e4101e10 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e9170640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41121c0 con 0x7fe8e41027c0 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55886/0 (socket says 172.21.15.66:55886) 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 -- 172.21.15.66:0/1507691234 learned_addr learned my addr 172.21.15.66:0/1507691234 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e259c640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 0x7fe8e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 0x7fe8e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 -- 172.21.15.66:0/1507691234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 msgr2=0x7fe8e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 0x7fe8e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 -- 172.21.15.66:0/1507691234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 msgr2=0x7fe8e40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 0x7fe8e40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 -- 172.21.15.66:0/1507691234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41a6a00 con 0x7fe8e4106f40 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.175+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc031a60 tx=0x7fe8dc031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.176+0000 7fe8dbfff640 1 -- 172.21.15.66:0/1507691234 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003b70 con 0x7fe8e4106f40 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.176+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e41a6c90 con 0x7fe8e4106f40 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.176+0000 7fe8dbfff640 1 -- 172.21.15.66:0/1507691234 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8dc003d10 con 0x7fe8e4106f40 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.176+0000 7fe8dbfff640 1 -- 172.21.15.66:0/1507691234 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc004770 con 0x7fe8e4106f40 2024-09-15T22:57:24.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.176+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41a71d0 con 0x7fe8e4106f40 2024-09-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.178+0000 7fe8dbfff640 1 -- 172.21.15.66:0/1507691234 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe8dc02f790 con 0x7fe8e4106f40 2024-09-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.178+0000 7fe8eb549740 1 Processor -- start 2024-09-15T22:57:24.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.178+0000 7fe8eb549740 1 -- start start 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14022090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc1402f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fc13f882f0 con 0x55fc140225d0 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fc13f2fcf0 con 0x55fc14023b40 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8eb549740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fc13f842b0 con 0x55fc1402d370 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55894/0 (socket says 172.21.15.66:55894) 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/611242648 learned_addr learned my addr 172.21.15.66:0/611242648 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e259c640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14022090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e259c640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc1402f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/611242648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 msgr2=0x55fc1402f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc1402f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/611242648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 msgr2=0x55fc14022090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14022090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/611242648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc13f143a0 con 0x55fc140225d0 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8e259c640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc1402f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.179+0000 7fe8dbfff640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 0x7fe8d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009a70 tx=0x7fe8d4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeee02705c0f06a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8e259c640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 0x7fe8d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8d97fa640 1 -- 172.21.15.66:0/611242648 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017070 con 0x55fc140225d0 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8dbfff640 1 -- 172.21.15.66:0/1507691234 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7fe8dc0f12b0 con 0x7fe8e4106f40 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8d97fa640 1 -- 172.21.15.66:0/611242648 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d4013470 con 0x55fc140225d0 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.180+0000 7fe8d97fa640 1 -- 172.21.15.66:0/611242648 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40125f0 con 0x55fc140225d0 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- 172.21.15.66:0/611242648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 msgr2=0x55fc14022a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8e259c640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 0x7fe8d00a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55fc14023070 tx=0x7fe8cc009470 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009a70 tx=0x7fe8d4009f30 comp rx=0 tx=0).stop 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- 172.21.15.66:0/611242648 shutdown_connections 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc1402f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc14022a10 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 --2- 172.21.15.66:0/611242648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14022090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- 172.21.15.66:0/611242648 >> 172.21.15.66:0/611242648 conn(0x55fc13feb310 msgr2=0x55fc1401ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- 172.21.15.66:0/611242648 shutdown_connections 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- 172.21.15.66:0/611242648 wait complete. 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 -- start start 2024-09-15T22:57:24.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.181+0000 7fe8eb549740 1 Processor -- start 2024-09-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc14023b40 0x55fc14029f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc1402d370 0x55fc1402a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fc14030070 con 0x55fc140225d0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fc13f43060 con 0x55fc1402d370 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fc140301f0 con 0x55fc14023b40 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8eb549740 10 client.0 _ll_register_callbacks cb 0x55fc13c968c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55908/0 (socket says 172.21.15.66:55908) 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/221232422 learned_addr learned my addr 172.21.15.66:0/221232422 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e359e640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc1402d370 0x55fc1402a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e259c640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc14023b40 0x55fc14029f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/221232422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc14023b40 msgr2=0x55fc14029f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc14023b40 0x55fc14029f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc1402d370 msgr2=0x55fc1402a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc1402d370 0x55fc1402a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/221232422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc13cf93c0 con 0x55fc140225d0 2024-09-15T22:57:24.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4013f40 tx=0x7fe8d40138d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b118eb42f19a909 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.182+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017050 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7fe8d401c450 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d4013470 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe8d402f050 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 10 client.18048 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55fc1403bab0 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d4013470 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fe8d4026730 con 0x55fc140225d0 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 10 client.18048 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 10 client.18048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 20 client.18048 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc1403ceb0 0x55fc1403f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 4 client.18048 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.183+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc13f95860 con 0x55fc1403ceb0 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.184+0000 7fe8e259c640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc1403ceb0 0x55fc1403f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.184+0000 7fe8e259c640 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc1403ceb0 0x55fc1403f2a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de832a4c7092d458 server_cookie=6ada06acf4722adb in_seq=0 out_seq=0 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.184+0000 7fe8ca7fc640 10 client.18048 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/221232422 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc13f95860 con 0x55fc1403ceb0 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8ca7fc640 10 client.18048 handle_command_reply: tid=0 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 client.18048 shutdown 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 msgr2=0x55fc1402ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4013f40 tx=0x7fe8d40138d0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 shutdown_connections 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc1403ceb0 0x55fc1403f2a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc1402d370 0x55fc1402a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc14023b40 0x55fc14029f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 --2- 172.21.15.66:0/221232422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1402ccc0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8ca7fc640 0 client.18048 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 >> 172.21.15.66:0/221232422 conn(0x55fc13feb310 msgr2=0x55fc14024930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 shutdown_connections 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 1 -- 172.21.15.66:0/221232422 wait complete. 2024-09-15T22:57:24.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.185+0000 7fe8eb549740 20 client.18048 trim_cache size 0 max 16384 2024-09-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 Processor -- start 2024-09-15T22:57:24.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 -- start start 2024-09-15T22:57:24.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc1401e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc14025120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41b1510 con 0x55fc140225d0 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41b31d0 con 0x55fc14023b40 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.198+0000 7fe8eb549740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41b1ca0 con 0x55fc1402d370 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55912/0 (socket says 172.21.15.66:55912) 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/4217206264 learned_addr learned my addr 172.21.15.66:0/4217206264 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e259c640 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc1401e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e359e640 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc14025120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/4217206264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 msgr2=0x55fc14025120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc14025120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/4217206264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 msgr2=0x55fc1401e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc1401e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 -- 172.21.15.66:0/4217206264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc1402b2f0 con 0x55fc140225d0 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009a70 tx=0x7fe8d4004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78747bb9ecfdb591 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8d8ff9640 1 -- 172.21.15.66:0/4217206264 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017030 con 0x55fc140225d0 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8d8ff9640 1 -- 172.21.15.66:0/4217206264 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d400e660 con 0x55fc140225d0 2024-09-15T22:57:24.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.199+0000 7fe8d8ff9640 1 -- 172.21.15.66:0/4217206264 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4006280 con 0x55fc140225d0 2024-09-15T22:57:24.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- 172.21.15.66:0/4217206264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 msgr2=0x55fc1401dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009a70 tx=0x7fe8d4004640 comp rx=0 tx=0).stop 2024-09-15T22:57:24.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- 172.21.15.66:0/4217206264 shutdown_connections 2024-09-15T22:57:24.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc1402d370 0x55fc14025120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc1401e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 --2- 172.21.15.66:0/4217206264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc140225d0 0x55fc1401dc10 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- 172.21.15.66:0/4217206264 >> 172.21.15.66:0/4217206264 conn(0x55fc13feb310 msgr2=0x55fc1401d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- 172.21.15.66:0/4217206264 shutdown_connections 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- 172.21.15.66:0/4217206264 wait complete. 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 -- start start 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.200+0000 7fe8eb549740 1 Processor -- start 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc140225d0 0x55fc14035980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14026a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41b2b00 con 0x55fc1402d370 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41b2430 con 0x55fc14023b40 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41af510 con 0x55fc140225d0 2024-09-15T22:57:24.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8eb549740 10 client.0 _ll_register_callbacks cb 0x7fe8cc0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14026a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55924/0 (socket says 172.21.15.66:55924) 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14026a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40416/0 (socket says 172.21.15.66:40416) 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 -- 172.21.15.66:0/1681366311 learned_addr learned my addr 172.21.15.66:0/1681366311 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc140225d0 0x55fc14035980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 -- 172.21.15.66:0/1681366311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc140225d0 msgr2=0x55fc14035980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc140225d0 0x55fc14035980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 -- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 msgr2=0x55fc14026a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14026a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 -- 172.21.15.66:0/1681366311 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc14027550 con 0x55fc1402d370 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8e359e640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc006010 tx=0x7fe8dc0bcc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f842db8df9b0f1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.201+0000 7fe8ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0098d0 con 0x55fc1402d370 2024-09-15T22:57:24.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7fe8dc0b98e0 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d400e660 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc0bd970 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 10 client.18054 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55fc140a7640 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d400e660 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fe8dc02fa80 con 0x55fc1402d370 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 10 client.18054 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 10 client.18054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 20 client.18054 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc140a7d60 0x55fc140aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 4 client.18054 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.202+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc13f8fd70 con 0x55fc140a7d60 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc140a7d60 0x55fc140aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:24.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8e2d9d640 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc140a7d60 0x55fc140aa180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb2a1ea687dfd2fc server_cookie=777eedc3fe5dc979 in_seq=0 out_seq=0 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8ca7fc640 10 client.18054 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8ca7fc640 1 -- 172.21.15.66:0/1681366311 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc13f8fd70 con 0x55fc140a7d60 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8ca7fc640 10 client.18054 handle_command_reply: tid=0 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 client.18054 shutdown 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 msgr2=0x55fc14026f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc006010 tx=0x7fe8dc0bcc90 comp rx=0 tx=0).stop 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 shutdown_connections 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fc1402d370 0x55fc14026f90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fc140a7d60 0x55fc140aa180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8ca7fc640 0 client.18054 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc14023b40 0x55fc14026a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 --2- 172.21.15.66:0/1681366311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fc140225d0 0x55fc14035980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.203+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 >> 172.21.15.66:0/1681366311 conn(0x55fc13feb310 msgr2=0x55fc1401dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 shutdown_connections 2024-09-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8eb549740 1 -- 172.21.15.66:0/1681366311 wait complete. 2024-09-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8eb549740 20 client.18054 trim_cache size 0 max 16384 2024-09-15T22:57:24.210 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 msgr2=0x7fe8d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 0x7fe8d00a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55fc14023070 tx=0x7fe8cc009470 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 msgr2=0x7fe8e4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc031a60 tx=0x7fe8dc031a90 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 shutdown_connections 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8d00a33b0 0x7fe8d00a5870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e4106f40 0x7fe8e4074f70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e41027c0 0x7fe8e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 --2- 172.21.15.66:0/1507691234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8e4101e10 0x7fe8e40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 >> 172.21.15.66:0/1507691234 conn(0x7fe8e40fd8d0 msgr2=0x7fe8e40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:24.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 shutdown_connections 2024-09-15T22:57:24.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:24.204+0000 7fe8e9170640 1 -- 172.21.15.66:0/1507691234 wait complete. 2024-09-15T22:57:25.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:25 smithi066 ceph-mon[31185]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 210 KiB/s wr, 65 op/s 2024-09-15T22:57:25.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:25 smithi066 ceph-mon[31185]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:57:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:25 smithi087 ceph-mon[35290]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 210 KiB/s wr, 65 op/s 2024-09-15T22:57:25.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:25 smithi087 ceph-mon[35290]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:57:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:25 smithi184 ceph-mon[35203]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 210 KiB/s wr, 65 op/s 2024-09-15T22:57:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:25 smithi184 ceph-mon[35203]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:57:25.911 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:57:25.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:57:26.184 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/298604991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102ef0 msgr2=0x7f4f8810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/298604991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102ef0 0x7f4f8810da40 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009ca0 tx=0x7f4f8002a950 comp rx=0 tx=0).stop 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/298604991 shutdown_connections 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/298604991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102ef0 0x7f4f8810da40 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/298604991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102570 0x7f4f881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/298604991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 0x7f4f88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/298604991 >> 172.21.15.66:0/298604991 conn(0x7f4f880fc7d0 msgr2=0x7f4f880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/298604991 shutdown_connections 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.692+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/298604991 wait complete. 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 Processor -- start 2024-09-15T22:57:26.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 -- start start 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 0x7f4f8819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102ef0 0x7f4f8819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881120a0 con 0x7f4f88102570 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f88111f20 con 0x7f4f88100e20 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8c9c7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f88112220 con 0x7f4f88102ef0 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f85d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f85d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55932/0 (socket says 172.21.15.66:55932) 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f85d9b640 1 -- 172.21.15.66:0/1932666702 learned_addr learned my addr 172.21.15.66:0/1932666702 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f8659c640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 0x7f4f8819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.693+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102ef0 0x7f4f8819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 -- 172.21.15.66:0/1932666702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102ef0 msgr2=0x7f4f8819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102ef0 0x7f4f8819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 -- 172.21.15.66:0/1932666702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 msgr2=0x7f4f8819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 0x7f4f8819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 -- 172.21.15.66:0/1932666702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8819f640 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c970 tx=0x7f4f7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f777fe640 1 -- 172.21.15.66:0/1932666702 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c007bb0 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8819f930 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f777fe640 1 -- 172.21.15.66:0/1932666702 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f7c007d50 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f777fe640 1 -- 172.21.15.66:0/1932666702 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00f450 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.694+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f881a7210 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.696+0000 7f4f777fe640 1 -- 172.21.15.66:0/1932666702 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4f7c005020 con 0x7f4f88102570 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 Processor -- start 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 -- start start 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230fa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a023052280 con 0x55a0230ecb60 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a022ff9b10 con 0x55a0230f7d40 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a02304e240 con 0x55a0230ed480 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55938/0 (socket says 172.21.15.66:55938) 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f86d9d640 1 -- 172.21.15.66:0/2476103883 learned_addr learned my addr 172.21.15.66:0/2476103883 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.697+0000 7f4f777fe640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 0x7f4f700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f8659c640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 0x7f4f700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 -- 172.21.15.66:0/2476103883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 msgr2=0x55a0230f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f777fe640 1 -- 172.21.15.66:0/1932666702 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f4f7c0cfe10 con 0x7f4f88102570 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 -- 172.21.15.66:0/2476103883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 msgr2=0x55a0230fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 -- 172.21.15.66:0/2476103883 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0230061f0 con 0x55a0230ecb60 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f8659c640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4f80035000 tx=0x7f4f8002f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9217f617fdddcc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f74ff9640 1 -- 172.21.15.66:0/2476103883 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80043050 con 0x55a0230ecb60 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f74ff9640 1 -- 172.21.15.66:0/2476103883 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f80044040 con 0x55a0230ecb60 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.698+0000 7f4f74ff9640 1 -- 172.21.15.66:0/2476103883 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8004d020 con 0x55a0230ecb60 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2476103883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 msgr2=0x55a0230ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 0x7f4f700a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f8004e000 tx=0x7f4f8004c000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4f80035000 tx=0x7f4f8002f420 comp rx=0 tx=0).stop 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2476103883 shutdown_connections 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2476103883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230ecf40 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2476103883 >> 172.21.15.66:0/2476103883 conn(0x55a0230e90f0 msgr2=0x55a0230e94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2476103883 shutdown_connections 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2476103883 wait complete. 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.699+0000 7f4f8eda0740 1 -- start start 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 Processor -- start 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a0230fa910 con 0x55a0230ecb60 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a02300cf10 con 0x55a0230f7d40 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a0230faa90 con 0x55a0230ed480 2024-09-15T22:57:26.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8eda0740 10 client.0 _ll_register_callbacks cb 0x55a022fd5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:26.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55942/0 (socket says 172.21.15.66:55942) 2024-09-15T22:57:26.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 -- 172.21.15.66:0/2128004500 learned_addr learned my addr 172.21.15.66:0/2128004500 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:26.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 -- 172.21.15.66:0/2128004500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 msgr2=0x55a0230f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 -- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 msgr2=0x55a0230f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 -- 172.21.15.66:0/2128004500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a022dc36a0 con 0x55a0230ecb60 2024-09-15T22:57:26.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f8659c640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bef0 tx=0x7f4f78012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e042b03ef37aa5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.700+0000 7f4f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78005220 con 0x55a0230ecb60 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f4f780053c0 con 0x55a0230ecb60 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f80044040 con 0x55a0230ecb60 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4f78005600 con 0x55a0230ecb60 2024-09-15T22:57:26.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 10 client.18066 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55a023106570 con 0x55a0230ecb60 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f80044040 con 0x55a0230ecb60 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f4f7801c400 con 0x55a0230ecb60 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 10 client.18066 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:26.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 20 client.18066 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a023107a30 0x55a023109ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 4 client.18066 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.701+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a02305f7f0 con 0x55a023107a30 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.702+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a023107a30 0x55a023109ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.702+0000 7f4f6dffb640 10 client.18066 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.702+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a023107a30 0x55a023109ea0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d94efc4a3c0327a server_cookie=a715fc818c93fa83 in_seq=0 out_seq=0 2024-09-15T22:57:26.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f6dffb640 1 -- 172.21.15.66:0/2128004500 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a02305f7f0 con 0x55a023107a30 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f6dffb640 10 client.18066 handle_command_reply: tid=0 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 client.18066 shutdown 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 msgr2=0x55a0230f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bef0 tx=0x7f4f78012820 comp rx=0 tx=0).stop 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 shutdown_connections 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a023107a30 0x55a023109ea0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230f7d40 0x55a0230f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ed480 0x55a0230f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f6dffb640 0 client.18066 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/2128004500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230f4c20 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 >> 172.21.15.66:0/2128004500 conn(0x55a0230e90f0 msgr2=0x55a0230e8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 shutdown_connections 2024-09-15T22:57:26.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 1 -- 172.21.15.66:0/2128004500 wait complete. 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.703+0000 7f4f8eda0740 20 client.18066 trim_cache size 0 max 16384 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 Processor -- start 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 -- start start 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 0x55a0230e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a02310f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881b1350 con 0x55a0230f7d40 2024-09-15T22:57:26.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881b3010 con 0x55a0230ed480 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881b1ae0 con 0x55a0230ecb60 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55956/0 (socket says 172.21.15.66:55956) 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 -- 172.21.15.66:0/165257411 learned_addr learned my addr 172.21.15.66:0/165257411 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8659c640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 0x55a0230e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a02310f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 -- 172.21.15.66:0/165257411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 msgr2=0x55a0230e8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 0x55a0230e8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 -- 172.21.15.66:0/165257411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 msgr2=0x55a02310f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a02310f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 -- 172.21.15.66:0/165257411 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0230f5bf0 con 0x55a0230f7d40 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f8659c640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 0x55a0230e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.721+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4f8003c000 tx=0x7f4f80053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3e6ad286b4f4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f6ffff640 1 -- 172.21.15.66:0/165257411 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80060070 con 0x55a0230f7d40 2024-09-15T22:57:26.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f6ffff640 1 -- 172.21.15.66:0/165257411 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f80005bf0 con 0x55a0230f7d40 2024-09-15T22:57:26.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f6ffff640 1 -- 172.21.15.66:0/165257411 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8004d050 con 0x55a0230f7d40 2024-09-15T22:57:26.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 -- 172.21.15.66:0/165257411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 msgr2=0x55a02310fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4f8003c000 tx=0x7f4f80053000 comp rx=0 tx=0).stop 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 -- 172.21.15.66:0/165257411 shutdown_connections 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230f7d40 0x55a02310fcb0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a02310f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/165257411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230ecb60 0x55a0230e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 -- 172.21.15.66:0/165257411 >> 172.21.15.66:0/165257411 conn(0x55a0230e90f0 msgr2=0x55a0230e7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 -- 172.21.15.66:0/165257411 shutdown_connections 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.722+0000 7f4f8eda0740 1 -- 172.21.15.66:0/165257411 wait complete. 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 -- start start 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 Processor -- start 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a0230fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 0x55a023182750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881b2940 con 0x55a0230ecb60 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881b2270 con 0x55a0230ed480 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881af350 con 0x55a0230f7d40 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8eda0740 10 client.0 _ll_register_callbacks cb 0x7f4f7800ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.723+0000 7f4f8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55958/0 (socket says 172.21.15.66:55958) 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 -- 172.21.15.66:0/1562764245 learned_addr learned my addr 172.21.15.66:0/1562764245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:26.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a0230fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 0x55a023182750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 -- 172.21.15.66:0/1562764245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 msgr2=0x55a023182750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 0x55a023182750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 -- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 msgr2=0x55a0230fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a0230fc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 -- 172.21.15.66:0/1562764245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a023182d90 con 0x55a0230ecb60 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f86d9d640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 0x55a023182750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:26.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8659c640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bec0 tx=0x7f4f7800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e6361d103dc48d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7802d070 con 0x55a0230ecb60 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f4f78010b70 con 0x55a0230ecb60 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f80005bf0 con 0x55a0230ecb60 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4f7803a050 con 0x55a0230ecb60 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8eda0740 10 client.18072 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:26.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.724+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55a023184060 con 0x55a0230ecb60 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f80005bf0 con 0x55a0230ecb60 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f4f78029ca0 con 0x55a0230ecb60 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 10 client.18072 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 10 client.18072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 20 client.18072 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a0231847b0 0x55a023186bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:26.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 4 client.18072 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:57:26.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a023059d00 con 0x55a0231847b0 2024-09-15T22:57:26.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.725+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a0231847b0 0x55a023186bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:26.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.726+0000 7f4f6dffb640 10 client.18072 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:26.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.726+0000 7f4f85d9b640 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a0231847b0 0x55a023186bd0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5dd24c31bc02749 server_cookie=38fb7f9cab00f822 in_seq=0 out_seq=0 2024-09-15T22:57:26.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:57:26.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f6dffb640 1 -- 172.21.15.66:0/1562764245 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a023059d00 con 0x55a0231847b0 2024-09-15T22:57:26.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f6dffb640 10 client.18072 handle_command_reply: tid=0 2024-09-15T22:57:26.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 client.18072 shutdown 2024-09-15T22:57:26.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 msgr2=0x55a0230fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bec0 tx=0x7f4f7800b9f0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 shutdown_connections 2024-09-15T22:57:26.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0230f7d40 0x55a023182750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a0231847b0 0x55a023186bd0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0230ed480 0x55a0230fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 --2- 172.21.15.66:0/1562764245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a0230ecb60 0x55a0230fc230 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 >> 172.21.15.66:0/1562764245 conn(0x55a0230e90f0 msgr2=0x55a0230f3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f6dffb640 0 client.18072 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 shutdown_connections 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 1 -- 172.21.15.66:0/1562764245 wait complete. 2024-09-15T22:57:26.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.727+0000 7f4f8eda0740 20 client.18072 trim_cache size 0 max 16384 2024-09-15T22:57:26.756 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:26.756 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:57:26.756 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "b79fcef6-2dfe-4cc2-a26c-587b136ddd1b", 2024-09-15T22:57:26.757 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:57:26.757 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:26.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 msgr2=0x7f4f700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 0x7f4f700a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f8004e000 tx=0x7f4f8004c000 comp rx=0 tx=0).stop 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 msgr2=0x7f4f8819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c970 tx=0x7f4f7c00ce30 comp rx=0 tx=0).stop 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 shutdown_connections 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4f700a33b0 0x7f4f700a5870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f88102ef0 0x7f4f8819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f88102570 0x7f4f8819abd0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 --2- 172.21.15.66:0/1932666702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f88100e20 0x7f4f8819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:26.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 >> 172.21.15.66:0/1932666702 conn(0x7f4f880fc7d0 msgr2=0x7f4f88106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:26.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 shutdown_connections 2024-09-15T22:57:26.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:26.728+0000 7f4f8c9c7640 1 -- 172.21.15.66:0/1932666702 wait complete. 2024-09-15T22:57:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:27 smithi087 ceph-mon[35290]: pgmap v377: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-15T22:57:27.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:27 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:57:27.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:27 smithi066 ceph-mon[31185]: pgmap v377: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-15T22:57:27.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:27 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:57:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:27 smithi184 ceph-mon[35203]: pgmap v377: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-15T22:57:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:27 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:57:27.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:57:27.459 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 -- 172.21.15.66:0/4080137443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4106a90 msgr2=0x7fbdc4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 --2- 172.21.15.66:0/4080137443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4106a90 0x7fbdc4106e70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009900 tx=0x7fbdc002a410 comp rx=0 tx=0).stop 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 -- 172.21.15.66:0/4080137443 shutdown_connections 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 --2- 172.21.15.66:0/4080137443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc4100860 0x7fbdc41045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 --2- 172.21.15.66:0/4080137443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4107440 0x7fbdc4100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 --2- 172.21.15.66:0/4080137443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4106a90 0x7fbdc4106e70 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 -- 172.21.15.66:0/4080137443 >> 172.21.15.66:0/4080137443 conn(0x7fbdc4077230 msgr2=0x7fbdc40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 -- 172.21.15.66:0/4080137443 shutdown_connections 2024-09-15T22:57:28.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.037+0000 7fbdcc146640 1 -- 172.21.15.66:0/4080137443 wait complete. 2024-09-15T22:57:28.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 Processor -- start 2024-09-15T22:57:28.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 -- start start 2024-09-15T22:57:28.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4100860 0x7fbdc41a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc419e7d0 0x7fbdc419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41185e0 con 0x7fbdc4100860 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4118460 con 0x7fbdc4106a90 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.038+0000 7fbdcc146640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4118760 con 0x7fbdc419e7d0 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc9ee2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4100860 0x7fbdc41a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40502/0 (socket says 172.21.15.66:40502) 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 -- 172.21.15.66:0/323776447 learned_addr learned my addr 172.21.15.66:0/323776447 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdca6e3640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc419e7d0 0x7fbdc419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 -- 172.21.15.66:0/323776447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc419e7d0 msgr2=0x7fbdc419ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc419e7d0 0x7fbdc419ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 -- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4100860 msgr2=0x7fbdc41a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4100860 0x7fbdc41a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 -- 172.21.15.66:0/323776447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc419f3b0 con 0x7fbdc4106a90 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.039+0000 7fbdc96e1640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e9a0 tx=0x7fbdb400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.040+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400cd80 con 0x7fbdc4106a90 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.040+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc419f640 con 0x7fbdc4106a90 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.040+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb40035f0 con 0x7fbdc4106a90 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.040+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4010670 con 0x7fbdc4106a90 2024-09-15T22:57:28.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.040+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41ab870 con 0x7fbdc4106a90 2024-09-15T22:57:28.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.042+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda8005290 con 0x7fbdc4106a90 2024-09-15T22:57:28.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.044+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbdb4021430 con 0x7fbdc4106a90 2024-09-15T22:57:28.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.044+0000 7fbdbaffd640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 0x7fbdb00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.045+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7fbdb40d0280 con 0x7fbdc4106a90 2024-09-15T22:57:28.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.045+0000 7fbdc9ee2640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 0x7fbdb00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.045+0000 7fbdc9ee2640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 0x7fbdb00a59c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0005ab0 tx=0x7fbdc002a910 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.052+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbdb409c7d0 con 0x7fbdc4106a90 2024-09-15T22:57:28.064 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:28.193 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:28 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:57:28.194 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:28 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:28.194 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:28 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:57:28.194 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:28 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:57:28.194 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:28 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:57:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:28 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:57:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:28 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:28 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:57:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:28 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:57:28.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:28 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:57:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.396+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbda8005850 con 0x7fbdc4106a90 2024-09-15T22:57:28.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.396+0000 7fbdbaffd640 1 -- 172.21.15.66:0/323776447 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11988 (secure 0 0 0) 0x7fbdb409c0d0 con 0x7fbdc4106a90 2024-09-15T22:57:28.398 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:57:28.398 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"btime":"2024-09-15T22:57:07:882300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:07.497310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:57:28.398 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-09-15T22:57:28.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 msgr2=0x7fbdb00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 0x7fbdb00a59c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0005ab0 tx=0x7fbdc002a910 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 msgr2=0x7fbdc41a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400e9a0 tx=0x7fbdb400ee60 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 shutdown_connections 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbdb00a3500 0x7fbdb00a59c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdc419e7d0 0x7fbdc419ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdc4106a90 0x7fbdc41a4b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 --2- 172.21.15.66:0/323776447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdc4100860 0x7fbdc41a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 >> 172.21.15.66:0/323776447 conn(0x7fbdc4077230 msgr2=0x7fbdc4102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 shutdown_connections 2024-09-15T22:57:28.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.399+0000 7fbdcc146640 1 -- 172.21.15.66:0/323776447 wait complete. 2024-09-15T22:57:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:28 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:57:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:28 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:28 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:57:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:28 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:57:28.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:28 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:57:28.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 -- 172.21.15.66:0/2577800448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 msgr2=0x7f81b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/2577800448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b01029b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8198009900 tx=0x7f819802a480 comp rx=0 tx=0).stop 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 -- 172.21.15.66:0/2577800448 shutdown_connections 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/2577800448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/2577800448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b01029b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/2577800448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 0x7f81b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 -- 172.21.15.66:0/2577800448 >> 172.21.15.66:0/2577800448 conn(0x7f81b00fc7d0 msgr2=0x7f81b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 -- 172.21.15.66:0/2577800448 shutdown_connections 2024-09-15T22:57:28.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.667+0000 7f81b4bf5640 1 -- 172.21.15.66:0/2577800448 wait complete. 2024-09-15T22:57:28.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.668+0000 7f81b4bf5640 1 Processor -- start 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.668+0000 7f81b4bf5640 1 -- start start 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.668+0000 7f81b4bf5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 0x7f81b0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.668+0000 7f81b4bf5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.668+0000 7f81b4bf5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81b4bf5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01120c0 con 0x7f81b0102570 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81b4bf5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0111f40 con 0x7f81b0102ef0 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81b4bf5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0112240 con 0x7f81b0100e20 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40520/0 (socket says 172.21.15.66:40520) 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 -- 172.21.15.66:0/1190415377 learned_addr learned my addr 172.21.15.66:0/1190415377 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81ae59c640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 0x7f81b0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 -- 172.21.15.66:0/1190415377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 msgr2=0x7f81b0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 0x7f81b0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 -- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 msgr2=0x7f81b0198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b0198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81aed9d640 1 -- 172.21.15.66:0/1190415377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b019d510 con 0x7f81b0102ef0 2024-09-15T22:57:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.669+0000 7f81a7fff640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81aed9d640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81a800eb10 tx=0x7f81a800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81a77fe640 1 -- 172.21.15.66:0/1190415377 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8004b20 con 0x7f81b0102ef0 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b019d800 con 0x7f81b0102ef0 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81a77fe640 1 -- 172.21.15.66:0/1190415377 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a8004cc0 con 0x7f81b0102ef0 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b010fce0 con 0x7f81b0102ef0 2024-09-15T22:57:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.670+0000 7f81a77fe640 1 -- 172.21.15.66:0/1190415377 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8010760 con 0x7f81b0102ef0 2024-09-15T22:57:28.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.673+0000 7f81a77fe640 1 -- 172.21.15.66:0/1190415377 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f81a8005020 con 0x7f81b0102ef0 2024-09-15T22:57:28.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 Processor -- start 2024-09-15T22:57:28.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 -- start start 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b0dc0 0x558bf04bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04bda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558bf04162e0 con 0x558bf04b0dc0 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558bf03bdce0 con 0x558bf04bb680 2024-09-15T22:57:28.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81b6fce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558bf04122a0 con 0x558bf04b04a0 2024-09-15T22:57:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:57734/0 (socket says 172.21.15.66:57734) 2024-09-15T22:57:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.674+0000 7f81a7fff640 1 -- 172.21.15.66:0/1888485717 learned_addr learned my addr 172.21.15.66:0/1888485717 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81ae59c640 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b0dc0 0x558bf04bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04bda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 -- 172.21.15.66:0/1888485717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 msgr2=0x558bf04bda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04bda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 -- 172.21.15.66:0/1888485717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b0dc0 msgr2=0x558bf04bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b0dc0 0x558bf04bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 -- 172.21.15.66:0/1888485717 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf03a2440 con 0x558bf04b04a0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a77fe640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 0x7f819c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.675+0000 7f81a7fff640 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558bf04addb0 tx=0x7f8198009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6a619f7ab8adb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.676+0000 7f81ae59c640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 0x7f819c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.676+0000 7f81a4ff9640 1 -- 172.21.15.66:0/1888485717 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819804b020 con 0x558bf04b04a0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.676+0000 7f81a4ff9640 1 -- 172.21.15.66:0/1888485717 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8198005520 con 0x558bf04b04a0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.676+0000 7f81a4ff9640 1 -- 172.21.15.66:0/1888485717 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198035030 con 0x558bf04b04a0 2024-09-15T22:57:28.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.676+0000 7f81a77fe640 1 -- 172.21.15.66:0/1190415377 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f81a80d0640 con 0x7f81b0102ef0 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 -- 172.21.15.66:0/1888485717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 msgr2=0x558bf04b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558bf04addb0 tx=0x7f8198009600 comp rx=0 tx=0).stop 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81ae59c640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 0x7f819c0a5970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x558bf04ad890 tx=0x7f81a000b410 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 -- 172.21.15.66:0/1888485717 shutdown_connections 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04bda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b0dc0 0x558bf04bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 --2- 172.21.15.66:0/1888485717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04b0880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 -- 172.21.15.66:0/1888485717 >> 172.21.15.66:0/1888485717 conn(0x558bf04aca30 msgr2=0x558bf04ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 -- 172.21.15.66:0/1888485717 shutdown_connections 2024-09-15T22:57:28.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.677+0000 7f81b6fce740 1 -- 172.21.15.66:0/1888485717 wait complete. 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 -- start start 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 Processor -- start 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558bf04be250 con 0x558bf04b04a0 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558bf03d1050 con 0x558bf04bb680 2024-09-15T22:57:28.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558bf04be3d0 con 0x558bf04b0dc0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81b6fce740 10 client.0 _ll_register_callbacks cb 0x558bf0411160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81ae59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81ae59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56006/0 (socket says 172.21.15.66:56006) 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81ae59c640 1 -- 172.21.15.66:0/2931886589 learned_addr learned my addr 172.21.15.66:0/2931886589 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.678+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81aed9d640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 -- 172.21.15.66:0/2931886589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 msgr2=0x558bf04b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 -- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 msgr2=0x558bf04b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 -- 172.21.15.66:0/2931886589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf01873c0 con 0x558bf04b04a0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f81a001f520 tx=0x7f81a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656ef62c9a0d9ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.679+0000 7f8195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a002c060 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f81a0017030 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8198005520 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f81a001c600 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f81b6fce740 10 client.18090 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558bf04c9d90 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8198005520 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.680+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f81a0010a40 con 0x558bf04b04a0 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 10 client.18090 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 10 client.18090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 20 client.18090 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf04cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 4 client.18090 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bf0423850 con 0x558bf04cb1a0 2024-09-15T22:57:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.681+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf04cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.682+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf04cd590 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d5b01adce32351 server_cookie=3b8a7dfe9482a916 in_seq=0 out_seq=0 2024-09-15T22:57:28.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.682+0000 7f8195ffb640 10 client.18090 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f8195ffb640 1 -- 172.21.15.66:0/2931886589 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bf0423850 con 0x558bf04cb1a0 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f8195ffb640 10 client.18090 handle_command_reply: tid=0 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f81b6fce740 1 client.18090 shutdown 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 msgr2=0x558bf04bb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f81a001f520 tx=0x7f81a0004730 comp rx=0 tx=0).stop 2024-09-15T22:57:28.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.683+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 shutdown_connections 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf04cd590 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f8195ffb640 0 client.18090 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2931886589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04bb070 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 >> 172.21.15.66:0/2931886589 conn(0x558bf04aca30 msgr2=0x558bf04b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 shutdown_connections 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 1 -- 172.21.15.66:0/2931886589 wait complete. 2024-09-15T22:57:28.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.684+0000 7f81b6fce740 20 client.18090 trim_cache size 0 max 16384 2024-09-15T22:57:28.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 Processor -- start 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 -- start start 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0073b80 con 0x558bf04b04a0 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01b74f0 con 0x558bf04bb680 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.711+0000 7f81b6fce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01b60d0 con 0x558bf04b0dc0 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:57766/0 (socket says 172.21.15.66:57766) 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 -- 172.21.15.66:0/3122067553 learned_addr learned my addr 172.21.15.66:0/3122067553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81aed9d640 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81ae59c640 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 -- 172.21.15.66:0/3122067553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 msgr2=0x558bf04d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 -- 172.21.15.66:0/3122067553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 msgr2=0x558bf04aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 -- 172.21.15.66:0/3122067553 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf04cd900 con 0x558bf04b0dc0 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.712+0000 7f81a7fff640 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8198004c90 tx=0x7f819802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4246e11a6daeaa18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.713+0000 7f8197fff640 1 -- 172.21.15.66:0/3122067553 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819804b040 con 0x558bf04b0dc0 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.713+0000 7f8197fff640 1 -- 172.21.15.66:0/3122067553 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8198005240 con 0x558bf04b0dc0 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.713+0000 7f8197fff640 1 -- 172.21.15.66:0/3122067553 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198035040 con 0x558bf04b0dc0 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- 172.21.15.66:0/3122067553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 msgr2=0x558bf04d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8198004c90 tx=0x7f819802a480 comp rx=0 tx=0).stop 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- 172.21.15.66:0/3122067553 shutdown_connections 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04bb680 0x558bf04d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b0dc0 0x558bf04d2e20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 --2- 172.21.15.66:0/3122067553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04b04a0 0x558bf04aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- 172.21.15.66:0/3122067553 >> 172.21.15.66:0/3122067553 conn(0x558bf04aca30 msgr2=0x558bf04ab350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- 172.21.15.66:0/3122067553 shutdown_connections 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- 172.21.15.66:0/3122067553 wait complete. 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 -- start start 2024-09-15T22:57:28.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.714+0000 7f81b6fce740 1 Processor -- start 2024-09-15T22:57:28.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 0x558bf04c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01b6e20 con 0x558bf04bb680 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81b01b6750 con 0x558bf04b0dc0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0071b80 con 0x558bf04b04a0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81b6fce740 10 client.0 _ll_register_callbacks cb 0x7f81a000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40558/0 (socket says 172.21.15.66:40558) 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 -- 172.21.15.66:0/2741912906 learned_addr learned my addr 172.21.15.66:0/2741912906 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81aed9d640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 0x558bf04c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 -- 172.21.15.66:0/2741912906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 msgr2=0x558bf04c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 -- 172.21.15.66:0/2741912906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 msgr2=0x558bf04c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 0x558bf04c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81a7fff640 1 -- 172.21.15.66:0/2741912906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf04b0bf0 con 0x558bf04b0dc0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.715+0000 7f81aed9d640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 0x558bf04c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.716+0000 7f81a7fff640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f819803a640 tx=0x7f8198005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73478cfeefd6fd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.716+0000 7f8195ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.716+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198065060 con 0x558bf04b0dc0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.716+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f8198004d60 con 0x558bf04b0dc0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.716+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8198005240 con 0x558bf04b0dc0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8198035070 con 0x558bf04b0dc0 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 10 client.27434 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:28.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558bf0536100 con 0x558bf04b0dc0 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8198005240 con 0x558bf04b0dc0 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f8198060440 con 0x558bf04b0dc0 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 10 client.27434 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 10 client.27434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 20 client.27434 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf05382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 4 client.27434 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558bf041dd60 con 0x558bf04cb1a0 2024-09-15T22:57:28.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.717+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf05382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.718+0000 7f81ae59c640 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf05382e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b40810b42e8f4e server_cookie=40a1ce757b6d591 in_seq=0 out_seq=0 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.718+0000 7f8195ffb640 10 client.27434 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f8195ffb640 1 -- 172.21.15.66:0/2741912906 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x558bf041dd60 con 0x558bf04cb1a0 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f8195ffb640 10 client.27434 handle_command_reply: tid=0 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 client.27434 shutdown 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 msgr2=0x558bf04c1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f819803a640 tx=0x7f8198005b50 comp rx=0 tx=0).stop 2024-09-15T22:57:28.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 shutdown_connections 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558bf04bb680 0x558bf04c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x558bf04cb1a0 0x558bf05382e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f8195ffb640 0 client.27434 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558bf04b0dc0 0x558bf04c1b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 --2- 172.21.15.66:0/2741912906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bf04b04a0 0x558bf04c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 >> 172.21.15.66:0/2741912906 conn(0x558bf04aca30 msgr2=0x558bf04abb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.719+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 shutdown_connections 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.720+0000 7f81b6fce740 1 -- 172.21.15.66:0/2741912906 wait complete. 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.720+0000 7f81b6fce740 20 client.27434 trim_cache size 0 max 16384 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:28.724 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (2766 inodes in the stack)", 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: "b79fcef6-2dfe-4cc2-a26c-587b136ddd1b": { 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "b79fcef6-2dfe-4cc2-a26c-587b136ddd1b", 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:28.725 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 msgr2=0x7f819c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 0x7f819c0a5970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x558bf04ad890 tx=0x7f81a000b410 comp rx=0 tx=0).stop 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 msgr2=0x7f81b019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81a800eb10 tx=0x7f81a800c2d0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 shutdown_connections 2024-09-15T22:57:28.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f819c0a34b0 0x7f819c0a5970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b0102ef0 0x7f81b019ce10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81b0102570 0x7f81b0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 --2- 172.21.15.66:0/1190415377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81b0100e20 0x7f81b0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.721+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 >> 172.21.15.66:0/1190415377 conn(0x7f81b00fc7d0 msgr2=0x7f81b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.722+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 shutdown_connections 2024-09-15T22:57:28.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:28.722+0000 7f81b4bf5640 1 -- 172.21.15.66:0/1190415377 wait complete. 2024-09-15T22:57:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:29 smithi087 ceph-mon[35290]: pgmap v378: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-15T22:57:29.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/323776447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:29.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:29 smithi066 ceph-mon[31185]: pgmap v378: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-15T22:57:29.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/323776447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:29.415 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 477159e6 --release --await' 2024-09-15T22:57:29.415 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 477159e6 --release --await 2024-09-15T22:57:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:29 smithi184 ceph-mon[35203]: pgmap v378: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-15T22:57:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/323776447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:30.086 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:30 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:30.116 INFO:tasks.cephfs.filesystem:scrub status for tag:b79fcef6-2dfe-4cc2-a26c-587b136ddd1b - {'path': '/', 'tag': 'b79fcef6-2dfe-4cc2-a26c-587b136ddd1b', 'options': 'recursive,force'} 2024-09-15T22:57:30.164 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:30.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:30 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:30 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:30.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 -- 172.21.15.66:0/173787688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 msgr2=0x7f7980106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 --2- 172.21.15.66:0/173787688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f7980106840 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7974009930 tx=0x7f797402a420 comp rx=0 tx=0).stop 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 -- 172.21.15.66:0/173787688 shutdown_connections 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 --2- 172.21.15.66:0/173787688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7980106f50 0x7f798010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 --2- 172.21.15.66:0/173787688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f7980106840 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 --2- 172.21.15.66:0/173787688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79801002f0 0x7f79801006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 -- 172.21.15.66:0/173787688 >> 172.21.15.66:0/173787688 conn(0x7f7980077210 msgr2=0x7f79800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 -- 172.21.15.66:0/173787688 shutdown_connections 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.635+0000 7f7987569640 1 -- 172.21.15.66:0/173787688 wait complete. 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 Processor -- start 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 -- start start 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 0x7f79801984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7980106f50 0x7f798019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7980111f60 con 0x7f7980100ca0 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7980111de0 con 0x7f79801002f0 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7987569640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79801120e0 con 0x7f7980106f50 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7984b04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7984b04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56044/0 (socket says 172.21.15.66:56044) 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7984b04640 1 -- 172.21.15.66:0/3544829953 learned_addr learned my addr 172.21.15.66:0/3544829953 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7985305640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 0x7f79801984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.636+0000 7f7985b06640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7980106f50 0x7f798019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 -- 172.21.15.66:0/3544829953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7980106f50 msgr2=0x7f798019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7980106f50 0x7f798019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 -- 172.21.15.66:0/3544829953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 msgr2=0x7f79801984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 0x7f79801984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 -- 172.21.15.66:0/3544829953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798019d450 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7985305640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 0x7f79801984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7984b04640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7974005940 tx=0x7f7974004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f79727fc640 1 -- 172.21.15.66:0/3544829953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797403f030 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798019d6e0 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f79727fc640 1 -- 172.21.15.66:0/3544829953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7974003ad0 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f79727fc640 1 -- 172.21.15.66:0/3544829953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974035070 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.637+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79801a5020 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.639+0000 7f79727fc640 1 -- 172.21.15.66:0/3544829953 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7974042030 con 0x7f7980100ca0 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 Processor -- start 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 -- start start 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f4999340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f9f48fe620 con 0x55f9f4999880 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f9f48a5e50 con 0x55f9f4998f60 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7989942740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f9f48fa5e0 con 0x55f9f49a8650 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56060/0 (socket says 172.21.15.66:56060) 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 -- 172.21.15.66:0/3178923808 learned_addr learned my addr 172.21.15.66:0/3178923808 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985b06640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f4999340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f79727fc640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 0x7f796c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7984b04640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 -- 172.21.15.66:0/3178923808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 msgr2=0x55f9f49aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 -- 172.21.15.66:0/3178923808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 msgr2=0x55f9f4999340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.640+0000 7f7985305640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f4999340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f7985305640 1 -- 172.21.15.66:0/3178923808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f4896d40 con 0x55f9f4999880 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f7985b06640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f4999340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f7985b06640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 0x7f796c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f79727fc640 1 -- 172.21.15.66:0/3544829953 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f79740f01e0 con 0x7f7980100ca0 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f7985305640 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f797c0104d0 tx=0x7f797c010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca25c8af44a0ef6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f796b7fe640 1 -- 172.21.15.66:0/3178923808 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c004220 con 0x55f9f4999880 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f796b7fe640 1 -- 172.21.15.66:0/3178923808 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f797c0043c0 con 0x55f9f4999880 2024-09-15T22:57:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.641+0000 7f796b7fe640 1 -- 172.21.15.66:0/3178923808 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c011b70 con 0x55f9f4999880 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- 172.21.15.66:0/3178923808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 msgr2=0x55f9f49a8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7985b06640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 0x7f796c0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7978005fd0 tx=0x7f7978014040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f797c0104d0 tx=0x7f797c010990 comp rx=0 tx=0).stop 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- 172.21.15.66:0/3178923808 shutdown_connections 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49a8110 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 --2- 172.21.15.66:0/3178923808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f4999340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- 172.21.15.66:0/3178923808 >> 172.21.15.66:0/3178923808 conn(0x55f9f49955f0 msgr2=0x55f9f49959d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- 172.21.15.66:0/3178923808 shutdown_connections 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- 172.21.15.66:0/3178923808 wait complete. 2024-09-15T22:57:30.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 -- start start 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.642+0000 7f7989942740 1 Processor -- start 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4999880 0x55f9f49a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f9f49ab280 con 0x55f9f4998f60 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f9f4886f10 con 0x55f9f4999880 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f9f49ab400 con 0x55f9f49a8650 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7989942740 10 client.0 _ll_register_callbacks cb 0x55f9f48aadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56064/0 (socket says 172.21.15.66:56064) 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 -- 172.21.15.66:0/2431937983 learned_addr learned my addr 172.21.15.66:0/2431937983 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7984b04640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4999880 0x55f9f49a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985b06640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 -- 172.21.15.66:0/2431937983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 msgr2=0x55f9f49a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 -- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4999880 msgr2=0x55f9f49a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4999880 0x55f9f49a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 -- 172.21.15.66:0/2431937983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f460d580 con 0x55f9f4998f60 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7985305640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f797c000c00 tx=0x7f797c004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c255ebea270aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.643+0000 7f7968ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c029060 con 0x55f9f4998f60 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f797c011ae0 con 0x55f9f4998f60 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f797c0043c0 con 0x55f9f4998f60 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f797c030050 con 0x55f9f4998f60 2024-09-15T22:57:30.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 10 client.18108 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f9f46d7960 con 0x55f9f4998f60 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f797c0043c0 con 0x55f9f4998f60 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f797c003850 con 0x55f9f4998f60 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 10 client.18108 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 10 client.18108 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 20 client.18108 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f49b8260 0x55f9f49ba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 4 client.18108 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.644+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9f490bb90 con 0x55f9f49b8260 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.645+0000 7f7984b04640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f49b8260 0x55f9f49ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.645+0000 7f7984b04640 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f49b8260 0x55f9f49ba650 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57aa6c630cbb5e23 server_cookie=10429b12c89bded3 in_seq=0 out_seq=0 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.645+0000 7f7968ff9640 10 client.18108 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:30.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7968ff9640 1 -- 172.21.15.66:0/2431937983 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9f490bb90 con 0x55f9f49b8260 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7968ff9640 10 client.18108 handle_command_reply: tid=0 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 client.18108 shutdown 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 msgr2=0x55f9f49a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f797c000c00 tx=0x7f797c004160 comp rx=0 tx=0).stop 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 shutdown_connections 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f49b8260 0x55f9f49ba650 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4999880 0x55f9f49a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 --2- 172.21.15.66:0/2431937983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4998f60 0x55f9f49a5610 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7968ff9640 0 client.18108 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 >> 172.21.15.66:0/2431937983 conn(0x55f9f49955f0 msgr2=0x55f9f499b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 shutdown_connections 2024-09-15T22:57:30.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 1 -- 172.21.15.66:0/2431937983 wait complete. 2024-09-15T22:57:30.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.646+0000 7f7989942740 20 client.18108 trim_cache size 0 max 16384 2024-09-15T22:57:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 Processor -- start 2024-09-15T22:57:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 -- start start 2024-09-15T22:57:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f49bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79801ad140 con 0x55f9f4999880 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79801aee00 con 0x55f9f4998f60 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7989942740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79801ad8d0 con 0x55f9f49a8650 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.663+0000 7f7984b04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56072/0 (socket says 172.21.15.66:56072) 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 -- 172.21.15.66:0/3536907758 learned_addr learned my addr 172.21.15.66:0/3536907758 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7985305640 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f49bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 -- 172.21.15.66:0/3536907758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 msgr2=0x55f9f49a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7985b06640 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 -- 172.21.15.66:0/3536907758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 msgr2=0x55f9f49bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f49bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 -- 172.21.15.66:0/3536907758 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9f4995090 con 0x55f9f4999880 2024-09-15T22:57:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f7984b04640 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f79740ed560 tx=0x7f79740c0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8702aa6de3fde3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f796affd640 1 -- 172.21.15.66:0/3536907758 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974049040 con 0x55f9f4999880 2024-09-15T22:57:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f796affd640 1 -- 172.21.15.66:0/3536907758 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79740bc140 con 0x55f9f4999880 2024-09-15T22:57:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.664+0000 7f796affd640 1 -- 172.21.15.66:0/3536907758 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974003da0 con 0x55f9f4999880 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- 172.21.15.66:0/3536907758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 msgr2=0x55f9f49c02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f79740ed560 tx=0x7f79740c0040 comp rx=0 tx=0).stop 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- 172.21.15.66:0/3536907758 shutdown_connections 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f49a8650 0x55f9f49a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f4999880 0x55f9f49c02d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 --2- 172.21.15.66:0/3536907758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f49bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- 172.21.15.66:0/3536907758 >> 172.21.15.66:0/3536907758 conn(0x55f9f49955f0 msgr2=0x55f9f49a55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- 172.21.15.66:0/3536907758 shutdown_connections 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- 172.21.15.66:0/3536907758 wait complete. 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 -- start start 2024-09-15T22:57:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.665+0000 7f7989942740 1 Processor -- start 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f499f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f4999880 0x55f9f49b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79801ae730 con 0x55f9f49a8650 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79801ae060 con 0x55f9f4998f60 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79801ab140 con 0x55f9f4999880 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7989942740 10 client.0 _ll_register_callbacks cb 0x7f797c011560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56086/0 (socket says 172.21.15.66:56086) 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985305640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f499f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 -- 172.21.15.66:0/1650266786 learned_addr learned my addr 172.21.15.66:0/1650266786 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:30.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7984b04640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f4999880 0x55f9f49b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 -- 172.21.15.66:0/1650266786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f4999880 msgr2=0x55f9f49b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f4999880 0x55f9f49b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 -- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 msgr2=0x55f9f499f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f499f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.666+0000 7f7985b06640 1 -- 172.21.15.66:0/1650266786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9f49b1240 con 0x55f9f49a8650 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7985b06640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f797801fc20 tx=0x7f7978009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a3e4e00781945c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978010930 con 0x55f9f49a8650 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f7978010ad0 con 0x55f9f49a8650 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79740bc140 con 0x55f9f49a8650 2024-09-15T22:57:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f79780048a0 con 0x55f9f49a8650 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 10 client.18114 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f9f4a27610 con 0x55f9f49a8650 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79740bc140 con 0x55f9f49a8650 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f797801d410 con 0x55f9f49a8650 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 10 client.18114 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 10 client.18114 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 20 client.18114 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f4a27d60 0x55f9f4a2a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 4 client.18114 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "477159e6", "release": true, "await": true}] 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.667+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "477159e6", "release": true, "await": true}) -- 0x55f9f49060a0 con 0x55f9f4a27d60 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.668+0000 7f7985305640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f4a27d60 0x55f9f4a2a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:30.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.668+0000 7f7968ff9640 10 client.18114 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:30.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:30.668+0000 7f7985305640 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f4a27d60 0x55f9f4a2a180 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=173669188d82440b server_cookie=3fe057034360b655 in_seq=0 out_seq=0 2024-09-15T22:57:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:31 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:31 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:31 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:31 smithi087 ceph-mon[35290]: pgmap v379: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 KiB/s wr, 41 op/s 2024-09-15T22:57:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:31 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:31 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:31 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:31 smithi184 ceph-mon[35203]: pgmap v379: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 KiB/s wr, 41 op/s 2024-09-15T22:57:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:31 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:31 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:31 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:57:31.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:31 smithi066 ceph-mon[31185]: pgmap v379: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 KiB/s wr, 41 op/s 2024-09-15T22:57:31.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.570+0000 7f7968ff9640 1 -- 172.21.15.66:0/1650266786 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f9f49060a0 con 0x55f9f4a27d60 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.570+0000 7f7968ff9640 10 client.18114 handle_command_reply: tid=0 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.570+0000 7f7989942740 1 client.18114 shutdown 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 msgr2=0x55f9f49b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f797801fc20 tx=0x7f7978009500 comp rx=0 tx=0).stop 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 shutdown_connections 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f9f49a8650 0x55f9f49b0bd0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9f4999880 0x55f9f49b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f9f4a27d60 0x55f9f4a2a180 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 --2- 172.21.15.66:0/1650266786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9f4998f60 0x55f9f499f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7968ff9640 0 client.18114 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 >> 172.21.15.66:0/1650266786 conn(0x55f9f49955f0 msgr2=0x55f9f499aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:31.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 shutdown_connections 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 1 -- 172.21.15.66:0/1650266786 wait complete. 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.571+0000 7f7989942740 20 client.18114 trim_cache size 0 max 16384 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 54, 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 40, 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "477159e6": { 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 40, 2024-09-15T22:57:31.574 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 141.8, 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:31.575 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 msgr2=0x7f796c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:31.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 0x7f796c0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7978005fd0 tx=0x7f7978014040 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 msgr2=0x7f79801989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7974005940 tx=0x7f7974004270 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 shutdown_connections 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f796c0a33b0 0x7f796c0a5870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7980106f50 0x7f798019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7980100ca0 0x7f79801989e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 --2- 172.21.15.66:0/3544829953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79801002f0 0x7f79801984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 >> 172.21.15.66:0/3544829953 conn(0x7f7980077210 msgr2=0x7f79801051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 shutdown_connections 2024-09-15T22:57:31.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:31.572+0000 7f7987569640 1 -- 172.21.15.66:0/3544829953 wait complete. 2024-09-15T22:57:32.428 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '477159e6', total seconds elapsed: 27.5 2024-09-15T22:57:32.428 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.85 2024-09-15T22:57:32.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:57:32.794 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:33.183 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:33 smithi066 ceph-mon[31185]: pgmap v380: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.8 KiB/s wr, 113 op/s 2024-09-15T22:57:33.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 -- 172.21.15.66:0/1342131930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 msgr2=0x7faaec1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 --2- 172.21.15.66:0/1342131930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec1031e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7faae8009900 tx=0x7faae802a480 comp rx=0 tx=0).stop 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 -- 172.21.15.66:0/1342131930 shutdown_connections 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 --2- 172.21.15.66:0/1342131930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 0x7faaec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 --2- 172.21.15.66:0/1342131930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 --2- 172.21.15.66:0/1342131930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec1031e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 -- 172.21.15.66:0/1342131930 >> 172.21.15.66:0/1342131930 conn(0x7faaec0fc7a0 msgr2=0x7faaec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 -- 172.21.15.66:0/1342131930 shutdown_connections 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.267+0000 7faaf4702640 1 -- 172.21.15.66:0/1342131930 wait complete. 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 Processor -- start 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 -- start start 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 0x7faaec1014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faaec111f70 con 0x7faaec102e00 2024-09-15T22:57:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faaec111df0 con 0x7faaec103720 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf4702640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faaec1120f0 con 0x7faaec10c1a0 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf249e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf1c9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf1c9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:50544/0 (socket says 172.21.15.66:50544) 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf1c9d640 1 -- 172.21.15.66:0/132740151 learned_addr learned my addr 172.21.15.66:0/132740151 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.268+0000 7faaf2c9f640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 0x7faaec1014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 -- 172.21.15.66:0/132740151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 msgr2=0x7faaec1014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 0x7faaec1014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 -- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 msgr2=0x7faaec100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 -- 172.21.15.66:0/132740151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec1a69b0 con 0x7faaec103720 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf249e640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf1c9d640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d950 tx=0x7faadc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc017030 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faadc004020 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec1a6ca0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc0047a0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.269+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec1a71d0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.270+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec1031e0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.271+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7faadc0041d0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.272+0000 7faae37fe640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 0x7faad80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.272+0000 7faaf249e640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 0x7faad80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.272+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7faadc0cf9f0 con 0x7faaec103720 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.273+0000 7faaf249e640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 0x7faad80a58f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faae8009230 tx=0x7faae80058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:33.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.275+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faadc09c020 con 0x7faaec103720 2024-09-15T22:57:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:33 smithi087 ceph-mon[35290]: pgmap v380: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.8 KiB/s wr, 113 op/s 2024-09-15T22:57:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:33 smithi184 ceph-mon[35203]: pgmap v380: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.8 KiB/s wr, 113 op/s 2024-09-15T22:57:33.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.494+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaec101f90 con 0x7faaec103720 2024-09-15T22:57:33.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.495+0000 7faae37fe640 1 -- 172.21.15.66:0/132740151 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11988 (secure 0 0 0) 0x7faadc09b920 con 0x7faaec103720 2024-09-15T22:57:33.497 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:57:33.497 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"btime":"2024-09-15T22:57:07:882300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:07.497310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:57:33.498 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-09-15T22:57:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.500+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 msgr2=0x7faad80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.501+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 0x7faad80a58f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faae8009230 tx=0x7faae80058d0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.501+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 msgr2=0x7faaec100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.501+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d950 tx=0x7faadc00de10 comp rx=0 tx=0).stop 2024-09-15T22:57:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 shutdown_connections 2024-09-15T22:57:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faad80a3430 0x7faad80a58f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaec10c1a0 0x7faaec1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaec103720 0x7faaec100fa0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d950 tx=0x7faadc00de10 comp rx=0 tx=0).stop 2024-09-15T22:57:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 --2- 172.21.15.66:0/132740151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faaec102e00 0x7faaec100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.502+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 >> 172.21.15.66:0/132740151 conn(0x7faaec0fc7a0 msgr2=0x7faaec0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.507+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 shutdown_connections 2024-09-15T22:57:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:33.507+0000 7faaf4702640 1 -- 172.21.15.66:0/132740151 wait complete. 2024-09-15T22:57:34.290 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:34 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/132740151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:34.318 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 141.85 --await-for 45.0' 2024-09-15T22:57:34.318 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 141.85 --await-for 45.0 2024-09-15T22:57:34.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:34 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/132740151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:34.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:34 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/132740151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:34.588 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.168+0000 7f7f0e777640 1 -- 172.21.15.66:0/1005348150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 msgr2=0x7f7f0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.168+0000 7f7f0e777640 1 --2- 172.21.15.66:0/1005348150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f0810da40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009ca0 tx=0x7f7f0002a950 comp rx=0 tx=0).stop 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 -- 172.21.15.66:0/1005348150 shutdown_connections 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 --2- 172.21.15.66:0/1005348150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f0810da40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 --2- 172.21.15.66:0/1005348150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 0x7f7f081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 --2- 172.21.15.66:0/1005348150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 -- 172.21.15.66:0/1005348150 >> 172.21.15.66:0/1005348150 conn(0x7f7f080fc7d0 msgr2=0x7f7f080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:35.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 -- 172.21.15.66:0/1005348150 shutdown_connections 2024-09-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 -- 172.21.15.66:0/1005348150 wait complete. 2024-09-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 Processor -- start 2024-09-15T22:57:35.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.169+0000 7f7f0e777640 1 -- start start 2024-09-15T22:57:35.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 0x7f7f08199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08110f80 con 0x7f7f08102ef0 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08110e00 con 0x7f7f08100e20 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0e777640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08111100 con 0x7f7f08102570 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43276/0 (socket says 172.21.15.66:43276) 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 0x7f7f08199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 -- 172.21.15.66:0/2620909493 learned_addr learned my addr 172.21.15.66:0/2620909493 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 -- 172.21.15.66:0/2620909493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 msgr2=0x7f7f08199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 0x7f7f08199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 -- 172.21.15.66:0/2620909493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 msgr2=0x7f7f08199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 -- 172.21.15.66:0/2620909493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f081a47f0 con 0x7f7f08102ef0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.170+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7f00004af0 tx=0x7f7f0002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.171+0000 7f7f057fa640 1 -- 172.21.15.66:0/2620909493 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00034040 con 0x7f7f08102ef0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.171+0000 7f7f057fa640 1 -- 172.21.15.66:0/2620909493 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f00030920 con 0x7f7f08102ef0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.171+0000 7f7f057fa640 1 -- 172.21.15.66:0/2620909493 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00004740 con 0x7f7f08102ef0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.171+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f08197020 con 0x7f7f08102ef0 2024-09-15T22:57:35.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.171+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f081974f0 con 0x7f7f08102ef0 2024-09-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.173+0000 7f7f10b50740 1 Processor -- start 2024-09-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.173+0000 7f7f057fa640 1 -- 172.21.15.66:0/2620909493 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7f00037020 con 0x7f7f08102ef0 2024-09-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.173+0000 7f7f10b50740 1 -- start start 2024-09-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b1d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b2b6a77160 con 0x55b2b6b13170 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b2b6a1e720 con 0x55b2b6b12850 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f10b50740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b2b6a73120 con 0x55b2b6b1da30 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b1d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:50580/0 (socket says 172.21.15.66:50580) 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b1d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43280/0 (socket says 172.21.15.66:43280) 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 -- 172.21.15.66:0/2341590981 learned_addr learned my addr 172.21.15.66:0/2341590981 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 -- 172.21.15.66:0/2341590981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 msgr2=0x55b2b6b1fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 -- 172.21.15.66:0/2341590981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 msgr2=0x55b2b6b1d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b1d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 -- 172.21.15.66:0/2341590981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b67e8ba0 con 0x55b2b6b12850 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f057fa640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 0x7f7ef00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.174+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011740 tx=0x7f7efc00a6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba35a3d94662ded server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 0x7f7ef00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7eee7fc640 1 -- 172.21.15.66:0/2341590981 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005020 con 0x55b2b6b12850 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7f057fa640 1 -- 172.21.15.66:0/2620909493 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f7f000f0d90 con 0x7f7f08102ef0 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7eee7fc640 1 -- 172.21.15.66:0/2341590981 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7efc0047a0 con 0x55b2b6b12850 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7eee7fc640 1 -- 172.21.15.66:0/2341590981 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00fa20 con 0x55b2b6b12850 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7f10b50740 1 -- 172.21.15.66:0/2341590981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 msgr2=0x55b2b6b12c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 0x7f7ef00a58f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b2b6b0fc40 tx=0x7f7ef8012040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.175+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011740 tx=0x7f7efc00a6e0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 -- 172.21.15.66:0/2341590981 shutdown_connections 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b1d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2341590981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b12c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 -- 172.21.15.66:0/2341590981 >> 172.21.15.66:0/2341590981 conn(0x55b2b6b0ede0 msgr2=0x55b2b6b0f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 -- 172.21.15.66:0/2341590981 shutdown_connections 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 -- 172.21.15.66:0/2341590981 wait complete. 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 -- start start 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 Processor -- start 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.176+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b1a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b2b6b20600 con 0x55b2b6b1da30 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b2b69ff900 con 0x55b2b6b12850 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b2b6b20780 con 0x55b2b6b13170 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 10 client.0 _ll_register_callbacks cb 0x55b2b69fd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b1a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f0cd14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49210/0 (socket says 172.21.15.66:49210) 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 -- 172.21.15.66:0/2295690982 learned_addr learned my addr 172.21.15.66:0/2295690982 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 -- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 msgr2=0x55b2b6b1a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b1a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 -- 172.21.15.66:0/2295690982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b1da30 msgr2=0x55b2b6b1b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 -- 172.21.15.66:0/2295690982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b6a3fc50 con 0x55b2b6b13170 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b1a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f077fe640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005280 tx=0x7f7efc0052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5eb71859129ef7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7ee77fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f990 con 0x55b2b6b13170 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f7efc00fb30 con 0x55b2b6b13170 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.177+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7efc0047a0 con 0x55b2b6b13170 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f7efc005560 con 0x55b2b6b13170 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 10 client.27376 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:35.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b2b6b2c360 con 0x55b2b6b13170 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7efc0047a0 con 0x55b2b6b13170 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f7efc029b20 con 0x55b2b6b13170 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 10 client.27376 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 10 client.27376 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 20 client.27376 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b2d6b0 0x55b2b6b2faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 4 client.27376 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b6a84890 con 0x55b2b6b2d6b0 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.178+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b2d6b0 0x55b2b6b2faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.179+0000 7f7ee77fe640 10 client.27376 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.179+0000 7f7f07fff640 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b2d6b0 0x55b2b6b2faa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13cc990c6b75f913 server_cookie=341c3310fe492eaa in_seq=0 out_seq=0 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.179+0000 7f7ee77fe640 1 -- 172.21.15.66:0/2295690982 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2b6a84890 con 0x55b2b6b2d6b0 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.179+0000 7f7ee77fe640 10 client.27376 handle_command_reply: tid=0 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.179+0000 7f7f10b50740 1 client.27376 shutdown 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 msgr2=0x55b2b6b1aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005280 tx=0x7f7efc0052b0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 shutdown_connections 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b1da30 0x55b2b6b1b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b1aed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b2d6b0 0x55b2b6b2faa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 --2- 172.21.15.66:0/2295690982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b1a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 >> 172.21.15.66:0/2295690982 conn(0x55b2b6b0ede0 msgr2=0x55b2b6b14b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:35.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7ee77fe640 0 client.27376 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 shutdown_connections 2024-09-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 1 -- 172.21.15.66:0/2295690982 wait complete. 2024-09-15T22:57:35.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.180+0000 7f7f10b50740 20 client.27376 trim_cache size 0 max 16384 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 Processor -- start 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 -- start start 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b35720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 0x55b2b6b17bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081acf50 con 0x55b2b6b12850 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081aec10 con 0x55b2b6b1da30 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f10b50740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081ad6e0 con 0x55b2b6b13170 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43290/0 (socket says 172.21.15.66:43290) 2024-09-15T22:57:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f07fff640 1 -- 172.21.15.66:0/1820048791 learned_addr learned my addr 172.21.15.66:0/1820048791 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f077fe640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b35720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.197+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 0x55b2b6b17bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 -- 172.21.15.66:0/1820048791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 msgr2=0x55b2b6b35720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b35720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 -- 172.21.15.66:0/1820048791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 msgr2=0x55b2b6b17bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 0x55b2b6b17bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 -- 172.21.15.66:0/1820048791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b6b0a3f0 con 0x55b2b6b12850 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 0x55b2b6b17bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009fd0 tx=0x7f7ef801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d0750e1829c437 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7eedffb640 1 -- 172.21.15.66:0/1820048791 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004220 con 0x55b2b6b12850 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7eedffb640 1 -- 172.21.15.66:0/1820048791 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef8021040 con 0x55b2b6b12850 2024-09-15T22:57:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.198+0000 7f7eedffb640 1 -- 172.21.15.66:0/1820048791 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004bc0 con 0x55b2b6b12850 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- 172.21.15.66:0/1820048791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 msgr2=0x55b2b6b351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009fd0 tx=0x7f7ef801a000 comp rx=0 tx=0).stop 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- 172.21.15.66:0/1820048791 shutdown_connections 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b1da30 0x55b2b6b17bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b13170 0x55b2b6b35720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1820048791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b12850 0x55b2b6b351e0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- 172.21.15.66:0/1820048791 >> 172.21.15.66:0/1820048791 conn(0x55b2b6b0ede0 msgr2=0x55b2b6b19260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- 172.21.15.66:0/1820048791 shutdown_connections 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- 172.21.15.66:0/1820048791 wait complete. 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 -- start start 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.199+0000 7f7f10b50740 1 Processor -- start 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b21890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081ae540 con 0x55b2b6b13170 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081ade70 con 0x55b2b6b12850 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081aaf50 con 0x55b2b6b1da30 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f10b50740 10 client.0 _ll_register_callbacks cb 0x7f7ef8010d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43298/0 (socket says 172.21.15.66:43298) 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 -- 172.21.15.66:0/1766470986 learned_addr learned my addr 172.21.15.66:0/1766470986 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:35.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b21890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f0cd14640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 -- 172.21.15.66:0/1766470986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 msgr2=0x55b2b6b22310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b22310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 -- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 msgr2=0x55b2b6b21890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b21890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 -- 172.21.15.66:0/1766470986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b6b0fa70 con 0x55b2b6b13170 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b21890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7f077fe640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x55b2b6b1bfd0 tx=0x7f7efc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f675a46af12816df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7ee77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00aa30 con 0x55b2b6b13170 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.200+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f7efc005560 con 0x55b2b6b13170 2024-09-15T22:57:35.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef8021040 con 0x55b2b6b13170 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f7efc041050 con 0x55b2b6b13170 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 10 client.18138 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b2b6b0fe90 con 0x55b2b6b13170 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef8021040 con 0x55b2b6b13170 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f7efc029480 con 0x55b2b6b13170 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 10 client.18138 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 10 client.18138 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 20 client.18138 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b989a0 0x55b2b6b9adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 4 client.18138 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.85, "await_for": 45.0}] 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.85, "await_for": 45.0}) -- 0x55b2b6a7ebe0 con 0x55b2b6b989a0 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.201+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b989a0 0x55b2b6b9adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:35.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.202+0000 7f7f07fff640 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b989a0 0x55b2b6b9adc0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6293be501c93bb server_cookie=7754f3eaf762cde in_seq=0 out_seq=0 2024-09-15T22:57:35.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:35.202+0000 7f7ee77fe640 10 client.18138 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:35 smithi087 ceph-mon[35290]: pgmap v381: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 460 KiB/s wr, 186 op/s 2024-09-15T22:57:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:35 smithi184 ceph-mon[35203]: pgmap v381: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 460 KiB/s wr, 186 op/s 2024-09-15T22:57:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:35 smithi066 ceph-mon[31185]: pgmap v381: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 460 KiB/s wr, 186 op/s 2024-09-15T22:57:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:37 smithi087 ceph-mon[35290]: pgmap v382: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 403 KiB/s wr, 173 op/s 2024-09-15T22:57:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:37 smithi184 ceph-mon[35203]: pgmap v382: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 403 KiB/s wr, 173 op/s 2024-09-15T22:57:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:37 smithi066 ceph-mon[31185]: pgmap v382: 129 pgs: 129 active+clean; 2.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 403 KiB/s wr, 173 op/s 2024-09-15T22:57:39.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:39 smithi066 ceph-mon[31185]: pgmap v383: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 409 KiB/s wr, 196 op/s 2024-09-15T22:57:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:39 smithi087 ceph-mon[35290]: pgmap v383: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 409 KiB/s wr, 196 op/s 2024-09-15T22:57:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:39 smithi184 ceph-mon[35203]: pgmap v383: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 409 KiB/s wr, 196 op/s 2024-09-15T22:57:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:40 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:57:40.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:40 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:57:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:40 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:57:40.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:40 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:57:40.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:40 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:57:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:40 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:57:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:41 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:57:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:41 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:57:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:41 smithi087 ceph-mon[35290]: pgmap v384: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 740 KiB/s wr, 226 op/s 2024-09-15T22:57:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:41 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:57:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:41 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:57:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:41 smithi184 ceph-mon[35203]: pgmap v384: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 740 KiB/s wr, 226 op/s 2024-09-15T22:57:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:41 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:57:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:41 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:57:41.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:41 smithi066 ceph-mon[31185]: pgmap v384: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 740 KiB/s wr, 226 op/s 2024-09-15T22:57:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:43 smithi087 ceph-mon[35290]: pgmap v385: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 744 KiB/s wr, 214 op/s 2024-09-15T22:57:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:43 smithi184 ceph-mon[35203]: pgmap v385: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 744 KiB/s wr, 214 op/s 2024-09-15T22:57:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:43 smithi066 ceph-mon[31185]: pgmap v385: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 744 KiB/s wr, 214 op/s 2024-09-15T22:57:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:45 smithi087 ceph-mon[35290]: pgmap v386: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 789 KiB/s wr, 157 op/s 2024-09-15T22:57:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:45 smithi184 ceph-mon[35203]: pgmap v386: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 789 KiB/s wr, 157 op/s 2024-09-15T22:57:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:45 smithi066 ceph-mon[31185]: pgmap v386: 129 pgs: 129 active+clean; 2.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 789 KiB/s wr, 157 op/s 2024-09-15T22:57:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7ee77fe640 1 -- 172.21.15.66:0/1766470986 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b2b6a7ebe0 con 0x55b2b6b989a0 2024-09-15T22:57:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7ee77fe640 10 client.18138 handle_command_reply: tid=0 2024-09-15T22:57:47.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 client.18138 shutdown 2024-09-15T22:57:47.002 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 54, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 42, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "3d191ac1": { 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 42, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:57:47.003 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 141.8, 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:47.004 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 msgr2=0x55b2b6b21dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x55b2b6b1bfd0 tx=0x7f7efc005850 comp rx=0 tx=0).stop 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 shutdown_connections 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b2b6b1da30 0x55b2b6b22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b2b6b13170 0x55b2b6b21dd0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b2b6b989a0 0x55b2b6b9adc0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 --2- 172.21.15.66:0/1766470986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b2b6b12850 0x55b2b6b21890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7ee77fe640 0 client.18138 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:47.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 >> 172.21.15.66:0/1766470986 conn(0x55b2b6b0ede0 msgr2=0x55b2b6b1a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 shutdown_connections 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 1 -- 172.21.15.66:0/1766470986 wait complete. 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.000+0000 7f7f10b50740 20 client.18138 trim_cache size 0 max 16384 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 msgr2=0x7f7ef00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 0x7f7ef00a58f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b2b6b0fc40 tx=0x7f7ef8012040 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 msgr2=0x7f7f081a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7f00004af0 tx=0x7f7f0002f5b0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 shutdown_connections 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7ef00a3430 0x7f7ef00a58f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f08102ef0 0x7f7f081a42b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f08102570 0x7f7f08199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 --2- 172.21.15.66:0/2620909493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f08100e20 0x7f7f08199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:47.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.001+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 >> 172.21.15.66:0/2620909493 conn(0x7f7f080fc7d0 msgr2=0x7f7f081067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.002+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 shutdown_connections 2024-09-15T22:57:47.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:47.002+0000 7f7f0e777640 1 -- 172.21.15.66:0/2620909493 wait complete. 2024-09-15T22:57:47.333 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:47 smithi066 ceph-mon[31185]: pgmap v387: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 412 KiB/s wr, 96 op/s 2024-09-15T22:57:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:47 smithi087 ceph-mon[35290]: pgmap v387: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 412 KiB/s wr, 96 op/s 2024-09-15T22:57:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:47 smithi184 ceph-mon[35203]: pgmap v387: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 412 KiB/s wr, 96 op/s 2024-09-15T22:57:47.912 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3d191ac1', quiesce took 15.5 seconds. Will release after: 6.350000000000001 2024-09-15T22:57:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:49 smithi087 ceph-mon[35290]: pgmap v388: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 401 KiB/s wr, 86 op/s 2024-09-15T22:57:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:49 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:57:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:49 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:57:49.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:49 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:57:49.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:49 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:57:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:49 smithi184 ceph-mon[35203]: pgmap v388: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 401 KiB/s wr, 86 op/s 2024-09-15T22:57:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:49 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:57:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:49 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:57:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:49 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:57:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:49 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:57:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:49 smithi066 ceph-mon[31185]: pgmap v388: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 401 KiB/s wr, 86 op/s 2024-09-15T22:57:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:49 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:57:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:49 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:57:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:49 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:57:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:49 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:57:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:51 smithi087 ceph-mon[35290]: pgmap v389: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 391 KiB/s wr, 63 op/s 2024-09-15T22:57:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:51 smithi184 ceph-mon[35203]: pgmap v389: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 391 KiB/s wr, 63 op/s 2024-09-15T22:57:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:51 smithi066 ceph-mon[31185]: pgmap v389: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 391 KiB/s wr, 63 op/s 2024-09-15T22:57:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:53 smithi087 ceph-mon[35290]: pgmap v390: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-15T22:57:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:53 smithi184 ceph-mon[35203]: pgmap v390: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-15T22:57:53.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:53 smithi066 ceph-mon[31185]: pgmap v390: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-15T22:57:54.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:57:54.537 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:55.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 -- 172.21.15.66:0/1174051488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa010c170 msgr2=0x7f9fa010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 --2- 172.21.15.66:0/1174051488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa010c170 0x7f9fa010e610 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009ca0 tx=0x7f9f9802a950 comp rx=0 tx=0).stop 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 -- 172.21.15.66:0/1174051488 shutdown_connections 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 --2- 172.21.15.66:0/1174051488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa010c170 0x7f9fa010e610 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 --2- 172.21.15.66:0/1174051488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa0103660 0x7f9fa010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 --2- 172.21.15.66:0/1174051488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0102d40 0x7f9fa0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 -- 172.21.15.66:0/1174051488 >> 172.21.15.66:0/1174051488 conn(0x7f9fa00fc7a0 msgr2=0x7f9fa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 -- 172.21.15.66:0/1174051488 shutdown_connections 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.014+0000 7f9fa814f640 1 -- 172.21.15.66:0/1174051488 wait complete. 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 Processor -- start 2024-09-15T22:57:55.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 -- start start 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0103660 0x7f9fa0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa010c170 0x7f9fa019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0111f30 con 0x7f9fa0102d40 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0111db0 con 0x7f9fa0103660 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.015+0000 7f9fa814f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01120b0 con 0x7f9fa010c170 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57318/0 (socket says 172.21.15.66:57318) 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 -- 172.21.15.66:0/2669547306 learned_addr learned my addr 172.21.15.66:0/2669547306 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa56ea640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0103660 0x7f9fa0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa66ec640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa010c170 0x7f9fa019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 -- 172.21.15.66:0/2669547306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa010c170 msgr2=0x7f9fa019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa010c170 0x7f9fa019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 -- 172.21.15.66:0/2669547306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0103660 msgr2=0x7f9fa0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0103660 0x7f9fa0198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 -- 172.21.15.66:0/2669547306 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa019d2e0 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9fa5eeb640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c920 tx=0x7f9f9c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.016+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c007c70 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.017+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa019d5d0 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.017+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9c007e10 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.017+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c018890 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.017+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa01a4eb0 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.018+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0103120 con 0x7f9fa0102d40 2024-09-15T22:57:55.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.019+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9f9c018a70 con 0x7f9fa0102d40 2024-09-15T22:57:55.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.020+0000 7f9f96ffd640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 0x7f9f8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:55.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.020+0000 7f9fa56ea640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 0x7f9f8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:55.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.020+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f9f9c0d01f0 con 0x7f9fa0102d40 2024-09-15T22:57:55.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.020+0000 7f9fa56ea640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 0x7f9f8c0a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fa010ea60 tx=0x7f9f9000a250 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:55.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.025+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f9c014030 con 0x7f9fa0102d40 2024-09-15T22:57:55.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:55 smithi066 ceph-mon[31185]: pgmap v391: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-15T22:57:55.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.263+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa01a5080 con 0x7f9fa0102d40 2024-09-15T22:57:55.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.263+0000 7f9f96ffd640 1 -- 172.21.15.66:0/2669547306 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11988 (secure 0 0 0) 0x7f9f9c09c7a0 con 0x7f9fa0102d40 2024-09-15T22:57:55.266 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:57:55.266 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"btime":"2024-09-15T22:57:07:882300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:07.497310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:57:55.266 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 msgr2=0x7f9f8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 0x7f9f8c0a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fa010ea60 tx=0x7f9f9000a250 comp rx=0 tx=0).stop 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 msgr2=0x7f9fa0198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c920 tx=0x7f9f9c00cde0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 shutdown_connections 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f8c0a33b0 0x7f9f8c0a5870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fa010c170 0x7f9fa019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa0103660 0x7f9fa0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 --2- 172.21.15.66:0/2669547306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fa0102d40 0x7f9fa0198330 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:55.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 >> 172.21.15.66:0/2669547306 conn(0x7f9fa00fc7a0 msgr2=0x7f9fa00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:55.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 shutdown_connections 2024-09-15T22:57:55.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:55.266+0000 7f9fa814f640 1 -- 172.21.15.66:0/2669547306 wait complete. 2024-09-15T22:57:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:55 smithi087 ceph-mon[35290]: pgmap v391: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-15T22:57:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:55 smithi184 ceph-mon[35203]: pgmap v391: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-15T22:57:55.932 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 3d191ac1 --release --await' 2024-09-15T22:57:55.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 3d191ac1 --release --await 2024-09-15T22:57:56.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2669547306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:56.203 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:57:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2669547306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2669547306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 -- 172.21.15.66:0/1875104203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d8103660 msgr2=0x7ff5d810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 --2- 172.21.15.66:0/1875104203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d8103660 0x7ff5d810bb50 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009900 tx=0x7ff5cc02a480 comp rx=0 tx=0).stop 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 -- 172.21.15.66:0/1875104203 shutdown_connections 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 --2- 172.21.15.66:0/1875104203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d810c170 0x7ff5d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 --2- 172.21.15.66:0/1875104203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d8103660 0x7ff5d810bb50 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 --2- 172.21.15.66:0/1875104203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8102d40 0x7ff5d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 -- 172.21.15.66:0/1875104203 >> 172.21.15.66:0/1875104203 conn(0x7ff5d80fc7a0 msgr2=0x7ff5d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 -- 172.21.15.66:0/1875104203 shutdown_connections 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.687+0000 7ff5de549640 1 -- 172.21.15.66:0/1875104203 wait complete. 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 Processor -- start 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 -- start start 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d8102d40 0x7ff5d81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8103660 0x7ff5d8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8111f70 con 0x7ff5d810c170 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d8111df0 con 0x7ff5d8102d40 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5de549640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81120f0 con 0x7ff5d8103660 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5dcae6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5dcae6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57348/0 (socket says 172.21.15.66:57348) 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5dcae6640 1 -- 172.21.15.66:0/497824814 learned_addr learned my addr 172.21.15.66:0/497824814 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d8102d40 0x7ff5d81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.688+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8103660 0x7ff5d8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 -- 172.21.15.66:0/497824814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8103660 msgr2=0x7ff5d8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8103660 0x7ff5d8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 -- 172.21.15.66:0/497824814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d8102d40 msgr2=0x7ff5d81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d8102d40 0x7ff5d81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 -- 172.21.15.66:0/497824814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d81a68d0 con 0x7ff5d810c170 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5dcae6640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000cad0 tx=0x7ff5d000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5d57fa640 1 -- 172.21.15.66:0/497824814 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000ad60 con 0x7ff5d810c170 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5d57fa640 1 -- 172.21.15.66:0/497824814 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5d0005020 con 0x7ff5d810c170 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d81a6bc0 con 0x7ff5d810c170 2024-09-15T22:57:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5d57fa640 1 -- 172.21.15.66:0/497824814 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000f6b0 con 0x7ff5d810c170 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.689+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d81a70d0 con 0x7ff5d810c170 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.691+0000 7ff5d57fa640 1 -- 172.21.15.66:0/497824814 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff5d0005560 con 0x7ff5d810c170 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 Processor -- start 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 -- start start 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x563116410440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x56311641d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563116375620 con 0x563116410980 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56311631ce50 con 0x563116410060 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5e0922740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5631163715e0 con 0x56311641b240 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d57fa640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 0x7ff5c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57352/0 (socket says 172.21.15.66:57352) 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 -- 172.21.15.66:0/452285856 learned_addr learned my addr 172.21.15.66:0/452285856 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x563116410440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5dcae6640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 0x7ff5c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x56311641d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d57fa640 1 -- 172.21.15.66:0/497824814 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff5d00d0030 con 0x7ff5d810c170 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 -- 172.21.15.66:0/452285856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 msgr2=0x56311641d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x56311641d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 -- 172.21.15.66:0/452285856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 msgr2=0x563116410440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x563116410440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d7fff640 1 -- 172.21.15.66:0/452285856 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311630dd40 con 0x563116410980 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.692+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x56311641d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:57:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.693+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ad00 tx=0x7ff5c800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcef708b23fd170 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.693+0000 7ff5dcae6640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 0x7ff5c00a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000a620 tx=0x7ff5d00a0040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.693+0000 7ff5be7fc640 1 -- 172.21.15.66:0/452285856 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c801d070 con 0x563116410980 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.693+0000 7ff5be7fc640 1 -- 172.21.15.66:0/452285856 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c8018b20 con 0x563116410980 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.693+0000 7ff5be7fc640 1 -- 172.21.15.66:0/452285856 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8010c20 con 0x563116410980 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- 172.21.15.66:0/452285856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 msgr2=0x56311641ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ad00 tx=0x7ff5c800f790 comp rx=0 tx=0).stop 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- 172.21.15.66:0/452285856 shutdown_connections 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x56311641d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x56311641ad00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- 172.21.15.66:0/452285856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x563116410440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- 172.21.15.66:0/452285856 >> 172.21.15.66:0/452285856 conn(0x56311640c5f0 msgr2=0x56311640c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- 172.21.15.66:0/452285856 shutdown_connections 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- 172.21.15.66:0/452285856 wait complete. 2024-09-15T22:57:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 -- start start 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 Processor -- start 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410060 0x563116418190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410980 0x5631164186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.694+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56311641de10 con 0x56311641b240 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5631162fdf10 con 0x563116410980 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56311641df90 con 0x563116410060 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 10 client.0 _ll_register_callbacks cb 0x563116321db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57358/0 (socket says 172.21.15.66:57358) 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 -- 172.21.15.66:0/2414345467 learned_addr learned my addr 172.21.15.66:0/2414345467 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410980 0x5631164186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410060 0x563116418190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 -- 172.21.15.66:0/2414345467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410060 msgr2=0x563116418190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410060 0x563116418190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 -- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410980 msgr2=0x5631164186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410980 0x5631164186d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 -- 172.21.15.66:0/2414345467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563116084580 con 0x56311641b240 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009900 tx=0x7ff5cc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69fa26b7a44be17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc035040 con 0x56311641b240 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff5cc005020 con 0x56311641b240 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c8018b20 con 0x56311641b240 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff5cc052050 con 0x56311641b240 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 10 client.18156 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:56.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.695+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56311614e960 con 0x56311641b240 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c8018b20 con 0x56311641b240 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7ff5cc0035f0 con 0x56311641b240 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 10 client.18156 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 10 client.18156 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 20 client.18156 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56311642ad60 0x56311642d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 4 client.18156 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563116382b90 con 0x56311642ad60 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.696+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56311642ad60 0x56311642d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.697+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56311642ad60 0x56311642d190 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=889fdecd4d3ba5f1 server_cookie=2f5a2f9e56709330 in_seq=0 out_seq=0 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.697+0000 7ff5b77fe640 10 client.18156 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.697+0000 7ff5b77fe640 1 -- 172.21.15.66:0/2414345467 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563116382b90 con 0x56311642ad60 2024-09-15T22:57:56.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.697+0000 7ff5b77fe640 10 client.18156 handle_command_reply: tid=0 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.697+0000 7ff5e0922740 1 client.18156 shutdown 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 msgr2=0x563116418c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009900 tx=0x7ff5cc02a480 comp rx=0 tx=0).stop 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 shutdown_connections 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56311641b240 0x563116418c10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56311642ad60 0x56311642d190 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410980 0x5631164186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 --2- 172.21.15.66:0/2414345467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410060 0x563116418190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5b77fe640 0 client.18156 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 >> 172.21.15.66:0/2414345467 conn(0x56311640c5f0 msgr2=0x56311640b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 shutdown_connections 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 1 -- 172.21.15.66:0/2414345467 wait complete. 2024-09-15T22:57:56.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.698+0000 7ff5e0922740 20 client.18156 trim_cache size 0 max 16384 2024-09-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 Processor -- start 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 -- start start 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x56311641a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x563116432a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81b13e0 con 0x563116410980 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81b30a0 con 0x563116410060 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5e0922740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81b1b70 con 0x56311641b240 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57374/0 (socket says 172.21.15.66:57374) 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 -- 172.21.15.66:0/3761841516 learned_addr learned my addr 172.21.15.66:0/3761841516 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x56311641a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x563116432a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 -- 172.21.15.66:0/3761841516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 msgr2=0x563116432a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x563116432a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 -- 172.21.15.66:0/3761841516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 msgr2=0x56311641a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x56311641a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d7fff640 1 -- 172.21.15.66:0/3761841516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631164107b0 con 0x563116410980 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.715+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x563116432a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.716+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800aac0 tx=0x7ff5c80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f9499ab4edbf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.716+0000 7ff5bdffb640 1 -- 172.21.15.66:0/3761841516 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c801d040 con 0x563116410980 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.716+0000 7ff5bdffb640 1 -- 172.21.15.66:0/3761841516 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c800a730 con 0x563116410980 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.716+0000 7ff5bdffb640 1 -- 172.21.15.66:0/3761841516 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80186a0 con 0x563116410980 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- 172.21.15.66:0/3761841516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 msgr2=0x563116412ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800aac0 tx=0x7ff5c80107a0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- 172.21.15.66:0/3761841516 shutdown_connections 2024-09-15T22:57:56.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56311641b240 0x563116432a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410980 0x563116412ac0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- 172.21.15.66:0/3761841516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563116410060 0x56311641a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- 172.21.15.66:0/3761841516 >> 172.21.15.66:0/3761841516 conn(0x56311640c5f0 msgr2=0x56311640b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- 172.21.15.66:0/3761841516 shutdown_connections 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- 172.21.15.66:0/3761841516 wait complete. 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 -- start start 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 Processor -- start 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410980 0x563116420010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.717+0000 7ff5e0922740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56311641b240 0x56311648d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5e0922740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81b29d0 con 0x563116410060 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5e0922740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81b2300 con 0x56311641b240 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5e0922740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d81af3e0 con 0x563116410980 2024-09-15T22:57:56.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5e0922740 10 client.0 _ll_register_callbacks cb 0x7ff5cc0315f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57380/0 (socket says 172.21.15.66:57380) 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 -- 172.21.15.66:0/879936607 learned_addr learned my addr 172.21.15.66:0/879936607 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410980 0x563116420010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56311641b240 0x56311648d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 -- 172.21.15.66:0/879936607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410980 msgr2=0x563116420010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410980 0x563116420010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 -- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56311641b240 msgr2=0x56311648d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56311641b240 0x56311648d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 -- 172.21.15.66:0/879936607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311648e0b0 con 0x563116410060 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5d77fe640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x5631164111a0 tx=0x7ff5cc009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a38d3f52916c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:57:56.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc035040 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff5cc005020 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.718+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c800a730 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff5cc0037f0 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 10 client.18162 fetch_fsmap learned FSMap version 54 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x563116496520 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c800a730 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7ff5cc004bf0 con 0x563116410060 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 10 client.18162 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 10 client.18162 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 20 client.18162 populate_metadata read hostname 'smithi066' 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563116496be0 0x563116499000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 4 client.18162 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3d191ac1", "release": true, "await": true}] 2024-09-15T22:57:56.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3d191ac1", "release": true, "await": true}) -- 0x563116407950 con 0x563116496be0 2024-09-15T22:57:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.719+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563116496be0 0x563116499000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:57:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.720+0000 7ff5b77fe640 10 client.18162 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:56.720+0000 7ff5d7fff640 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563116496be0 0x563116499000 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=807bfc861611e012 server_cookie=7a3d9ec95e12c861 in_seq=0 out_seq=0 2024-09-15T22:57:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:57 smithi087 ceph-mon[35290]: pgmap v392: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-15T22:57:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:57 smithi184 ceph-mon[35203]: pgmap v392: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-15T22:57:57.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:57 smithi066 ceph-mon[31185]: pgmap v392: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5b77fe640 1 -- 172.21.15.66:0/879936607 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563116407950 con 0x563116496be0 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5b77fe640 10 client.18162 handle_command_reply: tid=0 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 client.18162 shutdown 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 msgr2=0x56311641fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x5631164111a0 tx=0x7ff5cc009640 comp rx=0 tx=0).stop 2024-09-15T22:57:57.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 shutdown_connections 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563116496be0 0x563116499000 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56311641b240 0x56311648d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5b77fe640 0 client.18162 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563116410980 0x563116420010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 --2- 172.21.15.66:0/879936607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563116410060 0x56311641fad0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 >> 172.21.15.66:0/879936607 conn(0x56311640c5f0 msgr2=0x56311640af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 shutdown_connections 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 1 -- 172.21.15.66:0/879936607 wait complete. 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.548+0000 7ff5e0922740 20 client.18162 trim_cache size 0 max 16384 2024-09-15T22:57:57.551 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 54, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 44, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "3d191ac1": { 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 44, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:57:57.552 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 141.8, 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:57:57.553 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 msgr2=0x7ff5c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 0x7ff5c00a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000a620 tx=0x7ff5d00a0040 comp rx=0 tx=0).stop 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 msgr2=0x7ff5d8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000cad0 tx=0x7ff5d000ced0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 shutdown_connections 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5c00a3430 0x7ff5c00a58f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d810c170 0x7ff5d8101420 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d8103660 0x7ff5d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 --2- 172.21.15.66:0/497824814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d8102d40 0x7ff5d81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:57:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 >> 172.21.15.66:0/497824814 conn(0x7ff5d80fc7a0 msgr2=0x7ff5d80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:57:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 shutdown_connections 2024-09-15T22:57:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:57:57.549+0000 7ff5de549640 1 -- 172.21.15.66:0/497824814 wait complete. 2024-09-15T22:57:58.216 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3d191ac1', total seconds elapsed: 25.8 2024-09-15T22:57:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:57:59 smithi087 ceph-mon[35290]: pgmap v393: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-15T22:57:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:57:59 smithi184 ceph-mon[35203]: pgmap v393: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-15T22:57:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:57:59 smithi066 ceph-mon[31185]: pgmap v393: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-15T22:58:00.120 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:58:00.456 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:01.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.004+0000 7f9f1aab9640 1 -- 172.21.15.66:0/2878040147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108450 msgr2=0x7f9f14108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.004+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/2878040147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108450 0x7f9f14108830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009900 tx=0x7f9f0802a400 comp rx=0 tx=0).stop 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 -- 172.21.15.66:0/2878040147 shutdown_connections 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/2878040147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f1410d530 0x7f9f141150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/2878040147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f14108e00 0x7f9f1410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/2878040147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108450 0x7f9f14108830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 -- 172.21.15.66:0/2878040147 >> 172.21.15.66:0/2878040147 conn(0x7f9f14077ba0 msgr2=0x7f9f14079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 -- 172.21.15.66:0/2878040147 shutdown_connections 2024-09-15T22:58:01.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.005+0000 7f9f1aab9640 1 -- 172.21.15.66:0/2878040147 wait complete. 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.006+0000 7f9f1aab9640 1 Processor -- start 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.006+0000 7f9f1aab9640 1 -- start start 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 0x7f9f141a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f1410d530 0x7f9f1419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14118580 con 0x7f9f14108450 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f18855640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f18855640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57402/0 (socket says 172.21.15.66:57402) 2024-09-15T22:58:01.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f18855640 1 -- 172.21.15.66:0/3326737241 learned_addr learned my addr 172.21.15.66:0/3326737241 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:01.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14118400 con 0x7f9f1410d530 2024-09-15T22:58:01.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.007+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14118700 con 0x7f9f14108e00 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 0x7f9f141a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f19056640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f1410d530 0x7f9f1419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 -- 172.21.15.66:0/3326737241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 msgr2=0x7f9f141a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 0x7f9f141a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 -- 172.21.15.66:0/3326737241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f1410d530 msgr2=0x7f9f1419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f1410d530 0x7f9f1419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 -- 172.21.15.66:0/3326737241 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1419eff0 con 0x7f9f14108450 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 0x7f9f141a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.008+0000 7f9f18855640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004770 tx=0x7f9f08003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.009+0000 7f9f11ffb640 1 -- 172.21.15.66:0/3326737241 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0803f070 con 0x7f9f14108450 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.009+0000 7f9f11ffb640 1 -- 172.21.15.66:0/3326737241 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08031ca0 con 0x7f9f14108450 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.009+0000 7f9f11ffb640 1 -- 172.21.15.66:0/3326737241 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08035030 con 0x7f9f14108450 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.009+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1419f280 con 0x7f9f14108450 2024-09-15T22:58:01.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.009+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1419f650 con 0x7f9f14108450 2024-09-15T22:58:01.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.013+0000 7f9f11ffb640 1 -- 172.21.15.66:0/3326737241 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9f08042070 con 0x7f9f14108450 2024-09-15T22:58:01.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.014+0000 7f9f11ffb640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 0x7f9f040a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 Processor -- start 2024-09-15T22:58:01.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 -- start start 2024-09-15T22:58:01.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd08880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd15a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563f2cc6e2e0 con 0x563f2cd13680 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563f2cc15ce0 con 0x563f2cd08dc0 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.015+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563f2cc6a2a0 con 0x563f2cd084a0 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 0x7f9f040a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37954/0 (socket says 172.21.15.66:37954) 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 -- 172.21.15.66:0/3501110713 learned_addr learned my addr 172.21.15.66:0/3501110713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f19056640 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd15a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 -- 172.21.15.66:0/3501110713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 msgr2=0x563f2cd08880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd08880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 -- 172.21.15.66:0/3501110713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 msgr2=0x563f2cd15a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd15a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.016+0000 7f9f13fff640 1 -- 172.21.15.66:0/3501110713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2cbfa440 con 0x563f2cd08dc0 2024-09-15T22:58:01.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.018+0000 7f9f11ffb640 1 -- 172.21.15.66:0/3326737241 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f9f080f09d0 con 0x7f9f14108450 2024-09-15T22:58:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.019+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cf0 tx=0x7f9f000117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3215d969a8c7a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.019+0000 7f9f13fff640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 0x7f9f040a5970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9f00013000 tx=0x7f9f0001c000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.019+0000 7f9efeffd640 1 -- 172.21.15.66:0/3501110713 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00023070 con 0x563f2cd08dc0 2024-09-15T22:58:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.019+0000 7f9efeffd640 1 -- 172.21.15.66:0/3501110713 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f00014640 con 0x563f2cd08dc0 2024-09-15T22:58:01.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.019+0000 7f9efeffd640 1 -- 172.21.15.66:0/3501110713 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000035f0 con 0x563f2cd08dc0 2024-09-15T22:58:01.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 -- 172.21.15.66:0/3501110713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 msgr2=0x563f2cd13140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cf0 tx=0x7f9f000117b0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 -- 172.21.15.66:0/3501110713 shutdown_connections 2024-09-15T22:58:01.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd15a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd08dc0 0x563f2cd13140 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cf0 tx=0x7f9f000117b0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/3501110713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd08880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.020+0000 7f9f1ce92740 1 -- 172.21.15.66:0/3501110713 >> 172.21.15.66:0/3501110713 conn(0x563f2cd04a30 msgr2=0x563f2cd04e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.021+0000 7f9f1ce92740 1 -- 172.21.15.66:0/3501110713 shutdown_connections 2024-09-15T22:58:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.022+0000 7f9f1ce92740 1 -- 172.21.15.66:0/3501110713 wait complete. 2024-09-15T22:58:01.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.022+0000 7f9f1ce92740 1 -- start start 2024-09-15T22:58:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 Processor -- start 2024-09-15T22:58:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd104c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd10f40 0x563f2cd306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563f2cd16250 con 0x563f2cd13680 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563f2cc29050 con 0x563f2cd10f40 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563f2cd163d0 con 0x563f2cd084a0 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57418/0 (socket says 172.21.15.66:57418) 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.023+0000 7f9f13fff640 1 -- 172.21.15.66:0/1242792695 learned_addr learned my addr 172.21.15.66:0/1242792695 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f13fff640 1 -- 172.21.15.66:0/1242792695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 msgr2=0x563f2cd104c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f13fff640 1 -- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd10f40 msgr2=0x563f2cd306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd10f40 0x563f2cd306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f13fff640 1 -- 172.21.15.66:0/1242792695 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2c9df3c0 con 0x563f2cd13680 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.025+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cc0 tx=0x7f9f00014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd30cd3d295f96b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.024+0000 7f9f1ce92740 10 client.0 _ll_register_callbacks cb 0x563f2cc69160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.025+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f00014640 con 0x563f2cd13680 2024-09-15T22:58:01.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.025+0000 7f9ef3fff640 10 client.18174 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.027+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1242792695 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0002c070 con 0x563f2cd13680 2024-09-15T22:58:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.027+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1242792695 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f9f00005230 con 0x563f2cd13680 2024-09-15T22:58:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.028+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1242792695 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f9f00038050 con 0x563f2cd13680 2024-09-15T22:58:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.028+0000 7f9f1ce92740 10 client.18174 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:01.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.028+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=54}) -- 0x563f2cd33100 con 0x563f2cd13680 2024-09-15T22:58:01.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1242792695 <== mon.0 v2:172.21.15.66:3300/0 4 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f9f0001d040 con 0x563f2cd13680 2024-09-15T22:58:01.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 10 client.18174 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 10 client.18174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 20 client.18174 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd34900 0x563f2cd36dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 4 client.18174 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.029+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f2cc7b850 con 0x563f2cd34900 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.030+0000 7f9f18855640 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd34900 0x563f2cd36dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.030+0000 7f9f18855640 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd34900 0x563f2cd36dc0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f3e2c9d38cf9adb server_cookie=651e4b2dbb3bb39e in_seq=0 out_seq=0 2024-09-15T22:58:01.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.030+0000 7f9ef3fff640 10 client.18174 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:01.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1242792695 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f2cc7b850 con 0x563f2cd34900 2024-09-15T22:58:01.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9ef3fff640 10 client.18174 handle_command_reply: tid=0 2024-09-15T22:58:01.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9f1ce92740 1 client.18174 shutdown 2024-09-15T22:58:01.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 msgr2=0x563f2cd10a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cc0 tx=0x7f9f00014830 comp rx=0 tx=0).stop 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 shutdown_connections 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.031+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd34900 0x563f2cd36dc0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd10f40 0x563f2cd306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd10a00 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1242792695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd084a0 0x563f2cd104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 >> 172.21.15.66:0/1242792695 conn(0x563f2cd04a30 msgr2=0x563f2cd0a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9ef3fff640 0 client.18174 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 shutdown_connections 2024-09-15T22:58:01.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.032+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1242792695 wait complete. 2024-09-15T22:58:01.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.033+0000 7f9f1ce92740 20 client.18174 trim_cache size 0 max 16384 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 Processor -- start 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 -- start start 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd30540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd10f40 0x563f2cd30a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141ad030 con 0x563f2cd13680 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141aecf0 con 0x563f2cd084a0 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141ad7c0 con 0x563f2cd10f40 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f18855640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd30540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f18855640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd30540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37978/0 (socket says 172.21.15.66:37978) 2024-09-15T22:58:01.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f18855640 1 -- 172.21.15.66:0/940321691 learned_addr learned my addr 172.21.15.66:0/940321691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:01.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.067+0000 7f9f13fff640 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd10f40 0x563f2cd30a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 -- 172.21.15.66:0/940321691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd10f40 msgr2=0x563f2cd30a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd10f40 0x563f2cd30a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 -- 172.21.15.66:0/940321691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 msgr2=0x563f2cd30540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd30540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.068+0000 7f9f19056640 1 -- 172.21.15.66:0/940321691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2cd0f470 con 0x563f2cd13680 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.069+0000 7f9f19056640 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd3c6d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x563f2cd05db0 tx=0x7f9f0c0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee10dd6d7232d07c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.069+0000 7f9efe7fc640 1 -- 172.21.15.66:0/940321691 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c004d20 con 0x563f2cd13680 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.069+0000 7f9efe7fc640 1 -- 172.21.15.66:0/940321691 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f0c005500 con 0x563f2cd13680 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.069+0000 7f9efe7fc640 1 -- 172.21.15.66:0/940321691 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c010ad0 con 0x563f2cd13680 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.070+0000 7f9f1ce92740 1 -- 172.21.15.66:0/940321691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 msgr2=0x563f2cd3c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.070+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd3c6d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x563f2cd05db0 tx=0x7f9f0c0127c0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.071+0000 7f9f1ce92740 1 -- 172.21.15.66:0/940321691 shutdown_connections 2024-09-15T22:58:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.071+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd13680 0x563f2cd3c6d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.071+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd10f40 0x563f2cd30a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.071+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/940321691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd30540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.071+0000 7f9f1ce92740 1 -- 172.21.15.66:0/940321691 >> 172.21.15.66:0/940321691 conn(0x563f2cd04a30 msgr2=0x563f2cd12540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.072+0000 7f9f1ce92740 1 -- 172.21.15.66:0/940321691 shutdown_connections 2024-09-15T22:58:01.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.072+0000 7f9f1ce92740 1 -- 172.21.15.66:0/940321691 wait complete. 2024-09-15T22:58:01.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.072+0000 7f9f1ce92740 1 -- start start 2024-09-15T22:58:01.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.072+0000 7f9f1ce92740 1 Processor -- start 2024-09-15T22:58:01.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd29730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd13680 0x563f2cd2a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141ae620 con 0x563f2cd10f40 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141adf50 con 0x563f2cd084a0 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14073eb0 con 0x563f2cd13680 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f1ce92740 10 client.0 _ll_register_callbacks cb 0x7f9f00021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f19056640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd13680 0x563f2cd2a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f13fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57442/0 (socket says 172.21.15.66:57442) 2024-09-15T22:58:01.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.073+0000 7f9f13fff640 1 -- 172.21.15.66:0/1586948021 learned_addr learned my addr 172.21.15.66:0/1586948021 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 -- 172.21.15.66:0/1586948021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd13680 msgr2=0x563f2cd2a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd13680 0x563f2cd2a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 -- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 msgr2=0x563f2cd29730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd29730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 -- 172.21.15.66:0/1586948021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2cd9d990 con 0x563f2cd10f40 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.074+0000 7f9f13fff640 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cf0 tx=0x7f9f0000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f63b442182a297 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.075+0000 7f9ef3fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.075+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00043070 con 0x563f2cd10f40 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.075+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f9f00005250 con 0x563f2cd10f40 2024-09-15T22:58:01.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.076+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0c005500 con 0x563f2cd10f40 2024-09-15T22:58:01.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.078+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f9f0004d050 con 0x563f2cd10f40 2024-09-15T22:58:01.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.081+0000 7f9f1ce92740 10 client.18180 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:01.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.081+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x563f2cd9eca0 con 0x563f2cd10f40 2024-09-15T22:58:01.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f00014640 con 0x563f2cd10f40 2024-09-15T22:58:01.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f9f0001d040 con 0x563f2cd10f40 2024-09-15T22:58:01.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 10 client.18180 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:01.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 10 client.18180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:01.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 20 client.18180 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:01.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd9f350 0x563f2cda1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:01.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 4 client.18180 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:58:01.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.085+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9f0c005500 con 0x563f2cd9f350 2024-09-15T22:58:01.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.086+0000 7f9f18855640 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd9f350 0x563f2cda1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:01.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.089+0000 7f9ef3fff640 10 client.18180 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:01.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.089+0000 7f9f18855640 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd9f350 0x563f2cda1740 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3b3cfe0355d620a server_cookie=bbf5e007a6b9a84e in_seq=0 out_seq=0 2024-09-15T22:58:01.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.089+0000 7f9ef3fff640 1 -- 172.21.15.66:0/1586948021 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f9f0c005500 con 0x563f2cd9f350 2024-09-15T22:58:01.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.089+0000 7f9ef3fff640 10 client.18180 handle_command_reply: tid=0 2024-09-15T22:58:01.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.089+0000 7f9f1ce92740 1 client.18180 shutdown 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 msgr2=0x563f2cd29c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f9f00014cf0 tx=0x7f9f0000cd00 comp rx=0 tx=0).stop 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 shutdown_connections 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563f2cd13680 0x563f2cd2a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f2cd10f40 0x563f2cd29c70 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563f2cd9f350 0x563f2cda1740 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 --2- 172.21.15.66:0/1586948021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f2cd084a0 0x563f2cd29730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9ef3fff640 0 client.18180 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:01.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.090+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 >> 172.21.15.66:0/1586948021 conn(0x563f2cd04a30 msgr2=0x563f2cd03350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.092+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 shutdown_connections 2024-09-15T22:58:01.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.092+0000 7f9f1ce92740 1 -- 172.21.15.66:0/1586948021 wait complete. 2024-09-15T22:58:01.095 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:58:01.095 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:58:01.095 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:58:01.095 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:58:01.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.092+0000 7f9f1ce92740 20 client.18180 trim_cache size 0 max 16384 2024-09-15T22:58:01.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 msgr2=0x7f9f040a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 0x7f9f040a5970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9f00013000 tx=0x7f9f0001c000 comp rx=0 tx=0).stop 2024-09-15T22:58:01.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 msgr2=0x7f9f141a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:01.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004770 tx=0x7f9f08003c10 comp rx=0 tx=0).stop 2024-09-15T22:58:01.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 shutdown_connections 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9f040a34b0 0x7f9f040a5970 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f1410d530 0x7f9f1419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f14108e00 0x7f9f141a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 --2- 172.21.15.66:0/3326737241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f14108450 0x7f9f141a46d0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 >> 172.21.15.66:0/3326737241 conn(0x7f9f14077ba0 msgr2=0x7f9f14078e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 shutdown_connections 2024-09-15T22:58:01.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:01.094+0000 7f9f1aab9640 1 -- 172.21.15.66:0/3326737241 wait complete. 2024-09-15T22:58:01.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:01 smithi066 ceph-mon[31185]: pgmap v394: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 13 op/s 2024-09-15T22:58:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:01 smithi087 ceph-mon[35290]: pgmap v394: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 13 op/s 2024-09-15T22:58:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:01 smithi184 ceph-mon[35203]: pgmap v394: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 13 op/s 2024-09-15T22:58:01.784 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:58:01.784 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:58:02.052 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:02.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 -- 172.21.15.66:0/3778706841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1708109450 msgr2=0x7f1708109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 --2- 172.21.15.66:0/3778706841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1708109450 0x7f1708109830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16f80073b0 tx=0x7f16f802afe0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 -- 172.21.15.66:0/3778706841 shutdown_connections 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 --2- 172.21.15.66:0/3778706841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f170810ea10 0x7f1708115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 --2- 172.21.15.66:0/3778706841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f170810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 --2- 172.21.15.66:0/3778706841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1708109450 0x7f1708109830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.603+0000 7f170d138640 1 -- 172.21.15.66:0/3778706841 >> 172.21.15.66:0/3778706841 conn(0x7f1708073660 msgr2=0x7f1708073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:02.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.607+0000 7f170d138640 1 -- 172.21.15.66:0/3778706841 shutdown_connections 2024-09-15T22:58:02.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.607+0000 7f170d138640 1 -- 172.21.15.66:0/3778706841 wait complete. 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 Processor -- start 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 -- start start 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1708109450 0x7f1708118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f1708119360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 0x7f17081198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1708117e80 con 0x7f1708109450 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1708117d00 con 0x7f170810ea10 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170d138640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1708118000 con 0x7f1708109e00 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170c937640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 0x7f17081198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170c937640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 0x7f17081198a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60346/0 (socket says 172.21.15.66:60346) 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.608+0000 7f170c937640 1 -- 172.21.15.66:0/893844982 learned_addr learned my addr 172.21.15.66:0/893844982 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f1708119360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f1707fff640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1708109450 0x7f1708118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 -- 172.21.15.66:0/893844982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 msgr2=0x7f17081198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 0x7f17081198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 -- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1708109450 msgr2=0x7f1708118e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1708109450 0x7f1708118e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.609+0000 7f17077fe640 1 -- 172.21.15.66:0/893844982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17081b3300 con 0x7f1708109e00 2024-09-15T22:58:02.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.610+0000 7f17077fe640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f1708119360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e7c0 tx=0x7f16fc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:02.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.610+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00ccc0 con 0x7f1708109e00 2024-09-15T22:58:02.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.611+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17081b35f0 con 0x7f1708109e00 2024-09-15T22:58:02.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.611+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16fc00ce60 con 0x7f1708109e00 2024-09-15T22:58:02.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.612+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0187a0 con 0x7f1708109e00 2024-09-15T22:58:02.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.613+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081b3b30 con 0x7f1708109e00 2024-09-15T22:58:02.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.615+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f16fc018940 con 0x7f1708109e00 2024-09-15T22:58:02.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.619+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170806eef0 con 0x7f1708109e00 2024-09-15T22:58:02.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.619+0000 7f17057fa640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 0x7f16f00a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:02.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.620+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f16fc0d06e0 con 0x7f1708109e00 2024-09-15T22:58:02.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.620+0000 7f1707fff640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 0x7f16f00a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:02.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.622+0000 7f1707fff640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 0x7f16f00a58a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16f8008b30 tx=0x7f16f802d040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:02.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:02.627+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16fc09cc90 con 0x7f1708109e00 2024-09-15T22:58:03.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.050+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f170811a350 con 0x7f1708109e00 2024-09-15T22:58:03.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.052+0000 7f17057fa640 1 -- 172.21.15.66:0/893844982 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11988 (secure 0 0 0) 0x7f16fc09c590 con 0x7f1708109e00 2024-09-15T22:58:03.056 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:58:03.056 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":54,"btime":"2024-09-15T22:57:07:882300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:57:07.497310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:58:03.056 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 54 2024-09-15T22:58:03.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.058+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 msgr2=0x7f16f00a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.058+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 0x7f16f00a58a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16f8008b30 tx=0x7f16f802d040 comp rx=0 tx=0).stop 2024-09-15T22:58:03.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.058+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 msgr2=0x7f1708119360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:03.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.058+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f1708119360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e7c0 tx=0x7f16fc00ec80 comp rx=0 tx=0).stop 2024-09-15T22:58:03.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 shutdown_connections 2024-09-15T22:58:03.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f16f00a33e0 0x7f16f00a58a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170810ea10 0x7f17081198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1708109e00 0x7f1708119360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 --2- 172.21.15.66:0/893844982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1708109450 0x7f1708118e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:03.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.059+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 >> 172.21.15.66:0/893844982 conn(0x7f1708073660 msgr2=0x7f170806d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:03.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.060+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 shutdown_connections 2024-09-15T22:58:03.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:03.060+0000 7f170d138640 1 -- 172.21.15.66:0/893844982 wait complete. 2024-09-15T22:58:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:03 smithi087 ceph-mon[35290]: pgmap v395: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 154 KiB/s wr, 54 op/s 2024-09-15T22:58:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:03 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/893844982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:03.399 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:03 smithi066 ceph-mon[31185]: pgmap v395: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 154 KiB/s wr, 54 op/s 2024-09-15T22:58:03.400 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:03 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/893844982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:03 smithi184 ceph-mon[35203]: pgmap v395: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 154 KiB/s wr, 54 op/s 2024-09-15T22:58:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:03 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/893844982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:03.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:58:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:04.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 -- 172.21.15.66:0/987916973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b301012a0 msgr2=0x7f1b30105770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/987916973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b301012a0 0x7f1b30105770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009900 tx=0x7f1b2402a4b0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 -- 172.21.15.66:0/987916973 shutdown_connections 2024-09-15T22:58:04.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/987916973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30105d90 0x7f1b30106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/987916973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b301012a0 0x7f1b30105770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/987916973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b30100980 0x7f1b30100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.826+0000 7f1b2f59e640 1 -- 172.21.15.66:0/987916973 >> 172.21.15.66:0/987916973 conn(0x7f1b300fc610 msgr2=0x7f1b300fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.827+0000 7f1b2f59e640 1 -- 172.21.15.66:0/987916973 shutdown_connections 2024-09-15T22:58:04.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.827+0000 7f1b2f59e640 1 -- 172.21.15.66:0/987916973 wait complete. 2024-09-15T22:58:04.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.828+0000 7f1b2f59e640 1 Processor -- start 2024-09-15T22:58:04.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.828+0000 7f1b2f59e640 1 -- start start 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b301012a0 0x7f1b301a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b30105d90 0x7f1b3019e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30118400 con 0x7f1b301012a0 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30118280 con 0x7f1b30105d90 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2f59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30118580 con 0x7f1b30100980 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39838/0 (socket says 172.21.15.66:39838) 2024-09-15T22:58:04.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.829+0000 7f1b2e59c640 1 -- 172.21.15.66:0/899346784 learned_addr learned my addr 172.21.15.66:0/899346784 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:04.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.830+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b30105d90 0x7f1b3019e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.830+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b301012a0 0x7f1b301a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.831+0000 7f1b2e59c640 1 -- 172.21.15.66:0/899346784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b30105d90 msgr2=0x7f1b3019e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.831+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b30105d90 0x7f1b3019e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.831+0000 7f1b2e59c640 1 -- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b301012a0 msgr2=0x7f1b301a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.831+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b301012a0 0x7f1b301a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.831+0000 7f1b2e59c640 1 -- 172.21.15.66:0/899346784 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3019efe0 con 0x7f1b30100980 2024-09-15T22:58:04.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.832+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800ba50 tx=0x7f1b2800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.833+0000 7f1b1f7fe640 1 -- 172.21.15.66:0/899346784 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28019070 con 0x7f1b30100980 2024-09-15T22:58:04.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.834+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3019f2d0 con 0x7f1b30100980 2024-09-15T22:58:04.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.834+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301ab620 con 0x7f1b30100980 2024-09-15T22:58:04.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.834+0000 7f1b1f7fe640 1 -- 172.21.15.66:0/899346784 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2800cbe0 con 0x7f1b30100980 2024-09-15T22:58:04.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.834+0000 7f1b1f7fe640 1 -- 172.21.15.66:0/899346784 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b280076f0 con 0x7f1b30100980 2024-09-15T22:58:04.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.839+0000 7f1b36d56740 1 Processor -- start 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.839+0000 7f1b1f7fe640 1 -- 172.21.15.66:0/899346784 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1b2801c070 con 0x7f1b30100980 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.840+0000 7f1b1f7fe640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 0x7f1b180a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 -- start start 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babd8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babd8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3bab3e2f0 con 0x55d3babe3550 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d3baae5cf0 con 0x55d3babd9d20 2024-09-15T22:58:04.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.841+0000 7f1b36d56740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3bab3a2b0 con 0x55d3babd87b0 2024-09-15T22:58:04.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.842+0000 7f1b1f7fe640 1 -- 172.21.15.66:0/899346784 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f1b280cf540 con 0x7f1b30100980 2024-09-15T22:58:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.844+0000 7f1b2dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babd8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.844+0000 7f1b2dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babd8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39848/0 (socket says 172.21.15.66:39848) 2024-09-15T22:58:04.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.844+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/3138282569 learned_addr learned my addr 172.21.15.66:0/3138282569 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.845+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 0x7f1b180a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.845+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.845+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babd8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.846+0000 7f1b2e59c640 1 -- 172.21.15.66:0/3138282569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 msgr2=0x55d3babd8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.846+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babd8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.846+0000 7f1b2e59c640 1 -- 172.21.15.66:0/3138282569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 msgr2=0x55d3babe5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.846+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.846+0000 7f1b2e59c640 1 -- 172.21.15.66:0/3138282569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3baaca3a0 con 0x55d3babd9d20 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.849+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babd8270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b280cc910 tx=0x7f1b2809b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f978dd3df62a7ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.849+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 0x7f1b180a5a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55d3babd9250 tx=0x7f1b2000c2d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.849+0000 7f1b1cff9640 1 -- 172.21.15.66:0/3138282569 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b280a4600 con 0x55d3babd9d20 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.850+0000 7f1b1cff9640 1 -- 172.21.15.66:0/3138282569 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b28099c90 con 0x55d3babd9d20 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.850+0000 7f1b1cff9640 1 -- 172.21.15.66:0/3138282569 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b280a4170 con 0x55d3babd9d20 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 -- 172.21.15.66:0/3138282569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 msgr2=0x55d3babd8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babd8270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b280cc910 tx=0x7f1b2809b760 comp rx=0 tx=0).stop 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 -- 172.21.15.66:0/3138282569 shutdown_connections 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babd8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3138282569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babd8270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.851+0000 7f1b36d56740 1 -- 172.21.15.66:0/3138282569 >> 172.21.15.66:0/3138282569 conn(0x55d3baba1310 msgr2=0x55d3babd4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.855+0000 7f1b36d56740 1 -- 172.21.15.66:0/3138282569 shutdown_connections 2024-09-15T22:58:04.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.855+0000 7f1b36d56740 1 -- 172.21.15.66:0/3138282569 wait complete. 2024-09-15T22:58:04.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.856+0000 7f1b36d56740 1 -- start start 2024-09-15T22:58:04.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.856+0000 7f1b36d56740 1 Processor -- start 2024-09-15T22:58:04.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 0x55d3babe2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd9d20 0x55d3babe01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3babf72b0 con 0x55d3babe3550 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d3baaf9060 con 0x55d3babd87b0 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3babf7430 con 0x55d3babd9d20 2024-09-15T22:58:04.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.858+0000 7f1b36d56740 10 client.0 _ll_register_callbacks cb 0x55d3ba84c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:04.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.859+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 0x55d3babe2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.859+0000 7f1b2ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.859+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 0x55d3babe2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60378/0 (socket says 172.21.15.66:60378) 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.859+0000 7f1b2e59c640 1 -- 172.21.15.66:0/3091003909 learned_addr learned my addr 172.21.15.66:0/3091003909 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.859+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd9d20 0x55d3babe01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 -- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd9d20 msgr2=0x55d3babe01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd9d20 0x55d3babe01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 -- 172.21.15.66:0/3091003909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 msgr2=0x55d3babe2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 0x55d3babe2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 -- 172.21.15.66:0/3091003909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ba8af3c0 con 0x55d3babe3550 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe0800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1b20005fd0 tx=0x7f1b20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d1d55e22d91e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.860+0000 7f1b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:04.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.861+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20024070 con 0x55d3babe3550 2024-09-15T22:58:04.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.861+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b28099c90 con 0x55d3babe3550 2024-09-15T22:58:04.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.861+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f1b200128e0 con 0x55d3babe3550 2024-09-15T22:58:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.863+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f1b2002f050 con 0x55d3babe3550 2024-09-15T22:58:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.863+0000 7f1b36d56740 10 client.18195 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:04.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.863+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55d3bac02da0 con 0x55d3babe3550 2024-09-15T22:58:04.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b28099c90 con 0x55d3babe3550 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f1b20004900 con 0x55d3babe3550 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 10 client.18195 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 10 client.18195 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 20 client.18195 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac04760 0x55d3bac06c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 4 client.18195 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.865+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3bab4b860 con 0x55d3bac04760 2024-09-15T22:58:04.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.866+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac04760 0x55d3bac06c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.866+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac04760 0x55d3bac06c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=23de09d7fd390887 server_cookie=77597c04ca562b1d in_seq=0 out_seq=0 2024-09-15T22:58:04.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.866+0000 7f1b15ffb640 10 client.18195 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:04.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.867+0000 7f1b15ffb640 1 -- 172.21.15.66:0/3091003909 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3bab4b860 con 0x55d3bac04760 2024-09-15T22:58:04.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.867+0000 7f1b15ffb640 10 client.18195 handle_command_reply: tid=0 2024-09-15T22:58:04.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.867+0000 7f1b36d56740 1 client.18195 shutdown 2024-09-15T22:58:04.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 msgr2=0x55d3babe0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe0800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1b20005fd0 tx=0x7f1b20004730 comp rx=0 tx=0).stop 2024-09-15T22:58:04.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 shutdown_connections 2024-09-15T22:58:04.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac04760 0x55d3bac06c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babe3550 0x55d3babe0800 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd9d20 0x55d3babe01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 --2- 172.21.15.66:0/3091003909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd87b0 0x55d3babe2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 >> 172.21.15.66:0/3091003909 conn(0x55d3baba1310 msgr2=0x55d3babdaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b15ffb640 0 client.18195 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:04.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 shutdown_connections 2024-09-15T22:58:04.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.870+0000 7f1b36d56740 1 -- 172.21.15.66:0/3091003909 wait complete. 2024-09-15T22:58:04.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.871+0000 7f1b36d56740 20 client.18195 trim_cache size 0 max 16384 2024-09-15T22:58:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.898+0000 7f1b36d56740 1 Processor -- start 2024-09-15T22:58:04.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.898+0000 7f1b36d56740 1 -- start start 2024-09-15T22:58:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babdeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babe3550 0x55d3babdf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43920/0 (socket says 172.21.15.66:43920) 2024-09-15T22:58:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10010230 con 0x55d3babd87b0 2024-09-15T22:58:04.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10011ef0 con 0x55d3babd9d20 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b36d56740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100109c0 con 0x55d3babe3550 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b2e59c640 1 -- 172.21.15.66:0/2790088495 learned_addr learned my addr 172.21.15.66:0/2790088495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.899+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babdeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2ed9d640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babe3550 0x55d3babdf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/2790088495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babe3550 msgr2=0x55d3babdf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babe3550 0x55d3babdf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/2790088495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 msgr2=0x55d3bac005b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/2790088495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3babe3260 con 0x55d3babd9d20 2024-09-15T22:58:04.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.900+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:04.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.901+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babdeac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009230 tx=0x7f1b24004390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4897879e887d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.902+0000 7f1b17fff640 1 -- 172.21.15.66:0/2790088495 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24035040 con 0x55d3babd9d20 2024-09-15T22:58:04.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.902+0000 7f1b17fff640 1 -- 172.21.15.66:0/2790088495 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b240046c0 con 0x55d3babd9d20 2024-09-15T22:58:04.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.902+0000 7f1b17fff640 1 -- 172.21.15.66:0/2790088495 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b240317a0 con 0x55d3babd9d20 2024-09-15T22:58:04.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.903+0000 7f1b36d56740 1 -- 172.21.15.66:0/2790088495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 msgr2=0x55d3babdeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.903+0000 7f1b36d56740 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babdeac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009230 tx=0x7f1b24004390 comp rx=0 tx=0).stop 2024-09-15T22:58:04.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 -- 172.21.15.66:0/2790088495 shutdown_connections 2024-09-15T22:58:04.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babe3550 0x55d3babdf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babd9d20 0x55d3babdeac0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 --2- 172.21.15.66:0/2790088495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd87b0 0x55d3bac005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 -- 172.21.15.66:0/2790088495 >> 172.21.15.66:0/2790088495 conn(0x55d3baba1310 msgr2=0x55d3babdb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 -- 172.21.15.66:0/2790088495 shutdown_connections 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.904+0000 7f1b36d56740 1 -- 172.21.15.66:0/2790088495 wait complete. 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.905+0000 7f1b36d56740 1 -- start start 2024-09-15T22:58:04.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.905+0000 7f1b36d56740 1 Processor -- start 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babfc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b36d56740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 0x55d3babfcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babfc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babfc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39868/0 (socket says 172.21.15.66:39868) 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b2e59c640 1 -- 172.21.15.66:0/418134545 learned_addr learned my addr 172.21.15.66:0/418134545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.906+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babe3550 0x55d3babdc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10011820 con 0x55d3babd9d20 2024-09-15T22:58:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10011150 con 0x55d3babe3550 2024-09-15T22:58:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000e230 con 0x55d3babd87b0 2024-09-15T22:58:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b36d56740 10 client.0 _ll_register_callbacks cb 0x7f1b2000cd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:04.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 0x55d3babfcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 msgr2=0x55d3babfc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babfc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/418134545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babe3550 msgr2=0x55d3babdc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babe3550 0x55d3babdc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.907+0000 7f1b2dd9b640 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3babfd350 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.908+0000 7f1b2dd9b640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 0x55d3babfcc60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1b2402b070 tx=0x7f1b240045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794c0b7df9de9116 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.908+0000 7f1b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.908+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24035030 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.908+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f1b240054d0 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.908+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b240046c0 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.909+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f1b24031540 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.909+0000 7f1b36d56740 10 client.18201 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.909+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55d3bac6ea30 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.909+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b240046c0 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f1b2403c9c0 con 0x55d3babd9d20 2024-09-15T22:58:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 10 client.18201 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 10 client.18201 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 20 client.18201 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac6f200 0x55d3bac716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 4 client.18201 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3bab45d70 con 0x55d3bac6f200 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.910+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac6f200 0x55d3bac716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.912+0000 7f1b2e59c640 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac6f200 0x55d3bac716c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b0d24308b53b21b server_cookie=5dba0c78cc2aecb7 in_seq=0 out_seq=0 2024-09-15T22:58:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.912+0000 7f1b15ffb640 10 client.18201 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:04.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.913+0000 7f1b15ffb640 1 -- 172.21.15.66:0/418134545 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3bab45d70 con 0x55d3bac6f200 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.913+0000 7f1b15ffb640 10 client.18201 handle_command_reply: tid=0 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.913+0000 7f1b36d56740 1 client.18201 shutdown 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 msgr2=0x55d3babfcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 0x55d3babfcc60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1b2402b070 tx=0x7f1b240045c0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 shutdown_connections 2024-09-15T22:58:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55d3bac6f200 0x55d3bac716c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b15ffb640 0 client.18201 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3babe3550 0x55d3babdc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3babd9d20 0x55d3babfcc60 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 --2- 172.21.15.66:0/418134545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3babd87b0 0x55d3babfc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 >> 172.21.15.66:0/418134545 conn(0x55d3baba1310 msgr2=0x55d3babd3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 shutdown_connections 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 1 -- 172.21.15.66:0/418134545 wait complete. 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.914+0000 7f1b36d56740 20 client.18201 trim_cache size 0 max 16384 2024-09-15T22:58:04.917 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 msgr2=0x7f1b180a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 0x7f1b180a5a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55d3babd9250 tx=0x7f1b2000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 msgr2=0x7f1b301a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800ba50 tx=0x7f1b2800bf10 comp rx=0 tx=0).stop 2024-09-15T22:58:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 shutdown_connections 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1b180a35c0 0x7f1b180a5a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b30105d90 0x7f1b3019e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b301012a0 0x7f1b301a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 --2- 172.21.15.66:0/899346784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b30100980 0x7f1b301a46a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 >> 172.21.15.66:0/899346784 conn(0x7f1b300fc610 msgr2=0x7f1b30103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.916+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 shutdown_connections 2024-09-15T22:58:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:04.917+0000 7f1b2f59e640 1 -- 172.21.15.66:0/899346784 wait complete. 2024-09-15T22:58:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:05 smithi087 ceph-mon[35290]: pgmap v396: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-15T22:58:05.397 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:05 smithi066 ceph-mon[31185]: pgmap v396: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-15T22:58:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:05 smithi184 ceph-mon[35203]: pgmap v396: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-09-15T22:58:05.655 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:58:06.035 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:06.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.645+0000 7f97e3a26640 1 -- 172.21.15.66:0/756087265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109e00 msgr2=0x7f97dc0742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.645+0000 7f97e3a26640 1 --2- 172.21.15.66:0/756087265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109e00 0x7f97dc0742d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f97d400bd70 tx=0x7f97d402c430 comp rx=0 tx=0).stop 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.646+0000 7f97e3a26640 1 -- 172.21.15.66:0/756087265 shutdown_connections 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.646+0000 7f97e3a26640 1 --2- 172.21.15.66:0/756087265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc074990 0x7f97dc07b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.646+0000 7f97e3a26640 1 --2- 172.21.15.66:0/756087265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109e00 0x7f97dc0742d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.646+0000 7f97e3a26640 1 --2- 172.21.15.66:0/756087265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc109450 0x7f97dc109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.646+0000 7f97e3a26640 1 -- 172.21.15.66:0/756087265 >> 172.21.15.66:0/756087265 conn(0x7f97dc06e140 msgr2=0x7f97dc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.647+0000 7f97e3a26640 1 -- 172.21.15.66:0/756087265 shutdown_connections 2024-09-15T22:58:06.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.647+0000 7f97e3a26640 1 -- 172.21.15.66:0/756087265 wait complete. 2024-09-15T22:58:06.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 Processor -- start 2024-09-15T22:58:06.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 -- start start 2024-09-15T22:58:06.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109450 0x7f97dc076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 0x7f97dc076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc07e730 con 0x7f97dc109e00 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc07e5b0 con 0x7f97dc074990 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.648+0000 7f97e3a26640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc07e8b0 con 0x7f97dc109450 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e17c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e17c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60400/0 (socket says 172.21.15.66:60400) 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e17c2640 1 -- 172.21.15.66:0/4223404176 learned_addr learned my addr 172.21.15.66:0/4223404176 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109450 0x7f97dc076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 0x7f97dc076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 -- 172.21.15.66:0/4223404176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109450 msgr2=0x7f97dc076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109450 0x7f97dc076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 -- 172.21.15.66:0/4223404176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 msgr2=0x7f97dc07b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e1fc3640 1 -- 172.21.15.66:0/4223404176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc077020 con 0x7f97dc109e00 2024-09-15T22:58:06.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.649+0000 7f97e17c2640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:06.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.650+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 0x7f97dc076760 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00d6b0 tx=0x7f97cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.650+0000 7f97d27fc640 1 -- 172.21.15.66:0/4223404176 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc017070 con 0x7f97dc109e00 2024-09-15T22:58:06.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.650+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc1c4810 con 0x7f97dc109e00 2024-09-15T22:58:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.650+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc1c4d20 con 0x7f97dc109e00 2024-09-15T22:58:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.650+0000 7f97d27fc640 1 -- 172.21.15.66:0/4223404176 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc005500 con 0x7f97dc109e00 2024-09-15T22:58:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.651+0000 7f97d27fc640 1 -- 172.21.15.66:0/4223404176 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc009750 con 0x7f97dc109e00 2024-09-15T22:58:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.654+0000 7f97e5dff740 1 Processor -- start 2024-09-15T22:58:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 -- start start 2024-09-15T22:58:06.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff79fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a09760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cff79622f0 con 0x55cff7a07370 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cff7909cf0 con 0x55cff79fc5d0 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97e5dff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cff795e2b0 con 0x55cff79fdb40 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.656+0000 7f97d27fc640 1 -- 172.21.15.66:0/4223404176 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f97cc0098f0 con 0x7f97dc109e00 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.657+0000 7f97d27fc640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 0x7f97c80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.658+0000 7f97d27fc640 1 -- 172.21.15.66:0/4223404176 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f97cc0cfd30 con 0x7f97dc109e00 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.658+0000 7f97e17c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.658+0000 7f97e17c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60404/0 (socket says 172.21.15.66:60404) 2024-09-15T22:58:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.658+0000 7f97e17c2640 1 -- 172.21.15.66:0/417412159 learned_addr learned my addr 172.21.15.66:0/417412159 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a09760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 -- 172.21.15.66:0/417412159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 msgr2=0x55cff79fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff79fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 -- 172.21.15.66:0/417412159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 msgr2=0x55cff7a09760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a09760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 -- 172.21.15.66:0/417412159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff78ee3a0 con 0x55cff79fc5d0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 0x7f97c80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a09760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97e17c2640 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97d80112d0 tx=0x7f97d800ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6d7cbafe7b86ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97c77fe640 1 -- 172.21.15.66:0/417412159 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8015830 con 0x55cff79fc5d0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97c77fe640 1 -- 172.21.15.66:0/417412159 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d801d400 con 0x55cff79fc5d0 2024-09-15T22:58:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.659+0000 7f97c77fe640 1 -- 172.21.15.66:0/417412159 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8014600 con 0x55cff79fc5d0 2024-09-15T22:58:06.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.660+0000 7f97e5dff740 1 -- 172.21.15.66:0/417412159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 msgr2=0x55cff79fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.660+0000 7f97e1fc3640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 0x7f97c80a5970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97cc098550 tx=0x7f97cc004950 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.660+0000 7f97e5dff740 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97d80112d0 tx=0x7f97d800ac00 comp rx=0 tx=0).stop 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.661+0000 7f97e5dff740 1 -- 172.21.15.66:0/417412159 shutdown_connections 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.661+0000 7f97e5dff740 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a09760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.661+0000 7f97e5dff740 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fc5d0 0x55cff79fca10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.661+0000 7f97e5dff740 1 --2- 172.21.15.66:0/417412159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff79fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.661+0000 7f97e5dff740 1 -- 172.21.15.66:0/417412159 >> 172.21.15.66:0/417412159 conn(0x55cff79c5310 msgr2=0x55cff79f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.664+0000 7f97e5dff740 1 -- 172.21.15.66:0/417412159 shutdown_connections 2024-09-15T22:58:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.665+0000 7f97e5dff740 1 -- 172.21.15.66:0/417412159 wait complete. 2024-09-15T22:58:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.665+0000 7f97e5dff740 1 -- start start 2024-09-15T22:58:06.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.665+0000 7f97e5dff740 1 Processor -- start 2024-09-15T22:58:06.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fc5d0 0x55cff7a06dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff7a04070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cff7a0a0c0 con 0x55cff7a07370 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55cff791d060 con 0x55cff79fdb40 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cff7a0a240 con 0x55cff79fc5d0 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e5dff740 10 client.0 _ll_register_callbacks cb 0x55cff76708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43966/0 (socket says 172.21.15.66:43966) 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e0fc1640 1 -- 172.21.15.66:0/1061077584 learned_addr learned my addr 172.21.15.66:0/1061077584 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.666+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fc5d0 0x55cff7a06dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 -- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fc5d0 msgr2=0x55cff7a06dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fc5d0 0x55cff7a06dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 -- 172.21.15.66:0/1061077584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 msgr2=0x55cff7a04070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff7a04070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 -- 172.21.15.66:0/1061077584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff76d33c0 con 0x55cff7a07370 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06f670 tx=0x7f97d402c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43220e01d53dcf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.667+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4038070 con 0x55cff7a07370 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.668+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97d801d400 con 0x55cff7a07370 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.668+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f97d4003970 con 0x55cff7a07370 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.668+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f97d4003b70 con 0x55cff7a07370 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.668+0000 7f97e5dff740 10 client.18210 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:06.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.668+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55cff7a26b70 con 0x55cff7a07370 2024-09-15T22:58:06.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d801d400 con 0x55cff7a07370 2024-09-15T22:58:06.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f97d403e070 con 0x55cff7a07370 2024-09-15T22:58:06.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 10 client.18210 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:06.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 10 client.18210 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:58:06.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 20 client.18210 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:06.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a2a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 4 client.18210 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:06.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.669+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cff796f860 con 0x55cff7a27fd0 2024-09-15T22:58:06.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.671+0000 7f97e17c2640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a2a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.676+0000 7f97e17c2640 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a2a450 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a21938b9c3540595 server_cookie=e765e78d88f616e5 in_seq=0 out_seq=0 2024-09-15T22:58:06.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.677+0000 7f97c4ff9640 10 client.18210 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:06.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.678+0000 7f97c4ff9640 1 -- 172.21.15.66:0/1061077584 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cff796f860 con 0x55cff7a27fd0 2024-09-15T22:58:06.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.678+0000 7f97c4ff9640 10 client.18210 handle_command_reply: tid=0 2024-09-15T22:58:06.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.678+0000 7f97e5dff740 1 client.18210 shutdown 2024-09-15T22:58:06.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.679+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 msgr2=0x55cff7a04800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.679+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f97dc06f670 tx=0x7f97d402c430 comp rx=0 tx=0).stop 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.682+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 shutdown_connections 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.682+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a2a450 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.683+0000 7f97c4ff9640 0 client.18210 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.683+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff7a07370 0x55cff7a04800 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.683+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff7a04070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.683+0000 7f97e5dff740 1 --2- 172.21.15.66:0/1061077584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fc5d0 0x55cff7a06dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.683+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 >> 172.21.15.66:0/1061077584 conn(0x55cff79c5310 msgr2=0x55cff79fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.684+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 shutdown_connections 2024-09-15T22:58:06.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.684+0000 7f97e5dff740 1 -- 172.21.15.66:0/1061077584 wait complete. 2024-09-15T22:58:06.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.684+0000 7f97e5dff740 20 client.18210 trim_cache size 0 max 16384 2024-09-15T22:58:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.709+0000 7f97e5dff740 1 Processor -- start 2024-09-15T22:58:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.709+0000 7f97e5dff740 1 -- start start 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff79ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff7a07370 0x55cff79ff660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1c68e0 con 0x55cff79fc5d0 2024-09-15T22:58:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1c85a0 con 0x55cff79fdb40 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43982/0 (socket says 172.21.15.66:43982) 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e0fc1640 1 -- 172.21.15.66:0/330224842 learned_addr learned my addr 172.21.15.66:0/330224842 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1c7070 con 0x55cff7a07370 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.710+0000 7f97e17c2640 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff79ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 -- 172.21.15.66:0/330224842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff7a07370 msgr2=0x55cff79ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff7a07370 0x55cff79ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 -- 172.21.15.66:0/330224842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 msgr2=0x55cff79ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff79ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 -- 172.21.15.66:0/330224842 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff79f9dd0 con 0x55cff79fc5d0 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f97d40336d0 tx=0x7f97d4033820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88551dbaf705a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97c6ffd640 1 -- 172.21.15.66:0/330224842 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4059070 con 0x55cff79fc5d0 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97c6ffd640 1 -- 172.21.15.66:0/330224842 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d4039040 con 0x55cff79fc5d0 2024-09-15T22:58:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.711+0000 7f97c6ffd640 1 -- 172.21.15.66:0/330224842 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4038040 con 0x55cff79fc5d0 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 msgr2=0x55cff7a05fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f97d40336d0 tx=0x7f97d4033820 comp rx=0 tx=0).stop 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 shutdown_connections 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff7a07370 0x55cff79ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff79fdb40 0x55cff79ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 --2- 172.21.15.66:0/330224842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a05fe0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 >> 172.21.15.66:0/330224842 conn(0x55cff79c5310 msgr2=0x55cff7a058d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 shutdown_connections 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.712+0000 7f97e5dff740 1 -- 172.21.15.66:0/330224842 wait complete. 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.713+0000 7f97e5dff740 1 -- start start 2024-09-15T22:58:06.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.713+0000 7f97e5dff740 1 Processor -- start 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.714+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.714+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff7a01660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.714+0000 7f97e5dff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff7a07370 0x55cff7a01ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.714+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43996/0 (socket says 172.21.15.66:43996) 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 -- 172.21.15.66:0/2916685083 learned_addr learned my addr 172.21.15.66:0/2916685083 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1c7ed0 con 0x55cff79fc5d0 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc1c7800 con 0x55cff7a07370 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc077750 con 0x55cff79fdb40 2024-09-15T22:58:06.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e5dff740 10 client.0 _ll_register_callbacks cb 0x7f97d8005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff7a07370 0x55cff7a01ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 -- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 msgr2=0x55cff7a01660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff7a01660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 -- 172.21.15.66:0/2916685083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff7a07370 msgr2=0x55cff7a01ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff7a07370 0x55cff7a01ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.715+0000 7f97e0fc1640 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff79fd590 con 0x55cff79fc5d0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.716+0000 7f97e0fc1640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009720 tx=0x7f97d4045040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950c0b44bf41f560 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.716+0000 7f97c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.716+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4038030 con 0x55cff79fc5d0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.716+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7f97d4054910 con 0x55cff79fc5d0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.716+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97d4039040 con 0x55cff79fc5d0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.717+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f97d4059050 con 0x55cff79fc5d0 2024-09-15T22:58:06.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.717+0000 7f97e5dff740 10 client.18216 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:06.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.717+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55cff7a92e70 con 0x55cff79fc5d0 2024-09-15T22:58:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.717+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d405a040 con 0x55cff79fc5d0 2024-09-15T22:58:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7f97d403e040 con 0x55cff79fc5d0 2024-09-15T22:58:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 10 client.18216 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 10 client.18216 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 20 client.18216 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a95260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 4 client.18216 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f97d4039040 con 0x55cff7a27fd0 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.718+0000 7f97e17c2640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a95260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e17c2640 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a95260 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ff4e5afee55d415 server_cookie=75e5897189b0907c in_seq=0 out_seq=0 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97c4ff9640 10 client.18216 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97c4ff9640 1 -- 172.21.15.66:0/2916685083 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f97d4039040 con 0x55cff7a27fd0 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97c4ff9640 10 client.18216 handle_command_reply: tid=0 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 client.18216 shutdown 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 msgr2=0x55cff7a01120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009720 tx=0x7f97d4045040 comp rx=0 tx=0).stop 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 shutdown_connections 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55cff7a27fd0 0x55cff7a95260 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cff7a07370 0x55cff7a01ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97c4ff9640 0 client.18216 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cff79fdb40 0x55cff7a01660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 --2- 172.21.15.66:0/2916685083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cff79fc5d0 0x55cff7a01120 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 >> 172.21.15.66:0/2916685083 conn(0x55cff79c5310 msgr2=0x55cff7a060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 shutdown_connections 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 1 -- 172.21.15.66:0/2916685083 wait complete. 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.719+0000 7f97e5dff740 20 client.18216 trim_cache size 0 max 16384 2024-09-15T22:58:06.724 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 msgr2=0x7f97c80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 0x7f97c80a5970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97cc098550 tx=0x7f97cc004950 comp rx=0 tx=0).stop 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 msgr2=0x7f97dc076760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 0x7f97dc076760 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00d6b0 tx=0x7f97cc00dab0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 shutdown_connections 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f97c80a34b0 0x7f97c80a5970 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97dc109e00 0x7f97dc076760 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc109450 0x7f97dc076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 --2- 172.21.15.66:0/4223404176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97dc074990 0x7f97dc07b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 >> 172.21.15.66:0/4223404176 conn(0x7f97dc06e140 msgr2=0x7f97dc083750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 shutdown_connections 2024-09-15T22:58:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:06.720+0000 7f97e3a26640 1 -- 172.21.15.66:0/4223404176 wait complete. 2024-09-15T22:58:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:07 smithi087 ceph-mon[35290]: pgmap v397: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 138 op/s 2024-09-15T22:58:07.365 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:07 smithi066 ceph-mon[31185]: pgmap v397: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 138 op/s 2024-09-15T22:58:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:07 smithi184 ceph-mon[35203]: pgmap v397: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 138 op/s 2024-09-15T22:58:07.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:58:08.262 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.017+0000 7ff9e0431640 1 -- 172.21.15.66:0/589155919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d810c2f0 msgr2=0x7ff9d810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.017+0000 7ff9e0431640 1 --2- 172.21.15.66:0/589155919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d810c2f0 0x7ff9d810e790 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009ca0 tx=0x7ff9d002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- 172.21.15.66:0/589155919 shutdown_connections 2024-09-15T22:58:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- 172.21.15.66:0/589155919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d810c2f0 0x7ff9d810e790 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- 172.21.15.66:0/589155919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d81037a0 0x7ff9d810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- 172.21.15.66:0/589155919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d8102df0 0x7ff9d81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- 172.21.15.66:0/589155919 >> 172.21.15.66:0/589155919 conn(0x7ff9d80fc7d0 msgr2=0x7ff9d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- 172.21.15.66:0/589155919 shutdown_connections 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- 172.21.15.66:0/589155919 wait complete. 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 Processor -- start 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- start start 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d8102df0 0x7ff9d81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d810c2f0 0x7ff9d819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8112110 con 0x7ff9d81037a0 2024-09-15T22:58:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111f90 con 0x7ff9d810c2f0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.018+0000 7ff9e0431640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8112290 con 0x7ff9d8102df0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d8102df0 0x7ff9d81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44004/0 (socket says 172.21.15.66:44004) 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/2574098457 learned_addr learned my addr 172.21.15.66:0/2574098457 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d810c2f0 0x7ff9d819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/2574098457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d8102df0 msgr2=0x7ff9d81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d8102df0 0x7ff9d81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/2574098457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d810c2f0 msgr2=0x7ff9d819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d810c2f0 0x7ff9d819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/2574098457 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d819d570 con 0x7ff9d81037a0 2024-09-15T22:58:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800e9c0 tx=0x7ff9c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9cf7fe640 1 -- 172.21.15.66:0/2574098457 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800ccc0 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d819d860 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9cf7fe640 1 -- 172.21.15.66:0/2574098457 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c8005500 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9cf7fe640 1 -- 172.21.15.66:0/2574098457 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8010690 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.019+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81a5140 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.022+0000 7ff9cf7fe640 1 -- 172.21.15.66:0/2574098457 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff9c8004e80 con 0x7ff9d81037a0 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.022+0000 7ff9e280a740 1 Processor -- start 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.022+0000 7ff9e280a740 1 -- start start 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561515b892f0 con 0x561515c2e370 2024-09-15T22:58:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561515b30cf0 con 0x561515c24b40 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9e280a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561515b852b0 con 0x561515c235d0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9cf7fe640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 0x7ff9c40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39952/0 (socket says 172.21.15.66:39952) 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de9ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 -- 172.21.15.66:0/1694154531 learned_addr learned my addr 172.21.15.66:0/1694154531 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 0x7ff9c40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9cf7fe640 1 -- 172.21.15.66:0/2574098457 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff9c80d0530 con 0x7ff9d81037a0 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 -- 172.21.15.66:0/1694154531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 msgr2=0x561515c23090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c23090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 -- 172.21.15.66:0/1694154531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 msgr2=0x561515c30760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c30760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.023+0000 7ff9de1cd640 1 -- 172.21.15.66:0/1694154531 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561515b153a0 con 0x561515c235d0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.024+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bd10 tx=0x7ff9d40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f281782859f367b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.024+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 0x7ff9c40a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0005e30 tx=0x7ff9d00095c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.024+0000 7ff9ccdea640 1 -- 172.21.15.66:0/1694154531 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4004030 con 0x561515c235d0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.024+0000 7ff9ccdea640 1 -- 172.21.15.66:0/1694154531 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d4015d30 con 0x561515c235d0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.024+0000 7ff9ccdea640 1 -- 172.21.15.66:0/1694154531 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4003c20 con 0x561515c235d0 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- 172.21.15.66:0/1694154531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 msgr2=0x561515c23a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400bd10 tx=0x7ff9d40107a0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- 172.21.15.66:0/1694154531 shutdown_connections 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c30760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c235d0 0x561515c23a10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1694154531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c23090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- 172.21.15.66:0/1694154531 >> 172.21.15.66:0/1694154531 conn(0x561515bec310 msgr2=0x561515c1fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- 172.21.15.66:0/1694154531 shutdown_connections 2024-09-15T22:58:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- 172.21.15.66:0/1694154531 wait complete. 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 -- start start 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 Processor -- start 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.025+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 0x561515c2dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c2afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561515c31070 con 0x561515c2e370 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561515b44060 con 0x561515c235d0 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561515c311f0 con 0x561515c24b40 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 10 client.0 _ll_register_callbacks cb 0x5615158978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44016/0 (socket says 172.21.15.66:44016) 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 -- 172.21.15.66:0/1954962978 learned_addr learned my addr 172.21.15.66:0/1954962978 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c2afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 0x561515c2dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 -- 172.21.15.66:0/1954962978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 msgr2=0x561515c2afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c2afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 -- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 msgr2=0x561515c2dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 0x561515c2dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 -- 172.21.15.66:0/1954962978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615158fa3c0 con 0x561515c2e370 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 0x561515c2dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c2afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0035000 tx=0x7ff9d002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe23b07b39d484a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0003e20 con 0x561515c2e370 2024-09-15T22:58:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.026+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d4015d30 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff9d00044c0 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff9d00046c0 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 10 client.18228 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561515c3cb10 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d4015d30 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7ff9d00305c0 con 0x561515c2e370 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 10 client.18228 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 10 client.18228 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 20 client.18228 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515c403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 4 client.18228 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.027+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561515b96860 con 0x561515c3df20 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.028+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515c403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.028+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515c403a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f538f7c309545cf server_cookie=7198a511f299a9f8 in_seq=0 out_seq=0 2024-09-15T22:58:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.028+0000 7ff9c1ffb640 10 client.18228 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/1954962978 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561515b96860 con 0x561515c3df20 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9c1ffb640 10 client.18228 handle_command_reply: tid=0 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 client.18228 shutdown 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 msgr2=0x561515c2b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0035000 tx=0x7ff9d002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 shutdown_connections 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515c403a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c2e370 0x561515c2b570 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9c1ffb640 0 client.18228 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c2afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 --2- 172.21.15.66:0/1954962978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c235d0 0x561515c2dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 >> 172.21.15.66:0/1954962978 conn(0x561515bec310 msgr2=0x561515c25960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 shutdown_connections 2024-09-15T22:58:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 1 -- 172.21.15.66:0/1954962978 wait complete. 2024-09-15T22:58:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.029+0000 7ff9e280a740 20 client.18228 trim_cache size 0 max 16384 2024-09-15T22:58:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 Processor -- start 2024-09-15T22:58:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 -- start start 2024-09-15T22:58:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c2e370 0x561515c26120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ad0e0 con 0x561515c235d0 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81aeda0 con 0x561515c2e370 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9e280a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ad870 con 0x561515c24b40 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44032/0 (socket says 172.21.15.66:44032) 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.043+0000 7ff9de1cd640 1 -- 172.21.15.66:0/2872086988 learned_addr learned my addr 172.21.15.66:0/2872086988 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c2e370 0x561515c26120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 -- 172.21.15.66:0/2872086988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 msgr2=0x561515c3a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c3a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 -- 172.21.15.66:0/2872086988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c2e370 msgr2=0x561515c26120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c2e370 0x561515c26120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 -- 172.21.15.66:0/2872086988 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561515c30ad0 con 0x561515c235d0 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c3a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4011010 tx=0x7ff9d400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a83e31a87578831 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9c3fff640 1 -- 172.21.15.66:0/2872086988 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4015d30 con 0x561515c235d0 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9c3fff640 1 -- 172.21.15.66:0/2872086988 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d4005520 con 0x561515c235d0 2024-09-15T22:58:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.044+0000 7ff9c3fff640 1 -- 172.21.15.66:0/2872086988 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4003cc0 con 0x561515c235d0 2024-09-15T22:58:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- 172.21.15.66:0/2872086988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 msgr2=0x561515c1fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4011010 tx=0x7ff9d400b390 comp rx=0 tx=0).stop 2024-09-15T22:58:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- 172.21.15.66:0/2872086988 shutdown_connections 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c2e370 0x561515c26120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c24b40 0x561515c3a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 --2- 172.21.15.66:0/2872086988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c1fe10 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- 172.21.15.66:0/2872086988 >> 172.21.15.66:0/2872086988 conn(0x561515bec310 msgr2=0x561515c1f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- 172.21.15.66:0/2872086988 shutdown_connections 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- 172.21.15.66:0/2872086988 wait complete. 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.045+0000 7ff9e280a740 1 -- start start 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 Processor -- start 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c27ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c2e370 0x561515c281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ae6d0 con 0x561515c235d0 2024-09-15T22:58:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ae000 con 0x561515c24b40 2024-09-15T22:58:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ab0e0 con 0x561515c2e370 2024-09-15T22:58:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9e280a740 10 client.0 _ll_register_callbacks cb 0x7ff9d0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9de1cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44036/0 (socket says 172.21.15.66:44036) 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9de1cd640 1 -- 172.21.15.66:0/3167167629 learned_addr learned my addr 172.21.15.66:0/3167167629 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c27ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9de9ce640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c2e370 0x561515c281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/3167167629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c2e370 msgr2=0x561515c281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c2e370 0x561515c281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/3167167629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 msgr2=0x561515c36ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9dd9cc640 1 -- 172.21.15.66:0/3167167629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561515c288d0 con 0x561515c24b40 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.046+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9dd9cc640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c27ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80cd7f0 tx=0x7ff9c801c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db932120427ea69d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80b4020 con 0x561515c24b40 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9591+0+0 (secure 0 0 0) 0x7ff9c80cda70 con 0x561515c24b40 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9d4005520 con 0x561515c24b40 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff9c800ce60 con 0x561515c24b40 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 10 client.27560 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561515ca8b80 con 0x561515c24b40 2024-09-15T22:58:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d4005520 con 0x561515c24b40 2024-09-15T22:58:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7ff9c80d0120 con 0x561515c24b40 2024-09-15T22:58:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 10 client.27560 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 10 client.27560 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:58:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 20 client.27560 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515cab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 4 client.27560 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.047+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561515b90d70 con 0x561515c3df20 2024-09-15T22:58:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515cab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9c1ffb640 10 client.27560 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9de1cd640 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515cab400 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bfebc91e2215905f server_cookie=a0cab1cd3395fe61 in_seq=0 out_seq=0 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9c1ffb640 1 -- 172.21.15.66:0/3167167629 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561515b90d70 con 0x561515c3df20 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9c1ffb640 10 client.27560 handle_command_reply: tid=0 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 client.27560 shutdown 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 msgr2=0x561515c27ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c27ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80cd7f0 tx=0x7ff9c801c590 comp rx=0 tx=0).stop 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 shutdown_connections 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x561515c3df20 0x561515cab400 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561515c2e370 0x561515c281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561515c24b40 0x561515c27ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9c1ffb640 0 client.27560 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 --2- 172.21.15.66:0/3167167629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561515c235d0 0x561515c36ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 >> 172.21.15.66:0/3167167629 conn(0x561515bec310 msgr2=0x561515c2c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 shutdown_connections 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.048+0000 7ff9e280a740 1 -- 172.21.15.66:0/3167167629 wait complete. 2024-09-15T22:58:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e280a740 20 client.27560 trim_cache size 0 max 16384 2024-09-15T22:58:09.063 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 msgr2=0x7ff9c40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 0x7ff9c40a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0005e30 tx=0x7ff9d00095c0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 msgr2=0x7ff9d8198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800e9c0 tx=0x7ff9c800ee80 comp rx=0 tx=0).stop 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 shutdown_connections 2024-09-15T22:58:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9c40a3430 0x7ff9c40a58f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d810c2f0 0x7ff9d819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d81037a0 0x7ff9d8198b00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 --2- 172.21.15.66:0/2574098457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d8102df0 0x7ff9d81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 >> 172.21.15.66:0/2574098457 conn(0x7ff9d80fc7d0 msgr2=0x7ff9d80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 shutdown_connections 2024-09-15T22:58:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:09.049+0000 7ff9e0431640 1 -- 172.21.15.66:0/2574098457 wait complete. 2024-09-15T22:58:09.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:09 smithi066 ceph-mon[31185]: pgmap v398: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-09-15T22:58:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:09 smithi087 ceph-mon[35290]: pgmap v398: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-09-15T22:58:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:09 smithi184 ceph-mon[35203]: pgmap v398: 129 pgs: 129 active+clean; 2.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-09-15T22:58:10.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:58:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:11 smithi184 ceph-mon[35203]: pgmap v399: 129 pgs: 129 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-15T22:58:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:11 smithi184 ceph-mon[35203]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:58:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 -- 172.21.15.66:0/3722903406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf8101e10 msgr2=0x7fcaf81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 --2- 172.21.15.66:0/3722903406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf8101e10 0x7fcaf81021f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009900 tx=0x7fcae802a410 comp rx=0 tx=0).stop 2024-09-15T22:58:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 -- 172.21.15.66:0/3722903406 shutdown_connections 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 --2- 172.21.15.66:0/3722903406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 0x7fcaf810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 --2- 172.21.15.66:0/3722903406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf81027c0 0x7fcaf8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 --2- 172.21.15.66:0/3722903406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf8101e10 0x7fcaf81021f0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 -- 172.21.15.66:0/3722903406 >> 172.21.15.66:0/3722903406 conn(0x7fcaf80fd8d0 msgr2=0x7fcaf80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 -- 172.21.15.66:0/3722903406 shutdown_connections 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.209+0000 7fcafe394640 1 -- 172.21.15.66:0/3722903406 wait complete. 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 Processor -- start 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 -- start start 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf8101e10 0x7fcaf8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 0x7fcaf819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8111fa0 con 0x7fcaf81027c0 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8111e20 con 0x7fcaf8106f40 2024-09-15T22:58:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafe394640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8112120 con 0x7fcaf8101e10 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44052/0 (socket says 172.21.15.66:44052) 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 -- 172.21.15.66:0/3829469424 learned_addr learned my addr 172.21.15.66:0/3829469424 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf8101e10 0x7fcaf8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcafc931640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 0x7fcaf819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 -- 172.21.15.66:0/3829469424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf8101e10 msgr2=0x7fcaf8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf8101e10 0x7fcaf8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 -- 172.21.15.66:0/3829469424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 msgr2=0x7fcaf819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.210+0000 7fcaeffff640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 0x7fcaf819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcaeffff640 1 -- 172.21.15.66:0/3829469424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf819d410 con 0x7fcaf81027c0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcaeffff640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcaf5ffb640 1 -- 172.21.15.66:0/3829469424 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cd80 con 0x7fcaf81027c0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf819d700 con 0x7fcaf81027c0 2024-09-15T22:58:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcaf5ffb640 1 -- 172.21.15.66:0/3829469424 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae0005500 con 0x7fcaf81027c0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcaf5ffb640 1 -- 172.21.15.66:0/3829469424 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0010690 con 0x7fcaf81027c0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.211+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf81a4fe0 con 0x7fcaf81027c0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.215+0000 7fcb0076d740 1 Processor -- start 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.217+0000 7fcaf5ffb640 1 -- 172.21.15.66:0/3829469424 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcae00046c0 con 0x7fcaf81027c0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.218+0000 7fcaf5ffb640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 0x7fcae40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.218+0000 7fcb0076d740 1 -- start start 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.218+0000 7fcaf5ffb640 1 -- 172.21.15.66:0/3829469424 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fcae00d05e0 con 0x7fcaf81027c0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1011090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1011a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa101e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563fa0f772f0 con 0x563fa101c370 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563fa0f1ecf0 con 0x563fa10115d0 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcb0076d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563fa0f732b0 con 0x563fa1012b40 2024-09-15T22:58:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcafc931640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 0x7fcae40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcafc931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa101e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1011a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60490/0 (socket says 172.21.15.66:60490) 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.219+0000 7fcaeffff640 1 -- 172.21.15.66:0/975946676 learned_addr learned my addr 172.21.15.66:0/975946676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 0x7fcae40a58f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005fd0 tx=0x7fcaf0013ae0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 -- 172.21.15.66:0/975946676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 msgr2=0x563fa1011090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1011090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 -- 172.21.15.66:0/975946676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 msgr2=0x563fa1011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 -- 172.21.15.66:0/975946676 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa0f033a0 con 0x563fa101c370 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.220+0000 7fcafc931640 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa101e760 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000f3c0 tx=0x7fcaf001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18131f4f3e8d15d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.221+0000 7fcaee7fc640 1 -- 172.21.15.66:0/975946676 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004b20 con 0x563fa101c370 2024-09-15T22:58:11.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.221+0000 7fcaee7fc640 1 -- 172.21.15.66:0/975946676 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0004cc0 con 0x563fa101c370 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.221+0000 7fcaee7fc640 1 -- 172.21.15.66:0/975946676 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0005220 con 0x563fa101c370 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- 172.21.15.66:0/975946676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 msgr2=0x563fa101e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa101e760 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000f3c0 tx=0x7fcaf001d000 comp rx=0 tx=0).stop 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- 172.21.15.66:0/975946676 shutdown_connections 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa101e760 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1011a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 --2- 172.21.15.66:0/975946676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1011090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- 172.21.15.66:0/975946676 >> 172.21.15.66:0/975946676 conn(0x563fa0fda310 msgr2=0x563fa100dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- 172.21.15.66:0/975946676 shutdown_connections 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- 172.21.15.66:0/975946676 wait complete. 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.222+0000 7fcb0076d740 1 -- start start 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 Processor -- start 2024-09-15T22:58:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa101bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 0x563fa1019600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563fa1023470 con 0x563fa1012b40 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563fa0f32060 con 0x563fa10115d0 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563fa10235f0 con 0x563fa101c370 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcb0076d740 10 client.0 _ll_register_callbacks cb 0x563fa0c858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcaf7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa101bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44076/0 (socket says 172.21.15.66:44076) 2024-09-15T22:58:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcaeffff640 1 -- 172.21.15.66:0/1688190790 learned_addr learned my addr 172.21.15.66:0/1688190790 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.223+0000 7fcafc931640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 0x563fa1019600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 -- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 msgr2=0x563fa1019600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 0x563fa1019600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 -- 172.21.15.66:0/1688190790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 msgr2=0x563fa101bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa101bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 -- 172.21.15.66:0/1688190790 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa0ce83c0 con 0x563fa1012b40 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcafc931640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 0x563fa1019600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcaeffff640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcae009c370 tx=0x7fcae009be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54e42bc54c93bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae00ba060 con 0x563fa1012b40 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.224+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fcae00a4bc0 con 0x563fa1012b40 2024-09-15T22:58:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0004cc0 con 0x563fa1012b40 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fcae00ac050 con 0x563fa1012b40 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 10 client.18246 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x563fa102ef70 con 0x563fa1012b40 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0004cc0 con 0x563fa1012b40 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fcae00a7030 con 0x563fa1012b40 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 10 client.18246 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 10 client.18246 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 20 client.18246 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa1030430 0x563fa1032840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 4 client.18246 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.225+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa0f84860 con 0x563fa1030430 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.226+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa1030430 0x563fa1032840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.226+0000 7fcad77fe640 10 client.18246 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:58:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.226+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa1030430 0x563fa1032840 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3053a08d43558646 server_cookie=31f32e6e610eadfa in_seq=0 out_seq=0 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.227+0000 7fcad77fe640 1 -- 172.21.15.66:0/1688190790 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fa0f84860 con 0x563fa1030430 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.227+0000 7fcad77fe640 10 client.18246 handle_command_reply: tid=0 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.227+0000 7fcb0076d740 1 client.18246 shutdown 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 msgr2=0x563fa1019010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcae009c370 tx=0x7fcae009be00 comp rx=0 tx=0).stop 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 shutdown_connections 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa1030430 0x563fa1032840 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcad77fe640 0 client.18246 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa101c370 0x563fa1019600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa1012b40 0x563fa1019010 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 --2- 172.21.15.66:0/1688190790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa101bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 >> 172.21.15.66:0/1688190790 conn(0x563fa0fda310 msgr2=0x563fa1013960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 shutdown_connections 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 1 -- 172.21.15.66:0/1688190790 wait complete. 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.228+0000 7fcb0076d740 20 client.18246 trim_cache size 0 max 16384 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.250+0000 7fcb0076d740 1 Processor -- start 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcb0076d740 1 -- start start 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa10115d0 0x563fa102c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 0x563fa1038110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa1038650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcb0076d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ad1d0 con 0x563fa101c370 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 0x563fa1038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 0x563fa1038110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60508/0 (socket says 172.21.15.66:60508) 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.251+0000 7fcaeffff640 1 -- 172.21.15.66:0/2108331779 learned_addr learned my addr 172.21.15.66:0/2108331779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.252+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81aee90 con 0x563fa1012b40 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.252+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ad960 con 0x563fa10115d0 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.252+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa10115d0 0x563fa102c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.252+0000 7fcafc931640 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa1038650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 -- 172.21.15.66:0/2108331779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa10115d0 msgr2=0x563fa102c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa10115d0 0x563fa102c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 -- 172.21.15.66:0/2108331779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 msgr2=0x563fa1038110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 0x563fa1038110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 -- 172.21.15.66:0/2108331779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa1014120 con 0x563fa101c370 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.253+0000 7fcafc931640 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa1038650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009dc0 tx=0x7fcaf00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390b78295bceb64f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.254+0000 7fcaedffb640 1 -- 172.21.15.66:0/2108331779 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0005e30 con 0x563fa101c370 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.254+0000 7fcaedffb640 1 -- 172.21.15.66:0/2108331779 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0032d90 con 0x563fa101c370 2024-09-15T22:58:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.254+0000 7fcaedffb640 1 -- 172.21.15.66:0/2108331779 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00045a0 con 0x563fa101c370 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.255+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 msgr2=0x563fa1038650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.255+0000 7fcb0076d740 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa1038650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009dc0 tx=0x7fcaf00047e0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.261+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 shutdown_connections 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.261+0000 7fcb0076d740 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa1038650 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.261+0000 7fcb0076d740 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa1012b40 0x563fa1038110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.261+0000 7fcb0076d740 1 --2- 172.21.15.66:0/2108331779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa10115d0 0x563fa102c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.261+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 >> 172.21.15.66:0/2108331779 conn(0x563fa0fda310 msgr2=0x563fa1018100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.264+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 shutdown_connections 2024-09-15T22:58:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.264+0000 7fcb0076d740 1 -- 172.21.15.66:0/2108331779 wait complete. 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.264+0000 7fcb0076d740 1 -- start start 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.265+0000 7fcb0076d740 1 Processor -- start 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1028880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1028dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ae7c0 con 0x563fa101c370 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ae0f0 con 0x563fa10115d0 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ab1d0 con 0x563fa1012b40 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.266+0000 7fcb0076d740 10 client.0 _ll_register_callbacks cb 0x7fcae00cd7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.267+0000 7fcafc931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.267+0000 7fcafc931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44080/0 (socket says 172.21.15.66:44080) 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.267+0000 7fcafc931640 1 -- 172.21.15.66:0/4077011929 learned_addr learned my addr 172.21.15.66:0/4077011929 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.268+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1028880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.269+0000 7fcafc931640 1 -- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 msgr2=0x563fa1028dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.269+0000 7fcafc931640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1028dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.269+0000 7fcafc931640 1 -- 172.21.15.66:0/4077011929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 msgr2=0x563fa1028880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.269+0000 7fcafc931640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1028880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.269+0000 7fcafc931640 1 -- 172.21.15.66:0/4077011929 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa1029520 con 0x563fa101c370 2024-09-15T22:58:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.270+0000 7fcafc931640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000f460 tx=0x7fcaf0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c6a284ce966b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.270+0000 7fcad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.270+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00045a0 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.270+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0032d90 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.270+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fcaf0005250 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.271+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fcaf0043050 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.272+0000 7fcb0076d740 10 client.18252 fetch_fsmap learned FSMap version 54 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.272+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x563fa10a86f0 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0032d90 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fcaf0032560 con 0x563fa101c370 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 10 client.18252 fetch_fsmap finished waiting for FSMap version 54 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 10 client.18252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 20 client.18252 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa10a8d00 0x563fa10ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 4 client.18252 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.273+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563fa0f7ed70 con 0x563fa10a8d00 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.278+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa10a8d00 0x563fa10ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.285+0000 7fcaf7fff640 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa10a8d00 0x563fa10ab0f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4124680575c1e9dc server_cookie=e1c7d6700683061b in_seq=0 out_seq=0 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.285+0000 7fcad77fe640 10 client.18252 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.287+0000 7fcad77fe640 1 -- 172.21.15.66:0/4077011929 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563fa0f7ed70 con 0x563fa10a8d00 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.287+0000 7fcad77fe640 10 client.18252 handle_command_reply: tid=0 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.287+0000 7fcb0076d740 1 client.18252 shutdown 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.288+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 msgr2=0x563fa10201c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.288+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000f460 tx=0x7fcaf0004d00 comp rx=0 tx=0).stop 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 shutdown_connections 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563fa10a8d00 0x563fa10ab0f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563fa101c370 0x563fa10201c0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563fa1012b40 0x563fa1028dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 --2- 172.21.15.66:0/4077011929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fa10115d0 0x563fa1028880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 >> 172.21.15.66:0/4077011929 conn(0x563fa0fda310 msgr2=0x563fa100c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcad77fe640 0 client.18252 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.289+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 shutdown_connections 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.293+0000 7fcb0076d740 1 -- 172.21.15.66:0/4077011929 wait complete. 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.293+0000 7fcb0076d740 20 client.18252 trim_cache size 0 max 16384 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 msgr2=0x7fcae40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 0x7fcae40a58f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005fd0 tx=0x7fcaf0013ae0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 msgr2=0x7fcaf81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 shutdown_connections 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcae40a3430 0x7fcae40a58f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaf8106f40 0x7fcaf819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaf81027c0 0x7fcaf81989a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 --2- 172.21.15.66:0/3829469424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaf8101e10 0x7fcaf8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 >> 172.21.15.66:0/3829469424 conn(0x7fcaf80fd8d0 msgr2=0x7fcaf80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 shutdown_connections 2024-09-15T22:58:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:11.295+0000 7fcafe394640 1 -- 172.21.15.66:0/3829469424 wait complete. 2024-09-15T22:58:11.471 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:11 smithi066 ceph-mon[31185]: pgmap v399: 129 pgs: 129 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-15T22:58:11.471 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:11 smithi066 ceph-mon[31185]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:58:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:11 smithi087 ceph-mon[35290]: pgmap v399: 129 pgs: 129 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 233 op/s 2024-09-15T22:58:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:11 smithi087 ceph-mon[35290]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:58:12.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:58:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:13 smithi184 ceph-mon[35203]: pgmap v401: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-09-15T22:58:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:13 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:13 smithi066 ceph-mon[31185]: pgmap v401: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-09-15T22:58:13.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:13 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:13 smithi087 ceph-mon[35290]: pgmap v401: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-09-15T22:58:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:13 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.201+0000 7f0d56407640 1 -- 172.21.15.66:0/3351059293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 msgr2=0x7f0d5011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.201+0000 7f0d56407640 1 --2- 172.21.15.66:0/3351059293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d5011d530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009860 tx=0x7f0d4402a360 comp rx=0 tx=0).stop 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 -- 172.21.15.66:0/3351059293 shutdown_connections 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 --2- 172.21.15.66:0/3351059293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d5011d530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 --2- 172.21.15.66:0/3351059293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109830 0x7f0d50109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 --2- 172.21.15.66:0/3351059293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109450 0x7f0d50110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 -- 172.21.15.66:0/3351059293 >> 172.21.15.66:0/3351059293 conn(0x7f0d5006e140 msgr2=0x7f0d5006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.208+0000 7f0d56407640 1 -- 172.21.15.66:0/3351059293 shutdown_connections 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.209+0000 7f0d56407640 1 -- 172.21.15.66:0/3351059293 wait complete. 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 Processor -- start 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 -- start start 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109450 0x7f0d501185b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 0x7f0d50118af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d50111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d50120df0 con 0x7f0d50109830 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d50120c70 con 0x7f0d50109450 2024-09-15T22:58:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.210+0000 7f0d56407640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d50120f70 con 0x7f0d5011b140 2024-09-15T22:58:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.211+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 0x7f0d50118af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.211+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 0x7f0d50118af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36820/0 (socket says 172.21.15.66:36820) 2024-09-15T22:58:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.211+0000 7f0d4f7fe640 1 -- 172.21.15.66:0/3730356658 learned_addr learned my addr 172.21.15.66:0/3730356658 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d50111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109450 0x7f0d501185b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 -- 172.21.15.66:0/3730356658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109450 msgr2=0x7f0d501185b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109450 0x7f0d501185b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 -- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 msgr2=0x7f0d50118af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 0x7f0d50118af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.212+0000 7f0d549a4640 1 -- 172.21.15.66:0/3730356658 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d50112020 con 0x7f0d5011b140 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.213+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d50111760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d4402a950 tx=0x7f0d44033ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.213+0000 7f0d4d7fa640 1 -- 172.21.15.66:0/3730356658 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44037040 con 0x7f0d5011b140 2024-09-15T22:58:15.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.214+0000 7f0d4d7fa640 1 -- 172.21.15.66:0/3730356658 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d44040070 con 0x7f0d5011b140 2024-09-15T22:58:15.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.214+0000 7f0d4d7fa640 1 -- 172.21.15.66:0/3730356658 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44003e60 con 0x7f0d5011b140 2024-09-15T22:58:15.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.215+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d501122b0 con 0x7f0d5011b140 2024-09-15T22:58:15.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.215+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d501162b0 con 0x7f0d5011b140 2024-09-15T22:58:15.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.220+0000 7f0d4d7fa640 1 -- 172.21.15.66:0/3730356658 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0d4403b430 con 0x7f0d5011b140 2024-09-15T22:58:15.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.221+0000 7f0d4d7fa640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 0x7f0d380a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.221+0000 7f0d4d7fa640 1 -- 172.21.15.66:0/3730356658 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f0d440f08f0 con 0x7f0d5011b140 2024-09-15T22:58:15.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 Processor -- start 2024-09-15T22:58:15.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 0x7f0d380a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 -- start start 2024-09-15T22:58:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 0x561869da0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869da0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561869d062f0 con 0x561869dab370 2024-09-15T22:58:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561869cadcf0 con 0x561869da1b40 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.224+0000 7f0d587e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561869d022b0 con 0x561869da05d0 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.225+0000 7f0d549a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.225+0000 7f0d549a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36832/0 (socket says 172.21.15.66:36832) 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.225+0000 7f0d549a4640 1 -- 172.21.15.66:0/1212261856 learned_addr learned my addr 172.21.15.66:0/1212261856 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.225+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 0x561869da0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.225+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 0x7f0d380a5a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0d400043c0 tx=0x7f0d4000ba60 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4f7fe640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869da0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1212261856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 msgr2=0x561869da0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869da0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1212261856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 msgr2=0x561869dad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d4ffff640 1 -- 172.21.15.66:0/1212261856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561869c923a0 con 0x561869da1b40 2024-09-15T22:58:15.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.226+0000 7f0d549a4640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:15.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.229+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 0x561869da0090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d4001a000 tx=0x7f0d4001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cc3d4e1068d1862 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.231+0000 7f0d367fc640 1 -- 172.21.15.66:0/1212261856 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d400130d0 con 0x561869da1b40 2024-09-15T22:58:15.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.231+0000 7f0d367fc640 1 -- 172.21.15.66:0/1212261856 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d40013270 con 0x561869da1b40 2024-09-15T22:58:15.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.232+0000 7f0d587e0740 1 -- 172.21.15.66:0/1212261856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 msgr2=0x561869da0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.232+0000 7f0d587e0740 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 0x561869da0090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d4001a000 tx=0x7f0d4001b000 comp rx=0 tx=0).stop 2024-09-15T22:58:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.236+0000 7f0d587e0740 1 -- 172.21.15.66:0/1212261856 shutdown_connections 2024-09-15T22:58:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.236+0000 7f0d587e0740 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869dab370 0x561869dad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.236+0000 7f0d587e0740 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869da0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.236+0000 7f0d587e0740 1 --2- 172.21.15.66:0/1212261856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869da1b40 0x561869da0090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.236+0000 7f0d587e0740 1 -- 172.21.15.66:0/1212261856 >> 172.21.15.66:0/1212261856 conn(0x561869d69310 msgr2=0x561869d9cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.241+0000 7f0d587e0740 1 -- 172.21.15.66:0/1212261856 shutdown_connections 2024-09-15T22:58:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.242+0000 7f0d587e0740 1 -- 172.21.15.66:0/1212261856 wait complete. 2024-09-15T22:58:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.243+0000 7f0d587e0740 1 -- start start 2024-09-15T22:58:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.243+0000 7f0d587e0740 1 Processor -- start 2024-09-15T22:58:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.243+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869daac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.243+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869da8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d587e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561869dae0c0 con 0x561869da1b40 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36848/0 (socket says 172.21.15.66:36848) 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d4f7fe640 1 -- 172.21.15.66:0/247593725 learned_addr learned my addr 172.21.15.66:0/247593725 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d587e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561869cc1060 con 0x561869dab370 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561869dae240 con 0x561869da05d0 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d587e0740 10 client.0 _ll_register_callbacks cb 0x561869a148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.244+0000 7f0d549a4640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869da8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 -- 172.21.15.66:0/247593725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 msgr2=0x561869daac50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869daac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 -- 172.21.15.66:0/247593725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 msgr2=0x561869da7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 -- 172.21.15.66:0/247593725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561869a773c0 con 0x561869dab370 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d4f7fe640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.245+0000 7f0d549a4640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869da8440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d440c4f40 tx=0x7f0d440bc220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=285f247ddb2d717c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.246+0000 7f0d2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:15.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.248+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440d5060 con 0x561869dab370 2024-09-15T22:58:15.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.249+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f0d440bca60 con 0x561869dab370 2024-09-15T22:58:15.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.251+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d40013270 con 0x561869dab370 2024-09-15T22:58:15.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.254+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0d440da050 con 0x561869dab370 2024-09-15T22:58:15.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.254+0000 7f0d587e0740 10 client.27590 fetch_fsmap learned FSMap version 55 2024-09-15T22:58:15.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.255+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x561869db9b50 con 0x561869dab370 2024-09-15T22:58:15.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.259+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d440bc800 con 0x561869dab370 2024-09-15T22:58:15.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.259+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 55) ==== 8406+0+0 (secure 0 0 0) 0x7f0d4403a070 con 0x561869dab370 2024-09-15T22:58:15.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 10 client.27590 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:58:15.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 10 client.27590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:15.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 20 client.27590 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869dbb080 0x561869dbd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 4 client.27590 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0d40013270 con 0x561869dbb080 2024-09-15T22:58:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.260+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869dbb080 0x561869dbd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.261+0000 7f0d2f7fe640 10 client.27590 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.263+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869dbb080 0x561869dbd520 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad44f07c5cffb6d server_cookie=3c8d198bb4dcc7e1 in_seq=0 out_seq=0 2024-09-15T22:58:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.266+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/247593725 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0d40013270 con 0x561869dbb080 2024-09-15T22:58:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.266+0000 7f0d2f7fe640 10 client.27590 handle_command_reply: tid=0 2024-09-15T22:58:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.266+0000 7f0d587e0740 1 client.27590 shutdown 2024-09-15T22:58:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 msgr2=0x561869da8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869da8440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d440c4f40 tx=0x7f0d440bc220 comp rx=0 tx=0).stop 2024-09-15T22:58:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 shutdown_connections 2024-09-15T22:58:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869dbb080 0x561869dbd520 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869da8440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869da7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 --2- 172.21.15.66:0/247593725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869daac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d2f7fe640 0 client.27590 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.267+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 >> 172.21.15.66:0/247593725 conn(0x561869d69310 msgr2=0x561869da2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.268+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 shutdown_connections 2024-09-15T22:58:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.268+0000 7f0d587e0740 1 -- 172.21.15.66:0/247593725 wait complete. 2024-09-15T22:58:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.269+0000 7f0d587e0740 20 client.27590 trim_cache size 0 max 16384 2024-09-15T22:58:15.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.296+0000 7f0d587e0740 1 Processor -- start 2024-09-15T22:58:15.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.299+0000 7f0d587e0740 1 -- start start 2024-09-15T22:58:15.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da05d0 0x561869daa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 0x561869db7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c010390 con 0x561869da05d0 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c012050 con 0x561869dab370 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d587e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c010b20 con 0x561869da1b40 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 0x561869db7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 0x561869db7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48470/0 (socket says 172.21.15.66:48470) 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.300+0000 7f0d4f7fe640 1 -- 172.21.15.66:0/3905116393 learned_addr learned my addr 172.21.15.66:0/3905116393 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.301+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.304 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:15 smithi066 ceph-mon[31185]: pgmap v402: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 245 op/s 2024-09-15T22:58:15.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.301+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da05d0 0x561869daa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 -- 172.21.15.66:0/3905116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 msgr2=0x561869db7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 0x561869db7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 -- 172.21.15.66:0/3905116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da05d0 msgr2=0x561869daa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da05d0 0x561869daa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 -- 172.21.15.66:0/3905116393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561869dbdba0 con 0x561869dab370 2024-09-15T22:58:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.303+0000 7f0d549a4640 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db7980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d440bc790 tx=0x7f0d44033f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=263f51e4f53685ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.309+0000 7f0d35ffb640 1 -- 172.21.15.66:0/3905116393 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440bc800 con 0x561869dab370 2024-09-15T22:58:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.309+0000 7f0d35ffb640 1 -- 172.21.15.66:0/3905116393 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d440c0bb0 con 0x561869dab370 2024-09-15T22:58:15.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.309+0000 7f0d35ffb640 1 -- 172.21.15.66:0/3905116393 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440bcc70 con 0x561869dab370 2024-09-15T22:58:15.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.310+0000 7f0d587e0740 1 -- 172.21.15.66:0/3905116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 msgr2=0x561869db7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.310+0000 7f0d587e0740 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db7980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d440bc790 tx=0x7f0d44033f10 comp rx=0 tx=0).stop 2024-09-15T22:58:15.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.311+0000 7f0d587e0740 1 -- 172.21.15.66:0/3905116393 shutdown_connections 2024-09-15T22:58:15.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.311+0000 7f0d587e0740 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db7980 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.311+0000 7f0d587e0740 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da1b40 0x561869db7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.311+0000 7f0d587e0740 1 --2- 172.21.15.66:0/3905116393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da05d0 0x561869daa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.311+0000 7f0d587e0740 1 -- 172.21.15.66:0/3905116393 >> 172.21.15.66:0/3905116393 conn(0x561869d69310 msgr2=0x561869da7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.314+0000 7f0d587e0740 1 -- 172.21.15.66:0/3905116393 shutdown_connections 2024-09-15T22:58:15.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.314+0000 7f0d587e0740 1 -- 172.21.15.66:0/3905116393 wait complete. 2024-09-15T22:58:15.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.315+0000 7f0d587e0740 1 -- start start 2024-09-15T22:58:15.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 Processor -- start 2024-09-15T22:58:15.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869db35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869db3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c011980 con 0x561869da1b40 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.316+0000 7f0d587e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0112b0 con 0x561869dab370 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d587e0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c00e390 con 0x561869da05d0 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d587e0740 10 client.0 _ll_register_callbacks cb 0x7f0d44005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869db35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d549a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d549a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54418/0 (socket says 172.21.15.66:54418) 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.317+0000 7f0d549a4640 1 -- 172.21.15.66:0/541564978 learned_addr learned my addr 172.21.15.66:0/541564978 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.318+0000 7f0d549a4640 1 -- 172.21.15.66:0/541564978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 msgr2=0x561869db35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.318+0000 7f0d549a4640 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869db35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.318+0000 7f0d549a4640 1 -- 172.21.15.66:0/541564978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 msgr2=0x561869db3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:15.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.318+0000 7f0d549a4640 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869db3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.318+0000 7f0d549a4640 1 -- 172.21.15.66:0/541564978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561869d9d960 con 0x561869dab370 2024-09-15T22:58:15.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.320+0000 7f0d549a4640 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d440bc500 tx=0x7f0d44005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d69537b462c6f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:15.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.320+0000 7f0d2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.320+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440d5040 con 0x561869dab370 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.321+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d440c0bb0 con 0x561869dab370 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.321+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f0d44030750 con 0x561869dab370 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.321+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0d440b8aa0 con 0x561869dab370 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.321+0000 7f0d587e0740 10 client.27596 fetch_fsmap learned FSMap version 55 2024-09-15T22:58:15.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.321+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x561869dadf50 con 0x561869dab370 2024-09-15T22:58:15.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d440c0bb0 con 0x561869dab370 2024-09-15T22:58:15.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 55) ==== 8406+0+0 (secure 0 0 0) 0x7f0d4403a070 con 0x561869dab370 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 10 client.27596 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 10 client.27596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 20 client.27596 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869e262b0 0x561869e286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 4 client.27596 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:15.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.322+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561869d13860 con 0x561869e262b0 2024-09-15T22:58:15.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869e262b0 0x561869e286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:15.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d4ffff640 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869e262b0 0x561869e286a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c065f3abc94d195 server_cookie=f2511b268c5a5752 in_seq=0 out_seq=0 2024-09-15T22:58:15.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d2f7fe640 10 client.27596 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:15.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d2f7fe640 1 -- 172.21.15.66:0/541564978 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561869d13860 con 0x561869e262b0 2024-09-15T22:58:15.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d2f7fe640 10 client.27596 handle_command_reply: tid=0 2024-09-15T22:58:15.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.324+0000 7f0d587e0740 1 client.27596 shutdown 2024-09-15T22:58:15.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.326+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 msgr2=0x561869db0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.326+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d440bc500 tx=0x7f0d44005f90 comp rx=0 tx=0).stop 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 shutdown_connections 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561869e262b0 0x561869e286a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561869dab370 0x561869db0580 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561869da1b40 0x561869db3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 --2- 172.21.15.66:0/541564978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561869da05d0 0x561869db35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.327+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 >> 172.21.15.66:0/541564978 conn(0x561869d69310 msgr2=0x561869d9b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.330+0000 7f0d2f7fe640 0 client.27596 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:15.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.330+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 shutdown_connections 2024-09-15T22:58:15.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.330+0000 7f0d587e0740 1 -- 172.21.15.66:0/541564978 wait complete. 2024-09-15T22:58:15.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.330+0000 7f0d587e0740 20 client.27596 trim_cache size 0 max 16384 2024-09-15T22:58:15.333 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 msgr2=0x7f0d380a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 0x7f0d380a5a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0d400043c0 tx=0x7f0d4000ba60 comp rx=0 tx=0).stop 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 msgr2=0x7f0d50111760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d50111760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d4402a950 tx=0x7f0d44033ae0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 shutdown_connections 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d380a3540 0x7f0d380a5a00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5011b140 0x7f0d50111760 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d50109830 0x7f0d50118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 --2- 172.21.15.66:0/3730356658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d50109450 0x7f0d501185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 >> 172.21.15.66:0/3730356658 conn(0x7f0d5006e140 msgr2=0x7f0d5011bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 shutdown_connections 2024-09-15T22:58:15.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:15.331+0000 7f0d56407640 1 -- 172.21.15.66:0/3730356658 wait complete. 2024-09-15T22:58:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:15 smithi184 ceph-mon[35203]: pgmap v402: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 245 op/s 2024-09-15T22:58:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:15 smithi087 ceph-mon[35290]: pgmap v402: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 245 op/s 2024-09-15T22:58:17.137 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:58:17.137 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:58:17.400 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:17 smithi087 ceph-mon[35290]: pgmap v403: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-15T22:58:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:17 smithi184 ceph-mon[35203]: pgmap v403: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-15T22:58:17.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:17 smithi066 ceph-mon[31185]: pgmap v403: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 2.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 227 op/s 2024-09-15T22:58:17.640 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:18.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.260+0000 7fd05b13c640 1 -- 172.21.15.66:0/1812933586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109830 msgr2=0x7fd054109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.260+0000 7fd05b13c640 1 --2- 172.21.15.66:0/1812933586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109830 0x7fd054109c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd040009860 tx=0x7fd04002a360 comp rx=0 tx=0).stop 2024-09-15T22:58:18.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 -- 172.21.15.66:0/1812933586 shutdown_connections 2024-09-15T22:58:18.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 --2- 172.21.15.66:0/1812933586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 0x7fd05411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 --2- 172.21.15.66:0/1812933586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109830 0x7fd054109c90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 --2- 172.21.15.66:0/1812933586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109450 0x7fd054110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 -- 172.21.15.66:0/1812933586 >> 172.21.15.66:0/1812933586 conn(0x7fd05406e140 msgr2=0x7fd05406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 -- 172.21.15.66:0/1812933586 shutdown_connections 2024-09-15T22:58:18.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 -- 172.21.15.66:0/1812933586 wait complete. 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.262+0000 7fd05b13c640 1 Processor -- start 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.263+0000 7fd05b13c640 1 -- start start 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.263+0000 7fd05b13c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 0x7fd05411a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.263+0000 7fd05b13c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 0x7fd0541167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 0x7fd05411a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd05b13c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 0x7fd054116d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 0x7fd05411a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54438/0 (socket says 172.21.15.66:54438) 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd05b13c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd054113340 con 0x7fd054109830 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd058ed8640 1 -- 172.21.15.66:0/120406063 learned_addr learned my addr 172.21.15.66:0/120406063 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541131c0 con 0x7fd054109450 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541134c0 con 0x7fd05411b140 2024-09-15T22:58:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd053fff640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 0x7fd0541167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.264+0000 7fd0596d9640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 0x7fd054116d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.266+0000 7fd053fff640 1 -- 172.21.15.66:0/120406063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 msgr2=0x7fd054116d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.266+0000 7fd053fff640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 0x7fd054116d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.266+0000 7fd053fff640 1 -- 172.21.15.66:0/120406063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 msgr2=0x7fd05411a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.266+0000 7fd053fff640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 0x7fd05411a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.266+0000 7fd053fff640 1 -- 172.21.15.66:0/120406063 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd054117290 con 0x7fd054109830 2024-09-15T22:58:18.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.267+0000 7fd053fff640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 0x7fd0541167e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd040035040 tx=0x7fd040033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.275+0000 7fd051ffb640 1 -- 172.21.15.66:0/120406063 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040037040 con 0x7fd054109830 2024-09-15T22:58:18.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.275+0000 7fd051ffb640 1 -- 172.21.15.66:0/120406063 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd040040070 con 0x7fd054109830 2024-09-15T22:58:18.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.275+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd054117520 con 0x7fd054109830 2024-09-15T22:58:18.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.275+0000 7fd051ffb640 1 -- 172.21.15.66:0/120406063 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040003960 con 0x7fd054109830 2024-09-15T22:58:18.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.276+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0541ab390 con 0x7fd054109830 2024-09-15T22:58:18.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.279+0000 7fd05d515740 1 Processor -- start 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 -- start start 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564caf01e280 con 0x564caf0c3d40 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564caefc5b10 con 0x564caf0b9480 2024-09-15T22:58:18.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd05d515740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564caf01a240 con 0x564caf0b8b60 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd053fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd053fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36882/0 (socket says 172.21.15.66:36882) 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd053fff640 1 -- 172.21.15.66:0/135593732 learned_addr learned my addr 172.21.15.66:0/135593732 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.280+0000 7fd0596d9640 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd058ed8640 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd053fff640 1 -- 172.21.15.66:0/135593732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 msgr2=0x564caf0b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd053fff640 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0b8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd053fff640 1 -- 172.21.15.66:0/135593732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 msgr2=0x564caf0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd053fff640 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.281+0000 7fd053fff640 1 -- 172.21.15.66:0/135593732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564caefd21f0 con 0x564caf0c3d40 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.283+0000 7fd053fff640 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd04002a950 tx=0x7fd0400044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4050520bb167673 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.283+0000 7fd051ffb640 1 -- 172.21.15.66:0/120406063 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd040030580 con 0x7fd054109830 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.284+0000 7fd051ffb640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 0x7fd0440a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.285+0000 7fd051ffb640 1 -- 172.21.15.66:0/120406063 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fd0400f1070 con 0x7fd054109830 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.285+0000 7fd03effd640 1 -- 172.21.15.66:0/135593732 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b9560 con 0x564caf0c3d40 2024-09-15T22:58:18.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.285+0000 7fd03effd640 1 -- 172.21.15.66:0/135593732 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0400bd2c0 con 0x564caf0c3d40 2024-09-15T22:58:18.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.285+0000 7fd03effd640 1 -- 172.21.15.66:0/135593732 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400bcc20 con 0x564caf0c3d40 2024-09-15T22:58:18.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.286+0000 7fd0596d9640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 0x7fd0440a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.286+0000 7fd05d515740 1 -- 172.21.15.66:0/135593732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 msgr2=0x564caf0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.286+0000 7fd05d515740 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd04002a950 tx=0x7fd0400044a0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd05d515740 1 -- 172.21.15.66:0/135593732 shutdown_connections 2024-09-15T22:58:18.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd05d515740 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0c6130 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd05d515740 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd05d515740 1 --2- 172.21.15.66:0/135593732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd05d515740 1 -- 172.21.15.66:0/135593732 >> 172.21.15.66:0/135593732 conn(0x564caf0b50f0 msgr2=0x564caf0b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.289+0000 7fd0596d9640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 0x7fd0440a5a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00b440 tx=0x7fd04c00e040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.292+0000 7fd05d515740 1 -- 172.21.15.66:0/135593732 shutdown_connections 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.292+0000 7fd05d515740 1 -- 172.21.15.66:0/135593732 wait complete. 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.292+0000 7fd05d515740 1 -- start start 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.292+0000 7fd05d515740 1 Processor -- start 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 0x564caf0c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b9480 0x564caf0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 0x564caf0c1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564caf0c66d0 con 0x564caf0b8b60 2024-09-15T22:58:18.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564caefd8f10 con 0x564caf0c3d40 2024-09-15T22:58:18.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564caf0c6850 con 0x564caf0b9480 2024-09-15T22:58:18.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.293+0000 7fd05d515740 10 client.0 _ll_register_callbacks cb 0x564caefa1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:18.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 0x564caf0c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 0x564caf0c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36898/0 (socket says 172.21.15.66:36898) 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd058ed8640 1 -- 172.21.15.66:0/46933376 learned_addr learned my addr 172.21.15.66:0/46933376 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 0x564caf0c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd053fff640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b9480 0x564caf0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 -- 172.21.15.66:0/46933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b9480 msgr2=0x564caf0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b9480 0x564caf0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 -- 172.21.15.66:0/46933376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 msgr2=0x564caf0c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 0x564caf0c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.294+0000 7fd0596d9640 1 -- 172.21.15.66:0/46933376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564caed8f6a0 con 0x564caf0c3d40 2024-09-15T22:58:18.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.295+0000 7fd0596d9640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 0x564caf0c1660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd04c019aa0 tx=0x7fd04c004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e525944c77e7a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.297+0000 7fd033fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:18.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.297+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c029060 con 0x564caf0c3d40 2024-09-15T22:58:18.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.297+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fd04c015950 con 0x564caf0c3d40 2024-09-15T22:58:18.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.297+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0400bd2c0 con 0x564caf0c3d40 2024-09-15T22:58:18.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.297+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd04c015b50 con 0x564caf0c3d40 2024-09-15T22:58:18.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 10 client.27605 fetch_fsmap learned FSMap version 56 2024-09-15T22:58:18.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x564caf0d2270 con 0x564caf0c3d40 2024-09-15T22:58:18.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0400bd2c0 con 0x564caf0c3d40 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 56) ==== 8418+0+0 (secure 0 0 0) 0x7fd04c015070 con 0x564caf0c3d40 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 10 client.27605 fetch_fsmap finished waiting for FSMap version 56 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 10 client.27605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 20 client.27605 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf0d3730 0x564caf0d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 4 client.27605 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.298+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564caf02b7f0 con 0x564caf0d3730 2024-09-15T22:58:18.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.299+0000 7fd058ed8640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf0d3730 0x564caf0d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.301+0000 7fd058ed8640 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf0d3730 0x564caf0d5b20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef416f8925012027 server_cookie=488e23d8b56f771a in_seq=0 out_seq=0 2024-09-15T22:58:18.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.301+0000 7fd033fff640 10 client.27605 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:18.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.302+0000 7fd033fff640 1 -- 172.21.15.66:0/46933376 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564caf02b7f0 con 0x564caf0d3730 2024-09-15T22:58:18.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.302+0000 7fd033fff640 10 client.27605 handle_command_reply: tid=0 2024-09-15T22:58:18.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 client.27605 shutdown 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 msgr2=0x564caf0c1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 0x564caf0c1660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd04c019aa0 tx=0x7fd04c004b20 comp rx=0 tx=0).stop 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 shutdown_connections 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf0d3730 0x564caf0d5b20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0c3d40 0x564caf0c1660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b9480 0x564caf0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 --2- 172.21.15.66:0/46933376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b8b60 0x564caf0c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 >> 172.21.15.66:0/46933376 conn(0x564caf0b50f0 msgr2=0x564caf0bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd033fff640 0 client.27605 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:18.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 shutdown_connections 2024-09-15T22:58:18.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.303+0000 7fd05d515740 1 -- 172.21.15.66:0/46933376 wait complete. 2024-09-15T22:58:18.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.307+0000 7fd05d515740 20 client.27605 trim_cache size 0 max 16384 2024-09-15T22:58:18.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.343+0000 7fd05d515740 1 Processor -- start 2024-09-15T22:58:18.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 -- start start 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b5a50 con 0x564caf0c3d40 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b7710 con 0x564caf0b9480 2024-09-15T22:58:18.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.344+0000 7fd05d515740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b61e0 con 0x564caf0b8b60 2024-09-15T22:58:18.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36900/0 (socket says 172.21.15.66:36900) 2024-09-15T22:58:18.350 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:18 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 -- 172.21.15.66:0/4114909449 learned_addr learned my addr 172.21.15.66:0/4114909449 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 -- 172.21.15.66:0/4114909449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 msgr2=0x564caf0c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 -- 172.21.15.66:0/4114909449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 msgr2=0x564caf0db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.345+0000 7fd0596d9640 1 -- 172.21.15.66:0/4114909449 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564caf0b4f20 con 0x564caf0c3d40 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.346+0000 7fd0596d9640 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00bdf0 tx=0x7fd04c009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353a2049a153aba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.348+0000 7fd03e7fc640 1 -- 172.21.15.66:0/4114909449 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c032030 con 0x564caf0c3d40 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.348+0000 7fd03e7fc640 1 -- 172.21.15.66:0/4114909449 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04c015950 con 0x564caf0c3d40 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.348+0000 7fd03e7fc640 1 -- 172.21.15.66:0/4114909449 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c02dc10 con 0x564caf0c3d40 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.350+0000 7fd05d515740 1 -- 172.21.15.66:0/4114909449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 msgr2=0x564caf0db8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.350+0000 7fd05d515740 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00bdf0 tx=0x7fd04c009740 comp rx=0 tx=0).stop 2024-09-15T22:58:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.352+0000 7fd05d515740 1 -- 172.21.15.66:0/4114909449 shutdown_connections 2024-09-15T22:58:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.352+0000 7fd05d515740 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0c3d40 0x564caf0db8f0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.352+0000 7fd05d515740 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b9480 0x564caf0db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.352+0000 7fd05d515740 1 --2- 172.21.15.66:0/4114909449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0b8b60 0x564caf0c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.352+0000 7fd05d515740 1 -- 172.21.15.66:0/4114909449 >> 172.21.15.66:0/4114909449 conn(0x564caf0b50f0 msgr2=0x564caf0c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.356+0000 7fd05d515740 1 -- 172.21.15.66:0/4114909449 shutdown_connections 2024-09-15T22:58:18.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.356+0000 7fd05d515740 1 -- 172.21.15.66:0/4114909449 wait complete. 2024-09-15T22:58:18.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.357+0000 7fd05d515740 1 -- start start 2024-09-15T22:58:18.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.357+0000 7fd05d515740 1 Processor -- start 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd05d515740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd05d515740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b9480 0x564caf0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd05d515740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0c3d40 0x564caf0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd058ed8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54482/0 (socket says 172.21.15.66:54482) 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd058ed8640 1 -- 172.21.15.66:0/3469454770 learned_addr learned my addr 172.21.15.66:0/3469454770 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b7040 con 0x564caf0b9480 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.358+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b6970 con 0x564caf0b8b60 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd0541b3a50 con 0x564caf0c3d40 2024-09-15T22:58:18.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd0596d9640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0c3d40 0x564caf0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd05d515740 10 client.0 _ll_register_callbacks cb 0x7fd04c009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 -- 172.21.15.66:0/3469454770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0c3d40 msgr2=0x564caf0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0c3d40 0x564caf0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 -- 172.21.15.66:0/3469454770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b9480 msgr2=0x564caf0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b9480 0x564caf0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564caf13d580 con 0x564caf0b8b60 2024-09-15T22:58:18.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.359+0000 7fd058ed8640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd048000c00 tx=0x7fd0480039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d83174ffcd7dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd033fff640 10 client.27608 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd033fff640 1 -- 172.21.15.66:0/3469454770 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048032020 con 0x564caf0b8b60 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd04c015950 con 0x564caf0b8b60 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd033fff640 1 -- 172.21.15.66:0/3469454770 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7fd04802d3b0 con 0x564caf0b8b60 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd033fff640 1 -- 172.21.15.66:0/3469454770 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd04803d050 con 0x564caf0b8b60 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.360+0000 7fd05d515740 10 client.27608 fetch_fsmap learned FSMap version 56 2024-09-15T22:58:18.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.361+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({fsmap=56}) -- 0x564caf13e800 con 0x564caf0b8b60 2024-09-15T22:58:18.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.363+0000 7fd033fff640 1 -- 172.21.15.66:0/3469454770 <== mon.2 v2:172.21.15.87:3300/0 4 ==== fsmap(e 56) ==== 8418+0+0 (secure 0 0 0) 0x7fd04801f040 con 0x564caf0b8b60 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 10 client.27608 fetch_fsmap finished waiting for FSMap version 56 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 10 client.27608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 20 client.27608 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf13ed70 0x564caf1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 4 client.27608 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:58:18.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.366+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fd04c015950 con 0x564caf13ed70 2024-09-15T22:58:18.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.367+0000 7fd053fff640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf13ed70 0x564caf1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:18.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.370+0000 7fd053fff640 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf13ed70 0x564caf1411a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9a21a805c6eda5f server_cookie=c8976a457729a6d6 in_seq=0 out_seq=0 2024-09-15T22:58:18.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.371+0000 7fd033fff640 10 client.27608 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.374+0000 7fd033fff640 1 -- 172.21.15.66:0/3469454770 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fd04c015950 con 0x564caf13ed70 2024-09-15T22:58:18.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.374+0000 7fd033fff640 10 client.27608 handle_command_reply: tid=0 2024-09-15T22:58:18.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.376+0000 7fd05d515740 1 client.27608 shutdown 2024-09-15T22:58:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.379+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 msgr2=0x564caf0c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.379+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd048000c00 tx=0x7fd0480039c0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 shutdown_connections 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564caf0c3d40 0x564caf0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564caf0b9480 0x564caf0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x564caf13ed70 0x564caf1411a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 --2- 172.21.15.66:0/3469454770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf0b8b60 0x564caf0c7980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd033fff640 0 client.27608 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:18.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.381+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 >> 172.21.15.66:0/3469454770 conn(0x564caf0b50f0 msgr2=0x564caf0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.385+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 shutdown_connections 2024-09-15T22:58:18.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.385+0000 7fd05d515740 1 -- 172.21.15.66:0/3469454770 wait complete. 2024-09-15T22:58:18.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.385+0000 7fd05d515740 20 client.27608 trim_cache size 0 max 16384 2024-09-15T22:58:18.387 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:58:18.387 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:58:18.387 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "6f5544eb-ccb4-433c-ab05-6c089d0ced1c", 2024-09-15T22:58:18.387 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:58:18.387 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:58:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.388+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 msgr2=0x7fd0440a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.388+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 0x7fd0440a5a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00b440 tx=0x7fd04c00e040 comp rx=0 tx=0).stop 2024-09-15T22:58:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.388+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 msgr2=0x7fd0541167e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:18.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.388+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 0x7fd0541167e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd040035040 tx=0x7fd040033d10 comp rx=0 tx=0).stop 2024-09-15T22:58:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 shutdown_connections 2024-09-15T22:58:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd0440a35c0 0x7fd0440a5a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd05411b140 0x7fd054116d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd054109830 0x7fd0541167e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 --2- 172.21.15.66:0/120406063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd054109450 0x7fd05411a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.389+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 >> 172.21.15.66:0/120406063 conn(0x7fd05406e140 msgr2=0x7fd054070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.390+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 shutdown_connections 2024-09-15T22:58:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:18.390+0000 7fd05b13c640 1 -- 172.21.15.66:0/120406063 wait complete. 2024-09-15T22:58:18.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:18 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:18 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:19.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:58:19.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: pgmap v404: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:58:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:19 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: pgmap v404: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:58:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:58:19.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:19 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: pgmap v404: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 195 op/s 2024-09-15T22:58:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:58:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:58:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:58:19.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:58:19.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:58:19.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:19 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:19.721 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:20.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.317+0000 7f86cb3d5640 1 -- 172.21.15.66:0/942612487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c4114ab0 msgr2=0x7f86c4116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/942612487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c4114ab0 0x7f86c4116ea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009ca0 tx=0x7f86bc02a8e0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 -- 172.21.15.66:0/942612487 shutdown_connections 2024-09-15T22:58:20.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/942612487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c4114ab0 0x7f86c4116ea0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/942612487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4109ba0 0x7f86c4114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/942612487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c41091f0 0x7f86c41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 -- 172.21.15.66:0/942612487 >> 172.21.15.66:0/942612487 conn(0x7f86c406e2d0 msgr2=0x7f86c406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 -- 172.21.15.66:0/942612487 shutdown_connections 2024-09-15T22:58:20.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.318+0000 7f86cb3d5640 1 -- 172.21.15.66:0/942612487 wait complete. 2024-09-15T22:58:20.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.320+0000 7f86cb3d5640 1 Processor -- start 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.320+0000 7f86cb3d5640 1 -- start start 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 0x7f86c4114290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 0x7f86c410b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f86c411a820 con 0x7f86c4114ab0 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86c411a6a0 con 0x7f86c41091f0 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86cb3d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86c411a9a0 con 0x7f86c4109ba0 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c9972640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 0x7f86c410b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c8970640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 0x7f86c4114290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c9972640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 0x7f86c410b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36934/0 (socket says 172.21.15.66:36934) 2024-09-15T22:58:20.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c9972640 1 -- 172.21.15.66:0/3506922465 learned_addr learned my addr 172.21.15.66:0/3506922465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:20.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c8970640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 0x7f86c4114290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48530/0 (socket says 172.21.15.66:48530) 2024-09-15T22:58:20.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.321+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54494/0 (socket says 172.21.15.66:54494) 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.323+0000 7f86c9171640 1 -- 172.21.15.66:0/3506922465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 msgr2=0x7f86c4114290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.323+0000 7f86c9171640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 0x7f86c4114290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.323+0000 7f86c9171640 1 -- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 msgr2=0x7f86c410b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.323+0000 7f86c9171640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 0x7f86c410b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.323+0000 7f86c9171640 1 -- 172.21.15.66:0/3506922465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c410bff0 con 0x7f86c41091f0 2024-09-15T22:58:20.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.324+0000 7f86c9171640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9f0 tx=0x7f86c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.326+0000 7f86ba7fc640 1 -- 172.21.15.66:0/3506922465 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c000ccc0 con 0x7f86c41091f0 2024-09-15T22:58:20.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.326+0000 7f86ba7fc640 1 -- 172.21.15.66:0/3506922465 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86c0005020 con 0x7f86c41091f0 2024-09-15T22:58:20.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.326+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c410c2e0 con 0x7f86c41091f0 2024-09-15T22:58:20.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.327+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c410fa40 con 0x7f86c41091f0 2024-09-15T22:58:20.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.327+0000 7f86ba7fc640 1 -- 172.21.15.66:0/3506922465 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00049e0 con 0x7f86c41091f0 2024-09-15T22:58:20.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.331+0000 7f86ba7fc640 1 -- 172.21.15.66:0/3506922465 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f86c0005560 con 0x7f86c41091f0 2024-09-15T22:58:20.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.332+0000 7f86ba7fc640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 0x7f86b00a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.332+0000 7f86ba7fc640 1 -- 172.21.15.66:0/3506922465 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f86c00d06c0 con 0x7f86c41091f0 2024-09-15T22:58:20.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.333+0000 7f86c8970640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 0x7f86b00a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.334+0000 7f86c8970640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 0x7f86b00a5820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86c4072da0 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.337+0000 7f86cd7ae740 1 Processor -- start 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.337+0000 7f86cd7ae740 1 -- start start 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180a4dc0 0x5611180af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86c9171640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86c9171640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48538/0 (socket says 172.21.15.66:48538) 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86c9171640 1 -- 172.21.15.66:0/2093028362 learned_addr learned my addr 172.21.15.66:0/2093028362 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.338+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.339+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56111800a2e0 con 0x5611180a4dc0 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.339+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561117fb1ce0 con 0x5611180af680 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.339+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5611180062a0 con 0x5611180a44a0 2024-09-15T22:58:20.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.339+0000 7f86c9972640 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.339+0000 7f86c8970640 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180a4dc0 0x5611180af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 -- 172.21.15.66:0/2093028362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 msgr2=0x5611180b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 -- 172.21.15.66:0/2093028362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180a4dc0 msgr2=0x5611180af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180a4dc0 0x5611180af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 -- 172.21.15.66:0/2093028362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561117f96440 con 0x5611180a44a0 2024-09-15T22:58:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.341+0000 7f86c9171640 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86c0098980 tx=0x7f86c009ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6eecb1993045d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.342+0000 7f86af7fe640 1 -- 172.21.15.66:0/2093028362 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b4020 con 0x5611180a44a0 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.344+0000 7f86af7fe640 1 -- 172.21.15.66:0/2093028362 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86c00a5190 con 0x5611180a44a0 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.344+0000 7f86af7fe640 1 -- 172.21.15.66:0/2093028362 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00cdda0 con 0x5611180a44a0 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 msgr2=0x5611180a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86c0098980 tx=0x7f86c009ccf0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 shutdown_connections 2024-09-15T22:58:20.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180a4dc0 0x5611180af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2093028362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180a4880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.345+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 >> 172.21.15.66:0/2093028362 conn(0x5611180a0a30 msgr2=0x5611180a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.346+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 shutdown_connections 2024-09-15T22:58:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.350+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2093028362 wait complete. 2024-09-15T22:58:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.351+0000 7f86cd7ae740 1 -- start start 2024-09-15T22:58:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.351+0000 7f86cd7ae740 1 Processor -- start 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.352+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.352+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 0x5611180ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.352+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.352+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54516/0 (socket says 172.21.15.66:54516) 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.352+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180af680 0x5611180ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.353+0000 7f86c9171640 1 -- 172.21.15.66:0/2312297272 learned_addr learned my addr 172.21.15.66:0/2312297272 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.353+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5611180b22a0 con 0x5611180af680 2024-09-15T22:58:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.353+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561117fc5050 con 0x5611180a44a0 2024-09-15T22:58:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.353+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5611180b2420 con 0x5611180a4dc0 2024-09-15T22:58:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.353+0000 7f86cd7ae740 10 client.0 _ll_register_callbacks cb 0x561118005160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:20.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.356+0000 7f86c9972640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180af680 0x5611180ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.357+0000 7f86c8970640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 0x5611180ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.358+0000 7f86c8970640 1 -- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 msgr2=0x5611180aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.358+0000 7f86c8970640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.358+0000 7f86c8970640 1 -- 172.21.15.66:0/2312297272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180af680 msgr2=0x5611180ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.358+0000 7f86c8970640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180af680 0x5611180ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.358+0000 7f86c8970640 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561117d7b3c0 con 0x5611180a4dc0 2024-09-15T22:58:20.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.359+0000 7f86c8970640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 0x5611180ac2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5611180a1890 tx=0x7f86b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70ab760c4f32285 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.359+0000 7f86acff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:58:20.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.359+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4020420 con 0x5611180a4dc0 2024-09-15T22:58:20.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.359+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f86b400f040 con 0x5611180a4dc0 2024-09-15T22:58:20.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.360+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c00a5190 con 0x5611180a4dc0 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.364+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f86b40059c0 con 0x5611180a4dc0 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.364+0000 7f86cd7ae740 10 client.27508 fetch_fsmap learned FSMap version 57 2024-09-15T22:58:20.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.364+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x5611180bdd20 con 0x5611180a4dc0 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86b4025070 con 0x5611180a4dc0 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 57) ==== 8422+0+0 (secure 0 0 0) 0x7f86b4013070 con 0x5611180a4dc0 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 10 client.27508 fetch_fsmap finished waiting for FSMap version 57 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 10 client.27508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:20.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 20 client.27508 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5611180bf280 0x5611180c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 4 client.27508 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:20.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.365+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f86c00a5190 con 0x5611180bf280 2024-09-15T22:58:20.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.368+0000 7f86c9171640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5611180bf280 0x5611180c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.370+0000 7f86c9171640 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5611180bf280 0x5611180c16a0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f902d04e6b901a9 server_cookie=6960e38b0a74e3d in_seq=0 out_seq=0 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.370+0000 7f86acff9640 10 client.27508 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.375+0000 7f86acff9640 1 -- 172.21.15.66:0/2312297272 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f86c00a5190 con 0x5611180bf280 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.375+0000 7f86acff9640 10 client.27508 handle_command_reply: tid=0 2024-09-15T22:58:20.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.375+0000 7f86cd7ae740 1 client.27508 shutdown 2024-09-15T22:58:20.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.376+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 msgr2=0x5611180ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.376+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 0x5611180ac2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5611180a1890 tx=0x7f86b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.376+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 shutdown_connections 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.377+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180af680 0x5611180ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.377+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a4dc0 0x5611180ac2a0 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5611180a1890 tx=0x7f86b40046c0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.377+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5611180bf280 0x5611180c16a0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.377+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/2312297272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.377+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 >> 172.21.15.66:0/2312297272 conn(0x5611180a0a30 msgr2=0x5611180a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.378+0000 7f86acff9640 0 client.27508 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:20.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.379+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 shutdown_connections 2024-09-15T22:58:20.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.380+0000 7f86cd7ae740 1 -- 172.21.15.66:0/2312297272 wait complete. 2024-09-15T22:58:20.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.381+0000 7f86cd7ae740 20 client.27508 trim_cache size 0 max 16384 2024-09-15T22:58:20.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.420+0000 7f86cd7ae740 1 Processor -- start 2024-09-15T22:58:20.422 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:20 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:20.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.420+0000 7f86cd7ae740 1 -- start start 2024-09-15T22:58:20.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.421+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.422+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.422+0000 7f86c9171640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:54524/0 (socket says 172.21.15.66:54524) 2024-09-15T22:58:20.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.422+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180af680 0x5611180ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.423+0000 7f86c9171640 1 -- 172.21.15.66:0/3624150672 learned_addr learned my addr 172.21.15.66:0/3624150672 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:20.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.423+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.423+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c6750 con 0x5611180abd90 2024-09-15T22:58:20.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.423+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c8440 con 0x5611180a44a0 2024-09-15T22:58:20.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.423+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c6ee0 con 0x5611180af680 2024-09-15T22:58:20.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.424+0000 7f86c9972640 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 -- 172.21.15.66:0/3624150672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180af680 msgr2=0x5611180ab280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:20.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180af680 0x5611180ab280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 -- 172.21.15.66:0/3624150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 msgr2=0x5611180c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 -- 172.21.15.66:0/3624150672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611180af320 con 0x5611180a44a0 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.429+0000 7f86c9171640 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86c00045e0 tx=0x7f86c00a0a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1f80f8b41bc810 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.430+0000 7f86aeffd640 1 -- 172.21.15.66:0/3624150672 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b4040 con 0x5611180a44a0 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.430+0000 7f86aeffd640 1 -- 172.21.15.66:0/3624150672 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86c00a5190 con 0x5611180a44a0 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.430+0000 7f86aeffd640 1 -- 172.21.15.66:0/3624150672 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0004b80 con 0x5611180a44a0 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.432+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 msgr2=0x5611180bb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.432+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86c00045e0 tx=0x7f86c00a0a50 comp rx=0 tx=0).stop 2024-09-15T22:58:20.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.440+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 shutdown_connections 2024-09-15T22:58:20.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.440+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.440+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180af680 0x5611180ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.440+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/3624150672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180a44a0 0x5611180bb550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.440+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 >> 172.21.15.66:0/3624150672 conn(0x5611180a0a30 msgr2=0x5611180aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.443+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 shutdown_connections 2024-09-15T22:58:20.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.443+0000 7f86cd7ae740 1 -- 172.21.15.66:0/3624150672 wait complete. 2024-09-15T22:58:20.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.444+0000 7f86cd7ae740 1 -- start start 2024-09-15T22:58:20.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.444+0000 7f86cd7ae740 1 Processor -- start 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c7d70 con 0x5611180abd90 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c7670 con 0x5611180af680 2024-09-15T22:58:20.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86c41c4750 con 0x5611180a44a0 2024-09-15T22:58:20.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.445+0000 7f86cd7ae740 10 client.0 _ll_register_callbacks cb 0x7f86b4009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:20.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.446+0000 7f86c8970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.446+0000 7f86c8970640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36968/0 (socket says 172.21.15.66:36968) 2024-09-15T22:58:20.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.446+0000 7f86c8970640 1 -- 172.21.15.66:0/904868321 learned_addr learned my addr 172.21.15.66:0/904868321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:20.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.446+0000 7f86c9972640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.446+0000 7f86c9171640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 -- 172.21.15.66:0/904868321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 msgr2=0x5611180b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 -- 172.21.15.66:0/904868321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 msgr2=0x5611180b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 -- 172.21.15.66:0/904868321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611180b5e20 con 0x5611180af680 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86c9972640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b5610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5611180a1db0 tx=0x7f86bc031c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fdc894f70084f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.448+0000 7f86acff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.449+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc003b70 con 0x5611180af680 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.449+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9679+0+0 (secure 0 0 0) 0x7f86bc003d10 con 0x5611180af680 2024-09-15T22:58:20.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.449+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c00a5190 con 0x5611180af680 2024-09-15T22:58:20.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.452+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f86bc054050 con 0x5611180af680 2024-09-15T22:58:20.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.453+0000 7f86cd7ae740 10 client.27626 fetch_fsmap learned FSMap version 57 2024-09-15T22:58:20.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.453+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x561118129e90 con 0x5611180af680 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.453+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86c00a5190 con 0x5611180af680 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.453+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 57) ==== 8422+0+0 (secure 0 0 0) 0x7f86bc04f030 con 0x5611180af680 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 10 client.27626 fetch_fsmap finished waiting for FSMap version 57 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 10 client.27626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 20 client.27626 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56111812a5e0 0x56111812ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 4 client.27626 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:58:20.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.454+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561118017850 con 0x56111812a5e0 2024-09-15T22:58:20.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.455+0000 7f86c9171640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56111812a5e0 0x56111812ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:20.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.459+0000 7f86c9171640 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56111812a5e0 0x56111812ca00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=596c27e9b1b1a9f7 server_cookie=f679586157513fa4 in_seq=0 out_seq=0 2024-09-15T22:58:20.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.459+0000 7f86acff9640 10 client.27626 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.461+0000 7f86acff9640 1 -- 172.21.15.66:0/904868321 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x561118017850 con 0x56111812a5e0 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.461+0000 7f86acff9640 10 client.27626 handle_command_reply: tid=0 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.461+0000 7f86cd7ae740 1 client.27626 shutdown 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.461+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 msgr2=0x5611180b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.461+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b5610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5611180a1db0 tx=0x7f86bc031c60 comp rx=0 tx=0).stop 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 shutdown_connections 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56111812a5e0 0x56111812ca00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611180af680 0x5611180b5610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5611180abd90 0x5611180b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 --2- 172.21.15.66:0/904868321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5611180a44a0 0x5611180b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 >> 172.21.15.66:0/904868321 conn(0x5611180a0a30 msgr2=0x5611180ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.462+0000 7f86acff9640 0 client.27626 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:20.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.463+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 shutdown_connections 2024-09-15T22:58:20.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.463+0000 7f86cd7ae740 1 -- 172.21.15.66:0/904868321 wait complete. 2024-09-15T22:58:20.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.463+0000 7f86cd7ae740 20 client.27626 trim_cache size 0 max 16384 2024-09-15T22:58:20.465 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (12929 inodes in the stack)", 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "6f5544eb-ccb4-433c-ab05-6c089d0ced1c": { 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "6f5544eb-ccb4-433c-ab05-6c089d0ced1c", 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:58:20.466 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 msgr2=0x7f86b00a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 0x7f86b00a5820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86c4072da0 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 msgr2=0x7f86c4113d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9f0 tx=0x7f86c000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 shutdown_connections 2024-09-15T22:58:20.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f86b00a3360 0x7f86b00a5820 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c4114ab0 0x7f86c410b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86c4109ba0 0x7f86c4114290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 --2- 172.21.15.66:0/3506922465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86c41091f0 0x7f86c4113d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 >> 172.21.15.66:0/3506922465 conn(0x7f86c406e2d0 msgr2=0x7f86c410a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 shutdown_connections 2024-09-15T22:58:20.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:20.466+0000 7f86cb3d5640 1 -- 172.21.15.66:0/3506922465 wait complete. 2024-09-15T22:58:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:20 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:20 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:21 smithi066 ceph-mon[31185]: pgmap v405: 129 pgs: 14 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 77 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-09-15T22:58:21.573 INFO:tasks.cephfs.filesystem:scrub status for tag:6f5544eb-ccb4-433c-ab05-6c089d0ced1c - {'path': '/', 'tag': '6f5544eb-ccb4-433c-ab05-6c089d0ced1c', 'options': 'recursive,force'} 2024-09-15T22:58:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:21 smithi087 ceph-mon[35290]: pgmap v405: 129 pgs: 14 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 77 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-09-15T22:58:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:21 smithi184 ceph-mon[35203]: pgmap v405: 129 pgs: 14 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 77 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-09-15T22:58:23.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:23 smithi066 ceph-mon[31185]: pgmap v406: 129 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 93 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T22:58:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:23 smithi087 ceph-mon[35290]: pgmap v406: 129 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 93 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T22:58:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:23 smithi184 ceph-mon[35203]: pgmap v406: 129 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 93 active+clean; 2.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T22:58:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:25 smithi087 ceph-mon[35290]: pgmap v407: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-15T22:58:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:25 smithi184 ceph-mon[35203]: pgmap v407: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-15T22:58:25.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:25 smithi066 ceph-mon[31185]: pgmap v407: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 190 op/s 2024-09-15T22:58:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:27 smithi087 ceph-mon[35290]: pgmap v408: 129 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 106 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 193 op/s 2024-09-15T22:58:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:27 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:27 smithi184 ceph-mon[35203]: pgmap v408: 129 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 106 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 193 op/s 2024-09-15T22:58:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:27 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:27 smithi066 ceph-mon[31185]: pgmap v408: 129 pgs: 6 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 106 active+clean; 2.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 193 op/s 2024-09-15T22:58:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:27 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:29 smithi087 ceph-mon[35290]: pgmap v409: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-09-15T22:58:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:29 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:29 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:29 smithi184 ceph-mon[35203]: pgmap v409: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-09-15T22:58:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:29 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:29 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:29 smithi066 ceph-mon[31185]: pgmap v409: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 233 op/s 2024-09-15T22:58:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:29 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:29 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:58:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:31 smithi087 ceph-mon[35290]: pgmap v410: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-09-15T22:58:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:31 smithi184 ceph-mon[35203]: pgmap v410: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-09-15T22:58:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:31 smithi066 ceph-mon[31185]: pgmap v410: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-09-15T22:58:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:33 smithi087 ceph-mon[35290]: pgmap v411: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2024-09-15T22:58:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:33 smithi184 ceph-mon[35203]: pgmap v411: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2024-09-15T22:58:33.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:33 smithi066 ceph-mon[31185]: pgmap v411: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 323 op/s 2024-09-15T22:58:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:35 smithi087 ceph-mon[35290]: pgmap v412: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 378 op/s 2024-09-15T22:58:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:35 smithi087 ceph-mon[35290]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:58:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:35 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:58:35.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:35 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:58:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:35 smithi184 ceph-mon[35203]: pgmap v412: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 378 op/s 2024-09-15T22:58:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:35 smithi184 ceph-mon[35203]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:58:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:35 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:58:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:35 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:58:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:35 smithi066 ceph-mon[31185]: pgmap v412: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 378 op/s 2024-09-15T22:58:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:35 smithi066 ceph-mon[31185]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:58:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:35 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:58:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:35 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:58:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:36 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:58:36.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:36 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:58:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:36 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:58:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:36 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:58:36.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:36 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:58:36.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:36 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:58:37.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:37 smithi087 ceph-mon[35290]: pgmap v414: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 371 op/s 2024-09-15T22:58:37.349 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:37 smithi066 ceph-mon[31185]: pgmap v414: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 371 op/s 2024-09-15T22:58:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:37 smithi184 ceph-mon[35203]: pgmap v414: 129 pgs: 129 active+clean; 2.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 371 op/s 2024-09-15T22:58:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:39 smithi087 ceph-mon[35290]: pgmap v415: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-09-15T22:58:39.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:39 smithi087 ceph-mon[35290]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:58:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:39 smithi184 ceph-mon[35203]: pgmap v415: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-09-15T22:58:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:39 smithi184 ceph-mon[35203]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:58:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:39 smithi066 ceph-mon[31185]: pgmap v415: 129 pgs: 129 active+clean; 2.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 363 op/s 2024-09-15T22:58:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:39 smithi066 ceph-mon[31185]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:58:41.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:41 smithi087 ceph-mon[35290]: pgmap v417: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-15T22:58:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:41 smithi184 ceph-mon[35203]: pgmap v417: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-15T22:58:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:41 smithi066 ceph-mon[31185]: pgmap v417: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-15T22:58:43.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:43 smithi087 ceph-mon[35290]: pgmap v418: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 289 op/s 2024-09-15T22:58:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:43 smithi184 ceph-mon[35203]: pgmap v418: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 289 op/s 2024-09-15T22:58:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:43 smithi066 ceph-mon[31185]: pgmap v418: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 289 op/s 2024-09-15T22:58:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:45 smithi087 ceph-mon[35290]: pgmap v419: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 302 op/s 2024-09-15T22:58:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:45 smithi184 ceph-mon[35203]: pgmap v419: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 302 op/s 2024-09-15T22:58:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:45 smithi066 ceph-mon[31185]: pgmap v419: 129 pgs: 129 active+clean; 2.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 302 op/s 2024-09-15T22:58:47.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:47 smithi087 ceph-mon[35290]: pgmap v420: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 307 op/s 2024-09-15T22:58:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:47 smithi184 ceph-mon[35203]: pgmap v420: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 307 op/s 2024-09-15T22:58:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:47 smithi066 ceph-mon[31185]: pgmap v420: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 307 op/s 2024-09-15T22:58:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:49 smithi087 ceph-mon[35290]: pgmap v421: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 307 op/s 2024-09-15T22:58:49.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:49 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:58:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:49 smithi184 ceph-mon[35203]: pgmap v421: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 307 op/s 2024-09-15T22:58:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:49 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:58:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:49 smithi066 ceph-mon[31185]: pgmap v421: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 307 op/s 2024-09-15T22:58:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:49 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:58:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:50 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:50 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:58:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:50 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:58:50.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:50 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:58:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:50 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:50 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:58:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:50 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:58:50.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:50 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:58:50.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:50 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:50 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:58:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:50 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:58:50.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:50 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:58:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:51 smithi087 ceph-mon[35290]: pgmap v422: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 277 op/s 2024-09-15T22:58:51.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:51 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:51 smithi184 ceph-mon[35203]: pgmap v422: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 277 op/s 2024-09-15T22:58:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:51 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:51.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:51 smithi066 ceph-mon[31185]: pgmap v422: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 277 op/s 2024-09-15T22:58:51.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:51 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:51.574 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:58:51.969 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.810+0000 7f3f99995640 1 -- 172.21.15.66:0/766774272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f94105ec0 msgr2=0x7f3f94106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.810+0000 7f3f99995640 1 --2- 172.21.15.66:0/766774272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f94105ec0 0x7f3f94106340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009c10 tx=0x7f3f8c02a720 comp rx=0 tx=0).stop 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 -- 172.21.15.66:0/766774272 shutdown_connections 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 --2- 172.21.15.66:0/766774272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f94105ec0 0x7f3f94106340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 --2- 172.21.15.66:0/766774272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f941011e0 0x7f3f94105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 --2- 172.21.15.66:0/766774272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f941008c0 0x7f3f94100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 -- 172.21.15.66:0/766774272 >> 172.21.15.66:0/766774272 conn(0x7f3f940fc7d0 msgr2=0x7f3f940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.811+0000 7f3f99995640 1 -- 172.21.15.66:0/766774272 shutdown_connections 2024-09-15T22:58:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.812+0000 7f3f99995640 1 -- 172.21.15.66:0/766774272 wait complete. 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.813+0000 7f3f99995640 1 Processor -- start 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 -- start start 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f941008c0 0x7f3f94114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 0x7f3f94110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 0x7f3f94111390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94109870 con 0x7f3f94105ec0 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941096f0 con 0x7f3f941008c0 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.814+0000 7f3f99995640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941099f0 con 0x7f3f941011e0 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 0x7f3f94110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 0x7f3f94110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56412/0 (socket says 172.21.15.66:56412) 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f927fc640 1 -- 172.21.15.66:0/1194397746 learned_addr learned my addr 172.21.15.66:0/1194397746 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 0x7f3f94111390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 -- 172.21.15.66:0/1194397746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 msgr2=0x7f3f94110e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 0x7f3f94110e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 -- 172.21.15.66:0/1194397746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f941008c0 msgr2=0x7f3f94114d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f941008c0 0x7f3f94114d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.815+0000 7f3f937fe640 1 -- 172.21.15.66:0/1194397746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f94111950 con 0x7f3f94105ec0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.816+0000 7f3f937fe640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 0x7f3f94111390 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c02ad10 tx=0x7f3f8c031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.817+0000 7f3f98993640 1 -- 172.21.15.66:0/1194397746 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c041030 con 0x7f3f94105ec0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.818+0000 7f3f98993640 1 -- 172.21.15.66:0/1194397746 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f8c003970 con 0x7f3f94105ec0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.818+0000 7f3f98993640 1 -- 172.21.15.66:0/1194397746 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c036040 con 0x7f3f94105ec0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.818+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f94111be0 con 0x7f3f94105ec0 2024-09-15T22:58:52.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.819+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941a2c90 con 0x7f3f94105ec0 2024-09-15T22:58:52.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.823+0000 7f3f98993640 1 -- 172.21.15.66:0/1194397746 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3f8c044070 con 0x7f3f94105ec0 2024-09-15T22:58:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.825+0000 7f3f98993640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 0x7f3f7c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.825+0000 7f3f9bd6e740 1 Processor -- start 2024-09-15T22:58:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.825+0000 7f3f98993640 1 -- 172.21.15.66:0/1194397746 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f3f8c0f0c00 con 0x7f3f94105ec0 2024-09-15T22:58:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.825+0000 7f3f9bd6e740 1 -- start start 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c21f2e0 con 0x55ed1c2c4680 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 0x7f3f7c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c1c6ce0 con 0x55ed1c2b94a0 2024-09-15T22:58:52.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.826+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c21b2a0 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60578/0 (socket says 172.21.15.66:60578) 2024-09-15T22:58:52.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 -- 172.21.15.66:0/3821639510 learned_addr learned my addr 172.21.15.66:0/3821639510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:52.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 -- 172.21.15.66:0/3821639510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 msgr2=0x55ed1c2c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 -- 172.21.15.66:0/3821639510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 msgr2=0x55ed1c2b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 -- 172.21.15.66:0/3821639510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed1c1ab440 con 0x55ed1c2c4680 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.827+0000 7f3f937fe640 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0c51c0 tx=0x7f3f8c0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7323bb34915378e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.828+0000 7f3f79ffb640 1 -- 172.21.15.66:0/3821639510 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0d4020 con 0x55ed1c2c4680 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.829+0000 7f3f79ffb640 1 -- 172.21.15.66:0/3821639510 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f8c0c0e30 con 0x55ed1c2c4680 2024-09-15T22:58:52.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.829+0000 7f3f79ffb640 1 -- 172.21.15.66:0/3821639510 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0b90f0 con 0x55ed1c2c4680 2024-09-15T22:58:52.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/3821639510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 msgr2=0x55ed1c2c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0c51c0 tx=0x7f3f8c0098c0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/3821639510 shutdown_connections 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c6a70 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/3821639510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.830+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/3821639510 >> 172.21.15.66:0/3821639510 conn(0x55ed1c2b5a30 msgr2=0x55ed1c2b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.831+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 0x7f3f7c0a5a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800ef30 tx=0x7f3f8800e870 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.832+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/3821639510 shutdown_connections 2024-09-15T22:58:52.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.833+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/3821639510 wait complete. 2024-09-15T22:58:52.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.833+0000 7f3f9bd6e740 1 -- start start 2024-09-15T22:58:52.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.833+0000 7f3f9bd6e740 1 Processor -- start 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c21f2e0 con 0x55ed1c2b94a0 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c1da050 con 0x55ed1c2c4680 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed1c2c7010 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.834+0000 7f3f9bd6e740 10 client.0 _ll_register_callbacks cb 0x55ed1c21a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56424/0 (socket says 172.21.15.66:56424) 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 -- 172.21.15.66:0/2003041922 learned_addr learned my addr 172.21.15.66:0/2003041922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 -- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2c4680 msgr2=0x55ed1c2c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 -- 172.21.15.66:0/2003041922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2b94a0 msgr2=0x55ed1c2c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.835+0000 7f3f927fc640 1 -- 172.21.15.66:0/2003041922 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed1bf903c0 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.836+0000 7f3f927fc640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f84022700 tx=0x7f3f84022bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49fc0027d6ed9467 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.836+0000 7f3f72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.836+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8402f060 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.836+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f8c0c0e30 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.836+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f3f84020ac0 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.837+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f3f84036050 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.837+0000 7f3f9bd6e740 10 client.27520 fetch_fsmap learned FSMap version 59 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.837+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55ed1c2e3880 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f8c0c0e30 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 59) ==== 8430+0+0 (secure 0 0 0) 0x7f3f8401f400 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 10 client.27520 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T22:58:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 10 client.27520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 20 client.27520 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2e5100 0x55ed1c2e7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 4 client.27520 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.838+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed1c22c850 con 0x55ed1c2e5100 2024-09-15T22:58:52.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.841+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2e5100 0x55ed1c2e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.843+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2e5100 0x55ed1c2e7540 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f575b8b43373b8 server_cookie=f2d7b80e158e2947 in_seq=0 out_seq=0 2024-09-15T22:58:52.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.844+0000 7f3f72ffd640 10 client.27520 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:52.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.845+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2003041922 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed1c22c850 con 0x55ed1c2e5100 2024-09-15T22:58:52.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.845+0000 7f3f72ffd640 10 client.27520 handle_command_reply: tid=0 2024-09-15T22:58:52.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.846+0000 7f3f9bd6e740 1 client.27520 shutdown 2024-09-15T22:58:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.850+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 msgr2=0x55ed1c2c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.850+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f84022700 tx=0x7f3f84022bc0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 shutdown_connections 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2e5100 0x55ed1c2e7540 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2c4680 0x55ed1c2c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2c1230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2003041922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 >> 172.21.15.66:0/2003041922 conn(0x55ed1c2b5a30 msgr2=0x55ed1c2bb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f72ffd640 0 client.27520 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 shutdown_connections 2024-09-15T22:58:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.853+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2003041922 wait complete. 2024-09-15T22:58:52.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.854+0000 7f3f9bd6e740 20 client.27520 trim_cache size 0 max 16384 2024-09-15T22:58:52.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.888+0000 7f3f9bd6e740 1 Processor -- start 2024-09-15T22:58:52.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.889+0000 7f3f9bd6e740 1 -- start start 2024-09-15T22:58:52.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.889+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.889+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.889+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2ed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941a4760 con 0x55ed1c2c4680 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941a64b0 con 0x55ed1c2b94a0 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f92ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56440/0 (socket says 172.21.15.66:56440) 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f927fc640 1 -- 172.21.15.66:0/2715480417 learned_addr learned my addr 172.21.15.66:0/2715480417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f9bd6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941a4ef0 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.890+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.891+0000 7f3f937fe640 1 -- 172.21.15.66:0/2715480417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 msgr2=0x55ed1c2ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.891+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.891+0000 7f3f937fe640 1 -- 172.21.15.66:0/2715480417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 msgr2=0x55ed1c2c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.891+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.891+0000 7f3f937fe640 1 -- 172.21.15.66:0/2715480417 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed1c2c6de0 con 0x55ed1c2c4680 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2ed390 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d2000 tx=0x7f3f8c0b8e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1806ffa386d6ea0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f797fa640 1 -- 172.21.15.66:0/2715480417 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0d4040 con 0x55ed1c2c4680 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f797fa640 1 -- 172.21.15.66:0/2715480417 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f8c003e50 con 0x55ed1c2c4680 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f797fa640 1 -- 172.21.15.66:0/2715480417 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0b9280 con 0x55ed1c2c4680 2024-09-15T22:58:52.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f927fc640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:52.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.893+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2715480417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 msgr2=0x55ed1c2ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.893+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2ed390 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d2000 tx=0x7f3f8c0b8e50 comp rx=0 tx=0).stop 2024-09-15T22:58:52.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.894+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2715480417 shutdown_connections 2024-09-15T22:58:52.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.894+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2ed390 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.894+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.892+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:58:52.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.895+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2715480417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.895+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2715480417 >> 172.21.15.66:0/2715480417 conn(0x55ed1c2b5a30 msgr2=0x55ed1c2c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.895+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2715480417 shutdown_connections 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.895+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2715480417 wait complete. 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.895+0000 7f3f9bd6e740 1 -- start start 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.896+0000 7f3f9bd6e740 1 Processor -- start 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.896+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.896+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.896+0000 7f3f9bd6e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.896+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f927fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42688/0 (socket says 172.21.15.66:42688) 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f927fc640 1 -- 172.21.15.66:0/2913589013 learned_addr learned my addr 172.21.15.66:0/2913589013 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941a5db0 con 0x55ed1c2c4680 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f941a5680 con 0x55ed1c2b9dc0 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112330 con 0x55ed1c2b94a0 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f9bd6e740 10 client.0 _ll_register_callbacks cb 0x7f3f8401acd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 -- 172.21.15.66:0/2913589013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b94a0 msgr2=0x55ed1c2cc440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:52.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2cc440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 -- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 msgr2=0x55ed1c2cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.897+0000 7f3f937fe640 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed1c2be240 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.898+0000 7f3f937fe640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2bda40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d2000 tx=0x7f3f8c02a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ebfbf6c052b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.898+0000 7f3f72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.898+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0d4070 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.898+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f3f8c0c5260 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.898+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f8c003e50 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.899+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f3f8c0c0e30 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.899+0000 7f3f9bd6e740 10 client.18309 fetch_fsmap learned FSMap version 59 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.899+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55ed1c2be240 con 0x55ed1c2c4680 2024-09-15T22:58:52.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.899+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f8c0ee370 con 0x55ed1c2c4680 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.899+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 59) ==== 8430+0+0 (secure 0 0 0) 0x7f3f8c04e060 con 0x55ed1c2c4680 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 10 client.18309 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 10 client.18309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 20 client.18309 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2d0ed0 0x55ed1c2d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 4 client.18309 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.900+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3f8c003e50 con 0x55ed1c2d0ed0 2024-09-15T22:58:52.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.903+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2d0ed0 0x55ed1c2d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.906+0000 7f3f92ffd640 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2d0ed0 0x55ed1c2d3310 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba54a26f2b98cf0d server_cookie=66ec498029eb70d1 in_seq=0 out_seq=0 2024-09-15T22:58:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.906+0000 7f3f72ffd640 10 client.18309 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:52.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.906+0000 7f3f72ffd640 1 -- 172.21.15.66:0/2913589013 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f3f8c003e50 con 0x55ed1c2d0ed0 2024-09-15T22:58:52.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.906+0000 7f3f72ffd640 10 client.18309 handle_command_reply: tid=0 2024-09-15T22:58:52.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.906+0000 7f3f9bd6e740 1 client.18309 shutdown 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 msgr2=0x55ed1c2bda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2bda40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d2000 tx=0x7f3f8c02a720 comp rx=0 tx=0).stop 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 shutdown_connections 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed1c2c4680 0x55ed1c2bda40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ed1c2d0ed0 0x55ed1c2d3310 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed1c2b9dc0 0x55ed1c2cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 --2- 172.21.15.66:0/2913589013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed1c2b94a0 0x55ed1c2cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 >> 172.21.15.66:0/2913589013 conn(0x55ed1c2b5a30 msgr2=0x55ed1c2b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.908+0000 7f3f72ffd640 0 client.18309 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:58:52.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 shutdown_connections 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f9bd6e740 1 -- 172.21.15.66:0/2913589013 wait complete. 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f9bd6e740 20 client.18309 trim_cache size 0 max 16384 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:58:52.911 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 msgr2=0x7f3f7c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 0x7f3f7c0a5a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800ef30 tx=0x7f3f8800e870 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 msgr2=0x7f3f94111390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.909+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 0x7f3f94111390 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c02ad10 tx=0x7f3f8c031a70 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 shutdown_connections 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3f7c0a3580 0x7f3f7c0a5a40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f94105ec0 0x7f3f94111390 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f941011e0 0x7f3f94110e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 --2- 172.21.15.66:0/1194397746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f941008c0 0x7f3f94114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 >> 172.21.15.66:0/1194397746 conn(0x7f3f940fc7d0 msgr2=0x7f3f94103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 shutdown_connections 2024-09-15T22:58:52.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:52.910+0000 7f3f99995640 1 -- 172.21.15.66:0/1194397746 wait complete. 2024-09-15T22:58:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:53 smithi087 ceph-mon[35290]: pgmap v423: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2024-09-15T22:58:53.351 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:53 smithi066 ceph-mon[31185]: pgmap v423: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2024-09-15T22:58:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:53 smithi184 ceph-mon[35203]: pgmap v423: 129 pgs: 129 active+clean; 2.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 291 op/s 2024-09-15T22:58:54.297 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:58:54.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:58:54.680 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:55.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 -- 172.21.15.66:0/3636593628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc570102d30 msgr2=0x7fc570103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:55.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 --2- 172.21.15.66:0/3636593628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc570102d30 0x7fc570103110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc560009930 tx=0x7fc56002a420 comp rx=0 tx=0).stop 2024-09-15T22:58:55.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 -- 172.21.15.66:0/3636593628 shutdown_connections 2024-09-15T22:58:55.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 --2- 172.21.15.66:0/3636593628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5701082a0 0x7fc57010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 --2- 172.21.15.66:0/3636593628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701036e0 0x7fc570107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 --2- 172.21.15.66:0/3636593628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc570102d30 0x7fc570103110 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 -- 172.21.15.66:0/3636593628 >> 172.21.15.66:0/3636593628 conn(0x7fc5700fc7d0 msgr2=0x7fc5700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 -- 172.21.15.66:0/3636593628 shutdown_connections 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.296+0000 7fc5752c9640 1 -- 172.21.15.66:0/3636593628 wait complete. 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.297+0000 7fc5752c9640 1 Processor -- start 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.297+0000 7fc5752c9640 1 -- start start 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc570102d30 0x7fc570100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701082a0 0x7fc570101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701120a0 con 0x7fc5701036e0 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc570111f20 con 0x7fc5701082a0 2024-09-15T22:58:55.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc570112220 con 0x7fc570102d30 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60620/0 (socket says 172.21.15.66:60620) 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 -- 172.21.15.66:0/1381401023 learned_addr learned my addr 172.21.15.66:0/1381401023 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56effd640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc570102d30 0x7fc570100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56f7fe640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701082a0 0x7fc570101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 -- 172.21.15.66:0/1381401023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc570102d30 msgr2=0x7fc570100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc570102d30 0x7fc570100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 -- 172.21.15.66:0/1381401023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701082a0 msgr2=0x7fc570101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701082a0 0x7fc570101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 -- 172.21.15.66:0/1381401023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5701a6a60 con 0x7fc5701036e0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc56e7fc640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc56400e9f0 tx=0x7fc56400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56400ccc0 con 0x7fc5701036e0 2024-09-15T22:58:55.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5701a6d50 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.298+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564010910 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.299+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564018920 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.299+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5701a7250 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.300+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57006a850 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.302+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc564010ac0 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.302+0000 7fc557fff640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 0x7fc5580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.303+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7fc5640d0710 con 0x7fc5701036e0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.303+0000 7fc56effd640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 0x7fc5580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.303+0000 7fc56effd640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 0x7fc5580a58f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc560009900 tx=0x7fc5600058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:55.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.306+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc56409c6a0 con 0x7fc5701036e0 2024-09-15T22:58:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:55 smithi087 ceph-mon[35290]: pgmap v424: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 334 op/s 2024-09-15T22:58:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:55 smithi184 ceph-mon[35203]: pgmap v424: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 334 op/s 2024-09-15T22:58:55.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:55 smithi066 ceph-mon[31185]: pgmap v424: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 334 op/s 2024-09-15T22:58:55.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.527+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc570103110 con 0x7fc5701036e0 2024-09-15T22:58:55.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.527+0000 7fc557fff640 1 -- 172.21.15.66:0/1381401023 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+12001 (secure 0 0 0) 0x7fc570103110 con 0x7fc5701036e0 2024-09-15T22:58:55.529 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:58:55.529 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":60,"btime":"2024-09-15T22:58:55:075480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:58:54.130467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T22:58:55.530 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 60 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 msgr2=0x7fc5580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 0x7fc5580a58f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc560009900 tx=0x7fc5600058d0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 msgr2=0x7fc570100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc56400e9f0 tx=0x7fc56400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 shutdown_connections 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc5580a3430 0x7fc5580a58f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5701082a0 0x7fc570101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5701036e0 0x7fc570100ed0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 --2- 172.21.15.66:0/1381401023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc570102d30 0x7fc570100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 >> 172.21.15.66:0/1381401023 conn(0x7fc5700fc7d0 msgr2=0x7fc570105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 shutdown_connections 2024-09-15T22:58:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:55.530+0000 7fc5752c9640 1 -- 172.21.15.66:0/1381401023 wait complete. 2024-09-15T22:58:56.192 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:56 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:56.192 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1381401023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:56.242 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:58:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:56 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1381401023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:56 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:58:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1381401023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:58:56.559 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.277+0000 7f58080a1640 1 -- 172.21.15.66:0/1477603825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109830 msgr2=0x7f5800109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.277+0000 7f58080a1640 1 --2- 172.21.15.66:0/1477603825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109830 0x7f5800109c90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009900 tx=0x7f57f002a3f0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 -- 172.21.15.66:0/1477603825 shutdown_connections 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 --2- 172.21.15.66:0/1477603825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f580011b140 0x7f580011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 --2- 172.21.15.66:0/1477603825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109830 0x7f5800109c90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 --2- 172.21.15.66:0/1477603825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109450 0x7f5800110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 -- 172.21.15.66:0/1477603825 >> 172.21.15.66:0/1477603825 conn(0x7f580006e140 msgr2=0x7f580006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 -- 172.21.15.66:0/1477603825 shutdown_connections 2024-09-15T22:58:57.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.278+0000 7f58080a1640 1 -- 172.21.15.66:0/1477603825 wait complete. 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.279+0000 7f58080a1640 1 Processor -- start 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.279+0000 7f58080a1640 1 -- start start 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 0x7f58001a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f580011b140 0x7f58001abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5800120e10 con 0x7f5800109450 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5800120c90 con 0x7f5800109830 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f58080a1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5800120f90 con 0x7f580011b140 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42736/0 (socket says 172.21.15.66:42736) 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 -- 172.21.15.66:0/4148205390 learned_addr learned my addr 172.21.15.66:0/4148205390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f5805e3d640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 0x7f58001a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 -- 172.21.15.66:0/4148205390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f580011b140 msgr2=0x7f58001abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f580011b140 0x7f58001abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 -- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 msgr2=0x7f58001a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 0x7f58001a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f580563c640 1 -- 172.21.15.66:0/4148205390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58001ac300 con 0x7f5800109830 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.280+0000 7f5805e3d640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 0x7f58001a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:58:57.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f580563c640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57f0031980 tx=0x7f57f00055e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f57feffd640 1 -- 172.21.15.66:0/4148205390 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f003f030 con 0x7f5800109830 2024-09-15T22:58:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f57feffd640 1 -- 172.21.15.66:0/4148205390 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f0004e70 con 0x7f5800109830 2024-09-15T22:58:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f57feffd640 1 -- 172.21.15.66:0/4148205390 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0035070 con 0x7f5800109830 2024-09-15T22:58:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58001ac590 con 0x7f5800109830 2024-09-15T22:58:57.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.281+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5800110920 con 0x7f5800109830 2024-09-15T22:58:57.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.285+0000 7f580a47a740 1 Processor -- start 2024-09-15T22:58:57.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 -- start start 2024-09-15T22:58:57.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef675090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef680370 0x564eef682760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564eef5db2f0 con 0x564eef6755d0 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564eef582cf0 con 0x564eef676b40 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.287+0000 7f580a47a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564eef5d72b0 con 0x564eef680370 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.288+0000 7f57feffd640 1 -- 172.21.15.66:0/4148205390 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f57f0042030 con 0x7f5800109830 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.288+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.288+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60650/0 (socket says 172.21.15.66:60650) 2024-09-15T22:58:57.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.288+0000 7f5805e3d640 1 -- 172.21.15.66:0/4038979603 learned_addr learned my addr 172.21.15.66:0/4038979603 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 -- 172.21.15.66:0/4038979603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef680370 msgr2=0x564eef682760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef680370 0x564eef682760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 -- 172.21.15.66:0/4038979603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 msgr2=0x564eef675090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef675090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 -- 172.21.15.66:0/4038979603 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eef5673a0 con 0x564eef6755d0 2024-09-15T22:58:57.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f57feffd640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 0x7f57e80a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.289+0000 7f5805e3d640 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d50 tx=0x7f57f40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70410e143d04092b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.290+0000 7f57feffd640 1 -- 172.21.15.66:0/4148205390 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f57f00f0630 con 0x7f5800109830 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.290+0000 7f57e7fff640 1 -- 172.21.15.66:0/4038979603 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4012650 con 0x564eef6755d0 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.290+0000 7f57e7fff640 1 -- 172.21.15.66:0/4038979603 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f4009e40 con 0x564eef6755d0 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.290+0000 7f57e7fff640 1 -- 172.21.15.66:0/4038979603 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f400fc60 con 0x564eef6755d0 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.291+0000 7f580a47a740 1 -- 172.21.15.66:0/4038979603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 msgr2=0x564eef675a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.291+0000 7f580a47a740 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d50 tx=0x7f57f40117b0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.292+0000 7f580663e640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 0x7f57e80a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.293+0000 7f580663e640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 0x7f57e80a59b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001f50 tx=0x7f57f80015f0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 -- 172.21.15.66:0/4038979603 shutdown_connections 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef680370 0x564eef682760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef6755d0 0x564eef675a10 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 --2- 172.21.15.66:0/4038979603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef675090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 -- 172.21.15.66:0/4038979603 >> 172.21.15.66:0/4038979603 conn(0x564eef63e310 msgr2=0x564eef671c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 -- 172.21.15.66:0/4038979603 shutdown_connections 2024-09-15T22:58:57.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.294+0000 7f580a47a740 1 -- 172.21.15.66:0/4038979603 wait complete. 2024-09-15T22:58:57.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.295+0000 7f580a47a740 1 -- start start 2024-09-15T22:58:57.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.295+0000 7f580a47a740 1 Processor -- start 2024-09-15T22:58:57.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef67d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef67d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564eef683070 con 0x564eef680370 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564eef596060 con 0x564eef676b40 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564eef6831f0 con 0x564eef6755d0 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580a47a740 10 client.0 _ll_register_callbacks cb 0x564eef2e98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56522/0 (socket says 172.21.15.66:56522) 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f5805e3d640 1 -- 172.21.15.66:0/2141398604 learned_addr learned my addr 172.21.15.66:0/2141398604 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580563c640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef67d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.296+0000 7f580663e640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef67d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 -- 172.21.15.66:0/2141398604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 msgr2=0x564eef67d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef67d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 -- 172.21.15.66:0/2141398604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 msgr2=0x564eef67d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef67d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 -- 172.21.15.66:0/2141398604 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eef34c3c0 con 0x564eef6755d0 2024-09-15T22:58:57.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f5805e3d640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57f400f7e0 tx=0x7f57f40043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbed688c4f23f2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.297+0000 7f57e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.298+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4027030 con 0x564eef6755d0 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.298+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564eef5e8860 con 0x564eef6755d0 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.298+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f57f400fbf0 con 0x564eef6755d0 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.298+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f57f400fdf0 con 0x564eef6755d0 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.299+0000 7f580a47a740 10 client.27529 fetch_fsmap learned FSMap version 60 2024-09-15T22:58:57.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.299+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564eef68ebb0 con 0x564eef6755d0 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.299+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564eef5e8860 con 0x564eef6755d0 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f57f4023700 con 0x564eef6755d0 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 10 client.27529 fetch_fsmap finished waiting for FSMap version 60 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 10 client.27529 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 20 client.27529 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef690430 0x564eef692890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 4 client.27529 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:57.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.300+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eef5e2d70 con 0x564eef690430 2024-09-15T22:58:57.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.303+0000 7f580563c640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef690430 0x564eef692890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.304+0000 7f580563c640 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef690430 0x564eef692890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42095a8860090da5 server_cookie=45d6402c52c65ef3 in_seq=0 out_seq=0 2024-09-15T22:58:57.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.304+0000 7f57e57fa640 10 client.27529 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.308+0000 7f57e57fa640 1 -- 172.21.15.66:0/2141398604 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564eef5e2d70 con 0x564eef690430 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.308+0000 7f57e57fa640 10 client.27529 handle_command_reply: tid=0 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.308+0000 7f580a47a740 1 client.27529 shutdown 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.308+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 msgr2=0x564eef67fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.308+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57f400f7e0 tx=0x7f57f40043b0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 shutdown_connections 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef690430 0x564eef692890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef67d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef67d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 --2- 172.21.15.66:0/2141398604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 >> 172.21.15.66:0/2141398604 conn(0x564eef63e310 msgr2=0x564eef677930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f57e57fa640 0 client.27529 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 shutdown_connections 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 1 -- 172.21.15.66:0/2141398604 wait complete. 2024-09-15T22:58:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.309+0000 7f580a47a740 20 client.27529 trim_cache size 0 max 16384 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.332+0000 7f580a47a740 1 Processor -- start 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 -- start start 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef678800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58001c69b0 con 0x564eef680370 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58001c8730 con 0x564eef676b40 2024-09-15T22:58:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580a47a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f58001c7140 con 0x564eef6755d0 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580563c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580663e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef678800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580563c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42760/0 (socket says 172.21.15.66:42760) 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f580563c640 1 -- 172.21.15.66:0/1743232368 learned_addr learned my addr 172.21.15.66:0/1743232368 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.333+0000 7f5805e3d640 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.334+0000 7f580563c640 1 -- 172.21.15.66:0/1743232368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 msgr2=0x564eef67fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.334+0000 7f580563c640 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.334+0000 7f580563c640 1 -- 172.21.15.66:0/1743232368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 msgr2=0x564eef678800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.334+0000 7f580563c640 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef678800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.334+0000 7f580563c640 1 -- 172.21.15.66:0/1743232368 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eef67db60 con 0x564eef676b40 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.335+0000 7f580563c640 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57f002a9e0 tx=0x7f57f0005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5419d4eb076d29cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.335+0000 7f57e77fe640 1 -- 172.21.15.66:0/1743232368 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0049040 con 0x564eef676b40 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.335+0000 7f57e77fe640 1 -- 172.21.15.66:0/1743232368 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f00bcbb0 con 0x564eef676b40 2024-09-15T22:58:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.335+0000 7f57e77fe640 1 -- 172.21.15.66:0/1743232368 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00ba550 con 0x564eef676b40 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 -- 172.21.15.66:0/1743232368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 msgr2=0x564eef6782c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57f002a9e0 tx=0x7f57f0005750 comp rx=0 tx=0).stop 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 -- 172.21.15.66:0/1743232368 shutdown_connections 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef678800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef676b40 0x564eef6782c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 --2- 172.21.15.66:0/1743232368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef6755d0 0x564eef67fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.336+0000 7f580a47a740 1 -- 172.21.15.66:0/1743232368 >> 172.21.15.66:0/1743232368 conn(0x564eef63e310 msgr2=0x564eef66ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.337+0000 7f580a47a740 1 -- 172.21.15.66:0/1743232368 shutdown_connections 2024-09-15T22:58:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.337+0000 7f580a47a740 1 -- 172.21.15.66:0/1743232368 wait complete. 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.337+0000 7f580a47a740 1 -- start start 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.337+0000 7f580a47a740 1 Processor -- start 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.338+0000 7f580a47a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 0x564eef688d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.338+0000 7f580a47a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef676b40 0x564eef683490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.338+0000 7f580a47a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef683a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 0x564eef688d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f5805e3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 0x564eef688d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42770/0 (socket says 172.21.15.66:42770) 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580a47a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58001c8000 con 0x564eef680370 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f5805e3d640 1 -- 172.21.15.66:0/3280061179 learned_addr learned my addr 172.21.15.66:0/3280061179 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58001c78d0 con 0x564eef6755d0 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5800109c90 con 0x564eef676b40 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580a47a740 10 client.0 _ll_register_callbacks cb 0x7f57f4009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580563c640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef676b40 0x564eef683490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.339+0000 7f580663e640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef683a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 -- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef676b40 msgr2=0x564eef683490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef676b40 0x564eef683490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 -- 172.21.15.66:0/3280061179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 msgr2=0x564eef688d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 0x564eef688d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eef684280 con 0x564eef680370 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f580663e640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef683a80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x564eef671660 tx=0x7f57f80012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8aad27a2b2e909 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.340+0000 7f57e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.341+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8027060 con 0x564eef680370 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.341+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f57f8003d80 con 0x564eef680370 2024-09-15T22:58:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.341+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f00bcbb0 con 0x564eef680370 2024-09-15T22:58:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.343+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f57f8004050 con 0x564eef680370 2024-09-15T22:58:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.344+0000 7f580a47a740 10 client.18333 fetch_fsmap learned FSMap version 60 2024-09-15T22:58:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.344+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564eef6fa2a0 con 0x564eef680370 2024-09-15T22:58:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.345+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f80046d0 con 0x564eef680370 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.345+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f57f8022440 con 0x564eef680370 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.345+0000 7f580a47a740 10 client.18333 fetch_fsmap finished waiting for FSMap version 60 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.345+0000 7f580a47a740 10 client.18333 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.345+0000 7f580a47a740 20 client.18333 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.346+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef6faa60 0x564eef6fce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.346+0000 7f580a47a740 4 client.18333 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.346+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f57f00bcbb0 con 0x564eef6faa60 2024-09-15T22:58:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.346+0000 7f5805e3d640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef6faa60 0x564eef6fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.349+0000 7f5805e3d640 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef6faa60 0x564eef6fce80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1a3621dac6f936d8 server_cookie=7b6235bb6be44181 in_seq=0 out_seq=0 2024-09-15T22:58:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.349+0000 7f57e57fa640 10 client.18333 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:57.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.350+0000 7f57e57fa640 1 -- 172.21.15.66:0/3280061179 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f57f00bcbb0 con 0x564eef6faa60 2024-09-15T22:58:57.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.350+0000 7f57e57fa640 10 client.18333 handle_command_reply: tid=0 2024-09-15T22:58:57.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.351+0000 7f580a47a740 1 client.18333 shutdown 2024-09-15T22:58:57.352 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:57 smithi066 ceph-mon[31185]: pgmap v425: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 302 op/s 2024-09-15T22:58:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.351+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 msgr2=0x564eef683a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.351+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef683a80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x564eef671660 tx=0x7f57f80012f0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.351+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 shutdown_connections 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.351+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x564eef6faa60 0x564eef6fce80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564eef680370 0x564eef683a80 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f57e57fa640 0 client.18333 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564eef676b40 0x564eef683490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 --2- 172.21.15.66:0/3280061179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564eef6755d0 0x564eef688d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 >> 172.21.15.66:0/3280061179 conn(0x564eef63e310 msgr2=0x564eef6782c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 shutdown_connections 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 1 -- 172.21.15.66:0/3280061179 wait complete. 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.352+0000 7f580a47a740 20 client.18333 trim_cache size 0 max 16384 2024-09-15T22:58:57.354 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 msgr2=0x7f57e80a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 0x7f57e80a59b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001f50 tx=0x7f57f80015f0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 msgr2=0x7f58001a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57f0031980 tx=0x7f57f00055e0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 shutdown_connections 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f57e80a34f0 0x7f57e80a59b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f580011b140 0x7f58001abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800109830 0x7f58001a77f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 --2- 172.21.15.66:0/4148205390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5800109450 0x7f58001a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.353+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 >> 172.21.15.66:0/4148205390 conn(0x7f580006e140 msgr2=0x7f580011b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.354+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 shutdown_connections 2024-09-15T22:58:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:57.354+0000 7f58080a1640 1 -- 172.21.15.66:0/4148205390 wait complete. 2024-09-15T22:58:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:57 smithi184 ceph-mon[35203]: pgmap v425: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 302 op/s 2024-09-15T22:58:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:57 smithi087 ceph-mon[35290]: pgmap v425: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 302 op/s 2024-09-15T22:58:58.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:58:58.328 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:58:59.125 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.830+0000 7f7a242fb640 1 -- 172.21.15.66:0/3557411291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c102790 msgr2=0x7f7a1c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.830+0000 7f7a242fb640 1 --2- 172.21.15.66:0/3557411291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c102790 0x7f7a1c1067e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009900 tx=0x7f7a0c02a440 comp rx=0 tx=0).stop 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.835+0000 7f7a242fb640 1 -- 172.21.15.66:0/3557411291 shutdown_connections 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.835+0000 7f7a242fb640 1 --2- 172.21.15.66:0/3557411291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c106f10 0x7f7a1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.835+0000 7f7a242fb640 1 --2- 172.21.15.66:0/3557411291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c102790 0x7f7a1c1067e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.835+0000 7f7a242fb640 1 --2- 172.21.15.66:0/3557411291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101de0 0x7f7a1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.835+0000 7f7a242fb640 1 -- 172.21.15.66:0/3557411291 >> 172.21.15.66:0/3557411291 conn(0x7f7a1c0fd8e0 msgr2=0x7f7a1c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.836+0000 7f7a242fb640 1 -- 172.21.15.66:0/3557411291 shutdown_connections 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.836+0000 7f7a242fb640 1 -- 172.21.15.66:0/3557411291 wait complete. 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.837+0000 7f7a242fb640 1 Processor -- start 2024-09-15T22:58:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.837+0000 7f7a242fb640 1 -- start start 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c102790 0x7f7a1c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 0x7f7a1c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c111fe0 con 0x7f7a1c106f10 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c111e60 con 0x7f7a1c102790 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22898640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 0x7f7a1c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a21896640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c102790 0x7f7a1c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:56572/0 (socket says 172.21.15.66:56572) 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22898640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 0x7f7a1c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60702/0 (socket says 172.21.15.66:60702) 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 -- 172.21.15.66:0/2587918509 learned_addr learned my addr 172.21.15.66:0/2587918509 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:59.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c112160 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 -- 172.21.15.66:0/2587918509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c102790 msgr2=0x7f7a1c198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c102790 0x7f7a1c198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 -- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 msgr2=0x7f7a1c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 0x7f7a1c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.838+0000 7f7a22097640 1 -- 172.21.15.66:0/2587918509 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c19d4b0 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a22097640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800b4a0 tx=0x7f7a1800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a137fe640 1 -- 172.21.15.66:0/2587918509 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18014070 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a137fe640 1 -- 172.21.15.66:0/2587918509 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a18010af0 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a137fe640 1 -- 172.21.15.66:0/2587918509 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18017d10 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c19d7a0 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.839+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c074420 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.842+0000 7f7a137fe640 1 -- 172.21.15.66:0/2587918509 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7a18017070 con 0x7f7a1c101de0 2024-09-15T22:58:59.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.843+0000 7f7a266d4740 1 Processor -- start 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a266d4740 1 -- start start 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a137fe640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 0x7f7a080a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a137fe640 1 -- 172.21.15.66:0/2587918509 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f7a180cf390 con 0x7f7a1c101de0 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6555a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.844+0000 7f7a22898640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 0x7f7a080a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a22097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a22097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60706/0 (socket says 172.21.15.66:60706) 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc656af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a266d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dcc64bb2f0 con 0x55dcc6556b40 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a266d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dcc6462cf0 con 0x55dcc65555d0 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a266d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dcc64b72b0 con 0x55dcc6568b80 2024-09-15T22:58:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a22097640 1 -- 172.21.15.66:0/1896130219 learned_addr learned my addr 172.21.15.66:0/1896130219 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6555a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a22898640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc656af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a22898640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 0x7f7a080a5940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005fd0 tx=0x7f7a14009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 -- 172.21.15.66:0/1896130219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 msgr2=0x55dcc656af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc656af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 -- 172.21.15.66:0/1896130219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 msgr2=0x55dcc6555090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.845+0000 7f7a21896640 1 -- 172.21.15.66:0/1896130219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcc64473a0 con 0x55dcc65555d0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.846+0000 7f7a21896640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6555a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009850 tx=0x7f7a0c003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8009715fd7fbee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.846+0000 7f7a22097640 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.846+0000 7f7a10dea640 1 -- 172.21.15.66:0/1896130219 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0046c0 con 0x55dcc65555d0 2024-09-15T22:58:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.846+0000 7f7a10dea640 1 -- 172.21.15.66:0/1896130219 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a0c0054e0 con 0x55dcc65555d0 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.846+0000 7f7a10dea640 1 -- 172.21.15.66:0/1896130219 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c031910 con 0x55dcc65555d0 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.848+0000 7f7a266d4740 1 -- 172.21.15.66:0/1896130219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 msgr2=0x55dcc6555a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.848+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6555a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009850 tx=0x7f7a0c003770 comp rx=0 tx=0).stop 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 -- 172.21.15.66:0/1896130219 shutdown_connections 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc656af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6555a10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1896130219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6556b40 0x55dcc6555090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 -- 172.21.15.66:0/1896130219 >> 172.21.15.66:0/1896130219 conn(0x55dcc651e310 msgr2=0x55dcc6551c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 -- 172.21.15.66:0/1896130219 shutdown_connections 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.849+0000 7f7a266d4740 1 -- 172.21.15.66:0/1896130219 wait complete. 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.850+0000 7f7a266d4740 1 -- start start 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.850+0000 7f7a266d4740 1 Processor -- start 2024-09-15T22:58:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc6565810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6568b80 0x55dcc6565de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dcc656b820 con 0x55dcc65555d0 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55dcc6476060 con 0x55dcc6568b80 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55dcc656b9a0 con 0x55dcc6556b40 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a266d4740 10 client.0 _ll_register_callbacks cb 0x55dcc61c98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a22097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a22097640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60710/0 (socket says 172.21.15.66:60710) 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.851+0000 7f7a22097640 1 -- 172.21.15.66:0/478221081 learned_addr learned my addr 172.21.15.66:0/478221081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.852+0000 7f7a22898640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6568b80 0x55dcc6565de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.852+0000 7f7a21896640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc6565810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 -- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 msgr2=0x55dcc6565810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc6565810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 -- 172.21.15.66:0/478221081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6568b80 msgr2=0x55dcc6565de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6568b80 0x55dcc6565de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 -- 172.21.15.66:0/478221081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcc622c3c0 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a22097640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009420 tx=0x7f7a1809b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d008cd30a3b0a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a180b4060 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.853+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f7a18010ca0 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.854+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0c0054e0 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.854+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f7a1801e040 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.854+0000 7f7a266d4740 10 client.18342 fetch_fsmap learned FSMap version 60 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.854+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55dcc6577300 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.854+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a180cf160 con 0x55dcc65555d0 2024-09-15T22:58:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f7a1809a820 con 0x55dcc65555d0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 10 client.18342 fetch_fsmap finished waiting for FSMap version 60 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 10 client.18342 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 20 client.18342 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65787c0 0x55dcc657abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 4 client.18342 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7a0c0054e0 con 0x55dcc65787c0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.855+0000 7f7a21896640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65787c0 0x55dcc657abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.857+0000 7f7a21896640 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65787c0 0x55dcc657abf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e136161bc6fbd3e server_cookie=11d574d1e27b8ea6 in_seq=0 out_seq=0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.857+0000 7f7a05ffb640 10 client.18342 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a05ffb640 1 -- 172.21.15.66:0/478221081 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7a0c0054e0 con 0x55dcc65787c0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a05ffb640 10 client.18342 handle_command_reply: tid=0 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 client.18342 shutdown 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 msgr2=0x55dcc6568560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009420 tx=0x7f7a1809b3d0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 shutdown_connections 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65787c0 0x55dcc657abf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6568b80 0x55dcc6565de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc6565810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 --2- 172.21.15.66:0/478221081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6568560 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a05ffb640 0 client.18342 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 >> 172.21.15.66:0/478221081 conn(0x55dcc651e310 msgr2=0x55dcc6557960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 shutdown_connections 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 1 -- 172.21.15.66:0/478221081 wait complete. 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.858+0000 7f7a266d4740 20 client.18342 trim_cache size 0 max 16384 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 Processor -- start 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 -- start start 2024-09-15T22:58:59.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc65650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6568b80 0x55dcc65804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.884+0000 7f7a266d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1ad030 con 0x55dcc6568b80 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.885+0000 7f7a266d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1aedb0 con 0x55dcc65555d0 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.885+0000 7f7a266d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1ad7c0 con 0x55dcc6556b40 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.885+0000 7f7a22097640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.885+0000 7f7a22097640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42828/0 (socket says 172.21.15.66:42828) 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.885+0000 7f7a22097640 1 -- 172.21.15.66:0/1027037149 learned_addr learned my addr 172.21.15.66:0/1027037149 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22898640 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6568b80 0x55dcc65804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 -- 172.21.15.66:0/1027037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 msgr2=0x55dcc65650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc65650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 -- 172.21.15.66:0/1027037149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6568b80 msgr2=0x55dcc65804c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6568b80 0x55dcc65804c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 -- 172.21.15.66:0/1027037149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcc65688d0 con 0x55dcc65555d0 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a22097640 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1809b0d0 tx=0x7f7a180047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561873eee6662eff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.886+0000 7f7a07fff640 1 -- 172.21.15.66:0/1027037149 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a180cf160 con 0x55dcc65555d0 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.887+0000 7f7a07fff640 1 -- 172.21.15.66:0/1027037149 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a180a3f90 con 0x55dcc65555d0 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.887+0000 7f7a07fff640 1 -- 172.21.15.66:0/1027037149 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a180cc7e0 con 0x55dcc65555d0 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 -- 172.21.15.66:0/1027037149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 msgr2=0x55dcc6574ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1809b0d0 tx=0x7f7a180047d0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 -- 172.21.15.66:0/1027037149 shutdown_connections 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc6568b80 0x55dcc65804c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6556b40 0x55dcc65650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 --2- 172.21.15.66:0/1027037149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc65555d0 0x55dcc6574ac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 -- 172.21.15.66:0/1027037149 >> 172.21.15.66:0/1027037149 conn(0x55dcc651e310 msgr2=0x55dcc6567890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 -- 172.21.15.66:0/1027037149 shutdown_connections 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.888+0000 7f7a266d4740 1 -- 172.21.15.66:0/1027037149 wait complete. 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.889+0000 7f7a266d4740 1 -- start start 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.889+0000 7f7a266d4740 1 Processor -- start 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.890+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6570f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.890+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 0x55dcc6571450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.890+0000 7f7a266d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc6562250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.890+0000 7f7a266d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1ae680 con 0x55dcc65555d0 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a266d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1adf50 con 0x55dcc6556b40 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a21896640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 0x55dcc6571450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a21896640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 0x55dcc6571450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42830/0 (socket says 172.21.15.66:42830) 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a21896640 1 -- 172.21.15.66:0/2883601139 learned_addr learned my addr 172.21.15.66:0/2883601139 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c1ab030 con 0x55dcc6568b80 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a266d4740 10 client.0 _ll_register_callbacks cb 0x7f7a180cc730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:58:59.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a22097640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6570f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.891+0000 7f7a22898640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc6562250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 -- 172.21.15.66:0/2883601139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 msgr2=0x55dcc6571450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 0x55dcc6571450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 -- 172.21.15.66:0/2883601139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 msgr2=0x55dcc6570f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6570f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 -- 172.21.15.66:0/2883601139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcc6562a80 con 0x55dcc6568b80 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a22898640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc6562250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a14011ca0 tx=0x7f7a14004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22c8c80dcc696361 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.893+0000 7f7a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.894+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003970 con 0x55dcc6568b80 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.895+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f7a14009040 con 0x55dcc6568b80 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.895+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a180a3f90 con 0x55dcc6568b80 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.896+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f7a14033050 con 0x55dcc6568b80 2024-09-15T22:58:59.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.896+0000 7f7a266d4740 10 client.27550 fetch_fsmap learned FSMap version 60 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.896+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55dcc65f4120 con 0x55dcc6568b80 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a180a3f90 con 0x55dcc6568b80 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 60) ==== 8434+0+0 (secure 0 0 0) 0x7f7a1401e420 con 0x55dcc6568b80 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 10 client.27550 fetch_fsmap finished waiting for FSMap version 60 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 10 client.27550 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 20 client.27550 populate_metadata read hostname 'smithi066' 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65f4940 0x55dcc65f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 4 client.27550 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.897+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dcc64c8860 con 0x55dcc65f4940 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.900+0000 7f7a22097640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65f4940 0x55dcc65f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.902+0000 7f7a22097640 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65f4940 0x55dcc65f6d60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aaf5157154d403dc server_cookie=34b29fbba35fd80d in_seq=0 out_seq=0 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.902+0000 7f7a05ffb640 10 client.27550 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.902+0000 7f7a05ffb640 1 -- 172.21.15.66:0/2883601139 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dcc64c8860 con 0x55dcc65f4940 2024-09-15T22:58:59.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.902+0000 7f7a05ffb640 10 client.27550 handle_command_reply: tid=0 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.902+0000 7f7a266d4740 1 client.27550 shutdown 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.903+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 msgr2=0x55dcc6562250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.903+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc6562250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a14011ca0 tx=0x7f7a14004ab0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 shutdown_connections 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55dcc65f4940 0x55dcc65f6d60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dcc6568b80 0x55dcc6562250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55dcc6556b40 0x55dcc6571450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 --2- 172.21.15.66:0/2883601139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dcc65555d0 0x55dcc6570f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 >> 172.21.15.66:0/2883601139 conn(0x55dcc651e310 msgr2=0x55dcc6550500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.907+0000 7f7a05ffb640 0 client.27550 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.908+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 shutdown_connections 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.908+0000 7f7a266d4740 1 -- 172.21.15.66:0/2883601139 wait complete. 2024-09-15T22:58:59.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.910+0000 7f7a266d4740 20 client.27550 trim_cache size 0 max 16384 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.910+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 msgr2=0x7f7a080a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.910+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 0x7f7a080a5940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005fd0 tx=0x7f7a14009500 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 msgr2=0x7f7a1c198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800b4a0 tx=0x7f7a1800b960 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 shutdown_connections 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a080a3480 0x7f7a080a5940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c106f10 0x7f7a1c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a1c102790 0x7f7a1c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 --2- 172.21.15.66:0/2587918509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a1c101de0 0x7f7a1c198500 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800b4a0 tx=0x7f7a1800b960 comp rx=0 tx=0).stop 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 >> 172.21.15.66:0/2587918509 conn(0x7f7a1c0fd8e0 msgr2=0x7f7a1c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 shutdown_connections 2024-09-15T22:58:59.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:58:58.911+0000 7f7a242fb640 1 -- 172.21.15.66:0/2587918509 wait complete. 2024-09-15T22:58:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:58:59 smithi184 ceph-mon[35203]: pgmap v426: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 307 op/s 2024-09-15T22:58:59.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:58:59 smithi066 ceph-mon[31185]: pgmap v426: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 307 op/s 2024-09-15T22:58:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:58:59 smithi087 ceph-mon[35290]: pgmap v426: 129 pgs: 129 active+clean; 2.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 307 op/s 2024-09-15T22:59:00.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:59:01.024 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:01 smithi184 ceph-mon[35203]: pgmap v427: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 336 op/s 2024-09-15T22:59:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:01 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:01.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:01 smithi066 ceph-mon[31185]: pgmap v427: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 336 op/s 2024-09-15T22:59:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:01 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 -- 172.21.15.66:0/464117349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 msgr2=0x7f72601029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 --2- 172.21.15.66:0/464117349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601029b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7250009900 tx=0x7f725002a480 comp rx=0 tx=0).stop 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 -- 172.21.15.66:0/464117349 shutdown_connections 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 --2- 172.21.15.66:0/464117349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 0x7f726010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 --2- 172.21.15.66:0/464117349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601029b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 --2- 172.21.15.66:0/464117349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 -- 172.21.15.66:0/464117349 >> 172.21.15.66:0/464117349 conn(0x7f72600fc7d0 msgr2=0x7f72600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 -- 172.21.15.66:0/464117349 shutdown_connections 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.535+0000 7f7268190640 1 -- 172.21.15.66:0/464117349 wait complete. 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 Processor -- start 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 -- start start 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 0x7f726019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7260110fa0 con 0x7f7260102570 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7260110e20 con 0x7f7260102ef0 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7268190640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7260111120 con 0x7f7260100e20 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60738/0 (socket says 172.21.15.66:60738) 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f726572b640 1 -- 172.21.15.66:0/3159799843 learned_addr learned my addr 172.21.15.66:0/3159799843 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f726672d640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 0x7f726019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.536+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 -- 172.21.15.66:0/3159799843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 msgr2=0x7f7260197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 -- 172.21.15.66:0/3159799843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 msgr2=0x7f726019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 0x7f726019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 -- 172.21.15.66:0/3159799843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726019c410 con 0x7f7260102570 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f726572b640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7250006010 tx=0x7f7250003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7256ffd640 1 -- 172.21.15.66:0/3159799843 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250035070 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7256ffd640 1 -- 172.21.15.66:0/3159799843 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7250031c30 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726019c6a0 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7256ffd640 1 -- 172.21.15.66:0/3159799843 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250038d40 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.537+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7260069f70 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.539+0000 7f7256ffd640 1 -- 172.21.15.66:0/3159799843 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7250038470 con 0x7f7260102570 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 Processor -- start 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 -- start start 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137ddb40 0x562c137dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c137422f0 con 0x562c137dc5d0 2024-09-15T22:59:01.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c136e9cf0 con 0x562c137ddb40 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f726a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c1373e2b0 con 0x562c137e7370 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f7265f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.540+0000 7f7265f2c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60752/0 (socket says 172.21.15.66:60752) 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 -- 172.21.15.66:0/1417421092 learned_addr learned my addr 172.21.15.66:0/1417421092 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7256ffd640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 0x7f724c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f726672d640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137ddb40 0x562c137dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f726572b640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 -- 172.21.15.66:0/1417421092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 msgr2=0x562c137e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f726672d640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 0x7f724c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 -- 172.21.15.66:0/1417421092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137ddb40 msgr2=0x562c137dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137ddb40 0x562c137dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 -- 172.21.15.66:0/1417421092 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c136ce3a0 con 0x562c137dc5d0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7256ffd640 1 -- 172.21.15.66:0/3159799843 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f72500f24b0 con 0x7f7260102570 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f726572b640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f7265f2c640 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f725c007850 tx=0x7f725c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f615a3f4b52b9261 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f724bfff640 1 -- 172.21.15.66:0/1417421092 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c00d950 con 0x562c137dc5d0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f726672d640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 0x7f724c0a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f725800afd0 tx=0x7f725800a4d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f724bfff640 1 -- 172.21.15.66:0/1417421092 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c018070 con 0x562c137dc5d0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.541+0000 7f724bfff640 1 -- 172.21.15.66:0/1417421092 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0123e0 con 0x562c137dc5d0 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- 172.21.15.66:0/1417421092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 msgr2=0x562c137dca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f725c007850 tx=0x7f725c007d10 comp rx=0 tx=0).stop 2024-09-15T22:59:01.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- 172.21.15.66:0/1417421092 shutdown_connections 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137dc5d0 0x562c137dca10 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 --2- 172.21.15.66:0/1417421092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137ddb40 0x562c137dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- 172.21.15.66:0/1417421092 >> 172.21.15.66:0/1417421092 conn(0x562c137a5310 msgr2=0x562c137d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- 172.21.15.66:0/1417421092 shutdown_connections 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- 172.21.15.66:0/1417421092 wait complete. 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.542+0000 7f726a569740 1 -- start start 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 Processor -- start 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137dc5d0 0x562c137e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137e7370 0x562c137e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c137ea070 con 0x562c137ddb40 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c136fd060 con 0x562c137e7370 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c137ea1f0 con 0x562c137dc5d0 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726a569740 10 client.0 _ll_register_callbacks cb 0x562c134508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60756/0 (socket says 172.21.15.66:60756) 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 -- 172.21.15.66:0/2996781627 learned_addr learned my addr 172.21.15.66:0/2996781627 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f7265f2c640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137dc5d0 0x562c137e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726672d640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137e7370 0x562c137e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 -- 172.21.15.66:0/2996781627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137dc5d0 msgr2=0x562c137e6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137dc5d0 0x562c137e6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 -- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137e7370 msgr2=0x562c137e44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137e7370 0x562c137e44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.543+0000 7f726572b640 1 -- 172.21.15.66:0/2996781627 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c134b33c0 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726572b640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f72500c6a70 tx=0x7f7250089110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7838eecf62aafa0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250089180 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f725c018070 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f72500efa20 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f72500efc20 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 10 client.18357 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562c137f59d0 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c018070 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f7250041c70 con 0x562c137ddb40 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 10 client.18357 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 10 client.18357 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:59:01.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 20 client.18357 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.544+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c137f6e10 0x562c137f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.545+0000 7f726a569740 4 client.18357 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.545+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c1374f860 con 0x562c137f6e10 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.545+0000 7f7265f2c640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c137f6e10 0x562c137f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.545+0000 7f72497fa640 10 client.18357 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.545+0000 7f7265f2c640 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c137f6e10 0x562c137f9250 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a24c562efa2daa41 server_cookie=712ee66eb77ae3c8 in_seq=0 out_seq=0 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f72497fa640 1 -- 172.21.15.66:0/2996781627 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c1374f860 con 0x562c137f6e10 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f72497fa640 10 client.18357 handle_command_reply: tid=0 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 client.18357 shutdown 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 msgr2=0x562c137e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f72500c6a70 tx=0x7f7250089110 comp rx=0 tx=0).stop 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 shutdown_connections 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c137f6e10 0x562c137f9250 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137e7370 0x562c137e44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137e3f60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 --2- 172.21.15.66:0/2996781627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137dc5d0 0x562c137e6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 >> 172.21.15.66:0/2996781627 conn(0x562c137a5310 msgr2=0x562c137de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f72497fa640 0 client.18357 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 shutdown_connections 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 1 -- 172.21.15.66:0/2996781627 wait complete. 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.546+0000 7f726a569740 20 client.18357 trim_cache size 0 max 16384 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 Processor -- start 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 -- start start 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137d8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72601acef0 con 0x562c137ddb40 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72601aeca0 con 0x562c137dc5d0 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72601ad680 con 0x562c137e7370 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.559+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60768/0 (socket says 172.21.15.66:60768) 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 -- 172.21.15.66:0/1182565386 learned_addr learned my addr 172.21.15.66:0/1182565386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f7265f2c640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726672d640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137d8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 -- 172.21.15.66:0/1182565386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 msgr2=0x562c137d8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137d8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 -- 172.21.15.66:0/1182565386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 msgr2=0x562c137f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 -- 172.21.15.66:0/1182565386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c137d9180 con 0x562c137ddb40 2024-09-15T22:59:01.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726672d640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137d8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f726572b640 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f7250003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8859b60b52189795 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f724b7fe640 1 -- 172.21.15.66:0/1182565386 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72500bde70 con 0x562c137ddb40 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f724b7fe640 1 -- 172.21.15.66:0/1182565386 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72500bea30 con 0x562c137ddb40 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.560+0000 7f724b7fe640 1 -- 172.21.15.66:0/1182565386 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72500efa20 con 0x562c137ddb40 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- 172.21.15.66:0/1182565386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 msgr2=0x562c137d8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f7250003f40 comp rx=0 tx=0).stop 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- 172.21.15.66:0/1182565386 shutdown_connections 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137e7370 0x562c137d8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137ddb40 0x562c137d8700 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 --2- 172.21.15.66:0/1182565386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- 172.21.15.66:0/1182565386 >> 172.21.15.66:0/1182565386 conn(0x562c137a5310 msgr2=0x562c137df2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- 172.21.15.66:0/1182565386 shutdown_connections 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- 172.21.15.66:0/1182565386 wait complete. 2024-09-15T22:59:01.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 -- start start 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.561+0000 7f726a569740 1 Processor -- start 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137ddb40 0x562c137eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72601ae540 con 0x562c137e7370 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72601ade10 con 0x562c137dc5d0 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72601aaef0 con 0x562c137ddb40 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726a569740 10 client.0 _ll_register_callbacks cb 0x7f7250009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726572b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137ddb40 0x562c137eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:60778/0 (socket says 172.21.15.66:60778) 2024-09-15T22:59:01.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 -- 172.21.15.66:0/3635563259 learned_addr learned my addr 172.21.15.66:0/3635563259 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 -- 172.21.15.66:0/3635563259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137ddb40 msgr2=0x562c137eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137ddb40 0x562c137eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 -- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 msgr2=0x562c137ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f726672d640 1 -- 172.21.15.66:0/3635563259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c137eb6f0 con 0x562c137e7370 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.562+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726672d640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7258011b20 tx=0x7f7258004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a152a36deb9bbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258026070 con 0x562c137e7370 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f7258003970 con 0x562c137e7370 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72500bea30 con 0x562c137e7370 2024-09-15T22:59:01.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7258031050 con 0x562c137e7370 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 10 client.18363 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562c13861770 con 0x562c137e7370 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72500bea30 con 0x562c137e7370 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f725800f450 con 0x562c137e7370 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 10 client.18363 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 10 client.18363 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 20 client.18363 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c13861fb0 0x562c138643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 4 client.18363 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.563+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c13749d70 con 0x562c13861fb0 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c13861fb0 0x562c138643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f72497fa640 10 client.18363 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:01.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f7265f2c640 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c13861fb0 0x562c138643d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89c629aaba9ca3a6 server_cookie=e3e1d87b71138216 in_seq=0 out_seq=0 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f72497fa640 1 -- 172.21.15.66:0/3635563259 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c13749d70 con 0x562c13861fb0 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f72497fa640 10 client.18363 handle_command_reply: tid=0 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 client.18363 shutdown 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 msgr2=0x562c137eb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7258011b20 tx=0x7f7258004a40 comp rx=0 tx=0).stop 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 shutdown_connections 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x562c13861fb0 0x562c138643d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c137e7370 0x562c137eb1b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c137ddb40 0x562c137eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 --2- 172.21.15.66:0/3635563259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c137dc5d0 0x562c137ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f72497fa640 0 client.18363 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.564+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 >> 172.21.15.66:0/3635563259 conn(0x562c137a5310 msgr2=0x562c137df2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 shutdown_connections 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f726a569740 1 -- 172.21.15.66:0/3635563259 wait complete. 2024-09-15T22:59:01.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f726a569740 20 client.18363 trim_cache size 0 max 16384 2024-09-15T22:59:01.583 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:01.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 msgr2=0x7f724c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 0x7f724c0a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f725800afd0 tx=0x7f725800a4d0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 msgr2=0x7f72601979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7250006010 tx=0x7f7250003c00 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.565+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 shutdown_connections 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f724c0a33b0 0x7f724c0a5870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7260102ef0 0x7f726019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7260102570 0x7f72601979a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 --2- 172.21.15.66:0/3159799843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7260100e20 0x7f7260197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 >> 172.21.15.66:0/3159799843 conn(0x7f72600fc7d0 msgr2=0x7f72600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 shutdown_connections 2024-09-15T22:59:01.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:01.566+0000 7f7268190640 1 -- 172.21.15.66:0/3159799843 wait complete. 2024-09-15T22:59:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:01 smithi087 ceph-mon[35290]: pgmap v427: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 336 op/s 2024-09-15T22:59:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:01 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:02.344 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:59:02.600 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 -- 172.21.15.66:0/608060094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 msgr2=0x7f9b7410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/608060094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b7410ea90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009ca0 tx=0x7f9b6c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 -- 172.21.15.66:0/608060094 shutdown_connections 2024-09-15T22:59:03.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/608060094 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b7410ea90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/608060094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 0x7f9b741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/608060094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 0x7f9b741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 -- 172.21.15.66:0/608060094 >> 172.21.15.66:0/608060094 conn(0x7f9b740fd8c0 msgr2=0x7f9b740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 -- 172.21.15.66:0/608060094 shutdown_connections 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.062+0000 7f9b78ddc640 1 -- 172.21.15.66:0/608060094 wait complete. 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 Processor -- start 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 -- start start 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 0x7f9b740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 0x7f9b74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74111f70 con 0x7f9b74106f10 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74111df0 con 0x7f9b74102790 2024-09-15T22:59:03.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b78ddc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741120f0 con 0x7f9b74101de0 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b72d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b72d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48154/0 (socket says 172.21.15.66:48154) 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b72d9d640 1 -- 172.21.15.66:0/1518658045 learned_addr learned my addr 172.21.15.66:0/1518658045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b7259c640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 0x7f9b740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.063+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 0x7f9b74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 -- 172.21.15.66:0/1518658045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 msgr2=0x7f9b740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 0x7f9b740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 -- 172.21.15.66:0/1518658045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 msgr2=0x7f9b74074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 0x7f9b74074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 -- 172.21.15.66:0/1518658045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b741aacf0 con 0x7f9b74106f10 2024-09-15T22:59:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b72d9d640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c031a20 tx=0x7f9b6c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b6b7fe640 1 -- 172.21.15.66:0/1518658045 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c003b70 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b741aaf20 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b6b7fe640 1 -- 172.21.15.66:0/1518658045 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b6c003d10 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b6b7fe640 1 -- 172.21.15.66:0/1518658045 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c02fc80 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.064+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b741ab3d0 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b6b7fe640 1 -- 172.21.15.66:0/1518658045 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9b6c0046a0 con 0x7f9b74106f10 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 Processor -- start 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 -- start start 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ebba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3e212f0 con 0x55ccf3ebcb40 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3dc8cf0 con 0x55ccf3ec6370 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3e1d2b0 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.067+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48160/0 (socket says 172.21.15.66:48160) 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 -- 172.21.15.66:0/413472142 learned_addr learned my addr 172.21.15.66:0/413472142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b7259c640 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ebba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6b7fe640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 0x7f9b600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 -- 172.21.15.66:0/413472142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 msgr2=0x55ccf3ebba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ebba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 -- 172.21.15.66:0/413472142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 msgr2=0x55ccf3ec8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 -- 172.21.15.66:0/413472142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf3dad3a0 con 0x55ccf3ebcb40 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b72d9d640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 0x7f9b600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6b7fe640 1 -- 172.21.15.66:0/1518658045 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f9b6c0f1140 con 0x7f9b74106f10 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a5c0 tx=0x7f9b5c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d58cc5bec3e8659 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b68ff9640 1 -- 172.21.15.66:0/413472142 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c012450 con 0x55ccf3ebcb40 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b68ff9640 1 -- 172.21.15.66:0/413472142 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b5c012ad0 con 0x55ccf3ebcb40 2024-09-15T22:59:03.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b72d9d640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 0x7f9b600a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0eea90 tx=0x7f9b6c02a8c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.068+0000 7f9b68ff9640 1 -- 172.21.15.66:0/413472142 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00fa50 con 0x55ccf3ebcb40 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/413472142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 msgr2=0x55ccf3ebb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a5c0 tx=0x7f9b5c0117b0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/413472142 shutdown_connections 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ebba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/413472142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebb090 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/413472142 >> 172.21.15.66:0/413472142 conn(0x55ccf3e84310 msgr2=0x55ccf3eb7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/413472142 shutdown_connections 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.069+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/413472142 wait complete. 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 -- start start 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 Processor -- start 2024-09-15T22:59:03.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ec30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3ec9070 con 0x55ccf3ec6370 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3ddc060 con 0x55ccf3ebcb40 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ccf3ec91f0 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7b1b5740 10 client.0 _ll_register_callbacks cb 0x55ccf3b2f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:03.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48164/0 (socket says 172.21.15.66:48164) 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b6bfff640 1 -- 172.21.15.66:0/3309161924 learned_addr learned my addr 172.21.15.66:0/3309161924 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.070+0000 7f9b7259c640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ec30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 -- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 msgr2=0x55ccf3ec5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 -- 172.21.15.66:0/3309161924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 msgr2=0x55ccf3ec30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ec30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 -- 172.21.15.66:0/3309161924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf3b923c0 con 0x55ccf3ec6370 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b7259c640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ec30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00afb0 tx=0x7f9b5c00f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f626700309b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c023040 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f9b5c005230 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b5c012ad0 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9b5c005430 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b7b1b5740 10 client.18375 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ccf3ed4be0 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.071+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b5c012ad0 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f9b5c0048c0 con 0x55ccf3ec6370 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 10 client.18375 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 10 client.18375 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 20 client.18375 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3ed5f30 0x55ccf3ed8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 4 client.18375 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:03.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccf3e2e860 con 0x55ccf3ed5f30 2024-09-15T22:59:03.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.072+0000 7f9b7259c640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3ed5f30 0x55ccf3ed8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7259c640 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3ed5f30 0x55ccf3ed8320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55c98cec6f612075 server_cookie=6f141907649fccda in_seq=0 out_seq=0 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b59ffb640 10 client.18375 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b59ffb640 1 -- 172.21.15.66:0/3309161924 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccf3e2e860 con 0x55ccf3ed5f30 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b59ffb640 10 client.18375 handle_command_reply: tid=0 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 client.18375 shutdown 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 msgr2=0x55ccf3ec3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00afb0 tx=0x7f9b5c00f550 comp rx=0 tx=0).stop 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 shutdown_connections 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3ed5f30 0x55ccf3ed8320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec3860 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ec30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/3309161924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.074+0000 7f9b59ffb640 0 client.18375 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.073+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 >> 172.21.15.66:0/3309161924 conn(0x55ccf3e84310 msgr2=0x55ccf3ebd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.074+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 shutdown_connections 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.074+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/3309161924 wait complete. 2024-09-15T22:59:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.074+0000 7f9b7b1b5740 20 client.18375 trim_cache size 0 max 16384 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 Processor -- start 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 -- start start 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b56a0 con 0x55ccf3ec6370 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b7450 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b5e30 con 0x55ccf3ebcb40 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48176/0 (socket says 172.21.15.66:48176) 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1004802268 learned_addr learned my addr 172.21.15.66:0/1004802268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b7259c640 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1004802268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 msgr2=0x55ccf3ebe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1004802268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebb5d0 msgr2=0x55ccf3ec5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.087+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1004802268 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccf3eb7510 con 0x55ccf3ec6370 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x55ccf3ebc230 tx=0x7f9b5c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2c65ce06f033e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b5bfff640 1 -- 172.21.15.66:0/1004802268 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00a400 con 0x55ccf3ec6370 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b5bfff640 1 -- 172.21.15.66:0/1004802268 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b5c004660 con 0x55ccf3ec6370 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b5bfff640 1 -- 172.21.15.66:0/1004802268 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00f6b0 con 0x55ccf3ec6370 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1004802268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 msgr2=0x55ccf3ebe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x55ccf3ebc230 tx=0x7f9b5c0117b0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1004802268 shutdown_connections 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ec6370 0x55ccf3ebe660 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3ebe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1004802268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ec5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1004802268 >> 172.21.15.66:0/1004802268 conn(0x55ccf3e84310 msgr2=0x55ccf3ec4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1004802268 shutdown_connections 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.088+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1004802268 wait complete. 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 -- start start 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 Processor -- start 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3eced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b6cf0 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b65c0 con 0x55ccf3ec6370 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741b36a0 con 0x55ccf3ebcb40 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7b1b5740 10 client.0 _ll_register_callbacks cb 0x7f9b5c00ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48188/0 (socket says 172.21.15.66:48188) 2024-09-15T22:59:03.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1929271194 learned_addr learned my addr 172.21.15.66:0/1929271194 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b7259c640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3eced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 msgr2=0x55ccf3eced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3eced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1929271194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 msgr2=0x55ccf3ec9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.089+0000 7f9b6bfff640 1 -- 172.21.15.66:0/1929271194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccf3eca5a0 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b6bfff640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a790 tx=0x7f9b5c00f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6df543224a7fd77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00a400 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f9b5c00ae40 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b5c004660 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f9b5c047050 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 10 client.18381 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ccf3f40650 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b5c004660 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f9b5c00f640 con 0x55ccf3ebb5d0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 10 client.18381 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 10 client.18381 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 20 client.18381 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3f40cd0 0x55ccf3f430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 4 client.18381 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.090+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccf3e28d70 con 0x55ccf3f40cd0 2024-09-15T22:59:03.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7259c640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3f40cd0 0x55ccf3f430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7259c640 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3f40cd0 0x55ccf3f430f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9dd8e2371c763800 server_cookie=7432af4f865e1aea in_seq=0 out_seq=0 2024-09-15T22:59:03.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b59ffb640 10 client.18381 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b59ffb640 1 -- 172.21.15.66:0/1929271194 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccf3e28d70 con 0x55ccf3f40cd0 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b59ffb640 10 client.18381 handle_command_reply: tid=0 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 client.18381 shutdown 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 msgr2=0x55ccf3ece7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00a790 tx=0x7f9b5c00f530 comp rx=0 tx=0).stop 2024-09-15T22:59:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 shutdown_connections 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55ccf3f40cd0 0x55ccf3f430f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b59ffb640 0 client.18381 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.091+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ccf3ec6370 0x55ccf3ec9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccf3ebcb40 0x55ccf3eced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 1 --2- 172.21.15.66:0/1929271194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ccf3ebb5d0 0x55ccf3ece7f0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 >> 172.21.15.66:0/1929271194 conn(0x55ccf3e84310 msgr2=0x55ccf3ec5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 shutdown_connections 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 1 -- 172.21.15.66:0/1929271194 wait complete. 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b7b1b5740 20 client.18381 trim_cache size 0 max 16384 2024-09-15T22:59:03.100 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 msgr2=0x7f9b600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 0x7f9b600a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0eea90 tx=0x7f9b6c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 msgr2=0x7f9b74074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c031a20 tx=0x7f9b6c031a50 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 shutdown_connections 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9b600a33b0 0x7f9b600a5870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b74106f10 0x7f9b74074f70 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b74102790 0x7f9b74074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 --2- 172.21.15.66:0/1518658045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b74101de0 0x7f9b740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 >> 172.21.15.66:0/1518658045 conn(0x7f9b740fd8c0 msgr2=0x7f9b740febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 shutdown_connections 2024-09-15T22:59:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:03.092+0000 7f9b78ddc640 1 -- 172.21.15.66:0/1518658045 wait complete. 2024-09-15T22:59:03.409 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:03 smithi066 ceph-mon[31185]: pgmap v428: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-15T22:59:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:03 smithi184 ceph-mon[35203]: pgmap v428: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-15T22:59:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:03 smithi087 ceph-mon[35290]: pgmap v428: 129 pgs: 129 active+clean; 2.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-15T22:59:03.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:59:04.168 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 -- 172.21.15.66:0/535625146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 msgr2=0x7fa6fc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 --2- 172.21.15.66:0/535625146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc108830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6f801acb0 tx=0x7fa6f803b8f0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 -- 172.21.15.66:0/535625146 shutdown_connections 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 --2- 172.21.15.66:0/535625146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc10d530 0x7fa6fc1150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 --2- 172.21.15.66:0/535625146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc108e00 0x7fa6fc10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 --2- 172.21.15.66:0/535625146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc108830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 -- 172.21.15.66:0/535625146 >> 172.21.15.66:0/535625146 conn(0x7fa6fc077ba0 msgr2=0x7fa6fc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.941+0000 7fa703690640 1 -- 172.21.15.66:0/535625146 shutdown_connections 2024-09-15T22:59:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.943+0000 7fa703690640 1 -- 172.21.15.66:0/535625146 wait complete. 2024-09-15T22:59:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.944+0000 7fa703690640 1 Processor -- start 2024-09-15T22:59:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.944+0000 7fa703690640 1 -- start start 2024-09-15T22:59:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc108e00 0x7fa6fc110cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc10d530 0x7fa6fc1111f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc06e5a0 con 0x7fa6fc10d530 2024-09-15T22:59:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc06e420 con 0x7fa6fc108450 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa703690640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc06e720 con 0x7fa6fc108e00 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa70142c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa70142c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:34666/0 (socket says 172.21.15.66:34666) 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa70142c640 1 -- 172.21.15.66:0/1042516940 learned_addr learned my addr 172.21.15.66:0/1042516940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc10d530 0x7fa6fc1111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.945+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc108e00 0x7fa6fc110cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 -- 172.21.15.66:0/1042516940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc108e00 msgr2=0x7fa6fc110cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc108e00 0x7fa6fc110cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 -- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc10d530 msgr2=0x7fa6fc1111f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc10d530 0x7fa6fc1111f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 -- 172.21.15.66:0/1042516940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc1117b0 con 0x7fa6fc108450 2024-09-15T22:59:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa70142c640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8003b80 tx=0x7fa6f8003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa6f27fc640 1 -- 172.21.15.66:0/1042516940 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80415f0 con 0x7fa6fc108450 2024-09-15T22:59:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa6f27fc640 1 -- 172.21.15.66:0/1042516940 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f803e070 con 0x7fa6fc108450 2024-09-15T22:59:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.946+0000 7fa6f27fc640 1 -- 172.21.15.66:0/1042516940 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80415f0 con 0x7fa6fc108450 2024-09-15T22:59:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.947+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc111a40 con 0x7fa6fc108450 2024-09-15T22:59:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.947+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc1a2bf0 con 0x7fa6fc108450 2024-09-15T22:59:04.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.950+0000 7fa705a69740 1 Processor -- start 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 -- start start 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710e71090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e71a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c710dd72f0 con 0x55c710e7c370 2024-09-15T22:59:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c710d7ecf0 con 0x55c710e72b40 2024-09-15T22:59:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa705a69740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c710dd32b0 con 0x55c710e715d0 2024-09-15T22:59:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.951+0000 7fa6f27fc640 1 -- 172.21.15.66:0/1042516940 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa6f8041790 con 0x7fa6fc108450 2024-09-15T22:59:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.952+0000 7fa700c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.952+0000 7fa70142c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e71a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.952+0000 7fa700c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48216/0 (socket says 172.21.15.66:48216) 2024-09-15T22:59:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.952+0000 7fa700c2b640 1 -- 172.21.15.66:0/2524884925 learned_addr learned my addr 172.21.15.66:0/2524884925 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.952+0000 7fa701c2d640 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710e71090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa6f27fc640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 0x7fa6e80a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa6f27fc640 1 -- 172.21.15.66:0/1042516940 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7fa6f8019030 con 0x7fa6fc108450 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 0x7fa6e80a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 -- 172.21.15.66:0/2524884925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 msgr2=0x55c710e71090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710e71090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 -- 172.21.15.66:0/2524884925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 msgr2=0x55c710e7e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 -- 172.21.15.66:0/2524884925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c710d633a0 con 0x55c710e715d0 2024-09-15T22:59:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa700c2b640 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.953+0000 7fa70142c640 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e71a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80feec0 tx=0x7fa6f803b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aedabc6479c5348 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.954+0000 7fa6e77fe640 1 -- 172.21.15.66:0/2524884925 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80cd820 con 0x55c710e715d0 2024-09-15T22:59:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.954+0000 7fa6e77fe640 1 -- 172.21.15.66:0/2524884925 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f8047030 con 0x55c710e715d0 2024-09-15T22:59:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.954+0000 7fa6e77fe640 1 -- 172.21.15.66:0/2524884925 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80415f0 con 0x55c710e715d0 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 -- 172.21.15.66:0/2524884925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 msgr2=0x55c710e71a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e71a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80feec0 tx=0x7fa6f803b8f0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 0x7fa6e80a5cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4004650 tx=0x7fa6f4004730 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 -- 172.21.15.66:0/2524884925 shutdown_connections 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710e7e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e71a10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 --2- 172.21.15.66:0/2524884925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710e71090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 -- 172.21.15.66:0/2524884925 >> 172.21.15.66:0/2524884925 conn(0x55c710e3a310 msgr2=0x55c710e6dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:04.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.955+0000 7fa705a69740 1 -- 172.21.15.66:0/2524884925 shutdown_connections 2024-09-15T22:59:04.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.956+0000 7fa705a69740 1 -- 172.21.15.66:0/2524884925 wait complete. 2024-09-15T22:59:04.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.956+0000 7fa705a69740 1 -- start start 2024-09-15T22:59:04.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.956+0000 7fa705a69740 1 Processor -- start 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.957+0000 7fa705a69740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.957+0000 7fa705a69740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e79080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.957+0000 7fa705a69740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e7c370 0x55c710e79810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53924/0 (socket says 172.21.15.66:53924) 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa700c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e79080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 -- 172.21.15.66:0/1988414120 learned_addr learned my addr 172.21.15.66:0/1988414120 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c710e7ee30 con 0x55c710e72b40 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c710d92060 con 0x55c710e7c370 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c710e7efb0 con 0x55c710e715d0 2024-09-15T22:59:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa705a69740 10 client.0 _ll_register_callbacks cb 0x55c710ae58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 -- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e7c370 msgr2=0x55c710e79810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e7c370 0x55c710e79810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 -- 172.21.15.66:0/1988414120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 msgr2=0x55c710e79080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e79080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.958+0000 7fa70142c640 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c710b483c0 con 0x55c710e715d0 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa70142c640 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80428e0 tx=0x7fa6f80d1e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1c3a955c25dc6a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80cd3b0 con 0x55c710e715d0 2024-09-15T22:59:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f8047030 con 0x55c710e715d0 2024-09-15T22:59:04.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7fa6f80fefa0 con 0x55c710e715d0 2024-09-15T22:59:04.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa6f80cd590 con 0x55c710e715d0 2024-09-15T22:59:04.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa705a69740 10 client.27589 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:04.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.959+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55c710e7ee30 con 0x55c710e715d0 2024-09-15T22:59:04.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.960+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f8047030 con 0x55c710e715d0 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.960+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7fa6f80cdcb0 con 0x55c710e715d0 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.960+0000 7fa705a69740 10 client.27589 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.960+0000 7fa705a69740 10 client.27589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.961+0000 7fa705a69740 20 client.27589 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.961+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710e8ba50 0x55c710e8de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.961+0000 7fa705a69740 4 client.27589 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.961+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c710de4860 con 0x55c710e8ba50 2024-09-15T22:59:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.961+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710e8ba50 0x55c710e8de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.963+0000 7fa6e4ff9640 10 client.27589 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.963+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710e8ba50 0x55c710e8de60 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6a619810b4c39a server_cookie=49bc658bb86d0f0e in_seq=0 out_seq=0 2024-09-15T22:59:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1988414120 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c710de4860 con 0x55c710e8ba50 2024-09-15T22:59:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa6e4ff9640 10 client.27589 handle_command_reply: tid=0 2024-09-15T22:59:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 client.27589 shutdown 2024-09-15T22:59:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 msgr2=0x55c710e7bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80428e0 tx=0x7fa6f80d1e00 comp rx=0 tx=0).stop 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 shutdown_connections 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710e8ba50 0x55c710e8de60 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e7c370 0x55c710e79810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa6e4ff9640 0 client.27589 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e79080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.964+0000 7fa705a69740 1 --2- 172.21.15.66:0/1988414120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e715d0 0x55c710e7bdd0 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80428e0 tx=0x7fa6f80d1e00 comp rx=0 tx=0).stop 2024-09-15T22:59:04.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.965+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 >> 172.21.15.66:0/1988414120 conn(0x55c710e3a310 msgr2=0x55c710e73960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.965+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 shutdown_connections 2024-09-15T22:59:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.965+0000 7fa705a69740 1 -- 172.21.15.66:0/1988414120 wait complete. 2024-09-15T22:59:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.965+0000 7fa705a69740 20 client.27589 trim_cache size 0 max 16384 2024-09-15T22:59:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.990+0000 7fa705a69740 1 Processor -- start 2024-09-15T22:59:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.990+0000 7fa705a69740 1 -- start start 2024-09-15T22:59:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e6de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e7c370 0x55c710e93770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1acf30 con 0x55c710e72b40 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1aece0 con 0x55c710e8ba50 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa705a69740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1ad6c0 con 0x55c710e7c370 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa701c2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa701c2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:34696/0 (socket says 172.21.15.66:34696) 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.991+0000 7fa701c2d640 1 -- 172.21.15.66:0/1000026514 learned_addr learned my addr 172.21.15.66:0/1000026514 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 -- 172.21.15.66:0/1000026514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e7c370 msgr2=0x55c710e93770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e7c370 0x55c710e93770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 -- 172.21.15.66:0/1000026514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 msgr2=0x55c710e6de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e6de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 -- 172.21.15.66:0/1000026514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c710e88090 con 0x55c710e8ba50 2024-09-15T22:59:04.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4012360 tx=0x7fa6f4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95da6078107faff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa6e6ffd640 1 -- 172.21.15.66:0/1000026514 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4029480 con 0x55c710e8ba50 2024-09-15T22:59:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.992+0000 7fa6e6ffd640 1 -- 172.21.15.66:0/1000026514 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f4029b00 con 0x55c710e8ba50 2024-09-15T22:59:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.993+0000 7fa705a69740 1 -- 172.21.15.66:0/1000026514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 msgr2=0x55c710e93cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.993+0000 7fa705a69740 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4012360 tx=0x7fa6f4005f90 comp rx=0 tx=0).stop 2024-09-15T22:59:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 -- 172.21.15.66:0/1000026514 shutdown_connections 2024-09-15T22:59:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e8ba50 0x55c710e93cb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e7c370 0x55c710e93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 --2- 172.21.15.66:0/1000026514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e72b40 0x55c710e6de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 -- 172.21.15.66:0/1000026514 >> 172.21.15.66:0/1000026514 conn(0x55c710e3a310 msgr2=0x55c710e6d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 -- 172.21.15.66:0/1000026514 shutdown_connections 2024-09-15T22:59:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.995+0000 7fa705a69740 1 -- 172.21.15.66:0/1000026514 wait complete. 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.996+0000 7fa705a69740 1 -- start start 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.996+0000 7fa705a69740 1 Processor -- start 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710eefa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e8ba50 0x55c710e806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1ae580 con 0x55c710e7c370 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1ade50 con 0x55c710e72b40 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1aaf30 con 0x55c710e8ba50 2024-09-15T22:59:04.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa705a69740 10 client.0 _ll_register_callbacks cb 0x7fa6ec009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa700c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa700c2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48236/0 (socket says 172.21.15.66:48236) 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa700c2b640 1 -- 172.21.15.66:0/1104017065 learned_addr learned my addr 172.21.15.66:0/1104017065 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.997+0000 7fa70142c640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710eefa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa701c2d640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e8ba50 0x55c710e806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 -- 172.21.15.66:0/1104017065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e8ba50 msgr2=0x55c710e806e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e8ba50 0x55c710e806e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 -- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 msgr2=0x55c710eefa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710eefa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 -- 172.21.15.66:0/1104017065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c710e80ee0 con 0x55c710e7c370 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.998+0000 7fa700c2b640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55c710e78910 tx=0x7fa6ec0044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e95e2b48a7926f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.999+0000 7fa6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.999+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec022030 con 0x55c710e7c370 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.999+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f4029b00 con 0x55c710e7c370 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.999+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7fa6ec01f430 con 0x55c710e7c370 2024-09-15T22:59:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:04.999+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa6ec02f050 con 0x55c710e7c370 2024-09-15T22:59:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.002+0000 7fa705a69740 10 client.18396 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.002+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55c710ef7290 con 0x55c710e7c370 2024-09-15T22:59:05.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.003+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f4029b00 con 0x55c710e7c370 2024-09-15T22:59:05.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.003+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7fa6ec010900 con 0x55c710e7c370 2024-09-15T22:59:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 10 client.18396 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 10 client.18396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 20 client.18396 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710ef7ad0 0x55c710ef9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 4 client.18396 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c710dded70 con 0x55c710ef7ad0 2024-09-15T22:59:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.004+0000 7fa70142c640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710ef7ad0 0x55c710ef9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.005+0000 7fa70142c640 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710ef7ad0 0x55c710ef9ef0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de621621f9b1406d server_cookie=b4cac20203e5e137 in_seq=0 out_seq=0 2024-09-15T22:59:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.005+0000 7fa6e4ff9640 10 client.18396 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.005+0000 7fa6e4ff9640 1 -- 172.21.15.66:0/1104017065 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c710dded70 con 0x55c710ef7ad0 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.005+0000 7fa6e4ff9640 10 client.18396 handle_command_reply: tid=0 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.005+0000 7fa705a69740 1 client.18396 shutdown 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 msgr2=0x55c710eeffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55c710e78910 tx=0x7fa6ec0044d0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 shutdown_connections 2024-09-15T22:59:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c710e8ba50 0x55c710e806e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c710e7c370 0x55c710eeffa0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c710ef7ad0 0x55c710ef9ef0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 --2- 172.21.15.66:0/1104017065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c710e72b40 0x55c710eefa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.006+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 >> 172.21.15.66:0/1104017065 conn(0x55c710e3a310 msgr2=0x55c710e6c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.007+0000 7fa6e4ff9640 0 client.18396 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.007+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 shutdown_connections 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.007+0000 7fa705a69740 1 -- 172.21.15.66:0/1104017065 wait complete. 2024-09-15T22:59:05.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.007+0000 7fa705a69740 20 client.18396 trim_cache size 0 max 16384 2024-09-15T22:59:05.010 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:05.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 msgr2=0x7fa6e80a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:05.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 0x7fa6e80a5cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4004650 tx=0x7fa6f4004730 comp rx=0 tx=0).stop 2024-09-15T22:59:05.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 msgr2=0x7fa6fc114c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:05.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8003b80 tx=0x7fa6f8003bb0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 shutdown_connections 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa6e80a3830 0x7fa6e80a5cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6fc10d530 0x7fa6fc1111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6fc108e00 0x7fa6fc110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 --2- 172.21.15.66:0/1042516940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6fc108450 0x7fa6fc114c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.010+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 >> 172.21.15.66:0/1042516940 conn(0x7fa6fc077ba0 msgr2=0x7fa6fc078f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.011+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 shutdown_connections 2024-09-15T22:59:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:05.011+0000 7fa703690640 1 -- 172.21.15.66:0/1042516940 wait complete. 2024-09-15T22:59:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:05 smithi184 ceph-mon[35203]: pgmap v429: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-15T22:59:05.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:05 smithi066 ceph-mon[31185]: pgmap v429: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-15T22:59:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:05 smithi087 ceph-mon[35290]: pgmap v429: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-15T22:59:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:07 smithi184 ceph-mon[35203]: pgmap v430: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-15T22:59:07.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:07 smithi066 ceph-mon[31185]: pgmap v430: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-15T22:59:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:07 smithi087 ceph-mon[35290]: pgmap v430: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-15T22:59:07.745 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:59:07.746 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:59:08.174 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 -- 172.21.15.66:0/748181447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c741027c0 msgr2=0x7f8c74106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/748181447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c741027c0 0x7f8c74106810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009900 tx=0x7f8c5c02a410 comp rx=0 tx=0).stop 2024-09-15T22:59:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 -- 172.21.15.66:0/748181447 shutdown_connections 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/748181447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c74106f40 0x7f8c7410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/748181447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c741027c0 0x7f8c74106810 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/748181447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c741021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 -- 172.21.15.66:0/748181447 >> 172.21.15.66:0/748181447 conn(0x7f8c740fd8d0 msgr2=0x7f8c740ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 -- 172.21.15.66:0/748181447 shutdown_connections 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.736+0000 7f8c7a90f640 1 -- 172.21.15.66:0/748181447 wait complete. 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 Processor -- start 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 -- start start 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c741027c0 0x7f8c74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 0x7f8c74074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74111fa0 con 0x7f8c74106f40 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74111e20 con 0x7f8c741027c0 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c7a90f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74112120 con 0x7f8c74101e10 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53942/0 (socket says 172.21.15.66:53942) 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c78eac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 0x7f8c74074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c73fff640 1 -- 172.21.15.66:0/1594091431 learned_addr learned my addr 172.21.15.66:0/1594091431 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.737+0000 7f8c6bfff640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c741027c0 0x7f8c74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 -- 172.21.15.66:0/1594091431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 msgr2=0x7f8c740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 -- 172.21.15.66:0/1594091431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c741027c0 msgr2=0x7f8c74074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c741027c0 0x7f8c74074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 -- 172.21.15.66:0/1594091431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c741a68f0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 0x7f8c74074f70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e940 tx=0x7f8c6c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c71ffb640 1 -- 172.21.15.66:0/1594091431 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c004d20 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c741a6be0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c71ffb640 1 -- 172.21.15.66:0/1594091431 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c6c005020 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c71ffb640 1 -- 172.21.15.66:0/1594091431 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0116d0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.738+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c741a70a0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.740+0000 7f8c71ffb640 1 -- 172.21.15.66:0/1594091431 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8c6c0054d0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.741+0000 7f8c71ffb640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 0x7f8c600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.741+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 0x7f8c600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.741+0000 7f8c71ffb640 1 -- 172.21.15.66:0/1594091431 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f8c6c0d01c0 con 0x7f8c74106f40 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 Processor -- start 2024-09-15T22:59:08.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 -- start start 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 0x7f8c600a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8c64011500 tx=0x7f8c64005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ecd082a280 con 0x55ecd08c4b60 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ecd07d1b10 con 0x55ecd08c5480 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ecd0826240 con 0x55ecd08cfd40 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c78eac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48276/0 (socket says 172.21.15.66:48276) 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c73fff640 1 -- 172.21.15.66:0/408186363 learned_addr learned my addr 172.21.15.66:0/408186363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c6bfff640 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.742+0000 7f8c73fff640 1 -- 172.21.15.66:0/408186363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 msgr2=0x55ecd08d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c73fff640 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c73fff640 1 -- 172.21.15.66:0/408186363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 msgr2=0x55ecd08cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c73fff640 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c73fff640 1 -- 172.21.15.66:0/408186363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd07de1f0 con 0x55ecd08c4b60 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c78eac640 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c73fff640 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400f7c0 tx=0x7f8c64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e5282a4dccb977 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c6a7fc640 1 -- 172.21.15.66:0/408186363 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6402b070 con 0x55ecd08c4b60 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c6a7fc640 1 -- 172.21.15.66:0/408186363 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c64026420 con 0x55ecd08c4b60 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.743+0000 7f8c6a7fc640 1 -- 172.21.15.66:0/408186363 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6401a5f0 con 0x55ecd08c4b60 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- 172.21.15.66:0/408186363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 msgr2=0x55ecd08c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400f7c0 tx=0x7f8c64014000 comp rx=0 tx=0).stop 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- 172.21.15.66:0/408186363 shutdown_connections 2024-09-15T22:59:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/408186363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08c4f40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- 172.21.15.66:0/408186363 >> 172.21.15.66:0/408186363 conn(0x55ecd08c10f0 msgr2=0x55ecd08c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- 172.21.15.66:0/408186363 shutdown_connections 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- 172.21.15.66:0/408186363 wait complete. 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.744+0000 7f8c7cce8740 1 -- start start 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 Processor -- start 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ecd08d2910 con 0x55ecd08c4b60 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ecd07e4f10 con 0x55ecd08c5480 2024-09-15T22:59:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ecd08d2a90 con 0x55ecd08cfd40 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c7cce8740 10 client.0 _ll_register_callbacks cb 0x55ecd07ada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48290/0 (socket says 172.21.15.66:48290) 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c73fff640 1 -- 172.21.15.66:0/3761874412 learned_addr learned my addr 172.21.15.66:0/3761874412 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c78eac640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c6bfff640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.745+0000 7f8c78eac640 1 -- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 msgr2=0x55ecd08cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c78eac640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c78eac640 1 -- 172.21.15.66:0/3761874412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 msgr2=0x55ecd08ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c78eac640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c78eac640 1 -- 172.21.15.66:0/3761874412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecd059b6a0 con 0x55ecd08cfd40 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c73fff640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c78eac640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08cd6e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0cd4b0 tx=0x7f8c6c09c160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f7d510b3ae67ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c537fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c01f040 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c64026420 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f8c6c098760 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c09b540 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c7cce8740 10 client.27604 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ecd08de600 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.746+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c64026420 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f8c6c00f040 con 0x55ecd08cfd40 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 10 client.27604 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 10 client.27604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 20 client.27604 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd08dfa10 0x55ecd08e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 4 client.27604 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecd08377f0 con 0x55ecd08dfa10 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c73fff640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd08dfa10 0x55ecd08e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c73fff640 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd08dfa10 0x55ecd08e1e40 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6637cc3c99a5b015 server_cookie=351ffe9e3a8b6f1c in_seq=0 out_seq=0 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.747+0000 7f8c537fe640 10 client.27604 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.748+0000 7f8c537fe640 1 -- 172.21.15.66:0/3761874412 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecd08377f0 con 0x55ecd08dfa10 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.748+0000 7f8c537fe640 10 client.27604 handle_command_reply: tid=0 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.748+0000 7f8c7cce8740 1 client.27604 shutdown 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.748+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 msgr2=0x55ecd08cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.748+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08cd6e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0cd4b0 tx=0x7f8c6c09c160 comp rx=0 tx=0).stop 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 shutdown_connections 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08cfd40 0x55ecd08cd6e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd08dfa10 0x55ecd08e1e40 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08c5480 0x55ecd08cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/3761874412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 >> 172.21.15.66:0/3761874412 conn(0x55ecd08c10f0 msgr2=0x55ecd08c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c537fe640 0 client.27604 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 shutdown_connections 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 1 -- 172.21.15.66:0/3761874412 wait complete. 2024-09-15T22:59:08.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.749+0000 7f8c7cce8740 20 client.27604 trim_cache size 0 max 16384 2024-09-15T22:59:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 Processor -- start 2024-09-15T22:59:08.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 -- start start 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c4b60 0x55ecd08c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 0x55ecd08e7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741b13e0 con 0x55ecd08c5480 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741b3190 con 0x55ecd08cfd40 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.768+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741b1b70 con 0x55ecd08c4b60 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 0x55ecd08e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 0x55ecd08e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48298/0 (socket says 172.21.15.66:48298) 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c6bfff640 1 -- 172.21.15.66:0/1819506884 learned_addr learned my addr 172.21.15.66:0/1819506884 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c4b60 0x55ecd08c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 -- 172.21.15.66:0/1819506884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c4b60 msgr2=0x55ecd08c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c4b60 0x55ecd08c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 -- 172.21.15.66:0/1819506884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 msgr2=0x55ecd08e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 0x55ecd08e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 -- 172.21.15.66:0/1819506884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecd08bc830 con 0x55ecd08cfd40 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08e7c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c09a3a0 tx=0x7f8c6c0984c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99cccf37c33ff77e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c69ffb640 1 -- 172.21.15.66:0/1819506884 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c01f070 con 0x55ecd08cfd40 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c69ffb640 1 -- 172.21.15.66:0/1819506884 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c6c0a03f0 con 0x55ecd08cfd40 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.769+0000 7f8c69ffb640 1 -- 172.21.15.66:0/1819506884 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0a1830 con 0x55ecd08cfd40 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1819506884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 msgr2=0x55ecd08e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08e7c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c09a3a0 tx=0x7f8c6c0984c0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1819506884 shutdown_connections 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08e7c50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c5480 0x55ecd08e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1819506884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c4b60 0x55ecd08c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1819506884 >> 172.21.15.66:0/1819506884 conn(0x55ecd08c10f0 msgr2=0x55ecd08c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1819506884 shutdown_connections 2024-09-15T22:59:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1819506884 wait complete. 2024-09-15T22:59:08.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.770+0000 7f8c7cce8740 1 -- start start 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 Processor -- start 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 0x55ecd08d8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741b2a30 con 0x55ecd08c4b60 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741b2300 con 0x55ecd08cfd40 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8c741af3e0 con 0x55ecd08c5480 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c78eac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 0x55ecd08d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c7cce8740 10 client.0 _ll_register_callbacks cb 0x7f8c6c09bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c78eac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:34734/0 (socket says 172.21.15.66:34734) 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c6bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 0x55ecd08d8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:53970/0 (socket says 172.21.15.66:53970) 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.771+0000 7f8c78eac640 1 -- 172.21.15.66:0/1690647343 learned_addr learned my addr 172.21.15.66:0/1690647343 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 -- 172.21.15.66:0/1690647343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 msgr2=0x55ecd08d8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 0x55ecd08d8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 -- 172.21.15.66:0/1690647343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 msgr2=0x55ecd08d80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08d80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 -- 172.21.15.66:0/1690647343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecd08c1ca0 con 0x55ecd08cfd40 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c78eac640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0a4780 tx=0x7f8c6c0058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5221042fa2b0df12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c537fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c01f070 con 0x55ecd08cfd40 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9547+0+0 (secure 0 0 0) 0x7f8c6c0b0120 con 0x55ecd08cfd40 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c6c0a03f0 con 0x55ecd08cfd40 2024-09-15T22:59:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c00ce50 con 0x55ecd08cfd40 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c7cce8740 10 client.27731 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55ecd08c1ca0 con 0x55ecd08cfd40 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.772+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c6c0a03f0 con 0x55ecd08cfd40 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f8c6c09a6b0 con 0x55ecd08cfd40 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 10 client.27731 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 10 client.27731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 20 client.27731 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd094a580 0x55ecd094c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 4 client.27731 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.773+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ecd0831d00 con 0x55ecd094a580 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.774+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd094a580 0x55ecd094c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.774+0000 7f8c73fff640 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd094a580 0x55ecd094c9a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56b6630465b1fa server_cookie=835ab9a26539e11b in_seq=0 out_seq=0 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.774+0000 7f8c537fe640 10 client.27731 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c537fe640 1 -- 172.21.15.66:0/1690647343 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ecd0831d00 con 0x55ecd094a580 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c537fe640 10 client.27731 handle_command_reply: tid=0 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 client.27731 shutdown 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 msgr2=0x55ecd08d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0a4780 tx=0x7f8c6c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 shutdown_connections 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ecd094a580 0x55ecd094c9a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ecd08cfd40 0x55ecd08d3650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ecd08c5480 0x55ecd08d8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 --2- 172.21.15.66:0/1690647343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ecd08c4b60 0x55ecd08d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 >> 172.21.15.66:0/1690647343 conn(0x55ecd08c10f0 msgr2=0x55ecd08c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.775+0000 7f8c537fe640 0 client.27731 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 shutdown_connections 2024-09-15T22:59:08.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7cce8740 1 -- 172.21.15.66:0/1690647343 wait complete. 2024-09-15T22:59:08.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7cce8740 20 client.27731 trim_cache size 0 max 16384 2024-09-15T22:59:08.782 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:59:08.782 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T22:59:08.782 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "526da008-7314-4152-a1a9-b3aa6ed2c20e", 2024-09-15T22:59:08.783 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T22:59:08.783 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:59:08.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 msgr2=0x7f8c600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 0x7f8c600a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8c64011500 tx=0x7f8c64005f90 comp rx=0 tx=0).stop 2024-09-15T22:59:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 msgr2=0x7f8c74074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 0x7f8c74074f70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e940 tx=0x7f8c6c00ee00 comp rx=0 tx=0).stop 2024-09-15T22:59:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 shutdown_connections 2024-09-15T22:59:08.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8c600a33b0 0x7f8c600a5870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c74106f40 0x7f8c74074f70 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c741027c0 0x7f8c74074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 --2- 172.21.15.66:0/1594091431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c74101e10 0x7f8c740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.776+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 >> 172.21.15.66:0/1594091431 conn(0x7f8c740fd8d0 msgr2=0x7f8c740feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.777+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 shutdown_connections 2024-09-15T22:59:08.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:08.777+0000 7f8c7a90f640 1 -- 172.21.15.66:0/1594091431 wait complete. 2024-09-15T22:59:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:09 smithi184 ceph-mon[35203]: pgmap v431: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:59:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:09 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T22:59:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:09 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:09 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:59:09.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:09 smithi066 ceph-mon[31185]: pgmap v431: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:59:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:09 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T22:59:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:09 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:09 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:59:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:09 smithi087 ceph-mon[35290]: pgmap v431: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:59:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:09 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T22:59:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:09 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:09.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:09 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:59:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:10 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T22:59:10.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:10 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T22:59:10.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:59:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:10 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T22:59:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:11 smithi184 ceph-mon[35203]: pgmap v432: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-09-15T22:59:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:11 smithi184 ceph-mon[35203]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:59:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:11 smithi066 ceph-mon[31185]: pgmap v432: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-09-15T22:59:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:11 smithi066 ceph-mon[31185]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:59:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:11 smithi087 ceph-mon[35290]: pgmap v432: 129 pgs: 129 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 305 op/s 2024-09-15T22:59:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:11 smithi087 ceph-mon[35290]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:59:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.354+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2607692463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae0105ec0 msgr2=0x7f6ae0106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.354+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2607692463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0106340 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ad801ace0 tx=0x7f6ad803b960 comp rx=0 tx=0).stop 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.359+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2607692463 shutdown_connections 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.359+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2607692463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0106340 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.359+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2607692463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01011e0 0x7f6ae0105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.359+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2607692463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01008c0 0x7f6ae0100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.359+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2607692463 >> 172.21.15.66:0/2607692463 conn(0x7f6ae00fc7d0 msgr2=0x7f6ae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.360+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2607692463 shutdown_connections 2024-09-15T22:59:12.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.360+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2607692463 wait complete. 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.361+0000 7f6ae48e4640 1 Processor -- start 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.363+0000 7f6ae48e4640 1 -- start start 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae01008c0 0x7f6ae010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01098c0 con 0x7f6ae01011e0 2024-09-15T22:59:12.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0109740 con 0x7f6ae0105ec0 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ae48e4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0109a40 con 0x7f6ae01008c0 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43100/0 (socket says 172.21.15.66:43100) 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6addd9b640 1 -- 172.21.15.66:0/2436581215 learned_addr learned my addr 172.21.15.66:0/2436581215 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:12.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.364+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae01008c0 0x7f6ae010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.366+0000 7f6addd9b640 1 -- 172.21.15.66:0/2436581215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae01008c0 msgr2=0x7f6ae010d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.366+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae01008c0 0x7f6ae010d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.366+0000 7f6addd9b640 1 -- 172.21.15.66:0/2436581215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae0105ec0 msgr2=0x7f6ae0072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.366+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.366+0000 7f6addd9b640 1 -- 172.21.15.66:0/2436581215 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae0072f90 con 0x7f6ae01011e0 2024-09-15T22:59:12.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.368+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c890 tx=0x7f6ad400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.373+0000 7f6acf7fe640 1 -- 172.21.15.66:0/2436581215 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004220 con 0x7f6ae01011e0 2024-09-15T22:59:12.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.373+0000 7f6acf7fe640 1 -- 172.21.15.66:0/2436581215 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad40043c0 con 0x7f6ae01011e0 2024-09-15T22:59:12.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.373+0000 7f6acf7fe640 1 -- 172.21.15.66:0/2436581215 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004a00 con 0x7f6ae01011e0 2024-09-15T22:59:12.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.373+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae0073280 con 0x7f6ae01011e0 2024-09-15T22:59:12.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.373+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae0073740 con 0x7f6ae01011e0 2024-09-15T22:59:12.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.377+0000 7f6ae6cbd740 1 Processor -- start 2024-09-15T22:59:12.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.380+0000 7f6acf7fe640 1 -- 172.21.15.66:0/2436581215 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6ad4004ba0 con 0x7f6ae01011e0 2024-09-15T22:59:12.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.381+0000 7f6acf7fe640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 0x7f6ac80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.381+0000 7f6acf7fe640 1 -- 172.21.15.66:0/2436581215 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f6ad40cfc20 con 0x7f6ae01011e0 2024-09-15T22:59:12.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.382+0000 7f6ae6cbd740 1 -- start start 2024-09-15T22:59:12.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.382+0000 7f6aded9d640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 0x7f6ac80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.383+0000 7f6aded9d640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 0x7f6ac80a5a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006010 tx=0x7f6ad801a810 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.383+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 0x562459b3b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.383+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 0x562459b46140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.383+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b48a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.383+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 0x562459b3b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.384+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 0x562459b3b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47280/0 (socket says 172.21.15.66:47280) 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.384+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 0x562459b46140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.384+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 0x562459b46140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43114/0 (socket says 172.21.15.66:43114) 2024-09-15T22:59:12.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.384+0000 7f6ade59c640 1 -- 172.21.15.66:0/14470529 learned_addr learned my addr 172.21.15.66:0/14470529 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:12.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.386+0000 7f6aded9d640 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b48a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.384+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562459aa12e0 con 0x562459b3bdc0 2024-09-15T22:59:12.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.387+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562459a48ce0 con 0x562459b46680 2024-09-15T22:59:12.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.387+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562459a9d2a0 con 0x562459b3b4a0 2024-09-15T22:59:12.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.389+0000 7f6aded9d640 1 -- 172.21.15.66:0/14470529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 msgr2=0x562459b3b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.389+0000 7f6aded9d640 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 0x562459b3b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.389+0000 7f6aded9d640 1 -- 172.21.15.66:0/14470529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 msgr2=0x562459b46140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.389+0000 7f6aded9d640 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 0x562459b46140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.389+0000 7f6aded9d640 1 -- 172.21.15.66:0/14470529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562459a2d440 con 0x562459b46680 2024-09-15T22:59:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.390+0000 7f6aded9d640 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b48a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ad803be80 tx=0x7f6ad8050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd1d32949b552a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.391+0000 7f6accff9640 1 -- 172.21.15.66:0/14470529 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8045050 con 0x562459b46680 2024-09-15T22:59:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.391+0000 7f6accff9640 1 -- 172.21.15.66:0/14470529 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad805d070 con 0x562459b46680 2024-09-15T22:59:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.391+0000 7f6accff9640 1 -- 172.21.15.66:0/14470529 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8062730 con 0x562459b46680 2024-09-15T22:59:12.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.392+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 msgr2=0x562459b48a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.392+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b48a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ad803be80 tx=0x7f6ad8050000 comp rx=0 tx=0).stop 2024-09-15T22:59:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.393+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 shutdown_connections 2024-09-15T22:59:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.393+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b48a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.393+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3bdc0 0x562459b46140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.393+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/14470529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3b4a0 0x562459b3b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.393+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 >> 172.21.15.66:0/14470529 conn(0x562459b37a30 msgr2=0x562459b37e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.394+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 shutdown_connections 2024-09-15T22:59:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.394+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/14470529 wait complete. 2024-09-15T22:59:12.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.394+0000 7f6ae6cbd740 1 -- start start 2024-09-15T22:59:12.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.395+0000 7f6ae6cbd740 1 Processor -- start 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b46010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b43840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562459b49250 con 0x562459b3b4a0 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47290/0 (socket says 172.21.15.66:47290) 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.397+0000 7f6addd9b640 1 -- 172.21.15.66:0/2611698591 learned_addr learned my addr 172.21.15.66:0/2611698591 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.398+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562459a5c050 con 0x562459b46680 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.398+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562459b493d0 con 0x562459b3bdc0 2024-09-15T22:59:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.398+0000 7f6ae6cbd740 10 client.0 _ll_register_callbacks cb 0x562459a9c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.401+0000 7f6addd9b640 1 -- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 msgr2=0x562459b43840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.401+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b43840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.401+0000 7f6addd9b640 1 -- 172.21.15.66:0/2611698591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 msgr2=0x562459b46010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.401+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b46010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.401+0000 7f6addd9b640 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624598123c0 con 0x562459b3bdc0 2024-09-15T22:59:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.404+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4005fd0 tx=0x7f6ad409b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8095b6f9c7ec6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.405+0000 7f6ac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:59:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.405+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401d070 con 0x562459b3bdc0 2024-09-15T22:59:12.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.405+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f6ad409ae70 con 0x562459b3bdc0 2024-09-15T22:59:12.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.405+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad805d070 con 0x562459b3bdc0 2024-09-15T22:59:12.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.406+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6ad40cd320 con 0x562459b3bdc0 2024-09-15T22:59:12.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.406+0000 7f6ae6cbd740 10 client.27622 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:12.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.406+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562459b54c70 con 0x562459b3bdc0 2024-09-15T22:59:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad40a4690 con 0x562459b3bdc0 2024-09-15T22:59:12.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f6ad40a0f60 con 0x562459b3bdc0 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 10 client.27622 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 10 client.27622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 20 client.27622 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b56130 0x562459b58560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 4 client.27622 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:12.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.410+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6ad805d070 con 0x562459b56130 2024-09-15T22:59:12.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.414+0000 7f6ade59c640 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b56130 0x562459b58560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.419+0000 7f6ade59c640 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b56130 0x562459b58560 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a58d9a2d50f17dc server_cookie=75319798c0eaddaf in_seq=0 out_seq=0 2024-09-15T22:59:12.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.419+0000 7f6ac5ffb640 10 client.27622 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:12.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.420+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2611698591 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6ad805d070 con 0x562459b56130 2024-09-15T22:59:12.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.420+0000 7f6ac5ffb640 10 client.27622 handle_command_reply: tid=0 2024-09-15T22:59:12.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.421+0000 7f6ae6cbd740 1 client.27622 shutdown 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 msgr2=0x562459b432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4005fd0 tx=0x7f6ad409b480 comp rx=0 tx=0).stop 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 shutdown_connections 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b56130 0x562459b58560 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b46680 0x562459b43840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ac5ffb640 0 client.27622 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b432c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2611698591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b46010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.424+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 >> 172.21.15.66:0/2611698591 conn(0x562459b37a30 msgr2=0x562459b3d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.425+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 shutdown_connections 2024-09-15T22:59:12.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.425+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2611698591 wait complete. 2024-09-15T22:59:12.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.426+0000 7f6ae6cbd740 20 client.27622 trim_cache size 0 max 16384 2024-09-15T22:59:12.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.461+0000 7f6ae6cbd740 1 Processor -- start 2024-09-15T22:59:12.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 -- start start 2024-09-15T22:59:12.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b37a30 0x562459b524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b3b4a0 0x562459b36a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0010350 con 0x562459b37a30 2024-09-15T22:59:12.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.462+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0012100 con 0x562459b3b4a0 2024-09-15T22:59:12.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.463+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0010ae0 con 0x562459b3bdc0 2024-09-15T22:59:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.463+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47292/0 (socket says 172.21.15.66:47292) 2024-09-15T22:59:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 -- 172.21.15.66:0/3903392260 learned_addr learned my addr 172.21.15.66:0/3903392260 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6addd9b640 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b3b4a0 0x562459b36a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6ade59c640 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b37a30 0x562459b524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 -- 172.21.15.66:0/3903392260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b3b4a0 msgr2=0x562459b36a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b3b4a0 0x562459b36a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 -- 172.21.15.66:0/3903392260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b37a30 msgr2=0x562459b524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b37a30 0x562459b524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.464+0000 7f6aded9d640 1 -- 172.21.15.66:0/3903392260 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562459b3bbf0 con 0x562459b3bdc0 2024-09-15T22:59:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.468+0000 7f6aded9d640 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8040750 tx=0x7f6ad801a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318b610724f15724 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.469+0000 7f6ac7fff640 1 -- 172.21.15.66:0/3903392260 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8066070 con 0x562459b3bdc0 2024-09-15T22:59:12.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.469+0000 7f6ac7fff640 1 -- 172.21.15.66:0/3903392260 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad805d040 con 0x562459b3bdc0 2024-09-15T22:59:12.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.469+0000 7f6ac7fff640 1 -- 172.21.15.66:0/3903392260 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8045070 con 0x562459b3bdc0 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.470+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/3903392260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 msgr2=0x562459b5de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.470+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8040750 tx=0x7f6ad801a8c0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.471+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/3903392260 shutdown_connections 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.471+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b5de70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.471+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b3b4a0 0x562459b36a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.471+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/3903392260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b37a30 0x562459b524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.471+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/3903392260 >> 172.21.15.66:0/3903392260 conn(0x562459b3ecb0 msgr2=0x562459b36350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.474+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/3903392260 shutdown_connections 2024-09-15T22:59:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.474+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/3903392260 wait complete. 2024-09-15T22:59:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.474+0000 7f6ae6cbd740 1 -- start start 2024-09-15T22:59:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.474+0000 7f6ae6cbd740 1 Processor -- start 2024-09-15T22:59:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b37a30 0x562459b4ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b4b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac00119a0 con 0x562459b3b4a0 2024-09-15T22:59:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0011270 con 0x562459b37a30 2024-09-15T22:59:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac000e350 con 0x562459b3bdc0 2024-09-15T22:59:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.475+0000 7f6ae6cbd740 10 client.0 _ll_register_callbacks cb 0x7f6ad400a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.476+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.476+0000 7f6addd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43140/0 (socket says 172.21.15.66:43140) 2024-09-15T22:59:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.476+0000 7f6addd9b640 1 -- 172.21.15.66:0/2108102364 learned_addr learned my addr 172.21.15.66:0/2108102364 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.479+0000 7f6aded9d640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b4b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.479+0000 7f6addd9b640 1 -- 172.21.15.66:0/2108102364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 msgr2=0x562459b4b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.479+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b4b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.479+0000 7f6addd9b640 1 -- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b37a30 msgr2=0x562459b4ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.479+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b37a30 0x562459b4ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.480+0000 7f6addd9b640 1 -- 172.21.15.66:0/2108102364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562459b43bb0 con 0x562459b3b4a0 2024-09-15T22:59:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.480+0000 7f6addd9b640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f6ad409b720 tx=0x7f6ad409ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258f49ac2e1ef98b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.481+0000 7f6ac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:12.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.483+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401d040 con 0x562459b3b4a0 2024-09-15T22:59:12.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.483+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad805d040 con 0x562459b3b4a0 2024-09-15T22:59:12.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.483+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f6ad409ae70 con 0x562459b3b4a0 2024-09-15T22:59:12.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.487+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f6ad40a4690 con 0x562459b3b4a0 2024-09-15T22:59:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.491+0000 7f6ae6cbd740 10 client.18423 fetch_fsmap learned FSMap version 61 2024-09-15T22:59:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.491+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562459bc1b30 con 0x562459b3b4a0 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.498+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad805d040 con 0x562459b3b4a0 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.498+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 61) ==== 8438+0+0 (secure 0 0 0) 0x7f6ad40079b0 con 0x562459b3b4a0 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 10 client.18423 fetch_fsmap finished waiting for FSMap version 61 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 20 client.18423 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b46680 0x562459bc41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 4 client.18423 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:59:12.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562459aae850 con 0x562459b46680 2024-09-15T22:59:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.499+0000 7f6ade59c640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b46680 0x562459bc41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.500+0000 7f6ade59c640 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b46680 0x562459bc41b0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94c62bd069f0313 server_cookie=719bd9a997706446 in_seq=0 out_seq=0 2024-09-15T22:59:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.500+0000 7f6ac5ffb640 10 client.18423 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.501+0000 7f6ac5ffb640 1 -- 172.21.15.66:0/2108102364 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x562459aae850 con 0x562459b46680 2024-09-15T22:59:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.501+0000 7f6ac5ffb640 10 client.18423 handle_command_reply: tid=0 2024-09-15T22:59:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.502+0000 7f6ae6cbd740 1 client.18423 shutdown 2024-09-15T22:59:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.503+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 msgr2=0x562459b4af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.503+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f6ad409b720 tx=0x7f6ad409ff00 comp rx=0 tx=0).stop 2024-09-15T22:59:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 shutdown_connections 2024-09-15T22:59:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562459b3bdc0 0x562459b4b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562459b3b4a0 0x562459b4af90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562459b46680 0x562459bc41b0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 --2- 172.21.15.66:0/2108102364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562459b37a30 0x562459b4ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ac5ffb640 0 client.18423 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 >> 172.21.15.66:0/2108102364 conn(0x562459b3ecb0 msgr2=0x562459b45340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 shutdown_connections 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.504+0000 7f6ae6cbd740 1 -- 172.21.15.66:0/2108102364 wait complete. 2024-09-15T22:59:12.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.506+0000 7f6ae6cbd740 20 client.18423 trim_cache size 0 max 16384 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (7579 inodes in the stack)", 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "526da008-7314-4152-a1a9-b3aa6ed2c20e": { 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "526da008-7314-4152-a1a9-b3aa6ed2c20e", 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T22:59:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:12.508 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:59:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.506+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 msgr2=0x7f6ac80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.506+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 0x7f6ac80a5a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006010 tx=0x7f6ad801a810 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.506+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 msgr2=0x7f6ae010dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c890 tx=0x7f6ad400cc90 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 shutdown_connections 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6ac80a3580 0x7f6ac80a5a40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae0105ec0 0x7f6ae0072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae01011e0 0x7f6ae010dad0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 --2- 172.21.15.66:0/2436581215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ae01008c0 0x7f6ae010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 >> 172.21.15.66:0/2436581215 conn(0x7f6ae00fc7d0 msgr2=0x7f6ae0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 shutdown_connections 2024-09-15T22:59:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:12.507+0000 7f6ae48e4640 1 -- 172.21.15.66:0/2436581215 wait complete. 2024-09-15T22:59:13.369 INFO:tasks.cephfs.filesystem:scrub status for tag:526da008-7314-4152-a1a9-b3aa6ed2c20e - {'path': '/', 'tag': '526da008-7314-4152-a1a9-b3aa6ed2c20e', 'options': 'recursive,force'} 2024-09-15T22:59:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:13 smithi184 ceph-mon[35203]: pgmap v434: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 275 op/s 2024-09-15T22:59:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:13 smithi066 ceph-mon[31185]: pgmap v434: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 275 op/s 2024-09-15T22:59:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:13 smithi087 ceph-mon[35290]: pgmap v434: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 2.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 275 op/s 2024-09-15T22:59:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:15 smithi184 ceph-mon[35203]: pgmap v435: 129 pgs: 15 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 72 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-09-15T22:59:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:15 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:15 smithi066 ceph-mon[31185]: pgmap v435: 129 pgs: 15 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 72 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-09-15T22:59:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:15 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:15 smithi087 ceph-mon[35290]: pgmap v435: 129 pgs: 15 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 72 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-09-15T22:59:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:15 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:17 smithi184 ceph-mon[35203]: pgmap v436: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-09-15T22:59:17.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:17 smithi066 ceph-mon[31185]: pgmap v436: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-09-15T22:59:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:17 smithi087 ceph-mon[35290]: pgmap v436: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-09-15T22:59:19.374 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.4 2024-09-15T22:59:19.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:59:19.429 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:19 smithi066 ceph-mon[31185]: pgmap v437: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-09-15T22:59:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:19 smithi087 ceph-mon[35290]: pgmap v437: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-09-15T22:59:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:19 smithi184 ceph-mon[35203]: pgmap v437: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-09-15T22:59:19.936 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:20.371 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:20 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.519+0000 7f81a5bd7640 1 -- 172.21.15.66:0/3152644761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a0108da0 msgr2=0x7f81a010cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.519+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/3152644761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a0108da0 0x7f81a010cdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8190009900 tx=0x7f819002a420 comp rx=0 tx=0).stop 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 -- 172.21.15.66:0/3152644761 shutdown_connections 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/3152644761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a010d520 0x7f81a01150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/3152644761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a0108da0 0x7f81a010cdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/3152644761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a01083f0 0x7f81a01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 -- 172.21.15.66:0/3152644761 >> 172.21.15.66:0/3152644761 conn(0x7f81a0077af0 msgr2=0x7f81a0079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:20.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 -- 172.21.15.66:0/3152644761 shutdown_connections 2024-09-15T22:59:20.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.520+0000 7f81a5bd7640 1 -- 172.21.15.66:0/3152644761 wait complete. 2024-09-15T22:59:20.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.521+0000 7f81a5bd7640 1 Processor -- start 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.521+0000 7f81a5bd7640 1 -- start start 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a01083f0 0x7f81a0073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 0x7f81a006e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81a006c640 con 0x7f81a010d520 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81a006c4c0 con 0x7f81a01083f0 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.522+0000 7f81a5bd7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f81a006c7c0 con 0x7f81a0108da0 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.523+0000 7f819effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.523+0000 7f819effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47328/0 (socket says 172.21.15.66:47328) 2024-09-15T22:59:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.523+0000 7f819effd640 1 -- 172.21.15.66:0/1798472701 learned_addr learned my addr 172.21.15.66:0/1798472701 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819ffff640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 0x7f81a006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819f7fe640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a01083f0 0x7f81a0073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819effd640 1 -- 172.21.15.66:0/1798472701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a01083f0 msgr2=0x7f81a0073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819effd640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a01083f0 0x7f81a0073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819effd640 1 -- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 msgr2=0x7f81a006e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819effd640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 0x7f81a006e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.526+0000 7f819effd640 1 -- 172.21.15.66:0/1798472701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a006e8f0 con 0x7f81a0108da0 2024-09-15T22:59:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.527+0000 7f819ffff640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 0x7f81a006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.530+0000 7f819effd640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81900058c0 tx=0x7f8190003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:20.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.534+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819003f070 con 0x7f81a0108da0 2024-09-15T22:59:20.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.534+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8190031c90 con 0x7f81a0108da0 2024-09-15T22:59:20.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.534+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190035030 con 0x7f81a0108da0 2024-09-15T22:59:20.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.534+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a01b3910 con 0x7f81a0108da0 2024-09-15T22:59:20.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.535+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a01b3d10 con 0x7f81a0108da0 2024-09-15T22:59:20.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.539+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a01098d0 con 0x7f81a0108da0 2024-09-15T22:59:20.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.541+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8190042070 con 0x7f81a0108da0 2024-09-15T22:59:20.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.542+0000 7f819cff9640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 0x7f81880a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:20.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.542+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f81900f0de0 con 0x7f81a0108da0 2024-09-15T22:59:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.547+0000 7f819f7fe640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 0x7f81880a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.550+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81900bd3c0 con 0x7f81a0108da0 2024-09-15T22:59:20.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.551+0000 7f819f7fe640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 0x7f81880a5a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8194005fd0 tx=0x7f8194005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:20.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:20 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:20.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:20 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T22:59:20.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.966+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a01087d0 con 0x7f81a0108da0 2024-09-15T22:59:20.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.970+0000 7f819cff9640 1 -- 172.21.15.66:0/1798472701 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7f81a01087d0 con 0x7f81a0108da0 2024-09-15T22:59:20.972 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:59:20.972 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:59:20.972 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T22:59:20.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.975+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 msgr2=0x7f81880a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:20.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.975+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 0x7f81880a5a00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8194005fd0 tx=0x7f8194005850 comp rx=0 tx=0).stop 2024-09-15T22:59:20.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.975+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 msgr2=0x7f81a006dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:20.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.975+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81900058c0 tx=0x7f8190003b90 comp rx=0 tx=0).stop 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 shutdown_connections 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f81880a3540 0x7f81880a5a00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a010d520 0x7f81a006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81a0108da0 0x7f81a006dc30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 --2- 172.21.15.66:0/1798472701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a01083f0 0x7f81a0073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:20.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.977+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 >> 172.21.15.66:0/1798472701 conn(0x7f81a0077af0 msgr2=0x7f81a0078e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:20.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.981+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 shutdown_connections 2024-09-15T22:59:20.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:20.981+0000 7f81a5bd7640 1 -- 172.21.15.66:0/1798472701 wait complete. 2024-09-15T22:59:21.223 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:21 smithi066 ceph-mon[31185]: pgmap v438: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-09-15T22:59:21.223 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:21 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1798472701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:21 smithi087 ceph-mon[35290]: pgmap v438: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-09-15T22:59:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:21 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1798472701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:21 smithi184 ceph-mon[35203]: pgmap v438: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-09-15T22:59:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:21 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1798472701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:21.796 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 131.4 --await-for 45.0' 2024-09-15T22:59:21.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 131.4 --await-for 45.0 2024-09-15T22:59:22.199 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 22:59:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T22:59:21.899+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T22:59:22.313 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:23.552 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:23 smithi066 ceph-mon[31185]: pgmap v439: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-09-15T22:59:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:23 smithi087 ceph-mon[35290]: pgmap v439: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-09-15T22:59:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:23 smithi184 ceph-mon[35203]: pgmap v439: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 203 op/s 2024-09-15T22:59:23.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.718+0000 7f105b2fc640 1 -- 172.21.15.66:0/3040227343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1054108c30 msgr2=0x7f105410cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.718+0000 7f105b2fc640 1 --2- 172.21.15.66:0/3040227343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1054108c30 0x7f105410cc30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1044009be0 tx=0x7f104402a6d0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 -- 172.21.15.66:0/3040227343 shutdown_connections 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 --2- 172.21.15.66:0/3040227343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f105410d360 0x7f1054114ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 --2- 172.21.15.66:0/3040227343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1054108c30 0x7f105410cc30 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 --2- 172.21.15.66:0/3040227343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 -- 172.21.15.66:0/3040227343 >> 172.21.15.66:0/3040227343 conn(0x7f10540779f0 msgr2=0x7f1054079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:23.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 -- 172.21.15.66:0/3040227343 shutdown_connections 2024-09-15T22:59:23.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.719+0000 7f105b2fc640 1 -- 172.21.15.66:0/3040227343 wait complete. 2024-09-15T22:59:23.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 Processor -- start 2024-09-15T22:59:23.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 -- start start 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054114a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1054108c30 0x7f1054110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f105407d3d0 con 0x7f105410d360 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f105407d250 con 0x7f1054108c30 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.720+0000 7f105b2fc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f105407d550 con 0x7f1054108280 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33566/0 (socket says 172.21.15.66:33566) 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 -- 172.21.15.66:0/1116762084 learned_addr learned my addr 172.21.15.66:0/1116762084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f1059af9640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1054108c30 0x7f1054110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 -- 172.21.15.66:0/1116762084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 msgr2=0x7f1054114a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054114a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 -- 172.21.15.66:0/1116762084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1054108c30 msgr2=0x7f1054110b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.721+0000 7f105aafb640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1054108c30 0x7f1054110b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.722+0000 7f105aafb640 1 -- 172.21.15.66:0/1116762084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1054111650 con 0x7f105410d360 2024-09-15T22:59:23.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.722+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.722+0000 7f105aafb640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f104001f9d0 tx=0x7f104001fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.722+0000 7f10537fe640 1 -- 172.21.15.66:0/1116762084 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104001dbf0 con 0x7f105410d360 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.723+0000 7f10537fe640 1 -- 172.21.15.66:0/1116762084 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104001dd90 con 0x7f105410d360 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.723+0000 7f10537fe640 1 -- 172.21.15.66:0/1116762084 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400216a0 con 0x7f105410d360 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.723+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1054111940 con 0x7f105410d360 2024-09-15T22:59:23.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.723+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105406bf50 con 0x7f105410d360 2024-09-15T22:59:23.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.727+0000 7f105e937740 1 Processor -- start 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 -- start start 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 0x561de7ba8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba9220 0x561de7bb35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bb5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561de7b0e2a0 con 0x561de7ba8900 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561de7ab5b10 con 0x561de7bb3ae0 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.728+0000 7f105e937740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561de7b0a260 con 0x561de7ba9220 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.730+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba9220 0x561de7bb35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.730+0000 7f1059af9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bb5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.730+0000 7f1059af9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 0x561de7ba8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.730+0000 7f1059af9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 0x561de7ba8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33570/0 (socket says 172.21.15.66:33570) 2024-09-15T22:59:23.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.730+0000 7f1059af9640 1 -- 172.21.15.66:0/823324867 learned_addr learned my addr 172.21.15.66:0/823324867 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:23.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.731+0000 7f10537fe640 1 -- 172.21.15.66:0/1116762084 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f10400046c0 con 0x7f105410d360 2024-09-15T22:59:23.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.732+0000 7f10537fe640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 0x7f10380a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.733+0000 7f10537fe640 1 -- 172.21.15.66:0/1116762084 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f10400e1490 con 0x7f105410d360 2024-09-15T22:59:23.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.735+0000 7f1059af9640 1 -- 172.21.15.66:0/823324867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba9220 msgr2=0x561de7bb35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.735+0000 7f1059af9640 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba9220 0x561de7bb35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.735+0000 7f1059af9640 1 -- 172.21.15.66:0/823324867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 msgr2=0x561de7ba8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.735+0000 7f1059af9640 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 0x561de7ba8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.735+0000 7f1059af9640 1 -- 172.21.15.66:0/823324867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de787fb90 con 0x561de7bb3ae0 2024-09-15T22:59:23.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.737+0000 7f105aafb640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 0x7f10380a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.739+0000 7f1059af9640 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bb5ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1044005ee0 tx=0x7f1044009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee068c1b279a1718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.746+0000 7f105aafb640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 0x7f10380a5a40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10400a9bd0 tx=0x7f10400ab2a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.747+0000 7f1050ff9640 1 -- 172.21.15.66:0/823324867 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044036070 con 0x561de7bb3ae0 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.747+0000 7f1050ff9640 1 -- 172.21.15.66:0/823324867 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1044003e50 con 0x561de7bb3ae0 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.747+0000 7f1050ff9640 1 -- 172.21.15.66:0/823324867 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044031c10 con 0x561de7bb3ae0 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.749+0000 7f105e937740 1 -- 172.21.15.66:0/823324867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 msgr2=0x561de7bb5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.749+0000 7f105e937740 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bb5ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1044005ee0 tx=0x7f1044009330 comp rx=0 tx=0).stop 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.750+0000 7f105e937740 1 -- 172.21.15.66:0/823324867 shutdown_connections 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.750+0000 7f105e937740 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bb5ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.750+0000 7f105e937740 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba9220 0x561de7bb35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.750+0000 7f105e937740 1 --2- 172.21.15.66:0/823324867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba8900 0x561de7ba8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.750+0000 7f105e937740 1 -- 172.21.15.66:0/823324867 >> 172.21.15.66:0/823324867 conn(0x561de7ba4e90 msgr2=0x561de7ba5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:23.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.756+0000 7f105e937740 1 -- 172.21.15.66:0/823324867 shutdown_connections 2024-09-15T22:59:23.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.759+0000 7f105e937740 1 -- 172.21.15.66:0/823324867 wait complete. 2024-09-15T22:59:23.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.759+0000 7f105e937740 1 -- start start 2024-09-15T22:59:23.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.759+0000 7f105e937740 1 Processor -- start 2024-09-15T22:59:23.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.761+0000 7f105e937740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bb0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bb14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561de7bb66b0 con 0x561de7ba9220 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561de7a966e0 con 0x561de7ba8900 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561de7bb6830 con 0x561de7bb3ae0 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105e937740 10 client.0 _ll_register_callbacks cb 0x561de7abaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33578/0 (socket says 172.21.15.66:33578) 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.762+0000 7f105a2fa640 1 -- 172.21.15.66:0/1385368671 learned_addr learned my addr 172.21.15.66:0/1385368671 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.763+0000 7f1059af9640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bb0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.763+0000 7f105a2fa640 1 -- 172.21.15.66:0/1385368671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 msgr2=0x561de7bb14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.763+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bb14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.763+0000 7f105a2fa640 1 -- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 msgr2=0x561de7bb0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.763+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bb0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.764+0000 7f105a2fa640 1 -- 172.21.15.66:0/1385368671 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de7bbfc50 con 0x561de7ba9220 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.765+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f104c009fb0 tx=0x7f104c013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bfef2508dc61f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.765+0000 7f1049ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:23.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.768+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c042060 con 0x561de7ba9220 2024-09-15T22:59:23.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.768+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1044003e50 con 0x561de7ba9220 2024-09-15T22:59:23.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.768+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f104c0119c0 con 0x561de7ba9220 2024-09-15T22:59:23.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.769+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f104c049050 con 0x561de7ba9220 2024-09-15T22:59:23.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.769+0000 7f105e937740 10 client.18441 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:23.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.769+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561de7bc2690 con 0x561de7ba9220 2024-09-15T22:59:23.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1044003e50 con 0x561de7ba9220 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f104c00f040 con 0x561de7ba9220 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 10 client.18441 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 10 client.18441 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 20 client.18441 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7bc3f70 0x561de7bc63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 4 client.18441 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.770+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561de7b1b9d0 con 0x561de7bc3f70 2024-09-15T22:59:23.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.771+0000 7f1059af9640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7bc3f70 0x561de7bc63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.778+0000 7f1049ffb640 10 client.18441 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:23.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.778+0000 7f1059af9640 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7bc3f70 0x561de7bc63f0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8c895698e72f7ba server_cookie=3326fc473c5e3af0 in_seq=0 out_seq=0 2024-09-15T22:59:23.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.781+0000 7f1049ffb640 1 -- 172.21.15.66:0/1385368671 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561de7b1b9d0 con 0x561de7bc3f70 2024-09-15T22:59:23.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.781+0000 7f1049ffb640 10 client.18441 handle_command_reply: tid=0 2024-09-15T22:59:23.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.781+0000 7f105e937740 1 client.18441 shutdown 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.784+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 msgr2=0x561de7bb0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.784+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f104c009fb0 tx=0x7f104c013b70 comp rx=0 tx=0).stop 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 shutdown_connections 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bb14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bb0f90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7bc3f70 0x561de7bc63f0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 --2- 172.21.15.66:0/1385368671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bb0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 >> 172.21.15.66:0/1385368671 conn(0x561de7ba4e90 msgr2=0x561de7baabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:23.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.785+0000 7f1049ffb640 0 client.18441 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:23.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.786+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 shutdown_connections 2024-09-15T22:59:23.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.789+0000 7f105e937740 1 -- 172.21.15.66:0/1385368671 wait complete. 2024-09-15T22:59:23.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.789+0000 7f105e937740 20 client.18441 trim_cache size 0 max 16384 2024-09-15T22:59:23.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.822+0000 7f105e937740 1 Processor -- start 2024-09-15T22:59:23.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.823+0000 7f105e937740 1 -- start start 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.823+0000 7f105e937740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba8900 0x561de7baf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.823+0000 7f105e937740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.823+0000 7f105e937740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bcc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.823+0000 7f105e937740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a4930 con 0x561de7ba9220 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f105e937740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a6770 con 0x561de7bb3ae0 2024-09-15T22:59:23.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f105e937740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a50c0 con 0x561de7ba8900 2024-09-15T22:59:23.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33588/0 (socket says 172.21.15.66:33588) 2024-09-15T22:59:23.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f105a2fa640 1 -- 172.21.15.66:0/1595674880 learned_addr learned my addr 172.21.15.66:0/1595674880 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:23.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.824+0000 7f1059af9640 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba8900 0x561de7baf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.826+0000 7f105a2fa640 1 -- 172.21.15.66:0/1595674880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba8900 msgr2=0x561de7baf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.826+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba8900 0x561de7baf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.826+0000 7f105a2fa640 1 -- 172.21.15.66:0/1595674880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 msgr2=0x561de7bcc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.826+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bcc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.826+0000 7f105a2fa640 1 -- 172.21.15.66:0/1595674880 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de7bac4a0 con 0x561de7ba9220 2024-09-15T22:59:23.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.828+0000 7f105a2fa640 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f104c00ee50 tx=0x7f104c009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea9fbce19014c8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.829+0000 7f104bfff640 1 -- 172.21.15.66:0/1595674880 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c013dc0 con 0x561de7ba9220 2024-09-15T22:59:23.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.829+0000 7f104bfff640 1 -- 172.21.15.66:0/1595674880 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c005c50 con 0x561de7ba9220 2024-09-15T22:59:23.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.829+0000 7f104bfff640 1 -- 172.21.15.66:0/1595674880 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0035f0 con 0x561de7ba9220 2024-09-15T22:59:23.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.831+0000 7f105e937740 1 -- 172.21.15.66:0/1595674880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 msgr2=0x561de7bcbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.831+0000 7f105e937740 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f104c00ee50 tx=0x7f104c009ef0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.833+0000 7f105e937740 1 -- 172.21.15.66:0/1595674880 shutdown_connections 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.833+0000 7f105e937740 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7bb3ae0 0x561de7bcc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.833+0000 7f105e937740 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7bcbd00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.833+0000 7f105e937740 1 --2- 172.21.15.66:0/1595674880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7ba8900 0x561de7baf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.833+0000 7f105e937740 1 -- 172.21.15.66:0/1595674880 >> 172.21.15.66:0/1595674880 conn(0x561de7ba4e90 msgr2=0x561de7bb2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.834+0000 7f105e937740 1 -- 172.21.15.66:0/1595674880 shutdown_connections 2024-09-15T22:59:23.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.834+0000 7f105e937740 1 -- 172.21.15.66:0/1595674880 wait complete. 2024-09-15T22:59:23.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.835+0000 7f105e937740 1 -- start start 2024-09-15T22:59:23.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.835+0000 7f105e937740 1 Processor -- start 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7badf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bae460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a5fe0 con 0x561de7ba9220 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a5850 con 0x561de7ba8900 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f10541a2930 con 0x561de7bb3ae0 2024-09-15T22:59:23.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.836+0000 7f105e937740 10 client.0 _ll_register_callbacks cb 0x7f104c009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.837+0000 7f1059af9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.840+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7badf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.840+0000 7f105a2fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7badf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33594/0 (socket says 172.21.15.66:33594) 2024-09-15T22:59:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.840+0000 7f105a2fa640 1 -- 172.21.15.66:0/665097890 learned_addr learned my addr 172.21.15.66:0/665097890 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.840+0000 7f1059af9640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.844+0000 7f1059af9640 1 -- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 msgr2=0x561de7bad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.844+0000 7f1059af9640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.844+0000 7f1059af9640 1 -- 172.21.15.66:0/665097890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 msgr2=0x561de7badf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:23.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.844+0000 7f1059af9640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7badf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:23.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.844+0000 7f1059af9640 1 -- 172.21.15.66:0/665097890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de7bafa80 con 0x561de7bb3ae0 2024-09-15T22:59:23.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.848+0000 7f1059af9640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bae460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1044006010 tx=0x7f10440317f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d648b92527da5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:23.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.848+0000 7f1049ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:59:23.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.850+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044036040 con 0x561de7bb3ae0 2024-09-15T22:59:23.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.850+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f10440303a0 con 0x561de7bb3ae0 2024-09-15T22:59:23.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.850+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104c005c50 con 0x561de7bb3ae0 2024-09-15T22:59:23.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.855+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f10440305c0 con 0x561de7bb3ae0 2024-09-15T22:59:23.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.855+0000 7f105e937740 10 client.27637 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:23.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.855+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561de7c2ed20 con 0x561de7bb3ae0 2024-09-15T22:59:23.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c005c50 con 0x561de7bb3ae0 2024-09-15T22:59:23.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f1044004c40 con 0x561de7bb3ae0 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 10 client.27637 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 10 client.27637 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 20 client.27637 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7c2f100 0x561de7c31520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 4 client.27637 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.4, "await_for": 45.0}] 2024-09-15T22:59:23.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.856+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.4, "await_for": 45.0}) -- 0x561de7b15d20 con 0x561de7c2f100 2024-09-15T22:59:23.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.860+0000 7f105a2fa640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7c2f100 0x561de7c31520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:23.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.867+0000 7f1049ffb640 10 client.27637 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:23.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:23.867+0000 7f105a2fa640 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7c2f100 0x561de7c31520 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fa17f1a08dd33a server_cookie=fc06b37347c7ce8a in_seq=0 out_seq=0 2024-09-15T22:59:25.353 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:25 smithi066 ceph-mon[31185]: pgmap v440: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:59:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:25 smithi087 ceph-mon[35290]: pgmap v440: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:59:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:25 smithi184 ceph-mon[35203]: pgmap v440: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-09-15T22:59:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:27 smithi087 ceph-mon[35290]: pgmap v441: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T22:59:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:27 smithi184 ceph-mon[35203]: pgmap v441: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T22:59:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:27 smithi066 ceph-mon[31185]: pgmap v441: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T22:59:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:29 smithi087 ceph-mon[35290]: pgmap v442: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:59:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:29 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:29 smithi184 ceph-mon[35203]: pgmap v442: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:59:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:29 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:29 smithi066 ceph-mon[31185]: pgmap v442: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:59:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:29 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:31 smithi087 ceph-mon[35290]: pgmap v443: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T22:59:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:31 smithi184 ceph-mon[35203]: pgmap v443: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T22:59:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:31 smithi066 ceph-mon[31185]: pgmap v443: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T22:59:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:33 smithi087 ceph-mon[35290]: pgmap v444: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 725 KiB/s wr, 131 op/s 2024-09-15T22:59:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:33 smithi184 ceph-mon[35203]: pgmap v444: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 725 KiB/s wr, 131 op/s 2024-09-15T22:59:33.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:33 smithi066 ceph-mon[31185]: pgmap v444: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 725 KiB/s wr, 131 op/s 2024-09-15T22:59:34.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.632+0000 7f1049ffb640 1 -- 172.21.15.66:0/665097890 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561de7b15d20 con 0x561de7c2f100 2024-09-15T22:59:34.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.632+0000 7f1049ffb640 10 client.27637 handle_command_reply: tid=0 2024-09-15T22:59:34.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 client.27637 shutdown 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 msgr2=0x561de7bae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bae460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1044006010 tx=0x7f10440317f0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 shutdown_connections 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561de7bb3ae0 0x561de7bae460 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561de7ba9220 0x561de7badf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561de7c2f100 0x561de7c31520 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 --2- 172.21.15.66:0/665097890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561de7ba8900 0x561de7bad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 >> 172.21.15.66:0/665097890 conn(0x561de7ba4e90 msgr2=0x561de7bb2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.633+0000 7f1049ffb640 0 client.27637 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.634+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 shutdown_connections 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.634+0000 7f105e937740 1 -- 172.21.15.66:0/665097890 wait complete. 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.634+0000 7f105e937740 20 client.27637 trim_cache size 0 max 16384 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:59:34.636 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 63, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 46, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "d8a0fbbe": { 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 46, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:59:34.637 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 131.4, 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:34.638 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 msgr2=0x7f10380a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 0x7f10380a5a40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10400a9bd0 tx=0x7f10400ab2a0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 msgr2=0x7f1054111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f104001f9d0 tx=0x7f104001fe90 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 shutdown_connections 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f10380a3580 0x7f10380a5a40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105410d360 0x7f1054111060 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1054108c30 0x7f1054110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 --2- 172.21.15.66:0/1116762084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1054108280 0x7f1054114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.636+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 >> 172.21.15.66:0/1116762084 conn(0x7f10540779f0 msgr2=0x7f1054078e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:34.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.637+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 shutdown_connections 2024-09-15T22:59:34.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:34.637+0000 7f105b2fc640 1 -- 172.21.15.66:0/1116762084 wait complete. 2024-09-15T22:59:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:35 smithi087 ceph-mon[35290]: pgmap v445: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 500 KiB/s wr, 129 op/s 2024-09-15T22:59:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:35 smithi184 ceph-mon[35203]: pgmap v445: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 500 KiB/s wr, 129 op/s 2024-09-15T22:59:35.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:35 smithi066 ceph-mon[31185]: pgmap v445: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 500 KiB/s wr, 129 op/s 2024-09-15T22:59:36.433 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd8a0fbbe', quiesce took 17.1 seconds. Will release after: -5.700000000000001 2024-09-15T22:59:36.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:59:36.922 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:37.416 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:37 smithi066 ceph-mon[31185]: pgmap v446: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 503 KiB/s wr, 116 op/s 2024-09-15T22:59:37.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.559+0000 7fcaa991d640 1 -- 172.21.15.66:0/2319940022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa410ddc0 msgr2=0x7fcaa4115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:37.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.559+0000 7fcaa991d640 1 --2- 172.21.15.66:0/2319940022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa410ddc0 0x7fcaa4115940 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009ca0 tx=0x7fca9c02a8d0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.560+0000 7fcaa991d640 1 -- 172.21.15.66:0/2319940022 shutdown_connections 2024-09-15T22:59:37.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.560+0000 7fcaa991d640 1 --2- 172.21.15.66:0/2319940022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa410ddc0 0x7fcaa4115940 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.560+0000 7fcaa991d640 1 --2- 172.21.15.66:0/2319940022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 0x7fcaa410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.560+0000 7fcaa991d640 1 --2- 172.21.15.66:0/2319940022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa4109450 0x7fcaa4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.560+0000 7fcaa991d640 1 -- 172.21.15.66:0/2319940022 >> 172.21.15.66:0/2319940022 conn(0x7fcaa406e140 msgr2=0x7fcaa406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:37.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.564+0000 7fcaa991d640 1 -- 172.21.15.66:0/2319940022 shutdown_connections 2024-09-15T22:59:37.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.564+0000 7fcaa991d640 1 -- 172.21.15.66:0/2319940022 wait complete. 2024-09-15T22:59:37.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.564+0000 7fcaa991d640 1 Processor -- start 2024-09-15T22:59:37.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.565+0000 7fcaa991d640 1 -- start start 2024-09-15T22:59:37.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.565+0000 7fcaa991d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:37.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.565+0000 7fcaa991d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 0x7fcaa41a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:37.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.565+0000 7fcaa991d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa410ddc0 0x7fcaa41a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa991d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41185a0 con 0x7fcaa410ddc0 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa991d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4118420 con 0x7fcaa4109e00 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa991d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4118720 con 0x7fcaa4109450 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45756/0 (socket says 172.21.15.66:45756) 2024-09-15T22:59:37.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.566+0000 7fcaa2ffd640 1 -- 172.21.15.66:0/516274942 learned_addr learned my addr 172.21.15.66:0/516274942 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa27fc640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 0x7fcaa41a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa37fe640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa410ddc0 0x7fcaa41a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa2ffd640 1 -- 172.21.15.66:0/516274942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 msgr2=0x7fcaa41a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa2ffd640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 0x7fcaa41a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa2ffd640 1 -- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa410ddc0 msgr2=0x7fcaa41a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:37.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa2ffd640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa410ddc0 0x7fcaa41a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:37.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.568+0000 7fcaa2ffd640 1 -- 172.21.15.66:0/516274942 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa41a7de0 con 0x7fcaa4109450 2024-09-15T22:59:37.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.570+0000 7fcaa2ffd640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ddc0 tx=0x7fca9400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:37.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.572+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9401b070 con 0x7fcaa4109450 2024-09-15T22:59:37.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.572+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca9400be40 con 0x7fcaa4109450 2024-09-15T22:59:37.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.572+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94016bb0 con 0x7fcaa4109450 2024-09-15T22:59:37.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.573+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa41a80d0 con 0x7fcaa4109450 2024-09-15T22:59:37.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.573+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41af9b0 con 0x7fcaa4109450 2024-09-15T22:59:37.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.579+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fca9401e070 con 0x7fcaa4109450 2024-09-15T22:59:37.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.580+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4109830 con 0x7fcaa4109450 2024-09-15T22:59:37.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.580+0000 7fcaa891b640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 0x7fca8c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:37.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.580+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fca940cfe00 con 0x7fcaa4109450 2024-09-15T22:59:37.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.581+0000 7fcaa27fc640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 0x7fca8c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:37.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.582+0000 7fcaa27fc640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 0x7fca8c0a5a80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca98005fd0 tx=0x7fca98005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:37.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:37.590+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca9409c410 con 0x7fcaa4109450 2024-09-15T22:59:37.598 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:37 smithi087 ceph-mon[35290]: pgmap v446: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 503 KiB/s wr, 116 op/s 2024-09-15T22:59:37.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:37 smithi184 ceph-mon[35203]: pgmap v446: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 503 KiB/s wr, 116 op/s 2024-09-15T22:59:38.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.009+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa41a4190 con 0x7fcaa4109450 2024-09-15T22:59:38.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.011+0000 7fcaa891b640 1 -- 172.21.15.66:0/516274942 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7fcaa41a4190 con 0x7fcaa4109450 2024-09-15T22:59:38.013 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:59:38.013 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:59:38.013 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T22:59:38.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.015+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 msgr2=0x7fca8c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:38.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.015+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 0x7fca8c0a5a80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca98005fd0 tx=0x7fca98005850 comp rx=0 tx=0).stop 2024-09-15T22:59:38.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.015+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 msgr2=0x7fcaa41a2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:38.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.015+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ddc0 tx=0x7fca9400a620 comp rx=0 tx=0).stop 2024-09-15T22:59:38.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 shutdown_connections 2024-09-15T22:59:38.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fca8c0a35c0 0x7fca8c0a5a80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:38.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcaa410ddc0 0x7fcaa41a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:38.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa4109e00 0x7fcaa41a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 --2- 172.21.15.66:0/516274942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa4109450 0x7fcaa41a2e30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 >> 172.21.15.66:0/516274942 conn(0x7fcaa406e140 msgr2=0x7fcaa4071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 shutdown_connections 2024-09-15T22:59:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:38.019+0000 7fcaa991d640 1 -- 172.21.15.66:0/516274942 wait complete. 2024-09-15T22:59:38.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:38 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/516274942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:38.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:38 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/516274942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:38.686 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:38 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/516274942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:38.738 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id d8a0fbbe --release --await' 2024-09-15T22:59:38.738 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id d8a0fbbe --release --await 2024-09-15T22:59:39.245 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:39.553 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:39 smithi066 ceph-mon[31185]: pgmap v447: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 85 KiB/s wr, 126 op/s 2024-09-15T22:59:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:39 smithi087 ceph-mon[35290]: pgmap v447: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 85 KiB/s wr, 126 op/s 2024-09-15T22:59:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:39 smithi184 ceph-mon[35203]: pgmap v447: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 85 KiB/s wr, 126 op/s 2024-09-15T22:59:40.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.033+0000 7f0eb914a640 1 -- 172.21.15.66:0/3515819945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109450 msgr2=0x7f0eb4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.033+0000 7f0eb914a640 1 --2- 172.21.15.66:0/3515819945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109450 0x7f0eb4110250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0ea401a910 tx=0x7f0ea403b470 comp rx=0 tx=0).stop 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.035+0000 7f0eb914a640 1 -- 172.21.15.66:0/3515819945 shutdown_connections 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.035+0000 7f0eb914a640 1 --2- 172.21.15.66:0/3515819945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb411b140 0x7f0eb411d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.035+0000 7f0eb914a640 1 --2- 172.21.15.66:0/3515819945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb4109830 0x7f0eb4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.035+0000 7f0eb914a640 1 --2- 172.21.15.66:0/3515819945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109450 0x7f0eb4110250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.035+0000 7f0eb914a640 1 -- 172.21.15.66:0/3515819945 >> 172.21.15.66:0/3515819945 conn(0x7f0eb406e2d0 msgr2=0x7f0eb406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.037+0000 7f0eb914a640 1 -- 172.21.15.66:0/3515819945 shutdown_connections 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.037+0000 7f0eb914a640 1 -- 172.21.15.66:0/3515819945 wait complete. 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.038+0000 7f0eb914a640 1 Processor -- start 2024-09-15T22:59:40.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.040+0000 7f0eb914a640 1 -- start start 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb4109450 0x7f0eb411a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109830 0x7f0eb4116980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4113300 con 0x7f0eb411b140 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4113180 con 0x7f0eb4109830 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.041+0000 7f0eb914a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4113480 con 0x7f0eb4109450 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.042+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb4109450 0x7f0eb411a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.044+0000 7f0eb359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.044+0000 7f0eb359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51080/0 (socket says 172.21.15.66:51080) 2024-09-15T22:59:40.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.044+0000 7f0eb359e640 1 -- 172.21.15.66:0/69174204 learned_addr learned my addr 172.21.15.66:0/69174204 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb259c640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109830 0x7f0eb4116980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb359e640 1 -- 172.21.15.66:0/69174204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb4109450 msgr2=0x7f0eb411a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb359e640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb4109450 0x7f0eb411a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb359e640 1 -- 172.21.15.66:0/69174204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109830 msgr2=0x7f0eb4116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb359e640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109830 0x7f0eb4116980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.046+0000 7f0eb359e640 1 -- 172.21.15.66:0/69174204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb41175c0 con 0x7f0eb411b140 2024-09-15T22:59:40.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.049+0000 7f0eb359e640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00eb40 tx=0x7f0eac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.050+0000 7f0e9bfff640 1 -- 172.21.15.66:0/69174204 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac004b20 con 0x7f0eb411b140 2024-09-15T22:59:40.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.050+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb41cd1c0 con 0x7f0eb411b140 2024-09-15T22:59:40.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.050+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb41cd620 con 0x7f0eb411b140 2024-09-15T22:59:40.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.050+0000 7f0e9bfff640 1 -- 172.21.15.66:0/69174204 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eac010910 con 0x7f0eb411b140 2024-09-15T22:59:40.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.051+0000 7f0e9bfff640 1 -- 172.21.15.66:0/69174204 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00f920 con 0x7f0eb411b140 2024-09-15T22:59:40.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.061+0000 7f0ebb523740 1 Processor -- start 2024-09-15T22:59:40.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.062+0000 7f0e9bfff640 1 -- 172.21.15.66:0/69174204 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0eac010ac0 con 0x7f0eb411b140 2024-09-15T22:59:40.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.062+0000 7f0ebb523740 1 -- start start 2024-09-15T22:59:40.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.062+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.062+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20592d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.062+0000 7f0eb259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0eb259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45792/0 (socket says 172.21.15.66:45792) 2024-09-15T22:59:40.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20595630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0ebb523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c204ed620 con 0x562c20588980 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0ebb523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c20494e50 con 0x562c20593240 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0ebb523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c204e95e0 con 0x562c20588060 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20592d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20592d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51090/0 (socket says 172.21.15.66:51090) 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.063+0000 7f0eb2d9d640 1 -- 172.21.15.66:0/82113733 learned_addr learned my addr 172.21.15.66:0/82113733 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:40.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.065+0000 7f0eb259c640 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20595630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 -- 172.21.15.66:0/82113733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 msgr2=0x562c20595630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20595630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 -- 172.21.15.66:0/82113733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 msgr2=0x562c20592d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20592d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 -- 172.21.15.66:0/82113733 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c20485d40 con 0x562c20588060 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0e9bfff640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 0x7f0e9c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.068+0000 7f0eb259c640 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4072f50 tx=0x7f0ea80094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865d5a8c9c54677b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.069+0000 7f0e9bfff640 1 -- 172.21.15.66:0/69174204 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f0eac0d09d0 con 0x7f0eb411b140 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.069+0000 7f0e997fa640 1 -- 172.21.15.66:0/82113733 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80150d0 con 0x562c20588060 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.069+0000 7f0e997fa640 1 -- 172.21.15.66:0/82113733 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ea8015270 con 0x562c20588060 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.069+0000 7f0e997fa640 1 -- 172.21.15.66:0/82113733 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004da0 con 0x562c20588060 2024-09-15T22:59:40.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.070+0000 7f0ebb523740 1 -- 172.21.15.66:0/82113733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 msgr2=0x562c20588440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.070+0000 7f0ebb523740 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4072f50 tx=0x7f0ea80094a0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.071+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 0x7f0e9c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.073+0000 7f0ebb523740 1 -- 172.21.15.66:0/82113733 shutdown_connections 2024-09-15T22:59:40.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.073+0000 7f0ebb523740 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20595630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.073+0000 7f0ebb523740 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20592d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.073+0000 7f0ebb523740 1 --2- 172.21.15.66:0/82113733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c20588440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.073+0000 7f0ebb523740 1 -- 172.21.15.66:0/82113733 >> 172.21.15.66:0/82113733 conn(0x562c205845f0 msgr2=0x562c205849d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:40.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.075+0000 7f0ebb523740 1 -- 172.21.15.66:0/82113733 shutdown_connections 2024-09-15T22:59:40.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.076+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 0x7f0e9c0a57a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4006010 tx=0x7f0ea4005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.077+0000 7f0ebb523740 1 -- 172.21.15.66:0/82113733 wait complete. 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 -- start start 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 Processor -- start 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c205900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20590600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20590b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562c20595e10 con 0x562c20588980 2024-09-15T22:59:40.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562c20475f10 con 0x562c20593240 2024-09-15T22:59:40.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562c20595f90 con 0x562c20588060 2024-09-15T22:59:40.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.078+0000 7f0ebb523740 10 client.0 _ll_register_callbacks cb 0x562c20499db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:40.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.079+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c205900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.080+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c205900c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45794/0 (socket says 172.21.15.66:45794) 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.080+0000 7f0eb2d9d640 1 -- 172.21.15.66:0/2510174932 learned_addr learned my addr 172.21.15.66:0/2510174932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.080+0000 7f0eb259c640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20590600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 -- 172.21.15.66:0/2510174932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 msgr2=0x562c205900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c205900c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 -- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 msgr2=0x562c20590b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20590b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 -- 172.21.15.66:0/2510174932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c201fc580 con 0x562c20588980 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0eb259c640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20590600 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4072f50 tx=0x7f0ea8005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d8fe5550e10551 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.081+0000 7f0e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:40.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.084+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80108e0 con 0x562c20588980 2024-09-15T22:59:40.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.084+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ea8015270 con 0x562c20588980 2024-09-15T22:59:40.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.084+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f0ea8010a80 con 0x562c20588980 2024-09-15T22:59:40.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.088+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0ea8030050 con 0x562c20588980 2024-09-15T22:59:40.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.090+0000 7f0ebb523740 10 client.18465 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:40.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.090+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562c202c6960 con 0x562c20588980 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ea8023030 con 0x562c20588980 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f0ea802a540 con 0x562c20588980 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 10 client.18465 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 10 client.18465 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 20 client.18465 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:40.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c205a3140 0x562c205a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 4 client.18465 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:40.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.092+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ea8015270 con 0x562c205a3140 2024-09-15T22:59:40.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.094+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c205a3140 0x562c205a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.099+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c205a3140 0x562c205a55a0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0d0e7a363041e1 server_cookie=ca2115a6dba81719 in_seq=0 out_seq=0 2024-09-15T22:59:40.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.099+0000 7f0e96ff5640 10 client.18465 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:40.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2510174932 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0ea8015270 con 0x562c205a3140 2024-09-15T22:59:40.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0e96ff5640 10 client.18465 handle_command_reply: tid=0 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0ebb523740 1 client.18465 shutdown 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 msgr2=0x562c20590600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20590600 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4072f50 tx=0x7f0ea8005f30 comp rx=0 tx=0).stop 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 shutdown_connections 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.103+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c205a3140 0x562c205a55a0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.104+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c20590b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.104+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c20590600 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.104+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2510174932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c205900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.104+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 >> 172.21.15.66:0/2510174932 conn(0x562c205845f0 msgr2=0x562c2058a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.104+0000 7f0e96ff5640 0 client.18465 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.105+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 shutdown_connections 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.105+0000 7f0ebb523740 1 -- 172.21.15.66:0/2510174932 wait complete. 2024-09-15T22:59:40.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.105+0000 7f0ebb523740 20 client.18465 trim_cache size 0 max 16384 2024-09-15T22:59:40.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.138+0000 7f0ebb523740 1 Processor -- start 2024-09-15T22:59:40.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.138+0000 7f0ebb523740 1 -- start start 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.138+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 0x562c2058ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.138+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 0x562c20592030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.139+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20593240 0x562c205aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.139+0000 7f0ebb523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0010300 con 0x562c20588060 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.139+0000 7f0ebb523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0012140 con 0x562c20588980 2024-09-15T22:59:40.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.139+0000 7f0ebb523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0010a90 con 0x562c20593240 2024-09-15T22:59:40.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.140+0000 7f0eb359e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20593240 0x562c205aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.140+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 0x562c2058ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.140+0000 7f0eb2d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 0x562c2058ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51108/0 (socket says 172.21.15.66:51108) 2024-09-15T22:59:40.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.140+0000 7f0eb2d9d640 1 -- 172.21.15.66:0/1559338760 learned_addr learned my addr 172.21.15.66:0/1559338760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:40.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 0x562c20592030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 -- 172.21.15.66:0/1559338760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20593240 msgr2=0x562c205aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20593240 0x562c205aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 -- 172.21.15.66:0/1559338760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 msgr2=0x562c2058ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 0x562c2058ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.142+0000 7f0eb259c640 1 -- 172.21.15.66:0/1559338760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2058f090 con 0x562c20588980 2024-09-15T22:59:40.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.143+0000 7f0eb259c640 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 0x562c20592030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x562c20591670 tx=0x7f0ea8004620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c35e46fbb7d8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.143+0000 7f0e98ff9640 1 -- 172.21.15.66:0/1559338760 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8009c50 con 0x562c20588980 2024-09-15T22:59:40.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.143+0000 7f0e98ff9640 1 -- 172.21.15.66:0/1559338760 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ea8023070 con 0x562c20588980 2024-09-15T22:59:40.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.144+0000 7f0e98ff9640 1 -- 172.21.15.66:0/1559338760 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea802a660 con 0x562c20588980 2024-09-15T22:59:40.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.145+0000 7f0ebb523740 1 -- 172.21.15.66:0/1559338760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 msgr2=0x562c20592030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:40.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.145+0000 7f0ebb523740 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 0x562c20592030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x562c20591670 tx=0x7f0ea8004620 comp rx=0 tx=0).stop 2024-09-15T22:59:40.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.146+0000 7f0ebb523740 1 -- 172.21.15.66:0/1559338760 shutdown_connections 2024-09-15T22:59:40.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.146+0000 7f0ebb523740 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20593240 0x562c205aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.146+0000 7f0ebb523740 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20588980 0x562c20592030 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.146+0000 7f0ebb523740 1 --2- 172.21.15.66:0/1559338760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588060 0x562c2058ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.146+0000 7f0ebb523740 1 -- 172.21.15.66:0/1559338760 >> 172.21.15.66:0/1559338760 conn(0x562c205845f0 msgr2=0x562c20591920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:40.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.149+0000 7f0ebb523740 1 -- 172.21.15.66:0/1559338760 shutdown_connections 2024-09-15T22:59:40.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.149+0000 7f0ebb523740 1 -- 172.21.15.66:0/1559338760 wait complete. 2024-09-15T22:59:40.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 -- start start 2024-09-15T22:59:40.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 Processor -- start 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c2059b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c2058cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00119b0 con 0x562c20588980 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0011220 con 0x562c20593240 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea000e300 con 0x562c20588060 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.150+0000 7f0ebb523740 10 client.0 _ll_register_callbacks cb 0x7f0ea80156e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:40.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.151+0000 7f0eb359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.151+0000 7f0eb359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:60504/0 (socket says 172.21.15.66:60504) 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.151+0000 7f0eb359e640 1 -- 172.21.15.66:0/2873621757 learned_addr learned my addr 172.21.15.66:0/2873621757 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.151+0000 7f0eb259c640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c2058cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.151+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c2059b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.152+0000 7f0eb359e640 1 -- 172.21.15.66:0/2873621757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 msgr2=0x562c2059b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.152+0000 7f0eb359e640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c2059b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.152+0000 7f0eb359e640 1 -- 172.21.15.66:0/2873621757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 msgr2=0x562c2058cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:40.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.152+0000 7f0eb359e640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c2058cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:40.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.152+0000 7f0eb359e640 1 -- 172.21.15.66:0/2873621757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c205887b0 con 0x562c20593240 2024-09-15T22:59:40.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.156+0000 7f0eb359e640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0ce2a0 tx=0x7f0eac09c190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7450a54ae41f949 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:40.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.156+0000 7f0e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:40.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.158+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0b5020 con 0x562c20593240 2024-09-15T22:59:40.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.158+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f0eac09cc90 con 0x562c20593240 2024-09-15T22:59:40.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.159+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ea8023070 con 0x562c20593240 2024-09-15T22:59:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.163+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0eac09c830 con 0x562c20593240 2024-09-15T22:59:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.163+0000 7f0ebb523740 10 client.27779 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:40.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.163+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562c2060dae0 con 0x562c20593240 2024-09-15T22:59:40.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.164+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ea8023070 con 0x562c20593240 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f0eac09db60 con 0x562c20593240 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 10 client.27779 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 10 client.27779 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 20 client.27779 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c2060e2c0 0x562c206106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 4 client.27779 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d8a0fbbe", "release": true, "await": true}] 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.166+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d8a0fbbe", "release": true, "await": true}) -- 0x562c204fab90 con 0x562c2060e2c0 2024-09-15T22:59:40.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.167+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c2060e2c0 0x562c206106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:40.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.178+0000 7f0e96ff5640 10 client.27779 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:40.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:40.178+0000 7f0eb2d9d640 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c2060e2c0 0x562c206106e0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9d770a456ee3d67 server_cookie=2749cb4d1e5dd6db in_seq=0 out_seq=0 2024-09-15T22:59:40.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:40 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:40.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:40 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:40 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T22:59:41.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0e96ff5640 1 -- 172.21.15.66:0/2873621757 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562c204fab90 con 0x562c2060e2c0 2024-09-15T22:59:41.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0e96ff5640 10 client.27779 handle_command_reply: tid=0 2024-09-15T22:59:41.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 client.27779 shutdown 2024-09-15T22:59:41.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 msgr2=0x562c2058d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:41.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0ce2a0 tx=0x7f0eac09c190 comp rx=0 tx=0).stop 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 shutdown_connections 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562c2060e2c0 0x562c206106e0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562c20593240 0x562c2058d0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562c20588980 0x562c2058cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 --2- 172.21.15.66:0/2873621757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562c20588060 0x562c2059b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 >> 172.21.15.66:0/2873621757 conn(0x562c205845f0 msgr2=0x562c20592140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0e96ff5640 0 client.27779 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 shutdown_connections 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 1 -- 172.21.15.66:0/2873621757 wait complete. 2024-09-15T22:59:41.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.356+0000 7f0ebb523740 20 client.27779 trim_cache size 0 max 16384 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 63, 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 48, 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "d8a0fbbe": { 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 48, 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T22:59:41.360 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 131.4, 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:41.361 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:41.362 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:41.362 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T22:59:41.362 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 msgr2=0x7f0e9c0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 0x7f0e9c0a57a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4006010 tx=0x7f0ea4005850 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 msgr2=0x7f0eb4116ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00eb40 tx=0x7f0eac00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 shutdown_connections 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e9c0a32e0 0x7f0e9c0a57a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb411b140 0x7f0eb4116ec0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.357+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb4109830 0x7f0eb4116980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.358+0000 7f0eb914a640 1 --2- 172.21.15.66:0/69174204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb4109450 0x7f0eb411a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:41.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.358+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 >> 172.21.15.66:0/69174204 conn(0x7f0eb406e2d0 msgr2=0x7f0eb4071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:41.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.358+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 shutdown_connections 2024-09-15T22:59:41.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:41.358+0000 7f0eb914a640 1 -- 172.21.15.66:0/69174204 wait complete. 2024-09-15T22:59:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:41 smithi087 ceph-mon[35290]: pgmap v448: 129 pgs: 10 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 86 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 87 KiB/s wr, 144 op/s 2024-09-15T22:59:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:41 smithi184 ceph-mon[35203]: pgmap v448: 129 pgs: 10 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 86 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 87 KiB/s wr, 144 op/s 2024-09-15T22:59:41.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:41 smithi066 ceph-mon[31185]: pgmap v448: 129 pgs: 10 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 86 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 87 KiB/s wr, 144 op/s 2024-09-15T22:59:42.122 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd8a0fbbe', total seconds elapsed: 22.7 2024-09-15T22:59:43.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:59:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:43 smithi087 ceph-mon[35290]: pgmap v449: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 48 KiB/s wr, 134 op/s 2024-09-15T22:59:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:43 smithi184 ceph-mon[35203]: pgmap v449: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 48 KiB/s wr, 134 op/s 2024-09-15T22:59:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:43 smithi066 ceph-mon[31185]: pgmap v449: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 48 KiB/s wr, 134 op/s 2024-09-15T22:59:43.873 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:44.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.755+0000 7ff01ffff640 1 -- 172.21.15.66:0/3406234848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 msgr2=0x7ff0201041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.755+0000 7ff01ffff640 1 --2- 172.21.15.66:0/3406234848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff0201041f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7ff010009900 tx=0x7ff01002a400 comp rx=0 tx=0).stop 2024-09-15T22:59:44.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 -- 172.21.15.66:0/3406234848 shutdown_connections 2024-09-15T22:59:44.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 --2- 172.21.15.66:0/3406234848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff020108f40 0x7ff020110ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 --2- 172.21.15.66:0/3406234848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0201047c0 0x7ff020108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 --2- 172.21.15.66:0/3406234848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff0201041f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 -- 172.21.15.66:0/3406234848 >> 172.21.15.66:0/3406234848 conn(0x7ff0200ff870 msgr2=0x7ff020101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 -- 172.21.15.66:0/3406234848 shutdown_connections 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 -- 172.21.15.66:0/3406234848 wait complete. 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.756+0000 7ff01ffff640 1 Processor -- start 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 -- start start 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 0x7ff02019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff020108f40 0x7ff02019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48768/0 (socket says 172.21.15.66:48768) 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01effd640 1 -- 172.21.15.66:0/1659078750 learned_addr learned my addr 172.21.15.66:0/1659078750 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff020113fb0 con 0x7ff020103e10 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff020113e30 con 0x7ff020108f40 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff020114130 con 0x7ff0201047c0 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.757+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 0x7ff02019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff020108f40 0x7ff02019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 -- 172.21.15.66:0/1659078750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 msgr2=0x7ff02019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 0x7ff02019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 -- 172.21.15.66:0/1659078750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff020108f40 msgr2=0x7ff02019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff020108f40 0x7ff02019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02019f230 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 0x7ff02019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01effd640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff010009850 tx=0x7ff010030940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff007fff640 1 -- 172.21.15.66:0/1659078750 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01003f070 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff007fff640 1 -- 172.21.15.66:0/1659078750 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff010030d70 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02019f4c0 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff007fff640 1 -- 172.21.15.66:0/1659078750 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010035030 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.758+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201a6e00 con 0x7ff020103e10 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 Processor -- start 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 -- start start 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5560018892e0 con 0x55600192e850 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556001830ce0 con 0x556001923670 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff0279dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5560018852a0 con 0x556001923f90 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff007fff640 1 -- 172.21.15.66:0/1659078750 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff010042070 con 0x7ff020103e10 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43258/0 (socket says 172.21.15.66:43258) 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01f7fe640 1 -- 172.21.15.66:0/1448366561 learned_addr learned my addr 172.21.15.66:0/1448366561 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48770/0 (socket says 172.21.15.66:48770) 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.761+0000 7ff01effd640 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 -- 172.21.15.66:0/1448366561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 msgr2=0x55600192e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 -- 172.21.15.66:0/1448366561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 msgr2=0x556001930c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 -- 172.21.15.66:0/1448366561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556001815440 con 0x556001923670 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff007fff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 0x7ff0080a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff018009f50 tx=0x7ff0180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=184300314c7ad13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff01effd640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 0x7ff0080a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff0057fa640 1 -- 172.21.15.66:0/1448366561 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004d20 con 0x556001923670 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff0057fa640 1 -- 172.21.15.66:0/1448366561 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff018004050 con 0x556001923670 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff007fff640 1 -- 172.21.15.66:0/1659078750 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7ff0100f0ac0 con 0x7ff020103e10 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.762+0000 7ff0057fa640 1 -- 172.21.15.66:0/1448366561 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018005280 con 0x556001923670 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- 172.21.15.66:0/1448366561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 msgr2=0x556001923a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff018009f50 tx=0x7ff0180118d0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff01effd640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 0x7ff0080a58c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff0100ede40 tx=0x7ff0100f4610 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- 172.21.15.66:0/1448366561 shutdown_connections 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001930c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 --2- 172.21.15.66:0/1448366561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x556001923a50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- 172.21.15.66:0/1448366561 >> 172.21.15.66:0/1448366561 conn(0x55600191fc00 msgr2=0x55600191ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- 172.21.15.66:0/1448366561 shutdown_connections 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- 172.21.15.66:0/1448366561 wait complete. 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.763+0000 7ff0279dd740 1 -- start start 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 Processor -- start 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600192e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x55600192ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556001931420 con 0x55600192e850 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556001844050 con 0x556001923670 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5560019315a0 con 0x556001923f90 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff0279dd740 10 client.0 _ll_register_callbacks cb 0x556001884160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600192e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600192e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43260/0 (socket says 172.21.15.66:43260) 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 -- 172.21.15.66:0/960537905 learned_addr learned my addr 172.21.15.66:0/960537905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x55600192ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 -- 172.21.15.66:0/960537905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 msgr2=0x55600192b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 -- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 msgr2=0x55600192e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600192e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01f7fe640 1 -- 172.21.15.66:0/960537905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560015fa3c0 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.764+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x55600192ba40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff018012fd0 tx=0x7ff018005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6074f50dbef57f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01802b020 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7ff018027440 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff018004050 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff018036050 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 10 client.18483 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55600193ce30 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff018004050 con 0x55600192e850 2024-09-15T22:59:44.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7ff01800f6e0 con 0x55600192e850 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 10 client.18483 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 10 client.18483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 20 client.18483 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55600193e290 0x556001940680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 4 client.18483 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.765+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556001896850 con 0x55600193e290 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.766+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55600193e290 0x556001940680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.766+0000 7ff002ff5640 10 client.18483 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.766+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55600193e290 0x556001940680 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d8dcd109b295ba server_cookie=54977624753e316b in_seq=0 out_seq=0 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff002ff5640 1 -- 172.21.15.66:0/960537905 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556001896850 con 0x55600193e290 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff002ff5640 10 client.18483 handle_command_reply: tid=0 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 client.18483 shutdown 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 msgr2=0x55600192ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x55600192ba40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff018012fd0 tx=0x7ff018005fd0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 shutdown_connections 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x55600192ba40 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x55600192b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55600193e290 0x556001940680 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 --2- 172.21.15.66:0/960537905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600192e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff002ff5640 0 client.18483 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 >> 172.21.15.66:0/960537905 conn(0x55600191fc00 msgr2=0x5560019258e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 shutdown_connections 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.767+0000 7ff0279dd740 1 -- 172.21.15.66:0/960537905 wait complete. 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.768+0000 7ff0279dd740 20 client.18483 trim_cache size 0 max 16384 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.785+0000 7ff0279dd740 1 Processor -- start 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.785+0000 7ff0279dd740 1 -- start start 2024-09-15T22:59:44.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600193a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x556001945f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b1440 con 0x55600192e850 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b3280 con 0x556001923670 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff0279dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b1bd0 con 0x556001923f90 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48792/0 (socket says 172.21.15.66:48792) 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 -- 172.21.15.66:0/2979889795 learned_addr learned my addr 172.21.15.66:0/2979889795 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x556001945f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600193a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 -- 172.21.15.66:0/2979889795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 msgr2=0x556001945f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x556001945f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 -- 172.21.15.66:0/2979889795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 msgr2=0x55600193a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600193a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 -- 172.21.15.66:0/2979889795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600192e560 con 0x55600192e850 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x556001945f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff018002230 tx=0x7ff018011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff419fef5dd3a1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff004ff9640 1 -- 172.21.15.66:0/2979889795 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018041070 con 0x55600192e850 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff004ff9640 1 -- 172.21.15.66:0/2979889795 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff018004770 con 0x55600192e850 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.786+0000 7ff004ff9640 1 -- 172.21.15.66:0/2979889795 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01802b070 con 0x55600192e850 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- 172.21.15.66:0/2979889795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 msgr2=0x556001946440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff018002230 tx=0x7ff018011e50 comp rx=0 tx=0).stop 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- 172.21.15.66:0/2979889795 shutdown_connections 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001946440 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923f90 0x556001945f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 --2- 172.21.15.66:0/2979889795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923670 0x55600193a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- 172.21.15.66:0/2979889795 >> 172.21.15.66:0/2979889795 conn(0x55600191fc00 msgr2=0x556001929d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- 172.21.15.66:0/2979889795 shutdown_connections 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- 172.21.15.66:0/2979889795 wait complete. 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 -- start start 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.787+0000 7ff0279dd740 1 Processor -- start 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923670 0x556001936d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923f90 0x556001927fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b2af0 con 0x55600192e850 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201b2360 con 0x556001923f90 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201af440 con 0x556001923670 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff0279dd740 10 client.0 _ll_register_callbacks cb 0x7ff0100f44e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48806/0 (socket says 172.21.15.66:48806) 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 -- 172.21.15.66:0/312364114 learned_addr learned my addr 172.21.15.66:0/312364114 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923f90 0x556001927fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923670 0x556001936d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 -- 172.21.15.66:0/312364114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923670 msgr2=0x556001936d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923670 0x556001936d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 -- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923f90 msgr2=0x556001927fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923f90 0x556001927fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.788+0000 7ff01f7fe640 1 -- 172.21.15.66:0/312364114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556001928b00 con 0x55600192e850 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff01f7fe640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff01803f040 tx=0x7ff01800f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7ee46901927e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01802b070 con 0x55600192e850 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7ff018003c40 con 0x55600192e850 2024-09-15T22:59:44.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff018004770 con 0x55600192e850 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7ff018041040 con 0x55600192e850 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 10 client.18489 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5560019a8cc0 con 0x55600192e850 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff018004770 con 0x55600192e850 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7ff018024510 con 0x55600192e850 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 10 client.18489 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 10 client.18489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 20 client.18489 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5560019a9410 0x5560019ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 4 client.18489 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.789+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556001890d60 con 0x5560019a9410 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5560019a9410 0x5560019ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:44.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff002ff5640 10 client.18489 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff01e7fc640 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5560019a9410 0x5560019ab830 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb4c4dc40ffd984 server_cookie=dd357ffed1f9f01b in_seq=0 out_seq=0 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff002ff5640 1 -- 172.21.15.66:0/312364114 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556001890d60 con 0x5560019a9410 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff002ff5640 10 client.18489 handle_command_reply: tid=0 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 client.18489 shutdown 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 msgr2=0x556001928510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff01803f040 tx=0x7ff01800f600 comp rx=0 tx=0).stop 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 shutdown_connections 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55600192e850 0x556001928510 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5560019a9410 0x5560019ab830 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556001923f90 0x556001927fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff002ff5640 0 client.18489 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 --2- 172.21.15.66:0/312364114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556001923670 0x556001936d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.790+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 >> 172.21.15.66:0/312364114 conn(0x55600191fc00 msgr2=0x55600192d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 shutdown_connections 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff0279dd740 1 -- 172.21.15.66:0/312364114 wait complete. 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff0279dd740 20 client.18489 trim_cache size 0 max 16384 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T22:59:44.942 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T22:59:44.943 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T22:59:44.943 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T22:59:44.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 msgr2=0x7ff0080a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 0x7ff0080a58c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff0100ede40 tx=0x7ff0100f4610 comp rx=0 tx=0).stop 2024-09-15T22:59:44.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 msgr2=0x7ff02019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff010009850 tx=0x7ff010030940 comp rx=0 tx=0).stop 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 shutdown_connections 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0080a3400 0x7ff0080a58c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff020108f40 0x7ff02019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0201047c0 0x7ff02019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 --2- 172.21.15.66:0/1659078750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff020103e10 0x7ff02019a280 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 >> 172.21.15.66:0/1659078750 conn(0x7ff0200ff870 msgr2=0x7ff020100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 shutdown_connections 2024-09-15T22:59:44.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:44.791+0000 7ff01ffff640 1 -- 172.21.15.66:0/1659078750 wait complete. 2024-09-15T22:59:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:45 smithi087 ceph-mon[35290]: pgmap v450: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 280 KiB/s wr, 123 op/s 2024-09-15T22:59:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:59:45.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:45 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T22:59:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:45 smithi184 ceph-mon[35203]: pgmap v450: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 280 KiB/s wr, 123 op/s 2024-09-15T22:59:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:59:45.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:45 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T22:59:45.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:45 smithi066 ceph-mon[31185]: pgmap v450: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 280 KiB/s wr, 123 op/s 2024-09-15T22:59:45.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:59:45.678 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:45 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T22:59:45.728 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:59:45.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:59:46.222 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 -- 172.21.15.66:0/1494690061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d411b140 msgr2=0x7f79d411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 --2- 172.21.15.66:0/1494690061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d411b140 0x7f79d411d530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009900 tx=0x7f79cc02a420 comp rx=0 tx=0).stop 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 -- 172.21.15.66:0/1494690061 shutdown_connections 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 --2- 172.21.15.66:0/1494690061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d411b140 0x7f79d411d530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 --2- 172.21.15.66:0/1494690061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 --2- 172.21.15.66:0/1494690061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d4110190 0x7f79d406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:46.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.835+0000 7f79dac43640 1 -- 172.21.15.66:0/1494690061 >> 172.21.15.66:0/1494690061 conn(0x7f79d4073180 msgr2=0x7f79d4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.837+0000 7f79dac43640 1 -- 172.21.15.66:0/1494690061 shutdown_connections 2024-09-15T22:59:46.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.837+0000 7f79dac43640 1 -- 172.21.15.66:0/1494690061 wait complete. 2024-09-15T22:59:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 Processor -- start 2024-09-15T22:59:46.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 -- start start 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 0x7f79d41149e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 0x7f79d4114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79d4111370 con 0x7f79d406ea30 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41111f0 con 0x7f79d4110190 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.838+0000 7f79dac43640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41114f0 con 0x7f79d411b140 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.839+0000 7f79d9c41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:46.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.839+0000 7f79d9c41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48822/0 (socket says 172.21.15.66:48822) 2024-09-15T22:59:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.839+0000 7f79d9440640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 0x7f79d41149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:46.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.839+0000 7f79d9c41640 1 -- 172.21.15.66:0/1791820872 learned_addr learned my addr 172.21.15.66:0/1791820872 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79da442640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 0x7f79d4114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 -- 172.21.15.66:0/1791820872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 msgr2=0x7f79d4114f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:46.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 0x7f79d4114f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 -- 172.21.15.66:0/1791820872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 msgr2=0x7f79d41149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 0x7f79d41149e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 -- 172.21.15.66:0/1791820872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d41157e0 con 0x7f79d406ea30 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.840+0000 7f79d9c41640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f79c400ba50 tx=0x7f79c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4019070 con 0x7f79d406ea30 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79dac43640 1 -- 172.21.15.66:0/1791820872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41bbf50 con 0x7f79d406ea30 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c400cc10 con 0x7f79d406ea30 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79dac43640 1 -- 172.21.15.66:0/1791820872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41bc400 con 0x7f79d406ea30 2024-09-15T22:59:46.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79d9440640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 0x7f79d41149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:46.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.841+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4019070 con 0x7f79d406ea30 2024-09-15T22:59:46.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.842+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d41096f0 con 0x7f79d406ea30 2024-09-15T22:59:46.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.844+0000 7f79da442640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 0x7f79d4114f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:46.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.846+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f79c401c070 con 0x7f79d406ea30 2024-09-15T22:59:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.847+0000 7f79d2ffd640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 0x7f79bc0a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.847+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f79c400ca10 con 0x7f79d406ea30 2024-09-15T22:59:46.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.849+0000 7f79d9440640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 0x7f79bc0a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:46.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.855+0000 7f79d9440640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 0x7f79bc0a5cb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005d00 tx=0x7f79c8009550 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:46.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:46.857+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79c409bc50 con 0x7f79d406ea30 2024-09-15T22:59:47.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.221+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79d4115f10 con 0x7f79d406ea30 2024-09-15T22:59:47.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.222+0000 7f79d2ffd640 1 -- 172.21.15.66:0/1791820872 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7f79c409b550 con 0x7f79d406ea30 2024-09-15T22:59:47.224 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T22:59:47.224 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T22:59:47.224 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 msgr2=0x7f79bc0a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 0x7f79bc0a5cb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005d00 tx=0x7f79c8009550 comp rx=0 tx=0).stop 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 msgr2=0x7f79d411a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f79c400ba50 tx=0x7f79c400bf10 comp rx=0 tx=0).stop 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 shutdown_connections 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79bc0a37f0 0x7f79bc0a5cb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79d411b140 0x7f79d4114f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79d4110190 0x7f79d41149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:47.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 --2- 172.21.15.66:0/1791820872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d406ea30 0x7f79d411a960 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 >> 172.21.15.66:0/1791820872 conn(0x7f79d4073180 msgr2=0x7f79d411b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 shutdown_connections 2024-09-15T22:59:47.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:47.225+0000 7f79d0ff9640 1 -- 172.21.15.66:0/1791820872 wait complete. 2024-09-15T22:59:47.588 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:47 smithi066 ceph-mon[31185]: pgmap v451: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 270 KiB/s wr, 106 op/s 2024-09-15T22:59:47.589 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:47 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1791820872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:47 smithi087 ceph-mon[35290]: pgmap v451: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 270 KiB/s wr, 106 op/s 2024-09-15T22:59:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:47 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1791820872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:47 smithi184 ceph-mon[35203]: pgmap v451: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 270 KiB/s wr, 106 op/s 2024-09-15T22:59:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:47 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1791820872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:59:48.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T22:59:48.530 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:49.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 -- 172.21.15.66:0/2879083298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c80952d0 msgr2=0x7fa2c80a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 --2- 172.21.15.66:0/2879083298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c80952d0 0x7fa2c80a1320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0068370 tx=0x7fa2d0096c80 comp rx=0 tx=0).stop 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 -- 172.21.15.66:0/2879083298 shutdown_connections 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 --2- 172.21.15.66:0/2879083298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c80952d0 0x7fa2c80a1320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 --2- 172.21.15.66:0/2879083298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c8094930 0x7fa2c8094d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 --2- 172.21.15.66:0/2879083298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c809a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.129+0000 7fa2d6468640 1 -- 172.21.15.66:0/2879083298 >> 172.21.15.66:0/2879083298 conn(0x7fa2c800a1f0 msgr2=0x7fa2c800a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.130+0000 7fa2d6468640 1 -- 172.21.15.66:0/2879083298 shutdown_connections 2024-09-15T22:59:49.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.130+0000 7fa2d6468640 1 -- 172.21.15.66:0/2879083298 wait complete. 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.131+0000 7fa2d6468640 1 Processor -- start 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.131+0000 7fa2d6468640 1 -- start start 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 0x7fa2c809e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c80952d0 0x7fa2c809e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c812e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 0x7fa2c809e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 0x7fa2c809e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43302/0 (socket says 172.21.15.66:43302) 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80a5880 con 0x7fa2c80952d0 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80a5700 con 0x7fa2c8094930 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d6468640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80a5a00 con 0x7fa2c809a550 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c812e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d5466640 1 -- 172.21.15.66:0/1551324178 learned_addr learned my addr 172.21.15.66:0/1551324178 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.132+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c80952d0 0x7fa2c809e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.133+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1551324178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 msgr2=0x7fa2c809e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.133+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 0x7fa2c809e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.133+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c80952d0 msgr2=0x7fa2c809e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.133+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c80952d0 0x7fa2c809e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.133+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1551324178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c812e860 con 0x7fa2c809a550 2024-09-15T22:59:49.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.134+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c812e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0068040 tx=0x7fa2d0097830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.135+0000 7fa2c67fc640 1 -- 172.21.15.66:0/1551324178 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00ad020 con 0x7fa2c809a550 2024-09-15T22:59:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.135+0000 7fa2c67fc640 1 -- 172.21.15.66:0/1551324178 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d0097e30 con 0x7fa2c809a550 2024-09-15T22:59:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.135+0000 7fa2c67fc640 1 -- 172.21.15.66:0/1551324178 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d009f800 con 0x7fa2c809a550 2024-09-15T22:59:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.135+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c812eaf0 con 0x7fa2c809a550 2024-09-15T22:59:49.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.136+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c812efb0 con 0x7fa2c809a550 2024-09-15T22:59:49.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.139+0000 7fa2c67fc640 1 -- 172.21.15.66:0/1551324178 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa2d00b0020 con 0x7fa2c809a550 2024-09-15T22:59:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.141+0000 7fa2c67fc640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 0x7fa2bc0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.141+0000 7fa2d9aa3740 1 Processor -- start 2024-09-15T22:59:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.141+0000 7fa2d5466640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 0x7fa2bc0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.141+0000 7fa2c67fc640 1 -- 172.21.15.66:0/1551324178 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fa2d015cdf0 con 0x7fa2c809a550 2024-09-15T22:59:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.141+0000 7fa2d9aa3740 1 -- start start 2024-09-15T22:59:49.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84635cf0 0x556c84634240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c84634bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c8459a2f0 con 0x556c8463f520 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556c84541cf0 con 0x556c84634780 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556c845962b0 con 0x556c84635cf0 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d5c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d5c67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48852/0 (socket says 172.21.15.66:48852) 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d5c67640 1 -- 172.21.15.66:0/821583914 learned_addr learned my addr 172.21.15.66:0/821583914 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d5466640 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84635cf0 0x556c84634240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.142+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c84634bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 -- 172.21.15.66:0/821583914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84635cf0 msgr2=0x556c84634240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84635cf0 0x556c84634240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 -- 172.21.15.66:0/821583914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 msgr2=0x556c84634bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c84634bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 -- 172.21.15.66:0/821583914 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c845263a0 con 0x556c8463f520 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00518b0 tx=0x7fa2d00a9ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c56b3fd4f2c8790 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2d5466640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 0x7fa2bc0a5980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0058c0 tx=0x7fa2cc009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2bb7fe640 1 -- 172.21.15.66:0/821583914 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d007a0c0 con 0x556c8463f520 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2bb7fe640 1 -- 172.21.15.66:0/821583914 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d009b040 con 0x556c8463f520 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.143+0000 7fa2bb7fe640 1 -- 172.21.15.66:0/821583914 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d015a2e0 con 0x556c8463f520 2024-09-15T22:59:49.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.144+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/821583914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 msgr2=0x556c84641910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.144+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00518b0 tx=0x7fa2d00a9ee0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/821583914 shutdown_connections 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84641910 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c84634bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/821583914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84635cf0 0x556c84634240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/821583914 >> 172.21.15.66:0/821583914 conn(0x556c845fd310 msgr2=0x556c84630e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/821583914 shutdown_connections 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/821583914 wait complete. 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.145+0000 7fa2d9aa3740 1 -- start start 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 Processor -- start 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c8463eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c8463c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c8463f520 0x556c8463c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556c84641fe0 con 0x556c84635cf0 2024-09-15T22:59:49.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x556c84555060 con 0x556c84634780 2024-09-15T22:59:49.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556c84642160 con 0x556c8463f520 2024-09-15T22:59:49.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d9aa3740 10 client.0 _ll_register_callbacks cb 0x556c842a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:49.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c8463eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.146+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c8463eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43318/0 (socket says 172.21.15.66:43318) 2024-09-15T22:59:49.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.147+0000 7fa2d5466640 1 -- 172.21.15.66:0/628399140 learned_addr learned my addr 172.21.15.66:0/628399140 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.147+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c8463c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.148+0000 7fa2d4c65640 1 -- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c8463f520 msgr2=0x556c8463c790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.148+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c8463f520 0x556c8463c790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.148+0000 7fa2d4c65640 1 -- 172.21.15.66:0/628399140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 msgr2=0x556c8463eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.148+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c8463eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.148+0000 7fa2d4c65640 1 -- 172.21.15.66:0/628399140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8430b3c0 con 0x556c84635cf0 2024-09-15T22:59:49.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.149+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c8463c1a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa2c812b050 tx=0x7fa2c000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236627c581e23733 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.150+0000 7fa2b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:49.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.150+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0003dc0 con 0x556c84635cf0 2024-09-15T22:59:49.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.150+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fa2c0005020 con 0x556c84635cf0 2024-09-15T22:59:49.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.150+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d009b040 con 0x556c84635cf0 2024-09-15T22:59:49.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.151+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fa2c0005220 con 0x556c84635cf0 2024-09-15T22:59:49.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.151+0000 7fa2d9aa3740 10 client.18507 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:49.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.151+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x556c8464d9f0 con 0x556c84635cf0 2024-09-15T22:59:49.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.152+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d009b040 con 0x556c84635cf0 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.152+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fa2c0011570 con 0x556c84635cf0 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 10 client.18507 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 10 client.18507 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 20 client.18507 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c8464f360 0x556c84651780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 4 client.18507 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c845a7860 con 0x556c8464f360 2024-09-15T22:59:49.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.153+0000 7fa2d5466640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c8464f360 0x556c84651780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.154+0000 7fa2d5466640 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c8464f360 0x556c84651780 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9535d58cadd9465b server_cookie=1a67eb624f7dceb6 in_seq=0 out_seq=0 2024-09-15T22:59:49.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.154+0000 7fa2b8ff9640 10 client.18507 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:59:49.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.154+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/628399140 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c845a7860 con 0x556c8464f360 2024-09-15T22:59:49.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.154+0000 7fa2b8ff9640 10 client.18507 handle_command_reply: tid=0 2024-09-15T22:59:49.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.154+0000 7fa2d9aa3740 1 client.18507 shutdown 2024-09-15T22:59:49.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 msgr2=0x556c8463c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c8463c1a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa2c812b050 tx=0x7fa2c000bf30 comp rx=0 tx=0).stop 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 shutdown_connections 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c8464f360 0x556c84651780 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c8463f520 0x556c8463c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c8463c1a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/628399140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84634780 0x556c8463eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 >> 172.21.15.66:0/628399140 conn(0x556c845fd310 msgr2=0x556c84636b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2b8ff9640 0 client.18507 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:59:49.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.155+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 shutdown_connections 2024-09-15T22:59:49.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.156+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/628399140 wait complete. 2024-09-15T22:59:49.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.156+0000 7fa2d9aa3740 20 client.18507 trim_cache size 0 max 16384 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.175+0000 7fa2d9aa3740 1 Processor -- start 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 -- start start 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c8463c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84657060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8140c10 con 0x556c8463f520 2024-09-15T22:59:49.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8142a50 con 0x556c84635cf0 2024-09-15T22:59:49.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d9aa3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c81413a0 con 0x556c84634780 2024-09-15T22:59:49.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.176+0000 7fa2d4c65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:43334/0 (socket says 172.21.15.66:43334) 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 -- 172.21.15.66:0/1035754107 learned_addr learned my addr 172.21.15.66:0/1035754107 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84657060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 -- 172.21.15.66:0/1035754107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 msgr2=0x556c8463c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c8463c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 -- 172.21.15.66:0/1035754107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 msgr2=0x556c84657060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84657060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.177+0000 7fa2d4c65640 1 -- 172.21.15.66:0/1035754107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8463f260 con 0x556c84635cf0 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.178+0000 7fa2d4c65640 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005d00 tx=0x7fa2c00043a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2155a0c27439373 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.179+0000 7fa2baffd640 1 -- 172.21.15.66:0/1035754107 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c002a070 con 0x556c84635cf0 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.179+0000 7fa2baffd640 1 -- 172.21.15.66:0/1035754107 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c0003dc0 con 0x556c84635cf0 2024-09-15T22:59:49.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.179+0000 7fa2baffd640 1 -- 172.21.15.66:0/1035754107 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c001b7e0 con 0x556c84635cf0 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1035754107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 msgr2=0x556c8464b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005d00 tx=0x7fa2c00043a0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1035754107 shutdown_connections 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c8463f520 0x556c84657060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c84635cf0 0x556c8464b240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1035754107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c8463c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.180+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1035754107 >> 172.21.15.66:0/1035754107 conn(0x556c845fd310 msgr2=0x556c8463ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.181+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1035754107 shutdown_connections 2024-09-15T22:59:49.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.181+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1035754107 wait complete. 2024-09-15T22:59:49.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.181+0000 7fa2d9aa3740 1 -- start start 2024-09-15T22:59:49.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.181+0000 7fa2d9aa3740 1 Processor -- start 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.182+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c846432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.182+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c84643810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.182+0000 7fa2d9aa3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 0x556c84643d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.182+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c846432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5466640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c846432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35962/0 (socket says 172.21.15.66:35962) 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d4c65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c84643810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5466640 1 -- 172.21.15.66:0/1004481084 learned_addr learned my addr 172.21.15.66:0/1004481084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c81422c0 con 0x556c84635cf0 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c8141b30 con 0x556c8463f520 2024-09-15T22:59:49.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c812ae00 con 0x556c84634780 2024-09-15T22:59:49.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 0x556c84643d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d9aa3740 10 client.0 _ll_register_callbacks cb 0x7fa2c0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 msgr2=0x556c846432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c846432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1004481084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 msgr2=0x556c84643810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c84643810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.183+0000 7fa2d5c67640 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c846b9230 con 0x556c8463f520 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.184+0000 7fa2d5c67640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 0x556c84643d50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x556c846362f0 tx=0x7fa2d0068cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851c1298d7a3bda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.184+0000 7fa2b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.184+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d015a2e0 con 0x556c8463f520 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.184+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fa2d015a480 con 0x556c8463f520 2024-09-15T22:59:49.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.184+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c0003dc0 con 0x556c8463f520 2024-09-15T22:59:49.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.185+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fa2d0146050 con 0x556c8463f520 2024-09-15T22:59:49.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.185+0000 7fa2d9aa3740 10 client.27815 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:49.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.185+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x556c846ba490 con 0x556c8463f520 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.185+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c0003dc0 con 0x556c8463f520 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.185+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fa2d0127c50 con 0x556c8463f520 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 10 client.27815 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 10 client.27815 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 20 client.27815 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c846baa20 0x556c846bce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 4 client.27815 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c845a1d70 con 0x556c846baa20 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.186+0000 7fa2d5466640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c846baa20 0x556c846bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2d5466640 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c846baa20 0x556c846bce40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=59faaa27c7890a75 server_cookie=abf5dfab0689e602 in_seq=0 out_seq=0 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2b8ff9640 10 client.27815 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2b8ff9640 1 -- 172.21.15.66:0/1004481084 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c845a1d70 con 0x556c846baa20 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2b8ff9640 10 client.27815 handle_command_reply: tid=0 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2d9aa3740 1 client.27815 shutdown 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 msgr2=0x556c84643d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.187+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 0x556c84643d50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x556c846362f0 tx=0x7fa2d0068cb0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 shutdown_connections 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x556c846baa20 0x556c846bce40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2b8ff9640 0 client.27815 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556c8463f520 0x556c84643d50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x556c84635cf0 0x556c84643810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 --2- 172.21.15.66:0/1004481084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556c84634780 0x556c846432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 >> 172.21.15.66:0/1004481084 conn(0x556c845fd310 msgr2=0x556c84636320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 shutdown_connections 2024-09-15T22:59:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.188+0000 7fa2d9aa3740 1 -- 172.21.15.66:0/1004481084 wait complete. 2024-09-15T22:59:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.189+0000 7fa2d9aa3740 20 client.27815 trim_cache size 0 max 16384 2024-09-15T22:59:49.192 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 msgr2=0x7fa2bc0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 0x7fa2bc0a5980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0058c0 tx=0x7fa2cc009260 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 msgr2=0x7fa2c812e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c812e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0068040 tx=0x7fa2d0097830 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 shutdown_connections 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa2bc0a34c0 0x7fa2bc0a5980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c809a550 0x7fa2c812e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2c80952d0 0x7fa2c809e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 --2- 172.21.15.66:0/1551324178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8094930 0x7fa2c809e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 >> 172.21.15.66:0/1551324178 conn(0x7fa2c800a1f0 msgr2=0x7fa2c80a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.190+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 shutdown_connections 2024-09-15T22:59:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:49.191+0000 7fa2d6468640 1 -- 172.21.15.66:0/1551324178 wait complete. 2024-09-15T22:59:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:49 smithi066 ceph-mon[31185]: pgmap v452: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 852 KiB/s wr, 107 op/s 2024-09-15T22:59:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:49 smithi087 ceph-mon[35290]: pgmap v452: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 852 KiB/s wr, 107 op/s 2024-09-15T22:59:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:49 smithi184 ceph-mon[35203]: pgmap v452: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 852 KiB/s wr, 107 op/s 2024-09-15T22:59:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:50 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:59:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:50 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:59:50.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:50 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:59:51.389 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T22:59:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:51 smithi087 ceph-mon[35290]: pgmap v453: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 931 KiB/s wr, 124 op/s 2024-09-15T22:59:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:51 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:59:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:51 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:59:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:51 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:59:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:51 smithi184 ceph-mon[35203]: pgmap v453: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 931 KiB/s wr, 124 op/s 2024-09-15T22:59:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:51 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:59:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:51 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:59:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:51 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:59:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:51 smithi066 ceph-mon[31185]: pgmap v453: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 931 KiB/s wr, 124 op/s 2024-09-15T22:59:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:51 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:59:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:51 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:59:51.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:51 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T22:59:51.828 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:52.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.744+0000 7f709ab8c640 1 -- 172.21.15.66:0/3355571276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c09a500 msgr2=0x7f708c09a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.744+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3355571276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c09a500 0x7f708c09a8e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7088009860 tx=0x7f708802a340 comp rx=0 tx=0).stop 2024-09-15T22:59:52.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 -- 172.21.15.66:0/3355571276 shutdown_connections 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3355571276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c006fd0 0x7f708c098010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3355571276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 0x7f708c006980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3355571276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c09a500 0x7f708c09a8e0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 -- 172.21.15.66:0/3355571276 >> 172.21.15.66:0/3355571276 conn(0x7f708c00a290 msgr2=0x7f708c00a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 -- 172.21.15.66:0/3355571276 shutdown_connections 2024-09-15T22:59:52.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.745+0000 7f709ab8c640 1 -- 172.21.15.66:0/3355571276 wait complete. 2024-09-15T22:59:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.746+0000 7f709ab8c640 1 Processor -- start 2024-09-15T22:59:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.746+0000 7f709ab8c640 1 -- start start 2024-09-15T22:59:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 0x7f708c132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 0x7f708c132a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0ac010 con 0x7f708c006fd0 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0abe90 con 0x7f708c09a500 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f709ab8c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0ac190 con 0x7f708c006540 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7093fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 0x7f708c132a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7098928640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 0x7f708c132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7099129640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7093fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 0x7f708c132a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45570/0 (socket says 172.21.15.66:45570) 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7099129640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40818/0 (socket says 172.21.15.66:40818) 2024-09-15T22:59:52.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.747+0000 7f7093fff640 1 -- 172.21.15.66:0/3996770973 learned_addr learned my addr 172.21.15.66:0/3996770973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 -- 172.21.15.66:0/3996770973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 msgr2=0x7f708c132510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 0x7f708c132510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 -- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 msgr2=0x7f708c132a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 0x7f708c132a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 -- 172.21.15.66:0/3996770973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c1374c0 con 0x7f708c09a500 2024-09-15T22:59:52.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.748+0000 7f7099129640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7094067960 tx=0x7f70940747f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.752+0000 7f7091ffb640 1 -- 172.21.15.66:0/3996770973 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709407f640 con 0x7f708c09a500 2024-09-15T22:59:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.752+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c1377b0 con 0x7f708c09a500 2024-09-15T22:59:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.752+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c137c10 con 0x7f708c09a500 2024-09-15T22:59:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.753+0000 7f7091ffb640 1 -- 172.21.15.66:0/3996770973 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7094084020 con 0x7f708c09a500 2024-09-15T22:59:52.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.753+0000 7f7091ffb640 1 -- 172.21.15.66:0/3996770973 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709407ec30 con 0x7f708c09a500 2024-09-15T22:59:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.758+0000 7f709cf65740 1 Processor -- start 2024-09-15T22:59:52.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.758+0000 7f709cf65740 1 -- start start 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d30e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e33d2742f0 con 0x55e33d30e780 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e33d21bcf0 con 0x55e33d30fcf0 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f709cf65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e33d2702b0 con 0x55e33d319520 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.759+0000 7f7091ffb640 1 -- 172.21.15.66:0/3996770973 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f709407e3c0 con 0x7f708c09a500 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.760+0000 7f7091ffb640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 0x7f70840a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.761+0000 7f7091ffb640 1 -- 172.21.15.66:0/3996770973 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f709413d5a0 con 0x7f708c09a500 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.762+0000 7f7093fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.762+0000 7f7093fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48476/0 (socket says 172.21.15.66:48476) 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.762+0000 7f7093fff640 1 -- 172.21.15.66:0/1589538698 learned_addr learned my addr 172.21.15.66:0/1589538698 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.762+0000 7f7093fff640 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d30e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.762+0000 7f7099129640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 0x7f70840a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7098928640 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7093fff640 1 -- 172.21.15.66:0/1589538698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 msgr2=0x55e33d30e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7093fff640 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d30e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7093fff640 1 -- 172.21.15.66:0/1589538698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 msgr2=0x55e33d30ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7093fff640 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.764+0000 7f7093fff640 1 -- 172.21.15.66:0/1589538698 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33d2003a0 con 0x55e33d319520 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.765+0000 7f7099129640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 0x7f70840a5a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7094068040 tx=0x7f7094068300 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.765+0000 7f7093fff640 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7080012850 tx=0x7f70800097c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff4ca2a003798d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.766+0000 7f707effd640 1 -- 172.21.15.66:0/1589538698 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080012dd0 con 0x55e33d319520 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.766+0000 7f707effd640 1 -- 172.21.15.66:0/1589538698 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7080010cb0 con 0x55e33d319520 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f707effd640 1 -- 172.21.15.66:0/1589538698 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708001eba0 con 0x55e33d319520 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 -- 172.21.15.66:0/1589538698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 msgr2=0x55e33d31b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7080012850 tx=0x7f70800097c0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 -- 172.21.15.66:0/1589538698 shutdown_connections 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31b910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 --2- 172.21.15.66:0/1589538698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d30e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.767+0000 7f709cf65740 1 -- 172.21.15.66:0/1589538698 >> 172.21.15.66:0/1589538698 conn(0x55e33d2d7310 msgr2=0x55e33d30ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.770+0000 7f709cf65740 1 -- 172.21.15.66:0/1589538698 shutdown_connections 2024-09-15T22:59:52.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.770+0000 7f709cf65740 1 -- 172.21.15.66:0/1589538698 wait complete. 2024-09-15T22:59:52.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.770+0000 7f709cf65740 1 -- start start 2024-09-15T22:59:52.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.770+0000 7f709cf65740 1 Processor -- start 2024-09-15T22:59:52.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30e780 0x55e33d318e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30fcf0 0x55e33d316110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e33d31c270 con 0x55e33d30fcf0 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e33d22f060 con 0x55e33d30e780 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e33d31c3f0 con 0x55e33d319520 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.771+0000 7f709cf65740 10 client.0 _ll_register_callbacks cb 0x55e33cf828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48482/0 (socket says 172.21.15.66:48482) 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 -- 172.21.15.66:0/1524034329 learned_addr learned my addr 172.21.15.66:0/1524034329 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30e780 0x55e33d318e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7098928640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30fcf0 0x55e33d316110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 -- 172.21.15.66:0/1524034329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30e780 msgr2=0x55e33d318e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30e780 0x55e33d318e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 -- 172.21.15.66:0/1524034329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30fcf0 msgr2=0x55e33d316110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30fcf0 0x55e33d316110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.772+0000 7f7093fff640 1 -- 172.21.15.66:0/1524034329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33cfe53c0 con 0x55e33d319520 2024-09-15T22:59:52.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.774+0000 7f7093fff640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7080010b80 tx=0x7f7080014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9b5b1cd08aa7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.774+0000 7f7073fff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.774+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080024040 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.774+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f708001e980 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.774+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7080010cb0 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f7080010e60 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 10 client.27697 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55e33d338d20 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7080010cb0 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f708002a040 con 0x55e33d319520 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 10 client.27697 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 10 client.27697 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:59:52.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 20 client.27697 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d33a0d0 0x55e33d33c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 4 client.27697 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.775+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e33d281860 con 0x55e33d33a0d0 2024-09-15T22:59:52.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.776+0000 7f7098928640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d33a0d0 0x55e33d33c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.777+0000 7f7098928640 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d33a0d0 0x55e33d33c4c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b7edd0f4dcae8fad server_cookie=f64d23182b457d5d in_seq=0 out_seq=0 2024-09-15T22:59:52.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.777+0000 7f7073fff640 10 client.27697 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:59:52.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.778+0000 7f7073fff640 1 -- 172.21.15.66:0/1524034329 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e33d281860 con 0x55e33d33a0d0 2024-09-15T22:59:52.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.778+0000 7f7073fff640 10 client.27697 handle_command_reply: tid=0 2024-09-15T22:59:52.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.779+0000 7f709cf65740 1 client.27697 shutdown 2024-09-15T22:59:52.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.780+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 msgr2=0x55e33d316650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.780+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7080010b80 tx=0x7f7080014040 comp rx=0 tx=0).stop 2024-09-15T22:59:52.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 shutdown_connections 2024-09-15T22:59:52.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d33a0d0 0x55e33d33c4c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d316650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30fcf0 0x55e33d316110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 --2- 172.21.15.66:0/1524034329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30e780 0x55e33d318e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 >> 172.21.15.66:0/1524034329 conn(0x55e33d2d7310 msgr2=0x55e33d310ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.781+0000 7f7073fff640 0 client.27697 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.782+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 shutdown_connections 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.782+0000 7f709cf65740 1 -- 172.21.15.66:0/1524034329 wait complete. 2024-09-15T22:59:52.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.782+0000 7f709cf65740 20 client.27697 trim_cache size 0 max 16384 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 Processor -- start 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 -- start start 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d319520 0x55e33d311810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7078010230 con 0x55e33d30e780 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7078012070 con 0x55e33d319520 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.808+0000 7f709cf65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f70780109c0 con 0x55e33d30fcf0 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48490/0 (socket says 172.21.15.66:48490) 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 -- 172.21.15.66:0/1431736678 learned_addr learned my addr 172.21.15.66:0/1431736678 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 -- 172.21.15.66:0/1431736678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d319520 msgr2=0x55e33d311810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d319520 0x55e33d311810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 -- 172.21.15.66:0/1431736678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 msgr2=0x55e33d30afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.809+0000 7f7098928640 1 -- 172.21.15.66:0/1431736678 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33d311d50 con 0x55e33d30fcf0 2024-09-15T22:59:52.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.810+0000 7f7098928640 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f708802a900 tx=0x7f7088009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffdb2bbd1cc075dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.811+0000 7f707e7fc640 1 -- 172.21.15.66:0/1431736678 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088037040 con 0x55e33d30fcf0 2024-09-15T22:59:52.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.811+0000 7f707e7fc640 1 -- 172.21.15.66:0/1431736678 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7088041070 con 0x55e33d30fcf0 2024-09-15T22:59:52.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.811+0000 7f707e7fc640 1 -- 172.21.15.66:0/1431736678 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088005460 con 0x55e33d30fcf0 2024-09-15T22:59:52.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 -- 172.21.15.66:0/1431736678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 msgr2=0x55e33d3112d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f708802a900 tx=0x7f7088009570 comp rx=0 tx=0).stop 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 -- 172.21.15.66:0/1431736678 shutdown_connections 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d319520 0x55e33d311810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d30fcf0 0x55e33d3112d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 --2- 172.21.15.66:0/1431736678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d30afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.812+0000 7f709cf65740 1 -- 172.21.15.66:0/1431736678 >> 172.21.15.66:0/1431736678 conn(0x55e33d2d7310 msgr2=0x55e33d30a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.814+0000 7f709cf65740 1 -- 172.21.15.66:0/1431736678 shutdown_connections 2024-09-15T22:59:52.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.814+0000 7f709cf65740 1 -- 172.21.15.66:0/1431736678 wait complete. 2024-09-15T22:59:52.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.814+0000 7f709cf65740 1 -- start start 2024-09-15T22:59:52.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.815+0000 7f709cf65740 1 Processor -- start 2024-09-15T22:59:52.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d321aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70780118e0 con 0x55e33d30e780 2024-09-15T22:59:52.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7078011150 con 0x55e33d30fcf0 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f707800e230 con 0x55e33d319520 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.816+0000 7f709cf65740 10 client.0 _ll_register_callbacks cb 0x7f7080009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7093fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40862/0 (socket says 172.21.15.66:40862) 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 -- 172.21.15.66:0/2792076713 learned_addr learned my addr 172.21.15.66:0/2792076713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 -- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 msgr2=0x55e33d31d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 -- 172.21.15.66:0/2792076713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 msgr2=0x55e33d321aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d321aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.817+0000 7f7098928640 1 -- 172.21.15.66:0/2792076713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33d31d850 con 0x55e33d30fcf0 2024-09-15T22:59:52.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.818+0000 7f7098928640 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7088009250 tx=0x7f7088030f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5915e37f73bf6355 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:52.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.818+0000 7f7073fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:52.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.821+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088037040 con 0x55e33d30fcf0 2024-09-15T22:59:52.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.822+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7f7088030750 con 0x55e33d30fcf0 2024-09-15T22:59:52.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.822+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7088041070 con 0x55e33d30fcf0 2024-09-15T22:59:52.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.824+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f7088056050 con 0x55e33d30fcf0 2024-09-15T22:59:52.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.824+0000 7f709cf65740 10 client.27830 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.824+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55e33d3a4910 con 0x55e33d30fcf0 2024-09-15T22:59:52.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7088041070 con 0x55e33d30fcf0 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f7088004a70 con 0x55e33d30fcf0 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 10 client.27830 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 10 client.27830 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 20 client.27830 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d3a5060 0x55e33d3a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 4 client.27830 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e33d27bd70 con 0x55e33d3a5060 2024-09-15T22:59:52.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.825+0000 7f7093fff640 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d3a5060 0x55e33d3a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:52.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.832+0000 7f7093fff640 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d3a5060 0x55e33d3a7480 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=940ee95f6dbdb785 server_cookie=6b3cec85aca66555 in_seq=0 out_seq=0 2024-09-15T22:59:52.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.832+0000 7f7073fff640 10 client.27830 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T22:59:52.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f7073fff640 1 -- 172.21.15.66:0/2792076713 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e33d27bd70 con 0x55e33d3a5060 2024-09-15T22:59:52.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f7073fff640 10 client.27830 handle_command_reply: tid=0 2024-09-15T22:59:52.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f709cf65740 1 client.27830 shutdown 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 msgr2=0x55e33d321fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7088009250 tx=0x7f7088030f10 comp rx=0 tx=0).stop 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.835+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 shutdown_connections 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55e33d3a5060 0x55e33d3a7480 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f7073fff640 0 client.27830 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e33d319520 0x55e33d31d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e33d30fcf0 0x55e33d321fe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 --2- 172.21.15.66:0/2792076713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e33d30e780 0x55e33d321aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 >> 172.21.15.66:0/2792076713 conn(0x55e33d2d7310 msgr2=0x55e33d318190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 shutdown_connections 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.836+0000 7f709cf65740 1 -- 172.21.15.66:0/2792076713 wait complete. 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.837+0000 7f709cf65740 20 client.27830 trim_cache size 0 max 16384 2024-09-15T22:59:52.839 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 msgr2=0x7f70840a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 0x7f70840a5a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7094068040 tx=0x7f7094068300 comp rx=0 tx=0).stop 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 msgr2=0x7f708c136de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7094067960 tx=0x7f70940747f0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 shutdown_connections 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f70840a35c0 0x7f70840a5a80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f708c09a500 0x7f708c136de0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f708c006fd0 0x7f708c132a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 --2- 172.21.15.66:0/3996770973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f708c006540 0x7f708c132510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 >> 172.21.15.66:0/3996770973 conn(0x7f708c00a290 msgr2=0x7f708c091eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 shutdown_connections 2024-09-15T22:59:52.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:52.838+0000 7f709ab8c640 1 -- 172.21.15.66:0/3996770973 wait complete. 2024-09-15T22:59:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:53 smithi087 ceph-mon[35290]: pgmap v454: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 941 KiB/s wr, 125 op/s 2024-09-15T22:59:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:53 smithi184 ceph-mon[35203]: pgmap v454: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 941 KiB/s wr, 125 op/s 2024-09-15T22:59:53.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:53 smithi066 ceph-mon[31185]: pgmap v454: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 941 KiB/s wr, 125 op/s 2024-09-15T22:59:53.761 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T22:59:54.091 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:54.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.581+0000 7eff03e76640 1 -- 172.21.15.66:0/1515285368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 msgr2=0x7efefc10ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.581+0000 7eff03e76640 1 --2- 172.21.15.66:0/1515285368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc10ec50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7efef4009cd0 tx=0x7efef402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 -- 172.21.15.66:0/1515285368 shutdown_connections 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 --2- 172.21.15.66:0/1515285368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc10ec50 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 --2- 172.21.15.66:0/1515285368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc103760 0x7efefc107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 --2- 172.21.15.66:0/1515285368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc102db0 0x7efefc103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 -- 172.21.15.66:0/1515285368 >> 172.21.15.66:0/1515285368 conn(0x7efefc0fc7d0 msgr2=0x7efefc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 -- 172.21.15.66:0/1515285368 shutdown_connections 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 -- 172.21.15.66:0/1515285368 wait complete. 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.582+0000 7eff03e76640 1 Processor -- start 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 -- start start 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 0x7efefc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc103760 0x7efefc198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1120b0 con 0x7efefc1082e0 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efefc111f30 con 0x7efefc102db0 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff03e76640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112230 con 0x7efefc103760 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff01c12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 0x7efefc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45622/0 (socket says 172.21.15.66:45622) 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 -- 172.21.15.66:0/416287239 learned_addr learned my addr 172.21.15.66:0/416287239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff01c12640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 0x7efefc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40884/0 (socket says 172.21.15.66:40884) 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff01411640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc103760 0x7efefc198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 -- 172.21.15.66:0/416287239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc103760 msgr2=0x7efefc198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc103760 0x7efefc198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 -- 172.21.15.66:0/416287239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 msgr2=0x7efefc1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 0x7efefc1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.583+0000 7eff02413640 1 -- 172.21.15.66:0/416287239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc19d560 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7eff02413640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7efef4005cc0 tx=0x7efef4009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7efef2ffd640 1 -- 172.21.15.66:0/416287239 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4003e00 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7efef2ffd640 1 -- 172.21.15.66:0/416287239 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efef4004520 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc19d7f0 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7efef2ffd640 1 -- 172.21.15.66:0/416287239 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4030d60 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.584+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc100940 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.587+0000 7efef2ffd640 1 -- 172.21.15.66:0/416287239 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7efef4004040 con 0x7efefc1082e0 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 Processor -- start 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 -- start start 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5cb370 0x564ece5cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564ece5262f0 con 0x564ece5c1b40 2024-09-15T22:59:54.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564ece4cdcf0 con 0x564ece5cb370 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff0624f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564ece5222b0 con 0x564ece5c05d0 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7efef2ffd640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 0x7efee80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff01411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff01411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45628/0 (socket says 172.21.15.66:45628) 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff01411640 1 -- 172.21.15.66:0/1187373150 learned_addr learned my addr 172.21.15.66:0/1187373150 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.588+0000 7eff01c12640 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5cb370 0x564ece5cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7efef2ffd640 1 -- 172.21.15.66:0/416287239 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7efef402e030 con 0x7efefc1082e0 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 -- 172.21.15.66:0/1187373150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 msgr2=0x564ece5c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 -- 172.21.15.66:0/1187373150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5cb370 msgr2=0x564ece5cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5cb370 0x564ece5cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 -- 172.21.15.66:0/1187373150 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ece4b23a0 con 0x564ece5c1b40 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff02413640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 0x7efee80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7eff01411640 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efeec0136f0 tx=0x7efeec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8521b8253cfc7dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.589+0000 7efee7fff640 1 -- 172.21.15.66:0/1187373150 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec013c70 con 0x564ece5c1b40 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.590+0000 7efee7fff640 1 -- 172.21.15.66:0/1187373150 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeec013e10 con 0x564ece5c1b40 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.590+0000 7efee7fff640 1 -- 172.21.15.66:0/1187373150 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec0117e0 con 0x564ece5c1b40 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.590+0000 7eff0624f740 1 -- 172.21.15.66:0/1187373150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 msgr2=0x564ece5c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.590+0000 7eff0624f740 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efeec0136f0 tx=0x7efeec005f90 comp rx=0 tx=0).stop 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.590+0000 7eff02413640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 0x7efee80a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efef40bd620 tx=0x7efef40307f0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 -- 172.21.15.66:0/1187373150 shutdown_connections 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5cb370 0x564ece5cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 --2- 172.21.15.66:0/1187373150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c0090 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 -- 172.21.15.66:0/1187373150 >> 172.21.15.66:0/1187373150 conn(0x564ece589310 msgr2=0x564ece5bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 -- 172.21.15.66:0/1187373150 shutdown_connections 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 -- 172.21.15.66:0/1187373150 wait complete. 2024-09-15T22:59:54.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 -- start start 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.591+0000 7eff0624f740 1 Processor -- start 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5cb370 0x564ece5c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564ece5ce010 con 0x564ece5c1b40 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x564ece4e1060 con 0x564ece5c05d0 2024-09-15T22:59:54.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564ece5ce190 con 0x564ece5cb370 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff0624f740 10 client.0 _ll_register_callbacks cb 0x564ece2348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01c12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40906/0 (socket says 172.21.15.66:40906) 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 -- 172.21.15.66:0/3293285276 learned_addr learned my addr 172.21.15.66:0/3293285276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5cb370 0x564ece5c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 -- 172.21.15.66:0/3293285276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5cb370 msgr2=0x564ece5c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5cb370 0x564ece5c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 -- 172.21.15.66:0/3293285276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 msgr2=0x564ece5c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 -- 172.21.15.66:0/3293285276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ece2973c0 con 0x564ece5c05d0 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01c12640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:59:54.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7eff01411640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeec005f60 tx=0x7efeec01c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9866cd08a8a54779 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.592+0000 7efee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec004e00 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeec013e10 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7efeec005500 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7efeec033050 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7eff0624f740 10 client.27842 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.593+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x564ece5d9a20 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeec013e10 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7efeec011cb0 con 0x564ece5c05d0 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 10 client.27842 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:54.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 10 client.27842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 20 client.27842 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece5dadc0 0x564ece5dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 4 client.27842 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ece533860 con 0x564ece5dadc0 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.594+0000 7eff01c12640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece5dadc0 0x564ece5dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.595+0000 7efee57fa640 10 client.27842 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.595+0000 7eff01c12640 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece5dadc0 0x564ece5dd1d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dabfdcfae98dc26d server_cookie=b84e9452fca0233c in_seq=0 out_seq=0 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.602+0000 7efee57fa640 1 -- 172.21.15.66:0/3293285276 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ece533860 con 0x564ece5dadc0 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.602+0000 7efee57fa640 10 client.27842 handle_command_reply: tid=0 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.602+0000 7eff0624f740 1 client.27842 shutdown 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 msgr2=0x564ece5cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeec005f60 tx=0x7efeec01c040 comp rx=0 tx=0).stop 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 shutdown_connections 2024-09-15T22:59:54.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece5dadc0 0x564ece5dd1d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5cb370 0x564ece5c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5c1b40 0x564ece5c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 --2- 172.21.15.66:0/3293285276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5cacf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7efee57fa640 0 client.27842 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.603+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 >> 172.21.15.66:0/3293285276 conn(0x564ece589310 msgr2=0x564ece5c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.604+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 shutdown_connections 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.604+0000 7eff0624f740 1 -- 172.21.15.66:0/3293285276 wait complete. 2024-09-15T22:59:54.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.604+0000 7eff0624f740 20 client.27842 trim_cache size 0 max 16384 2024-09-15T22:59:54.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.629+0000 7eff0624f740 1 Processor -- start 2024-09-15T22:59:54.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.629+0000 7eff0624f740 1 -- start start 2024-09-15T22:59:54.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.629+0000 7eff0624f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff0624f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c1b40 0x564ece5c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff0624f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff0624f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ad150 con 0x564ece5cb370 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff0624f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1aef90 con 0x564ece5c1b40 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff0624f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ad8e0 con 0x564ece5c05d0 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45648/0 (socket says 172.21.15.66:45648) 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 -- 172.21.15.66:0/2115003091 learned_addr learned my addr 172.21.15.66:0/2115003091 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 -- 172.21.15.66:0/2115003091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 msgr2=0x564ece5d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5d72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 -- 172.21.15.66:0/2115003091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c1b40 msgr2=0x564ece5c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c1b40 0x564ece5c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.630+0000 7eff01411640 1 -- 172.21.15.66:0/2115003091 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ece5c64f0 con 0x564ece5cb370 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.631+0000 7eff01411640 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7efeec003970 tx=0x7efeec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff112f3d865289b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.631+0000 7efee77fe640 1 -- 172.21.15.66:0/2115003091 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec004cd0 con 0x564ece5cb370 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.631+0000 7efee77fe640 1 -- 172.21.15.66:0/2115003091 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeec004e70 con 0x564ece5cb370 2024-09-15T22:59:54.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.631+0000 7efee77fe640 1 -- 172.21.15.66:0/2115003091 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec013030 con 0x564ece5cb370 2024-09-15T22:59:54.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.633+0000 7eff0624f740 1 -- 172.21.15.66:0/2115003091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 msgr2=0x564ece5e2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.633+0000 7eff0624f740 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7efeec003970 tx=0x7efeec009f90 comp rx=0 tx=0).stop 2024-09-15T22:59:54.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 -- 172.21.15.66:0/2115003091 shutdown_connections 2024-09-15T22:59:54.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece5e2ae0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c1b40 0x564ece5c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 --2- 172.21.15.66:0/2115003091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c05d0 0x564ece5d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 -- 172.21.15.66:0/2115003091 >> 172.21.15.66:0/2115003091 conn(0x564ece589310 msgr2=0x564ece5c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 -- 172.21.15.66:0/2115003091 shutdown_connections 2024-09-15T22:59:54.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.635+0000 7eff0624f740 1 -- 172.21.15.66:0/2115003091 wait complete. 2024-09-15T22:59:54.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.636+0000 7eff0624f740 1 -- start start 2024-09-15T22:59:54.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.636+0000 7eff0624f740 1 Processor -- start 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c1b40 0x564ece5cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece63da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ae800 con 0x564ece5cb370 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ae070 con 0x564ece5c05d0 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ab150 con 0x564ece5c1b40 2024-09-15T22:59:54.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff0624f740 10 client.0 _ll_register_callbacks cb 0x7efeec009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:54.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff01411640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff01411640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:40910/0 (socket says 172.21.15.66:40910) 2024-09-15T22:59:54.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff01411640 1 -- 172.21.15.66:0/3761812003 learned_addr learned my addr 172.21.15.66:0/3761812003 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:54.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff01411640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece63da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.637+0000 7eff01c12640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c1b40 0x564ece5cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 -- 172.21.15.66:0/3761812003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c1b40 msgr2=0x564ece5cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c1b40 0x564ece5cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 -- 172.21.15.66:0/3761812003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 msgr2=0x564ece63da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece63da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 -- 172.21.15.66:0/3761812003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ece63e110 con 0x564ece5c05d0 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7eff01411640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efeec0136f0 tx=0x7efeec0059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd52aebf8955513e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.638+0000 7efee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec003690 con 0x564ece5c05d0 2024-09-15T22:59:54.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7efeec011bf0 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeec004e70 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7efeec048050 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7eff0624f740 10 client.27845 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.639+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x564ece645480 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.640+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeec004e70 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.640+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7efeec020420 con 0x564ece5c05d0 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.640+0000 7eff0624f740 10 client.27845 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.640+0000 7eff0624f740 10 client.27845 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.640+0000 7eff0624f740 20 client.27845 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.641+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece645b90 0x564ece647fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.641+0000 7eff0624f740 4 client.27845 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.641+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ece52dd70 con 0x564ece645b90 2024-09-15T22:59:54.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.641+0000 7eff01c12640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece645b90 0x564ece647fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.646+0000 7eff01c12640 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece645b90 0x564ece647fb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ea29acd703a45c1 server_cookie=7bba9a37c0dd0359 in_seq=0 out_seq=0 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.646+0000 7efee57fa640 10 client.27845 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.646+0000 7efee57fa640 1 -- 172.21.15.66:0/3761812003 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ece52dd70 con 0x564ece645b90 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.646+0000 7efee57fa640 10 client.27845 handle_command_reply: tid=0 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.646+0000 7eff0624f740 1 client.27845 shutdown 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 msgr2=0x564ece5ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efeec0136f0 tx=0x7efeec0059b0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 shutdown_connections 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x564ece645b90 0x564ece647fb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ece5cb370 0x564ece63da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ece5c1b40 0x564ece5cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 --2- 172.21.15.66:0/3761812003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ece5c05d0 0x564ece5ceb60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 >> 172.21.15.66:0/3761812003 conn(0x564ece589310 msgr2=0x564ece5bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7efee57fa640 0 client.27845 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 shutdown_connections 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 1 -- 172.21.15.66:0/3761812003 wait complete. 2024-09-15T22:59:54.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.647+0000 7eff0624f740 20 client.27845 trim_cache size 0 max 16384 2024-09-15T22:59:54.656 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.648+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 msgr2=0x7efee80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 0x7efee80a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efef40bd620 tx=0x7efef40307f0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 msgr2=0x7efefc19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7efef4005cc0 tx=0x7efef4009870 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 shutdown_connections 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7efee80a33b0 0x7efee80a5870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc1082e0 0x7efefc19ce80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efefc103760 0x7efefc198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 --2- 172.21.15.66:0/416287239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efefc102db0 0x7efefc1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 >> 172.21.15.66:0/416287239 conn(0x7efefc0fc7d0 msgr2=0x7efefc106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.649+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 shutdown_connections 2024-09-15T22:59:54.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:54.650+0000 7eff03e76640 1 -- 172.21.15.66:0/416287239 wait complete. 2024-09-15T22:59:55.445 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:55 smithi066 ceph-mon[31185]: pgmap v455: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-15T22:59:55.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T22:59:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:55 smithi087 ceph-mon[35290]: pgmap v455: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-15T22:59:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:55 smithi184 ceph-mon[35203]: pgmap v455: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-15T22:59:55.909 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 -- 172.21.15.66:0/3321891269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641036e0 msgr2=0x7fe764107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 --2- 172.21.15.66:0/3321891269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641036e0 0x7fe764107b90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe750009930 tx=0x7fe75002a420 comp rx=0 tx=0).stop 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 -- 172.21.15.66:0/3321891269 shutdown_connections 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 --2- 172.21.15.66:0/3321891269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641082a0 0x7fe76410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 --2- 172.21.15.66:0/3321891269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641036e0 0x7fe764107b90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 --2- 172.21.15.66:0/3321891269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 0x7fe764103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 -- 172.21.15.66:0/3321891269 >> 172.21.15.66:0/3321891269 conn(0x7fe7640fc7d0 msgr2=0x7fe7640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 -- 172.21.15.66:0/3321891269 shutdown_connections 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 -- 172.21.15.66:0/3321891269 wait complete. 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.415+0000 7fe76af26640 1 Processor -- start 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 -- start start 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 0x7fe764198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641082a0 0x7fe76419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641120a0 con 0x7fe7641082a0 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe764111f20 con 0x7fe764102d30 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe76af26640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe764112220 con 0x7fe7641036e0 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe7694c3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641082a0 0x7fe76419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe768cc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 0x7fe764198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48568/0 (socket says 172.21.15.66:48568) 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 -- 172.21.15.66:0/3264019750 learned_addr learned my addr 172.21.15.66:0/3264019750 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 -- 172.21.15.66:0/3264019750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 msgr2=0x7fe764198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 0x7fe764198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 -- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641082a0 msgr2=0x7fe76419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641082a0 0x7fe76419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.416+0000 7fe763fff640 1 -- 172.21.15.66:0/3264019750 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76419d5f0 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe763fff640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe750005940 tx=0x7fe750031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe761ffb640 1 -- 172.21.15.66:0/3264019750 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75003f030 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76419d880 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe761ffb640 1 -- 172.21.15.66:0/3264019750 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7500043d0 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe761ffb640 1 -- 172.21.15.66:0/3264019750 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750035070 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.417+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641a51c0 con 0x7fe7641036e0 2024-09-15T22:59:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.420+0000 7fe761ffb640 1 -- 172.21.15.66:0/3264019750 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe750042030 con 0x7fe7641036e0 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.420+0000 7fe761ffb640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 0x7fe7540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.420+0000 7fe761ffb640 1 -- 172.21.15.66:0/3264019750 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fe7500f03d0 con 0x7fe7641036e0 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.420+0000 7fe768cc2640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 0x7fe7540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe768cc2640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 0x7fe7540a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe758009bd0 tx=0x7fe758005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 Processor -- start 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 -- start start 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188a5d0 0x55a51188aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511897760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5117f02f0 con 0x55a51188bb40 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a511797cf0 con 0x55a51188a5d0 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a5117ec2b0 con 0x55a511895370 2024-09-15T22:59:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.421+0000 7fe768cc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45690/0 (socket says 172.21.15.66:45690) 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 -- 172.21.15.66:0/923318514 learned_addr learned my addr 172.21.15.66:0/923318514 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe7694c3640 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511897760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 -- 172.21.15.66:0/923318514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 msgr2=0x55a511897760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511897760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 -- 172.21.15.66:0/923318514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188a5d0 msgr2=0x55a51188aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188a5d0 0x55a51188aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 -- 172.21.15.66:0/923318514 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51177c3a0 con 0x55a51188bb40 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe768cc2640 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e630 tx=0x7fe758014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf4bf5d52ae950b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe74effd640 1 -- 172.21.15.66:0/923318514 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758004020 con 0x55a51188bb40 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe74effd640 1 -- 172.21.15.66:0/923318514 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7580041c0 con 0x55a51188bb40 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.422+0000 7fe74effd640 1 -- 172.21.15.66:0/923318514 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75801c720 con 0x55a51188bb40 2024-09-15T22:59:56.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 -- 172.21.15.66:0/923318514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 msgr2=0x55a51188a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e630 tx=0x7fe758014000 comp rx=0 tx=0).stop 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 -- 172.21.15.66:0/923318514 shutdown_connections 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511897760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188a5d0 0x55a51188aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/923318514 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a51188a090 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.423+0000 7fe76d2ff740 1 -- 172.21.15.66:0/923318514 >> 172.21.15.66:0/923318514 conn(0x55a511853310 msgr2=0x55a511886c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.424+0000 7fe76d2ff740 1 -- 172.21.15.66:0/923318514 shutdown_connections 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.424+0000 7fe76d2ff740 1 -- 172.21.15.66:0/923318514 wait complete. 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.424+0000 7fe76d2ff740 1 -- start start 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.424+0000 7fe76d2ff740 1 Processor -- start 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511892850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a511898070 con 0x55a51188a5d0 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a5117ab060 con 0x55a51188bb40 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a5118981f0 con 0x55a511895370 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45700/0 (socket says 172.21.15.66:45700) 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 -- 172.21.15.66:0/2083858102 learned_addr learned my addr 172.21.15.66:0/2083858102 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe76d2ff740 10 client.0 _ll_register_callbacks cb 0x55a5114fe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe7694c3640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511892850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe763fff640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 -- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 msgr2=0x55a511892850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511892850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 -- 172.21.15.66:0/2083858102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 msgr2=0x55a5118920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118920c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.425+0000 7fe768cc2640 1 -- 172.21.15.66:0/2083858102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5115613c0 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe768cc2640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fe75800a010 tx=0x7fe7580040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9a01a953610625 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe743fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758035060 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fe75801c480 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7580041c0 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fe75803c050 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe76d2ff740 10 client.18555 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.426+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55a5118a3ba0 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7580041c0 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fe7580039f0 con 0x55a51188a5d0 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 10 client.18555 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 10 client.18555 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:59:56.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 20 client.18555 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a5118a53c0 0x55a5118a7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 4 client.18555 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5117fd860 con 0x55a5118a53c0 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe763fff640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a5118a53c0 0x55a5118a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe743fff640 10 client.18555 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.428+0000 7fe763fff640 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a5118a53c0 0x55a5118a7840 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=244e16bf74373a65 server_cookie=b82c755a7cea05c4 in_seq=0 out_seq=0 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe743fff640 1 -- 172.21.15.66:0/2083858102 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5117fd860 con 0x55a5118a53c0 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe743fff640 10 client.18555 handle_command_reply: tid=0 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 client.18555 shutdown 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 msgr2=0x55a511894e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fe75800a010 tx=0x7fe7580040d0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 shutdown_connections 2024-09-15T22:59:56.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a5118a53c0 0x55a5118a7840 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe743fff640 0 client.18555 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a511892850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118920c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/2083858102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188a5d0 0x55a511894e10 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.429+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 >> 172.21.15.66:0/2083858102 conn(0x55a511853310 msgr2=0x55a51188c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.430+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 shutdown_connections 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.430+0000 7fe76d2ff740 1 -- 172.21.15.66:0/2083858102 wait complete. 2024-09-15T22:59:56.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.430+0000 7fe76d2ff740 20 client.18555 trim_cache size 0 max 16384 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 Processor -- start 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 -- start start 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe763fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe763fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45708/0 (socket says 172.21.15.66:45708) 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe763fff640 1 -- 172.21.15.66:0/3938128468 learned_addr learned my addr 172.21.15.66:0/3938128468 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 0x55a5118ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ad280 con 0x55a511895370 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641af0c0 con 0x55a51188bb40 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ada10 con 0x55a511886a50 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.446+0000 7fe768cc2640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe7694c3640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 0x55a5118ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 -- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 msgr2=0x55a5118ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 0x55a5118ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 -- 172.21.15.66:0/3938128468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 msgr2=0x55a5118911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 -- 172.21.15.66:0/3938128468 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51188b740 con 0x55a511895370 2024-09-15T22:59:56.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe7694c3640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 0x55a5118ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe763fff640 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe750000c00 tx=0x7fe750004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad7ba11669483cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe74e7fc640 1 -- 172.21.15.66:0/3938128468 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750049040 con 0x55a511895370 2024-09-15T22:59:56.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe74e7fc640 1 -- 172.21.15.66:0/3938128468 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7500b6e50 con 0x55a511895370 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.447+0000 7fe74e7fc640 1 -- 172.21.15.66:0/3938128468 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b8950 con 0x55a511895370 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.448+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 msgr2=0x55a511886510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.448+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe750000c00 tx=0x7fe750004610 comp rx=0 tx=0).stop 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 shutdown_connections 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511886a50 0x55a5118ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a511895370 0x55a511886510 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/3938128468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a51188bb40 0x55a5118911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 >> 172.21.15.66:0/3938128468 conn(0x55a511853310 msgr2=0x55a511891950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 shutdown_connections 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 -- 172.21.15.66:0/3938128468 wait complete. 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 -- start start 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.449+0000 7fe76d2ff740 1 Processor -- start 2024-09-15T22:59:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a511886a50 0x55a51189db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a5118993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ae930 con 0x55a51188bb40 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ae1a0 con 0x55a511886a50 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641ab280 con 0x55a511895370 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45714/0 (socket says 172.21.15.66:45714) 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 -- 172.21.15.66:0/1330012527 learned_addr learned my addr 172.21.15.66:0/1330012527 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe76d2ff740 10 client.0 _ll_register_callbacks cb 0x7fe75c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe768cc2640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a511886a50 0x55a51189db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe7694c3640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a5118993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 -- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 msgr2=0x55a5118993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a5118993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 -- 172.21.15.66:0/1330012527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a511886a50 msgr2=0x55a51189db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a511886a50 0x55a51189db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.450+0000 7fe763fff640 1 -- 172.21.15.66:0/1330012527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a511899bc0 con 0x55a51188bb40 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe763fff640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fe75003b510 tx=0x7fe7500c06a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c2c680d5e6499 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe743fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500d9070 con 0x55a51188bb40 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7500b6e50 con 0x55a51188bb40 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9679+0+0 (secure 0 0 0) 0x7fe7500ed920 con 0x55a51188bb40 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.451+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fe7500a0050 con 0x55a51188bb40 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.452+0000 7fe76d2ff740 10 client.18561 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.452+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55a511918850 con 0x55a51188bb40 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.453+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7500b8950 con 0x55a51188bb40 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fe7500c0170 con 0x55a51188bb40 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 10 client.18561 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 10 client.18561 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 20 client.18561 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a511918d30 0x55a51191b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:56.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 4 client.18561 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:56.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe7500b6e50 con 0x55a511918d30 2024-09-15T22:59:56.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.455+0000 7fe768cc2640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a511918d30 0x55a51191b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.456+0000 7fe768cc2640 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a511918d30 0x55a51191b150 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb1bd87835d5bdfc server_cookie=5e421b6313213c8c in_seq=0 out_seq=0 2024-09-15T22:59:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.457+0000 7fe743fff640 10 client.18561 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.457+0000 7fe743fff640 1 -- 172.21.15.66:0/1330012527 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe7500b6e50 con 0x55a511918d30 2024-09-15T22:59:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.457+0000 7fe743fff640 10 client.18561 handle_command_reply: tid=0 2024-09-15T22:59:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.457+0000 7fe76d2ff740 1 client.18561 shutdown 2024-09-15T22:59:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.461+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 msgr2=0x55a511898ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.461+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fe75003b510 tx=0x7fe7500c06a0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 shutdown_connections 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55a511918d30 0x55a51191b150 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a511895370 0x55a5118993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a51188bb40 0x55a511898ea0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe743fff640 0 client.18561 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 --2- 172.21.15.66:0/1330012527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a511886a50 0x55a51189db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.462+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 >> 172.21.15.66:0/1330012527 conn(0x55a511853310 msgr2=0x55a5118911b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.464+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 shutdown_connections 2024-09-15T22:59:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.464+0000 7fe76d2ff740 1 -- 172.21.15.66:0/1330012527 wait complete. 2024-09-15T22:59:56.466 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:56.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.465+0000 7fe76d2ff740 20 client.18561 trim_cache size 0 max 16384 2024-09-15T22:59:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 msgr2=0x7fe7540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 0x7fe7540a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe758009bd0 tx=0x7fe758005f90 comp rx=0 tx=0).stop 2024-09-15T22:59:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 msgr2=0x7fe764198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe750005940 tx=0x7fe750031b50 comp rx=0 tx=0).stop 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 shutdown_connections 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe7540a33b0 0x7fe7540a5870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7641082a0 0x7fe76419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641036e0 0x7fe764198b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 --2- 172.21.15.66:0/3264019750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe764102d30 0x7fe764198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 >> 172.21.15.66:0/3264019750 conn(0x7fe7640fc7d0 msgr2=0x7fe764106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 shutdown_connections 2024-09-15T22:59:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:56.466+0000 7fe76af26640 1 -- 172.21.15.66:0/3264019750 wait complete. 2024-09-15T22:59:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:57 smithi087 ceph-mon[35290]: pgmap v456: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-15T22:59:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:57 smithi184 ceph-mon[35203]: pgmap v456: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-15T22:59:57.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:57 smithi066 ceph-mon[31185]: pgmap v456: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 206 op/s 2024-09-15T22:59:58.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:59:59.002 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:59:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:59 smithi066 ceph-mon[31185]: pgmap v457: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2024-09-15T22:59:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 22:59:59 smithi066 ceph-mon[31185]: osdmap e107: 12 total, 12 up, 12 in 2024-09-15T22:59:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:59 smithi087 ceph-mon[35290]: pgmap v457: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2024-09-15T22:59:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 22:59:59 smithi087 ceph-mon[35290]: osdmap e107: 12 total, 12 up, 12 in 2024-09-15T22:59:59.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 -- 172.21.15.66:0/3065240726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44100130 msgr2=0x7f0d44100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 --2- 172.21.15.66:0/3065240726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44100130 0x7f0d44100510 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009930 tx=0x7f0d3402a420 comp rx=0 tx=0).stop 2024-09-15T22:59:59.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 -- 172.21.15.66:0/3065240726 shutdown_connections 2024-09-15T22:59:59.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 --2- 172.21.15.66:0/3065240726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44106ea0 0x7f0d4410ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 --2- 172.21.15.66:0/3065240726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d44106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 --2- 172.21.15.66:0/3065240726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44100130 0x7f0d44100510 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.601+0000 7f0d49092640 1 -- 172.21.15.66:0/3065240726 >> 172.21.15.66:0/3065240726 conn(0x7f0d44077010 msgr2=0x7f0d440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.606+0000 7f0d49092640 1 -- 172.21.15.66:0/3065240726 shutdown_connections 2024-09-15T22:59:59.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.606+0000 7f0d49092640 1 -- 172.21.15.66:0/3065240726 wait complete. 2024-09-15T22:59:59.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.607+0000 7f0d49092640 1 Processor -- start 2024-09-15T22:59:59.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.607+0000 7f0d49092640 1 -- start start 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44100130 0x7f0d4410f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d4410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44114140 con 0x7f0d44106ea0 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44113fc0 con 0x7f0d44100130 2024-09-15T22:59:59.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.608+0000 7f0d49092640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d441142c0 con 0x7f0d44100ae0 2024-09-15T22:59:59.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.611+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44100130 0x7f0d4410f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.611+0000 7f0d48891640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.611+0000 7f0d48891640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45726/0 (socket says 172.21.15.66:45726) 2024-09-15T22:59:59.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.611+0000 7f0d48891640 1 -- 172.21.15.66:0/231394804 learned_addr learned my addr 172.21.15.66:0/231394804 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:59.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.611+0000 7f0d437fe640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d4410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 -- 172.21.15.66:0/231394804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 msgr2=0x7f0d4410f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d4410f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 -- 172.21.15.66:0/231394804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44100130 msgr2=0x7f0d4410f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44100130 0x7f0d4410f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 -- 172.21.15.66:0/231394804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4419a3c0 con 0x7f0d44106ea0 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d437fe640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d4410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.612+0000 7f0d48891640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00eb10 tx=0x7f0d3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.613+0000 7f0d417fa640 1 -- 172.21.15.66:0/231394804 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c004b20 con 0x7f0d44106ea0 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.613+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4419a6b0 con 0x7f0d44106ea0 2024-09-15T22:59:59.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.613+0000 7f0d417fa640 1 -- 172.21.15.66:0/231394804 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3c004cc0 con 0x7f0d44106ea0 2024-09-15T22:59:59.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.613+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4419abf0 con 0x7f0d44106ea0 2024-09-15T22:59:59.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.614+0000 7f0d417fa640 1 -- 172.21.15.66:0/231394804 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c004b20 con 0x7f0d44106ea0 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.617+0000 7f0d4c6cd740 1 Processor -- start 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.618+0000 7f0d417fa640 1 -- 172.21.15.66:0/231394804 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0d3c005000 con 0x7f0d44106ea0 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.618+0000 7f0d4c6cd740 1 -- start start 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e6ff6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e7014950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b7e6f5c2f0 con 0x55b7e6ff67b0 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b7e6f03cf0 con 0x55b7e7012560 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b7e6f582b0 con 0x55b7e6ff7d20 2024-09-15T22:59:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.619+0000 7f0d417fa640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 0x7f0d2c0a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.620+0000 7f0d417fa640 1 -- 172.21.15.66:0/231394804 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f0d3c00cce0 con 0x7f0d44106ea0 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.621+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.621+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e6ff6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.621+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45736/0 (socket says 172.21.15.66:45736) 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.621+0000 7f0d43fff640 1 -- 172.21.15.66:0/2007338518 learned_addr learned my addr 172.21.15.66:0/2007338518 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.621+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e7014950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d43fff640 1 -- 172.21.15.66:0/2007338518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 msgr2=0x55b7e6ff6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e6ff6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d43fff640 1 -- 172.21.15.66:0/2007338518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 msgr2=0x55b7e7014950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e7014950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d43fff640 1 -- 172.21.15.66:0/2007338518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7e6ee83a0 con 0x55b7e6ff67b0 2024-09-15T22:59:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.623+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e6ff6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:59:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.624+0000 7f0d48891640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 0x7f0d2c0a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.625+0000 7f0d48891640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 0x7f0d2c0a5d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ae0 tx=0x7f0d3c009a70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.626+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311551a498f17cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.627+0000 7f0d2a7fc640 1 -- 172.21.15.66:0/2007338518 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035030 con 0x55b7e6ff67b0 2024-09-15T22:59:59.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.627+0000 7f0d2a7fc640 1 -- 172.21.15.66:0/2007338518 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d34005520 con 0x55b7e6ff67b0 2024-09-15T22:59:59.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.627+0000 7f0d2a7fc640 1 -- 172.21.15.66:0/2007338518 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004e40 con 0x55b7e6ff67b0 2024-09-15T22:59:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2007338518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 msgr2=0x55b7e6ff6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34031500 comp rx=0 tx=0).stop 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2007338518 shutdown_connections 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e7014950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff67b0 0x55b7e6ff6bf0 secure :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34031500 comp rx=0 tx=0).stop 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2007338518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e6ff6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2007338518 >> 172.21.15.66:0/2007338518 conn(0x55b7e6fbf310 msgr2=0x55b7e6ff2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.628+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2007338518 shutdown_connections 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.629+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2007338518 wait complete. 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.629+0000 7f0d4c6cd740 1 -- start start 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.629+0000 7f0d4c6cd740 1 Processor -- start 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e701e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b7e7015200 con 0x55b7e6ff7d20 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b7e6f17060 con 0x55b7e7012560 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b7e7015380 con 0x55b7e700ff20 2024-09-15T22:59:59.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d4c6cd740 10 client.0 _ll_register_callbacks cb 0x55b7e6c6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45746/0 (socket says 172.21.15.66:45746) 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d437fe640 1 -- 172.21.15.66:0/2296553374 learned_addr learned my addr 172.21.15.66:0/2296553374 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.630+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e701e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 -- 172.21.15.66:0/2296553374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 msgr2=0x55b7e701e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e701e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 -- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 msgr2=0x55b7e700f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 -- 172.21.15.66:0/2296553374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7e6ccd3c0 con 0x55b7e6ff7d20 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406a100 tx=0x7f0d380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3a091af9724425 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d237fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:59.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38012e00 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d34005520 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.631+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f0d38004020 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0d38029050 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 10 client.18573 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b7e7021360 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d34005520 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f0d380035f0 con 0x55b7e6ff7d20 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 10 client.18573 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 10 client.18573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 20 client.18573 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e7022c10 0x55b7e7025090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 4 client.18573 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.632+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7e6f69860 con 0x55b7e7022c10 2024-09-15T22:59:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.633+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e7022c10 0x55b7e7025090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.634+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e7022c10 0x55b7e7025090 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0525342386a2cd7 server_cookie=9a4c35a4197d18de in_seq=0 out_seq=0 2024-09-15T22:59:59.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.634+0000 7f0d237fe640 10 client.18573 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:59.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.638+0000 7f0d237fe640 1 -- 172.21.15.66:0/2296553374 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7e6f69860 con 0x55b7e7022c10 2024-09-15T22:59:59.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.638+0000 7f0d237fe640 10 client.18573 handle_command_reply: tid=0 2024-09-15T22:59:59.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.638+0000 7f0d4c6cd740 1 client.18573 shutdown 2024-09-15T22:59:59.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.640+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 msgr2=0x55b7e700f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.640+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0d4406a100 tx=0x7f0d380046c0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 shutdown_connections 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e701e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e7022c10 0x55b7e7025090 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2296553374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e700f4a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 >> 172.21.15.66:0/2296553374 conn(0x55b7e6fbf310 msgr2=0x55b7e6ff8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.641+0000 7f0d237fe640 0 client.18573 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.642+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 shutdown_connections 2024-09-15T22:59:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.642+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2296553374 wait complete. 2024-09-15T22:59:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.642+0000 7f0d4c6cd740 20 client.18573 trim_cache size 0 max 16384 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.667+0000 7f0d4c6cd740 1 Processor -- start 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.667+0000 7f0d4c6cd740 1 -- start start 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e700a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406df90 con 0x55b7e6ff7d20 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406fdd0 con 0x55b7e7012560 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d4c6cd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406e720 con 0x55b7e700ff20 2024-09-15T22:59:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45748/0 (socket says 172.21.15.66:45748) 2024-09-15T22:59:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d437fe640 1 -- 172.21.15.66:0/3266078103 learned_addr learned my addr 172.21.15.66:0/3266078103 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.668+0000 7f0d437fe640 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d43fff640 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e700a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 -- 172.21.15.66:0/3266078103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 msgr2=0x55b7e700a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e700a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 -- 172.21.15.66:0/3266078103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 msgr2=0x55b7e700aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 -- 172.21.15.66:0/3266078103 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7e7015370 con 0x55b7e6ff7d20 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d437fe640 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0d38014b20 tx=0x7f0d38009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8b465d6f46eebb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d29ffb640 1 -- 172.21.15.66:0/3266078103 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38033070 con 0x55b7e6ff7d20 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d29ffb640 1 -- 172.21.15.66:0/3266078103 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d38012e00 con 0x55b7e6ff7d20 2024-09-15T22:59:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.669+0000 7f0d29ffb640 1 -- 172.21.15.66:0/3266078103 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38004990 con 0x55b7e6ff7d20 2024-09-15T22:59:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:59 smithi184 ceph-mon[35203]: pgmap v457: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2024-09-15T22:59:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 22:59:59 smithi184 ceph-mon[35203]: osdmap e107: 12 total, 12 up, 12 in 2024-09-15T22:59:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.670+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/3266078103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 msgr2=0x55b7e701e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.670+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0d38014b20 tx=0x7f0d38009720 comp rx=0 tx=0).stop 2024-09-15T22:59:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.672+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/3266078103 shutdown_connections 2024-09-15T22:59:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.672+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.672+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e700ff20 0x55b7e700a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.672+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/3266078103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e6ff7d20 0x55b7e701e4a0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.672+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/3266078103 >> 172.21.15.66:0/3266078103 conn(0x55b7e6fbf310 msgr2=0x55b7e6ff2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.675+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/3266078103 shutdown_connections 2024-09-15T22:59:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.675+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/3266078103 wait complete. 2024-09-15T22:59:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.676+0000 7f0d4c6cd740 1 -- start start 2024-09-15T22:59:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.676+0000 7f0d4c6cd740 1 Processor -- start 2024-09-15T22:59:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.677+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e701a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.677+0000 7f0d4c6cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.677+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.677+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45762/0 (socket says 172.21.15.66:45762) 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d43fff640 1 -- 172.21.15.66:0/2286301185 learned_addr learned my addr 172.21.15.66:0/2286301185 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406f640 con 0x55b7e700ff20 2024-09-15T22:59:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406eeb0 con 0x55b7e7012560 2024-09-15T22:59:59.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4406bf70 con 0x55b7e6ff7d20 2024-09-15T22:59:59.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d4c6cd740 10 client.0 _ll_register_callbacks cb 0x7f0d38014be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:59:59.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d43fff640 1 -- 172.21.15.66:0/2286301185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 msgr2=0x55b7e701a610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:59:59.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e701a610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d43fff640 1 -- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 msgr2=0x55b7e700c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:59:59.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.678+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.679+0000 7f0d43fff640 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7e700cca0 con 0x55b7e700ff20 2024-09-15T22:59:59.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.679+0000 7f0d43fff640 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ae91b27104c8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:59:59.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.680+0000 7f0d237fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.680+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34055020 con 0x55b7e700ff20 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.680+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f0d34005040 con 0x55b7e700ff20 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.680+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d38012e00 con 0x55b7e700ff20 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.681+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0d340044d0 con 0x55b7e700ff20 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.681+0000 7f0d4c6cd740 10 client.18579 fetch_fsmap learned FSMap version 63 2024-09-15T22:59:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.681+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55b7e7013170 con 0x55b7e700ff20 2024-09-15T22:59:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d38012e00 con 0x55b7e700ff20 2024-09-15T22:59:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f0d34050440 con 0x55b7e700ff20 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 10 client.18579 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 10 client.18579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 20 client.18579 populate_metadata read hostname 'smithi066' 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e70134b0 0x55b7e708f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 4 client.18579 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.682+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7e6f63d70 con 0x55b7e70134b0 2024-09-15T22:59:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.683+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e70134b0 0x55b7e708f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:59:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.684+0000 7f0d437fe640 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e70134b0 0x55b7e708f980 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12c26e10eabc716 server_cookie=cc6ac22db83ccbd2 in_seq=0 out_seq=0 2024-09-15T22:59:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.684+0000 7f0d237fe640 10 client.18579 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.686+0000 7f0d237fe640 1 -- 172.21.15.66:0/2286301185 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7e6f63d70 con 0x55b7e70134b0 2024-09-15T22:59:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.686+0000 7f0d237fe640 10 client.18579 handle_command_reply: tid=0 2024-09-15T22:59:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.687+0000 7f0d4c6cd740 1 client.18579 shutdown 2024-09-15T22:59:59.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.690+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 msgr2=0x55b7e701ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.690+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d34005d50 comp rx=0 tx=0).stop 2024-09-15T22:59:59.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 shutdown_connections 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b7e70134b0 0x55b7e708f980 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7e7012560 0x55b7e700c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7e700ff20 0x55b7e701ab50 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 --2- 172.21.15.66:0/2286301185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b7e6ff7d20 0x55b7e701a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 >> 172.21.15.66:0/2286301185 conn(0x55b7e6fbf310 msgr2=0x55b7e700a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.691+0000 7f0d237fe640 0 client.18579 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T22:59:59.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.694+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 shutdown_connections 2024-09-15T22:59:59.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.694+0000 7f0d4c6cd740 1 -- 172.21.15.66:0/2286301185 wait complete. 2024-09-15T22:59:59.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.695+0000 7f0d4c6cd740 20 client.18579 trim_cache size 0 max 16384 2024-09-15T22:59:59.697 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T22:59:59.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 msgr2=0x7f0d2c0a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 0x7f0d2c0a5d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ae0 tx=0x7f0d3c009a70 comp rx=0 tx=0).stop 2024-09-15T22:59:59.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 msgr2=0x7f0d4410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:59:59.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00eb10 tx=0x7f0d3c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 shutdown_connections 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0d2c0a3870 0x7f0d2c0a5d30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d44106ea0 0x7f0d4410fe20 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d44100ae0 0x7f0d4410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 --2- 172.21.15.66:0/231394804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d44100130 0x7f0d4410f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:59:59.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.697+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 >> 172.21.15.66:0/231394804 conn(0x7f0d44077010 msgr2=0x7f0d440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:59:59.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.698+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 shutdown_connections 2024-09-15T22:59:59.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T22:59:59.701+0000 7f0d49092640 1 -- 172.21.15.66:0/231394804 wait complete. 2024-09-15T23:00:00.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:00 smithi184 ceph-mon[35203]: overall HEALTH_OK 2024-09-15T23:00:00.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:00 smithi066 ceph-mon[31185]: overall HEALTH_OK 2024-09-15T23:00:00.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:00 smithi087 ceph-mon[35290]: overall HEALTH_OK 2024-09-15T23:00:01.573 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:00:01.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:00:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:01 smithi184 ceph-mon[35203]: pgmap v459: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 244 op/s 2024-09-15T23:00:01.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:01 smithi066 ceph-mon[31185]: pgmap v459: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 244 op/s 2024-09-15T23:00:01.832 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:01.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:01 smithi087 ceph-mon[35290]: pgmap v459: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 244 op/s 2024-09-15T23:00:03.295 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.5 2024-09-15T23:00:03.296 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:00:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:03 smithi184 ceph-mon[35203]: pgmap v460: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-15T23:00:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:03 smithi066 ceph-mon[31185]: pgmap v460: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-15T23:00:03.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:03 smithi087 ceph-mon[35290]: pgmap v460: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 258 op/s 2024-09-15T23:00:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 -- 172.21.15.66:0/2997382283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 msgr2=0x7f278010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 --2- 172.21.15.66:0/2997382283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f278010da40 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2778009ca0 tx=0x7f277802a950 comp rx=0 tx=0).stop 2024-09-15T23:00:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 -- 172.21.15.66:0/2997382283 shutdown_connections 2024-09-15T23:00:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 --2- 172.21.15.66:0/2997382283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f278010da40 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 --2- 172.21.15.66:0/2997382283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 0x7f27801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 --2- 172.21.15.66:0/2997382283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f2780101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 -- 172.21.15.66:0/2997382283 >> 172.21.15.66:0/2997382283 conn(0x7f27800fc7d0 msgr2=0x7f27800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 -- 172.21.15.66:0/2997382283 shutdown_connections 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.414+0000 7f2784b6d640 1 -- 172.21.15.66:0/2997382283 wait complete. 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.415+0000 7f2784b6d640 1 Processor -- start 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.415+0000 7f2784b6d640 1 -- start start 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f27801992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 0x7f2780199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2780110f80 con 0x7f2780102ef0 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2780110e00 con 0x7f2780100e20 2024-09-15T23:00:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f2784b6d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2780111100 con 0x7f2780102570 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54632/0 (socket says 172.21.15.66:54632) 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 -- 172.21.15.66:0/3528437371 learned_addr learned my addr 172.21.15.66:0/3528437371 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277e59c640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f27801992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277dd9b640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 0x7f2780199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 -- 172.21.15.66:0/3528437371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 msgr2=0x7f2780199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 0x7f2780199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 -- 172.21.15.66:0/3528437371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 msgr2=0x7f27801992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f27801992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 -- 172.21.15.66:0/3528437371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27801a4880 con 0x7f2780102ef0 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277e59c640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f27801992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.416+0000 7f277ed9d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f277802ae70 tx=0x7f277802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.417+0000 7f276f7fe640 1 -- 172.21.15.66:0/3528437371 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778034040 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.417+0000 7f276f7fe640 1 -- 172.21.15.66:0/3528437371 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2778030920 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.417+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27801a4a50 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.417+0000 7f276f7fe640 1 -- 172.21.15.66:0/3528437371 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778045480 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.417+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27801a4f00 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.419+0000 7f276f7fe640 1 -- 172.21.15.66:0/3528437371 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2778037020 con 0x7f2780102ef0 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 Processor -- start 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 -- start start 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38f4b60 0x5647c38f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38ffd40 0x5647c3902130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5647c385a280 con 0x5647c38f5480 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5647c3801b10 con 0x5647c38f4b60 2024-09-15T23:00:03.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f2786f46740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5647c3856240 con 0x5647c38ffd40 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54642/0 (socket says 172.21.15.66:54642) 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f277e59c640 1 -- 172.21.15.66:0/2835005827 learned_addr learned my addr 172.21.15.66:0/2835005827 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.420+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38ffd40 0x5647c3902130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38f4b60 0x5647c38f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f276f7fe640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 0x7f27680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 -- 172.21.15.66:0/2835005827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38ffd40 msgr2=0x5647c3902130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38ffd40 0x5647c3902130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 -- 172.21.15.66:0/2835005827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38f4b60 msgr2=0x5647c38f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38f4b60 0x5647c38f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 -- 172.21.15.66:0/2835005827 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c380e1f0 con 0x5647c38f5480 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277ed9d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 0x7f27680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f277e59c640 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f27700104d0 tx=0x7f2770010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550ee92eb7a3d26f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f276f7fe640 1 -- 172.21.15.66:0/3528437371 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f27780f0ec0 con 0x7f2780102ef0 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f276cff9640 1 -- 172.21.15.66:0/2835005827 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770011760 con 0x5647c38f5480 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f276cff9640 1 -- 172.21.15.66:0/2835005827 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2770011de0 con 0x5647c38f5480 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.421+0000 7f276cff9640 1 -- 172.21.15.66:0/2835005827 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277000e430 con 0x5647c38f5480 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 -- 172.21.15.66:0/2835005827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 msgr2=0x5647c38ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f277ed9d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 0x7f27680a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f27780b8af0 tx=0x7f2778087ca0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f27700104d0 tx=0x7f2770010990 comp rx=0 tx=0).stop 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 -- 172.21.15.66:0/2835005827 shutdown_connections 2024-09-15T23:00:03.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38ffd40 0x5647c3902130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38ff800 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 --2- 172.21.15.66:0/2835005827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38f4b60 0x5647c38f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 -- 172.21.15.66:0/2835005827 >> 172.21.15.66:0/2835005827 conn(0x5647c38f10f0 msgr2=0x5647c38f14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 -- 172.21.15.66:0/2835005827 shutdown_connections 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.422+0000 7f2786f46740 1 -- 172.21.15.66:0/2835005827 wait complete. 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 -- start start 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 Processor -- start 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c38fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5647c3902910 con 0x5647c38f5480 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5647c3814f10 con 0x5647c38ffd40 2024-09-15T23:00:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5647c3902a90 con 0x5647c38f4b60 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f2786f46740 10 client.0 _ll_register_callbacks cb 0x5647c37dda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54646/0 (socket says 172.21.15.66:54646) 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.423+0000 7f277e59c640 1 -- 172.21.15.66:0/98557419 learned_addr learned my addr 172.21.15.66:0/98557419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277dd9b640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277dd9b640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c38fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 -- 172.21.15.66:0/98557419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 msgr2=0x5647c38fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c38fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 -- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 msgr2=0x5647c38fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 -- 172.21.15.66:0/98557419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c35cb6a0 con 0x5647c38f5480 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277dd9b640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c38fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:00:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f277e59c640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f277000bcd0 tx=0x7f277001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33914f9ac3be0c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277002c060 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f2770005240 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2770011de0 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f2770005440 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2786f46740 10 client.18591 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.424+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5647c390e520 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2770011de0 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f2770004930 con 0x5647c38f5480 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 10 client.18591 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 10 client.18591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 20 client.18591 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c3911d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 4 client.18591 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647c38677f0 con 0x5647c390f980 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.425+0000 7f277dd9b640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c3911d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.426+0000 7f277dd9b640 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c3911d70 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ca321396128b835 server_cookie=e19b54383302b9bd in_seq=0 out_seq=0 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.426+0000 7f2765ffb640 10 client.18591 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2765ffb640 1 -- 172.21.15.66:0/98557419 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647c38677f0 con 0x5647c390f980 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2765ffb640 10 client.18591 handle_command_reply: tid=0 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 client.18591 shutdown 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 msgr2=0x5647c38fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f277000bcd0 tx=0x7f277001c6b0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 shutdown_connections 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c3911d70 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2765ffb640 0 client.18591 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38fd140 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 --2- 172.21.15.66:0/98557419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c38fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 >> 172.21.15.66:0/98557419 conn(0x5647c38f10f0 msgr2=0x5647c38f0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 shutdown_connections 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 1 -- 172.21.15.66:0/98557419 wait complete. 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.427+0000 7f2786f46740 20 client.18591 trim_cache size 0 max 16384 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 Processor -- start 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 -- start start 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f5480 0x5647c3917a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38efa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27801af230 con 0x5647c38f4b60 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27801b1070 con 0x5647c38ffd40 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f2786f46740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27801af9c0 con 0x5647c38f5480 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54660/0 (socket says 172.21.15.66:54660) 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 -- 172.21.15.66:0/3398608852 learned_addr learned my addr 172.21.15.66:0/3398608852 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277e59c640 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f5480 0x5647c3917a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 -- 172.21.15.66:0/3398608852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f5480 msgr2=0x5647c3917a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f5480 0x5647c3917a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 -- 172.21.15.66:0/3398608852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 msgr2=0x5647c38efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.464+0000 7f277dd9b640 1 -- 172.21.15.66:0/3398608852 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c38ff4d0 con 0x5647c38f4b60 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.465+0000 7f277dd9b640 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f277400b450 tx=0x7f277400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d9e9d715bc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.465+0000 7f2767fff640 1 -- 172.21.15.66:0/3398608852 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774004020 con 0x5647c38f4b60 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.465+0000 7f2767fff640 1 -- 172.21.15.66:0/3398608852 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2774013e10 con 0x5647c38f4b60 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.465+0000 7f2767fff640 1 -- 172.21.15.66:0/3398608852 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774005440 con 0x5647c38f4b60 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- 172.21.15.66:0/3398608852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 msgr2=0x5647c3917550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f277400b450 tx=0x7f277400b650 comp rx=0 tx=0).stop 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- 172.21.15.66:0/3398608852 shutdown_connections 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f5480 0x5647c3917a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 --2- 172.21.15.66:0/3398608852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f4b60 0x5647c3917550 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- 172.21.15.66:0/3398608852 >> 172.21.15.66:0/3398608852 conn(0x5647c38f10f0 msgr2=0x5647c38feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- 172.21.15.66:0/3398608852 shutdown_connections 2024-09-15T23:00:03.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- 172.21.15.66:0/3398608852 wait complete. 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 -- start start 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 Processor -- start 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.466+0000 7f2786f46740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c3908320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27801b08e0 con 0x5647c38f5480 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f27801b0150 con 0x5647c38ffd40 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27801ad210 con 0x5647c38f4b60 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2786f46740 10 client.0 _ll_register_callbacks cb 0x7f277400ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54672/0 (socket says 172.21.15.66:54672) 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 -- 172.21.15.66:0/2258889709 learned_addr learned my addr 172.21.15.66:0/2258889709 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:03.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c3908320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 -- 172.21.15.66:0/2258889709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 msgr2=0x5647c3908320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c3908320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 -- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 msgr2=0x5647c38f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 -- 172.21.15.66:0/2258889709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c38fa510 con 0x5647c38f5480 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f277e59c640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2770004d50 tx=0x7f27700053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c114385528cad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.467+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277002c040 con 0x5647c38f5480 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9603+0+0 (secure 0 0 0) 0x7f277001cbc0 con 0x5647c38f5480 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2774013e10 con 0x5647c38f5480 2024-09-15T23:00:03.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f277001cdc0 con 0x5647c38f5480 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 10 client.18597 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5647c397a4a0 con 0x5647c38f5480 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2774013e10 con 0x5647c38f5480 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f2770011b00 con 0x5647c38f5480 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 10 client.18597 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 10 client.18597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 20 client.18597 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c397cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 4 client.18597 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.468+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5647c3861d00 con 0x5647c390f980 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.469+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c397cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.469+0000 7f277dd9b640 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c397cc80 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a9707d978c6d4d server_cookie=c810635db798ef3b in_seq=0 out_seq=0 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.469+0000 7f2765ffb640 10 client.18597 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:03.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2765ffb640 1 -- 172.21.15.66:0/2258889709 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5647c3861d00 con 0x5647c390f980 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2765ffb640 10 client.18597 handle_command_reply: tid=0 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 client.18597 shutdown 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 msgr2=0x5647c38f98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2770004d50 tx=0x7f27700053d0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 shutdown_connections 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5647c390f980 0x5647c397cc80 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647c38ffd40 0x5647c38f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5647c38f5480 0x5647c38f98c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 --2- 172.21.15.66:0/2258889709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5647c38f4b60 0x5647c3908320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 >> 172.21.15.66:0/2258889709 conn(0x5647c38f10f0 msgr2=0x5647c38f6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2765ffb640 0 client.18597 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 shutdown_connections 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 1 -- 172.21.15.66:0/2258889709 wait complete. 2024-09-15T23:00:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.470+0000 7f2786f46740 20 client.18597 trim_cache size 0 max 16384 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "5d557e24-e35c-4b9d-9e84-b843cb3b9c06", 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:00:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 msgr2=0x7f27680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 0x7f27680a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f27780b8af0 tx=0x7f2778087ca0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 msgr2=0x7f27801a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f277802ae70 tx=0x7f277802f5d0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 shutdown_connections 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27680a3430 0x7f27680a58f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2780102ef0 0x7f27801a4340 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2780102570 0x7f2780199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 --2- 172.21.15.66:0/3528437371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2780100e20 0x7f27801992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 >> 172.21.15.66:0/3528437371 conn(0x7f27800fc7d0 msgr2=0x7f27800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 shutdown_connections 2024-09-15T23:00:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:03.471+0000 7f2784b6d640 1 -- 172.21.15.66:0/3528437371 wait complete. 2024-09-15T23:00:04.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:00:04.788 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: pgmap v461: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-15T23:00:05.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:05 smithi066 ceph-mon[31185]: osdmap e108: 12 total, 12 up, 12 in 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: pgmap v461: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-15T23:00:05.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:05 smithi087 ceph-mon[35290]: osdmap e108: 12 total, 12 up, 12 in 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: pgmap v461: 129 pgs: 129 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-15T23:00:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:05 smithi184 ceph-mon[35203]: osdmap e108: 12 total, 12 up, 12 in 2024-09-15T23:00:05.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.539+0000 7fe637972640 1 -- 172.21.15.66:0/292448183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 msgr2=0x7fe630110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:05.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.539+0000 7fe637972640 1 --2- 172.21.15.66:0/292448183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630110b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe628009be0 tx=0x7fe62802a710 comp rx=0 tx=0).stop 2024-09-15T23:00:05.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.541+0000 7fe637972640 1 -- 172.21.15.66:0/292448183 shutdown_connections 2024-09-15T23:00:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.541+0000 7fe637972640 1 --2- 172.21.15.66:0/292448183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630110b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.541+0000 7fe637972640 1 --2- 172.21.15.66:0/292448183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.541+0000 7fe637972640 1 --2- 172.21.15.66:0/292448183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe630103e60 0x7fe630104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.541+0000 7fe637972640 1 -- 172.21.15.66:0/292448183 >> 172.21.15.66:0/292448183 conn(0x7fe6300ff8e0 msgr2=0x7fe630101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:05.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.544+0000 7fe637972640 1 -- 172.21.15.66:0/292448183 shutdown_connections 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.545+0000 7fe637972640 1 -- 172.21.15.66:0/292448183 wait complete. 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.545+0000 7fe637972640 1 Processor -- start 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 -- start start 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe630103e60 0x7fe630110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:05.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe63006e5e0 con 0x7fe630103e60 2024-09-15T23:00:05.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe63006e460 con 0x7fe630104810 2024-09-15T23:00:05.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe637972640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe63006e760 con 0x7fe630108f90 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe634f0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe634f0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42646/0 (socket says 172.21.15.66:42646) 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.546+0000 7fe634f0d640 1 -- 172.21.15.66:0/1638616852 learned_addr learned my addr 172.21.15.66:0/1638616852 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe635f0f640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe634f0d640 1 -- 172.21.15.66:0/1638616852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 msgr2=0x7fe630071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe634f0d640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe634f0d640 1 -- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe630103e60 msgr2=0x7fe630110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe634f0d640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe630103e60 0x7fe630110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.548+0000 7fe634f0d640 1 -- 172.21.15.66:0/1638616852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe630072660 con 0x7fe630104810 2024-09-15T23:00:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.549+0000 7fe634f0d640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe62000b450 tx=0x7fe62000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.553+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620015020 con 0x7fe630104810 2024-09-15T23:00:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.553+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe620011d70 con 0x7fe630104810 2024-09-15T23:00:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.553+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62000f340 con 0x7fe630104810 2024-09-15T23:00:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.553+0000 7fe637972640 1 -- 172.21.15.66:0/1638616852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe630072950 con 0x7fe630104810 2024-09-15T23:00:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.553+0000 7fe637972640 1 -- 172.21.15.66:0/1638616852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63019a560 con 0x7fe630104810 2024-09-15T23:00:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.556+0000 7fe637972640 1 -- 172.21.15.66:0/1638616852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe614005290 con 0x7fe630104810 2024-09-15T23:00:05.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.559+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe620018020 con 0x7fe630104810 2024-09-15T23:00:05.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.560+0000 7fe6267fc640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 0x7fe61c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:05.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.560+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fe6200cff40 con 0x7fe630104810 2024-09-15T23:00:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.565+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe62001f020 con 0x7fe630104810 2024-09-15T23:00:05.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.570+0000 7fe63570e640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 0x7fe61c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:05.580+0000 7fe63570e640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 0x7fe61c0a5a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005fd0 tx=0x7fe62c005a00 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:05.626 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:06.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.000+0000 7fe637972640 1 -- 172.21.15.66:0/1638616852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe614005580 con 0x7fe630104810 2024-09-15T23:00:06.007 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:00:06.007 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:00:06.008 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T23:00:06.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.005+0000 7fe6267fc640 1 -- 172.21.15.66:0/1638616852 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7fe62000d040 con 0x7fe630104810 2024-09-15T23:00:06.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.009+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 msgr2=0x7fe61c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.009+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 0x7fe61c0a5a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005fd0 tx=0x7fe62c005a00 comp rx=0 tx=0).stop 2024-09-15T23:00:06.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.009+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 msgr2=0x7fe630073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.009+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe62000b450 tx=0x7fe62000b910 comp rx=0 tx=0).stop 2024-09-15T23:00:06.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 shutdown_connections 2024-09-15T23:00:06.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe61c0a35c0 0x7fe61c0a5a80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe630108f90 0x7fe630071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe630104810 0x7fe630073c90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 --2- 172.21.15.66:0/1638616852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe630103e60 0x7fe630110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.010+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 >> 172.21.15.66:0/1638616852 conn(0x7fe6300ff8e0 msgr2=0x7fe630100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.011+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 shutdown_connections 2024-09-15T23:00:06.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.011+0000 7fe61bfff640 1 -- 172.21.15.66:0/1638616852 wait complete. 2024-09-15T23:00:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.295+0000 7fb4704b9640 1 -- 172.21.15.66:0/184369315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 msgr2=0x7fb468110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.295+0000 7fb4704b9640 1 --2- 172.21.15.66:0/184369315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb468110250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb458009900 tx=0x7fb45802a420 comp rx=0 tx=0).stop 2024-09-15T23:00:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.297+0000 7fb4704b9640 1 -- 172.21.15.66:0/184369315 shutdown_connections 2024-09-15T23:00:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.297+0000 7fb4704b9640 1 --2- 172.21.15.66:0/184369315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb46811b140 0x7fb46811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.297+0000 7fb4704b9640 1 --2- 172.21.15.66:0/184369315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.297+0000 7fb4704b9640 1 --2- 172.21.15.66:0/184369315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb468110250 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.297+0000 7fb4704b9640 1 -- 172.21.15.66:0/184369315 >> 172.21.15.66:0/184369315 conn(0x7fb46806e140 msgr2=0x7fb46806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.299+0000 7fb4704b9640 1 -- 172.21.15.66:0/184369315 shutdown_connections 2024-09-15T23:00:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.299+0000 7fb4704b9640 1 -- 172.21.15.66:0/184369315 wait complete. 2024-09-15T23:00:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.300+0000 7fb4704b9640 1 Processor -- start 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.300+0000 7fb4704b9640 1 -- start start 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb46811a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb46811b140 0x7fb468114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb468111370 con 0x7fb468109830 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681111f0 con 0x7fb46811b140 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb4704b9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681114f0 con 0x7fb468109450 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb46e255640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb46811a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb46da54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb46da54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54692/0 (socket says 172.21.15.66:54692) 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.301+0000 7fb46da54640 1 -- 172.21.15.66:0/4048921436 learned_addr learned my addr 172.21.15.66:0/4048921436 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.302+0000 7fb46da54640 1 -- 172.21.15.66:0/4048921436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 msgr2=0x7fb46811a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.302+0000 7fb46da54640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb46811a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.302+0000 7fb46da54640 1 -- 172.21.15.66:0/4048921436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb46811b140 msgr2=0x7fb468114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.302+0000 7fb46da54640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb46811b140 0x7fb468114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.302+0000 7fb46da54640 1 -- 172.21.15.66:0/4048921436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468115620 con 0x7fb468109830 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.306 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.307 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.308 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.309 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.310 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: osdmap e109: 12 total, 12 up, 12 in 2024-09-15T23:00:06.310 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:06 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1638616852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.303+0000 7fb46da54640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b450 tx=0x7fb46400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.308+0000 7fb45f7fe640 1 -- 172.21.15.66:0/4048921436 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464015020 con 0x7fb468109830 2024-09-15T23:00:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.308+0000 7fb45f7fe640 1 -- 172.21.15.66:0/4048921436 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb464011d70 con 0x7fb468109830 2024-09-15T23:00:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.308+0000 7fb45f7fe640 1 -- 172.21.15.66:0/4048921436 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46400f340 con 0x7fb468109830 2024-09-15T23:00:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.309+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb468126490 con 0x7fb468109830 2024-09-15T23:00:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.309+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb468126920 con 0x7fb468109830 2024-09-15T23:00:06.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.312+0000 7fb472892740 1 Processor -- start 2024-09-15T23:00:06.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.312+0000 7fb472892740 1 -- start start 2024-09-15T23:00:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c74a0 0x55887e3c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55887e32d2e0 con 0x55887e3c74a0 2024-09-15T23:00:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55887e2d4ce0 con 0x55887e3d2680 2024-09-15T23:00:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb472892740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55887e3292a0 con 0x55887e3c7dc0 2024-09-15T23:00:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb46da54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb46da54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42672/0 (socket says 172.21.15.66:42672) 2024-09-15T23:00:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.313+0000 7fb46da54640 1 -- 172.21.15.66:0/1168535744 learned_addr learned my addr 172.21.15.66:0/1168535744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.314+0000 7fb46da54640 1 -- 172.21.15.66:0/1168535744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 msgr2=0x55887e3d2140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:00:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.314+0000 7fb46da54640 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3d2140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.314+0000 7fb46da54640 1 -- 172.21.15.66:0/1168535744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c74a0 msgr2=0x55887e3c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.314+0000 7fb46da54640 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c74a0 0x55887e3c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.314+0000 7fb46da54640 1 -- 172.21.15.66:0/1168535744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887e2b9440 con 0x55887e3d2680 2024-09-15T23:00:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.324+0000 7fb46da54640 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb464011040 tx=0x7fb464010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7373d3fb24f67639 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.325+0000 7fb45f7fe640 1 -- 172.21.15.66:0/4048921436 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fb464018020 con 0x7fb468109830 2024-09-15T23:00:06.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.326+0000 7fb45f7fe640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 0x7fb4540a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.327+0000 7fb45f7fe640 1 -- 172.21.15.66:0/4048921436 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fb46402a050 con 0x7fb468109830 2024-09-15T23:00:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.333+0000 7fb46ea56640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 0x7fb4540a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.333+0000 7fb45cff9640 1 -- 172.21.15.66:0/1168535744 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464099ee0 con 0x55887e3d2680 2024-09-15T23:00:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.333+0000 7fb45cff9640 1 -- 172.21.15.66:0/1168535744 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb46409e340 con 0x55887e3d2680 2024-09-15T23:00:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 -- 172.21.15.66:0/1168535744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 msgr2=0x55887e3d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb464011040 tx=0x7fb464010940 comp rx=0 tx=0).stop 2024-09-15T23:00:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 -- 172.21.15.66:0/1168535744 shutdown_connections 2024-09-15T23:00:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3d2680 0x55887e3d4a70 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb464011040 tx=0x7fb464010940 comp rx=0 tx=0).stop 2024-09-15T23:00:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 --2- 172.21.15.66:0/1168535744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c74a0 0x55887e3c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.334+0000 7fb472892740 1 -- 172.21.15.66:0/1168535744 >> 172.21.15.66:0/1168535744 conn(0x55887e3c3a30 msgr2=0x55887e3c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.335+0000 7fb46ea56640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 0x7fb4540a5a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb460001fa0 tx=0x7fb460001680 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.339+0000 7fb472892740 1 -- 172.21.15.66:0/1168535744 shutdown_connections 2024-09-15T23:00:06.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.343+0000 7fb472892740 1 -- 172.21.15.66:0/1168535744 wait complete. 2024-09-15T23:00:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.343+0000 7fb472892740 1 -- start start 2024-09-15T23:00:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.343+0000 7fb472892740 1 Processor -- start 2024-09-15T23:00:06.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.352 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.353 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.354 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.355 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.355 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.355 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.355 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.356 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.356 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:00:06.356 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.356 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.356 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: osdmap e109: 12 total, 12 up, 12 in 2024-09-15T23:00:06.357 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:06 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1638616852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3c7dc0 0x55887e3cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3cfa50 0x55887e3de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55887e3d5250 con 0x55887e3cfa50 2024-09-15T23:00:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55887e2e8050 con 0x55887e3c7dc0 2024-09-15T23:00:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55887e3d53d0 con 0x55887e3c74a0 2024-09-15T23:00:06.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.350+0000 7fb472892740 10 client.0 _ll_register_callbacks cb 0x55887e328160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.351+0000 7fb46e255640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.351+0000 7fb46da54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3c7dc0 0x55887e3cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.351+0000 7fb46e255640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47512/0 (socket says 172.21.15.66:47512) 2024-09-15T23:00:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.351+0000 7fb46e255640 1 -- 172.21.15.66:0/2259787624 learned_addr learned my addr 172.21.15.66:0/2259787624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:06.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 -- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3c7dc0 msgr2=0x55887e3cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3c7dc0 0x55887e3cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 -- 172.21.15.66:0/2259787624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3cfa50 msgr2=0x55887e3de6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3cfa50 0x55887e3de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 -- 172.21.15.66:0/2259787624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887e09e3c0 con 0x55887e3c74a0 2024-09-15T23:00:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.353+0000 7fb46e255640 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb4580042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb2b9ed1ece5327a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:00:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45803f070 con 0x55887e3c74a0 2024-09-15T23:00:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb46409e340 con 0x55887e3c74a0 2024-09-15T23:00:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fb458005240 con 0x55887e3c74a0 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb45804b050 con 0x55887e3c74a0 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb472892740 10 client.27769 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.354+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55887e3e1140 con 0x55887e3c74a0 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.357+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb458005440 con 0x55887e3c74a0 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fb458003a70 con 0x55887e3c74a0 2024-09-15T23:00:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 10 client.27769 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 10 client.27769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 20 client.27769 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e3e2550 0x55887e3e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 4 client.27769 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:00:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.358+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb46409e340 con 0x55887e3e2550 2024-09-15T23:00:06.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.362+0000 7fb46da54640 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e3e2550 0x55887e3e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.364+0000 7fb46da54640 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e3e2550 0x55887e3e49f0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21100e5fc5ffab51 server_cookie=ab3f4c9b6482744c in_seq=0 out_seq=0 2024-09-15T23:00:06.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.367+0000 7fb451ffb640 10 client.27769 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:06.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.374+0000 7fb451ffb640 1 -- 172.21.15.66:0/2259787624 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb46409e340 con 0x55887e3e2550 2024-09-15T23:00:06.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.374+0000 7fb451ffb640 10 client.27769 handle_command_reply: tid=0 2024-09-15T23:00:06.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.374+0000 7fb472892740 1 client.27769 shutdown 2024-09-15T23:00:06.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 msgr2=0x55887e3d20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb4580042e0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 shutdown_connections 2024-09-15T23:00:06.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3cfa50 0x55887e3de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e3e2550 0x55887e3e49f0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3c7dc0 0x55887e3cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 --2- 172.21.15.66:0/2259787624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c74a0 0x55887e3d20b0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb4580042e0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 >> 172.21.15.66:0/2259787624 conn(0x55887e3c3a30 msgr2=0x55887e3c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.378+0000 7fb451ffb640 0 client.27769 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:06.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.379+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 shutdown_connections 2024-09-15T23:00:06.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.382+0000 7fb472892740 1 -- 172.21.15.66:0/2259787624 wait complete. 2024-09-15T23:00:06.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.384+0000 7fb472892740 20 client.27769 trim_cache size 0 max 16384 2024-09-15T23:00:06.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.421+0000 7fb472892740 1 Processor -- start 2024-09-15T23:00:06.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.421+0000 7fb472892740 1 -- start start 2024-09-15T23:00:06.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c7dc0 0x55887e3c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: osdmap e109: 12 total, 12 up, 12 in 2024-09-15T23:00:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:06 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1638616852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb468130c70 con 0x55887e3c7dc0 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681d97d0 con 0x55887e3ca900 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb472892740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681d8190 con 0x55887e3cfa50 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb46da54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb46da54640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47520/0 (socket says 172.21.15.66:47520) 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.422+0000 7fb46da54640 1 -- 172.21.15.66:0/2510011928 learned_addr learned my addr 172.21.15.66:0/2510011928 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.423+0000 7fb46da54640 1 -- 172.21.15.66:0/2510011928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 msgr2=0x55887e3de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.423+0000 7fb46da54640 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.423+0000 7fb46da54640 1 -- 172.21.15.66:0/2510011928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c7dc0 msgr2=0x55887e3c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.423+0000 7fb46da54640 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c7dc0 0x55887e3c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.423+0000 7fb46da54640 1 -- 172.21.15.66:0/2510011928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887e3c4ae0 con 0x55887e3cfa50 2024-09-15T23:00:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.428+0000 7fb46da54640 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb464009fd0 tx=0x7fb464010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc341b3090fcbd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.430+0000 7fb453fff640 1 -- 172.21.15.66:0/2510011928 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46409d780 con 0x55887e3cfa50 2024-09-15T23:00:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.430+0000 7fb453fff640 1 -- 172.21.15.66:0/2510011928 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4640a4040 con 0x55887e3cfa50 2024-09-15T23:00:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.430+0000 7fb453fff640 1 -- 172.21.15.66:0/2510011928 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46409da10 con 0x55887e3cfa50 2024-09-15T23:00:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 -- 172.21.15.66:0/2510011928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 msgr2=0x55887e3de4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb464009fd0 tx=0x7fb464010a40 comp rx=0 tx=0).stop 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 -- 172.21.15.66:0/2510011928 shutdown_connections 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3cfa50 0x55887e3de4b0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb464009fd0 tx=0x7fb464010a40 comp rx=0 tx=0).stop 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 --2- 172.21.15.66:0/2510011928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3c7dc0 0x55887e3c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.431+0000 7fb472892740 1 -- 172.21.15.66:0/2510011928 >> 172.21.15.66:0/2510011928 conn(0x55887e3c3a30 msgr2=0x55887e3c2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.432+0000 7fb472892740 1 -- 172.21.15.66:0/2510011928 shutdown_connections 2024-09-15T23:00:06.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.432+0000 7fb472892740 1 -- 172.21.15.66:0/2510011928 wait complete. 2024-09-15T23:00:06.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.433+0000 7fb472892740 1 -- start start 2024-09-15T23:00:06.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.433+0000 7fb472892740 1 Processor -- start 2024-09-15T23:00:06.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.434+0000 7fb472892740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3daba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.434+0000 7fb472892740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3d6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.434+0000 7fb46e255640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3daba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb46e255640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3daba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47532/0 (socket says 172.21.15.66:47532) 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb46da54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3d6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb46e255640 1 -- 172.21.15.66:0/2653724391 learned_addr learned my addr 172.21.15.66:0/2653724391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 0x55887e3d7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681d9040 con 0x55887e3d7380 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681d88b0 con 0x55887e3ca900 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.435+0000 7fb46ea56640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 0x55887e3d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.436+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb46812ed00 con 0x55887e3c7dc0 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.436+0000 7fb472892740 10 client.0 _ll_register_callbacks cb 0x7fb458009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 -- 172.21.15.66:0/2653724391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 msgr2=0x55887e3daba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3daba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 -- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 msgr2=0x55887e3d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 0x55887e3d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887e3c72d0 con 0x55887e3ca900 2024-09-15T23:00:06.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46ea56640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 0x55887e3d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:00:06.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.437+0000 7fb46da54640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3d6e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55887e3cda90 tx=0x7fb4640a6930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d4a1c714405203 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:06.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.442+0000 7fb451ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:00:06.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.442+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640aa020 con 0x55887e3ca900 2024-09-15T23:00:06.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.442+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fb4640a6390 con 0x55887e3ca900 2024-09-15T23:00:06.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.442+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4640a4040 con 0x55887e3ca900 2024-09-15T23:00:06.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.443+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb46409da10 con 0x55887e3ca900 2024-09-15T23:00:06.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.444+0000 7fb472892740 10 client.27902 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:06.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.444+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55887e44e300 con 0x55887e3ca900 2024-09-15T23:00:06.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.445+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4640a1ff0 con 0x55887e3ca900 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.446+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fb46402c070 con 0x55887e3ca900 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.446+0000 7fb472892740 10 client.27902 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.446+0000 7fb472892740 10 client.27902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.446+0000 7fb472892740 20 client.27902 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.447+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e44e590 0x55887e450980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.447+0000 7fb472892740 4 client.27902 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:00:06.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.447+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb4640a4040 con 0x55887e44e590 2024-09-15T23:00:06.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.448+0000 7fb46e255640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e44e590 0x55887e450980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:06.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.452+0000 7fb451ffb640 10 client.27902 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:06.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.452+0000 7fb46e255640 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e44e590 0x55887e450980 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64256bad98ec979f server_cookie=c78cd264be619bba in_seq=0 out_seq=0 2024-09-15T23:00:06.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.455+0000 7fb451ffb640 1 -- 172.21.15.66:0/2653724391 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fb4640a4040 con 0x55887e44e590 2024-09-15T23:00:06.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.455+0000 7fb451ffb640 10 client.27902 handle_command_reply: tid=0 2024-09-15T23:00:06.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.455+0000 7fb472892740 1 client.27902 shutdown 2024-09-15T23:00:06.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.455+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 msgr2=0x55887e3d6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3d6e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55887e3cda90 tx=0x7fb4640a6930 comp rx=0 tx=0).stop 2024-09-15T23:00:06.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 shutdown_connections 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55887e3d7380 0x55887e3d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55887e44e590 0x55887e450980 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55887e3ca900 0x55887e3d6e40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb451ffb640 0 client.27902 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.456+0000 7fb472892740 1 --2- 172.21.15.66:0/2653724391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55887e3c7dc0 0x55887e3daba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.457+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 >> 172.21.15.66:0/2653724391 conn(0x55887e3c3a30 msgr2=0x55887e3c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.460+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 shutdown_connections 2024-09-15T23:00:06.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.460+0000 7fb472892740 1 -- 172.21.15.66:0/2653724391 wait complete. 2024-09-15T23:00:06.461 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:00:06.461 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:00:06.461 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: "5d557e24-e35c-4b9d-9e84-b843cb3b9c06": { 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "5d557e24-e35c-4b9d-9e84-b843cb3b9c06", 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:00:06.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.460+0000 7fb472892740 20 client.27902 trim_cache size 0 max 16384 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 msgr2=0x7fb4540a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 0x7fb4540a5a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb460001fa0 tx=0x7fb460001680 comp rx=0 tx=0).stop 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 msgr2=0x7fb468114960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b450 tx=0x7fb46400b910 comp rx=0 tx=0).stop 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 shutdown_connections 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fb4540a35c0 0x7fb4540a5a80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb46811b140 0x7fb468114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb468109830 0x7fb468114960 secure :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b450 tx=0x7fb46400b910 comp rx=0 tx=0).stop 2024-09-15T23:00:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 --2- 172.21.15.66:0/4048921436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb468109450 0x7fb46811a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.461+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 >> 172.21.15.66:0/4048921436 conn(0x7fb46806e140 msgr2=0x7fb4680722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.462+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 shutdown_connections 2024-09-15T23:00:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:06.462+0000 7fb4704b9640 1 -- 172.21.15.66:0/4048921436 wait complete. 2024-09-15T23:00:07.193 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:07 smithi066 ceph-mon[31185]: pgmap v464: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 245 op/s 2024-09-15T23:00:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 146.5 --await-for 45.0' 2024-09-15T23:00:07.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 146.5 --await-for 45.0 2024-09-15T23:00:07.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:07 smithi087 ceph-mon[35290]: pgmap v464: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 245 op/s 2024-09-15T23:00:07.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:07 smithi184 ceph-mon[35203]: pgmap v464: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 245 op/s 2024-09-15T23:00:08.409 INFO:tasks.cephfs.filesystem:scrub status for tag:5d557e24-e35c-4b9d-9e84-b843cb3b9c06 - {'path': '/', 'tag': '5d557e24-e35c-4b9d-9e84-b843cb3b9c06', 'options': 'recursive,force'} 2024-09-15T23:00:08.526 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:09.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:09 smithi087 ceph-mon[35290]: pgmap v465: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-15T23:00:09.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:09 smithi184 ceph-mon[35203]: pgmap v465: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-15T23:00:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:09 smithi066 ceph-mon[31185]: pgmap v465: 129 pgs: 10 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 92 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-15T23:00:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.637+0000 7f5974bc1640 1 -- 172.21.15.66:0/1116000223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 msgr2=0x7f5970101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.637+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1116000223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f5970101200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5960009930 tx=0x7f596002a4d0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 -- 172.21.15.66:0/1116000223 shutdown_connections 2024-09-15T23:00:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1116000223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5970102ef0 0x7f597010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1116000223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102570 0x7f59701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1116000223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f5970101200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 -- 172.21.15.66:0/1116000223 >> 172.21.15.66:0/1116000223 conn(0x7f59700fc7d0 msgr2=0x7f59700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 -- 172.21.15.66:0/1116000223 shutdown_connections 2024-09-15T23:00:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.640+0000 7f5974bc1640 1 -- 172.21.15.66:0/1116000223 wait complete. 2024-09-15T23:00:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.641+0000 7f5974bc1640 1 Processor -- start 2024-09-15T23:00:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 -- start start 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f597019e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5970102570 0x7f597019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5970111070 con 0x7f5970102570 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5970110ef0 con 0x7f5970102ef0 2024-09-15T23:00:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.642+0000 7f5974bc1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f59701111f0 con 0x7f5970100e20 2024-09-15T23:00:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.645+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.645+0000 7f596e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f597019e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.645+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42720/0 (socket says 172.21.15.66:42720) 2024-09-15T23:00:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.645+0000 7f596ed9d640 1 -- 172.21.15.66:0/1489366497 learned_addr learned my addr 172.21.15.66:0/1489366497 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 -- 172.21.15.66:0/1489366497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 msgr2=0x7f597019e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f597019e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 -- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5970102570 msgr2=0x7f597019e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5970102570 0x7f597019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 -- 172.21.15.66:0/1489366497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5970196dd0 con 0x7f5970102ef0 2024-09-15T23:00:09.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.646+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f596800b970 tx=0x7f596800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.650+0000 7f595f7fe640 1 -- 172.21.15.66:0/1489366497 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968019070 con 0x7f5970102ef0 2024-09-15T23:00:09.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.650+0000 7f595f7fe640 1 -- 172.21.15.66:0/1489366497 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596800cb40 con 0x7f5970102ef0 2024-09-15T23:00:09.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.650+0000 7f595f7fe640 1 -- 172.21.15.66:0/1489366497 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680076e0 con 0x7f5970102ef0 2024-09-15T23:00:09.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.651+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59701970c0 con 0x7f5970102ef0 2024-09-15T23:00:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.651+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597006be60 con 0x7f5970102ef0 2024-09-15T23:00:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.654+0000 7f5976f9a740 1 Processor -- start 2024-09-15T23:00:09.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 -- start start 2024-09-15T23:00:09.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a02760 0x55d3b5a02b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3b59682a0 con 0x55d3b5a03080 2024-09-15T23:00:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d3b590fb10 con 0x55d3b5a0d940 2024-09-15T23:00:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.656+0000 7f5976f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5964260 con 0x55d3b5a02760 2024-09-15T23:00:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.660+0000 7f596e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.660+0000 7f596e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54768/0 (socket says 172.21.15.66:54768) 2024-09-15T23:00:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.660+0000 7f596e59c640 1 -- 172.21.15.66:0/1244151890 learned_addr learned my addr 172.21.15.66:0/1244151890 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.660+0000 7f596dd9b640 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a02760 0x55d3b5a02b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.661+0000 7f596dd9b640 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.663+0000 7f596e59c640 1 -- 172.21.15.66:0/1244151890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a02760 msgr2=0x55d3b5a02b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.663+0000 7f596e59c640 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a02760 0x55d3b5a02b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.663+0000 7f596e59c640 1 -- 172.21.15.66:0/1244151890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 msgr2=0x55d3b5a0fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.663+0000 7f596e59c640 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.663+0000 7f596e59c640 1 -- 172.21.15.66:0/1244151890 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b56d9b90 con 0x55d3b5a03080 2024-09-15T23:00:09.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.665+0000 7f595f7fe640 1 -- 172.21.15.66:0/1489366497 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5968014440 con 0x7f5970102ef0 2024-09-15T23:00:09.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.666+0000 7f595f7fe640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 0x7f59580a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.666+0000 7f595f7fe640 1 -- 172.21.15.66:0/1489366497 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f59680cf6e0 con 0x7f5970102ef0 2024-09-15T23:00:09.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.667+0000 7f596dd9b640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 0x7f59580a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.668+0000 7f596e59c640 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5960000c00 tx=0x7f5960031ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2f80f0a0ba6b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.671+0000 7f595cff9640 1 -- 172.21.15.66:0/1244151890 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960035030 con 0x55d3b5a03080 2024-09-15T23:00:09.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.671+0000 7f595cff9640 1 -- 172.21.15.66:0/1244151890 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5960005020 con 0x55d3b5a03080 2024-09-15T23:00:09.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.671+0000 7f595cff9640 1 -- 172.21.15.66:0/1244151890 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960004b50 con 0x55d3b5a03080 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.672+0000 7f5976f9a740 1 -- 172.21.15.66:0/1244151890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 msgr2=0x55d3b5a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.672+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f5960000c00 tx=0x7f5960031ad0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f596dd9b640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 0x7f59580a5a80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55d3b5a00070 tx=0x7f5964009040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f5976f9a740 1 -- 172.21.15.66:0/1244151890 shutdown_connections 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a0d400 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1244151890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a02760 0x55d3b5a02b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.673+0000 7f5976f9a740 1 -- 172.21.15.66:0/1244151890 >> 172.21.15.66:0/1244151890 conn(0x55d3b59fecf0 msgr2=0x55d3b59ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:09.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.675+0000 7f5976f9a740 1 -- 172.21.15.66:0/1244151890 shutdown_connections 2024-09-15T23:00:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.679+0000 7f5976f9a740 1 -- 172.21.15.66:0/1244151890 wait complete. 2024-09-15T23:00:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.679+0000 7f5976f9a740 1 -- start start 2024-09-15T23:00:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.679+0000 7f5976f9a740 1 Processor -- start 2024-09-15T23:00:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a0a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a03080 0x55d3b5a0ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5a10510 con 0x55d3b5a02760 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d3b58f06e0 con 0x55d3b5a03080 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5a10690 con 0x55d3b5a0d940 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f5976f9a740 10 client.0 _ll_register_callbacks cb 0x55d3b5914a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47564/0 (socket says 172.21.15.66:47564) 2024-09-15T23:00:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.680+0000 7f596ed9d640 1 -- 172.21.15.66:0/411884995 learned_addr learned my addr 172.21.15.66:0/411884995 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.682+0000 7f596ed9d640 1 -- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a03080 msgr2=0x55d3b5a0ad30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.682+0000 7f596ed9d640 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a03080 0x55d3b5a0ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.682+0000 7f596ed9d640 1 -- 172.21.15.66:0/411884995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 msgr2=0x55d3b5a0a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.682+0000 7f596ed9d640 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a0a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.682+0000 7f596ed9d640 1 -- 172.21.15.66:0/411884995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b5a19a00 con 0x55d3b5a0d940 2024-09-15T23:00:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.683+0000 7f596ed9d640 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f596800cfd0 tx=0x7f596809bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56bc30cd5f9742a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.686+0000 7f5955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:00:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.686+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680ccdd0 con 0x55d3b5a0d940 2024-09-15T23:00:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.686+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f596809b850 con 0x55d3b5a0d940 2024-09-15T23:00:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.687+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5960005020 con 0x55d3b5a0d940 2024-09-15T23:00:09.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.690+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f59680a4260 con 0x55d3b5a0d940 2024-09-15T23:00:09.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.692+0000 7f5976f9a740 10 client.27787 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:09.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.692+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55d3b5a1c3f0 con 0x55d3b5a0d940 2024-09-15T23:00:09.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.696+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5960005020 con 0x55d3b5a0d940 2024-09-15T23:00:09.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f596809aa40 con 0x55d3b5a0d940 2024-09-15T23:00:09.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 10 client.27787 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 10 client.27787 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 20 client.27787 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a1ddb0 0x55d3b5a20270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 4 client.27787 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.697+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b59759d0 con 0x55d3b5a1ddb0 2024-09-15T23:00:09.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.698+0000 7f596e59c640 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a1ddb0 0x55d3b5a20270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.702+0000 7f596e59c640 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a1ddb0 0x55d3b5a20270 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2a116a9714f1f6 server_cookie=93efb4056c6b3d61 in_seq=0 out_seq=0 2024-09-15T23:00:09.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.702+0000 7f5955ffb640 10 client.27787 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:09.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.708+0000 7f5955ffb640 1 -- 172.21.15.66:0/411884995 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3b59759d0 con 0x55d3b5a1ddb0 2024-09-15T23:00:09.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.708+0000 7f5955ffb640 10 client.27787 handle_command_reply: tid=0 2024-09-15T23:00:09.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.708+0000 7f5976f9a740 1 client.27787 shutdown 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.713+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 msgr2=0x55d3b5a0b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.713+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f596800cfd0 tx=0x7f596809bcf0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 shutdown_connections 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a0b270 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a1ddb0 0x55d3b5a20270 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a03080 0x55d3b5a0ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 --2- 172.21.15.66:0/411884995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a0a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 >> 172.21.15.66:0/411884995 conn(0x55d3b59fecf0 msgr2=0x55d3b5a04a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:09.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.714+0000 7f5955ffb640 0 client.27787 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:09.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.717+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 shutdown_connections 2024-09-15T23:00:09.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.717+0000 7f5976f9a740 1 -- 172.21.15.66:0/411884995 wait complete. 2024-09-15T23:00:09.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.717+0000 7f5976f9a740 20 client.27787 trim_cache size 0 max 16384 2024-09-15T23:00:09.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 Processor -- start 2024-09-15T23:00:09.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 -- start start 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a02760 0x55d3b5a0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a25b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59701c6920 con 0x55d3b5a03080 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59701c8760 con 0x55d3b5a02760 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.754+0000 7f5976f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f59701c70b0 con 0x55d3b5a0d940 2024-09-15T23:00:09.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.755+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.755+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47578/0 (socket says 172.21.15.66:47578) 2024-09-15T23:00:09.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.755+0000 7f596ed9d640 1 -- 172.21.15.66:0/2287150403 learned_addr learned my addr 172.21.15.66:0/2287150403 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:09.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596dd9b640 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596ed9d640 1 -- 172.21.15.66:0/2287150403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a02760 msgr2=0x55d3b5a0c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:00:09.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596ed9d640 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a02760 0x55d3b5a0c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596ed9d640 1 -- 172.21.15.66:0/2287150403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 msgr2=0x55d3b5a25b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596ed9d640 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a25b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.757+0000 7f596ed9d640 1 -- 172.21.15.66:0/2287150403 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b59feb20 con 0x55d3b5a0d940 2024-09-15T23:00:09.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.758+0000 7f596ed9d640 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f596809b7b0 tx=0x7f596809b4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6c3785c3b1a96d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.762+0000 7f5957fff640 1 -- 172.21.15.66:0/2287150403 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680090a0 con 0x55d3b5a0d940 2024-09-15T23:00:09.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.762+0000 7f5957fff640 1 -- 172.21.15.66:0/2287150403 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59680a3dd0 con 0x55d3b5a0d940 2024-09-15T23:00:09.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.762+0000 7f5957fff640 1 -- 172.21.15.66:0/2287150403 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680cf3e0 con 0x55d3b5a0d940 2024-09-15T23:00:09.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.766+0000 7f5976f9a740 1 -- 172.21.15.66:0/2287150403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 msgr2=0x55d3b5a260c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:09.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.766+0000 7f5976f9a740 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f596809b7b0 tx=0x7f596809b4d0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 -- 172.21.15.66:0/2287150403 shutdown_connections 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a0d940 0x55d3b5a260c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a03080 0x55d3b5a25b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 --2- 172.21.15.66:0/2287150403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a02760 0x55d3b5a0c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 -- 172.21.15.66:0/2287150403 >> 172.21.15.66:0/2287150403 conn(0x55d3b59fecf0 msgr2=0x55d3b5a0c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 -- 172.21.15.66:0/2287150403 shutdown_connections 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 -- 172.21.15.66:0/2287150403 wait complete. 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.769+0000 7f5976f9a740 1 -- start start 2024-09-15T23:00:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.770+0000 7f5976f9a740 1 Processor -- start 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.770+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a15d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a03080 0x55d3b5a110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59701c7fd0 con 0x55d3b5a02760 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59701c7840 con 0x55d3b5a0d940 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5970101200 con 0x55d3b5a03080 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f5976f9a740 10 client.0 _ll_register_callbacks cb 0x7f596809b130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:09.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f596ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:42752/0 (socket says 172.21.15.66:42752) 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.771+0000 7f596ed9d640 1 -- 172.21.15.66:0/1789359096 learned_addr learned my addr 172.21.15.66:0/1789359096 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.772+0000 7f596ed9d640 1 -- 172.21.15.66:0/1789359096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a03080 msgr2=0x55d3b5a110d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.772+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a03080 0x55d3b5a110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.772+0000 7f596ed9d640 1 -- 172.21.15.66:0/1789359096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 msgr2=0x55d3b5a15d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.772+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a15d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:09.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.772+0000 7f596ed9d640 1 -- 172.21.15.66:0/1789359096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b5a11b50 con 0x55d3b5a0d940 2024-09-15T23:00:09.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.773+0000 7f596ed9d640 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f59680998a0 tx=0x7f5968014d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34428ada284a69eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:09.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.774+0000 7f5955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:00:09.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.774+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968083060 con 0x55d3b5a0d940 2024-09-15T23:00:09.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.774+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59680a3dd0 con 0x55d3b5a0d940 2024-09-15T23:00:09.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.774+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f59680afb10 con 0x55d3b5a0d940 2024-09-15T23:00:09.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.777+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f5968089020 con 0x55d3b5a0d940 2024-09-15T23:00:09.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.780+0000 7f5976f9a740 10 client.27911 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:09.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.780+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55d3b5a11b50 con 0x55d3b5a0d940 2024-09-15T23:00:09.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59680afd10 con 0x55d3b5a0d940 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f596809a5c0 con 0x55d3b5a0d940 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 10 client.27911 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 10 client.27911 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 20 client.27911 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a88c40 0x55d3b5a8b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 4 client.27911 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.5, "await_for": 45.0}] 2024-09-15T23:00:09.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.783+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.5, "await_for": 45.0}) -- 0x7f59680a3dd0 con 0x55d3b5a88c40 2024-09-15T23:00:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.797+0000 7f596e59c640 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a88c40 0x55d3b5a8b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:09.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.800+0000 7f596e59c640 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a88c40 0x55d3b5a8b0a0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db7d739d247075a9 server_cookie=a1f5a90c0686b4ca in_seq=0 out_seq=0 2024-09-15T23:00:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:09.800+0000 7f5955ffb640 10 client.27911 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:11 smithi087 ceph-mon[35290]: pgmap v466: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2024-09-15T23:00:11.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:11 smithi184 ceph-mon[35203]: pgmap v466: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2024-09-15T23:00:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:11 smithi066 ceph-mon[31185]: pgmap v466: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2024-09-15T23:00:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:13 smithi184 ceph-mon[35203]: pgmap v467: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T23:00:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:13 smithi066 ceph-mon[31185]: pgmap v467: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T23:00:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:13 smithi087 ceph-mon[35290]: pgmap v467: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-15T23:00:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:15 smithi184 ceph-mon[35203]: pgmap v468: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 127 op/s 2024-09-15T23:00:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:15 smithi066 ceph-mon[31185]: pgmap v468: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 127 op/s 2024-09-15T23:00:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:15 smithi087 ceph-mon[35290]: pgmap v468: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 127 op/s 2024-09-15T23:00:17.401 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:17 smithi087 ceph-mon[35290]: pgmap v469: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-15T23:00:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:17 smithi184 ceph-mon[35203]: pgmap v469: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-15T23:00:17.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:17 smithi066 ceph-mon[31185]: pgmap v469: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-15T23:00:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:19 smithi184 ceph-mon[35203]: pgmap v470: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T23:00:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:19 smithi066 ceph-mon[31185]: pgmap v470: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5955ffb640 1 -- 172.21.15.66:0/1789359096 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f59680a3dd0 con 0x55d3b5a88c40 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5955ffb640 10 client.27911 handle_command_reply: tid=0 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 client.27911 shutdown 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 msgr2=0x55d3b5a11610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f59680998a0 tx=0x7f5968014d30 comp rx=0 tx=0).stop 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 shutdown_connections 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d3b5a88c40 0x55d3b5a8b0a0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3b5a0d940 0x55d3b5a11610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b5a03080 0x55d3b5a110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 --2- 172.21.15.66:0/1789359096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d3b5a02760 0x55d3b5a15d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 >> 172.21.15.66:0/1789359096 conn(0x55d3b59fecf0 msgr2=0x55d3b5a0c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5955ffb640 0 client.27911 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 shutdown_connections 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.506+0000 7f5976f9a740 1 -- 172.21.15.66:0/1789359096 wait complete. 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.507+0000 7f5976f9a740 20 client.27911 trim_cache size 0 max 16384 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:00:19.510 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 63, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 50, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "6d64a139": { 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 50, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 146.5, 2024-09-15T23:00:19.511 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:19.512 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 msgr2=0x7f59580a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 0x7f59580a5a80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55d3b5a00070 tx=0x7f5964009040 comp rx=0 tx=0).stop 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 msgr2=0x7f5970196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f596800b970 tx=0x7f596800be30 comp rx=0 tx=0).stop 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 shutdown_connections 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f59580a35c0 0x7f59580a5a80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5970102ef0 0x7f5970196540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5970102570 0x7f597019e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 --2- 172.21.15.66:0/1489366497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5970100e20 0x7f597019e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:19.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 >> 172.21.15.66:0/1489366497 conn(0x7f59700fc7d0 msgr2=0x7f5970069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:19.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 shutdown_connections 2024-09-15T23:00:19.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:19.508+0000 7f5974bc1640 1 -- 172.21.15.66:0/1489366497 wait complete. 2024-09-15T23:00:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:19 smithi087 ceph-mon[35290]: pgmap v470: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T23:00:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:21 smithi184 ceph-mon[35203]: pgmap v471: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 866 KiB/s wr, 109 op/s 2024-09-15T23:00:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:21 smithi066 ceph-mon[31185]: pgmap v471: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 866 KiB/s wr, 109 op/s 2024-09-15T23:00:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:21 smithi087 ceph-mon[35290]: pgmap v471: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 866 KiB/s wr, 109 op/s 2024-09-15T23:00:22.198 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:00:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:00:21.931+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T23:00:22.522 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6d64a139', quiesce took 19.2 seconds. Will release after: 7.300000000000001 2024-09-15T23:00:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:23 smithi184 ceph-mon[35203]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 500 KiB/s wr, 84 op/s 2024-09-15T23:00:23.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:23 smithi066 ceph-mon[31185]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 500 KiB/s wr, 84 op/s 2024-09-15T23:00:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:23 smithi087 ceph-mon[35290]: pgmap v472: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 500 KiB/s wr, 84 op/s 2024-09-15T23:00:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:25 smithi184 ceph-mon[35203]: pgmap v473: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 442 KiB/s wr, 79 op/s 2024-09-15T23:00:25.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:25 smithi066 ceph-mon[31185]: pgmap v473: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 442 KiB/s wr, 79 op/s 2024-09-15T23:00:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:25 smithi087 ceph-mon[35290]: pgmap v473: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 442 KiB/s wr, 79 op/s 2024-09-15T23:00:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:27 smithi184 ceph-mon[35203]: pgmap v474: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 58 op/s 2024-09-15T23:00:27.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:27 smithi066 ceph-mon[31185]: pgmap v474: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 58 op/s 2024-09-15T23:00:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:27 smithi087 ceph-mon[35290]: pgmap v474: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 58 op/s 2024-09-15T23:00:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:29 smithi184 ceph-mon[35203]: pgmap v475: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 KiB/s wr, 46 op/s 2024-09-15T23:00:29.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:29 smithi066 ceph-mon[31185]: pgmap v475: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 KiB/s wr, 46 op/s 2024-09-15T23:00:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:29 smithi087 ceph-mon[35290]: pgmap v475: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 KiB/s wr, 46 op/s 2024-09-15T23:00:29.823 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:00:30.377 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:31.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.095+0000 7f18bbbf7640 1 -- 172.21.15.66:0/3295067230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 msgr2=0x7f18b4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:31.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.095+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/3295067230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b4101200 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f18b001a910 tx=0x7f18b003b500 comp rx=0 tx=0).stop 2024-09-15T23:00:31.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.101+0000 7f18bbbf7640 1 -- 172.21.15.66:0/3295067230 shutdown_connections 2024-09-15T23:00:31.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.101+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/3295067230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 0x7f18b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.101+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/3295067230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b4102570 0x7f18b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.101+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/3295067230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b4101200 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.101+0000 7f18bbbf7640 1 -- 172.21.15.66:0/3295067230 >> 172.21.15.66:0/3295067230 conn(0x7f18b40fc7d0 msgr2=0x7f18b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:31.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.103+0000 7f18bbbf7640 1 -- 172.21.15.66:0/3295067230 shutdown_connections 2024-09-15T23:00:31.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.107+0000 7f18bbbf7640 1 -- 172.21.15.66:0/3295067230 wait complete. 2024-09-15T23:00:31.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 Processor -- start 2024-09-15T23:00:31.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 -- start start 2024-09-15T23:00:31.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:31.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b4102570 0x7f18b4108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:31.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 0x7f18b4108b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:31.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18b406e5f0 con 0x7f18b4100e20 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f18b406e470 con 0x7f18b4102570 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.108+0000 7f18bbbf7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f18b406e770 con 0x7f18b4102ef0 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37858/0 (socket says 172.21.15.66:37858) 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 -- 172.21.15.66:0/1431914429 learned_addr learned my addr 172.21.15.66:0/1431914429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:31.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18ba194640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 0x7f18b4108b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:31.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 -- 172.21.15.66:0/1431914429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 msgr2=0x7f18b4108b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:31.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 0x7f18b4108b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 -- 172.21.15.66:0/1431914429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b4102570 msgr2=0x7f18b4108620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:00:31.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b4102570 0x7f18b4108620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.109+0000 7f18b9993640 1 -- 172.21.15.66:0/1431914429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b4109120 con 0x7f18b4100e20 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.110+0000 7f18b9993640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005ab0 tx=0x7f18b00049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.111+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b004f020 con 0x7f18b4100e20 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.111+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b00035f0 con 0x7f18b4100e20 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.111+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0046070 con 0x7f18b4100e20 2024-09-15T23:00:31.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.111+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b41093b0 con 0x7f18b4100e20 2024-09-15T23:00:31.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.111+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b419a550 con 0x7f18b4100e20 2024-09-15T23:00:31.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.117+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f18b0052020 con 0x7f18b4100e20 2024-09-15T23:00:31.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.118+0000 7f18aaffd640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 0x7f18a00a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:31.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.118+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f18b0101520 con 0x7f18b4100e20 2024-09-15T23:00:31.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.118+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1898005290 con 0x7f18b4100e20 2024-09-15T23:00:31.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.121+0000 7f18b9192640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 0x7f18a00a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:31.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.129+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18b0059020 con 0x7f18b4100e20 2024-09-15T23:00:31.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.129+0000 7f18b9192640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 0x7f18a00a5a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f18b4109de0 tx=0x7f18a4005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:31 smithi066 ceph-mon[31185]: pgmap v476: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 KiB/s wr, 30 op/s 2024-09-15T23:00:31.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.547+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1898005850 con 0x7f18b4100e20 2024-09-15T23:00:31.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.550+0000 7f18aaffd640 1 -- 172.21.15.66:0/1431914429 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7f18b00cda20 con 0x7f18b4100e20 2024-09-15T23:00:31.552 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:00:31.553 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:00:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T23:00:31.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.555+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 msgr2=0x7f18a00a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:31.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.555+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 0x7f18a00a5a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f18b4109de0 tx=0x7f18a4005f90 comp rx=0 tx=0).stop 2024-09-15T23:00:31.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.555+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 msgr2=0x7f18b410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:31.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.555+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005ab0 tx=0x7f18b00049e0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 shutdown_connections 2024-09-15T23:00:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18a00a3580 0x7f18a00a5a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4102ef0 0x7f18b4108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b4102570 0x7f18b4108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 --2- 172.21.15.66:0/1431914429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18b4100e20 0x7f18b410d590 secure :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005ab0 tx=0x7f18b00049e0 comp rx=0 tx=0).stop 2024-09-15T23:00:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.556+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 >> 172.21.15.66:0/1431914429 conn(0x7f18b40fc7d0 msgr2=0x7f18b40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:31.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.564+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 shutdown_connections 2024-09-15T23:00:31.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:31.564+0000 7f18bbbf7640 1 -- 172.21.15.66:0/1431914429 wait complete. 2024-09-15T23:00:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:31 smithi087 ceph-mon[35290]: pgmap v476: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 KiB/s wr, 30 op/s 2024-09-15T23:00:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:31 smithi184 ceph-mon[35203]: pgmap v476: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 KiB/s wr, 30 op/s 2024-09-15T23:00:32.383 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 6d64a139 --release --await' 2024-09-15T23:00:32.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 6d64a139 --release --await 2024-09-15T23:00:32.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:32 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1431914429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:32.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:32 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1431914429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:32.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:32 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1431914429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:00:32.905 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:33.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:33 smithi066 ceph-mon[31185]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T23:00:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:33 smithi087 ceph-mon[35290]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T23:00:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:33 smithi184 ceph-mon[35203]: pgmap v477: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-15T23:00:33.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.924+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/125856644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 msgr2=0x7fcbe410e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:33.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.924+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/125856644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe410e470 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0007380 tx=0x7fcbe002afb0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.930+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/125856644 shutdown_connections 2024-09-15T23:00:33.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.930+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/125856644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406ee70 0x7fcbe407a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.930+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/125856644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406e4f0 0x7fcbe406e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.930+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/125856644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe410e470 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.930+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/125856644 >> 172.21.15.66:0/125856644 conn(0x7fcbe4073180 msgr2=0x7fcbe4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:33.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.935+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/125856644 shutdown_connections 2024-09-15T23:00:33.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.936+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/125856644 wait complete. 2024-09-15T23:00:33.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.936+0000 7fcbeaf0f640 1 Processor -- start 2024-09-15T23:00:33.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.936+0000 7fcbeaf0f640 1 -- start start 2024-09-15T23:00:33.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 0x7fcbe4084d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406ee70 0x7fcbe407ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe407f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe407da70 con 0x7fcbe410e090 2024-09-15T23:00:33.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe407d8f0 con 0x7fcbe406ee70 2024-09-15T23:00:33.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.937+0000 7fcbeaf0f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe407dbf0 con 0x7fcbe406e4f0 2024-09-15T23:00:33.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.938+0000 7fcbea70e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe407f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.939+0000 7fcbea70e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe407f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36368/0 (socket says 172.21.15.66:36368) 2024-09-15T23:00:33.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.939+0000 7fcbea70e640 1 -- 172.21.15.66:0/724224779 learned_addr learned my addr 172.21.15.66:0/724224779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:33.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.939+0000 7fcbe970c640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406ee70 0x7fcbe407ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.940+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 0x7fcbe4084d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.941+0000 7fcbe9f0d640 1 -- 172.21.15.66:0/724224779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406ee70 msgr2=0x7fcbe407ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:33.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.941+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406ee70 0x7fcbe407ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.941+0000 7fcbe9f0d640 1 -- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 msgr2=0x7fcbe407f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:33.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.941+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe407f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.941+0000 7fcbe9f0d640 1 -- 172.21.15.66:0/724224779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe41bbb80 con 0x7fcbe406e4f0 2024-09-15T23:00:33.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.942+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 0x7fcbe4084d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0035040 tx=0x7fcbe0033eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:33.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.942+0000 7fcbdaffd640 1 -- 172.21.15.66:0/724224779 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe002be40 con 0x7fcbe406e4f0 2024-09-15T23:00:33.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.942+0000 7fcbdaffd640 1 -- 172.21.15.66:0/724224779 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe0005510 con 0x7fcbe406e4f0 2024-09-15T23:00:33.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.942+0000 7fcbdaffd640 1 -- 172.21.15.66:0/724224779 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004920 con 0x7fcbe406e4f0 2024-09-15T23:00:33.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.942+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe41bbe10 con 0x7fcbe406e4f0 2024-09-15T23:00:33.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.943+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41bc1b0 con 0x7fcbe406e4f0 2024-09-15T23:00:33.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.949+0000 7fcbdaffd640 1 -- 172.21.15.66:0/724224779 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fcbe0044060 con 0x7fcbe406e4f0 2024-09-15T23:00:33.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.951+0000 7fcbee54a740 1 Processor -- start 2024-09-15T23:00:33.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.952+0000 7fcbdaffd640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 0x7fcbd00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.952+0000 7fcbdaffd640 1 -- 172.21.15.66:0/724224779 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fcbe00ef6f0 con 0x7fcbe406e4f0 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 -- start start 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6b30 0x55ad40d00eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ad40c5b620 con 0x55ad40cf6b30 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ad40c02e50 con 0x55ad40d013f0 2024-09-15T23:00:33.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.953+0000 7fcbee54a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ad40c575e0 con 0x55ad40cf6210 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.954+0000 7fcbea70e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.954+0000 7fcbea70e640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 0x7fcbd00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.954+0000 7fcbea70e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58628/0 (socket says 172.21.15.66:58628) 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.954+0000 7fcbea70e640 1 -- 172.21.15.66:0/3509516867 learned_addr learned my addr 172.21.15.66:0/3509516867 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 -- 172.21.15.66:0/3509516867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 msgr2=0x55ad40cf65f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf65f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 -- 172.21.15.66:0/3509516867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6b30 msgr2=0x55ad40d00eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6b30 0x55ad40d00eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 -- 172.21.15.66:0/3509516867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad40bf3d40 con 0x55ad40d013f0 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.955+0000 7fcbea70e640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 0x7fcbd00a5a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02fc60 tx=0x7fcbdc009c20 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:33.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.956+0000 7fcbea70e640 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02fed0 tx=0x7fcbdc03e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc08f698b0cb056b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:33.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.960+0000 7fcbcffff640 1 -- 172.21.15.66:0/3509516867 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc038040 con 0x55ad40d013f0 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.960+0000 7fcbcffff640 1 -- 172.21.15.66:0/3509516867 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc042070 con 0x55ad40d013f0 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 -- 172.21.15.66:0/3509516867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 msgr2=0x55ad40d037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02fed0 tx=0x7fcbdc03e000 comp rx=0 tx=0).stop 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 -- 172.21.15.66:0/3509516867 shutdown_connections 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40d037e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6b30 0x55ad40d00eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 --2- 172.21.15.66:0/3509516867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.961+0000 7fcbee54a740 1 -- 172.21.15.66:0/3509516867 >> 172.21.15.66:0/3509516867 conn(0x55ad40cf27a0 msgr2=0x55ad40cf2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.962+0000 7fcbee54a740 1 -- 172.21.15.66:0/3509516867 shutdown_connections 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.962+0000 7fcbee54a740 1 -- 172.21.15.66:0/3509516867 wait complete. 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.962+0000 7fcbee54a740 1 -- start start 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.962+0000 7fcbee54a740 1 Processor -- start 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cfe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40cfecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ad40d04010 con 0x55ad40d013f0 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ad40be3f10 con 0x55ad40cf6b30 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ad40d04190 con 0x55ad40cf6210 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbee54a740 10 client.0 _ll_register_callbacks cb 0x55ad40c07db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbe970c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbe970c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58632/0 (socket says 172.21.15.66:58632) 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbe970c640 1 -- 172.21.15.66:0/1560748244 learned_addr learned my addr 172.21.15.66:0/1560748244 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:33.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.963+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cfe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 -- 172.21.15.66:0/1560748244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 msgr2=0x55ad40cfe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cfe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 -- 172.21.15.66:0/1560748244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 msgr2=0x55ad40cfecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40cfecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 -- 172.21.15.66:0/1560748244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4096a580 con 0x55ad40cf6b30 2024-09-15T23:00:33.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400bd80 tx=0x7fcbd400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6608a203e99a939 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:33.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.964+0000 7fcbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:00:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.968+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4015070 con 0x55ad40cf6b30 2024-09-15T23:00:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.968+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fcbd4004020 con 0x55ad40cf6b30 2024-09-15T23:00:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.971+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbdc042070 con 0x55ad40cf6b30 2024-09-15T23:00:33.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.971+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fcbd4004260 con 0x55ad40cf6b30 2024-09-15T23:00:33.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.978+0000 7fcbee54a740 10 client.27926 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:33.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.978+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55ad40a34960 con 0x55ad40cf6b30 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc042070 con 0x55ad40cf6b30 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fcbd4003860 con 0x55ad40cf6b30 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 10 client.27926 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 10 client.27926 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 20 client.27926 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:33.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d11470 0x55ad40d138d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 4 client.27926 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:00:33.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.980+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad40c68b90 con 0x55ad40d11470 2024-09-15T23:00:33.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.981+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d11470 0x55ad40d138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:33.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.982+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d11470 0x55ad40d138d0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60539f94a313d1d server_cookie=2ba3b547e316eee0 in_seq=0 out_seq=0 2024-09-15T23:00:33.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.983+0000 7fcbcd7fa640 10 client.27926 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.986+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1560748244 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad40c68b90 con 0x55ad40d11470 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.986+0000 7fcbcd7fa640 10 client.27926 handle_command_reply: tid=0 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.986+0000 7fcbee54a740 1 client.27926 shutdown 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.986+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 msgr2=0x55ad40cfe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.986+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400bd80 tx=0x7fcbd400f730 comp rx=0 tx=0).stop 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 shutdown_connections 2024-09-15T23:00:33.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40cfecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d11470 0x55ad40d138d0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cfe790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1560748244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cfe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:33.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 >> 172.21.15.66:0/1560748244 conn(0x55ad40cf27a0 msgr2=0x55ad40cf84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:33.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.987+0000 7fcbcd7fa640 0 client.27926 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:33.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.991+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 shutdown_connections 2024-09-15T23:00:33.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.992+0000 7fcbee54a740 1 -- 172.21.15.66:0/1560748244 wait complete. 2024-09-15T23:00:33.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:33.992+0000 7fcbee54a740 20 client.27926 trim_cache size 0 max 16384 2024-09-15T23:00:34.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.026+0000 7fcbee54a740 1 Processor -- start 2024-09-15T23:00:34.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.026+0000 7fcbee54a740 1 -- start start 2024-09-15T23:00:34.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cf83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40d191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c6710 con 0x55ad40d013f0 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c8550 con 0x55ad40cf6b30 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.027+0000 7fcbee54a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c6ea0 con 0x55ad40cf6210 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.031+0000 7fcbe9f0d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.031+0000 7fcbe9f0d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:33862/0 (socket says 172.21.15.66:33862) 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.031+0000 7fcbe9f0d640 1 -- 172.21.15.66:0/417637953 learned_addr learned my addr 172.21.15.66:0/417637953 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.032+0000 7fcbea70e640 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40d191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.032+0000 7fcbe970c640 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cf83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.033+0000 7fcbea70e640 1 -- 172.21.15.66:0/417637953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 msgr2=0x55ad40cf9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.033+0000 7fcbea70e640 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.034+0000 7fcbea70e640 1 -- 172.21.15.66:0/417637953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 msgr2=0x55ad40cf83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.034+0000 7fcbea70e640 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cf83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.034+0000 7fcbea70e640 1 -- 172.21.15.66:0/417637953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad40d0fb80 con 0x55ad40d013f0 2024-09-15T23:00:34.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.034+0000 7fcbea70e640 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40d191e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc030fd0 tx=0x7fcbdc009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4f5e53c038df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:34.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.035+0000 7fcbcf7fe640 1 -- 172.21.15.66:0/417637953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc02f6e0 con 0x55ad40d013f0 2024-09-15T23:00:34.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.035+0000 7fcbcf7fe640 1 -- 172.21.15.66:0/417637953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc042070 con 0x55ad40d013f0 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.035+0000 7fcbcf7fe640 1 -- 172.21.15.66:0/417637953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc003e00 con 0x55ad40d013f0 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.036+0000 7fcbee54a740 1 -- 172.21.15.66:0/417637953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 msgr2=0x55ad40d191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.036+0000 7fcbee54a740 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40d191e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc030fd0 tx=0x7fcbdc009d30 comp rx=0 tx=0).stop 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.036+0000 7fcbee54a740 1 -- 172.21.15.66:0/417637953 shutdown_connections 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.036+0000 7fcbee54a740 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40d013f0 0x55ad40d191e0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.037+0000 7fcbee54a740 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40cf6b30 0x55ad40cf83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.037+0000 7fcbee54a740 1 --2- 172.21.15.66:0/417637953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6210 0x55ad40cf9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.037+0000 7fcbee54a740 1 -- 172.21.15.66:0/417637953 >> 172.21.15.66:0/417637953 conn(0x55ad40cf27a0 msgr2=0x55ad40cf7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:34.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.041+0000 7fcbee54a740 1 -- 172.21.15.66:0/417637953 shutdown_connections 2024-09-15T23:00:34.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.041+0000 7fcbee54a740 1 -- 172.21.15.66:0/417637953 wait complete. 2024-09-15T23:00:34.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.041+0000 7fcbee54a740 1 -- start start 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.041+0000 7fcbee54a740 1 Processor -- start 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 0x55ad40cfb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 0x55ad40cfb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40cfbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c7dc0 con 0x55ad40cf6210 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c7630 con 0x55ad40d013f0 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41c4710 con 0x55ad40cf6b30 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbee54a740 10 client.0 _ll_register_callbacks cb 0x7fcbd400b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:34.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbe9f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 0x55ad40cfb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbe9f0d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 0x55ad40cfb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36398/0 (socket says 172.21.15.66:36398) 2024-09-15T23:00:34.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.042+0000 7fcbe9f0d640 1 -- 172.21.15.66:0/1081917747 learned_addr learned my addr 172.21.15.66:0/1081917747 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:34.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.043+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 0x55ad40cfb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbea70e640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40cfbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 -- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 msgr2=0x55ad40cfbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:34.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40cfbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 -- 172.21.15.66:0/1081917747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 msgr2=0x55ad40cfb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 0x55ad40cfb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 -- 172.21.15.66:0/1081917747 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad40d7b260 con 0x55ad40cf6b30 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbe970c640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 0x55ad40cfb820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55ad40cff800 tx=0x7fcbd4005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e55d2cb1fad1bedc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.046+0000 7fcbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.047+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4015070 con 0x55ad40cf6b30 2024-09-15T23:00:34.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.047+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7fcbd40035f0 con 0x55ad40cf6b30 2024-09-15T23:00:34.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.047+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbdc042070 con 0x55ad40cf6b30 2024-09-15T23:00:34.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.048+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fcbd4029040 con 0x55ad40cf6b30 2024-09-15T23:00:34.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.048+0000 7fcbee54a740 10 client.27808 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:34.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.048+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55ad40d7c560 con 0x55ad40cf6b30 2024-09-15T23:00:34.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.051+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc042070 con 0x55ad40cf6b30 2024-09-15T23:00:34.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.051+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fcbd402e430 con 0x55ad40cf6b30 2024-09-15T23:00:34.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 10 client.27808 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:34.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 10 client.27808 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:00:34.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 20 client.27808 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:34.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d7cd50 0x55ad40d7f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:34.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 4 client.27808 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6d64a139", "release": true, "await": true}] 2024-09-15T23:00:34.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.055+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6d64a139", "release": true, "await": true}) -- 0x55ad40c630a0 con 0x55ad40d7cd50 2024-09-15T23:00:34.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.056+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d7cd50 0x55ad40d7f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:34.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.058+0000 7fcbe9f0d640 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d7cd50 0x55ad40d7f170 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6cd45c6220dea0e server_cookie=53ba1dd0710fac40 in_seq=0 out_seq=0 2024-09-15T23:00:34.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:34.058+0000 7fcbcd7fa640 10 client.27808 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:35.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:35 smithi066 ceph-mon[31185]: pgmap v478: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 KiB/s wr, 28 op/s 2024-09-15T23:00:35.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.475+0000 7fcbcd7fa640 1 -- 172.21.15.66:0/1081917747 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ad40c630a0 con 0x55ad40d7cd50 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.475+0000 7fcbcd7fa640 10 client.27808 handle_command_reply: tid=0 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.475+0000 7fcbee54a740 1 client.27808 shutdown 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.475+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 msgr2=0x55ad40cfb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.475+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 0x55ad40cfb820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55ad40cff800 tx=0x7fcbd4005cc0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 shutdown_connections 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55ad40d7cd50 0x55ad40d7f170 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad40d013f0 0x55ad40cfbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ad40cf6b30 0x55ad40cfb820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 --2- 172.21.15.66:0/1081917747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad40cf6210 0x55ad40cfb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 >> 172.21.15.66:0/1081917747 conn(0x55ad40cf27a0 msgr2=0x55ad40cf1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbcd7fa640 0 client.27808 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 shutdown_connections 2024-09-15T23:00:35.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 1 -- 172.21.15.66:0/1081917747 wait complete. 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 63, 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 52, 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "6d64a139": { 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 52, 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:00:35.482 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 146.5, 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:00:35.483 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:35.484 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:00:35.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.477+0000 7fcbee54a740 20 client.27808 trim_cache size 0 max 16384 2024-09-15T23:00:35.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.478+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 msgr2=0x7fcbd00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:35.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.478+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 0x7fcbd00a5a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02fc60 tx=0x7fcbdc009c20 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.478+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 msgr2=0x7fcbe4084d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.478+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 0x7fcbe4084d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0035040 tx=0x7fcbe0033eb0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 shutdown_connections 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fcbd00a35c0 0x7fcbd00a5a80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe410e090 0x7fcbe407f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbe406ee70 0x7fcbe407ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 --2- 172.21.15.66:0/724224779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbe406e4f0 0x7fcbe4084d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.479+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 >> 172.21.15.66:0/724224779 conn(0x7fcbe4073180 msgr2=0x7fcbe406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.481+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 shutdown_connections 2024-09-15T23:00:35.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:35.481+0000 7fcbeaf0f640 1 -- 172.21.15.66:0/724224779 wait complete. 2024-09-15T23:00:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:35 smithi087 ceph-mon[35290]: pgmap v478: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 KiB/s wr, 28 op/s 2024-09-15T23:00:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:35 smithi184 ceph-mon[35203]: pgmap v478: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 KiB/s wr, 28 op/s 2024-09-15T23:00:36.372 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6d64a139', total seconds elapsed: 33.1 2024-09-15T23:00:37.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:37 smithi066 ceph-mon[31185]: pgmap v479: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 KiB/s wr, 38 op/s 2024-09-15T23:00:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:37 smithi087 ceph-mon[35290]: pgmap v479: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 KiB/s wr, 38 op/s 2024-09-15T23:00:37.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:37 smithi184 ceph-mon[35203]: pgmap v479: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 KiB/s wr, 38 op/s 2024-09-15T23:00:38.410 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:00:38.922 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:00:39.402 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:39 smithi066 ceph-mon[31185]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 176 KiB/s wr, 60 op/s 2024-09-15T23:00:39.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 -- 172.21.15.66:0/1043483695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 msgr2=0x7f8b5011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 --2- 172.21.15.66:0/1043483695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b5011d530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009860 tx=0x7f8b4802a360 comp rx=0 tx=0).stop 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 -- 172.21.15.66:0/1043483695 shutdown_connections 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 --2- 172.21.15.66:0/1043483695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b5011d530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 --2- 172.21.15.66:0/1043483695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50109830 0x7f8b50109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 --2- 172.21.15.66:0/1043483695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b50110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.575+0000 7f8b55f12640 1 -- 172.21.15.66:0/1043483695 >> 172.21.15.66:0/1043483695 conn(0x7f8b5006e140 msgr2=0x7f8b5006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.577+0000 7f8b55f12640 1 -- 172.21.15.66:0/1043483695 shutdown_connections 2024-09-15T23:00:39.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.577+0000 7f8b55f12640 1 -- 172.21.15.66:0/1043483695 wait complete. 2024-09-15T23:00:39.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.578+0000 7f8b55f12640 1 Processor -- start 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 -- start start 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b5011a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50109830 0x7f8b50113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b50120da0 con 0x7f8b50109450 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b50120c20 con 0x7f8b50109830 2024-09-15T23:00:39.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.579+0000 7f8b55f12640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b50120f20 con 0x7f8b5011b140 2024-09-15T23:00:39.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.581+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.582+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:33880/0 (socket says 172.21.15.66:33880) 2024-09-15T23:00:39.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.582+0000 7f8b4ffff640 1 -- 172.21.15.66:0/4267617534 learned_addr learned my addr 172.21.15.66:0/4267617534 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:39.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.582+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b5011a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 -- 172.21.15.66:0/4267617534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50109830 msgr2=0x7f8b50113770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50109830 0x7f8b50113770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 -- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 msgr2=0x7f8b5011a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b5011a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 -- 172.21.15.66:0/4267617534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b50114270 con 0x7f8b5011b140 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4ffff640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b4802a950 tx=0x7f8b48033cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.584+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b5011a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.585+0000 7f8b4cff9640 1 -- 172.21.15.66:0/4267617534 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4803f020 con 0x7f8b5011b140 2024-09-15T23:00:39.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.585+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b50114500 con 0x7f8b5011b140 2024-09-15T23:00:39.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.585+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b501184f0 con 0x7f8b5011b140 2024-09-15T23:00:39.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.585+0000 7f8b4cff9640 1 -- 172.21.15.66:0/4267617534 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b480303d0 con 0x7f8b5011b140 2024-09-15T23:00:39.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.585+0000 7f8b4cff9640 1 -- 172.21.15.66:0/4267617534 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48037040 con 0x7f8b5011b140 2024-09-15T23:00:39.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.593+0000 7f8b582eb740 1 Processor -- start 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.594+0000 7f8b4cff9640 1 -- 172.21.15.66:0/4267617534 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8b48042020 con 0x7f8b5011b140 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.595+0000 7f8b4cff9640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 0x7f8b3c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.595+0000 7f8b4cff9640 1 -- 172.21.15.66:0/4267617534 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f8b480b9b10 con 0x7f8b5011b140 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.595+0000 7f8b582eb740 1 -- start start 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccb4a0 0x563937ccb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563937c312e0 con 0x563937ccbdc0 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563937bd8ce0 con 0x563937ccb4a0 2024-09-15T23:00:39.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.596+0000 7f8b582eb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563937c2d2a0 con 0x563937cd6680 2024-09-15T23:00:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:39 smithi087 ceph-mon[35290]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 176 KiB/s wr, 60 op/s 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.600+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccb4a0 0x563937ccb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.600+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.601+0000 7f8b4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.601+0000 7f8b4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36426/0 (socket says 172.21.15.66:36426) 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.601+0000 7f8b4effd640 1 -- 172.21.15.66:0/2659588022 learned_addr learned my addr 172.21.15.66:0/2659588022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:39.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.601+0000 7f8b4effd640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 0x7f8b3c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 -- 172.21.15.66:0/2659588022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 msgr2=0x563937cd8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 -- 172.21.15.66:0/2659588022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccb4a0 msgr2=0x563937ccb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccb4a0 0x563937ccb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 -- 172.21.15.66:0/2659588022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563937bbd440 con 0x563937ccbdc0 2024-09-15T23:00:39.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f8b38013ab0 tx=0x7f8b38013f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a39b9adbef16d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.604+0000 7f8b4effd640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 0x7f8b3c0a58f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b38010860 tx=0x7f8b3800b000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.607+0000 7f8b45ffb640 1 -- 172.21.15.66:0/2659588022 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b380098d0 con 0x563937ccbdc0 2024-09-15T23:00:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.607+0000 7f8b45ffb640 1 -- 172.21.15.66:0/2659588022 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b38004030 con 0x563937ccbdc0 2024-09-15T23:00:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.607+0000 7f8b45ffb640 1 -- 172.21.15.66:0/2659588022 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800ec90 con 0x563937ccbdc0 2024-09-15T23:00:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.609+0000 7f8b582eb740 1 -- 172.21.15.66:0/2659588022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 msgr2=0x563937cd6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.609+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f8b38013ab0 tx=0x7f8b38013f70 comp rx=0 tx=0).stop 2024-09-15T23:00:39.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.612+0000 7f8b582eb740 1 -- 172.21.15.66:0/2659588022 shutdown_connections 2024-09-15T23:00:39.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.612+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.612+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cd6140 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.612+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2659588022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccb4a0 0x563937ccb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.612+0000 7f8b582eb740 1 -- 172.21.15.66:0/2659588022 >> 172.21.15.66:0/2659588022 conn(0x563937cc7a30 msgr2=0x563937cc7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.618+0000 7f8b582eb740 1 -- 172.21.15.66:0/2659588022 shutdown_connections 2024-09-15T23:00:39.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.618+0000 7f8b582eb740 1 -- 172.21.15.66:0/2659588022 wait complete. 2024-09-15T23:00:39.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.618+0000 7f8b582eb740 1 -- start start 2024-09-15T23:00:39.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.618+0000 7f8b582eb740 1 Processor -- start 2024-09-15T23:00:39.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563937cd9250 con 0x563937ccb4a0 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563937bec050 con 0x563937ccbdc0 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563937cd93d0 con 0x563937cd6680 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b582eb740 10 client.0 _ll_register_callbacks cb 0x563937c2c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36432/0 (socket says 172.21.15.66:36432) 2024-09-15T23:00:39.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.619+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2008501281 learned_addr learned my addr 172.21.15.66:0/2008501281 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.620+0000 7f8b4ffff640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.620+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.623+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2008501281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 msgr2=0x563937cd3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.623+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.623+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 msgr2=0x563937cd32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.623+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cd32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.623+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2008501281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639379a23c0 con 0x563937ccb4a0 2024-09-15T23:00:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.627+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000ff40 tx=0x7f8b4000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2b06d794f09d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.627+0000 7f8b2effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:00:39.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.637+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400195f0 con 0x563937ccb4a0 2024-09-15T23:00:39.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.637+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b38004030 con 0x563937ccb4a0 2024-09-15T23:00:39.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.637+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f8b40019790 con 0x563937ccb4a0 2024-09-15T23:00:39.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.640+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8b40027050 con 0x563937ccb4a0 2024-09-15T23:00:39.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.641+0000 7f8b582eb740 10 client.18642 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:39.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.641+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x563937ce4d00 con 0x563937ccb4a0 2024-09-15T23:00:39.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b38004030 con 0x563937ccb4a0 2024-09-15T23:00:39.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f8b4000b040 con 0x563937ccb4a0 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 10 client.18642 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 10 client.18642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 20 client.18642 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937ce66c0 0x563937ce8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 4 client.18642 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:00:39.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.642+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563937c3e850 con 0x563937ce66c0 2024-09-15T23:00:39.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.646+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937ce66c0 0x563937ce8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.658+0000 7f8b4effd640 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937ce66c0 0x563937ce8b20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4517a5f312c29eb6 server_cookie=8589f0ef302c469b in_seq=0 out_seq=0 2024-09-15T23:00:39.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.659+0000 7f8b2effd640 10 client.18642 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:39.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.662+0000 7f8b2effd640 1 -- 172.21.15.66:0/2008501281 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563937c3e850 con 0x563937ce66c0 2024-09-15T23:00:39.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.662+0000 7f8b2effd640 10 client.18642 handle_command_reply: tid=0 2024-09-15T23:00:39.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.662+0000 7f8b582eb740 1 client.18642 shutdown 2024-09-15T23:00:39.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 msgr2=0x563937cd6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000ff40 tx=0x7f8b4000d7b0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 shutdown_connections 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937cd6680 0x563937cd3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937ce66c0 0x563937ce8b20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cd32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2008501281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccb4a0 0x563937cd6010 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 >> 172.21.15.66:0/2008501281 conn(0x563937cc7a30 msgr2=0x563937cc6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.664+0000 7f8b2effd640 0 client.18642 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:39.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.669+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 shutdown_connections 2024-09-15T23:00:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:39 smithi184 ceph-mon[35203]: pgmap v480: 129 pgs: 15 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 73 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 176 KiB/s wr, 60 op/s 2024-09-15T23:00:39.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.671+0000 7f8b582eb740 1 -- 172.21.15.66:0/2008501281 wait complete. 2024-09-15T23:00:39.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.672+0000 7f8b582eb740 20 client.18642 trim_cache size 0 max 16384 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 Processor -- start 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 -- start start 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937cd6680 0x563937cee970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30010300 con 0x563937cd6680 2024-09-15T23:00:39.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30012140 con 0x563937ccbdc0 2024-09-15T23:00:39.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.709+0000 7f8b582eb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30010a90 con 0x563937ccb4a0 2024-09-15T23:00:39.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.712+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.712+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:33906/0 (socket says 172.21.15.66:33906) 2024-09-15T23:00:39.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.712+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2105967339 learned_addr learned my addr 172.21.15.66:0/2105967339 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:39.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.713+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2105967339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 msgr2=0x563937cee430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:00:39.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.713+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cee430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.713+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2105967339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937cd6680 msgr2=0x563937cee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.713+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937cd6680 0x563937cee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.713+0000 7f8b4f7fe640 1 -- 172.21.15.66:0/2105967339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563937ccb2d0 con 0x563937ccb4a0 2024-09-15T23:00:39.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.716+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000bb00 tx=0x7f8b4000bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=243c18fcba2916f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.717+0000 7f8b457fa640 1 -- 172.21.15.66:0/2105967339 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40030070 con 0x563937ccb4a0 2024-09-15T23:00:39.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.717+0000 7f8b457fa640 1 -- 172.21.15.66:0/2105967339 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b4001e070 con 0x563937ccb4a0 2024-09-15T23:00:39.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.717+0000 7f8b457fa640 1 -- 172.21.15.66:0/2105967339 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40005290 con 0x563937ccb4a0 2024-09-15T23:00:39.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.720+0000 7f8b582eb740 1 -- 172.21.15.66:0/2105967339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 msgr2=0x563937ce2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.720+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000bb00 tx=0x7f8b4000bf80 comp rx=0 tx=0).stop 2024-09-15T23:00:39.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.722+0000 7f8b582eb740 1 -- 172.21.15.66:0/2105967339 shutdown_connections 2024-09-15T23:00:39.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.722+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937cd6680 0x563937cee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.722+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937ccbdc0 0x563937cee430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.722+0000 7f8b582eb740 1 --2- 172.21.15.66:0/2105967339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937ce2510 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.722+0000 7f8b582eb740 1 -- 172.21.15.66:0/2105967339 >> 172.21.15.66:0/2105967339 conn(0x563937cc7a30 msgr2=0x563937cd3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.724+0000 7f8b582eb740 1 -- 172.21.15.66:0/2105967339 shutdown_connections 2024-09-15T23:00:39.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.727+0000 7f8b582eb740 1 -- 172.21.15.66:0/2105967339 wait complete. 2024-09-15T23:00:39.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.727+0000 7f8b582eb740 1 -- start start 2024-09-15T23:00:39.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.727+0000 7f8b582eb740 1 Processor -- start 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937cdc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cdc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 0x563937cdcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300119b0 con 0x563937ccbdc0 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30011220 con 0x563937cd6680 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3000e300 con 0x563937ccb4a0 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b582eb740 10 client.0 _ll_register_callbacks cb 0x7f8b40009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b4effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cdc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937cdc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 0x563937cdcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 0x563937cdcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:58690/0 (socket says 172.21.15.66:58690) 2024-09-15T23:00:39.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.728+0000 7f8b4ffff640 1 -- 172.21.15.66:0/856910730 learned_addr learned my addr 172.21.15.66:0/856910730 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:00:39.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.732+0000 7f8b4effd640 1 -- 172.21.15.66:0/856910730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 msgr2=0x563937cdc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.732+0000 7f8b4effd640 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937cdc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.732+0000 7f8b4effd640 1 -- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 msgr2=0x563937cdcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:00:39.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.732+0000 7f8b4effd640 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 0x563937cdcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.732+0000 7f8b4effd640 1 -- 172.21.15.66:0/856910730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563937ccc6a0 con 0x563937ccbdc0 2024-09-15T23:00:39.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.747+0000 7f8b4effd640 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cdc8b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800efd0 tx=0x7f8b38009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35ccb4414d9f6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:00:39.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.747+0000 7f8b2effd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:00:39.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.748+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38038060 con 0x563937ccbdc0 2024-09-15T23:00:39.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.748+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b4001e070 con 0x563937ccbdc0 2024-09-15T23:00:39.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.748+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9679+0+0 (secure 0 0 0) 0x7f8b38013250 con 0x563937ccbdc0 2024-09-15T23:00:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.750+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8b38013470 con 0x563937ccbdc0 2024-09-15T23:00:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.750+0000 7f8b582eb740 10 client.18645 fetch_fsmap learned FSMap version 63 2024-09-15T23:00:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.750+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x563937d514b0 con 0x563937ccbdc0 2024-09-15T23:00:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.750+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b4001e070 con 0x563937ccbdc0 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f8b3801c070 con 0x563937ccbdc0 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 10 client.18645 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 20 client.18645 populate_metadata read hostname 'smithi066' 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937d51c20 0x563937d54040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:00:39.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 4 client.18645 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:00:39.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.752+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563937c38d60 con 0x563937d51c20 2024-09-15T23:00:39.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.755+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937d51c20 0x563937d54040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:00:39.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.762+0000 7f8b4f7fe640 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937d51c20 0x563937d54040 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce35676f6f6158bd server_cookie=b210bfca0afe923b in_seq=0 out_seq=0 2024-09-15T23:00:39.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.763+0000 7f8b2effd640 10 client.18645 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.763+0000 7f8b2effd640 1 -- 172.21.15.66:0/856910730 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563937c38d60 con 0x563937d51c20 2024-09-15T23:00:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.763+0000 7f8b2effd640 10 client.18645 handle_command_reply: tid=0 2024-09-15T23:00:39.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.763+0000 7f8b582eb740 1 client.18645 shutdown 2024-09-15T23:00:39.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.769+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 msgr2=0x563937cdc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.769+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cdc8b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800efd0 tx=0x7f8b38009dd0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 shutdown_connections 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x563937d51c20 0x563937d54040 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563937cd6680 0x563937cdcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563937ccbdc0 0x563937cdc8b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 --2- 172.21.15.66:0/856910730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563937ccb4a0 0x563937cdc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b2effd640 0 client.18645 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:00:39.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 >> 172.21.15.66:0/856910730 conn(0x563937cc7a30 msgr2=0x563937cc6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 shutdown_connections 2024-09-15T23:00:39.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.772+0000 7f8b582eb740 1 -- 172.21.15.66:0/856910730 wait complete. 2024-09-15T23:00:39.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.773+0000 7f8b582eb740 20 client.18645 trim_cache size 0 max 16384 2024-09-15T23:00:39.775 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:00:39.775 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:00:39.775 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T23:00:39.775 INFO:teuthology.orchestra.run.smithi066.stdout: "5d557e24-e35c-4b9d-9e84-b843cb3b9c06": { 2024-09-15T23:00:39.775 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T23:00:39.776 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "5d557e24-e35c-4b9d-9e84-b843cb3b9c06", 2024-09-15T23:00:39.776 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T23:00:39.776 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:39.776 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:00:39.776 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:00:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 msgr2=0x7f8b3c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 0x7f8b3c0a58f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b38010860 tx=0x7f8b3800b000 comp rx=0 tx=0).stop 2024-09-15T23:00:39.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 msgr2=0x7f8b50113cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b4802a950 tx=0x7f8b48033cf0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 shutdown_connections 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b3c0a3430 0x7f8b3c0a58f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5011b140 0x7f8b50113cb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50109830 0x7f8b50113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 --2- 172.21.15.66:0/4267617534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b50109450 0x7f8b5011a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 >> 172.21.15.66:0/4267617534 conn(0x7f8b5006e140 msgr2=0x7f8b50070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:00:39.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 shutdown_connections 2024-09-15T23:00:39.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:00:39.776+0000 7f8b55f12640 1 -- 172.21.15.66:0/4267617534 wait complete. 2024-09-15T23:00:40.597 INFO:tasks.cephfs.filesystem:scrub status for tag:5d557e24-e35c-4b9d-9e84-b843cb3b9c06 - {'path': '/', 'tag': '5d557e24-e35c-4b9d-9e84-b843cb3b9c06', 'options': 'recursive,force'} 2024-09-15T23:00:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:41 smithi087 ceph-mon[35290]: pgmap v481: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 304 KiB/s wr, 94 op/s 2024-09-15T23:00:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:41 smithi184 ceph-mon[35203]: pgmap v481: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 304 KiB/s wr, 94 op/s 2024-09-15T23:00:41.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:41 smithi066 ceph-mon[31185]: pgmap v481: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 304 KiB/s wr, 94 op/s 2024-09-15T23:00:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:43 smithi087 ceph-mon[35290]: pgmap v482: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 307 KiB/s wr, 101 op/s 2024-09-15T23:00:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:43 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:43.684 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:43 smithi184 ceph-mon[35203]: pgmap v482: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 307 KiB/s wr, 101 op/s 2024-09-15T23:00:43.684 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:43 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:43.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:43 smithi066 ceph-mon[31185]: pgmap v482: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 307 KiB/s wr, 101 op/s 2024-09-15T23:00:43.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:43 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:00:45.486 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:45 smithi184 ceph-mon[35203]: pgmap v483: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 959 KiB/s wr, 174 op/s 2024-09-15T23:00:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:45 smithi087 ceph-mon[35290]: pgmap v483: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 959 KiB/s wr, 174 op/s 2024-09-15T23:00:45.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:45 smithi066 ceph-mon[31185]: pgmap v483: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 959 KiB/s wr, 174 op/s 2024-09-15T23:00:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:47 smithi087 ceph-mon[35290]: pgmap v484: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 954 KiB/s wr, 173 op/s 2024-09-15T23:00:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:47 smithi184 ceph-mon[35203]: pgmap v484: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 954 KiB/s wr, 173 op/s 2024-09-15T23:00:47.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:47 smithi066 ceph-mon[31185]: pgmap v484: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 954 KiB/s wr, 173 op/s 2024-09-15T23:00:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:49 smithi087 ceph-mon[35290]: pgmap v485: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-15T23:00:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:49 smithi184 ceph-mon[35203]: pgmap v485: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-15T23:00:49.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:49 smithi066 ceph-mon[31185]: pgmap v485: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 192 op/s 2024-09-15T23:00:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:00:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:00:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:50 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:00:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:00:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:00:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:50 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:00:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:00:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:00:50.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:50 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:00:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:51 smithi087 ceph-mon[35290]: pgmap v486: 129 pgs: 11 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 85 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-15T23:00:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:51 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:00:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:51 smithi184 ceph-mon[35203]: pgmap v486: 129 pgs: 11 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 85 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-15T23:00:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:51 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:00:51.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:51 smithi066 ceph-mon[31185]: pgmap v486: 129 pgs: 11 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 85 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-09-15T23:00:51.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:51 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:00:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:52 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:00:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:52 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:00:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:52 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:00:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:52 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:00:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:52 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:00:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:52 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:00:52.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:52 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:00:52.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:52 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:00:52.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:52 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:00:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:53 smithi087 ceph-mon[35290]: pgmap v487: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-15T23:00:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:53 smithi184 ceph-mon[35203]: pgmap v487: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-15T23:00:53.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:53 smithi066 ceph-mon[31185]: pgmap v487: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 185 op/s 2024-09-15T23:00:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:55 smithi087 ceph-mon[35290]: pgmap v488: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2024-09-15T23:00:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:55 smithi184 ceph-mon[35203]: pgmap v488: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2024-09-15T23:00:55.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:55 smithi066 ceph-mon[31185]: pgmap v488: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 219 op/s 2024-09-15T23:00:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:57 smithi087 ceph-mon[35290]: pgmap v489: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-15T23:00:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:57 smithi184 ceph-mon[35203]: pgmap v489: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-15T23:00:57.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:57 smithi066 ceph-mon[31185]: pgmap v489: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-15T23:00:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:00:59 smithi087 ceph-mon[35290]: pgmap v490: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-15T23:00:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:00:59 smithi184 ceph-mon[35203]: pgmap v490: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-15T23:00:59.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:00:59 smithi066 ceph-mon[31185]: pgmap v490: 129 pgs: 9 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 102 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-15T23:01:01.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:01 smithi066 ceph-mon[31185]: pgmap v491: 129 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 109 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 171 op/s 2024-09-15T23:01:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:01 smithi087 ceph-mon[35290]: pgmap v491: 129 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 109 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 171 op/s 2024-09-15T23:01:01.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:01 smithi184 ceph-mon[35203]: pgmap v491: 129 pgs: 8 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 109 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 171 op/s 2024-09-15T23:01:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:03 smithi087 ceph-mon[35290]: pgmap v492: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-15T23:01:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:03 smithi184 ceph-mon[35203]: pgmap v492: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-15T23:01:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:03 smithi066 ceph-mon[31185]: pgmap v492: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-15T23:01:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:05 smithi087 ceph-mon[35290]: pgmap v493: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-15T23:01:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:05 smithi184 ceph-mon[35203]: pgmap v493: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-15T23:01:05.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:05 smithi066 ceph-mon[31185]: pgmap v493: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-15T23:01:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:07 smithi087 ceph-mon[35290]: pgmap v494: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-15T23:01:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:07 smithi184 ceph-mon[35203]: pgmap v494: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-15T23:01:07.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:07 smithi066 ceph-mon[31185]: pgmap v494: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-09-15T23:01:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:09 smithi087 ceph-mon[35290]: pgmap v495: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-09-15T23:01:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:09 smithi087 ceph-mon[35290]: osdmap e110: 12 total, 12 up, 12 in 2024-09-15T23:01:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:09 smithi184 ceph-mon[35203]: pgmap v495: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-09-15T23:01:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:09 smithi184 ceph-mon[35203]: osdmap e110: 12 total, 12 up, 12 in 2024-09-15T23:01:09.704 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:09 smithi066 ceph-mon[31185]: pgmap v495: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-09-15T23:01:09.704 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:09 smithi066 ceph-mon[31185]: osdmap e110: 12 total, 12 up, 12 in 2024-09-15T23:01:10.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:01:11.136 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:11 smithi087 ceph-mon[35290]: pgmap v497: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-09-15T23:01:11.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:11 smithi087 ceph-mon[35290]: osdmap e111: 12 total, 12 up, 12 in 2024-09-15T23:01:11.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:11 smithi184 ceph-mon[35203]: pgmap v497: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-09-15T23:01:11.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:11 smithi184 ceph-mon[35203]: osdmap e111: 12 total, 12 up, 12 in 2024-09-15T23:01:11.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:11 smithi066 ceph-mon[31185]: pgmap v497: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-09-15T23:01:11.440 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:11 smithi066 ceph-mon[31185]: osdmap e111: 12 total, 12 up, 12 in 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.792+0000 7f799cf0a640 1 -- 172.21.15.66:0/3253515782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109450 msgr2=0x7f7998110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.793+0000 7f799cf0a640 1 --2- 172.21.15.66:0/3253515782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109450 0x7f7998110250 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f798801a910 tx=0x7f798803b450 comp rx=0 tx=0).stop 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.793+0000 7f799cf0a640 1 -- 172.21.15.66:0/3253515782 shutdown_connections 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.793+0000 7f799cf0a640 1 --2- 172.21.15.66:0/3253515782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 0x7f799811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.793+0000 7f799cf0a640 1 --2- 172.21.15.66:0/3253515782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109830 0x7f7998109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.793+0000 7f799cf0a640 1 --2- 172.21.15.66:0/3253515782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109450 0x7f7998110250 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.794+0000 7f799cf0a640 1 -- 172.21.15.66:0/3253515782 >> 172.21.15.66:0/3253515782 conn(0x7f799806e140 msgr2=0x7f799806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.799+0000 7f799cf0a640 1 -- 172.21.15.66:0/3253515782 shutdown_connections 2024-09-15T23:01:11.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.799+0000 7f799cf0a640 1 -- 172.21.15.66:0/3253515782 wait complete. 2024-09-15T23:01:11.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.800+0000 7f799cf0a640 1 Processor -- start 2024-09-15T23:01:11.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.800+0000 7f799cf0a640 1 -- start start 2024-09-15T23:01:11.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.800+0000 7f799cf0a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109450 0x7f799811a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.800+0000 7f799cf0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f799cf0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 0x7f7998116eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f799cf0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7998113360 con 0x7f7998109830 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f799cf0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79981131e0 con 0x7f799811b140 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f799cf0a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79981134e0 con 0x7f7998109450 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 0x7f7998116eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f798ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f798ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41882/0 (socket says 172.21.15.66:41882) 2024-09-15T23:01:11.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f798ffff640 1 -- 172.21.15.66:0/2120637795 learned_addr learned my addr 172.21.15.66:0/2120637795 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:11.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.801+0000 7f799659c640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109450 0x7f799811a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 -- 172.21.15.66:0/2120637795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109450 msgr2=0x7f799811a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109450 0x7f799811a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 -- 172.21.15.66:0/2120637795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 msgr2=0x7f7998116eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 0x7f7998116eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 -- 172.21.15.66:0/2120637795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79981175e0 con 0x7f7998109830 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798ffff640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f798000b450 tx=0x7f798000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.806+0000 7f798f7fe640 1 -- 172.21.15.66:0/2120637795 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980015020 con 0x7f7998109830 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.807+0000 7f798f7fe640 1 -- 172.21.15.66:0/2120637795 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7980011d70 con 0x7f7998109830 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.807+0000 7f798f7fe640 1 -- 172.21.15.66:0/2120637795 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798000f340 con 0x7f7998109830 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.807+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79981ab170 con 0x7f7998109830 2024-09-15T23:01:11.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.807+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79981ab570 con 0x7f7998109830 2024-09-15T23:01:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.816+0000 7f798f7fe640 1 -- 172.21.15.66:0/2120637795 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7980018020 con 0x7f7998109830 2024-09-15T23:01:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.817+0000 7f798f7fe640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 0x7f79840a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.817+0000 7f798f7fe640 1 -- 172.21.15.66:0/2120637795 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f79800cfa30 con 0x7f7998109830 2024-09-15T23:01:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 Processor -- start 2024-09-15T23:01:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 -- start start 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae504a0 0x5617eae50880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5617eadb62e0 con 0x5617eae5b680 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5617ead5dce0 con 0x5617eae50dc0 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.818+0000 7f799f2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5617eadb22a0 con 0x5617eae504a0 2024-09-15T23:01:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.819+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.819+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41894/0 (socket says 172.21.15.66:41894) 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.819+0000 7f7996d9d640 1 -- 172.21.15.66:0/960519842 learned_addr learned my addr 172.21.15.66:0/960519842 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.820+0000 7f7996d9d640 1 -- 172.21.15.66:0/960519842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae504a0 msgr2=0x5617eae50880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.820+0000 7f7996d9d640 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae504a0 0x5617eae50880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.820+0000 7f7996d9d640 1 -- 172.21.15.66:0/960519842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 msgr2=0x5617eae5b140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.820+0000 7f7996d9d640 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae5b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.820+0000 7f7996d9d640 1 -- 172.21.15.66:0/960519842 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ead42440 con 0x5617eae5b680 2024-09-15T23:01:11.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.821+0000 7f7996d9d640 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7990007ea0 tx=0x7f7990007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccfb8ea1faee646 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.823+0000 7f798cff9640 1 -- 172.21.15.66:0/960519842 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990003b70 con 0x5617eae5b680 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.823+0000 7f798cff9640 1 -- 172.21.15.66:0/960519842 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7990003d10 con 0x5617eae5b680 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.823+0000 7f798cff9640 1 -- 172.21.15.66:0/960519842 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990010bb0 con 0x5617eae5b680 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.825+0000 7f799659c640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 0x7f79840a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.825+0000 7f799f2e3740 1 -- 172.21.15.66:0/960519842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 msgr2=0x5617eae5da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.825+0000 7f799f2e3740 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7990007ea0 tx=0x7f7990007f90 comp rx=0 tx=0).stop 2024-09-15T23:01:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.828+0000 7f799f2e3740 1 -- 172.21.15.66:0/960519842 shutdown_connections 2024-09-15T23:01:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.828+0000 7f799f2e3740 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae5b680 0x5617eae5da70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.828+0000 7f799f2e3740 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae5b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.828+0000 7f799f2e3740 1 --2- 172.21.15.66:0/960519842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae504a0 0x5617eae50880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.828+0000 7f799f2e3740 1 -- 172.21.15.66:0/960519842 >> 172.21.15.66:0/960519842 conn(0x5617eae4ca30 msgr2=0x5617eae4ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.832+0000 7f799f2e3740 1 -- 172.21.15.66:0/960519842 shutdown_connections 2024-09-15T23:01:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.838+0000 7f799f2e3740 1 -- 172.21.15.66:0/960519842 wait complete. 2024-09-15T23:01:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.838+0000 7f799f2e3740 1 -- start start 2024-09-15T23:01:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.838+0000 7f799f2e3740 1 Processor -- start 2024-09-15T23:01:11.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 0x5617eae5af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae50dc0 0x5617eae58230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae58770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5617eae5e250 con 0x5617eae50dc0 2024-09-15T23:01:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5617ead71050 con 0x5617eae504a0 2024-09-15T23:01:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5617eae5e3d0 con 0x5617eae5b680 2024-09-15T23:01:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.839+0000 7f799f2e3740 10 client.0 _ll_register_callbacks cb 0x5617eadb1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.840+0000 7f799659c640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 0x7f79840a5a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7988005a90 tx=0x7f7988005a00 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.842+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae58770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.842+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae58770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35336/0 (socket says 172.21.15.66:35336) 2024-09-15T23:01:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.842+0000 7f7996d9d640 1 -- 172.21.15.66:0/906917662 learned_addr learned my addr 172.21.15.66:0/906917662 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.842+0000 7f799659c640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 0x5617eae5af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.842+0000 7f798ffff640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae50dc0 0x5617eae58230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.843+0000 7f799659c640 1 -- 172.21.15.66:0/906917662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 msgr2=0x5617eae58770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.843+0000 7f799659c640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae58770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.843+0000 7f799659c640 1 -- 172.21.15.66:0/906917662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae50dc0 msgr2=0x5617eae58230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.843+0000 7f799659c640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae50dc0 0x5617eae58230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.843+0000 7f799659c640 1 -- 172.21.15.66:0/906917662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617eab273c0 con 0x5617eae504a0 2024-09-15T23:01:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.853+0000 7f799659c640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 0x5617eae5af80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c00 tx=0x7f798801a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712e4fa36a2672c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.853+0000 7f797dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.858+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798805e020 con 0x5617eae504a0 2024-09-15T23:01:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.858+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f7988004230 con 0x5617eae504a0 2024-09-15T23:01:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.858+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7990003d10 con 0x5617eae504a0 2024-09-15T23:01:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.867+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f7988046050 con 0x5617eae504a0 2024-09-15T23:01:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.867+0000 7f799f2e3740 10 client.27950 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.867+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5617eae69c50 con 0x5617eae504a0 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.868+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7990003d10 con 0x5617eae504a0 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.868+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f79880407c0 con 0x5617eae504a0 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 10 client.27950 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 10 client.27950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 20 client.27950 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eae6b0b0 0x5617eae6d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 4 client.27950 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617eadc3850 con 0x5617eae6b0b0 2024-09-15T23:01:11.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.869+0000 7f798ffff640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eae6b0b0 0x5617eae6d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.875+0000 7f798ffff640 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eae6b0b0 0x5617eae6d530 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b40aa9e38012d65 server_cookie=b2e9b82ed0d20f4c in_seq=0 out_seq=0 2024-09-15T23:01:11.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.875+0000 7f797dffb640 10 client.27950 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.877+0000 7f797dffb640 1 -- 172.21.15.66:0/906917662 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617eadc3850 con 0x5617eae6b0b0 2024-09-15T23:01:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.877+0000 7f797dffb640 10 client.27950 handle_command_reply: tid=0 2024-09-15T23:01:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.877+0000 7f799f2e3740 1 client.27950 shutdown 2024-09-15T23:01:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.877+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 msgr2=0x5617eae5af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.877+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 0x5617eae5af80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7988000c00 tx=0x7f798801a270 comp rx=0 tx=0).stop 2024-09-15T23:01:11.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 shutdown_connections 2024-09-15T23:01:11.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae58770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae50dc0 0x5617eae58230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eae6b0b0 0x5617eae6d530 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 --2- 172.21.15.66:0/906917662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae504a0 0x5617eae5af80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 >> 172.21.15.66:0/906917662 conn(0x5617eae4ca30 msgr2=0x5617eae52710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.882+0000 7f797dffb640 0 client.27950 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:11.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.886+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 shutdown_connections 2024-09-15T23:01:11.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.887+0000 7f799f2e3740 1 -- 172.21.15.66:0/906917662 wait complete. 2024-09-15T23:01:11.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.888+0000 7f799f2e3740 20 client.27950 trim_cache size 0 max 16384 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.921+0000 7f799f2e3740 1 Processor -- start 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.921+0000 7f799f2e3740 1 -- start start 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.921+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.921+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.921+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae73340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.922+0000 7f799f2e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b5a10 con 0x5617eae504a0 2024-09-15T23:01:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.922+0000 7f799f2e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b7850 con 0x5617eae50dc0 2024-09-15T23:01:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.922+0000 7f799f2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b61a0 con 0x5617eae5b680 2024-09-15T23:01:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.923+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.923+0000 7f798ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.923+0000 7f798ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:45628/0 (socket says 172.21.15.66:45628) 2024-09-15T23:01:11.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.923+0000 7f798ffff640 1 -- 172.21.15.66:0/3005249491 learned_addr learned my addr 172.21.15.66:0/3005249491 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.924+0000 7f798ffff640 1 -- 172.21.15.66:0/3005249491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 msgr2=0x5617eae73340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.924+0000 7f798ffff640 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae73340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.924+0000 7f798ffff640 1 -- 172.21.15.66:0/3005249491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 msgr2=0x5617eae674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.924+0000 7f798ffff640 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.924+0000 7f798ffff640 1 -- 172.21.15.66:0/3005249491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617eae50220 con 0x5617eae50dc0 2024-09-15T23:01:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.925+0000 7f798ffff640 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79800982e0 tx=0x7f7980010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee0fdeae6f8d7045 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.928+0000 7f797ffff640 1 -- 172.21.15.66:0/3005249491 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79800b9070 con 0x5617eae50dc0 2024-09-15T23:01:11.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.928+0000 7f797ffff640 1 -- 172.21.15.66:0/3005249491 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f798009fcc0 con 0x5617eae50dc0 2024-09-15T23:01:11.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.928+0000 7f797ffff640 1 -- 172.21.15.66:0/3005249491 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79800ccef0 con 0x5617eae50dc0 2024-09-15T23:01:11.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.929+0000 7f799f2e3740 1 -- 172.21.15.66:0/3005249491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 msgr2=0x5617eae72e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.929+0000 7f799f2e3740 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79800982e0 tx=0x7f7980010990 comp rx=0 tx=0).stop 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 -- 172.21.15.66:0/3005249491 shutdown_connections 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae5b680 0x5617eae73340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae50dc0 0x5617eae72e00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 --2- 172.21.15.66:0/3005249491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 -- 172.21.15.66:0/3005249491 >> 172.21.15.66:0/3005249491 conn(0x5617eae4ca30 msgr2=0x5617eae57320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.930+0000 7f799f2e3740 1 -- 172.21.15.66:0/3005249491 shutdown_connections 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 -- 172.21.15.66:0/3005249491 wait complete. 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 -- start start 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 Processor -- start 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae63b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae50dc0 0x5617eae54cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 0x5617eae55230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b70c0 con 0x5617eae504a0 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b6930 con 0x5617eae5b680 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.931+0000 7f799f2e3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79981b3a10 con 0x5617eae50dc0 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.932+0000 7f799f2e3740 10 client.0 _ll_register_callbacks cb 0x7f7988051070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.932+0000 7f799659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae63b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.932+0000 7f799659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae63b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41928/0 (socket says 172.21.15.66:41928) 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.932+0000 7f799659c640 1 -- 172.21.15.66:0/789117321 learned_addr learned my addr 172.21.15.66:0/789117321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.933+0000 7f798ffff640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae50dc0 0x5617eae54cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.933+0000 7f7996d9d640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 0x5617eae55230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.934+0000 7f7996d9d640 1 -- 172.21.15.66:0/789117321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae50dc0 msgr2=0x5617eae54cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.934+0000 7f7996d9d640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae50dc0 0x5617eae54cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.934+0000 7f7996d9d640 1 -- 172.21.15.66:0/789117321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 msgr2=0x5617eae63b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.934+0000 7f7996d9d640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae63b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.934+0000 7f7996d9d640 1 -- 172.21.15.66:0/789117321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617eae557f0 con 0x5617eae5b680 2024-09-15T23:01:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.937+0000 7f7996d9d640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 0x5617eae55230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7990010830 tx=0x7f7990012a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a6f34cfcc50dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.938+0000 7f797dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.939+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990027070 con 0x5617eae5b680 2024-09-15T23:01:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.939+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f798009fcc0 con 0x5617eae5b680 2024-09-15T23:01:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.939+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f7990010860 con 0x5617eae5b680 2024-09-15T23:01:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.940+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f7990033050 con 0x5617eae5b680 2024-09-15T23:01:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.940+0000 7f799f2e3740 10 client.27956 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.940+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5617eaef7b60 con 0x5617eae5b680 2024-09-15T23:01:11.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f798009fcc0 con 0x5617eae5b680 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f7990023450 con 0x5617eae5b680 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 10 client.27956 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 10 client.27956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 20 client.27956 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eaef8300 0x5617eaefa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 4 client.27956 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:01:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.941+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617eadbdd60 con 0x5617eaef8300 2024-09-15T23:01:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.944+0000 7f799659c640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eaef8300 0x5617eaefa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.945+0000 7f797dffb640 10 client.27956 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.945+0000 7f799659c640 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eaef8300 0x5617eaefa720 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eadd93cf46bb5d0 server_cookie=83846d1cc81f722f in_seq=0 out_seq=0 2024-09-15T23:01:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.945+0000 7f797dffb640 1 -- 172.21.15.66:0/789117321 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617eadbdd60 con 0x5617eaef8300 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.945+0000 7f797dffb640 10 client.27956 handle_command_reply: tid=0 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.945+0000 7f799f2e3740 1 client.27956 shutdown 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 msgr2=0x5617eae55230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 0x5617eae55230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7990010830 tx=0x7f7990012a00 comp rx=0 tx=0).stop 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 shutdown_connections 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5617eaef8300 0x5617eaefa720 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617eae5b680 0x5617eae55230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5617eae50dc0 0x5617eae54cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 --2- 172.21.15.66:0/789117321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5617eae504a0 0x5617eae63b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 >> 172.21.15.66:0/789117321 conn(0x5617eae4ca30 msgr2=0x5617eae51ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f797dffb640 0 client.27956 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 shutdown_connections 2024-09-15T23:01:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.946+0000 7f799f2e3740 1 -- 172.21.15.66:0/789117321 wait complete. 2024-09-15T23:01:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.947+0000 7f799f2e3740 20 client.27956 trim_cache size 0 max 16384 2024-09-15T23:01:11.950 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:01:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T23:01:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T23:01:11.951 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:01:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.949+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 msgr2=0x7f79840a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.949+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 0x7f79840a5a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7988005a90 tx=0x7f7988005a00 comp rx=0 tx=0).stop 2024-09-15T23:01:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.949+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 msgr2=0x7f7998116970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.949+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f798000b450 tx=0x7f798000b910 comp rx=0 tx=0).stop 2024-09-15T23:01:11.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 shutdown_connections 2024-09-15T23:01:11.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f79840a35c0 0x7f79840a5a80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f799811b140 0x7f7998116eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7998109830 0x7f7998116970 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 --2- 172.21.15.66:0/2120637795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7998109450 0x7f799811a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.951+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 >> 172.21.15.66:0/2120637795 conn(0x7f799806e140 msgr2=0x7f7998072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.952+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 shutdown_connections 2024-09-15T23:01:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:11.952+0000 7f799cf0a640 1 -- 172.21.15.66:0/2120637795 wait complete. 2024-09-15T23:01:13.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:13 smithi087 ceph-mon[35290]: pgmap v499: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.2 MiB/s wr, 158 op/s 2024-09-15T23:01:13.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:13 smithi184 ceph-mon[35203]: pgmap v499: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.2 MiB/s wr, 158 op/s 2024-09-15T23:01:13.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:13 smithi066 ceph-mon[31185]: pgmap v499: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.2 MiB/s wr, 158 op/s 2024-09-15T23:01:13.638 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:01:13.639 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:01:14.212 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.822+0000 7f303a2fc640 1 -- 172.21.15.66:0/4066191215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034109130 msgr2=0x7f3034110cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.822+0000 7f303a2fc640 1 --2- 172.21.15.66:0/4066191215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034109130 0x7f3034110cb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f302c009be0 tx=0x7f302c02a710 comp rx=0 tx=0).stop 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.823+0000 7f303a2fc640 1 -- 172.21.15.66:0/4066191215 shutdown_connections 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.823+0000 7f303a2fc640 1 --2- 172.21.15.66:0/4066191215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034109130 0x7f3034110cb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.823+0000 7f303a2fc640 1 --2- 172.21.15.66:0/4066191215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30341049b0 0x7f3034108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.823+0000 7f303a2fc640 1 --2- 172.21.15.66:0/4066191215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f30341043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.824+0000 7f303a2fc640 1 -- 172.21.15.66:0/4066191215 >> 172.21.15.66:0/4066191215 conn(0x7f30340ffa20 msgr2=0x7f3034101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.826+0000 7f303a2fc640 1 -- 172.21.15.66:0/4066191215 shutdown_connections 2024-09-15T23:01:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.826+0000 7f303a2fc640 1 -- 172.21.15.66:0/4066191215 wait complete. 2024-09-15T23:01:14.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.827+0000 7f303a2fc640 1 Processor -- start 2024-09-15T23:01:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.835+0000 7f303a2fc640 1 -- start start 2024-09-15T23:01:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.835+0000 7f303a2fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.836+0000 7f303a2fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30341049b0 0x7f303419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.836+0000 7f303a2fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3034109130 0x7f303419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.836+0000 7f303a2fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3034114140 con 0x7f3034104000 2024-09-15T23:01:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.836+0000 7f303a2fc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3034113fc0 con 0x7f3034109130 2024-09-15T23:01:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.836+0000 7f303a2fc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f30341142c0 con 0x7f30341049b0 2024-09-15T23:01:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.837+0000 7f3033fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.838+0000 7f3033fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36970/0 (socket says 172.21.15.66:36970) 2024-09-15T23:01:14.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.838+0000 7f3033fff640 1 -- 172.21.15.66:0/1155806019 learned_addr learned my addr 172.21.15.66:0/1155806019 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 -- 172.21.15.66:0/1155806019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30341049b0 msgr2=0x7f303419ab20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30341049b0 0x7f303419ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 -- 172.21.15.66:0/1155806019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3034109130 msgr2=0x7f303419eeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3034109130 0x7f303419eeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 -- 172.21.15.66:0/1155806019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303419f590 con 0x7f3034104000 2024-09-15T23:01:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.843+0000 7f3033fff640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f302400d950 tx=0x7f302400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.844+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024017070 con 0x7f3034104000 2024-09-15T23:01:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.844+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3024009c30 con 0x7f3034104000 2024-09-15T23:01:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.844+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303419f880 con 0x7f3034104000 2024-09-15T23:01:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.844+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30341a7160 con 0x7f3034104000 2024-09-15T23:01:14.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.845+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302400f6b0 con 0x7f3034104000 2024-09-15T23:01:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.849+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f302400f850 con 0x7f3034104000 2024-09-15T23:01:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.851+0000 7f3031ffb640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 0x7f30200a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.851+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f30240d0e90 con 0x7f3034104000 2024-09-15T23:01:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.851+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014005290 con 0x7f3034104000 2024-09-15T23:01:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.854+0000 7f302bfff640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 0x7f30200a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.855+0000 7f302bfff640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 0x7f30200a5a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30340ffe40 tx=0x7f301c009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:14.860+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f302409d360 con 0x7f3034104000 2024-09-15T23:01:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.275+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3014005850 con 0x7f3034104000 2024-09-15T23:01:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.277+0000 7f3031ffb640 1 -- 172.21.15.66:0/1155806019 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7f3024009de0 con 0x7f3034104000 2024-09-15T23:01:15.278 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:01:15.279 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:01:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T23:01:15.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.283+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 msgr2=0x7f30200a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.283+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 0x7f30200a5a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30340ffe40 tx=0x7f301c009260 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.283+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 msgr2=0x7f303419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.283+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f302400d950 tx=0x7f302400de10 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.284+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 shutdown_connections 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.284+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f30200a3580 0x7f30200a5a40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.285+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3034109130 0x7f303419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.285+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30341049b0 0x7f303419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.285+0000 7f303a2fc640 1 --2- 172.21.15.66:0/1155806019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3034104000 0x7f303419a5e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.285+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 >> 172.21.15.66:0/1155806019 conn(0x7f30340ffa20 msgr2=0x7f3034100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.292+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 shutdown_connections 2024-09-15T23:01:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:15.293+0000 7f303a2fc640 1 -- 172.21.15.66:0/1155806019 wait complete. 2024-09-15T23:01:15.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:15 smithi087 ceph-mon[35290]: pgmap v500: 129 pgs: 14 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 81 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-15T23:01:15.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:15 smithi184 ceph-mon[35203]: pgmap v500: 129 pgs: 14 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 81 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-15T23:01:15.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:15 smithi066 ceph-mon[31185]: pgmap v500: 129 pgs: 14 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 81 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-15T23:01:16.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T23:01:16.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:16 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1155806019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:16.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:16 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1155806019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:16.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:16 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1155806019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:16.637 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:17.369 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:17 smithi066 ceph-mon[31185]: pgmap v501: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 155 op/s 2024-09-15T23:01:17.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:17 smithi184 ceph-mon[35203]: pgmap v501: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 155 op/s 2024-09-15T23:01:17.500 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:17 smithi087 ceph-mon[35290]: pgmap v501: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 155 op/s 2024-09-15T23:01:18.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.941+0000 7f9d2136e640 1 -- 172.21.15.66:0/2350274807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 msgr2=0x7f9d1c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.941+0000 7f9d2136e640 1 --2- 172.21.15.66:0/2350274807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 0x7f9d1c109c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009be0 tx=0x7f9d1402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.942+0000 7f9d2136e640 1 -- 172.21.15.66:0/2350274807 shutdown_connections 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.942+0000 7f9d2136e640 1 --2- 172.21.15.66:0/2350274807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.942+0000 7f9d2136e640 1 --2- 172.21.15.66:0/2350274807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 0x7f9d1c109c90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.942+0000 7f9d2136e640 1 --2- 172.21.15.66:0/2350274807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.942+0000 7f9d2136e640 1 -- 172.21.15.66:0/2350274807 >> 172.21.15.66:0/2350274807 conn(0x7f9d1c06e140 msgr2=0x7f9d1c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.949+0000 7f9d2136e640 1 -- 172.21.15.66:0/2350274807 shutdown_connections 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.949+0000 7f9d2136e640 1 -- 172.21.15.66:0/2350274807 wait complete. 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.950+0000 7f9d2136e640 1 Processor -- start 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.950+0000 7f9d2136e640 1 -- start start 2024-09-15T23:01:18.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.950+0000 7f9d2136e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c1a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.950+0000 7f9d2136e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 0x7f9d1c1a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.950+0000 7f9d2136e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c1abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d2136e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c120dc0 con 0x7f9d1c11b140 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d2136e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c120c40 con 0x7f9d1c109450 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d2136e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c120f40 con 0x7f9d1c109830 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c1a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c1abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c1a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:45244/0 (socket says 172.21.15.66:45244) 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1affd640 1 -- 172.21.15.66:0/3174938602 learned_addr learned my addr 172.21.15.66:0/3174938602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/3174938602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 msgr2=0x7f9d1c1a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 0x7f9d1c1a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/3174938602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 msgr2=0x7f9d1c1a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c1a7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.951+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/3174938602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c1ac2f0 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.954+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c1abc10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c410 tx=0x7f9d0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.954+0000 7f9d03fff640 1 -- 172.21.15.66:0/3174938602 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c004020 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.954+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c1ac5e0 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.954+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c1b3ec0 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.954+0000 7f9d03fff640 1 -- 172.21.15.66:0/3174938602 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c0041c0 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.955+0000 7f9d03fff640 1 -- 172.21.15.66:0/3174938602 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c004020 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.964+0000 7f9d23747740 1 Processor -- start 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.964+0000 7f9d03fff640 1 -- 172.21.15.66:0/3174938602 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9d0c019020 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.967+0000 7f9d03fff640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 0x7f9d040a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.972+0000 7f9d03fff640 1 -- 172.21.15.66:0/3174938602 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f9d0c017020 con 0x7f9d1c11b140 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.972+0000 7f9d23747740 1 -- start start 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdfab40 0x559ebbdf9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdf95d0 0x559ebbdf9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559ebbd5f2f0 con 0x559ebbdf95d0 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559ebbd06cf0 con 0x559ebbdfab40 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.973+0000 7f9d23747740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559ebbd5b2b0 con 0x559ebbe04370 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.974+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.974+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55218/0 (socket says 172.21.15.66:55218) 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.974+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/785420278 learned_addr learned my addr 172.21.15.66:0/785420278 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.974+0000 7f9d1affd640 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdfab40 0x559ebbdf9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.975+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/785420278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdfab40 msgr2=0x559ebbdf9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.975+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdfab40 0x559ebbdf9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.975+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/785420278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdf95d0 msgr2=0x559ebbdf9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.975+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdf95d0 0x559ebbdf9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.975+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/785420278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebbceb3a0 con 0x559ebbe04370 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.976+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 0x7f9d040a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.977+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 0x7f9d040a5cb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9d140099a0 tx=0x7f9d140098d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.978+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0cc440 tx=0x7f9d0c004110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ac117edeb4723f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.980+0000 7f9d017fa640 1 -- 172.21.15.66:0/785420278 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0a3c50 con 0x559ebbe04370 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.980+0000 7f9d017fa640 1 -- 172.21.15.66:0/785420278 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c0992e0 con 0x559ebbe04370 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.981+0000 7f9d017fa640 1 -- 172.21.15.66:0/785420278 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c095db0 con 0x559ebbe04370 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.983+0000 7f9d23747740 1 -- 172.21.15.66:0/785420278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 msgr2=0x559ebbe06760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0cc440 tx=0x7f9d0c004110 comp rx=0 tx=0).stop 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 -- 172.21.15.66:0/785420278 shutdown_connections 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe06760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdf95d0 0x559ebbdf9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 --2- 172.21.15.66:0/785420278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdfab40 0x559ebbdf9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.984+0000 7f9d23747740 1 -- 172.21.15.66:0/785420278 >> 172.21.15.66:0/785420278 conn(0x559ebbdc2310 msgr2=0x559ebbdf5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.987+0000 7f9d23747740 1 -- 172.21.15.66:0/785420278 shutdown_connections 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.988+0000 7f9d23747740 1 -- 172.21.15.66:0/785420278 wait complete. 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.988+0000 7f9d23747740 1 -- start start 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.988+0000 7f9d23747740 1 Processor -- start 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe03e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe01840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559ebbe07070 con 0x559ebbdfab40 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559ebbd1a060 con 0x559ebbdf95d0 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559ebbe071f0 con 0x559ebbe04370 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d23747740 10 client.0 _ll_register_callbacks cb 0x559ebba6d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe01840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37008/0 (socket says 172.21.15.66:37008) 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.989+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/942049445 learned_addr learned my addr 172.21.15.66:0/942049445 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.990+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/942049445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 msgr2=0x559ebbe03e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.990+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe03e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.991+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/942049445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 msgr2=0x559ebbe010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.997+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.997+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/942049445 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebbad03c0 con 0x559ebbe04370 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:17.999+0000 7f9d1b7fe640 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe01840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00cdd0 tx=0x7f9d0c09aee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5420e7aea812a0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.000+0000 7f9cfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.000+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0b7070 con 0x559ebbe04370 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.000+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0c0992e0 con 0x559ebbe04370 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.000+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f9d0c09a430 con 0x559ebbe04370 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.003+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f9d0c0977c0 con 0x559ebbe04370 2024-09-15T23:01:18.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.003+0000 7f9d23747740 10 client.27847 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.003+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x559ebbe07070 con 0x559ebbe04370 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0c060e50 con 0x559ebbe04370 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f9d0c0b3ce0 con 0x559ebbe04370 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 10 client.27847 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 10 client.27847 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 20 client.27847 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbe360e0 0x559ebbe38500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 4 client.27847 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.005+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ebbd6c860 con 0x559ebbe360e0 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.006+0000 7f9d1affd640 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbe360e0 0x559ebbe38500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.016+0000 7f9cfeff5640 10 client.27847 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.016+0000 7f9d1affd640 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbe360e0 0x559ebbe38500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=20d17bcc2ee7d1ee server_cookie=bdbc58d139e7b0df in_seq=0 out_seq=0 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.021+0000 7f9cfeff5640 1 -- 172.21.15.66:0/942049445 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ebbd6c860 con 0x559ebbe360e0 2024-09-15T23:01:18.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.021+0000 7f9cfeff5640 10 client.27847 handle_command_reply: tid=0 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.021+0000 7f9d23747740 1 client.27847 shutdown 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 msgr2=0x559ebbe01840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe01840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00cdd0 tx=0x7f9d0c09aee0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 shutdown_connections 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbe360e0 0x559ebbe38500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbe04370 0x559ebbe01840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 --2- 172.21.15.66:0/942049445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe03e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 >> 172.21.15.66:0/942049445 conn(0x559ebbdc2310 msgr2=0x559ebbdfb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9cfeff5640 0 client.27847 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 shutdown_connections 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.026+0000 7f9d23747740 1 -- 172.21.15.66:0/942049445 wait complete. 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.027+0000 7f9d23747740 20 client.27847 trim_cache size 0 max 16384 2024-09-15T23:01:18.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.051+0000 7f9d23747740 1 Processor -- start 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.052+0000 7f9d23747740 1 -- start start 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.052+0000 7f9d23747740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe00970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.052+0000 7f9d23747740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d23747740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbe04370 0x559ebbe3ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d23747740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9d080102f0 con 0x559ebbe04370 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d23747740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9d08012130 con 0x559ebbdf95d0 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d23747740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9d08010a80 con 0x559ebbdfab40 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55234/0 (socket says 172.21.15.66:55234) 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.053+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/4083797905 learned_addr learned my addr 172.21.15.66:0/4083797905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1affd640 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe00970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/4083797905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 msgr2=0x559ebbe00970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe00970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/4083797905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbe04370 msgr2=0x559ebbe3ddd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbe04370 0x559ebbe3ddd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.054+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/4083797905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebbdf5de0 con 0x559ebbdfab40 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.055+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d14034040 tx=0x7f9d1403b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb40b5f85dd6244f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.060+0000 7f9d00ff9640 1 -- 172.21.15.66:0/4083797905 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14030ed0 con 0x559ebbdfab40 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.060+0000 7f9d00ff9640 1 -- 172.21.15.66:0/4083797905 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1404f070 con 0x559ebbdfab40 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.060+0000 7f9d00ff9640 1 -- 172.21.15.66:0/4083797905 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1403d6e0 con 0x559ebbdfab40 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.061+0000 7f9d23747740 1 -- 172.21.15.66:0/4083797905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 msgr2=0x559ebbe03020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.061+0000 7f9d23747740 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d14034040 tx=0x7f9d1403b000 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 -- 172.21.15.66:0/4083797905 shutdown_connections 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbe04370 0x559ebbe3ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdfab40 0x559ebbe03020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 --2- 172.21.15.66:0/4083797905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbdf95d0 0x559ebbe00970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 -- 172.21.15.66:0/4083797905 >> 172.21.15.66:0/4083797905 conn(0x559ebbdc2310 msgr2=0x559ebbe02910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.064+0000 7f9d23747740 1 -- 172.21.15.66:0/4083797905 shutdown_connections 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.065+0000 7f9d23747740 1 -- 172.21.15.66:0/4083797905 wait complete. 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.065+0000 7f9d23747740 1 -- start start 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 Processor -- start 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdf95d0 0x559ebbe07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe07f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 0x559ebbe9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9d080119a0 con 0x559ebbdfab40 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9d08011210 con 0x559ebbe04370 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800e2f0 con 0x559ebbdf95d0 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d23747740 10 client.0 _ll_register_callbacks cb 0x7f9d0c09aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 0x559ebbe9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe07f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d1b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 0x559ebbe9ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:45282/0 (socket says 172.21.15.66:45282) 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.066+0000 7f9d1b7fe640 1 -- 172.21.15.66:0/3002509796 learned_addr learned my addr 172.21.15.66:0/3002509796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.067+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdf95d0 msgr2=0x559ebbe07a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.067+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdf95d0 0x559ebbe07a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.067+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/3002509796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 msgr2=0x559ebbe9ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.067+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 0x559ebbe9ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.067+0000 7f9d1a7fc640 1 -- 172.21.15.66:0/3002509796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebbe9f350 con 0x559ebbdfab40 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.068+0000 7f9d1a7fc640 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe07f80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006010 tx=0x7f9d140319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffa17499836b061 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.069+0000 7f9cfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.069+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14030ed0 con 0x559ebbdfab40 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.069+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f9d14004800 con 0x559ebbdfab40 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.069+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d1404f070 con 0x559ebbdfab40 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.069+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f9d14031dc0 con 0x559ebbdfab40 2024-09-15T23:01:18.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.075+0000 7f9d23747740 10 client.18675 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.075+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x559ebbea0650 con 0x559ebbdfab40 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1404f070 con 0x559ebbdfab40 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f9d1403e490 con 0x559ebbdfab40 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 10 client.18675 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 10 client.18675 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 20 client.18675 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbea0d70 0x559ebbea3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 4 client.18675 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.080+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ebbd66d70 con 0x559ebbea0d70 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.084+0000 7f9d1affd640 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbea0d70 0x559ebbea3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.085+0000 7f9d1affd640 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbea0d70 0x559ebbea3190 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a112df21b7a55698 server_cookie=4925f7ad92b8b248 in_seq=0 out_seq=0 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.085+0000 7f9cfeff5640 10 client.18675 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.085+0000 7f9cfeff5640 1 -- 172.21.15.66:0/3002509796 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ebbd66d70 con 0x559ebbea0d70 2024-09-15T23:01:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.085+0000 7f9cfeff5640 10 client.18675 handle_command_reply: tid=0 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.087+0000 7f9d23747740 1 client.18675 shutdown 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.091+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 msgr2=0x559ebbe07f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.091+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe07f80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006010 tx=0x7f9d140319c0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 shutdown_connections 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x559ebbea0d70 0x559ebbea3190 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559ebbe04370 0x559ebbe9ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9cfeff5640 0 client.18675 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559ebbdfab40 0x559ebbe07f80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 --2- 172.21.15.66:0/3002509796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ebbdf95d0 0x559ebbe07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 >> 172.21.15.66:0/3002509796 conn(0x559ebbdc2310 msgr2=0x559ebbdff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 shutdown_connections 2024-09-15T23:01:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.093+0000 7f9d23747740 1 -- 172.21.15.66:0/3002509796 wait complete. 2024-09-15T23:01:18.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.097+0000 7f9d23747740 20 client.18675 trim_cache size 0 max 16384 2024-09-15T23:01:18.157 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:01:18.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.099+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 msgr2=0x7f9d040a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.099+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 0x7f9d040a5cb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9d140099a0 tx=0x7f9d140098d0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.099+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 msgr2=0x7f9d1c1abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.099+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c1abc10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c410 tx=0x7f9d0c00c8d0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 shutdown_connections 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9d040a37f0 0x7f9d040a5cb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d1c11b140 0x7f9d1c1abc10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d1c109830 0x7f9d1c1a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 --2- 172.21.15.66:0/3174938602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c109450 0x7f9d1c1a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.100+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 >> 172.21.15.66:0/3174938602 conn(0x7f9d1c06e140 msgr2=0x7f9d1c11c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.101+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 shutdown_connections 2024-09-15T23:01:18.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:18.102+0000 7f9d2136e640 1 -- 172.21.15.66:0/3174938602 wait complete. 2024-09-15T23:01:18.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T23:01:19.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:19 smithi184 ceph-mon[35203]: pgmap v502: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-09-15T23:01:19.434 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:19.455 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:19 smithi066 ceph-mon[31185]: pgmap v502: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-09-15T23:01:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:19 smithi087 ceph-mon[35290]: pgmap v502: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.047+0000 7fd88ec95640 1 -- 172.21.15.66:0/791114109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109830 msgr2=0x7fd888109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.047+0000 7fd88ec95640 1 --2- 172.21.15.66:0/791114109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109830 0x7fd888109c90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd874009900 tx=0x7fd87402a420 comp rx=0 tx=0).stop 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.048+0000 7fd88ec95640 1 -- 172.21.15.66:0/791114109 shutdown_connections 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.048+0000 7fd88ec95640 1 --2- 172.21.15.66:0/791114109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 0x7fd88811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.048+0000 7fd88ec95640 1 --2- 172.21.15.66:0/791114109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109830 0x7fd888109c90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.048+0000 7fd88ec95640 1 --2- 172.21.15.66:0/791114109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109450 0x7fd888110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.048+0000 7fd88ec95640 1 -- 172.21.15.66:0/791114109 >> 172.21.15.66:0/791114109 conn(0x7fd88806e140 msgr2=0x7fd88806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.055+0000 7fd88ec95640 1 -- 172.21.15.66:0/791114109 shutdown_connections 2024-09-15T23:01:20.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.056+0000 7fd88ec95640 1 -- 172.21.15.66:0/791114109 wait complete. 2024-09-15T23:01:20.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.056+0000 7fd88ec95640 1 Processor -- start 2024-09-15T23:01:20.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.059+0000 7fd88ec95640 1 -- start start 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.059+0000 7fd88ec95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109450 0x7fd88811a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.059+0000 7fd88ec95640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.059+0000 7fd88ec95640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 0x7fd888113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.060+0000 7fd88ec95640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd888120e10 con 0x7fd888109830 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.060+0000 7fd88ec95640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd888120c90 con 0x7fd888109450 2024-09-15T23:01:20.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.060+0000 7fd88ec95640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd888120f90 con 0x7fd88811b140 2024-09-15T23:01:20.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd88d232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 0x7fd888113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37024/0 (socket says 172.21.15.66:37024) 2024-09-15T23:01:20.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 -- 172.21.15.66:0/909531783 learned_addr learned my addr 172.21.15.66:0/909531783 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 -- 172.21.15.66:0/909531783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 msgr2=0x7fd888113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 0x7fd888113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 -- 172.21.15.66:0/909531783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109450 msgr2=0x7fd88811a6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:01:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109450 0x7fd88811a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.063+0000 7fd887fff640 1 -- 172.21.15.66:0/909531783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8881141f0 con 0x7fd888109830 2024-09-15T23:01:20.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.065+0000 7fd887fff640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd874009230 tx=0x7fd874005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.066+0000 7fd885ffb640 1 -- 172.21.15.66:0/909531783 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87403f070 con 0x7fd888109830 2024-09-15T23:01:20.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.066+0000 7fd88ec95640 1 -- 172.21.15.66:0/909531783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd888114480 con 0x7fd888109830 2024-09-15T23:01:20.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.067+0000 7fd88ec95640 1 -- 172.21.15.66:0/909531783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd888118470 con 0x7fd888109830 2024-09-15T23:01:20.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 Processor -- start 2024-09-15T23:01:20.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd885ffb640 1 -- 172.21.15.66:0/909531783 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd874005580 con 0x7fd888109830 2024-09-15T23:01:20.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd885ffb640 1 -- 172.21.15.66:0/909531783 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874035030 con 0x7fd888109830 2024-09-15T23:01:20.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 -- start start 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5648771973e0 0x564877197840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877197e60 0x5648771a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5648770fd2f0 con 0x564877198b40 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5648770a4cf0 con 0x5648771973e0 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.071+0000 7fd89106e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5648770f92b0 con 0x564877197e60 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.072+0000 7fd88d232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.072+0000 7fd88d232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37028/0 (socket says 172.21.15.66:37028) 2024-09-15T23:01:20.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.072+0000 7fd88d232640 1 -- 172.21.15.66:0/851573753 learned_addr learned my addr 172.21.15.66:0/851573753 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:20.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.076+0000 7fd88ca31640 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5648771973e0 0x564877197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.075+0000 7fd885ffb640 1 -- 172.21.15.66:0/909531783 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fd874042070 con 0x7fd888109830 2024-09-15T23:01:20.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.078+0000 7fd885ffb640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 0x7fd8780a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.078+0000 7fd887fff640 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877197e60 0x5648771a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 -- 172.21.15.66:0/851573753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877197e60 msgr2=0x5648771a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877197e60 0x5648771a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 -- 172.21.15.66:0/851573753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5648771973e0 msgr2=0x564877197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5648771973e0 0x564877197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 -- 172.21.15.66:0/851573753 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648770893a0 con 0x564877198b40 2024-09-15T23:01:20.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd885ffb640 1 -- 172.21.15.66:0/909531783 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fd8740f0d20 con 0x7fd888109830 2024-09-15T23:01:20.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.079+0000 7fd88d232640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 0x7fd8780a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.082+0000 7fd88d232640 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd880009f90 tx=0x7fd88000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a25aa1714edae97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.083+0000 7fd88d232640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 0x7fd8780a59c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd880020000 tx=0x7fd880023000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.083+0000 7fd88ec95640 1 -- 172.21.15.66:0/851573753 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017030 con 0x564877198b40 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.083+0000 7fd88ec95640 1 -- 172.21.15.66:0/851573753 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd88001b420 con 0x564877198b40 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 -- 172.21.15.66:0/851573753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 msgr2=0x564877198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd880009f90 tx=0x7fd88000f7f0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 -- 172.21.15.66:0/851573753 shutdown_connections 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877197e60 0x5648771a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5648771973e0 0x564877197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 --2- 172.21.15.66:0/851573753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x564877198f20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.084+0000 7fd89106e740 1 -- 172.21.15.66:0/851573753 >> 172.21.15.66:0/851573753 conn(0x564877160310 msgr2=0x564877193f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.092+0000 7fd89106e740 1 -- 172.21.15.66:0/851573753 shutdown_connections 2024-09-15T23:01:20.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.093+0000 7fd89106e740 1 -- 172.21.15.66:0/851573753 wait complete. 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.093+0000 7fd89106e740 1 -- start start 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.093+0000 7fd89106e740 1 Processor -- start 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648771973e0 0x5648771a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5648771a50c0 con 0x5648771973e0 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5648770b8060 con 0x564877197e60 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.094+0000 7fd89106e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5648771a5240 con 0x564877198b40 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.095+0000 7fd89106e740 10 client.0 _ll_register_callbacks cb 0x564876e0b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:20.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.095+0000 7fd88d232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.096+0000 7fd88d232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55264/0 (socket says 172.21.15.66:55264) 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.096+0000 7fd88d232640 1 -- 172.21.15.66:0/3215186748 learned_addr learned my addr 172.21.15.66:0/3215186748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.098+0000 7fd88d232640 1 -- 172.21.15.66:0/3215186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 msgr2=0x5648771a16a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.098+0000 7fd88d232640 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771a16a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.098+0000 7fd88d232640 1 -- 172.21.15.66:0/3215186748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648771973e0 msgr2=0x5648771a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.098+0000 7fd88d232640 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648771973e0 0x5648771a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.098+0000 7fd88d232640 1 -- 172.21.15.66:0/3215186748 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564876e6e3c0 con 0x564877198b40 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.099+0000 7fd88d232640 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd88001c000 tx=0x7fd88001bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634af6018f8f8f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.101+0000 7fd867fff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.101+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017050 con 0x564877198b40 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.101+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd88001b420 con 0x564877198b40 2024-09-15T23:01:20.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.101+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fd88001cb90 con 0x564877198b40 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.103+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fd88001b5d0 con 0x564877198b40 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.103+0000 7fd89106e740 10 client.27859 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.103+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5648771d2ae0 con 0x564877198b40 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.104+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd88001b420 con 0x564877198b40 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fd8800303f0 con 0x564877198b40 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 10 client.27859 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 10 client.27859 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:01:20.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 20 client.27859 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:20.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x5648771d4420 0x5648771d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 4 client.27859 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:20.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.105+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56487710a860 con 0x5648771d4420 2024-09-15T23:01:20.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.108+0000 7fd88ca31640 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x5648771d4420 0x5648771d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.117+0000 7fd867fff640 10 client.27859 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:01:20.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.117+0000 7fd88ca31640 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x5648771d4420 0x5648771d68e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=878e707292b96f30 server_cookie=3bcf7296f19b254c in_seq=0 out_seq=0 2024-09-15T23:01:20.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.122+0000 7fd867fff640 1 -- 172.21.15.66:0/3215186748 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56487710a860 con 0x5648771d4420 2024-09-15T23:01:20.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.122+0000 7fd867fff640 10 client.27859 handle_command_reply: tid=0 2024-09-15T23:01:20.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.122+0000 7fd89106e740 1 client.27859 shutdown 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.124+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 msgr2=0x5648771a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.124+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd88001c000 tx=0x7fd88001bb70 comp rx=0 tx=0).stop 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 shutdown_connections 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x5648771d4420 0x5648771d68e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564877198b40 0x5648771a1be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 --2- 172.21.15.66:0/3215186748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5648771973e0 0x5648771a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 >> 172.21.15.66:0/3215186748 conn(0x564877160310 msgr2=0x5648771931a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.125+0000 7fd867fff640 0 client.27859 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:01:20.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.131+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 shutdown_connections 2024-09-15T23:01:20.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.131+0000 7fd89106e740 1 -- 172.21.15.66:0/3215186748 wait complete. 2024-09-15T23:01:20.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.131+0000 7fd89106e740 20 client.27859 trim_cache size 0 max 16384 2024-09-15T23:01:20.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.157+0000 7fd89106e740 1 Processor -- start 2024-09-15T23:01:20.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.158+0000 7fd89106e740 1 -- start start 2024-09-15T23:01:20.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.158+0000 7fd89106e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x564877199f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.158+0000 7fd89106e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd89106e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877198b40 0x56487719b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd89106e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c010210 con 0x564877197e60 2024-09-15T23:01:20.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd89106e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c012050 con 0x564877198b40 2024-09-15T23:01:20.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd89106e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c0109a0 con 0x5648771973e0 2024-09-15T23:01:20.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd887fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd88d232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877198b40 0x56487719b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd887fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37054/0 (socket says 172.21.15.66:37054) 2024-09-15T23:01:20.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd88ca31640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x564877199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.159+0000 7fd887fff640 1 -- 172.21.15.66:0/1325684218 learned_addr learned my addr 172.21.15.66:0/1325684218 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 -- 172.21.15.66:0/1325684218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 msgr2=0x564877199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x564877199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 -- 172.21.15.66:0/1325684218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877198b40 msgr2=0x56487719b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877198b40 0x56487719b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 -- 172.21.15.66:0/1325684218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648771d6f60 con 0x564877197e60 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.160+0000 7fd887fff640 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd874005ab0 tx=0x7fd8740b8ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16c647420bf184d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.161+0000 7fd8727fc640 1 -- 172.21.15.66:0/1325684218 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874049040 con 0x564877197e60 2024-09-15T23:01:20.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.161+0000 7fd8727fc640 1 -- 172.21.15.66:0/1325684218 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8740bd1f0 con 0x564877197e60 2024-09-15T23:01:20.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.162+0000 7fd89106e740 1 -- 172.21.15.66:0/1325684218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 msgr2=0x5648771a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.162+0000 7fd89106e740 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd874005ab0 tx=0x7fd8740b8ea0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.169+0000 7fd89106e740 1 -- 172.21.15.66:0/1325684218 shutdown_connections 2024-09-15T23:01:20.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.169+0000 7fd89106e740 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877198b40 0x56487719b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.169+0000 7fd89106e740 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877197e60 0x5648771a3610 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.169+0000 7fd89106e740 1 --2- 172.21.15.66:0/1325684218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x564877199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.169+0000 7fd89106e740 1 -- 172.21.15.66:0/1325684218 >> 172.21.15.66:0/1325684218 conn(0x564877160310 msgr2=0x5648771a2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.172+0000 7fd89106e740 1 -- 172.21.15.66:0/1325684218 shutdown_connections 2024-09-15T23:01:20.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.176+0000 7fd89106e740 1 -- 172.21.15.66:0/1325684218 wait complete. 2024-09-15T23:01:20.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.176+0000 7fd89106e740 1 -- start start 2024-09-15T23:01:20.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.177+0000 7fd89106e740 1 Processor -- start 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x5648771aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c0118c0 con 0x564877198b40 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c011130 con 0x564877197e60 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c00e2a0 con 0x5648771973e0 2024-09-15T23:01:20.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.181+0000 7fd89106e740 10 client.0 _ll_register_callbacks cb 0x7fd88001f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:20.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.183+0000 7fd88d232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.183+0000 7fd88d232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37070/0 (socket says 172.21.15.66:37070) 2024-09-15T23:01:20.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.183+0000 7fd88d232640 1 -- 172.21.15.66:0/2918649591 learned_addr learned my addr 172.21.15.66:0/2918649591 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:20.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.184+0000 7fd887fff640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.184+0000 7fd88ca31640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x5648771aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 -- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 msgr2=0x5648771aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x5648771aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 -- 172.21.15.66:0/2918649591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 msgr2=0x5648771aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 -- 172.21.15.66:0/2918649591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648771a21e0 con 0x564877198b40 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.187+0000 7fd88d232640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd88001bbe0 tx=0x7fd88001bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e55225c555f4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.188+0000 7fd867fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.188+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880047060 con 0x564877198b40 2024-09-15T23:01:20.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.188+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8740bd1f0 con 0x564877198b40 2024-09-15T23:01:20.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.188+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fd880022040 con 0x564877198b40 2024-09-15T23:01:20.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.190+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fd88004e050 con 0x564877198b40 2024-09-15T23:01:20.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.193+0000 7fd89106e740 10 client.18687 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:20.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.193+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5648771950e0 con 0x564877198b40 2024-09-15T23:01:20.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8740bd1f0 con 0x564877198b40 2024-09-15T23:01:20.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fd88001b770 con 0x564877198b40 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 10 client.18687 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 10 client.18687 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 20 client.18687 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56487723fa10 0x564877241e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 4 client.18687 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:01:20.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.195+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564877104d70 con 0x56487723fa10 2024-09-15T23:01:20.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.198+0000 7fd88ca31640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56487723fa10 0x564877241e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:20.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.208+0000 7fd88ca31640 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56487723fa10 0x564877241e30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6613f50e382cb0ff server_cookie=abafac1f05de5b42 in_seq=0 out_seq=0 2024-09-15T23:01:20.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.208+0000 7fd867fff640 10 client.18687 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:01:20.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.209+0000 7fd867fff640 1 -- 172.21.15.66:0/2918649591 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564877104d70 con 0x56487723fa10 2024-09-15T23:01:20.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.209+0000 7fd867fff640 10 client.18687 handle_command_reply: tid=0 2024-09-15T23:01:20.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.209+0000 7fd89106e740 1 client.18687 shutdown 2024-09-15T23:01:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 msgr2=0x5648771a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd88001bbe0 tx=0x7fd88001bf00 comp rx=0 tx=0).stop 2024-09-15T23:01:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 shutdown_connections 2024-09-15T23:01:20.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x56487723fa10 0x564877241e30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564877198b40 0x5648771a5570 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564877197e60 0x5648771aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 --2- 172.21.15.66:0/2918649591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648771973e0 0x5648771aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd867fff640 0 client.18687 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 >> 172.21.15.66:0/2918649591 conn(0x564877160310 msgr2=0x56487719c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 shutdown_connections 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 1 -- 172.21.15.66:0/2918649591 wait complete. 2024-09-15T23:01:20.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.214+0000 7fd89106e740 20 client.18687 trim_cache size 0 max 16384 2024-09-15T23:01:20.217 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.215+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 msgr2=0x7fd8780a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.215+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 0x7fd8780a59c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd880020000 tx=0x7fd880023000 comp rx=0 tx=0).stop 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.215+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 msgr2=0x7fd88811ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.215+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd874009230 tx=0x7fd874005000 comp rx=0 tx=0).stop 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.215+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 shutdown_connections 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fd8780a3500 0x7fd8780a59c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd88811b140 0x7fd888113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd888109830 0x7fd88811ac00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 --2- 172.21.15.66:0/909531783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd888109450 0x7fd88811a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:20.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 >> 172.21.15.66:0/909531783 conn(0x7fd88806e140 msgr2=0x7fd888072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:20.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 shutdown_connections 2024-09-15T23:01:20.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:20.216+0000 7fd8737fe640 1 -- 172.21.15.66:0/909531783 wait complete. 2024-09-15T23:01:20.930 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T23:01:21.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:21 smithi066 ceph-mon[31185]: pgmap v503: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-09-15T23:01:21.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:21 smithi184 ceph-mon[35203]: pgmap v503: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-09-15T23:01:21.443 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:21 smithi087 ceph-mon[35290]: pgmap v503: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-09-15T23:01:22.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.073+0000 7f47db9a3640 1 -- 172.21.15.66:0/1317745715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d41011e0 msgr2=0x7f47d4105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.073+0000 7f47db9a3640 1 --2- 172.21.15.66:0/1317745715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d41011e0 0x7f47d4105980 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009860 tx=0x7f47d002a380 comp rx=0 tx=0).stop 2024-09-15T23:01:22.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.078+0000 7f47db9a3640 1 -- 172.21.15.66:0/1317745715 shutdown_connections 2024-09-15T23:01:22.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.078+0000 7f47db9a3640 1 --2- 172.21.15.66:0/1317745715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d4105ec0 0x7f47d4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.078+0000 7f47db9a3640 1 --2- 172.21.15.66:0/1317745715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d41011e0 0x7f47d4105980 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.078+0000 7f47db9a3640 1 --2- 172.21.15.66:0/1317745715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41008c0 0x7f47d4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.078+0000 7f47db9a3640 1 -- 172.21.15.66:0/1317745715 >> 172.21.15.66:0/1317745715 conn(0x7f47d40fc7d0 msgr2=0x7f47d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.082+0000 7f47db9a3640 1 -- 172.21.15.66:0/1317745715 shutdown_connections 2024-09-15T23:01:22.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.083+0000 7f47db9a3640 1 -- 172.21.15.66:0/1317745715 wait complete. 2024-09-15T23:01:22.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.084+0000 7f47db9a3640 1 Processor -- start 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.084+0000 7f47db9a3640 1 -- start start 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 0x7f47d4073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41011e0 0x7f47d406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 0x7f47d406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4118700 con 0x7f47d4105ec0 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4118580 con 0x7f47d41011e0 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47db9a3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4118880 con 0x7f47d41008c0 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47d973f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 0x7f47d4073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47d9f40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 0x7f47d406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47d9f40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 0x7f47d406d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37096/0 (socket says 172.21.15.66:37096) 2024-09-15T23:01:22.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.085+0000 7f47d9f40640 1 -- 172.21.15.66:0/567928204 learned_addr learned my addr 172.21.15.66:0/567928204 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:22.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.086+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41011e0 0x7f47d406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 -- 172.21.15.66:0/567928204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41011e0 msgr2=0x7f47d406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41011e0 0x7f47d406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 -- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 msgr2=0x7f47d406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 0x7f47d406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 -- 172.21.15.66:0/567928204 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d406d5f0 con 0x7f47d41008c0 2024-09-15T23:01:22.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.087+0000 7f47d973f640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 0x7f47d4073a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009fd0 tx=0x7f47c400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.093+0000 7f47ca7fc640 1 -- 172.21.15.66:0/567928204 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4015020 con 0x7f47d41008c0 2024-09-15T23:01:22.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.093+0000 7f47ca7fc640 1 -- 172.21.15.66:0/567928204 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c4011d10 con 0x7f47d41008c0 2024-09-15T23:01:22.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.093+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d406d8e0 con 0x7f47d41008c0 2024-09-15T23:01:22.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.093+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d4071870 con 0x7f47d41008c0 2024-09-15T23:01:22.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.093+0000 7f47ca7fc640 1 -- 172.21.15.66:0/567928204 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c400f2e0 con 0x7f47d41008c0 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.097+0000 7f47ddd7c740 1 Processor -- start 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 -- start start 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015091b40 0x565015090090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x565015090a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x565014ff62f0 con 0x565015091b40 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x565014f9dcf0 con 0x56501509b370 2024-09-15T23:01:22.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565014ff22b0 con 0x5650150905d0 2024-09-15T23:01:22.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:45340/0 (socket says 172.21.15.66:45340) 2024-09-15T23:01:22.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.103+0000 7f47d8f3e640 1 -- 172.21.15.66:0/61226222 learned_addr learned my addr 172.21.15.66:0/61226222 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:22.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d973f640 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x565015090a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47ca7fc640 1 -- 172.21.15.66:0/567928204 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f47c4018020 con 0x7f47d41008c0 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d8f3e640 1 -- 172.21.15.66:0/61226222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 msgr2=0x565015090a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x565015090a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d8f3e640 1 -- 172.21.15.66:0/61226222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015091b40 msgr2=0x565015090090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015091b40 0x565015090090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.104+0000 7f47d8f3e640 1 -- 172.21.15.66:0/61226222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565014f823a0 con 0x56501509b370 2024-09-15T23:01:22.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.108+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47d002a8f0 tx=0x7f47d0005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645865ab3d95939a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.108+0000 7f47bf7fe640 1 -- 172.21.15.66:0/61226222 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0040020 con 0x56501509b370 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.109+0000 7f47ca7fc640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 0x7f47c00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.109+0000 7f47ca7fc640 1 -- 172.21.15.66:0/567928204 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f47c40cf880 con 0x7f47d41008c0 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.110+0000 7f47bf7fe640 1 -- 172.21.15.66:0/61226222 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d0038040 con 0x56501509b370 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.111+0000 7f47d9f40640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 0x7f47c00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.111+0000 7f47ddd7c740 1 -- 172.21.15.66:0/61226222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 msgr2=0x56501509d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.111+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47d002a8f0 tx=0x7f47d0005c50 comp rx=0 tx=0).stop 2024-09-15T23:01:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 -- 172.21.15.66:0/61226222 shutdown_connections 2024-09-15T23:01:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56501509b370 0x56501509d760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x565015090a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/61226222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015091b40 0x565015090090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 -- 172.21.15.66:0/61226222 >> 172.21.15.66:0/61226222 conn(0x565015059310 msgr2=0x56501508cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.115+0000 7f47ddd7c740 1 -- 172.21.15.66:0/61226222 shutdown_connections 2024-09-15T23:01:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.116+0000 7f47ddd7c740 1 -- 172.21.15.66:0/61226222 wait complete. 2024-09-15T23:01:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.116+0000 7f47ddd7c740 1 -- start start 2024-09-15T23:01:22.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.116+0000 7f47ddd7c740 1 Processor -- start 2024-09-15T23:01:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.118+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x56501509ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015098420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56501509e060 con 0x56501509b370 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x565014fb1060 con 0x5650150905d0 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56501509e1e0 con 0x565015091b40 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47ddd7c740 10 client.0 _ll_register_callbacks cb 0x565014d048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55338/0 (socket says 172.21.15.66:55338) 2024-09-15T23:01:22.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.119+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3580848880 learned_addr learned my addr 172.21.15.66:0/3580848880 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 msgr2=0x56501509ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x56501509ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3580848880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 msgr2=0x565015098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3580848880 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565014d673c0 con 0x565015091b40 2024-09-15T23:01:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f47d0035040 tx=0x7f47d002a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddaee46b13747d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.120+0000 7f47bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.122+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0040070 con 0x565015091b40 2024-09-15T23:01:22.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.122+0000 7f47d9f40640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 0x7f47c00a5a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009c50 tx=0x7f47cc010040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.122+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d0038040 con 0x565015091b40 2024-09-15T23:01:22.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.122+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f47d00043a0 con 0x565015091b40 2024-09-15T23:01:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.126+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f47d0030e90 con 0x565015091b40 2024-09-15T23:01:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.126+0000 7f47ddd7c740 10 client.27871 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.126+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x56501509e060 con 0x565015091b40 2024-09-15T23:01:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d0038040 con 0x565015091b40 2024-09-15T23:01:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f47d004f740 con 0x565015091b40 2024-09-15T23:01:22.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 10 client.27871 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 10 client.27871 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:01:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 20 client.27871 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5650150ab0d0 0x5650150ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 4 client.27871 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:22.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.131+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565015003860 con 0x5650150ab0d0 2024-09-15T23:01:22.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.134+0000 7f47d973f640 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5650150ab0d0 0x5650150ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.137+0000 7f47bcff9640 10 client.27871 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.137+0000 7f47d973f640 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5650150ab0d0 0x5650150ad510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47a9d63c9fba3318 server_cookie=ce1b0919697c11c6 in_seq=0 out_seq=0 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.140+0000 7f47bcff9640 1 -- 172.21.15.66:0/3580848880 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565015003860 con 0x5650150ab0d0 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.140+0000 7f47bcff9640 10 client.27871 handle_command_reply: tid=0 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.140+0000 7f47ddd7c740 1 client.27871 shutdown 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.140+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 msgr2=0x565015097ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.140+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f47d0035040 tx=0x7f47d002a380 comp rx=0 tx=0).stop 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 shutdown_connections 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x5650150ab0d0 0x5650150ad510 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565015091b40 0x565015097ee0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f47d0035040 tx=0x7f47d002a380 comp rx=0 tx=0).stop 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3580848880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x56501509ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 >> 172.21.15.66:0/3580848880 conn(0x565015059310 msgr2=0x565015092930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.141+0000 7f47bcff9640 0 client.27871 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:01:22.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.143+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 shutdown_connections 2024-09-15T23:01:22.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.143+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3580848880 wait complete. 2024-09-15T23:01:22.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.144+0000 7f47ddd7c740 20 client.27871 trim_cache size 0 max 16384 2024-09-15T23:01:22.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.172+0000 7f47ddd7c740 1 Processor -- start 2024-09-15T23:01:22.177 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:01:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:01:21.967+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T23:01:22.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 -- start start 2024-09-15T23:01:22.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x5650150a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 0x5650150b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47d8f3e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37112/0 (socket says 172.21.15.66:37112) 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3086595227 learned_addr learned my addr 172.21.15.66:0/3086595227 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8010380 con 0x56501509b370 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80121c0 con 0x565015096fd0 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.173+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8010b10 con 0x5650150905d0 2024-09-15T23:01:22.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.176+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 0x5650150b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.179+0000 7f47d973f640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x5650150a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3086595227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 msgr2=0x5650150a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x5650150a73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3086595227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 msgr2=0x5650150b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 0x5650150b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 -- 172.21.15.66:0/3086595227 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565015096430 con 0x56501509b370 2024-09-15T23:01:22.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 0x5650150b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:01:22.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.180+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f47d004fb90 tx=0x7f47d0030ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85765f0827159e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.183+0000 7f47beffd640 1 -- 172.21.15.66:0/3086595227 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0040070 con 0x56501509b370 2024-09-15T23:01:22.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.183+0000 7f47beffd640 1 -- 172.21.15.66:0/3086595227 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d004f910 con 0x56501509b370 2024-09-15T23:01:22.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47beffd640 1 -- 172.21.15.66:0/3086595227 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0046a10 con 0x56501509b370 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 msgr2=0x565015099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f47d004fb90 tx=0x7f47d0030ad0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 shutdown_connections 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565015096fd0 0x5650150b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56501509b370 0x565015099e50 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3086595227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650150905d0 0x5650150a73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.184+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 >> 172.21.15.66:0/3086595227 conn(0x565015059310 msgr2=0x565015099740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.185+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 shutdown_connections 2024-09-15T23:01:22.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.185+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3086595227 wait complete. 2024-09-15T23:01:22.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.185+0000 7f47ddd7c740 1 -- start start 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 Processor -- start 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x5650150a3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015096fd0 0x5650150a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 0x5650150946f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8011a30 con 0x565015096fd0 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80112a0 con 0x5650150905d0 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47b800e380 con 0x56501509b370 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.186+0000 7f47ddd7c740 10 client.0 _ll_register_callbacks cb 0x7f47c40d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.187+0000 7f47d973f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x5650150a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.187+0000 7f47d973f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x5650150a3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:45374/0 (socket says 172.21.15.66:45374) 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.187+0000 7f47d973f640 1 -- 172.21.15.66:0/3160615065 learned_addr learned my addr 172.21.15.66:0/3160615065 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.187+0000 7f47d8f3e640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015096fd0 0x5650150a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.187+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 0x5650150946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.191+0000 7f47d9f40640 1 -- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 msgr2=0x5650150a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.191+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x5650150a3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.191+0000 7f47d9f40640 1 -- 172.21.15.66:0/3160615065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015096fd0 msgr2=0x5650150a3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:22.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.191+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015096fd0 0x5650150a3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.192+0000 7f47d9f40640 1 -- 172.21.15.66:0/3160615065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565015094e30 con 0x56501509b370 2024-09-15T23:01:22.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.197+0000 7f47d9f40640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 0x5650150946f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56501508d9b0 tx=0x7f47cc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0322b807af0148 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:22.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.197+0000 7f47bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:22.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.198+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc02a060 con 0x56501509b370 2024-09-15T23:01:22.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.198+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f47cc0253f0 con 0x56501509b370 2024-09-15T23:01:22.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.198+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d004f910 con 0x56501509b370 2024-09-15T23:01:22.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.203+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f47cc031050 con 0x56501509b370 2024-09-15T23:01:22.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.207+0000 7f47ddd7c740 10 client.27877 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:22.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.207+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x565015115850 con 0x56501509b370 2024-09-15T23:01:22.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.215+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d004f910 con 0x56501509b370 2024-09-15T23:01:22.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.215+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f47cc00b040 con 0x56501509b370 2024-09-15T23:01:22.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 10 client.27877 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:22.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 10 client.27877 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:01:22.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 20 client.27877 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:22.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x565015116090 0x5650151184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:22.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 4 client.27877 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:01:22.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.216+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565014ffdd70 con 0x565015116090 2024-09-15T23:01:22.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.219+0000 7f47d973f640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x565015116090 0x5650151184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:22.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.224+0000 7f47d973f640 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x565015116090 0x5650151184b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea7edc12b34cd784 server_cookie=2f94c0a9df97633f in_seq=0 out_seq=0 2024-09-15T23:01:22.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.225+0000 7f47bcff9640 10 client.27877 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:01:22.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.228+0000 7f47bcff9640 1 -- 172.21.15.66:0/3160615065 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565014ffdd70 con 0x565015116090 2024-09-15T23:01:22.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.228+0000 7f47bcff9640 10 client.27877 handle_command_reply: tid=0 2024-09-15T23:01:22.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.229+0000 7f47ddd7c740 1 client.27877 shutdown 2024-09-15T23:01:22.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.229+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 msgr2=0x5650150946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.229+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 0x5650150946f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56501508d9b0 tx=0x7f47cc0095c0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 shutdown_connections 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x565015116090 0x5650151184b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56501509b370 0x5650150946f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565015096fd0 0x5650150a3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 --2- 172.21.15.66:0/3160615065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5650150905d0 0x5650150a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 >> 172.21.15.66:0/3160615065 conn(0x565015059310 msgr2=0x565015099f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.230+0000 7f47bcff9640 0 client.27877 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:01:22.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.236+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 shutdown_connections 2024-09-15T23:01:22.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.236+0000 7f47ddd7c740 1 -- 172.21.15.66:0/3160615065 wait complete. 2024-09-15T23:01:22.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.236+0000 7f47ddd7c740 20 client.27877 trim_cache size 0 max 16384 2024-09-15T23:01:22.238 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:01:22.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.237+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 msgr2=0x7f47c00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.237+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 0x7f47c00a5a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009c50 tx=0x7f47cc010040 comp rx=0 tx=0).stop 2024-09-15T23:01:22.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.237+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 msgr2=0x7f47d4073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:22.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.237+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 0x7f47d4073a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009fd0 tx=0x7f47c400b870 comp rx=0 tx=0).stop 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 shutdown_connections 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f47c00a35c0 0x7f47c00a5a80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d4105ec0 0x7f47d406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47d41011e0 0x7f47d406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 --2- 172.21.15.66:0/567928204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d41008c0 0x7f47d4073a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:22.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.240+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 >> 172.21.15.66:0/567928204 conn(0x7f47d40fc7d0 msgr2=0x7f47d4103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:22.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.242+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 shutdown_connections 2024-09-15T23:01:22.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:22.246+0000 7f47db9a3640 1 -- 172.21.15.66:0/567928204 wait complete. 2024-09-15T23:01:23.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:23 smithi184 ceph-mon[35203]: pgmap v504: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 97 op/s 2024-09-15T23:01:23.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:23 smithi066 ceph-mon[31185]: pgmap v504: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 97 op/s 2024-09-15T23:01:23.581 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T23:01:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:23 smithi087 ceph-mon[35290]: pgmap v504: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 97 op/s 2024-09-15T23:01:24.080 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:25 smithi184 ceph-mon[35203]: pgmap v505: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-09-15T23:01:25.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:25 smithi066 ceph-mon[31185]: pgmap v505: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-09-15T23:01:25.588 INFO:tasks.quiescer.fs.[cephfs]:Total duration (35.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T23:01:25.588 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.7 2024-09-15T23:01:25.588 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:01:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:25 smithi087 ceph-mon[35290]: pgmap v505: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-09-15T23:01:26.072 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:01:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.831+0000 7f1ccae06640 1 -- 172.21.15.66:0/476564283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 msgr2=0x7f1cc4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.831+0000 7f1ccae06640 1 --2- 172.21.15.66:0/476564283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4100ee0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009cd0 tx=0x7f1cb402a910 comp rx=0 tx=0).stop 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.832+0000 7f1ccae06640 1 -- 172.21.15.66:0/476564283 shutdown_connections 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.832+0000 7f1ccae06640 1 --2- 172.21.15.66:0/476564283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4101420 0x7f1cc410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.832+0000 7f1ccae06640 1 --2- 172.21.15.66:0/476564283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4100ee0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.832+0000 7f1ccae06640 1 --2- 172.21.15.66:0/476564283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4106a80 0x7f1cc4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.832+0000 7f1ccae06640 1 -- 172.21.15.66:0/476564283 >> 172.21.15.66:0/476564283 conn(0x7f1cc40fc7a0 msgr2=0x7f1cc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.838+0000 7f1ccae06640 1 -- 172.21.15.66:0/476564283 shutdown_connections 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.838+0000 7f1ccae06640 1 -- 172.21.15.66:0/476564283 wait complete. 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.839+0000 7f1ccae06640 1 Processor -- start 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 -- start start 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4101420 0x7f1cc41967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4196ce0 0x7f1cc41aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc410fe90 con 0x7f1cc4100a80 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc410fd10 con 0x7f1cc4196ce0 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.843+0000 7f1ccae06640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4110010 con 0x7f1cc4101420 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.844+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.844+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43182/0 (socket says 172.21.15.66:43182) 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.844+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/3918799863 learned_addr learned my addr 172.21.15.66:0/3918799863 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.846+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4196ce0 0x7f1cc41aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.846+0000 7f1cc3fff640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4101420 0x7f1cc41967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/3918799863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4101420 msgr2=0x7f1cc41967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4101420 0x7f1cc41967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/3918799863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4196ce0 msgr2=0x7f1cc41aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4196ce0 0x7f1cc41aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/3918799863 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc41ab340 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.850+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b430 tx=0x7f1cbc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.851+0000 7f1cc1ffb640 1 -- 172.21.15.66:0/3918799863 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc015020 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.851+0000 7f1cc1ffb640 1 -- 172.21.15.66:0/3918799863 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cbc011d10 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.852+0000 7f1cc1ffb640 1 -- 172.21.15.66:0/3918799863 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00f2e0 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.854+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc41ab630 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.854+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc41abaf0 con 0x7f1cc4100a80 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.857+0000 7f1ccd1df740 1 Processor -- start 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 -- start start 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb385700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3857d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bb384c52f0 con 0x55bb3857b380 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bb3846ccf0 con 0x55bb385705e0 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.858+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb384c12b0 con 0x55bb38571b50 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.859+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.859+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55734/0 (socket says 172.21.15.66:55734) 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.859+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/1345681048 learned_addr learned my addr 172.21.15.66:0/1345681048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.859+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb385700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.863+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/1345681048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 msgr2=0x55bb385700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.863+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb385700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.863+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/1345681048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 msgr2=0x55bb3857d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.863+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3857d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.863+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/1345681048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb384513a0 con 0x55bb385705e0 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.864+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0d38a0 tx=0x7f1cbc0d71a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f839cfb75604c24c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.865+0000 7f1cc1ffb640 1 -- 172.21.15.66:0/3918799863 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1cbc018020 con 0x7f1cc4100a80 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.866+0000 7f1caaffd640 1 -- 172.21.15.66:0/1345681048 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0dd070 con 0x55bb385705e0 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.866+0000 7f1cc1ffb640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 0x7f1cac0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.866+0000 7f1cc1ffb640 1 -- 172.21.15.66:0/3918799863 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f1cbc0d6550 con 0x7f1cc4100a80 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.866+0000 7f1caaffd640 1 -- 172.21.15.66:0/1345681048 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cbc0e0890 con 0x55bb385705e0 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.867+0000 7f1caaffd640 1 -- 172.21.15.66:0/1345681048 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0de710 con 0x55bb385705e0 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.867+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1345681048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 msgr2=0x55bb38570a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.867+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0d38a0 tx=0x7f1cbc0d71a0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.869+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 0x7f1cac0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.873+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 0x7f1cac0a5960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800b9d0 tx=0x7f1cb8008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.877+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1345681048 shutdown_connections 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.877+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3857d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.877+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38570a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.877+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1345681048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb385700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.877+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1345681048 >> 172.21.15.66:0/1345681048 conn(0x55bb38528310 msgr2=0x55bb3856cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.881+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1345681048 shutdown_connections 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.882+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1345681048 wait complete. 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.883+0000 7f1ccd1df740 1 -- start start 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.883+0000 7f1ccd1df740 1 Processor -- start 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb3857ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38577f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb385784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bb3858ef10 con 0x55bb38571b50 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55bb38480060 con 0x55bb385705e0 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bb3858f090 con 0x55bb3857b380 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1ccd1df740 10 client.0 _ll_register_callbacks cb 0x55bb381d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1cc93a3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb385784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38577f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38577f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43208/0 (socket says 172.21.15.66:43208) 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.884+0000 7f1cc3fff640 1 -- 172.21.15.66:0/2543198877 learned_addr learned my addr 172.21.15.66:0/2543198877 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.887+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb3857ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.888+0000 7f1cc93a3640 1 -- 172.21.15.66:0/2543198877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 msgr2=0x55bb3857ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.888+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb3857ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.888+0000 7f1cc93a3640 1 -- 172.21.15.66:0/2543198877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 msgr2=0x55bb38577f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.888+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38577f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.888+0000 7f1cc93a3640 1 -- 172.21.15.66:0/2543198877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb382363c0 con 0x55bb3857b380 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.889+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb385784f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800bfd0 tx=0x7f1cb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9703706669af65f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.890+0000 7f1ca3fff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.894+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb801b050 con 0x55bb3857b380 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.894+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f1cb8015820 con 0x55bb3857b380 2024-09-15T23:01:26.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.896+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cbc0e0890 con 0x55bb3857b380 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.902+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f1cb8015a20 con 0x55bb3857b380 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.905+0000 7f1ccd1df740 10 client.27886 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.905+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55bb3859aa50 con 0x55bb3857b380 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.910+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cbc0e0890 con 0x55bb3857b380 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f1cb80133c0 con 0x55bb3857b380 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 10 client.27886 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 10 client.27886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 20 client.27886 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb3859c3b0 0x55bb3859e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 4 client.27886 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.911+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb384d2860 con 0x55bb3859c3b0 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.914+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb3859c3b0 0x55bb3859e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.923+0000 7f1ca3fff640 10 client.27886 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.923+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb3859c3b0 0x55bb3859e810 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c3ea0d8b66bf58a server_cookie=3d38c1603d5d097e in_seq=0 out_seq=0 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.929+0000 7f1ca3fff640 1 -- 172.21.15.66:0/2543198877 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb384d2860 con 0x55bb3859c3b0 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.929+0000 7f1ca3fff640 10 client.27886 handle_command_reply: tid=0 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.929+0000 7f1ccd1df740 1 client.27886 shutdown 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 msgr2=0x55bb385784f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb385784f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800bfd0 tx=0x7f1cb80046c0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 shutdown_connections 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb3859c3b0 0x55bb3859e810 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb385784f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38577f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2543198877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb3857ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ca3fff640 0 client.27886 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 >> 172.21.15.66:0/2543198877 conn(0x55bb38528310 msgr2=0x55bb38572970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 shutdown_connections 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2543198877 wait complete. 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.934+0000 7f1ccd1df740 20 client.27886 trim_cache size 0 max 16384 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 Processor -- start 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 -- start start 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38573130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb38573670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc419bbe0 con 0x55bb38571b50 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc419da20 con 0x55bb385705e0 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.960+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc419c370 con 0x55bb3857b380 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38573130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55746/0 (socket says 172.21.15.66:55746) 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/2490330465 learned_addr learned my addr 172.21.15.66:0/2490330465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/2490330465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 msgr2=0x55bb38573670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb38573670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/2490330465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 msgr2=0x55bb38573130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38573130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 -- 172.21.15.66:0/2490330465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb385764e0 con 0x55bb385705e0 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.961+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc09ed70 tx=0x7f1cbc0d6a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b4a8271a44a7903 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.962+0000 7f1caa7fc640 1 -- 172.21.15.66:0/2490330465 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0dd070 con 0x55bb385705e0 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.963+0000 7f1caa7fc640 1 -- 172.21.15.66:0/2490330465 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cbc0a2b30 con 0x55bb385705e0 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2490330465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 msgr2=0x55bb38598280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc09ed70 tx=0x7f1cbc0d6a70 comp rx=0 tx=0).stop 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2490330465 shutdown_connections 2024-09-15T23:01:26.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb3857b380 0x55bb38573670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb38571b50 0x55bb38573130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/2490330465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb385705e0 0x55bb38598280 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.964+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2490330465 >> 172.21.15.66:0/2490330465 conn(0x55bb38528310 msgr2=0x55bb3857a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.971+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2490330465 shutdown_connections 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.975+0000 7f1ccd1df740 1 -- 172.21.15.66:0/2490330465 wait complete. 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.975+0000 7f1ccd1df740 1 -- start start 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.975+0000 7f1ccd1df740 1 Processor -- start 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb38594ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3858fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc419d290 con 0x55bb3857b380 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc419cb00 con 0x55bb38590370 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc4073b30 con 0x55bb38571b50 2024-09-15T23:01:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.976+0000 7f1ccd1df740 10 client.0 _ll_register_callbacks cb 0x7f1cb800b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.979+0000 7f1cc93a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.979+0000 7f1cc8ba2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb38594ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.979+0000 7f1cc93a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55752/0 (socket says 172.21.15.66:55752) 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.979+0000 7f1cc93a3640 1 -- 172.21.15.66:0/1766044801 learned_addr learned my addr 172.21.15.66:0/1766044801 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.981+0000 7f1cc93a3640 1 -- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 msgr2=0x55bb38594ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.981+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb38594ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.981+0000 7f1cc93a3640 1 -- 172.21.15.66:0/1766044801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 msgr2=0x55bb3858fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.981+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3858fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.981+0000 7f1cc93a3640 1 -- 172.21.15.66:0/1766044801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb38606250 con 0x55bb38590370 2024-09-15T23:01:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.984+0000 7f1cc93a3640 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8013980 tx=0x7f1cb800f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e290168f3c836c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.984+0000 7f1ca3fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.985+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb801b040 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.985+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb384ccd70 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.985+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f1cb8013a00 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.986+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f1cb8015270 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.986+0000 7f1ccd1df740 10 client.28001 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.986+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55bb386075c0 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55bb384ccd70 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f1cb8033960 con 0x55bb38590370 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 10 client.28001 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 10 client.28001 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 20 client.28001 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb38607d40 0x55bb3860a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 4 client.28001 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.988+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb38449170 con 0x55bb38607d40 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:25.991+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb38607d40 0x55bb3860a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.002+0000 7f1cc8ba2640 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb38607d40 0x55bb3860a160 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57537a6bf5c80764 server_cookie=1fe587f3aced568 in_seq=0 out_seq=0 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.002+0000 7f1ca3fff640 10 client.28001 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.003+0000 7f1ca3fff640 1 -- 172.21.15.66:0/1766044801 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb38449170 con 0x55bb38607d40 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.003+0000 7f1ca3fff640 10 client.28001 handle_command_reply: tid=0 2024-09-15T23:01:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.003+0000 7f1ccd1df740 1 client.28001 shutdown 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.004+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 msgr2=0x55bb385907b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.004+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8013980 tx=0x7f1cb800f7d0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 shutdown_connections 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55bb38607d40 0x55bb3860a160 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb38590370 0x55bb385907b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bb3857b380 0x55bb3858fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 --2- 172.21.15.66:0/1766044801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb38571b50 0x55bb38594ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 >> 172.21.15.66:0/1766044801 conn(0x55bb38528310 msgr2=0x55bb3855a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ca3fff640 0 client.28001 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.005+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 shutdown_connections 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.007+0000 7f1ccd1df740 1 -- 172.21.15.66:0/1766044801 wait complete. 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.007+0000 7f1ccd1df740 20 client.28001 trim_cache size 0 max 16384 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.008+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 msgr2=0x7f1cac0a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.008+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 0x7f1cac0a5960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800b9d0 tx=0x7f1cb8008040 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.008+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 msgr2=0x7f1cc4196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.008+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b430 tx=0x7f1cbc00b8f0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 shutdown_connections 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1cac0a34a0 0x7f1cac0a5960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cc4196ce0 0x7f1cc41aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cc4101420 0x7f1cc41967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 --2- 172.21.15.66:0/3918799863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cc4100a80 0x7f1cc4196260 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 >> 172.21.15.66:0/3918799863 conn(0x7f1cc40fc7a0 msgr2=0x7f1cc40fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 shutdown_connections 2024-09-15T23:01:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:26.009+0000 7f1ccae06640 1 -- 172.21.15.66:0/3918799863 wait complete. 2024-09-15T23:01:26.971 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:01:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:27.201 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:27 smithi066 ceph-mon[31185]: pgmap v506: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2024-09-15T23:01:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:27 smithi184 ceph-mon[35203]: pgmap v506: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2024-09-15T23:01:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:27 smithi087 ceph-mon[35290]: pgmap v506: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2024-09-15T23:01:27.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.818+0000 7faf3a325640 1 -- 172.21.15.66:0/2702550557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 msgr2=0x7faf34109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:27.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.818+0000 7faf3a325640 1 --2- 172.21.15.66:0/2702550557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf34109c90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf2801a910 tx=0x7faf2803b430 comp rx=0 tx=0).stop 2024-09-15T23:01:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.825+0000 7faf3a325640 1 -- 172.21.15.66:0/2702550557 shutdown_connections 2024-09-15T23:01:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.825+0000 7faf3a325640 1 --2- 172.21.15.66:0/2702550557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf3411b140 0x7faf3411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.825+0000 7faf3a325640 1 --2- 172.21.15.66:0/2702550557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf34109c90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.825+0000 7faf3a325640 1 --2- 172.21.15.66:0/2702550557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf34109450 0x7faf34110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:27.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.825+0000 7faf3a325640 1 -- 172.21.15.66:0/2702550557 >> 172.21.15.66:0/2702550557 conn(0x7faf3406e140 msgr2=0x7faf3406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:27.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.829+0000 7faf3a325640 1 -- 172.21.15.66:0/2702550557 shutdown_connections 2024-09-15T23:01:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.830+0000 7faf3a325640 1 -- 172.21.15.66:0/2702550557 wait complete. 2024-09-15T23:01:27.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.831+0000 7faf3a325640 1 Processor -- start 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.840+0000 7faf3a325640 1 -- start start 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.840+0000 7faf3a325640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.840+0000 7faf3a325640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf341168f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.840+0000 7faf3a325640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3411b140 0x7faf34116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf3a325640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faf34113320 con 0x7faf3411b140 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf3a325640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faf341131a0 con 0x7faf34109450 2024-09-15T23:01:27.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf3a325640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faf341134a0 con 0x7faf34109830 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf33fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf33fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55768/0 (socket says 172.21.15.66:55768) 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf33fff640 1 -- 172.21.15.66:0/174191550 learned_addr learned my addr 172.21.15.66:0/174191550 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.841+0000 7faf388c2640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3411b140 0x7faf34116e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf337fe640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf341168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf33fff640 1 -- 172.21.15.66:0/174191550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 msgr2=0x7faf341168f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf33fff640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf341168f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:27.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf33fff640 1 -- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3411b140 msgr2=0x7faf34116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf33fff640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3411b140 0x7faf34116e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:27.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.842+0000 7faf33fff640 1 -- 172.21.15.66:0/174191550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf34117560 con 0x7faf34109450 2024-09-15T23:01:27.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.844+0000 7faf33fff640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00ba50 tx=0x7faf2c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.845+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c019070 con 0x7faf34109450 2024-09-15T23:01:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.845+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2c00cbe0 con 0x7faf34109450 2024-09-15T23:01:27.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.845+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0076e0 con 0x7faf34109450 2024-09-15T23:01:27.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.848+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf341ab170 con 0x7faf34109450 2024-09-15T23:01:27.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.848+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341ab570 con 0x7faf34109450 2024-09-15T23:01:27.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.851+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf20005290 con 0x7faf34109450 2024-09-15T23:01:27.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.855+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7faf2c01c070 con 0x7faf34109450 2024-09-15T23:01:27.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.856+0000 7faf317fa640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 0x7faf1c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.856+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7faf2c0cf5b0 con 0x7faf34109450 2024-09-15T23:01:27.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.856+0000 7faf337fe640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 0x7faf1c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:27.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.857+0000 7faf337fe640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 0x7faf1c0a5a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf28005ab0 tx=0x7faf28000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:27.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:27.862+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf2c09b5c0 con 0x7faf34109450 2024-09-15T23:01:28.016 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:28.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.279+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf20005580 con 0x7faf34109450 2024-09-15T23:01:28.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.285+0000 7faf317fa640 1 -- 172.21.15.66:0/174191550 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7faf2c09f8c0 con 0x7faf34109450 2024-09-15T23:01:28.286 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:01:28.286 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:01:28.287 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T23:01:28.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.291+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 msgr2=0x7faf1c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.291+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 0x7faf1c0a5a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf28005ab0 tx=0x7faf28000bc0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.291+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 msgr2=0x7faf3411a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.291+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00ba50 tx=0x7faf2c00bf10 comp rx=0 tx=0).stop 2024-09-15T23:01:28.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 shutdown_connections 2024-09-15T23:01:28.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7faf1c0a35c0 0x7faf1c0a5a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3411b140 0x7faf34116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf34109830 0x7faf341168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 --2- 172.21.15.66:0/174191550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf34109450 0x7faf3411a850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.293+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 >> 172.21.15.66:0/174191550 conn(0x7faf3406e140 msgr2=0x7faf340722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.294+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 shutdown_connections 2024-09-15T23:01:28.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.296+0000 7faf3a325640 1 -- 172.21.15.66:0/174191550 wait complete. 2024-09-15T23:01:28.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.841+0000 7f72c53b4640 1 -- 172.21.15.66:0/1873823557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0101460 msgr2=0x7f72c0105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.841+0000 7f72c53b4640 1 --2- 172.21.15.66:0/1873823557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0101460 0x7f72c0105930 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b002a4b0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.844+0000 7f72c53b4640 1 -- 172.21.15.66:0/1873823557 shutdown_connections 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.844+0000 7f72c53b4640 1 --2- 172.21.15.66:0/1873823557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0105f50 0x7f72c01063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.844+0000 7f72c53b4640 1 --2- 172.21.15.66:0/1873823557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0101460 0x7f72c0105930 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.844+0000 7f72c53b4640 1 --2- 172.21.15.66:0/1873823557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0100b40 0x7f72c0100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.844+0000 7f72c53b4640 1 -- 172.21.15.66:0/1873823557 >> 172.21.15.66:0/1873823557 conn(0x7f72c00fc7d0 msgr2=0x7f72c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.846+0000 7f72c53b4640 1 -- 172.21.15.66:0/1873823557 shutdown_connections 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.849+0000 7f72c53b4640 1 -- 172.21.15.66:0/1873823557 wait complete. 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.850+0000 7f72c53b4640 1 Processor -- start 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.852+0000 7f72c53b4640 1 -- start start 2024-09-15T23:01:28.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0101460 0x7f72c010f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 0x7f72c0114740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0107510 con 0x7f72c0105f50 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0107390 con 0x7f72c0100b40 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72c53b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0107690 con 0x7f72c0101460 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.853+0000 7f72beffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.854+0000 7f72beffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55782/0 (socket says 172.21.15.66:55782) 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.854+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 0x7f72c0114740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.854+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 0x7f72c0114740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43250/0 (socket says 172.21.15.66:43250) 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.854+0000 7f72beffd640 1 -- 172.21.15.66:0/503350755 learned_addr learned my addr 172.21.15.66:0/503350755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.854+0000 7f72be7fc640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0101460 0x7f72c010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.855+0000 7f72beffd640 1 -- 172.21.15.66:0/503350755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0101460 msgr2=0x7f72c010f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.855+0000 7f72beffd640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0101460 0x7f72c010f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.855+0000 7f72beffd640 1 -- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 msgr2=0x7f72c0114740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.855+0000 7f72beffd640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 0x7f72c0114740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.855+0000 7f72beffd640 1 -- 172.21.15.66:0/503350755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0114fb0 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.857+0000 7f72beffd640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72a800b450 tx=0x7f72a800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.860+0000 7f72b7fff640 1 -- 172.21.15.66:0/503350755 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8015020 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.860+0000 7f72b7fff640 1 -- 172.21.15.66:0/503350755 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8011d70 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.861+0000 7f72b7fff640 1 -- 172.21.15.66:0/503350755 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800f340 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.861+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01152a0 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.861+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c006bde0 con 0x7f72c0100b40 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.865+0000 7f72c778d740 1 Processor -- start 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.866+0000 7f72c778d740 1 -- start start 2024-09-15T23:01:28.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.866+0000 7f72c778d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.866+0000 7f72c778d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2b5d0 0x561fc5a2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72c778d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72c778d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561fc59912f0 con 0x561fc5a36370 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72c778d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561fc5938cf0 con 0x561fc5a2b5d0 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43260/0 (socket says 172.21.15.66:43260) 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 -- 172.21.15.66:0/1531828848 learned_addr learned my addr 172.21.15.66:0/1531828848 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561fc598d2b0 con 0x561fc5a2cb40 2024-09-15T23:01:28.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72b7fff640 1 -- 172.21.15.66:0/503350755 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f72a8018020 con 0x7f72c0100b40 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 -- 172.21.15.66:0/1531828848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 msgr2=0x561fc5a2b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 -- 172.21.15.66:0/1531828848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2b5d0 msgr2=0x561fc5a2ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2b5d0 0x561fc5a2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.867+0000 7f72be7fc640 1 -- 172.21.15.66:0/1531828848 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fc591d3a0 con 0x561fc5a36370 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.868+0000 7f72be7fc640 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d7f72a27f1a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.868+0000 7f72b57fa640 1 -- 172.21.15.66:0/1531828848 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0041070 con 0x561fc5a36370 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.868+0000 7f72b57fa640 1 -- 172.21.15.66:0/1531828848 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b0005500 con 0x561fc5a36370 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.869+0000 7f72b57fa640 1 -- 172.21.15.66:0/1531828848 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0035040 con 0x561fc5a36370 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.869+0000 7f72b7fff640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 0x7f72ac0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.869+0000 7f72b7fff640 1 -- 172.21.15.66:0/503350755 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f72a80cf870 con 0x7f72c0100b40 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.869+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 0x7f72ac0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 msgr2=0x561fc5a38760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b00316d0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 shutdown_connections 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a38760 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 0x7f72ac0a58e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009440 tx=0x7f72b800d040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2b5d0 0x561fc5a2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 --2- 172.21.15.66:0/1531828848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.870+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 >> 172.21.15.66:0/1531828848 conn(0x561fc59f4310 msgr2=0x561fc5a27c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.871+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 shutdown_connections 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.871+0000 7f72c778d740 1 -- 172.21.15.66:0/1531828848 wait complete. 2024-09-15T23:01:28.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.871+0000 7f72c778d740 1 -- start start 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.871+0000 7f72c778d740 1 Processor -- start 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2cb40 0x561fc5a33630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561fc5a39010 con 0x561fc5a36370 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x561fc594c060 con 0x561fc5a2cb40 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561fc5a39190 con 0x561fc5a2b5d0 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.872+0000 7f72c778d740 10 client.0 _ll_register_callbacks cb 0x561fc569f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.875+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.875+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43266/0 (socket says 172.21.15.66:43266) 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.875+0000 7f72bf7fe640 1 -- 172.21.15.66:0/4094406826 learned_addr learned my addr 172.21.15.66:0/4094406826 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.875+0000 7f72beffd640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 -- 172.21.15.66:0/4094406826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 msgr2=0x561fc5a330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 -- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2cb40 msgr2=0x561fc5a33630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2cb40 0x561fc5a33630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 -- 172.21.15.66:0/4094406826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fc57023c0 con 0x561fc5a36370 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f72b8016e20 tx=0x7f72b8004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f51f9e760f057 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.876+0000 7f72a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.877+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80205f0 con 0x561fc5a36370 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.877+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b0005500 con 0x561fc5a36370 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.877+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f72b8020790 con 0x561fc5a36370 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.877+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f72b802b050 con 0x561fc5a36370 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.878+0000 7f72c778d740 10 client.18726 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:28.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.878+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561fc5a44cb0 con 0x561fc5a36370 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.878+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b0005500 con 0x561fc5a36370 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.879+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f72b8013aa0 con 0x561fc5a36370 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.879+0000 7f72c778d740 10 client.18726 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72c778d740 10 client.18726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72c778d740 20 client.18726 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5a46670 0x561fc5a48b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72c778d740 4 client.18726 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fc599e860 con 0x561fc5a46670 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.880+0000 7f72beffd640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5a46670 0x561fc5a48b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.883+0000 7f72beffd640 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5a46670 0x561fc5a48b10 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3a14fb8d8a9601 server_cookie=99d20ae0f24ab15d in_seq=0 out_seq=0 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.883+0000 7f72a67fc640 10 client.18726 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.885+0000 7f72a67fc640 1 -- 172.21.15.66:0/4094406826 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fc599e860 con 0x561fc5a46670 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.885+0000 7f72a67fc640 10 client.18726 handle_command_reply: tid=0 2024-09-15T23:01:28.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.885+0000 7f72c778d740 1 client.18726 shutdown 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.888+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 msgr2=0x561fc5a33b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.888+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f72b8016e20 tx=0x7f72b8004a60 comp rx=0 tx=0).stop 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 shutdown_connections 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a36370 0x561fc5a33b70 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5a46670 0x561fc5a48b10 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a2cb40 0x561fc5a33630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 --2- 172.21.15.66:0/4094406826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 >> 172.21.15.66:0/4094406826 conn(0x561fc59f4310 msgr2=0x561fc5a2d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.891+0000 7f72a67fc640 0 client.18726 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:28.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.892+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 shutdown_connections 2024-09-15T23:01:28.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.895+0000 7f72c778d740 1 -- 172.21.15.66:0/4094406826 wait complete. 2024-09-15T23:01:28.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.895+0000 7f72c778d740 20 client.18726 trim_cache size 0 max 16384 2024-09-15T23:01:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 Processor -- start 2024-09-15T23:01:28.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 -- start start 2024-09-15T23:01:28.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2cb40 0x561fc5a2e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5a2e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c6560 con 0x561fc5a2cb40 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c83a0 con 0x561fc5a36370 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72c778d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c6cf0 con 0x561fc5a2b5d0 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.923+0000 7f72beffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2cb40 0x561fc5a2e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45892/0 (socket says 172.21.15.66:45892) 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 -- 172.21.15.66:0/4010615121 learned_addr learned my addr 172.21.15.66:0/4010615121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5a2e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 -- 172.21.15.66:0/4010615121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 msgr2=0x561fc5a2e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5a2e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 -- 172.21.15.66:0/4010615121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2cb40 msgr2=0x561fc5a2e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2cb40 0x561fc5a2e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.924+0000 7f72beffd640 1 -- 172.21.15.66:0/4010615121 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fc5a2bd80 con 0x561fc5a2b5d0 2024-09-15T23:01:28.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.927+0000 7f72beffd640 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72a8098120 tx=0x7f72a801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a21a58b45719fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.931+0000 7f72b4ff9640 1 -- 172.21.15.66:0/4010615121 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8099a50 con 0x561fc5a2b5d0 2024-09-15T23:01:28.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.931+0000 7f72b4ff9640 1 -- 172.21.15.66:0/4010615121 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8097dc0 con 0x561fc5a2b5d0 2024-09-15T23:01:28.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.931+0000 7f72b4ff9640 1 -- 172.21.15.66:0/4010615121 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a809ae90 con 0x561fc5a2b5d0 2024-09-15T23:01:28.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.932+0000 7f72c778d740 1 -- 172.21.15.66:0/4010615121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 msgr2=0x561fc5a339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.932+0000 7f72c778d740 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72a8098120 tx=0x7f72a801c040 comp rx=0 tx=0).stop 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.937+0000 7f72c778d740 1 -- 172.21.15.66:0/4010615121 shutdown_connections 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.937+0000 7f72c778d740 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5a2e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.937+0000 7f72c778d740 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2cb40 0x561fc5a2e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.937+0000 7f72c778d740 1 --2- 172.21.15.66:0/4010615121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2b5d0 0x561fc5a339c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.937+0000 7f72c778d740 1 -- 172.21.15.66:0/4010615121 >> 172.21.15.66:0/4010615121 conn(0x561fc59f4310 msgr2=0x561fc5a35170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.939+0000 7f72c778d740 1 -- 172.21.15.66:0/4010615121 shutdown_connections 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.940+0000 7f72c778d740 1 -- 172.21.15.66:0/4010615121 wait complete. 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.940+0000 7f72c778d740 1 -- start start 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.940+0000 7f72c778d740 1 Processor -- start 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2b5d0 0x561fc5a399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5aaf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c7c10 con 0x561fc5a2b5d0 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c7480 con 0x561fc5a36370 2024-09-15T23:01:28.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72c006b070 con 0x561fc5a2cb40 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72be7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72be7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45908/0 (socket says 172.21.15.66:45908) 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72be7fc640 1 -- 172.21.15.66:0/3465591973 learned_addr learned my addr 172.21.15.66:0/3465591973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72bf7fe640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5aaf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.941+0000 7f72c778d740 10 client.0 _ll_register_callbacks cb 0x7f72b8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.942+0000 7f72be7fc640 1 -- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 msgr2=0x561fc5aaf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.942+0000 7f72be7fc640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5aaf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.942+0000 7f72be7fc640 1 -- 172.21.15.66:0/3465591973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2b5d0 msgr2=0x561fc5a399e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.942+0000 7f72be7fc640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2b5d0 0x561fc5a399e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.942+0000 7f72be7fc640 1 -- 172.21.15.66:0/3465591973 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fc5aaf9f0 con 0x561fc5a2cb40 2024-09-15T23:01:28.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.945+0000 7f72be7fc640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfee7e77c5ab6ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:28.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.945+0000 7f72a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:28.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.945+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0041050 con 0x561fc5a2cb40 2024-09-15T23:01:28.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.945+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a8097dc0 con 0x561fc5a2cb40 2024-09-15T23:01:28.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.946+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f72b00037f0 con 0x561fc5a2cb40 2024-09-15T23:01:28.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.950+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f72b0057050 con 0x561fc5a2cb40 2024-09-15T23:01:28.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.950+0000 7f72c778d740 10 client.27904 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:28.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.950+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x561fc5ad2ca0 con 0x561fc5a2cb40 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8097dc0 con 0x561fc5a2cb40 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f72b003a040 con 0x561fc5a2cb40 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 10 client.27904 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 10 client.27904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 20 client.27904 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5ad3390 0x561fc5ad57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:28.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 4 client.27904 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:01:28.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.951+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561fc5998d70 con 0x561fc5ad3390 2024-09-15T23:01:28.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.953+0000 7f72beffd640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5ad3390 0x561fc5ad57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:28.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.959+0000 7f72a67fc640 10 client.27904 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:28.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.959+0000 7f72beffd640 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5ad3390 0x561fc5ad57b0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e0178eb8d4e2910 server_cookie=afee83d9e86d6cab in_seq=0 out_seq=0 2024-09-15T23:01:28.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.960+0000 7f72a67fc640 1 -- 172.21.15.66:0/3465591973 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561fc5998d70 con 0x561fc5ad3390 2024-09-15T23:01:28.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.960+0000 7f72a67fc640 10 client.27904 handle_command_reply: tid=0 2024-09-15T23:01:28.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.960+0000 7f72c778d740 1 client.27904 shutdown 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.963+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 msgr2=0x561fc5a39f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.963+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b0004270 comp rx=0 tx=0).stop 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 shutdown_connections 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x561fc5ad3390 0x561fc5ad57b0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561fc5a36370 0x561fc5aaf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561fc5a2cb40 0x561fc5a39f20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 --2- 172.21.15.66:0/3465591973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fc5a2b5d0 0x561fc5a399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 >> 172.21.15.66:0/3465591973 conn(0x561fc59f4310 msgr2=0x561fc5a264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72a67fc640 0 client.27904 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:28.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 shutdown_connections 2024-09-15T23:01:28.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.964+0000 7f72c778d740 1 -- 172.21.15.66:0/3465591973 wait complete. 2024-09-15T23:01:28.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.968+0000 7f72c778d740 20 client.27904 trim_cache size 0 max 16384 2024-09-15T23:01:28.971 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:01:28.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 msgr2=0x7f72ac0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 0x7f72ac0a58e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009440 tx=0x7f72b800d040 comp rx=0 tx=0).stop 2024-09-15T23:01:28.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 msgr2=0x7f72c010ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:28.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72a800b450 tx=0x7f72a800b910 comp rx=0 tx=0).stop 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 shutdown_connections 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72ac0a3420 0x7f72ac0a58e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72c0105f50 0x7f72c0114740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72c0101460 0x7f72c010f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 --2- 172.21.15.66:0/503350755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c0100b40 0x7f72c010ef00 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72a800b450 tx=0x7f72a800b910 comp rx=0 tx=0).stop 2024-09-15T23:01:28.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.971+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 >> 172.21.15.66:0/503350755 conn(0x7f72c00fc7d0 msgr2=0x7f72c0103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:28.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.973+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 shutdown_connections 2024-09-15T23:01:28.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:28.973+0000 7f72c53b4640 1 -- 172.21.15.66:0/503350755 wait complete. 2024-09-15T23:01:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:29 smithi184 ceph-mon[35203]: pgmap v507: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 93 op/s 2024-09-15T23:01:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:29 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/174191550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:29.453 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:29 smithi066 ceph-mon[31185]: pgmap v507: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 93 op/s 2024-09-15T23:01:29.453 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:29 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/174191550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:29 smithi087 ceph-mon[35290]: pgmap v507: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 93 op/s 2024-09-15T23:01:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:29 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/174191550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:30.702 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 137.7 --await-for 45.0' 2024-09-15T23:01:30.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 137.7 --await-for 45.0 2024-09-15T23:01:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:31 smithi184 ceph-mon[35203]: pgmap v508: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 102 op/s 2024-09-15T23:01:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:31 smithi066 ceph-mon[31185]: pgmap v508: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 102 op/s 2024-09-15T23:01:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:31 smithi087 ceph-mon[35290]: pgmap v508: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 102 op/s 2024-09-15T23:01:32.610 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 -- 172.21.15.66:0/604069114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102570 msgr2=0x7f04101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 --2- 172.21.15.66:0/604069114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102570 0x7f04101029b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f040401a910 tx=0x7f040403d710 comp rx=0 tx=0).stop 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 -- 172.21.15.66:0/604069114 shutdown_connections 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 --2- 172.21.15.66:0/604069114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0410102ef0 0x7f041010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 --2- 172.21.15.66:0/604069114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102570 0x7f04101029b0 secure :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f040401a910 tx=0x7f040403d710 comp rx=0 tx=0).stop 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 --2- 172.21.15.66:0/604069114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0410100e20 0x7f0410101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.308+0000 7f04154ec640 1 -- 172.21.15.66:0/604069114 >> 172.21.15.66:0/604069114 conn(0x7f04100fc7d0 msgr2=0x7f04100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.311+0000 7f04154ec640 1 -- 172.21.15.66:0/604069114 shutdown_connections 2024-09-15T23:01:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.312+0000 7f04154ec640 1 -- 172.21.15.66:0/604069114 wait complete. 2024-09-15T23:01:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.313+0000 7f04154ec640 1 Processor -- start 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.313+0000 7f04154ec640 1 -- start start 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.313+0000 7f04154ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0410100e20 0x7f0410073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.313+0000 7f04154ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102ef0 0x7f041006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.314+0000 7f04154ec640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.314+0000 7f04154ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f041006d590 con 0x7f0410102ef0 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.314+0000 7f04154ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f041006d410 con 0x7f0410100e20 2024-09-15T23:01:33.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.314+0000 7f04154ec640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f041006d710 con 0x7f041006f1d0 2024-09-15T23:01:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.314+0000 7f040f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.315+0000 7f040f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49590/0 (socket says 172.21.15.66:49590) 2024-09-15T23:01:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.315+0000 7f040f7fe640 1 -- 172.21.15.66:0/3305040648 learned_addr learned my addr 172.21.15.66:0/3305040648 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.316+0000 7f040f7fe640 1 -- 172.21.15.66:0/3305040648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0410100e20 msgr2=0x7f0410073c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.316+0000 7f040f7fe640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0410100e20 0x7f0410073c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.317+0000 7f040f7fe640 1 -- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102ef0 msgr2=0x7f041006ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.317+0000 7f040f7fe640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102ef0 0x7f041006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.317+0000 7f040f7fe640 1 -- 172.21.15.66:0/3305040648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04101933f0 con 0x7f041006f1d0 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.320+0000 7f040f7fe640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f040800b9c0 tx=0x7f040800be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.320+0000 7f03f7fff640 1 -- 172.21.15.66:0/3305040648 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408019070 con 0x7f041006f1d0 2024-09-15T23:01:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.321+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04101936e0 con 0x7f041006f1d0 2024-09-15T23:01:33.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.321+0000 7f03f7fff640 1 -- 172.21.15.66:0/3305040648 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040800cba0 con 0x7f041006f1d0 2024-09-15T23:01:33.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.321+0000 7f03f7fff640 1 -- 172.21.15.66:0/3305040648 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408019070 con 0x7f041006f1d0 2024-09-15T23:01:33.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.321+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0410193ca0 con 0x7f041006f1d0 2024-09-15T23:01:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.328+0000 7f04178c5740 1 Processor -- start 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.330+0000 7f04178c5740 1 -- start start 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a4710b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 0x5590a471b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a471b940 0x5590a471dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5590a46762a0 con 0x5590a4710760 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5590a461db10 con 0x5590a4711080 2024-09-15T23:01:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f04178c5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5590a4672260 con 0x5590a471b940 2024-09-15T23:01:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.331+0000 7f03f7fff640 1 -- 172.21.15.66:0/3305040648 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f040801c070 con 0x7f041006f1d0 2024-09-15T23:01:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f03f7fff640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 0x7f03f80a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f03f7fff640 1 -- 172.21.15.66:0/3305040648 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f040800c9a0 con 0x7f041006f1d0 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a471b940 0x5590a471dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a4710b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a4710b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40722/0 (socket says 172.21.15.66:40722) 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.332+0000 7f040e7fc640 1 -- 172.21.15.66:0/1596357259 learned_addr learned my addr 172.21.15.66:0/1596357259 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.334+0000 7f040f7fe640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 0x7f03f80a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.337+0000 7f040effd640 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 0x5590a471b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 -- 172.21.15.66:0/1596357259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a471b940 msgr2=0x5590a471dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a471b940 0x5590a471dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 -- 172.21.15.66:0/1596357259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 msgr2=0x5590a4710b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a4710b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 -- 172.21.15.66:0/1596357259 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a43e7b90 con 0x5590a4711080 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.339+0000 7f040effd640 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 0x5590a471b400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0400009690 tx=0x7f0400009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d65d9f8be27757 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.340+0000 7f03f57fa640 1 -- 172.21.15.66:0/1596357259 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400015020 con 0x5590a4711080 2024-09-15T23:01:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.340+0000 7f040f7fe640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 0x7f03f80a5d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f040809ca40 tx=0x7f04080093e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.340+0000 7f03f57fa640 1 -- 172.21.15.66:0/1596357259 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040000bda0 con 0x5590a4711080 2024-09-15T23:01:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 -- 172.21.15.66:0/1596357259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 msgr2=0x5590a471b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 0x5590a471b400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0400009690 tx=0x7f0400009b50 comp rx=0 tx=0).stop 2024-09-15T23:01:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 -- 172.21.15.66:0/1596357259 shutdown_connections 2024-09-15T23:01:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a471b940 0x5590a471dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4711080 0x5590a471b400 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0400009690 tx=0x7f0400009b50 comp rx=0 tx=0).stop 2024-09-15T23:01:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 --2- 172.21.15.66:0/1596357259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a4710b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.341+0000 7f04178c5740 1 -- 172.21.15.66:0/1596357259 >> 172.21.15.66:0/1596357259 conn(0x5590a470ccf0 msgr2=0x5590a470d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:33.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.342+0000 7f04178c5740 1 -- 172.21.15.66:0/1596357259 shutdown_connections 2024-09-15T23:01:33.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.343+0000 7f04178c5740 1 -- 172.21.15.66:0/1596357259 wait complete. 2024-09-15T23:01:33.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.344+0000 7f04178c5740 1 -- start start 2024-09-15T23:01:33.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.344+0000 7f04178c5740 1 Processor -- start 2024-09-15T23:01:33.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.344+0000 7f04178c5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a47188e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a4727b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a47188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a47188e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40736/0 (socket says 172.21.15.66:40736) 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f040effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f040effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47800/0 (socket says 172.21.15.66:47800) 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f040e7fc640 1 -- 172.21.15.66:0/1628349113 learned_addr learned my addr 172.21.15.66:0/1628349113 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5590a471e5b0 con 0x5590a4710760 2024-09-15T23:01:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5590a45fe6e0 con 0x5590a471b940 2024-09-15T23:01:33.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5590a471e730 con 0x5590a4719360 2024-09-15T23:01:33.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.345+0000 7f04178c5740 10 client.0 _ll_register_callbacks cb 0x5590a4622a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:33.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.347+0000 7f040e7fc640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a4727b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.348+0000 7f040effd640 1 -- 172.21.15.66:0/1628349113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 msgr2=0x5590a4727b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.348+0000 7f040effd640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a4727b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.348+0000 7f040effd640 1 -- 172.21.15.66:0/1628349113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 msgr2=0x5590a47188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.348+0000 7f040effd640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a47188e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.348+0000 7f040effd640 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a4728040 con 0x5590a471b940 2024-09-15T23:01:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.350+0000 7f040effd640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5590a470dc50 tx=0x7f0400011650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1411c440e6186d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.351+0000 7f03f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.351+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400015050 con 0x5590a471b940 2024-09-15T23:01:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.352+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f040000bad0 con 0x5590a471b940 2024-09-15T23:01:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.352+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f040000bda0 con 0x5590a471b940 2024-09-15T23:01:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.354+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f04000092b0 con 0x5590a471b940 2024-09-15T23:01:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.360+0000 7f04178c5740 10 client.28022 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.360+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5590a472a990 con 0x5590a471b940 2024-09-15T23:01:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.361+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040000bda0 con 0x5590a471b940 2024-09-15T23:01:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.362+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f0400003ad0 con 0x5590a471b940 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 10 client.28022 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 10 client.28022 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 20 client.28022 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a472c1a0 0x5590a472e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 4 client.28022 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.363+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590a46839d0 con 0x5590a472c1a0 2024-09-15T23:01:33.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.366+0000 7f040e7fc640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a472c1a0 0x5590a472e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.367+0000 7f040e7fc640 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a472c1a0 0x5590a472e620 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528b6329b00a41c3 server_cookie=aa6846a39e4cd1bf in_seq=0 out_seq=0 2024-09-15T23:01:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.367+0000 7f03f2ff5640 10 client.28022 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.368+0000 7f03f2ff5640 1 -- 172.21.15.66:0/1628349113 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590a46839d0 con 0x5590a472c1a0 2024-09-15T23:01:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.368+0000 7f03f2ff5640 10 client.28022 handle_command_reply: tid=0 2024-09-15T23:01:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.368+0000 7f04178c5740 1 client.28022 shutdown 2024-09-15T23:01:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.372+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 msgr2=0x5590a4718e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.372+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5590a470dc50 tx=0x7f0400011650 comp rx=0 tx=0).stop 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 shutdown_connections 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a4727b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a472c1a0 0x5590a472e620 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4718e20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 --2- 172.21.15.66:0/1628349113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a47188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 >> 172.21.15.66:0/1628349113 conn(0x5590a470ccf0 msgr2=0x5590a4712a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:33.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.373+0000 7f03f2ff5640 0 client.28022 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.377+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 shutdown_connections 2024-09-15T23:01:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.380+0000 7f04178c5740 1 -- 172.21.15.66:0/1628349113 wait complete. 2024-09-15T23:01:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.381+0000 7f04178c5740 20 client.28022 trim_cache size 0 max 16384 2024-09-15T23:01:33.419 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:01:33.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:01:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:33 smithi184 ceph-mon[35203]: pgmap v509: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-09-15T23:01:33.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.423+0000 7f04178c5740 1 Processor -- start 2024-09-15T23:01:33.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.424+0000 7f04178c5740 1 -- start start 2024-09-15T23:01:33.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:33 smithi066 ceph-mon[31185]: pgmap v509: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-09-15T23:01:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.424+0000 7f04178c5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 0x5590a47278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.424+0000 7f04178c5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f04178c5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a471b940 0x5590a4733f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f040effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f040effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49622/0 (socket says 172.21.15.66:49622) 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 0x5590a47278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 0x5590a47278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47814/0 (socket says 172.21.15.66:47814) 2024-09-15T23:01:33.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f040effd640 1 -- 172.21.15.66:0/1852640647 learned_addr learned my addr 172.21.15.66:0/1852640647 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:33.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc010380 con 0x5590a471b940 2024-09-15T23:01:33.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0121c0 con 0x5590a4710760 2024-09-15T23:01:33.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.425+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc010b10 con 0x5590a4719360 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.426+0000 7f040e7fc640 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a471b940 0x5590a4733f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.427+0000 7f040effd640 1 -- 172.21.15.66:0/1852640647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 msgr2=0x5590a47278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.427+0000 7f040effd640 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 0x5590a47278f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.427+0000 7f040effd640 1 -- 172.21.15.66:0/1852640647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a471b940 msgr2=0x5590a4733f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.427+0000 7f040effd640 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a471b940 0x5590a4733f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.427+0000 7f040effd640 1 -- 172.21.15.66:0/1852640647 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a47135d0 con 0x5590a4719360 2024-09-15T23:01:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.429+0000 7f040effd640 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0400009b90 tx=0x7f0400010780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a5bab3be74845c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.432+0000 7f03f4ff9640 1 -- 172.21.15.66:0/1852640647 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400015030 con 0x5590a4719360 2024-09-15T23:01:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.432+0000 7f03f4ff9640 1 -- 172.21.15.66:0/1852640647 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040000b8d0 con 0x5590a4719360 2024-09-15T23:01:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.433+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 msgr2=0x5590a471a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.434+0000 7f04178c5740 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0400009b90 tx=0x7f0400010780 comp rx=0 tx=0).stop 2024-09-15T23:01:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.446+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 shutdown_connections 2024-09-15T23:01:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.446+0000 7f04178c5740 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a471b940 0x5590a4733f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.446+0000 7f04178c5740 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471a850 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.446+0000 7f04178c5740 1 --2- 172.21.15.66:0/1852640647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a4710760 0x5590a47278f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.446+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 >> 172.21.15.66:0/1852640647 conn(0x5590a470ccf0 msgr2=0x5590a471a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:33.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.451+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 shutdown_connections 2024-09-15T23:01:33.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.451+0000 7f04178c5740 1 -- 172.21.15.66:0/1852640647 wait complete. 2024-09-15T23:01:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 -- start start 2024-09-15T23:01:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 Processor -- start 2024-09-15T23:01:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4720480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc011a30 con 0x5590a4710760 2024-09-15T23:01:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc0112a0 con 0x5590a471b940 2024-09-15T23:01:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc00e380 con 0x5590a4719360 2024-09-15T23:01:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.452+0000 7f04178c5740 10 client.0 _ll_register_callbacks cb 0x7f0400009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:33.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.453+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.453+0000 7f040e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40756/0 (socket says 172.21.15.66:40756) 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.453+0000 7f040e7fc640 1 -- 172.21.15.66:0/3075189284 learned_addr learned my addr 172.21.15.66:0/3075189284 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.453+0000 7f040e7fc640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4720480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.454+0000 7f040e7fc640 1 -- 172.21.15.66:0/3075189284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 msgr2=0x5590a471ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.454+0000 7f040e7fc640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.455+0000 7f040e7fc640 1 -- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 msgr2=0x5590a4720480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.455+0000 7f040e7fc640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4720480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.455+0000 7f040e7fc640 1 -- 172.21.15.66:0/3075189284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a4795fd0 con 0x5590a4710760 2024-09-15T23:01:33.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.459+0000 7f040e7fc640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0410101be0 tx=0x7f0400006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690cea9979ca10df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:33.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.459+0000 7f03f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.462+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404000e60 con 0x5590a4710760 2024-09-15T23:01:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.463+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5590a467dd20 con 0x5590a4710760 2024-09-15T23:01:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.463+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f0404019040 con 0x5590a4710760 2024-09-15T23:01:33.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.466+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0404048040 con 0x5590a4710760 2024-09-15T23:01:33.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.467+0000 7f04178c5740 10 client.18744 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.467+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5590a47973b0 con 0x5590a4710760 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5590a467dd20 con 0x5590a4710760 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f040404d040 con 0x5590a4710760 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 10 client.18744 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 10 client.18744 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 20 client.18744 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a4797c40 0x5590a479a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 4 client.18744 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.7, "await_for": 45.0}] 2024-09-15T23:01:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.468+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.7, "await_for": 45.0}) -- 0x5590a45f9ec0 con 0x5590a4797c40 2024-09-15T23:01:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.470+0000 7f040effd640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a4797c40 0x5590a479a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.476+0000 7f040effd640 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a4797c40 0x5590a479a060 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c87de16f5ec296e0 server_cookie=d45baa254a93c9a8 in_seq=0 out_seq=0 2024-09-15T23:01:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:33.476+0000 7f03f2ff5640 10 client.18744 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:33 smithi087 ceph-mon[35290]: pgmap v509: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-09-15T23:01:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:35.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:35 smithi066 ceph-mon[31185]: pgmap v510: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 104 op/s 2024-09-15T23:01:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:35 smithi184 ceph-mon[35203]: pgmap v510: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 104 op/s 2024-09-15T23:01:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:35 smithi087 ceph-mon[35290]: pgmap v510: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 104 op/s 2024-09-15T23:01:35.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.831+0000 7f12de73d640 1 -- 172.21.15.66:0/850711316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 msgr2=0x7f12d8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:35.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.831+0000 7f12de73d640 1 --2- 172.21.15.66:0/850711316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d8109c90 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009ca0 tx=0x7f12d002a8f0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.835+0000 7f12de73d640 1 -- 172.21.15.66:0/850711316 shutdown_connections 2024-09-15T23:01:35.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.835+0000 7f12de73d640 1 --2- 172.21.15.66:0/850711316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d811b140 0x7f12d811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.835+0000 7f12de73d640 1 --2- 172.21.15.66:0/850711316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d8109c90 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.835+0000 7f12de73d640 1 --2- 172.21.15.66:0/850711316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.835+0000 7f12de73d640 1 -- 172.21.15.66:0/850711316 >> 172.21.15.66:0/850711316 conn(0x7f12d806e140 msgr2=0x7f12d806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.840+0000 7f12de73d640 1 -- 172.21.15.66:0/850711316 shutdown_connections 2024-09-15T23:01:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.840+0000 7f12de73d640 1 -- 172.21.15.66:0/850711316 wait complete. 2024-09-15T23:01:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 Processor -- start 2024-09-15T23:01:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 -- start start 2024-09-15T23:01:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d81a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d811b140 0x7f12d81abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f12d8120e30 con 0x7f12d8109830 2024-09-15T23:01:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12d8120cb0 con 0x7f12d811b140 2024-09-15T23:01:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.841+0000 7f12de73d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12d8120fb0 con 0x7f12d8109450 2024-09-15T23:01:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.842+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.842+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49646/0 (socket says 172.21.15.66:49646) 2024-09-15T23:01:35.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.842+0000 7f12d7fff640 1 -- 172.21.15.66:0/1277873973 learned_addr learned my addr 172.21.15.66:0/1277873973 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:35.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d81a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 -- 172.21.15.66:0/1277873973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 msgr2=0x7f12d81a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 -- 172.21.15.66:0/1277873973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d811b140 msgr2=0x7f12d81abc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d811b140 0x7f12d81abc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.843+0000 7f12d77fe640 1 -- 172.21.15.66:0/1277873973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d81ac300 con 0x7f12d8109830 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.844+0000 7f12d7fff640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:01:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.844+0000 7f12d77fe640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d81a7890 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009ca0 tx=0x7f12d0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:35.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.845+0000 7f12d57fa640 1 -- 172.21.15.66:0/1277873973 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0031680 con 0x7f12d8109830 2024-09-15T23:01:35.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.845+0000 7f12d57fa640 1 -- 172.21.15.66:0/1277873973 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d002d070 con 0x7f12d8109830 2024-09-15T23:01:35.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.845+0000 7f12d57fa640 1 -- 172.21.15.66:0/1277873973 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d002f9c0 con 0x7f12d8109830 2024-09-15T23:01:35.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.845+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d81ac590 con 0x7f12d8109830 2024-09-15T23:01:35.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.845+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d81ac9c0 con 0x7f12d8109830 2024-09-15T23:01:35.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.849+0000 7f12d57fa640 1 -- 172.21.15.66:0/1277873973 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f12d002fb60 con 0x7f12d8109830 2024-09-15T23:01:35.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.850+0000 7f12d57fa640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 0x7f12c40a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.851+0000 7f12d57fa640 1 -- 172.21.15.66:0/1277873973 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f12d00f11a0 con 0x7f12d8109830 2024-09-15T23:01:35.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.851+0000 7f12d7fff640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 0x7f12c40a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.852+0000 7f12d7fff640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 0x7f12c40a5a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e00 tx=0x7f12c8009190 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:35.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.853+0000 7f12e0b16740 1 Processor -- start 2024-09-15T23:01:35.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 -- start start 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a352313f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a352321130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a352279280 con 0x55a35231ed40 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a352220b10 con 0x55a352314480 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.859+0000 7f12e0b16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a352275240 con 0x55a352313b60 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.860+0000 7f12d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.860+0000 7f12d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47856/0 (socket says 172.21.15.66:47856) 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.860+0000 7f12d77fe640 1 -- 172.21.15.66:0/3615657864 learned_addr learned my addr 172.21.15.66:0/3615657864 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:35.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.860+0000 7f12d7fff640 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a352313f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.863+0000 7f12dccda640 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a352321130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.867+0000 7f12d77fe640 1 -- 172.21.15.66:0/3615657864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 msgr2=0x55a352313f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:35.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.867+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a352313f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.867+0000 7f12d77fe640 1 -- 172.21.15.66:0/3615657864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 msgr2=0x55a352321130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:35.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.867+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a352321130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.867+0000 7f12d77fe640 1 -- 172.21.15.66:0/3615657864 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35222d1f0 con 0x55a352314480 2024-09-15T23:01:35.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.870+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12d00b9a50 tx=0x7f12d00098d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b3286621778aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:35.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.871+0000 7f12ce7fc640 1 -- 172.21.15.66:0/3615657864 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00c1430 con 0x55a352314480 2024-09-15T23:01:35.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.871+0000 7f12ce7fc640 1 -- 172.21.15.66:0/3615657864 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d0036070 con 0x55a352314480 2024-09-15T23:01:35.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 -- 172.21.15.66:0/3615657864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 msgr2=0x55a35231e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12d00b9a50 tx=0x7f12d00098d0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 -- 172.21.15.66:0/3615657864 shutdown_connections 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a352321130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352314480 0x55a35231e800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3615657864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a352313f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.872+0000 7f12e0b16740 1 -- 172.21.15.66:0/3615657864 >> 172.21.15.66:0/3615657864 conn(0x55a3523100f0 msgr2=0x55a3523104d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:35.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.874+0000 7f12e0b16740 1 -- 172.21.15.66:0/3615657864 shutdown_connections 2024-09-15T23:01:35.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.877+0000 7f12e0b16740 1 -- 172.21.15.66:0/3615657864 wait complete. 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.878+0000 7f12e0b16740 1 -- start start 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.878+0000 7f12e0b16740 1 Processor -- start 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 0x55a35231e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a35231b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a35231c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a3523216d0 con 0x55a352313b60 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a352233f10 con 0x55a35231bf80 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a352321850 con 0x55a35231ed40 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12e0b16740 10 client.0 _ll_register_callbacks cb 0x55a3521fca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 0x55a35231e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 0x55a35231e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40808/0 (socket says 172.21.15.66:40808) 2024-09-15T23:01:35.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12d7fff640 1 -- 172.21.15.66:0/2593004405 learned_addr learned my addr 172.21.15.66:0/2593004405 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.879+0000 7f12d77fe640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a35231b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.880+0000 7f12d77fe640 1 -- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 msgr2=0x55a35231c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.880+0000 7f12d77fe640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a35231c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.880+0000 7f12d77fe640 1 -- 172.21.15.66:0/2593004405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 msgr2=0x55a35231e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.880+0000 7f12d77fe640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 0x55a35231e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.880+0000 7f12d77fe640 1 -- 172.21.15.66:0/2593004405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a351fea6a0 con 0x55a35231ed40 2024-09-15T23:01:35.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.883+0000 7f12d77fe640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a35231b9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f12d0006010 tx=0x7f12d00bb590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f35941c484785c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:35.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.884+0000 7f12b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:35.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.886+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00d5070 con 0x55a35231ed40 2024-09-15T23:01:35.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.886+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f12d00bd2e0 con 0x55a35231ed40 2024-09-15T23:01:35.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.886+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3522867f0 con 0x55a35231ed40 2024-09-15T23:01:35.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.891+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f12d00c1430 con 0x55a35231ed40 2024-09-15T23:01:35.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.891+0000 7f12e0b16740 10 client.27922 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:35.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.891+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55a3523216d0 con 0x55a35231ed40 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.895+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a3522867f0 con 0x55a35231ed40 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.895+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f12d00ee5d0 con 0x55a35231ed40 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 10 client.27922 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 10 client.27922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 20 client.27922 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a35232e820 0x55a352330c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 4 client.27922 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:35.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.896+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a352280d00 con 0x55a35232e820 2024-09-15T23:01:35.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.898+0000 7f12d7fff640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a35232e820 0x55a352330c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.909+0000 7f12d7fff640 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a35232e820 0x55a352330c10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a47490312f7d770b server_cookie=d779772bf11b643b in_seq=0 out_seq=0 2024-09-15T23:01:35.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.909+0000 7f12b77fe640 10 client.27922 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:35.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.951+0000 7f12b77fe640 1 -- 172.21.15.66:0/2593004405 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a352280d00 con 0x55a35232e820 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.951+0000 7f12b77fe640 10 client.27922 handle_command_reply: tid=0 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.951+0000 7f12e0b16740 1 client.27922 shutdown 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 msgr2=0x55a35231b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a35231b9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f12d0006010 tx=0x7f12d00bb590 comp rx=0 tx=0).stop 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 shutdown_connections 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a35232e820 0x55a352330c10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a35231c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a35231b9f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 --2- 172.21.15.66:0/2593004405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a352313b60 0x55a35231e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 >> 172.21.15.66:0/2593004405 conn(0x55a3523100f0 msgr2=0x55a352315600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12b77fe640 0 client.27922 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 shutdown_connections 2024-09-15T23:01:35.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 1 -- 172.21.15.66:0/2593004405 wait complete. 2024-09-15T23:01:35.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.952+0000 7f12e0b16740 20 client.27922 trim_cache size 0 max 16384 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.986+0000 7f12e0b16740 1 Processor -- start 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.986+0000 7f12e0b16740 1 -- start start 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.986+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352313b60 0x55a35231b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.986+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231bf80 0x55a3523155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.987+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:35.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.987+0000 7f12e0b16740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80102e0 con 0x55a35231bf80 2024-09-15T23:01:35.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.987+0000 7f12e0b16740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8012120 con 0x55a352313b60 2024-09-15T23:01:35.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.987+0000 7f12e0b16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8010a70 con 0x55a35231ed40 2024-09-15T23:01:35.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.990+0000 7f12dccda640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.990+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352313b60 0x55a35231b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.990+0000 7f12dccda640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49672/0 (socket says 172.21.15.66:49672) 2024-09-15T23:01:35.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.990+0000 7f12dccda640 1 -- 172.21.15.66:0/675793611 learned_addr learned my addr 172.21.15.66:0/675793611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:35.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.990+0000 7f12d77fe640 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231bf80 0x55a3523155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:35.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.994+0000 7f12dccda640 1 -- 172.21.15.66:0/675793611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352313b60 msgr2=0x55a35231b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:35.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.994+0000 7f12dccda640 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352313b60 0x55a35231b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.994+0000 7f12dccda640 1 -- 172.21.15.66:0/675793611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231bf80 msgr2=0x55a3523155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:35.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.994+0000 7f12dccda640 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231bf80 0x55a3523155b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:35.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.994+0000 7f12dccda640 1 -- 172.21.15.66:0/675793611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a352319f40 con 0x55a35231ed40 2024-09-15T23:01:35.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:35.998+0000 7f12dccda640 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c00099f0 tx=0x7f12c0009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fc8d808969b8045 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:36.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.002+0000 7f12cdffb640 1 -- 172.21.15.66:0/675793611 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0011d80 con 0x55a35231ed40 2024-09-15T23:01:36.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.003+0000 7f12cdffb640 1 -- 172.21.15.66:0/675793611 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c00035f0 con 0x55a35231ed40 2024-09-15T23:01:36.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.003+0000 7f12e0b16740 1 -- 172.21.15.66:0/675793611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 msgr2=0x55a352315af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.003+0000 7f12e0b16740 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12c00099f0 tx=0x7f12c0009eb0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.012+0000 7f12e0b16740 1 -- 172.21.15.66:0/675793611 shutdown_connections 2024-09-15T23:01:36.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.012+0000 7f12e0b16740 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a35231ed40 0x55a352315af0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.012+0000 7f12e0b16740 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231bf80 0x55a3523155b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.012+0000 7f12e0b16740 1 --2- 172.21.15.66:0/675793611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a352313b60 0x55a35231b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.012+0000 7f12e0b16740 1 -- 172.21.15.66:0/675793611 >> 172.21.15.66:0/675793611 conn(0x55a3523100f0 msgr2=0x55a35231b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:36.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.016+0000 7f12e0b16740 1 -- 172.21.15.66:0/675793611 shutdown_connections 2024-09-15T23:01:36.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.016+0000 7f12e0b16740 1 -- 172.21.15.66:0/675793611 wait complete. 2024-09-15T23:01:36.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.016+0000 7f12e0b16740 1 -- start start 2024-09-15T23:01:36.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 Processor -- start 2024-09-15T23:01:36.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a35231fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:36.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a352320370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:36.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a3523208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:36.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8011990 con 0x55a35231ed40 2024-09-15T23:01:36.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8011200 con 0x55a35231bf80 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12b800e2e0 con 0x55a352313b60 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.017+0000 7f12e0b16740 10 client.0 _ll_register_callbacks cb 0x7f12d8110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.018+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a35231fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.018+0000 7f12d7fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a35231fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:49678/0 (socket says 172.21.15.66:49678) 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.018+0000 7f12d7fff640 1 -- 172.21.15.66:0/3284567518 learned_addr learned my addr 172.21.15.66:0/3284567518 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:36.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.019+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a352320370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 -- 172.21.15.66:0/3284567518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 msgr2=0x55a35231fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a35231fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 -- 172.21.15.66:0/3284567518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 msgr2=0x55a3523208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a3523208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 -- 172.21.15.66:0/3284567518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3523252e0 con 0x55a35231bf80 2024-09-15T23:01:36.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.021+0000 7f12d77fe640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a352320370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bcd80 tx=0x7f12d002a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c5f84e6d4cbbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:36.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.022+0000 7f12b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:36.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.026+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00d5060 con 0x55a35231bf80 2024-09-15T23:01:36.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.026+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7f12d00bd4e0 con 0x55a35231bf80 2024-09-15T23:01:36.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.027+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c00035f0 con 0x55a35231bf80 2024-09-15T23:01:36.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.030+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f12d00b9320 con 0x55a35231bf80 2024-09-15T23:01:36.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.031+0000 7f12e0b16740 10 client.28040 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:36.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.031+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x55a3523252e0 con 0x55a35231bf80 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c00035f0 con 0x55a35231bf80 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f12d00bbf40 con 0x55a35231bf80 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 10 client.28040 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 10 client.28040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 20 client.28040 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a3523aac40 0x55a3523ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 4 client.28040 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.033+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a3521fd110 con 0x55a3523aac40 2024-09-15T23:01:36.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.036+0000 7f12d7fff640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a3523aac40 0x55a3523ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:36.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.046+0000 7f12b77fe640 10 client.28040 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:36.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.046+0000 7f12d7fff640 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a3523aac40 0x55a3523ad060 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11013bc58bf1aaaf server_cookie=f8e2408838705263 in_seq=0 out_seq=0 2024-09-15T23:01:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.083+0000 7f12b77fe640 1 -- 172.21.15.66:0/3284567518 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a3521fd110 con 0x55a3523aac40 2024-09-15T23:01:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.083+0000 7f12b77fe640 10 client.28040 handle_command_reply: tid=0 2024-09-15T23:01:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.083+0000 7f12e0b16740 1 client.28040 shutdown 2024-09-15T23:01:36.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 msgr2=0x55a352320370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a352320370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bcd80 tx=0x7f12d002a8f0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 shutdown_connections 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a35231ed40 0x55a3523208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a3523aac40 0x55a3523ad060 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a35231bf80 0x55a352320370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 --2- 172.21.15.66:0/3284567518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a352313b60 0x55a35231fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12b77fe640 0 client.28040 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 >> 172.21.15.66:0/3284567518 conn(0x55a3523100f0 msgr2=0x55a3523155b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 shutdown_connections 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 1 -- 172.21.15.66:0/3284567518 wait complete. 2024-09-15T23:01:36.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.084+0000 7f12e0b16740 20 client.28040 trim_cache size 0 max 16384 2024-09-15T23:01:36.087 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:01:36.087 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T23:01:36.087 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "9380fab7-342a-47a2-bcc9-7c0b47ad1517", 2024-09-15T23:01:36.087 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T23:01:36.087 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 msgr2=0x7f12c40a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 0x7f12c40a5a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e00 tx=0x7f12c8009190 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 msgr2=0x7f12d81a7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d81a7890 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009ca0 tx=0x7f12d0003ce0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 shutdown_connections 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f12c40a35c0 0x7f12c40a5a80 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e00 tx=0x7f12c8009190 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12d811b140 0x7f12d81abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12d8109830 0x7f12d81a7890 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 --2- 172.21.15.66:0/1277873973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d8109450 0x7f12d81a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.085+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 >> 172.21.15.66:0/1277873973 conn(0x7f12d806e140 msgr2=0x7f12d811bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.086+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 shutdown_connections 2024-09-15T23:01:36.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.086+0000 7f12de73d640 1 -- 172.21.15.66:0/1277873973 wait complete. 2024-09-15T23:01:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:36 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T23:01:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:36 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:36.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:36 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:01:36.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:36 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T23:01:36.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:36 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:36.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:36 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:01:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:36 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T23:01:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:36 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:36.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:36 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f03f2ff5640 1 -- 172.21.15.66:0/3075189284 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5590a45f9ec0 con 0x5590a4797c40 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f03f2ff5640 10 client.18744 handle_command_reply: tid=0 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 client.18744 shutdown 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 msgr2=0x5590a471fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0410101be0 tx=0x7f0400006d30 comp rx=0 tx=0).stop 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 shutdown_connections 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5590a4797c40 0x5590a479a060 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5590a471b940 0x5590a4720480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5590a4719360 0x5590a471ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 --2- 172.21.15.66:0/3075189284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5590a4710760 0x5590a471fa00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 >> 172.21.15.66:0/3075189284 conn(0x5590a470ccf0 msgr2=0x5590a471a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 63, 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 54, 2024-09-15T23:01:36.835 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "4dd62132": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 54, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 137.7, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:01:36.836 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:36.837 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f03f2ff5640 0 client.18744 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.832+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 shutdown_connections 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.833+0000 7f04178c5740 1 -- 172.21.15.66:0/3075189284 wait complete. 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.833+0000 7f04178c5740 20 client.18744 trim_cache size 0 max 16384 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 msgr2=0x7f03f80a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 0x7f03f80a5d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f040809ca40 tx=0x7f04080093e0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 msgr2=0x7f041006f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f040800b9c0 tx=0x7f040800be80 comp rx=0 tx=0).stop 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 shutdown_connections 2024-09-15T23:01:36.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f03f80a3870 0x7f03f80a5d30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f041006f1d0 0x7f041006f680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0410102ef0 0x7f041006ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 --2- 172.21.15.66:0/3305040648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0410100e20 0x7f0410073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.834+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 >> 172.21.15.66:0/3305040648 conn(0x7f04100fc7d0 msgr2=0x7f04100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.835+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 shutdown_connections 2024-09-15T23:01:36.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:36.836+0000 7f04154ec640 1 -- 172.21.15.66:0/3305040648 wait complete. 2024-09-15T23:01:36.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:01:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:37 smithi184 ceph-mon[35203]: pgmap v511: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 83 op/s 2024-09-15T23:01:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:01:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:37 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:37 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:01:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:37 smithi066 ceph-mon[31185]: pgmap v511: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 83 op/s 2024-09-15T23:01:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:01:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:37 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:37.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:37 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:01:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:37 smithi087 ceph-mon[35290]: pgmap v511: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 83 op/s 2024-09-15T23:01:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:01:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:37 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:37 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:01:37.719 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4dd62132', quiesce took 12.1 seconds. Will release after: 5.6 2024-09-15T23:01:37.865 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:38.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.480+0000 7fc27998d640 1 -- 172.21.15.66:0/1678135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc274114ab0 msgr2=0x7fc274116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.480+0000 7fc27998d640 1 --2- 172.21.15.66:0/1678135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc274114ab0 0x7fc274116ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009860 tx=0x7fc26c02a3f0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.480+0000 7fc27998d640 1 -- 172.21.15.66:0/1678135524 shutdown_connections 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 --2- 172.21.15.66:0/1678135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc274114ab0 0x7fc274116ea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 --2- 172.21.15.66:0/1678135524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc274114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 --2- 172.21.15.66:0/1678135524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2741091f0 0x7fc2741095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 -- 172.21.15.66:0/1678135524 >> 172.21.15.66:0/1678135524 conn(0x7fc27406e140 msgr2=0x7fc27406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 -- 172.21.15.66:0/1678135524 shutdown_connections 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 -- 172.21.15.66:0/1678135524 wait complete. 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.481+0000 7fc27998d640 1 Processor -- start 2024-09-15T23:01:38.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 -- start start 2024-09-15T23:01:38.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2741091f0 0x7fc27419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc27419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 0x7fc2741a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc27419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc27419f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40852/0 (socket says 172.21.15.66:40852) 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc2727fc640 1 -- 172.21.15.66:0/2501785806 learned_addr learned my addr 172.21.15.66:0/2501785806 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741185e0 con 0x7fc274109b10 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc274118460 con 0x7fc274114ab0 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.483+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc274118760 con 0x7fc2741091f0 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 0x7fc2741a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 -- 172.21.15.66:0/2501785806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2741091f0 msgr2=0x7fc27419eb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2741091f0 0x7fc27419eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 -- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 msgr2=0x7fc27419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc27419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.484+0000 7fc2737fe640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2741a3b90 con 0x7fc274114ab0 2024-09-15T23:01:38.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.487+0000 7fc2737fe640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 0x7fc2741a3460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009780 tx=0x7fc26c005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.491+0000 7fc27898b640 1 -- 172.21.15.66:0/2501785806 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c040070 con 0x7fc274114ab0 2024-09-15T23:01:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.491+0000 7fc27898b640 1 -- 172.21.15.66:0/2501785806 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc26c005540 con 0x7fc274114ab0 2024-09-15T23:01:38.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.491+0000 7fc27898b640 1 -- 172.21.15.66:0/2501785806 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c045460 con 0x7fc274114ab0 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.493+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2741a3e20 con 0x7fc274114ab0 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.493+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741a4280 con 0x7fc274114ab0 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.496+0000 7fc27bd66740 1 Processor -- start 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.496+0000 7fc27bd66740 1 -- start start 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 0x56267245f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 0x562672469950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562672469e90 0x56267246c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5626723bc2e0 con 0x562672469e90 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562672363ce0 con 0x56267245ecb0 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.497+0000 7fc27bd66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5626723b82a0 con 0x56267245f5d0 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.498+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 0x56267245f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.498+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 0x56267245f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47902/0 (socket says 172.21.15.66:47902) 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.498+0000 7fc2727fc640 1 -- 172.21.15.66:0/789019792 learned_addr learned my addr 172.21.15.66:0/789019792 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc27898b640 1 -- 172.21.15.66:0/2501785806 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc26c039040 con 0x7fc274114ab0 2024-09-15T23:01:38.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 0x562672469950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 -- 172.21.15.66:0/789019792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 msgr2=0x56267245f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 0x56267245f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 -- 172.21.15.66:0/789019792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562672469e90 msgr2=0x56267246c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562672469e90 0x56267246c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 -- 172.21.15.66:0/789019792 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562672348440 con 0x56267245f5d0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.499+0000 7fc272ffd640 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 0x562672469950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc264009d60 tx=0x7fc26400b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28fec5f2391a466 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.500+0000 7fc27898b640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 0x7fc2600a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.501+0000 7fc27898b640 1 -- 172.21.15.66:0/2501785806 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fc26c0f0e20 con 0x7fc274114ab0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.501+0000 7fc269ffb640 1 -- 172.21.15.66:0/789019792 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264018070 con 0x56267245f5d0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.501+0000 7fc269ffb640 1 -- 172.21.15.66:0/789019792 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc264011a00 con 0x56267245f5d0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.503+0000 7fc2727fc640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 0x7fc2600a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.505+0000 7fc269ffb640 1 -- 172.21.15.66:0/789019792 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264013ad0 con 0x56267245f5d0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 -- 172.21.15.66:0/789019792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 msgr2=0x562672469950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 0x562672469950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc264009d60 tx=0x7fc26400b7e0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc2727fc640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 0x7fc2600a5a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x56267245c5c0 tx=0x7fc25c00b4c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 -- 172.21.15.66:0/789019792 shutdown_connections 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562672469e90 0x56267246c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245f5d0 0x562672469950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 --2- 172.21.15.66:0/789019792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245ecb0 0x56267245f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 -- 172.21.15.66:0/789019792 >> 172.21.15.66:0/789019792 conn(0x56267245b240 msgr2=0x56267245b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 -- 172.21.15.66:0/789019792 shutdown_connections 2024-09-15T23:01:38.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.506+0000 7fc27bd66740 1 -- 172.21.15.66:0/789019792 wait complete. 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 -- start start 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 Processor -- start 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x562672469730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245f5d0 0x5626724669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56267246cab0 con 0x56267245f5d0 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562672377050 con 0x562672469e90 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56267246cc30 con 0x56267245ecb0 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.507+0000 7fc27bd66740 10 client.0 _ll_register_callbacks cb 0x5626723b7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47904/0 (socket says 172.21.15.66:47904) 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2737fe640 1 -- 172.21.15.66:0/3524466175 learned_addr learned my addr 172.21.15.66:0/3524466175 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:38.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2727fc640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245f5d0 0x5626724669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2737fe640 1 -- 172.21.15.66:0/3524466175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 msgr2=0x562672469730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.508+0000 7fc2737fe640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x562672469730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.509+0000 7fc2737fe640 1 -- 172.21.15.66:0/3524466175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245f5d0 msgr2=0x5626724669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.509+0000 7fc2737fe640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245f5d0 0x5626724669e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.509+0000 7fc2737fe640 1 -- 172.21.15.66:0/3524466175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267212d3c0 con 0x562672469e90 2024-09-15T23:01:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.512+0000 7fc2737fe640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0ee000 tx=0x7fc26c0bc550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9a7089ca3ce09d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.513+0000 7fc252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:38.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.516+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0d3070 con 0x562672469e90 2024-09-15T23:01:38.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.516+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fc26c0ee2e0 con 0x562672469e90 2024-09-15T23:01:38.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.519+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc264011a00 con 0x562672469e90 2024-09-15T23:01:38.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.521+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fc26c0c0fa0 con 0x562672469e90 2024-09-15T23:01:38.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.521+0000 7fc27bd66740 10 client.28049 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:38.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.521+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562672454830 con 0x562672469e90 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc264011a00 con 0x562672469e90 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fc26c04d060 con 0x562672469e90 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 10 client.28049 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 10 client.28049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 20 client.28049 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672455dc0 0x562672458260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 4 client.28049 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:38.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.526+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626723c9850 con 0x562672455dc0 2024-09-15T23:01:38.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.527+0000 7fc272ffd640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672455dc0 0x562672458260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.530+0000 7fc272ffd640 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672455dc0 0x562672458260 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=146c1a7e38cebaab server_cookie=ccdec571b77189f1 in_seq=0 out_seq=0 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.531+0000 7fc252ffd640 10 client.28049 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.532+0000 7fc252ffd640 1 -- 172.21.15.66:0/3524466175 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626723c9850 con 0x562672455dc0 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.532+0000 7fc252ffd640 10 client.28049 handle_command_reply: tid=0 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.532+0000 7fc27bd66740 1 client.28049 shutdown 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.533+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 msgr2=0x562672466f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.533+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0ee000 tx=0x7fc26c0bc550 comp rx=0 tx=0).stop 2024-09-15T23:01:38.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 shutdown_connections 2024-09-15T23:01:38.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672455dc0 0x562672458260 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562672469e90 0x562672466f20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245f5d0 0x5626724669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3524466175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x562672469730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 >> 172.21.15.66:0/3524466175 conn(0x56267245b240 msgr2=0x562672451b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.535+0000 7fc252ffd640 0 client.28049 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:38.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.537+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 shutdown_connections 2024-09-15T23:01:38.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.540+0000 7fc27bd66740 1 -- 172.21.15.66:0/3524466175 wait complete. 2024-09-15T23:01:38.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.542+0000 7fc27bd66740 20 client.28049 trim_cache size 0 max 16384 2024-09-15T23:01:38.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 Processor -- start 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 -- start start 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245b240 0x5626724669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x56267248bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b5970 con 0x56267245b240 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b77b0 con 0x56267245f5d0 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc27bd66740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b6100 con 0x56267245ecb0 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:47916/0 (socket says 172.21.15.66:47916) 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc2737fe640 1 -- 172.21.15.66:0/462054129 learned_addr learned my addr 172.21.15.66:0/462054129 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:38.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.582+0000 7fc2727fc640 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x56267248bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 -- 172.21.15.66:0/462054129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 msgr2=0x56267248bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x56267248bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 -- 172.21.15.66:0/462054129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245b240 msgr2=0x5626724669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245b240 0x5626724669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 -- 172.21.15.66:0/462054129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267245b070 con 0x56267245f5d0 2024-09-15T23:01:38.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2737fe640 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0bc8f0 tx=0x7fc26c0bb100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55a29286f1face76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.583+0000 7fc2697fa640 1 -- 172.21.15.66:0/462054129 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0cd070 con 0x56267245f5d0 2024-09-15T23:01:38.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.584+0000 7fc2697fa640 1 -- 172.21.15.66:0/462054129 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc26c0ee2e0 con 0x56267245f5d0 2024-09-15T23:01:38.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.584+0000 7fc2697fa640 1 -- 172.21.15.66:0/462054129 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0d3070 con 0x56267245f5d0 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.584+0000 7fc27bd66740 1 -- 172.21.15.66:0/462054129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 msgr2=0x56267248c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0bc8f0 tx=0x7fc26c0bb100 comp rx=0 tx=0).stop 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 -- 172.21.15.66:0/462054129 shutdown_connections 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267248c530 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245ecb0 0x56267248bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 --2- 172.21.15.66:0/462054129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245b240 0x5626724669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.585+0000 7fc27bd66740 1 -- 172.21.15.66:0/462054129 >> 172.21.15.66:0/462054129 conn(0x562672467080 msgr2=0x562672468a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.588+0000 7fc27bd66740 1 -- 172.21.15.66:0/462054129 shutdown_connections 2024-09-15T23:01:38.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.591+0000 7fc27bd66740 1 -- 172.21.15.66:0/462054129 wait complete. 2024-09-15T23:01:38.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.591+0000 7fc27bd66740 1 -- start start 2024-09-15T23:01:38.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.592+0000 7fc27bd66740 1 Processor -- start 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.592+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245b240 0x562672472640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.592+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc27bd66740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267246ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc2727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40896/0 (socket says 172.21.15.66:40896) 2024-09-15T23:01:38.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc2727fc640 1 -- 172.21.15.66:0/3180334203 learned_addr learned my addr 172.21.15.66:0/3180334203 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:38.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b7020 con 0x56267245ecb0 2024-09-15T23:01:38.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b6890 con 0x56267245f5d0 2024-09-15T23:01:38.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2741b3970 con 0x56267245b240 2024-09-15T23:01:38.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc2737fe640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267246ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.593+0000 7fc27bd66740 10 client.0 _ll_register_callbacks cb 0x7fc26c005770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:38.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 -- 172.21.15.66:0/3180334203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245b240 msgr2=0x562672472640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245b240 0x562672472640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 -- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 msgr2=0x56267246ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267246ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626724707a0 con 0x56267245ecb0 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.599+0000 7fc2727fc640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005fd0 tx=0x7fc25c00b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ebd8d7748800 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:38.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.600+0000 7fc252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.603+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c01f8f0 con 0x56267245ecb0 2024-09-15T23:01:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.603+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc26c0ee2e0 con 0x56267245ecb0 2024-09-15T23:01:38.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.603+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9727+0+0 (secure 0 0 0) 0x7fc25c01fa90 con 0x56267245ecb0 2024-09-15T23:01:38.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.609+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fc25c01fc90 con 0x56267245ecb0 2024-09-15T23:01:38.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.611+0000 7fc27bd66740 10 client.18768 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:38.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.611+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5626724ed070 con 0x56267245ecb0 2024-09-15T23:01:38.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc26c0ee2e0 con 0x56267245ecb0 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7fc25c033420 con 0x56267245ecb0 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 10 client.18768 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 10 client.18768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 20 client.18768 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672469e90 0x5626724ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 4 client.18768 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:01:38.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.620+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626723c3d60 con 0x562672469e90 2024-09-15T23:01:38.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.624+0000 7fc272ffd640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672469e90 0x5626724ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.629+0000 7fc252ffd640 10 client.18768 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:38.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.629+0000 7fc272ffd640 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672469e90 0x5626724ef880 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a72ba5a5a9a8b1 server_cookie=c8038eab230c1c15 in_seq=0 out_seq=0 2024-09-15T23:01:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.629+0000 7fc252ffd640 1 -- 172.21.15.66:0/3180334203 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5626723c3d60 con 0x562672469e90 2024-09-15T23:01:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.629+0000 7fc252ffd640 10 client.18768 handle_command_reply: tid=0 2024-09-15T23:01:38.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.629+0000 7fc27bd66740 1 client.18768 shutdown 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 msgr2=0x56267246fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fc25c005fd0 tx=0x7fc25c00b450 comp rx=0 tx=0).stop 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 shutdown_connections 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562672469e90 0x5626724ef880 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56267245f5d0 0x56267246ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56267245ecb0 0x56267246fa30 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 --2- 172.21.15.66:0/3180334203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56267245b240 0x562672472640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 >> 172.21.15.66:0/3180334203 conn(0x562672467080 msgr2=0x562672468a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.631+0000 7fc252ffd640 0 client.18768 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:38.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.632+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 shutdown_connections 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.632+0000 7fc27bd66740 1 -- 172.21.15.66:0/3180334203 wait complete. 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.632+0000 7fc27bd66740 20 client.18768 trim_cache size 0 max 16384 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (8134 inodes in the stack)", 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stdout: "9380fab7-342a-47a2-bcc9-7c0b47ad1517": { 2024-09-15T23:01:38.634 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T23:01:38.635 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "9380fab7-342a-47a2-bcc9-7c0b47ad1517", 2024-09-15T23:01:38.635 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T23:01:38.635 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:38.635 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:38.635 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 msgr2=0x7fc2600a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 0x7fc2600a5a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x56267245c5c0 tx=0x7fc25c00b4c0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 msgr2=0x7fc2741a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 0x7fc2741a3460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009780 tx=0x7fc26c005040 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 shutdown_connections 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc2600a35c0 0x7fc2600a5a80 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x56267245c5c0 tx=0x7fc25c00b4c0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc274114ab0 0x7fc2741a3460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc274109b10 0x7fc27419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 --2- 172.21.15.66:0/2501785806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2741091f0 0x7fc27419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.633+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 >> 172.21.15.66:0/2501785806 conn(0x7fc27406e140 msgr2=0x7fc274070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.636+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 shutdown_connections 2024-09-15T23:01:38.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:38.636+0000 7fc27998d640 1 -- 172.21.15.66:0/2501785806 wait complete. 2024-09-15T23:01:39.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:39 smithi066 ceph-mon[31185]: pgmap v512: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-09-15T23:01:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:39 smithi087 ceph-mon[35290]: pgmap v512: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-09-15T23:01:39.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:39 smithi184 ceph-mon[35203]: pgmap v512: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-09-15T23:01:41.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:41 smithi066 ceph-mon[31185]: pgmap v513: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 129 op/s 2024-09-15T23:01:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:41 smithi087 ceph-mon[35290]: pgmap v513: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 129 op/s 2024-09-15T23:01:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:41 smithi184 ceph-mon[35203]: pgmap v513: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 129 op/s 2024-09-15T23:01:42.265 INFO:tasks.cephfs.filesystem:scrub status for tag:9380fab7-342a-47a2-bcc9-7c0b47ad1517 - {'path': '/', 'tag': '9380fab7-342a-47a2-bcc9-7c0b47ad1517', 'options': 'recursive,force'} 2024-09-15T23:01:43.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:01:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:43 smithi066 ceph-mon[31185]: pgmap v514: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 116 op/s 2024-09-15T23:01:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:43 smithi087 ceph-mon[35290]: pgmap v514: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 116 op/s 2024-09-15T23:01:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:43 smithi184 ceph-mon[35203]: pgmap v514: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 116 op/s 2024-09-15T23:01:43.951 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.104+0000 7ff9d880a640 1 -- 172.21.15.66:0/3584366056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d4101270 msgr2=0x7ff9d410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.105+0000 7ff9d880a640 1 --2- 172.21.15.66:0/3584366056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d4101270 0x7ff9d410d7a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009cd0 tx=0x7ff9cc02a910 comp rx=0 tx=0).stop 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.105+0000 7ff9d880a640 1 -- 172.21.15.66:0/3584366056 shutdown_connections 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.105+0000 7ff9d880a640 1 --2- 172.21.15.66:0/3584366056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d4101270 0x7ff9d410d7a0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.105+0000 7ff9d880a640 1 --2- 172.21.15.66:0/3584366056 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d41008d0 0x7ff9d4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.105+0000 7ff9d880a640 1 --2- 172.21.15.66:0/3584366056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41068d0 0x7ff9d4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.106+0000 7ff9d880a640 1 -- 172.21.15.66:0/3584366056 >> 172.21.15.66:0/3584366056 conn(0x7ff9d40fc610 msgr2=0x7ff9d40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:45.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.107+0000 7ff9d880a640 1 -- 172.21.15.66:0/3584366056 shutdown_connections 2024-09-15T23:01:45.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.107+0000 7ff9d880a640 1 -- 172.21.15.66:0/3584366056 wait complete. 2024-09-15T23:01:45.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.109+0000 7ff9d880a640 1 Processor -- start 2024-09-15T23:01:45.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.109+0000 7ff9d880a640 1 -- start start 2024-09-15T23:01:45.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 0x7ff9d41960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:45.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d4101270 0x7ff9d4196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:45.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:45.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d410fc00 con 0x7ff9d41068d0 2024-09-15T23:01:45.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d410fa80 con 0x7ff9d4101270 2024-09-15T23:01:45.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d880a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d410fd80 con 0x7ff9d41008d0 2024-09-15T23:01:45.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:45.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52302/0 (socket says 172.21.15.66:52302) 2024-09-15T23:01:45.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.110+0000 7ff9d3fff640 1 -- 172.21.15.66:0/10301143 learned_addr learned my addr 172.21.15.66:0/10301143 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:45.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.111+0000 7ff9d37fe640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 0x7ff9d41960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:45.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.111+0000 7ff9d2ffd640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d4101270 0x7ff9d4196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:45.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 -- 172.21.15.66:0/10301143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d4101270 msgr2=0x7ff9d4196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:45.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d4101270 0x7ff9d4196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 -- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 msgr2=0x7ff9d419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:45.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 -- 172.21.15.66:0/10301143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d419b090 con 0x7ff9d41008d0 2024-09-15T23:01:45.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d3fff640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:01:45.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.112+0000 7ff9d37fe640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 0x7ff9d41960e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009fd0 tx=0x7ff9c800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.113+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8015020 con 0x7ff9d41008d0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.113+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c8011d10 con 0x7ff9d41008d0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.113+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800f2e0 con 0x7ff9d41008d0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.113+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d419b380 con 0x7ff9d41008d0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.113+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41a2c60 con 0x7ff9d41008d0 2024-09-15T23:01:45.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.115+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d4100d30 con 0x7ff9d41008d0 2024-09-15T23:01:45.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.118+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff9c8018020 con 0x7ff9d41008d0 2024-09-15T23:01:45.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.119+0000 7ff9d0ff9640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 0x7ff9bc0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:45.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.119+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7ff9c80cff90 con 0x7ff9d41008d0 2024-09-15T23:01:45.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.120+0000 7ff9d2ffd640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 0x7ff9bc0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:45.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.121+0000 7ff9d2ffd640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 0x7ff9bc0a5a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4105f20 tx=0x7ff9c4005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:45.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.124+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9c809c630 con 0x7ff9d41008d0 2024-09-15T23:01:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:45 smithi087 ceph-mon[35290]: pgmap v515: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 767 KiB/s wr, 147 op/s 2024-09-15T23:01:45.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:45 smithi087 ceph-mon[35290]: osdmap e112: 12 total, 12 up, 12 in 2024-09-15T23:01:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:45 smithi184 ceph-mon[35203]: pgmap v515: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 767 KiB/s wr, 147 op/s 2024-09-15T23:01:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:45 smithi184 ceph-mon[35203]: osdmap e112: 12 total, 12 up, 12 in 2024-09-15T23:01:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:45 smithi066 ceph-mon[31185]: pgmap v515: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 767 KiB/s wr, 147 op/s 2024-09-15T23:01:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:45 smithi066 ceph-mon[31185]: osdmap e112: 12 total, 12 up, 12 in 2024-09-15T23:01:45.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.538+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9d4197440 con 0x7ff9d41008d0 2024-09-15T23:01:45.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.541+0000 7ff9d0ff9640 1 -- 172.21.15.66:0/10301143 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+12009 (secure 0 0 0) 0x7ff9d4197440 con 0x7ff9d41008d0 2024-09-15T23:01:45.543 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:01:45.543 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":63,"btime":"2024-09-15T22:59:19:174407+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T22:59:19.133770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:01:45.543 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 63 2024-09-15T23:01:45.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 msgr2=0x7ff9bc0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:45.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 0x7ff9bc0a5a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4105f20 tx=0x7ff9c4005f90 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 msgr2=0x7ff9d41960e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 0x7ff9d41960e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009fd0 tx=0x7ff9c800b870 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 shutdown_connections 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff9bc0a3540 0x7ff9bc0a5a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9d41068d0 0x7ff9d419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9d4101270 0x7ff9d4196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 --2- 172.21.15.66:0/10301143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9d41008d0 0x7ff9d41960e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 >> 172.21.15.66:0/10301143 conn(0x7ff9d40fc610 msgr2=0x7ff9d40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.548+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 shutdown_connections 2024-09-15T23:01:45.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:45.549+0000 7ff9d880a640 1 -- 172.21.15.66:0/10301143 wait complete. 2024-09-15T23:01:46.316 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:46 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/10301143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:46.371 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 4dd62132 --release --await' 2024-09-15T23:01:46.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 4dd62132 --release --await 2024-09-15T23:01:46.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:46 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/10301143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:46 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/10301143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:46.924 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:47.412 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:47 smithi066 ceph-mon[31185]: pgmap v517: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 333 KiB/s wr, 153 op/s 2024-09-15T23:01:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:47 smithi184 ceph-mon[35203]: pgmap v517: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 333 KiB/s wr, 153 op/s 2024-09-15T23:01:47.500 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:47 smithi087 ceph-mon[35290]: pgmap v517: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 333 KiB/s wr, 153 op/s 2024-09-15T23:01:47.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.567+0000 7f073e395640 1 -- 172.21.15.66:0/3962846829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109830 msgr2=0x7f0738109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.567+0000 7f073e395640 1 --2- 172.21.15.66:0/3962846829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109830 0x7f0738109c90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f072c009860 tx=0x7f072c02a380 comp rx=0 tx=0).stop 2024-09-15T23:01:47.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.582+0000 7f073e395640 1 -- 172.21.15.66:0/3962846829 shutdown_connections 2024-09-15T23:01:47.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.582+0000 7f073e395640 1 --2- 172.21.15.66:0/3962846829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 0x7f073811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.582+0000 7f073e395640 1 --2- 172.21.15.66:0/3962846829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109830 0x7f0738109c90 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.582+0000 7f073e395640 1 --2- 172.21.15.66:0/3962846829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109450 0x7f0738110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.582+0000 7f073e395640 1 -- 172.21.15.66:0/3962846829 >> 172.21.15.66:0/3962846829 conn(0x7f073806e140 msgr2=0x7f073806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:47.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.584+0000 7f073e395640 1 -- 172.21.15.66:0/3962846829 shutdown_connections 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.584+0000 7f073e395640 1 -- 172.21.15.66:0/3962846829 wait complete. 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 Processor -- start 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 -- start start 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109450 0x7f07381185d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 0x7f0738111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0738120eb0 con 0x7f0738109450 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0738120d30 con 0x7f0738109830 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.585+0000 7f073e395640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0738121030 con 0x7f073811b140 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:34036/0 (socket says 172.21.15.66:34036) 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 -- 172.21.15.66:0/1507599906 learned_addr learned my addr 172.21.15.66:0/1507599906 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f073c932640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 0x7f0738111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 -- 172.21.15.66:0/1507599906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 msgr2=0x7f0738111760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 0x7f0738111760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 -- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109450 msgr2=0x7f07381185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109450 0x7f07381185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.586+0000 7f07377fe640 1 -- 172.21.15.66:0/1507599906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0738112020 con 0x7f0738109830 2024-09-15T23:01:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.587+0000 7f07377fe640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f072c02a8f0 tx=0x7f072c033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.587+0000 7f07357fa640 1 -- 172.21.15.66:0/1507599906 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037040 con 0x7f0738109830 2024-09-15T23:01:47.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.587+0000 7f07357fa640 1 -- 172.21.15.66:0/1507599906 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f072c040070 con 0x7f0738109830 2024-09-15T23:01:47.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.588+0000 7f07357fa640 1 -- 172.21.15.66:0/1507599906 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c03b430 con 0x7f0738109830 2024-09-15T23:01:47.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.589+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07381122b0 con 0x7f0738109830 2024-09-15T23:01:47.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.589+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07381162d0 con 0x7f0738109830 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.594+0000 7f07357fa640 1 -- 172.21.15.66:0/1507599906 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f072c004250 con 0x7f0738109830 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.595+0000 7f07357fa640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 0x7f07200a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.595+0000 7f07357fa640 1 -- 172.21.15.66:0/1507599906 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f072c0ef8a0 con 0x7f0738109830 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.596+0000 7f074076e740 1 Processor -- start 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.596+0000 7f0737fff640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 0x7f07200a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 -- start start 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x56261169fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116a0240 0x5626116a2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5626115fa620 con 0x562611695980 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5626115a1e50 con 0x5626116a0240 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f074076e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5626115f65e0 con 0x562611695060 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.597+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.599+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55324/0 (socket says 172.21.15.66:55324) 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.599+0000 7f0737fff640 1 -- 172.21.15.66:0/2930809291 learned_addr learned my addr 172.21.15.66:0/2930809291 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:47.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.599+0000 7f0737fff640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 0x7f07200a5860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07280097a0 tx=0x7f0728006c90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.601+0000 7f073c932640 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116a0240 0x5626116a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.601+0000 7f07377fe640 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x56261169fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 -- 172.21.15.66:0/2930809291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116a0240 msgr2=0x5626116a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116a0240 0x5626116a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 -- 172.21.15.66:0/2930809291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 msgr2=0x56261169fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x56261169fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 -- 172.21.15.66:0/2930809291 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562611592d40 con 0x562611695060 2024-09-15T23:01:47.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.602+0000 7f0737fff640 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f072800ba60 tx=0x7f0728016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88beda9eb10ca520 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.603+0000 7f07267fc640 1 -- 172.21.15.66:0/2930809291 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728022070 con 0x562611695060 2024-09-15T23:01:47.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.603+0000 7f07267fc640 1 -- 172.21.15.66:0/2930809291 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0728019040 con 0x562611695060 2024-09-15T23:01:47.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.603+0000 7f07267fc640 1 -- 172.21.15.66:0/2930809291 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728014410 con 0x562611695060 2024-09-15T23:01:47.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.604+0000 7f074076e740 1 -- 172.21.15.66:0/2930809291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 msgr2=0x562611695440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.604+0000 7f074076e740 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f072800ba60 tx=0x7f0728016000 comp rx=0 tx=0).stop 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.605+0000 7f074076e740 1 -- 172.21.15.66:0/2930809291 shutdown_connections 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.605+0000 7f074076e740 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116a0240 0x5626116a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.605+0000 7f074076e740 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x56261169fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.605+0000 7f074076e740 1 --2- 172.21.15.66:0/2930809291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x562611695440 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.605+0000 7f074076e740 1 -- 172.21.15.66:0/2930809291 >> 172.21.15.66:0/2930809291 conn(0x5626116915f0 msgr2=0x5626116919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:47.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.607+0000 7f074076e740 1 -- 172.21.15.66:0/2930809291 shutdown_connections 2024-09-15T23:01:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.608+0000 7f074076e740 1 -- 172.21.15.66:0/2930809291 wait complete. 2024-09-15T23:01:47.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.609+0000 7f074076e740 1 -- start start 2024-09-15T23:01:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.609+0000 7f074076e740 1 Processor -- start 2024-09-15T23:01:47.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x56261169d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695980 0x56261169d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 0x56261169db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5626116a2e60 con 0x5626116a0240 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562611582f10 con 0x562611695980 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.610+0000 7f074076e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5626116a2fe0 con 0x562611695060 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x56261169d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f07377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695980 0x56261169d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f074076e740 10 client.0 _ll_register_callbacks cb 0x5626115a6db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x56261169d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55340/0 (socket says 172.21.15.66:55340) 2024-09-15T23:01:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f0737fff640 1 -- 172.21.15.66:0/2854037212 learned_addr learned my addr 172.21.15.66:0/2854037212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.611+0000 7f073c932640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 0x56261169db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 -- 172.21.15.66:0/2854037212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 msgr2=0x56261169d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x56261169d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 -- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695980 msgr2=0x56261169d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695980 0x56261169d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 -- 172.21.15.66:0/2854037212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562611309580 con 0x5626116a0240 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f073c932640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 0x56261169db30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f0730009fd0 tx=0x7f0730010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9242a306631636 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.612+0000 7f071b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.613+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073000ece0 con 0x5626116a0240 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.613+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0728019040 con 0x5626116a0240 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.613+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f0730003970 con 0x5626116a0240 2024-09-15T23:01:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.613+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f0730024050 con 0x5626116a0240 2024-09-15T23:01:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.616+0000 7f074076e740 10 client.18783 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.616+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x5626113d3960 con 0x5626116a0240 2024-09-15T23:01:47.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.618+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0730003b70 con 0x5626116a0240 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.618+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f073000b040 con 0x5626116a0240 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.618+0000 7f074076e740 10 client.18783 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.618+0000 7f074076e740 10 client.18783 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.619+0000 7f074076e740 20 client.18783 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.619+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5626116b0270 0x5626116b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.619+0000 7f074076e740 4 client.18783 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.619+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0728019040 con 0x5626116b0270 2024-09-15T23:01:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.621+0000 7f0737fff640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5626116b0270 0x5626116b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.632+0000 7f0737fff640 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5626116b0270 0x5626116b2710 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1105d50fe7b719bd server_cookie=570dd9484032485a in_seq=0 out_seq=0 2024-09-15T23:01:47.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.633+0000 7f071b7fe640 10 client.18783 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.637+0000 7f071b7fe640 1 -- 172.21.15.66:0/2854037212 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0728019040 con 0x5626116b0270 2024-09-15T23:01:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.637+0000 7f071b7fe640 10 client.18783 handle_command_reply: tid=0 2024-09-15T23:01:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.637+0000 7f074076e740 1 client.18783 shutdown 2024-09-15T23:01:47.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.640+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 msgr2=0x56261169db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.640+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 0x56261169db30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f0730009fd0 tx=0x7f0730010f00 comp rx=0 tx=0).stop 2024-09-15T23:01:47.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.644+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 shutdown_connections 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.644+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5626116a0240 0x56261169db30 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.644+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5626116b0270 0x5626116b2710 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.644+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695980 0x56261169d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.645+0000 7f074076e740 1 --2- 172.21.15.66:0/2854037212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562611695060 0x56261169d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.645+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 >> 172.21.15.66:0/2854037212 conn(0x5626116915f0 msgr2=0x562611697320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.645+0000 7f071b7fe640 0 client.18783 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.648+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 shutdown_connections 2024-09-15T23:01:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.648+0000 7f074076e740 1 -- 172.21.15.66:0/2854037212 wait complete. 2024-09-15T23:01:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.648+0000 7f074076e740 20 client.18783 trim_cache size 0 max 16384 2024-09-15T23:01:47.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.688+0000 7f074076e740 1 Processor -- start 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 -- start start 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 0x562611690640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695060 0x5626116b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x5626116b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b5640 con 0x562611695980 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f074076e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f07381d9490 con 0x562611695060 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 0x562611690640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f0737fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 0x562611690640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55356/0 (socket says 172.21.15.66:55356) 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.692+0000 7f0737fff640 1 -- 172.21.15.66:0/2378237349 learned_addr learned my addr 172.21.15.66:0/2378237349 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f07377fe640 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695060 0x5626116b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b5dd0 con 0x5626116915f0 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x5626116b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 -- 172.21.15.66:0/2378237349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 msgr2=0x562611690640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 0x562611690640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 -- 172.21.15.66:0/2378237349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695060 msgr2=0x5626116b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695060 0x5626116b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.693+0000 7f073c932640 1 -- 172.21.15.66:0/2378237349 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562611691420 con 0x562611695980 2024-09-15T23:01:47.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.694+0000 7f073c932640 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x5626116b8520 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f07300198f0 tx=0x7f073000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c520b0b4b8ced5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.697+0000 7f0725ffb640 1 -- 172.21.15.66:0/2378237349 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730019410 con 0x562611695980 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.697+0000 7f0725ffb640 1 -- 172.21.15.66:0/2378237349 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0730019970 con 0x562611695980 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 msgr2=0x5626116b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x5626116b8520 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f07300198f0 tx=0x7f073000eef0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 shutdown_connections 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695980 0x5626116b8520 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562611695060 0x5626116b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 --2- 172.21.15.66:0/2378237349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116915f0 0x562611690640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.698+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 >> 172.21.15.66:0/2378237349 conn(0x56261168c720 msgr2=0x56261168ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:47.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.703+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 shutdown_connections 2024-09-15T23:01:47.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.708+0000 7f074076e740 1 -- 172.21.15.66:0/2378237349 wait complete. 2024-09-15T23:01:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.709+0000 7f074076e740 1 -- start start 2024-09-15T23:01:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.709+0000 7f074076e740 1 Processor -- start 2024-09-15T23:01:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.710+0000 7f074076e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116915f0 0x5626116a4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.710+0000 7f074076e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 0x5626116a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.710+0000 7f074076e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 0x562611719fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.711+0000 7f074076e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b6cf0 con 0x562611695060 2024-09-15T23:01:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.711+0000 7f074076e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f07381b6560 con 0x5626116915f0 2024-09-15T23:01:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.711+0000 7f074076e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0738073b00 con 0x5626116a0240 2024-09-15T23:01:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.712+0000 7f074076e740 10 client.0 _ll_register_callbacks cb 0x7f07300106b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:47.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.712+0000 7f0737fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116915f0 0x5626116a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.712+0000 7f073c932640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 0x562611719fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.716+0000 7f07377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 0x5626116a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.716+0000 7f073c932640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 0x562611719fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:55370/0 (socket says 172.21.15.66:55370) 2024-09-15T23:01:47.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.716+0000 7f073c932640 1 -- 172.21.15.66:0/3895051622 learned_addr learned my addr 172.21.15.66:0/3895051622 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:47.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.720+0000 7f07377fe640 1 -- 172.21.15.66:0/3895051622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 msgr2=0x562611719fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.720+0000 7f07377fe640 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 0x562611719fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.720+0000 7f07377fe640 1 -- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116915f0 msgr2=0x5626116a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:47.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.720+0000 7f07377fe640 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116915f0 0x5626116a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:47.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.720+0000 7f07377fe640 1 -- 172.21.15.66:0/3895051622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626116a3020 con 0x562611695060 2024-09-15T23:01:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.722+0000 7f07377fe640 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 0x5626116a4ba0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f072c0ecc90 tx=0x7f072c0bb4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6ebb99ae052701 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.722+0000 7f071b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:01:47.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.725+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c0bbfb0 con 0x562611695060 2024-09-15T23:01:47.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.725+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562611607b90 con 0x562611695060 2024-09-15T23:01:47.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.725+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f072c0c20b0 con 0x562611695060 2024-09-15T23:01:47.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.728+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f072c0bb8b0 con 0x562611695060 2024-09-15T23:01:47.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.729+0000 7f074076e740 10 client.18789 fetch_fsmap learned FSMap version 63 2024-09-15T23:01:47.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.729+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x56261171b630 con 0x562611695060 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562611607b90 con 0x562611695060 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 63) ==== 8450+0+0 (secure 0 0 0) 0x7f072c03a070 con 0x562611695060 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 10 client.18789 fetch_fsmap finished waiting for FSMap version 63 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 10 client.18789 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 20 client.18789 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56261171bf60 0x56261171e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:47.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 4 client.18789 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4dd62132", "release": true, "await": true}] 2024-09-15T23:01:47.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4dd62132", "release": true, "await": true}) -- 0x5626116020a0 con 0x56261171bf60 2024-09-15T23:01:47.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.730+0000 7f0737fff640 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56261171bf60 0x56261171e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:47.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.732+0000 7f0737fff640 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56261171bf60 0x56261171e380 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=663a701ef445f711 server_cookie=dec40c72b70de73c in_seq=0 out_seq=0 2024-09-15T23:01:47.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:47.732+0000 7f071b7fe640 10 client.18789 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:48.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f071b7fe640 1 -- 172.21.15.66:0/3895051622 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5626116020a0 con 0x56261171bf60 2024-09-15T23:01:48.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f071b7fe640 10 client.18789 handle_command_reply: tid=0 2024-09-15T23:01:48.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 client.18789 shutdown 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 msgr2=0x5626116a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 0x5626116a4ba0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f072c0ecc90 tx=0x7f072c0bb4b0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 shutdown_connections 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5626116a0240 0x562611719fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562611695060 0x5626116a4ba0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56261171bf60 0x56261171e380 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 --2- 172.21.15.66:0/3895051622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626116915f0 0x5626116a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 >> 172.21.15.66:0/3895051622 conn(0x56261168c720 msgr2=0x562611690750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f071b7fe640 0 client.18789 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.282+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 shutdown_connections 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.283+0000 7f074076e740 1 -- 172.21.15.66:0/3895051622 wait complete. 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.283+0000 7f074076e740 20 client.18789 trim_cache size 0 max 16384 2024-09-15T23:01:48.285 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 64, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 56, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "4dd62132": { 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 56, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 137.7, 2024-09-15T23:01:48.286 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:01:48.287 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 msgr2=0x7f07200a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 0x7f07200a5860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07280097a0 tx=0x7f0728006c90 comp rx=0 tx=0).stop 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 msgr2=0x7f0738118b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f072c02a8f0 tx=0x7f072c033d10 comp rx=0 tx=0).stop 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 shutdown_connections 2024-09-15T23:01:48.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f07200a33a0 0x7f07200a5860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073811b140 0x7f0738111760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0738109830 0x7f0738118b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 --2- 172.21.15.66:0/1507599906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0738109450 0x7f07381185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.284+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 >> 172.21.15.66:0/1507599906 conn(0x7f073806e140 msgr2=0x7f073811bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.286+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 shutdown_connections 2024-09-15T23:01:48.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:48.286+0000 7f073e395640 1 -- 172.21.15.66:0/1507599906 wait complete. 2024-09-15T23:01:49.178 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4dd62132', total seconds elapsed: 23.6 2024-09-15T23:01:49.179 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.7 2024-09-15T23:01:49.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:01:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:49 smithi184 ceph-mon[35203]: pgmap v518: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 334 KiB/s wr, 151 op/s 2024-09-15T23:01:49.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:49 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:01:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:49 smithi066 ceph-mon[31185]: pgmap v518: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 334 KiB/s wr, 151 op/s 2024-09-15T23:01:49.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:49 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:01:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:49 smithi087 ceph-mon[35290]: pgmap v518: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 334 KiB/s wr, 151 op/s 2024-09-15T23:01:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:49 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:01:49.765 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:50.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.419+0000 7f275b0e6640 1 -- 172.21.15.66:0/2527948732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 msgr2=0x7f2754114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:50.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.419+0000 7f275b0e6640 1 --2- 172.21.15.66:0/2527948732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f2754114ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2744009860 tx=0x7f274402a360 comp rx=0 tx=0).stop 2024-09-15T23:01:50.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.422+0000 7f275b0e6640 1 -- 172.21.15.66:0/2527948732 shutdown_connections 2024-09-15T23:01:50.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.422+0000 7f275b0e6640 1 --2- 172.21.15.66:0/2527948732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f2754114ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.422+0000 7f275b0e6640 1 --2- 172.21.15.66:0/2527948732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2754108c30 0x7f275410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.422+0000 7f275b0e6640 1 --2- 172.21.15.66:0/2527948732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f2754108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.422+0000 7f275b0e6640 1 -- 172.21.15.66:0/2527948732 >> 172.21.15.66:0/2527948732 conn(0x7f27540779f0 msgr2=0x7f2754079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:50.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.423+0000 7f275b0e6640 1 -- 172.21.15.66:0/2527948732 shutdown_connections 2024-09-15T23:01:50.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.424+0000 7f275b0e6640 1 -- 172.21.15.66:0/2527948732 wait complete. 2024-09-15T23:01:50.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.425+0000 7f275b0e6640 1 Processor -- start 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.425+0000 7f275b0e6640 1 -- start start 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2754108c30 0x7f2754082cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f275407ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27541183e0 con 0x7f2754108280 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2754118260 con 0x7f275410d360 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.426+0000 7f275b0e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2754118560 con 0x7f2754108c30 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.427+0000 7f275a0e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.427+0000 7f275a0e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52366/0 (socket says 172.21.15.66:52366) 2024-09-15T23:01:50.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.427+0000 7f275a0e4640 1 -- 172.21.15.66:0/3964573609 learned_addr learned my addr 172.21.15.66:0/3964573609 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.427+0000 7f275a8e5640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f275407ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 -- 172.21.15.66:0/3964573609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2754108c30 msgr2=0x7f2754082cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:01:50.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2754108c30 0x7f2754082cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 -- 172.21.15.66:0/3964573609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 msgr2=0x7f275407ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f275407ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 -- 172.21.15.66:0/3964573609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275407c2c0 con 0x7f2754108280 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.428+0000 7f275a0e4640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ba50 tx=0x7f274c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.429+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c019070 con 0x7f2754108280 2024-09-15T23:01:50.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.429+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f274c00cbe0 con 0x7f2754108280 2024-09-15T23:01:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.429+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0076f0 con 0x7f2754108280 2024-09-15T23:01:50.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.429+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275407c5b0 con 0x7f2754108280 2024-09-15T23:01:50.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.429+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2754080570 con 0x7f2754108280 2024-09-15T23:01:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.436+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754109710 con 0x7f2754108280 2024-09-15T23:01:50.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.437+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f274c01c070 con 0x7f2754108280 2024-09-15T23:01:50.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.438+0000 7f274b7fe640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 0x7f27400a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:50.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.438+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f274c0cf640 con 0x7f2754108280 2024-09-15T23:01:50.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.439+0000 7f27598e3640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 0x7f27400a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.448+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f274c09bcc0 con 0x7f2754108280 2024-09-15T23:01:50.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.450+0000 7f27598e3640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 0x7f27400a59c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f275407d000 tx=0x7f2750009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.871+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2754080ff0 con 0x7f2754108280 2024-09-15T23:01:50.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.874+0000 7f274b7fe640 1 -- 172.21.15.66:0/3964573609 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+12007 (secure 0 0 0) 0x7f274c09b5c0 con 0x7f2754108280 2024-09-15T23:01:50.875 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:01:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":64,"btime":"2024-09-15T23:01:48:107397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:01:47.557315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:01:50.876 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 64 2024-09-15T23:01:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 msgr2=0x7f27400a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 0x7f27400a59c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f275407d000 tx=0x7f2750009260 comp rx=0 tx=0).stop 2024-09-15T23:01:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 msgr2=0x7f27540827b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f274c00ba50 tx=0x7f274c00bf10 comp rx=0 tx=0).stop 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 shutdown_connections 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f27400a3500 0x7f27400a59c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275410d360 0x7f275407ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2754108c30 0x7f2754082cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 --2- 172.21.15.66:0/3964573609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2754108280 0x7f27540827b0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 >> 172.21.15.66:0/3964573609 conn(0x7f27540779f0 msgr2=0x7f2754078e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 shutdown_connections 2024-09-15T23:01:50.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:50.878+0000 7f275b0e6640 1 -- 172.21.15.66:0/3964573609 wait complete. 2024-09-15T23:01:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:51 smithi184 ceph-mon[35203]: pgmap v519: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 KiB/s wr, 151 op/s 2024-09-15T23:01:51.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3964573609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:51 smithi066 ceph-mon[31185]: pgmap v519: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 KiB/s wr, 151 op/s 2024-09-15T23:01:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3964573609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:51 smithi087 ceph-mon[35290]: pgmap v519: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 KiB/s wr, 151 op/s 2024-09-15T23:01:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3964573609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:01:52.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:52 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:01:52.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:52 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:01:52.550 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 137.7 --await-for 45.0' 2024-09-15T23:01:52.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 137.7 --await-for 45.0 2024-09-15T23:01:52.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:52 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:01:53.095 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:01:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:53 smithi184 ceph-mon[35203]: pgmap v520: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 252 KiB/s wr, 153 op/s 2024-09-15T23:01:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:01:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:01:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:53 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:01:53.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:53 smithi066 ceph-mon[31185]: pgmap v520: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 252 KiB/s wr, 153 op/s 2024-09-15T23:01:53.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:01:53.425 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:01:53.426 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:53 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:01:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:53 smithi087 ceph-mon[35290]: pgmap v520: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 252 KiB/s wr, 153 op/s 2024-09-15T23:01:53.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:01:53.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:01:53.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:53 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:01:53.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.777+0000 7f4dcd797640 1 -- 172.21.15.66:0/671438582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8105560 msgr2=0x7f4dc810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.777+0000 7f4dcd797640 1 --2- 172.21.15.66:0/671438582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8105560 0x7f4dc810d0e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000b880 tx=0x7f4dc0005f90 comp rx=0 tx=0).stop 2024-09-15T23:01:53.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.779+0000 7f4dcd797640 1 -- 172.21.15.66:0/671438582 shutdown_connections 2024-09-15T23:01:53.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.779+0000 7f4dcd797640 1 --2- 172.21.15.66:0/671438582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8105560 0x7f4dc810d0e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.779+0000 7f4dcd797640 1 --2- 172.21.15.66:0/671438582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.779+0000 7f4dcd797640 1 --2- 172.21.15.66:0/671438582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8100430 0x7f4dc8100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.779+0000 7f4dcd797640 1 -- 172.21.15.66:0/671438582 >> 172.21.15.66:0/671438582 conn(0x7f4dc8077230 msgr2=0x7f4dc80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:53.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.782+0000 7f4dcd797640 1 -- 172.21.15.66:0/671438582 shutdown_connections 2024-09-15T23:01:53.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.785+0000 7f4dcd797640 1 -- 172.21.15.66:0/671438582 wait complete. 2024-09-15T23:01:53.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.786+0000 7f4dcd797640 1 Processor -- start 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 -- start start 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8100430 0x7f4dc80739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 0x7f4dc806cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc8118550 con 0x7f4dc8100de0 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc81183d0 con 0x7f4dc8100430 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dcd797640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc81186d0 con 0x7f4dc8105560 2024-09-15T23:01:53.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.789+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 0x7f4dc806cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.790+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 0x7f4dc806cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:58382/0 (socket says 172.21.15.66:58382) 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.790+0000 7f4dc77fe640 1 -- 172.21.15.66:0/2353962857 learned_addr learned my addr 172.21.15.66:0/2353962857 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.790+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8100430 0x7f4dc80739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2353962857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 msgr2=0x7f4dc806cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 0x7f4dc806cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2353962857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8100430 msgr2=0x7f4dc80739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8100430 0x7f4dc80739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.792+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2353962857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc806d530 con 0x7f4dc8100de0 2024-09-15T23:01:53.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.795+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc806ca60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.797+0000 7f4dbffff640 1 -- 172.21.15.66:0/2353962857 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db001e070 con 0x7f4dc8100de0 2024-09-15T23:01:53.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.797+0000 7f4dbffff640 1 -- 172.21.15.66:0/2353962857 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db000dda0 con 0x7f4dc8100de0 2024-09-15T23:01:53.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.797+0000 7f4dbffff640 1 -- 172.21.15.66:0/2353962857 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db000b820 con 0x7f4dc8100de0 2024-09-15T23:01:53.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.797+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc806d820 con 0x7f4dc8100de0 2024-09-15T23:01:53.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.798+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc8071810 con 0x7f4dc8100de0 2024-09-15T23:01:53.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.805+0000 7f4dbffff640 1 -- 172.21.15.66:0/2353962857 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f4db000b9c0 con 0x7f4dc8100de0 2024-09-15T23:01:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.806+0000 7f4dcfb70740 1 Processor -- start 2024-09-15T23:01:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.808+0000 7f4dbffff640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 0x7f4db40a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.808+0000 7f4dbffff640 1 -- 172.21.15.66:0/2353962857 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f4db00d0fa0 con 0x7f4dc8100de0 2024-09-15T23:01:53.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.809+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 0x7f4db40a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.810+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 0x7f4db40a5a80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000b850 tx=0x7f4dc000b280 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 -- start start 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552336400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f552338d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f5522912a0 con 0x55f55232b760 2024-09-15T23:01:53.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f552238b10 con 0x55f552336940 2024-09-15T23:01:53.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.816+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f55228d260 con 0x55f55232c080 2024-09-15T23:01:53.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.818+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.818+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:32772/0 (socket says 172.21.15.66:32772) 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.818+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/1529928740 learned_addr learned my addr 172.21.15.66:0/1529928740 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.819+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/1529928740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 msgr2=0x55f552336400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.819+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552336400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.819+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/1529928740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 msgr2=0x55f552338d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.819+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f552338d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.819+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/1529928740 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f552002b90 con 0x55f55232b760 2024-09-15T23:01:53.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.821+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4db800d660 tx=0x7f4db800d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2caf4a3e9dd15ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.825+0000 7f4dbd7fa640 1 -- 172.21.15.66:0/1529928740 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8014500 con 0x55f55232b760 2024-09-15T23:01:53.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.825+0000 7f4dbd7fa640 1 -- 172.21.15.66:0/1529928740 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db8014b80 con 0x55f55232b760 2024-09-15T23:01:53.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.825+0000 7f4dbd7fa640 1 -- 172.21.15.66:0/1529928740 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8016c00 con 0x55f55232b760 2024-09-15T23:01:53.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.826+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1529928740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 msgr2=0x55f55232bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.826+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4db800d660 tx=0x7f4db800d910 comp rx=0 tx=0).stop 2024-09-15T23:01:53.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.834+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1529928740 shutdown_connections 2024-09-15T23:01:53.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.834+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f552338d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.834+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552336400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.834+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1529928740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55232bb40 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.834+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1529928740 >> 172.21.15.66:0/1529928740 conn(0x55f552327cf0 msgr2=0x55f5523280d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:53.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.837+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1529928740 shutdown_connections 2024-09-15T23:01:53.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.839+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1529928740 wait complete. 2024-09-15T23:01:53.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.839+0000 7f4dcfb70740 1 -- start start 2024-09-15T23:01:53.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.839+0000 7f4dcfb70740 1 Processor -- start 2024-09-15T23:01:53.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552333840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f5523342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552333840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552333840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55322/0 (socket says 172.21.15.66:55322) 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dc67fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dc67fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:58388/0 (socket says 172.21.15.66:58388) 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/2601639236 learned_addr learned my addr 172.21.15.66:0/2601639236 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f552339510 con 0x55f552336940 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55f5522196e0 con 0x55f55232b760 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f552339690 con 0x55f55232c080 2024-09-15T23:01:53.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.840+0000 7f4dcfb70740 10 client.0 _ll_register_callbacks cb 0x55f55223da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:53.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.844+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 msgr2=0x55f552333840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.844+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552333840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.844+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2601639236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 msgr2=0x55f5523342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.844+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f5523342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.844+0000 7f4dc67fc640 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f552342ac0 con 0x55f55232c080 2024-09-15T23:01:53.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.848+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4db00ce1f0 tx=0x7f4db000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14510d17595889e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.849+0000 7f4dae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:01:53.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.853+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00ce6b0 con 0x55f55232c080 2024-09-15T23:01:53.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.853+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f4db009c400 con 0x55f55232c080 2024-09-15T23:01:53.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.853+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db8014b80 con 0x55f55232c080 2024-09-15T23:01:53.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.857+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f4db00ba050 con 0x55f55232c080 2024-09-15T23:01:53.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.857+0000 7f4dcfb70740 10 client.27970 fetch_fsmap learned FSMap version 64 2024-09-15T23:01:53.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.858+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55f552345450 con 0x55f55232c080 2024-09-15T23:01:53.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db8014b80 con 0x55f55232c080 2024-09-15T23:01:53.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f4db000b040 con 0x55f55232c080 2024-09-15T23:01:53.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 10 client.27970 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:01:53.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 10 client.27970 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:53.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 20 client.27970 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:53.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f552346e50 0x55f5523492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 4 client.27970 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:01:53.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.860+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f55229e9d0 con 0x55f552346e50 2024-09-15T23:01:53.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.861+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f552346e50 0x55f5523492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.865+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f552346e50 0x55f5523492b0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f477e31d03e34a48 server_cookie=dea9e4274cdf9ece in_seq=0 out_seq=0 2024-09-15T23:01:53.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.866+0000 7f4dae7fc640 10 client.27970 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:53.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.868+0000 7f4dae7fc640 1 -- 172.21.15.66:0/2601639236 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f55229e9d0 con 0x55f552346e50 2024-09-15T23:01:53.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.868+0000 7f4dae7fc640 10 client.27970 handle_command_reply: tid=0 2024-09-15T23:01:53.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.868+0000 7f4dcfb70740 1 client.27970 shutdown 2024-09-15T23:01:53.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.874+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 msgr2=0x55f552333d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.874+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4db00ce1f0 tx=0x7f4db000bd70 comp rx=0 tx=0).stop 2024-09-15T23:01:53.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 shutdown_connections 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f5523342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552333d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f552346e50 0x55f5523492b0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/2601639236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552333840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dae7fc640 0 client.27970 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.880+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 >> 172.21.15.66:0/2601639236 conn(0x55f552327cf0 msgr2=0x55f55232da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:53.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.881+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 shutdown_connections 2024-09-15T23:01:53.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.882+0000 7f4dcfb70740 1 -- 172.21.15.66:0/2601639236 wait complete. 2024-09-15T23:01:53.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.883+0000 7f4dcfb70740 20 client.27970 trim_cache size 0 max 16384 2024-09-15T23:01:53.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.918+0000 7f4dcfb70740 1 Processor -- start 2024-09-15T23:01:53.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.918+0000 7f4dcfb70740 1 -- start start 2024-09-15T23:01:53.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.919+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552334110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.919+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552326d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.919+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552334110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.919+0000 7f4dc6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552334110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55324/0 (socket says 172.21.15.66:55324) 2024-09-15T23:01:53.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dc6ffd640 1 -- 172.21.15.66:0/3525758943 learned_addr learned my addr 172.21.15.66:0/3525758943 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:53.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f55234ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8010250 con 0x55f552336940 2024-09-15T23:01:53.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8012060 con 0x55f55232b760 2024-09-15T23:01:53.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80109b0 con 0x55f55232c080 2024-09-15T23:01:53.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552326d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.920+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f55234ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.921+0000 7f4dc67fc640 1 -- 172.21.15.66:0/3525758943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 msgr2=0x55f552334110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.921+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552334110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.921+0000 7f4dc67fc640 1 -- 172.21.15.66:0/3525758943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 msgr2=0x55f55234ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.921+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f55234ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.921+0000 7f4dc67fc640 1 -- 172.21.15.66:0/3525758943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f552332810 con 0x55f55232c080 2024-09-15T23:01:53.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.922+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552326d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b470 tx=0x7f4db000bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa5fc82a43577a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.923+0000 7f4dbcff9640 1 -- 172.21.15.66:0/3525758943 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00ce6b0 con 0x55f55232c080 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.923+0000 7f4dbcff9640 1 -- 172.21.15.66:0/3525758943 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db00a0070 con 0x55f55232c080 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.923+0000 7f4dbcff9640 1 -- 172.21.15.66:0/3525758943 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db009cb80 con 0x55f55232c080 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 msgr2=0x55f552326d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552326d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4db000b470 tx=0x7f4db000bde0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 shutdown_connections 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f552336940 0x55f55234ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f552326d60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/3525758943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f55232b760 0x55f552334110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.924+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 >> 172.21.15.66:0/3525758943 conn(0x55f552327cf0 msgr2=0x55f552326650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:01:53.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.927+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 shutdown_connections 2024-09-15T23:01:53.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.928+0000 7f4dcfb70740 1 -- 172.21.15.66:0/3525758943 wait complete. 2024-09-15T23:01:53.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.929+0000 7f4dcfb70740 1 -- start start 2024-09-15T23:01:53.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.929+0000 7f4dcfb70740 1 Processor -- start 2024-09-15T23:01:53.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.930+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55233e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.930+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f55233eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.930+0000 7f4dcfb70740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80118d0 con 0x55f55232b760 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8011140 con 0x55f552336940 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dcfb70740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4da800e230 con 0x55f55232c080 2024-09-15T23:01:53.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dcfb70740 10 client.0 _ll_register_callbacks cb 0x7f4db009c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:01:53.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55326/0 (socket says 172.21.15.66:55326) 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.931+0000 7f4dc77fe640 1 -- 172.21.15.66:0/1709131235 learned_addr learned my addr 172.21.15.66:0/1709131235 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55233e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc67fc640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f55233eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 -- 172.21.15.66:0/1709131235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 msgr2=0x55f55233eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f55233eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 -- 172.21.15.66:0/1709131235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 msgr2=0x55f55233e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55233e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 -- 172.21.15.66:0/1709131235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55232beb0 con 0x55f552336940 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dc77fe640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00043c0 tx=0x7f4dc000a800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d09a698b50b8733 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:01:53.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.932+0000 7f4dae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:01:53.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.935+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0005040 con 0x55f552336940 2024-09-15T23:01:53.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.935+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9651+0+0 (secure 0 0 0) 0x7f4dc00051e0 con 0x55f552336940 2024-09-15T23:01:53.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.935+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db00a0070 con 0x55f552336940 2024-09-15T23:01:53.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.938+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f4dc0005420 con 0x55f552336940 2024-09-15T23:01:53.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.938+0000 7f4dcfb70740 10 client.28085 fetch_fsmap learned FSMap version 64 2024-09-15T23:01:53.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.938+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55f5523b2060 con 0x55f552336940 2024-09-15T23:01:53.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db00a0070 con 0x55f552336940 2024-09-15T23:01:53.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f4dc0053030 con 0x55f552336940 2024-09-15T23:01:53.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 10 client.28085 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:01:53.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 10 client.28085 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:01:53.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 20 client.28085 populate_metadata read hostname 'smithi066' 2024-09-15T23:01:53.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5523b28f0 0x55f5523b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:01:53.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 4 client.28085 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.7, "await_for": 45.0}] 2024-09-15T23:01:53.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.941+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.7, "await_for": 45.0}) -- 0x55f552298d20 con 0x55f5523b28f0 2024-09-15T23:01:53.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.947+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5523b28f0 0x55f5523b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:01:53.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.949+0000 7f4dc6ffd640 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5523b28f0 0x55f5523b4d10 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c210e5e6c05064 server_cookie=7986eb902b8cce2c in_seq=0 out_seq=0 2024-09-15T23:01:53.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:01:53.949+0000 7f4dae7fc640 10 client.28085 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:01:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:55 smithi184 ceph-mon[35203]: pgmap v521: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 973 KiB/s wr, 154 op/s 2024-09-15T23:01:55.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:55 smithi066 ceph-mon[31185]: pgmap v521: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 973 KiB/s wr, 154 op/s 2024-09-15T23:01:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:55 smithi087 ceph-mon[35290]: pgmap v521: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 973 KiB/s wr, 154 op/s 2024-09-15T23:01:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:57 smithi184 ceph-mon[35203]: pgmap v522: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 833 KiB/s wr, 143 op/s 2024-09-15T23:01:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:57 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:57.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:57 smithi066 ceph-mon[31185]: pgmap v522: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 833 KiB/s wr, 143 op/s 2024-09-15T23:01:57.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:57 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:57 smithi087 ceph-mon[35290]: pgmap v522: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 833 KiB/s wr, 143 op/s 2024-09-15T23:01:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:57 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:01:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:01:59 smithi184 ceph-mon[35203]: pgmap v523: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-09-15T23:01:59.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:01:59 smithi066 ceph-mon[31185]: pgmap v523: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-09-15T23:01:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:01:59 smithi087 ceph-mon[35290]: pgmap v523: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-09-15T23:02:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dae7fc640 1 -- 172.21.15.66:0/1709131235 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f552298d20 con 0x55f5523b28f0 2024-09-15T23:02:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dae7fc640 10 client.28085 handle_command_reply: tid=0 2024-09-15T23:02:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dcfb70740 1 client.28085 shutdown 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 msgr2=0x55f55233b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00043c0 tx=0x7f4dc000a800 comp rx=0 tx=0).stop 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.847+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 shutdown_connections 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55f5523b28f0 0x55f5523b4d10 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f552336940 0x55f55233b940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dae7fc640 0 client.28085 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f55232c080 0x55f55233eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 --2- 172.21.15.66:0/1709131235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f55232b760 0x55f55233e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 >> 172.21.15.66:0/1709131235 conn(0x55f552327cf0 msgr2=0x55f552326e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 shutdown_connections 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 1 -- 172.21.15.66:0/1709131235 wait complete. 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.848+0000 7f4dcfb70740 20 client.28085 trim_cache size 0 max 16384 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 64, 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:02:00.850 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 58, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "86b9ec12": { 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 58, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 137.7, 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:02:00.851 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:00.852 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 msgr2=0x7f4db40a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 0x7f4db40a5a80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000b850 tx=0x7f4dc000b280 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 msgr2=0x7f4dc806ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc806ca60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005fd0 tx=0x7f4db000ff70 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 shutdown_connections 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f4db40a35c0 0x7f4db40a5a80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dc8105560 0x7f4dc806cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dc8100de0 0x7f4dc806ca60 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 --2- 172.21.15.66:0/2353962857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4dc8100430 0x7f4dc80739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.849+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 >> 172.21.15.66:0/2353962857 conn(0x7f4dc8077230 msgr2=0x7f4dc8103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.850+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 shutdown_connections 2024-09-15T23:02:00.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:00.850+0000 7f4dcd797640 1 -- 172.21.15.66:0/2353962857 wait complete. 2024-09-15T23:02:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:01 smithi184 ceph-mon[35203]: pgmap v524: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-09-15T23:02:01.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:01 smithi066 ceph-mon[31185]: pgmap v524: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-09-15T23:02:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:01 smithi087 ceph-mon[35290]: pgmap v524: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-09-15T23:02:01.630 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '86b9ec12', quiesce took 12.5 seconds. Will release after: 5.199999999999999 2024-09-15T23:02:03.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:03 smithi184 ceph-mon[35203]: pgmap v525: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:03.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:03 smithi066 ceph-mon[31185]: pgmap v525: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:03 smithi087 ceph-mon[35290]: pgmap v525: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:05 smithi066 ceph-mon[31185]: pgmap v526: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T23:02:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:02:05.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:05 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:02:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:05 smithi087 ceph-mon[35290]: pgmap v526: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T23:02:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:02:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:05 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:02:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:05 smithi184 ceph-mon[35203]: pgmap v526: 129 pgs: 13 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 79 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T23:02:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:02:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:05 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:02:06.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:06 smithi066 ceph-mon[31185]: osdmap e113: 12 total, 12 up, 12 in 2024-09-15T23:02:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:06 smithi087 ceph-mon[35290]: osdmap e113: 12 total, 12 up, 12 in 2024-09-15T23:02:06.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:06 smithi184 ceph-mon[35203]: osdmap e113: 12 total, 12 up, 12 in 2024-09-15T23:02:06.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:02:07.191 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:07 smithi066 ceph-mon[31185]: pgmap v528: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 850 KiB/s wr, 141 op/s 2024-09-15T23:02:07.326 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:07 smithi087 ceph-mon[35290]: pgmap v528: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 850 KiB/s wr, 141 op/s 2024-09-15T23:02:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:07 smithi184 ceph-mon[35203]: pgmap v528: 129 pgs: 14 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 75 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 850 KiB/s wr, 141 op/s 2024-09-15T23:02:09.278 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:09 smithi066 ceph-mon[31185]: pgmap v529: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 467 KiB/s wr, 130 op/s 2024-09-15T23:02:09.278 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:09 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1977921538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:09 smithi087 ceph-mon[35290]: pgmap v529: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 467 KiB/s wr, 130 op/s 2024-09-15T23:02:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:09 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1977921538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:09 smithi184 ceph-mon[35203]: pgmap v529: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 467 KiB/s wr, 130 op/s 2024-09-15T23:02:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:09 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1977921538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 -- 172.21.15.66:0/964381620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102570 msgr2=0x7f0bb41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:10.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 --2- 172.21.15.66:0/964381620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102570 0x7f0bb41029b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009900 tx=0x7f0b9c02a480 comp rx=0 tx=0).stop 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 -- 172.21.15.66:0/964381620 shutdown_connections 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 --2- 172.21.15.66:0/964381620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102ef0 0x7f0bb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 --2- 172.21.15.66:0/964381620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102570 0x7f0bb41029b0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 --2- 172.21.15.66:0/964381620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 0x7f0bb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 -- 172.21.15.66:0/964381620 >> 172.21.15.66:0/964381620 conn(0x7f0bb40fc7d0 msgr2=0x7f0bb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 -- 172.21.15.66:0/964381620 shutdown_connections 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.558+0000 7f0bb932f640 1 -- 172.21.15.66:0/964381620 wait complete. 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 Processor -- start 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 -- start start 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 0x7f0bb419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:10.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102570 0x7f0bb419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4110f80 con 0x7f0bb4102ef0 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4110e00 con 0x7f0bb4100e20 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.559+0000 7f0bb932f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4111100 con 0x7f0bb4102570 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36208/0 (socket says 172.21.15.66:36208) 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 -- 172.21.15.66:0/1977921538 learned_addr learned my addr 172.21.15.66:0/1977921538 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 0x7f0bb419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb27fc640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102570 0x7f0bb419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 -- 172.21.15.66:0/1977921538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102570 msgr2=0x7f0bb419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102570 0x7f0bb419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 -- 172.21.15.66:0/1977921538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 msgr2=0x7f0bb419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:10.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 0x7f0bb419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 -- 172.21.15.66:0/1977921538 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb419f660 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb37fe640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009fd0 tx=0x7f0bac00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017070 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb419f950 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bac003e50 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.560+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0106c0 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.561+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb41a7230 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.562+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb41021b0 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.563+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0bac003970 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.564+0000 7f0babfff640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 0x7f0ba00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.564+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f0bac0cfee0 con 0x7f0bb4102ef0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.564+0000 7f0bb2ffd640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 0x7f0ba00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:10.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.564+0000 7f0bb2ffd640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 0x7f0ba00a5870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009bd0 tx=0x7f0ba4005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:10.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:08.567+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0bac09bd90 con 0x7f0bb4102ef0 2024-09-15T23:02:10.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.017+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bb4101200 con 0x7f0bb4102ef0 2024-09-15T23:02:10.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.019+0000 7f0babfff640 1 -- 172.21.15.66:0/1977921538 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+12007 (secure 0 0 0) 0x7f0bb4101200 con 0x7f0bb4102ef0 2024-09-15T23:02:10.087 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:02:10.087 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":64,"btime":"2024-09-15T23:01:48:107397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:01:47.557315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:02:10.088 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 64 2024-09-15T23:02:10.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.026+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 msgr2=0x7f0ba00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:10.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.026+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 0x7f0ba00a5870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009bd0 tx=0x7f0ba4005f90 comp rx=0 tx=0).stop 2024-09-15T23:02:10.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.026+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 msgr2=0x7f0bb419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.026+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009fd0 tx=0x7f0bac00b260 comp rx=0 tx=0).stop 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 shutdown_connections 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0ba00a33b0 0x7f0ba00a5870 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009bd0 tx=0x7f0ba4005f90 comp rx=0 tx=0).stop 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bb4102ef0 0x7f0bb419ef80 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bb4102570 0x7f0bb419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 --2- 172.21.15.66:0/1977921538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb4100e20 0x7f0bb419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.027+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 >> 172.21.15.66:0/1977921538 conn(0x7f0bb40fc7d0 msgr2=0x7f0bb406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.034+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 shutdown_connections 2024-09-15T23:02:10.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:09.036+0000 7f0bb932f640 1 -- 172.21.15.66:0/1977921538 wait complete. 2024-09-15T23:02:11.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:11 smithi066 ceph-mon[31185]: pgmap v530: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 117 op/s 2024-09-15T23:02:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:11 smithi087 ceph-mon[35290]: pgmap v530: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 117 op/s 2024-09-15T23:02:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:11 smithi184 ceph-mon[35203]: pgmap v530: 129 pgs: 17 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 64 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 117 op/s 2024-09-15T23:02:12.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:02:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:13 smithi087 ceph-mon[35290]: pgmap v531: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 114 op/s 2024-09-15T23:02:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:13 smithi184 ceph-mon[35203]: pgmap v531: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 114 op/s 2024-09-15T23:02:13.677 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:13 smithi066 ceph-mon[31185]: pgmap v531: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 295 KiB/s wr, 114 op/s 2024-09-15T23:02:14.394 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 86b9ec12 --release --await' 2024-09-15T23:02:14.395 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 86b9ec12 --release --await 2024-09-15T23:02:14.472 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 -- 172.21.15.66:0/3228324166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e2811b140 msgr2=0x7f6e2811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/3228324166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e2811b140 0x7f6e2811d530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009860 tx=0x7f6e1c02a380 comp rx=0 tx=0).stop 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 -- 172.21.15.66:0/3228324166 shutdown_connections 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/3228324166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e2811b140 0x7f6e2811d530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/3228324166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e28109830 0x7f6e28109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/3228324166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 0x7f6e28110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 -- 172.21.15.66:0/3228324166 >> 172.21.15.66:0/3228324166 conn(0x7f6e2806e140 msgr2=0x7f6e2806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.135+0000 7f6e2ef39640 1 -- 172.21.15.66:0/3228324166 shutdown_connections 2024-09-15T23:02:15.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.139+0000 7f6e2ef39640 1 -- 172.21.15.66:0/3228324166 wait complete. 2024-09-15T23:02:15.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.140+0000 7f6e2ef39640 1 Processor -- start 2024-09-15T23:02:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 -- start start 2024-09-15T23:02:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 0x7f6e281a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e2811b140 0x7f6e281abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28120da0 con 0x7f6e2811b140 2024-09-15T23:02:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28120c20 con 0x7f6e28109450 2024-09-15T23:02:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.143+0000 7f6e2ef39640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28120f20 con 0x7f6e28109830 2024-09-15T23:02:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.144+0000 7f6e27fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.144+0000 7f6e27fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44236/0 (socket says 172.21.15.66:44236) 2024-09-15T23:02:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.144+0000 7f6e27fff640 1 -- 172.21.15.66:0/2290957031 learned_addr learned my addr 172.21.15.66:0/2290957031 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 0x7f6e281a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e2811b140 0x7f6e281abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e27fff640 1 -- 172.21.15.66:0/2290957031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 msgr2=0x7f6e281a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 0x7f6e281a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e27fff640 1 -- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e2811b140 msgr2=0x7f6e281abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e2811b140 0x7f6e281abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.145+0000 7f6e27fff640 1 -- 172.21.15.66:0/2290957031 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e281ac180 con 0x7f6e28109830 2024-09-15T23:02:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.146+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9f0 tx=0x7f6e1800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.150+0000 7f6e25ffb640 1 -- 172.21.15.66:0/2290957031 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800cd80 con 0x7f6e28109830 2024-09-15T23:02:15.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.150+0000 7f6e25ffb640 1 -- 172.21.15.66:0/2290957031 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e18010910 con 0x7f6e28109830 2024-09-15T23:02:15.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.150+0000 7f6e25ffb640 1 -- 172.21.15.66:0/2290957031 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18018950 con 0x7f6e28109830 2024-09-15T23:02:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.158+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281ac470 con 0x7f6e28109830 2024-09-15T23:02:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.158+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281b3d50 con 0x7f6e28109830 2024-09-15T23:02:15.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.163+0000 7f6e31312740 1 Processor -- start 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 -- start start 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d639dc0 0x55a53d644140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d644680 0x55a53d646a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a53d59f2e0 con 0x55a53d644680 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a53d546ce0 con 0x55a53d6394a0 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.164+0000 7f6e31312740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a53d59b2a0 con 0x55a53d639dc0 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.165+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d639dc0 0x55a53d644140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.165+0000 7f6e2d4d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.166+0000 7f6e2d4d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55426/0 (socket says 172.21.15.66:55426) 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.166+0000 7f6e2d4d6640 1 -- 172.21.15.66:0/2405236985 learned_addr learned my addr 172.21.15.66:0/2405236985 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.166+0000 7f6e25ffb640 1 -- 172.21.15.66:0/2290957031 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6e18010ac0 con 0x7f6e28109830 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.166+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d644680 0x55a53d646a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.167+0000 7f6e25ffb640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 0x7f6e100a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e25ffb640 1 -- 172.21.15.66:0/2290957031 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f6e180d0710 con 0x7f6e28109830 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 -- 172.21.15.66:0/2405236985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d639dc0 msgr2=0x55a53d644140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d639dc0 0x55a53d644140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 -- 172.21.15.66:0/2405236985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d644680 msgr2=0x55a53d646a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d644680 0x55a53d646a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 -- 172.21.15.66:0/2405236985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53d52b440 con 0x55a53d6394a0 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.168+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 0x7f6e100a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.169+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c035040 tx=0x7f6e1c030da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47916b1599d644b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.170+0000 7f6e0effd640 1 -- 172.21.15.66:0/2405236985 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c043070 con 0x55a53d6394a0 2024-09-15T23:02:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.174+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 0x7f6e100a5a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c048000 tx=0x7f6e1c045000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.174+0000 7f6e0effd640 1 -- 172.21.15.66:0/2405236985 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c044030 con 0x55a53d6394a0 2024-09-15T23:02:15.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 -- 172.21.15.66:0/2405236985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 msgr2=0x55a53d639880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c035040 tx=0x7f6e1c030da0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 -- 172.21.15.66:0/2405236985 shutdown_connections 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d644680 0x55a53d646a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d639dc0 0x55a53d644140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 --2- 172.21.15.66:0/2405236985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d639880 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.175+0000 7f6e31312740 1 -- 172.21.15.66:0/2405236985 >> 172.21.15.66:0/2405236985 conn(0x55a53d635a30 msgr2=0x55a53d635e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.178+0000 7f6e31312740 1 -- 172.21.15.66:0/2405236985 shutdown_connections 2024-09-15T23:02:15.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.180+0000 7f6e31312740 1 -- 172.21.15.66:0/2405236985 wait complete. 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.180+0000 7f6e31312740 1 -- start start 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.180+0000 7f6e31312740 1 Processor -- start 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d6411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d644680 0x55a53d6416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a53d6472f0 con 0x55a53d639dc0 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a53d55a050 con 0x55a53d644680 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a53d647470 con 0x55a53d6394a0 2024-09-15T23:02:15.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.181+0000 7f6e31312740 10 client.0 _ll_register_callbacks cb 0x55a53d59a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:15.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.183+0000 7f6e2d4d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d644680 0x55a53d6416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.187+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.187+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44254/0 (socket says 172.21.15.66:44254) 2024-09-15T23:02:15.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.187+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/1588105689 learned_addr learned my addr 172.21.15.66:0/1588105689 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:15.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.187+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d6411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.192+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d644680 msgr2=0x55a53d6416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.192+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d644680 0x55a53d6416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.192+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/1588105689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 msgr2=0x55a53d6411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.192+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d6411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.192+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/1588105689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53d3103c0 con 0x55a53d6394a0 2024-09-15T23:02:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.197+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000fba0 tx=0x7f6e2000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ae3cdb4184b38d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.197+0000 7f6e07fff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.199+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001d060 con 0x55a53d6394a0 2024-09-15T23:02:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.199+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f6e2000d5f0 con 0x55a53d6394a0 2024-09-15T23:02:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.199+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c044030 con 0x55a53d6394a0 2024-09-15T23:02:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.201+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f6e20024050 con 0x55a53d6394a0 2024-09-15T23:02:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.202+0000 7f6e31312740 10 client.27988 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.202+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55a53d663cd0 con 0x55a53d6394a0 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.203+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e2000dcd0 con 0x55a53d6394a0 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.203+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f6e2000b040 con 0x55a53d6394a0 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 10 client.27988 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 10 client.27988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 20 client.27988 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6655d0 0x55a53d667a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 4 client.27988 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:15.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.204+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6e1c044030 con 0x55a53d6655d0 2024-09-15T23:02:15.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.207+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6655d0 0x55a53d667a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.207+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6655d0 0x55a53d667a30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edeb9549d381cb93 server_cookie=8b8d0745817f0547 in_seq=0 out_seq=0 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.208+0000 7f6e07fff640 10 client.27988 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.208+0000 7f6e07fff640 1 -- 172.21.15.66:0/1588105689 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6e1c044030 con 0x55a53d6655d0 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.208+0000 7f6e07fff640 10 client.27988 handle_command_reply: tid=0 2024-09-15T23:02:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.208+0000 7f6e31312740 1 client.27988 shutdown 2024-09-15T23:02:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.209+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 msgr2=0x55a53d643ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.209+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000fba0 tx=0x7f6e2000c740 comp rx=0 tx=0).stop 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 shutdown_connections 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6655d0 0x55a53d667a30 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d644680 0x55a53d6416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d6411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 --2- 172.21.15.66:0/1588105689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d6394a0 0x55a53d643ef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 >> 172.21.15.66:0/1588105689 conn(0x55a53d635a30 msgr2=0x55a53d634b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.211+0000 7f6e07fff640 0 client.27988 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:15.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.216+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 shutdown_connections 2024-09-15T23:02:15.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.216+0000 7f6e31312740 1 -- 172.21.15.66:0/1588105689 wait complete. 2024-09-15T23:02:15.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.216+0000 7f6e31312740 20 client.27988 trim_cache size 0 max 16384 2024-09-15T23:02:15.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.251+0000 7f6e31312740 1 Processor -- start 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.253+0000 7f6e31312740 1 -- start start 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 0x55a53d66d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 0x55a53d66d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d634370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281b5a90 con 0x55a53d6394a0 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281b78a0 con 0x55a53d639dc0 2024-09-15T23:02:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.254+0000 7f6e31312740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281b61f0 con 0x55a53d644680 2024-09-15T23:02:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.256+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 0x55a53d66d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.256+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 0x55a53d66d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39608/0 (socket says 172.21.15.66:39608) 2024-09-15T23:02:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.256+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/1084375506 learned_addr learned my addr 172.21.15.66:0/1084375506 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.258+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 0x55a53d66d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.258+0000 7f6e2d4d6640 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d634370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.262+0000 7f6e27fff640 1 -- 172.21.15.66:0/1084375506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 msgr2=0x55a53d634370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.262+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d634370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.262+0000 7f6e27fff640 1 -- 172.21.15.66:0/1084375506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 msgr2=0x55a53d66d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.262+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 0x55a53d66d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.262+0000 7f6e27fff640 1 -- 172.21.15.66:0/1084375506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53d635840 con 0x55a53d639dc0 2024-09-15T23:02:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.263+0000 7f6e27fff640 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 0x55a53d66d880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e180cd920 tx=0x7f6e180d2040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3279f72f00f69bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.268+0000 7f6e0e7fc640 1 -- 172.21.15.66:0/1084375506 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1809c4b0 con 0x55a53d639dc0 2024-09-15T23:02:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.268+0000 7f6e0e7fc640 1 -- 172.21.15.66:0/1084375506 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e180a0860 con 0x55a53d639dc0 2024-09-15T23:02:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.269+0000 7f6e31312740 1 -- 172.21.15.66:0/1084375506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 msgr2=0x55a53d66d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.269+0000 7f6e31312740 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 0x55a53d66d880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e180cd920 tx=0x7f6e180d2040 comp rx=0 tx=0).stop 2024-09-15T23:02:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.270+0000 7f6e31312740 1 -- 172.21.15.66:0/1084375506 shutdown_connections 2024-09-15T23:02:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.270+0000 7f6e31312740 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d634370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.270+0000 7f6e31312740 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d639dc0 0x55a53d66d880 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.270+0000 7f6e31312740 1 --2- 172.21.15.66:0/1084375506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d6394a0 0x55a53d66d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.270+0000 7f6e31312740 1 -- 172.21.15.66:0/1084375506 >> 172.21.15.66:0/1084375506 conn(0x55a53d635a30 msgr2=0x55a53d63fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.274+0000 7f6e31312740 1 -- 172.21.15.66:0/1084375506 shutdown_connections 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.274+0000 7f6e31312740 1 -- 172.21.15.66:0/1084375506 wait complete. 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 -- start start 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 Processor -- start 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d64ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d64cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d645340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281b7110 con 0x55a53d639dc0 2024-09-15T23:02:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281b6980 con 0x55a53d6394a0 2024-09-15T23:02:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.275+0000 7f6e31312740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28118ca0 con 0x55a53d644680 2024-09-15T23:02:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.276+0000 7f6e31312740 10 client.0 _ll_register_callbacks cb 0x7f6e20009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:15.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.279+0000 7f6e2ccd5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d64ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.279+0000 7f6e2d4d6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d645340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.279+0000 7f6e2d4d6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d645340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44268/0 (socket says 172.21.15.66:44268) 2024-09-15T23:02:15.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.279+0000 7f6e2d4d6640 1 -- 172.21.15.66:0/2271823505 learned_addr learned my addr 172.21.15.66:0/2271823505 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.284+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d64cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/2271823505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 msgr2=0x55a53d645340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d645340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/2271823505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 msgr2=0x55a53d64cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d64cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 -- 172.21.15.66:0/2271823505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53d645b70 con 0x55a53d6394a0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e2ccd5640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d64ca90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e20006010 tx=0x7f6e20005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a37e34c0d90826 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e07fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.285+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2002c070 con 0x55a53d6394a0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.286+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e180a0860 con 0x55a53d6394a0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.286+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f6e2000d800 con 0x55a53d6394a0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.286+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f6e20038050 con 0x55a53d6394a0 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.286+0000 7f6e31312740 10 client.28106 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.286+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55a53d64c460 con 0x55a53d6394a0 2024-09-15T23:02:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e180a0860 con 0x55a53d6394a0 2024-09-15T23:02:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f6e2000b040 con 0x55a53d6394a0 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 10 client.28106 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 10 client.28106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 20 client.28106 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6d0730 0x55a53d6d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 4 client.28106 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a53d5ac850 con 0x55a53d6d0730 2024-09-15T23:02:15.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.292+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6d0730 0x55a53d6d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:15.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.295+0000 7f6e27fff640 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6d0730 0x55a53d6d2b50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bead5c43d45b697 server_cookie=a113e6abbecd643 in_seq=0 out_seq=0 2024-09-15T23:02:15.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.295+0000 7f6e07fff640 10 client.28106 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:15.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.295+0000 7f6e07fff640 1 -- 172.21.15.66:0/2271823505 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a53d5ac850 con 0x55a53d6d0730 2024-09-15T23:02:15.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.295+0000 7f6e07fff640 10 client.28106 handle_command_reply: tid=0 2024-09-15T23:02:15.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.295+0000 7f6e31312740 1 client.28106 shutdown 2024-09-15T23:02:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.299+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 msgr2=0x55a53d64ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.299+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d64ca90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e20006010 tx=0x7f6e20005c20 comp rx=0 tx=0).stop 2024-09-15T23:02:15.307 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:02:15.308 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T23:02:15.308 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T23:02:15.308 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:02:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 shutdown_connections 2024-09-15T23:02:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a53d644680 0x55a53d645340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a53d639dc0 0x55a53d64cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55a53d6d0730 0x55a53d6d2b50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 --2- 172.21.15.66:0/2271823505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a53d6394a0 0x55a53d64ca90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 >> 172.21.15.66:0/2271823505 conn(0x55a53d635a30 msgr2=0x55a53d634350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e07fff640 0 client.28106 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 shutdown_connections 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.303+0000 7f6e31312740 1 -- 172.21.15.66:0/2271823505 wait complete. 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.305+0000 7f6e31312740 20 client.28106 trim_cache size 0 max 16384 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 msgr2=0x7f6e100a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 0x7f6e100a5a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c048000 tx=0x7f6e1c045000 comp rx=0 tx=0).stop 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 msgr2=0x7f6e281a7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9f0 tx=0x7f6e1800eeb0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 shutdown_connections 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6e100a3580 0x7f6e100a5a40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e2811b140 0x7f6e281abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e28109830 0x7f6e281a7710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 --2- 172.21.15.66:0/2290957031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e28109450 0x7f6e281a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 >> 172.21.15.66:0/2290957031 conn(0x7f6e2806e140 msgr2=0x7f6e2811c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.306+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 shutdown_connections 2024-09-15T23:02:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:15.308+0000 7f6e2ef39640 1 -- 172.21.15.66:0/2290957031 wait complete. 2024-09-15T23:02:15.474 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:15 smithi184 ceph-mon[35203]: pgmap v532: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 83 op/s 2024-09-15T23:02:15.506 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:15 smithi066 ceph-mon[31185]: pgmap v532: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 83 op/s 2024-09-15T23:02:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:15 smithi087 ceph-mon[35290]: pgmap v532: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 83 op/s 2024-09-15T23:02:16.209 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:02:16.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:02:16.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.492+0000 7fa553bef640 1 -- 172.21.15.66:0/1219692604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109450 msgr2=0x7fa54c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.492+0000 7fa553bef640 1 --2- 172.21.15.66:0/1219692604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109450 0x7fa54c110250 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa544009ca0 tx=0x7fa54402a8f0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.493+0000 7fa553bef640 1 -- 172.21.15.66:0/1219692604 shutdown_connections 2024-09-15T23:02:16.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.493+0000 7fa553bef640 1 --2- 172.21.15.66:0/1219692604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c11b140 0x7fa54c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.493+0000 7fa553bef640 1 --2- 172.21.15.66:0/1219692604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c109830 0x7fa54c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.493+0000 7fa553bef640 1 --2- 172.21.15.66:0/1219692604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109450 0x7fa54c110250 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.493+0000 7fa553bef640 1 -- 172.21.15.66:0/1219692604 >> 172.21.15.66:0/1219692604 conn(0x7fa54c06e140 msgr2=0x7fa54c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:16.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.494+0000 7fa553bef640 1 -- 172.21.15.66:0/1219692604 shutdown_connections 2024-09-15T23:02:16.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.503+0000 7fa553bef640 1 -- 172.21.15.66:0/1219692604 wait complete. 2024-09-15T23:02:16.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.503+0000 7fa553bef640 1 Processor -- start 2024-09-15T23:02:16.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 -- start start 2024-09-15T23:02:16.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 0x7fa54c1a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109830 0x7fa54c1a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 0x7fa54c1abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c120e10 con 0x7fa54c11b140 2024-09-15T23:02:16.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c120c90 con 0x7fa54c109450 2024-09-15T23:02:16.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.504+0000 7fa553bef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c120f90 con 0x7fa54c109830 2024-09-15T23:02:16.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.505+0000 7fa55198b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 0x7fa54c1a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.505+0000 7fa55198b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 0x7fa54c1a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55480/0 (socket says 172.21.15.66:55480) 2024-09-15T23:02:16.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.505+0000 7fa55198b640 1 -- 172.21.15.66:0/3104927559 learned_addr learned my addr 172.21.15.66:0/3104927559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:16.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.505+0000 7fa55118a640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109830 0x7fa54c1a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.507+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 0x7fa54c1abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.509+0000 7fa55218c640 1 -- 172.21.15.66:0/3104927559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109830 msgr2=0x7fa54c1a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.509+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109830 0x7fa54c1a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.509+0000 7fa55218c640 1 -- 172.21.15.66:0/3104927559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 msgr2=0x7fa54c1a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.509+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 0x7fa54c1a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.509+0000 7fa55218c640 1 -- 172.21.15.66:0/3104927559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c1ac200 con 0x7fa54c11b140 2024-09-15T23:02:16.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.513+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 0x7fa54c1abb00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c410 tx=0x7fa53c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.514+0000 7fa542ffd640 1 -- 172.21.15.66:0/3104927559 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c004020 con 0x7fa54c11b140 2024-09-15T23:02:16.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.514+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c1ac4f0 con 0x7fa54c11b140 2024-09-15T23:02:16.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.514+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54c110920 con 0x7fa54c11b140 2024-09-15T23:02:16.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.514+0000 7fa542ffd640 1 -- 172.21.15.66:0/3104927559 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa53c0041c0 con 0x7fa54c11b140 2024-09-15T23:02:16.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.514+0000 7fa542ffd640 1 -- 172.21.15.66:0/3104927559 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c011aa0 con 0x7fa54c11b140 2024-09-15T23:02:16.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.524+0000 7fa555fc8740 1 Processor -- start 2024-09-15T23:02:16.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.528+0000 7fa542ffd640 1 -- 172.21.15.66:0/3104927559 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa53c019020 con 0x7fa54c11b140 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.531+0000 7fa555fc8740 1 -- start start 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c947440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c954630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559f0c8ac620 con 0x559f0c952240 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559f0c853e50 con 0x559f0c947060 2024-09-15T23:02:16.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa555fc8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559f0c8a85e0 con 0x559f0c947980 2024-09-15T23:02:16.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.532+0000 7fa542ffd640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 0x7fa5380a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.533+0000 7fa542ffd640 1 -- 172.21.15.66:0/3104927559 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa53c0cf200 con 0x7fa54c11b140 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.537+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 0x7fa5380a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55218c640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 0x7fa5380a5a80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0a3ce0 tx=0x7fa53c000f70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55198b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55198b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44290/0 (socket says 172.21.15.66:44290) 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55198b640 1 -- 172.21.15.66:0/2271552353 learned_addr learned my addr 172.21.15.66:0/2271552353 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55118a640 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c947440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.538+0000 7fa55118a640 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c954630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.539+0000 7fa55198b640 1 -- 172.21.15.66:0/2271552353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 msgr2=0x559f0c947440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.539+0000 7fa55198b640 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c947440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.540+0000 7fa55198b640 1 -- 172.21.15.66:0/2271552353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 msgr2=0x559f0c954630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.540+0000 7fa55198b640 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c954630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.540+0000 7fa55198b640 1 -- 172.21.15.66:0/2271552353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c844d40 con 0x559f0c947980 2024-09-15T23:02:16.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.541+0000 7fa55198b640 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa544006010 tx=0x7fa544009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18db1570cb4d60d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.542+0000 7fa537fff640 1 -- 172.21.15.66:0/2271552353 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544031c60 con 0x559f0c947980 2024-09-15T23:02:16.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.542+0000 7fa537fff640 1 -- 172.21.15.66:0/2271552353 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa544036040 con 0x559f0c947980 2024-09-15T23:02:16.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.543+0000 7fa555fc8740 1 -- 172.21.15.66:0/2271552353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 msgr2=0x559f0c951d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.543+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa544006010 tx=0x7fa544009900 comp rx=0 tx=0).stop 2024-09-15T23:02:16.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.545+0000 7fa555fc8740 1 -- 172.21.15.66:0/2271552353 shutdown_connections 2024-09-15T23:02:16.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.545+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c954630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.545+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c951d00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.545+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2271552353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c947440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.545+0000 7fa555fc8740 1 -- 172.21.15.66:0/2271552353 >> 172.21.15.66:0/2271552353 conn(0x559f0c9435f0 msgr2=0x559f0c9439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:16.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.548+0000 7fa555fc8740 1 -- 172.21.15.66:0/2271552353 shutdown_connections 2024-09-15T23:02:16.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.550+0000 7fa555fc8740 1 -- 172.21.15.66:0/2271552353 wait complete. 2024-09-15T23:02:16.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.551+0000 7fa555fc8740 1 -- start start 2024-09-15T23:02:16.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.551+0000 7fa555fc8740 1 Processor -- start 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c951c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c952240 0x559f0c94f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559f0c954e50 con 0x559f0c947980 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559f0c834f10 con 0x559f0c947060 2024-09-15T23:02:16.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559f0c954fd0 con 0x559f0c952240 2024-09-15T23:02:16.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.554+0000 7fa555fc8740 10 client.0 _ll_register_callbacks cb 0x559f0c858db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:16.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.562+0000 7fa55198b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.563+0000 7fa55198b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39650/0 (socket says 172.21.15.66:39650) 2024-09-15T23:02:16.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.563+0000 7fa55198b640 1 -- 172.21.15.66:0/2801682084 learned_addr learned my addr 172.21.15.66:0/2801682084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:16.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.563+0000 7fa55118a640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c951c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.563+0000 7fa55118a640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c952240 0x559f0c94f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.576+0000 7fa55198b640 1 -- 172.21.15.66:0/2801682084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c952240 msgr2=0x559f0c94f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.576+0000 7fa55198b640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c952240 0x559f0c94f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.576+0000 7fa55198b640 1 -- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 msgr2=0x559f0c951c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.576+0000 7fa55198b640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c951c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.576+0000 7fa55198b640 1 -- 172.21.15.66:0/2801682084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f0c5bb580 con 0x559f0c947980 2024-09-15T23:02:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.583+0000 7fa55198b640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa544009970 tx=0x7fa544003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b85a91c7a2d27ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.583+0000 7fa5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.587+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544031c60 con 0x559f0c947980 2024-09-15T23:02:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.587+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa544041040 con 0x559f0c947980 2024-09-15T23:02:16.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.588+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa544036040 con 0x559f0c947980 2024-09-15T23:02:16.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.588+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fa544031690 con 0x559f0c947980 2024-09-15T23:02:16.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.588+0000 7fa555fc8740 10 client.18843 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:16.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.588+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x559f0c685960 con 0x559f0c947980 2024-09-15T23:02:16.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa544036040 con 0x559f0c947980 2024-09-15T23:02:16.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fa54402fbb0 con 0x559f0c947980 2024-09-15T23:02:16.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa555fc8740 10 client.18843 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa555fc8740 10 client.18843 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa555fc8740 20 client.18843 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.589+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c961cb0 0x559f0c964150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.590+0000 7fa555fc8740 4 client.18843 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.590+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f0c8b9b90 con 0x559f0c961cb0 2024-09-15T23:02:16.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.590+0000 7fa55118a640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c961cb0 0x559f0c964150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.591+0000 7fa5357fa640 10 client.18843 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.591+0000 7fa55118a640 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c961cb0 0x559f0c964150 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c564eb6433a391df server_cookie=24a62dc1a173e753 in_seq=0 out_seq=0 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.595+0000 7fa5357fa640 1 -- 172.21.15.66:0/2801682084 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f0c8b9b90 con 0x559f0c961cb0 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.595+0000 7fa5357fa640 10 client.18843 handle_command_reply: tid=0 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.595+0000 7fa555fc8740 1 client.18843 shutdown 2024-09-15T23:02:16.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.595+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 msgr2=0x559f0c94ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.595+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa544009970 tx=0x7fa544003e40 comp rx=0 tx=0).stop 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 shutdown_connections 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c952240 0x559f0c94f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c947980 0x559f0c94ef30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c961cb0 0x559f0c964150 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2801682084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c951c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.596+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 >> 172.21.15.66:0/2801682084 conn(0x559f0c9435f0 msgr2=0x559f0c9492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.597+0000 7fa5357fa640 0 client.18843 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.597+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 shutdown_connections 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.597+0000 7fa555fc8740 1 -- 172.21.15.66:0/2801682084 wait complete. 2024-09-15T23:02:16.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.597+0000 7fa555fc8740 20 client.18843 trim_cache size 0 max 16384 2024-09-15T23:02:16.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.631+0000 7fa555fc8740 1 Processor -- start 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa555fc8740 1 -- start start 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c969a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c969f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa55118a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.632+0000 7fa55118a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55508/0 (socket says 172.21.15.66:55508) 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 -- 172.21.15.66:0/2700807511 learned_addr learned my addr 172.21.15.66:0/2700807511 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa530010280 con 0x559f0c952240 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa530012090 con 0x559f0c947060 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5300109e0 con 0x559f0c947980 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c969f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 -- 172.21.15.66:0/2700807511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 msgr2=0x559f0c969a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:02:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c969a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 -- 172.21.15.66:0/2700807511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 msgr2=0x559f0c969f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c969f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.633+0000 7fa55118a640 1 -- 172.21.15.66:0/2700807511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c94fa30 con 0x559f0c947060 2024-09-15T23:02:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.637+0000 7fa55118a640 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ba0 tx=0x7fa548004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8756474b456e530b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.638+0000 7fa5377fe640 1 -- 172.21.15.66:0/2700807511 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480130d0 con 0x559f0c947060 2024-09-15T23:02:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.638+0000 7fa5377fe640 1 -- 172.21.15.66:0/2700807511 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa548026040 con 0x559f0c947060 2024-09-15T23:02:16.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 msgr2=0x559f0c942640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ba0 tx=0x7fa548004730 comp rx=0 tx=0).stop 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 shutdown_connections 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c952240 0x559f0c969f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c969a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 --2- 172.21.15.66:0/2700807511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c947060 0x559f0c942640 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.639+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 >> 172.21.15.66:0/2700807511 conn(0x559f0c9435f0 msgr2=0x559f0c941f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.644+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 shutdown_connections 2024-09-15T23:02:16.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.644+0000 7fa555fc8740 1 -- 172.21.15.66:0/2700807511 wait complete. 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.644+0000 7fa555fc8740 1 -- start start 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.644+0000 7fa555fc8740 1 Processor -- start 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 0x559f0c95aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c94b1a0 0x559f0c94b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa530011900 con 0x559f0c94b1a0 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa530011170 con 0x559f0c952240 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa53000e280 con 0x559f0c947980 2024-09-15T23:02:16.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.645+0000 7fa555fc8740 10 client.0 _ll_register_callbacks cb 0x7fa544004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44310/0 (socket says 172.21.15.66:44310) 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 -- 172.21.15.66:0/53064542 learned_addr learned my addr 172.21.15.66:0/53064542 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55198b640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 0x559f0c95aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 -- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 msgr2=0x559f0c95aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 0x559f0c95aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 -- 172.21.15.66:0/53064542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c94b1a0 msgr2=0x559f0c94b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c94b1a0 0x559f0c94b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.646+0000 7fa55118a640 1 -- 172.21.15.66:0/53064542 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f0c94be50 con 0x559f0c947980 2024-09-15T23:02:16.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa55198b640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 0x559f0c95aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa55118a640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa548010620 tx=0x7fa5480044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d399ad444e198cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480039f0 con 0x559f0c947980 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa548003b90 con 0x559f0c947980 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.647+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f0c8b40a0 con 0x559f0c947980 2024-09-15T23:02:16.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.648+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fa548003d90 con 0x559f0c947980 2024-09-15T23:02:16.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.650+0000 7fa555fc8740 10 client.28009 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:16.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.650+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x559f0c9cda00 con 0x559f0c947980 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.656+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559f0c8b40a0 con 0x559f0c947980 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.656+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fa548011610 con 0x559f0c947980 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 10 client.28009 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 10 client.28009 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 20 client.28009 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c9cdfb0 0x559f0c9d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 4 client.28009 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "86b9ec12", "release": true, "await": true}] 2024-09-15T23:02:16.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.660+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "86b9ec12", "release": true, "await": true}) -- 0x559f0c8305a0 con 0x559f0c9cdfb0 2024-09-15T23:02:16.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.663+0000 7fa55198b640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c9cdfb0 0x559f0c9d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:16.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.675+0000 7fa55198b640 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c9cdfb0 0x559f0c9d03d0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d34b59aea2b2f6a server_cookie=7956313fae1fc135 in_seq=0 out_seq=0 2024-09-15T23:02:16.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:16.675+0000 7fa5357fa640 10 client.28009 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:16.765 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.402+0000 7fa56633f640 1 -- 172.21.15.66:0/2469404199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 msgr2=0x7fa560106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.402+0000 7fa56633f640 1 --2- 172.21.15.66:0/2469404199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa560106e60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa550009900 tx=0x7fa55002a440 comp rx=0 tx=0).stop 2024-09-15T23:02:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.403+0000 7fa56633f640 1 -- 172.21.15.66:0/2469404199 shutdown_connections 2024-09-15T23:02:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.403+0000 7fa56633f640 1 --2- 172.21.15.66:0/2469404199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560101420 0x7fa56010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.403+0000 7fa56633f640 1 --2- 172.21.15.66:0/2469404199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa560100a80 0x7fa560100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.403+0000 7fa56633f640 1 --2- 172.21.15.66:0/2469404199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa560106e60 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.403+0000 7fa56633f640 1 -- 172.21.15.66:0/2469404199 >> 172.21.15.66:0/2469404199 conn(0x7fa5600fc7a0 msgr2=0x7fa5600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:17.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.407+0000 7fa56633f640 1 -- 172.21.15.66:0/2469404199 shutdown_connections 2024-09-15T23:02:17.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.408+0000 7fa56633f640 1 -- 172.21.15.66:0/2469404199 wait complete. 2024-09-15T23:02:17.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.409+0000 7fa56633f640 1 Processor -- start 2024-09-15T23:02:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 -- start start 2024-09-15T23:02:17.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa560100a80 0x7fa56010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:17.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560101420 0x7fa56010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:17.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:17.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa560112020 con 0x7fa560106a80 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa560111ea0 con 0x7fa560101420 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.410+0000 7fa56633f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601121a0 con 0x7fa560100a80 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.411+0000 7fa5648dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.411+0000 7fa5648dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39692/0 (socket says 172.21.15.66:39692) 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.411+0000 7fa5648dc640 1 -- 172.21.15.66:0/1495720749 learned_addr learned my addr 172.21.15.66:0/1495720749 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 -- 172.21.15.66:0/1495720749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa560100a80 msgr2=0x7fa56010e010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa560100a80 0x7fa56010e010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 -- 172.21.15.66:0/1495720749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560101420 msgr2=0x7fa56010e550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560101420 0x7fa56010e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 -- 172.21.15.66:0/1495720749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa560072c10 con 0x7fa560106a80 2024-09-15T23:02:17.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.412+0000 7fa5648dc640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa55800b970 tx=0x7fa55800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:17.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.413+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558019070 con 0x7fa560106a80 2024-09-15T23:02:17.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.413+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa560072f00 con 0x7fa560106a80 2024-09-15T23:02:17.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.413+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa560073440 con 0x7fa560106a80 2024-09-15T23:02:17.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.413+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa55800cb40 con 0x7fa560106a80 2024-09-15T23:02:17.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.414+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580076c0 con 0x7fa560106a80 2024-09-15T23:02:17.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.415+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa548005290 con 0x7fa560106a80 2024-09-15T23:02:17.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.422+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa55801c070 con 0x7fa560106a80 2024-09-15T23:02:17.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.423+0000 7fa55d7fa640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 0x7fa5440a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:17.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.423+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa5580cf610 con 0x7fa560106a80 2024-09-15T23:02:17.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.425+0000 7fa55ffff640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 0x7fa5440a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:17.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.427+0000 7fa55ffff640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 0x7fa5440a5a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa550033040 tx=0x7fa550005fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:17.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.438+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa55809bbc0 con 0x7fa560106a80 2024-09-15T23:02:17.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.556+0000 7fa5357fa640 1 -- 172.21.15.66:0/53064542 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559f0c8305a0 con 0x559f0c9cdfb0 2024-09-15T23:02:17.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.556+0000 7fa5357fa640 10 client.28009 handle_command_reply: tid=0 2024-09-15T23:02:17.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.556+0000 7fa555fc8740 1 client.28009 shutdown 2024-09-15T23:02:17.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.556+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 msgr2=0x559f0c95a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.556+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa548010620 tx=0x7fa5480044f0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.558 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:17 smithi066 ceph-mon[31185]: pgmap v533: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 75 op/s 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 64, 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 60, 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "86b9ec12": { 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 60, 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:02:17.559 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 137.7, 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:17.560 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 shutdown_connections 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559f0c94b1a0 0x559f0c94b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559f0c9cdfb0 0x559f0c9d03d0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f0c952240 0x559f0c95aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 --2- 172.21.15.66:0/53064542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f0c947980 0x559f0c95a4e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 >> 172.21.15.66:0/53064542 conn(0x559f0c9435f0 msgr2=0x559f0c942750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa5357fa640 0 client.28009 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 shutdown_connections 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 1 -- 172.21.15.66:0/53064542 wait complete. 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.557+0000 7fa555fc8740 20 client.28009 trim_cache size 0 max 16384 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 msgr2=0x7fa5380a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 0x7fa5380a5a80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0a3ce0 tx=0x7fa53c000f70 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 msgr2=0x7fa54c1abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 0x7fa54c1abb00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c410 tx=0x7fa53c00c8d0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 shutdown_connections 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5380a35c0 0x7fa5380a5a80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c11b140 0x7fa54c1abb00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa54c109830 0x7fa54c1a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 --2- 172.21.15.66:0/3104927559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa54c109450 0x7fa54c1a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 >> 172.21.15.66:0/3104927559 conn(0x7fa54c06e140 msgr2=0x7fa54c11bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:17.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 shutdown_connections 2024-09-15T23:02:17.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.558+0000 7fa553bef640 1 -- 172.21.15.66:0/3104927559 wait complete. 2024-09-15T23:02:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:17 smithi087 ceph-mon[35290]: pgmap v533: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 75 op/s 2024-09-15T23:02:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:17 smithi184 ceph-mon[35203]: pgmap v533: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 75 op/s 2024-09-15T23:02:17.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.869+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa548005850 con 0x7fa560106a80 2024-09-15T23:02:17.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.877+0000 7fa55d7fa640 1 -- 172.21.15.66:0/1495720749 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+12007 (secure 0 0 0) 0x7fa55809b4c0 con 0x7fa560106a80 2024-09-15T23:02:17.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:02:17.883 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":64,"btime":"2024-09-15T23:01:48:107397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:01:47.557315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:02:17.883 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 64 2024-09-15T23:02:17.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.886+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 msgr2=0x7fa5440a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.886+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 0x7fa5440a5a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa550033040 tx=0x7fa550005fd0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.886+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 msgr2=0x7fa56010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:17.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.886+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa55800b970 tx=0x7fa55800be30 comp rx=0 tx=0).stop 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 shutdown_connections 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa5440a35c0 0x7fa5440a5a80 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa550033040 tx=0x7fa550005fd0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa560106a80 0x7fa56010ea90 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa560101420 0x7fa56010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 --2- 172.21.15.66:0/1495720749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa560100a80 0x7fa56010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:17.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.891+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 >> 172.21.15.66:0/1495720749 conn(0x7fa5600fc7a0 msgr2=0x7fa5600fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:17.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.897+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 shutdown_connections 2024-09-15T23:02:17.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:17.898+0000 7fa56633f640 1 -- 172.21.15.66:0/1495720749 wait complete. 2024-09-15T23:02:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1495720749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:18.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1495720749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:18.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1495720749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:02:19.213 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T23:02:19.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:19 smithi066 ceph-mon[31185]: pgmap v534: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 70 op/s 2024-09-15T23:02:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:19 smithi087 ceph-mon[35290]: pgmap v534: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 70 op/s 2024-09-15T23:02:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:19 smithi184 ceph-mon[35203]: pgmap v534: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 70 op/s 2024-09-15T23:02:19.854 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '86b9ec12', total seconds elapsed: 30.7 2024-09-15T23:02:20.052 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:20.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.713+0000 7f6562830640 1 -- 172.21.15.66:0/4172782453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109e00 msgr2=0x7f655c10e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.713+0000 7f6562830640 1 --2- 172.21.15.66:0/4172782453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109e00 0x7f655c10e350 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6550008570 tx=0x7f655002a1d0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.718+0000 7f6562830640 1 -- 172.21.15.66:0/4172782453 shutdown_connections 2024-09-15T23:02:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.718+0000 7f6562830640 1 --2- 172.21.15.66:0/4172782453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f655c10ea80 0x7f655c1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.718+0000 7f6562830640 1 --2- 172.21.15.66:0/4172782453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109e00 0x7f655c10e350 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.718+0000 7f6562830640 1 --2- 172.21.15.66:0/4172782453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c109450 0x7f655c109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.718+0000 7f6562830640 1 -- 172.21.15.66:0/4172782453 >> 172.21.15.66:0/4172782453 conn(0x7f655c06e2d0 msgr2=0x7f655c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.720+0000 7f6562830640 1 -- 172.21.15.66:0/4172782453 shutdown_connections 2024-09-15T23:02:20.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.723+0000 7f6562830640 1 -- 172.21.15.66:0/4172782453 wait complete. 2024-09-15T23:02:20.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.723+0000 7f6562830640 1 Processor -- start 2024-09-15T23:02:20.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 -- start start 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109450 0x7f655c1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f655c109e00 0x7f655c1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1185f0 con 0x7f655c10ea80 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f655c118470 con 0x7f655c109e00 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.724+0000 7f6562830640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f655c118770 con 0x7f655c109450 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39708/0 (socket says 172.21.15.66:39708) 2024-09-15T23:02:20.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 -- 172.21.15.66:0/1947323446 learned_addr learned my addr 172.21.15.66:0/1947323446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 -- 172.21.15.66:0/1947323446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109450 msgr2=0x7f655c1a4740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109450 0x7f655c1a4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 -- 172.21.15.66:0/1947323446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f655c109e00 msgr2=0x7f655c1a4c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f655c109e00 0x7f655c1a4c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 -- 172.21.15.66:0/1947323446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c19f030 con 0x7f655c10ea80 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.725+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f655400b970 tx=0x7f655400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.726+0000 7f65597fa640 1 -- 172.21.15.66:0/1947323446 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554019070 con 0x7f655c10ea80 2024-09-15T23:02:20.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.726+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c19f320 con 0x7f655c10ea80 2024-09-15T23:02:20.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.726+0000 7f65597fa640 1 -- 172.21.15.66:0/1947323446 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655400cb40 con 0x7f655c10ea80 2024-09-15T23:02:20.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.726+0000 7f65597fa640 1 -- 172.21.15.66:0/1947323446 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540076a0 con 0x7f655c10ea80 2024-09-15T23:02:20.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.726+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c1bc620 con 0x7f655c10ea80 2024-09-15T23:02:20.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.734+0000 7f65597fa640 1 -- 172.21.15.66:0/1947323446 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f655401c070 con 0x7f655c10ea80 2024-09-15T23:02:20.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.738+0000 7f6564c09740 1 Processor -- start 2024-09-15T23:02:20.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.739+0000 7f65597fa640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 0x7f65440a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.739+0000 7f65597fa640 1 -- 172.21.15.66:0/1947323446 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f65540cf660 con 0x7f655c10ea80 2024-09-15T23:02:20.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 -- start start 2024-09-15T23:02:20.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f655b7fe640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 0x7f65440a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2edb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2edba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acf2e412f0 con 0x55acf2edb5d0 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55acf2de8cf0 con 0x55acf2edcb40 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.740+0000 7f6564c09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55acf2e3d2b0 con 0x55acf2ee6370 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44354/0 (socket says 172.21.15.66:44354) 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 -- 172.21.15.66:0/2207070398 learned_addr learned my addr 172.21.15.66:0/2207070398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f655b7fe640 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2edba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 -- 172.21.15.66:0/2207070398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 msgr2=0x55acf2edb090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2edb090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 -- 172.21.15.66:0/2207070398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 msgr2=0x55acf2edba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2edba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f6560dcd640 1 -- 172.21.15.66:0/2207070398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf2dcd3a0 con 0x55acf2ee6370 2024-09-15T23:02:20.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.741+0000 7f655b7fe640 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2edba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:02:20.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.744+0000 7f6560dcd640 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f65540a3c50 tx=0x7f6554097170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d1a8e1780783e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.745+0000 7f65427fc640 1 -- 172.21.15.66:0/2207070398 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540a4180 con 0x55acf2ee6370 2024-09-15T23:02:20.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.745+0000 7f65427fc640 1 -- 172.21.15.66:0/2207070398 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655400ccf0 con 0x55acf2ee6370 2024-09-15T23:02:20.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.745+0000 7f65427fc640 1 -- 172.21.15.66:0/2207070398 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540a3cf0 con 0x55acf2ee6370 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 -- 172.21.15.66:0/2207070398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 msgr2=0x55acf2ee8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f65540a3c50 tx=0x7f6554097170 comp rx=0 tx=0).stop 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f655b7fe640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 0x7f65440a59b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f655002a6f0 tx=0x7f6550000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 -- 172.21.15.66:0/2207070398 shutdown_connections 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2ee8760 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2edba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 --2- 172.21.15.66:0/2207070398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2edb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.748+0000 7f6564c09740 1 -- 172.21.15.66:0/2207070398 >> 172.21.15.66:0/2207070398 conn(0x55acf2ea4310 msgr2=0x55acf2ed7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.750+0000 7f6564c09740 1 -- 172.21.15.66:0/2207070398 shutdown_connections 2024-09-15T23:02:20.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.754+0000 7f6564c09740 1 -- 172.21.15.66:0/2207070398 wait complete. 2024-09-15T23:02:20.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.754+0000 7f6564c09740 1 -- start start 2024-09-15T23:02:20.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.755+0000 7f6564c09740 1 Processor -- start 2024-09-15T23:02:20.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.755+0000 7f6564c09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 0x55acf2ee5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6564c09740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2ee2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6564c09740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f655bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 0x55acf2ee5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f655bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 0x55acf2ee5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44356/0 (socket says 172.21.15.66:44356) 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f655b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2ee2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f655b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2ee2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55550/0 (socket says 172.21.15.66:55550) 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6564c09740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acf2ee9070 con 0x55acf2ee6370 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f655bfff640 1 -- 172.21.15.66:0/1881736143 learned_addr learned my addr 172.21.15.66:0/1881736143 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55acf2dfc060 con 0x55acf2edcb40 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.756+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55acf2ee91f0 con 0x55acf2edb5d0 2024-09-15T23:02:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.757+0000 7f6564c09740 10 client.0 _ll_register_callbacks cb 0x55acf2b4f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:20.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 -- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 msgr2=0x55acf2ee5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:20.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 0x55acf2ee5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 -- 172.21.15.66:0/1881736143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 msgr2=0x55acf2ee2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:20.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2ee2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf2bb23c0 con 0x55acf2ee6370 2024-09-15T23:02:20.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee3570 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f65540997c0 tx=0x7f655409b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dcdd3b0d0e81b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.758+0000 7f653b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:20.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.760+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554014bc0 con 0x55acf2ee6370 2024-09-15T23:02:20.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.760+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f655400ccf0 con 0x55acf2ee6370 2024-09-15T23:02:20.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.760+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f65540a3cf0 con 0x55acf2ee6370 2024-09-15T23:02:20.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.763+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f65540a3f30 con 0x55acf2ee6370 2024-09-15T23:02:20.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.763+0000 7f6564c09740 10 client.18861 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:20.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.763+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55acf2ee9070 con 0x55acf2ee6370 2024-09-15T23:02:20.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.767+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655400ccf0 con 0x55acf2ee6370 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f655409a3d0 con 0x55acf2ee6370 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 10 client.18861 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 10 client.18861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 20 client.18861 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2ef5f40 0x55acf2ef8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 4 client.18861 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:20.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.768+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acf2e4e860 con 0x55acf2ef5f40 2024-09-15T23:02:20.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.772+0000 7f655bfff640 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2ef5f40 0x55acf2ef8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.775+0000 7f653b7fe640 10 client.18861 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:02:20.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.775+0000 7f655bfff640 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2ef5f40 0x55acf2ef8380 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c3b6d2dda0c3a5c5 server_cookie=1952ce95b1a6d4fd in_seq=0 out_seq=0 2024-09-15T23:02:20.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.776+0000 7f653b7fe640 1 -- 172.21.15.66:0/1881736143 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acf2e4e860 con 0x55acf2ef5f40 2024-09-15T23:02:20.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.776+0000 7f653b7fe640 10 client.18861 handle_command_reply: tid=0 2024-09-15T23:02:20.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.776+0000 7f6564c09740 1 client.18861 shutdown 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 msgr2=0x55acf2ee3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee3570 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f65540997c0 tx=0x7f655409b690 comp rx=0 tx=0).stop 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 shutdown_connections 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2ef5f40 0x55acf2ef8380 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee3570 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2ee2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 --2- 172.21.15.66:0/1881736143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edb5d0 0x55acf2ee5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 >> 172.21.15.66:0/1881736143 conn(0x55acf2ea4310 msgr2=0x55acf2edd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.781+0000 7f653b7fe640 0 client.18861 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:02:20.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.782+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 shutdown_connections 2024-09-15T23:02:20.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.784+0000 7f6564c09740 1 -- 172.21.15.66:0/1881736143 wait complete. 2024-09-15T23:02:20.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.784+0000 7f6564c09740 20 client.18861 trim_cache size 0 max 16384 2024-09-15T23:02:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.811+0000 7f6564c09740 1 Processor -- start 2024-09-15T23:02:20.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.818+0000 7f6564c09740 1 -- start start 2024-09-15T23:02:20.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.818+0000 7f6564c09740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2ef23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.818+0000 7f6564c09740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2efdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.819+0000 7f6564c09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2efe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.819+0000 7f6564c09740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f65480102c0 con 0x55acf2edb5d0 2024-09-15T23:02:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.819+0000 7f6564c09740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65480120d0 con 0x55acf2edcb40 2024-09-15T23:02:20.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.819+0000 7f6564c09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6548010a20 con 0x55acf2ee6370 2024-09-15T23:02:20.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.820+0000 7f655b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2efdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.821+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2efe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.821+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2efe190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44370/0 (socket says 172.21.15.66:44370) 2024-09-15T23:02:20.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.821+0000 7f6560dcd640 1 -- 172.21.15.66:0/2375854526 learned_addr learned my addr 172.21.15.66:0/2375854526 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:20.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.824+0000 7f655bfff640 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2ef23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.826+0000 7f655b7fe640 1 -- 172.21.15.66:0/2375854526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 msgr2=0x55acf2efe190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:20.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.826+0000 7f655b7fe640 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2efe190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.826+0000 7f655b7fe640 1 -- 172.21.15.66:0/2375854526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 msgr2=0x55acf2ef23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:20.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.826+0000 7f655b7fe640 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2ef23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.826+0000 7f655b7fe640 1 -- 172.21.15.66:0/2375854526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf2ed8730 con 0x55acf2edcb40 2024-09-15T23:02:20.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.829+0000 7f655b7fe640 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2efdc50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f655c0733a0 tx=0x7f655003c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703bfae7a2bcb8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.829+0000 7f6541ffb640 1 -- 172.21.15.66:0/2375854526 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655004f070 con 0x55acf2edcb40 2024-09-15T23:02:20.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.829+0000 7f6541ffb640 1 -- 172.21.15.66:0/2375854526 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6550038040 con 0x55acf2edcb40 2024-09-15T23:02:20.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.829+0000 7f6541ffb640 1 -- 172.21.15.66:0/2375854526 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655003ecb0 con 0x55acf2edcb40 2024-09-15T23:02:20.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.830+0000 7f6564c09740 1 -- 172.21.15.66:0/2375854526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 msgr2=0x55acf2efdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.830+0000 7f6564c09740 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2efdc50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f655c0733a0 tx=0x7f655003c000 comp rx=0 tx=0).stop 2024-09-15T23:02:20.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.831+0000 7f6564c09740 1 -- 172.21.15.66:0/2375854526 shutdown_connections 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.831+0000 7f6564c09740 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2ee6370 0x55acf2efe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.831+0000 7f6564c09740 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edcb40 0x55acf2efdc50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.831+0000 7f6564c09740 1 --2- 172.21.15.66:0/2375854526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2edb5d0 0x55acf2ef23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.831+0000 7f6564c09740 1 -- 172.21.15.66:0/2375854526 >> 172.21.15.66:0/2375854526 conn(0x55acf2ea4310 msgr2=0x55acf2ee5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.833+0000 7f6564c09740 1 -- 172.21.15.66:0/2375854526 shutdown_connections 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.833+0000 7f6564c09740 1 -- 172.21.15.66:0/2375854526 wait complete. 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.833+0000 7f6564c09740 1 -- start start 2024-09-15T23:02:20.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.833+0000 7f6564c09740 1 Processor -- start 2024-09-15T23:02:20.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.834+0000 7f6564c09740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edb5d0 0x55acf2eee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.834+0000 7f6564c09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edcb40 0x55acf2eeed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.834+0000 7f6564c09740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6564c09740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6548011940 con 0x55acf2ee6370 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6564c09740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65480111b0 con 0x55acf2edb5d0 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6564c09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f654800e2c0 con 0x55acf2edcb40 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6564c09740 10 client.0 _ll_register_callbacks cb 0x7f655409ae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6560dcd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39740/0 (socket says 172.21.15.66:39740) 2024-09-15T23:02:20.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.835+0000 7f6560dcd640 1 -- 172.21.15.66:0/1247361819 learned_addr learned my addr 172.21.15.66:0/1247361819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.836+0000 7f6560dcd640 1 -- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edcb40 msgr2=0x55acf2eeed10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.836+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edcb40 0x55acf2eeed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.836+0000 7f6560dcd640 1 -- 172.21.15.66:0/1247361819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edb5d0 msgr2=0x55acf2eee7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.836+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edb5d0 0x55acf2eee7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.836+0000 7f6560dcd640 1 -- 172.21.15.66:0/1247361819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf2eea3c0 con 0x55acf2ee6370 2024-09-15T23:02:20.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.845+0000 7f6560dcd640 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f655400b940 tx=0x7f6554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9617e5ea9d91dac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:20.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.845+0000 7f653b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.850+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65540b3060 con 0x55acf2ee6370 2024-09-15T23:02:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.850+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f655409a3d0 con 0x55acf2ee6370 2024-09-15T23:02:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.850+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6550038040 con 0x55acf2ee6370 2024-09-15T23:02:20.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.854+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f6554014bc0 con 0x55acf2ee6370 2024-09-15T23:02:20.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.855+0000 7f6564c09740 10 client.18867 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:20.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.855+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55acf2f60780 con 0x55acf2ee6370 2024-09-15T23:02:20.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.855+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6550038040 con 0x55acf2ee6370 2024-09-15T23:02:20.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.856+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f65540cf160 con 0x55acf2ee6370 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.856+0000 7f6564c09740 10 client.18867 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.856+0000 7f6564c09740 10 client.18867 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.857+0000 7f6564c09740 20 client.18867 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.857+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2f60d10 0x55acf2f63190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.857+0000 7f6564c09740 4 client.18867 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:02:20.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.857+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acf2e48d70 con 0x55acf2f60d10 2024-09-15T23:02:20.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.860+0000 7f655bfff640 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2f60d10 0x55acf2f63190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:20.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.864+0000 7f655bfff640 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2f60d10 0x55acf2f63190 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d48bd47afe2ee81 server_cookie=9d974524f61e58e3 in_seq=0 out_seq=0 2024-09-15T23:02:20.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.864+0000 7f653b7fe640 10 client.18867 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:02:20.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.864+0000 7f653b7fe640 1 -- 172.21.15.66:0/1247361819 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acf2e48d70 con 0x55acf2f60d10 2024-09-15T23:02:20.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.865+0000 7f653b7fe640 10 client.18867 handle_command_reply: tid=0 2024-09-15T23:02:20.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.865+0000 7f6564c09740 1 client.18867 shutdown 2024-09-15T23:02:20.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 msgr2=0x55acf2ee9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f655400b940 tx=0x7f6554004a40 comp rx=0 tx=0).stop 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 shutdown_connections 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55acf2f60d10 0x55acf2f63190 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acf2ee6370 0x55acf2ee9b90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acf2edcb40 0x55acf2eeed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 --2- 172.21.15.66:0/1247361819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acf2edb5d0 0x55acf2eee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 >> 172.21.15.66:0/1247361819 conn(0x55acf2ea4310 msgr2=0x55acf2edd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.868+0000 7f653b7fe640 0 client.18867 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:02:20.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.869+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 shutdown_connections 2024-09-15T23:02:20.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.870+0000 7f6564c09740 1 -- 172.21.15.66:0/1247361819 wait complete. 2024-09-15T23:02:20.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.870+0000 7f6564c09740 20 client.18867 trim_cache size 0 max 16384 2024-09-15T23:02:20.872 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:02:20.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.871+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 msgr2=0x7f65440a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.871+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 0x7f65440a59b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f655002a6f0 tx=0x7f6550000bc0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.871+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 msgr2=0x7f655c19e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.871+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f655400b970 tx=0x7f655400be30 comp rx=0 tx=0).stop 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 shutdown_connections 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f65440a34f0 0x7f65440a59b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f655c10ea80 0x7f655c19e900 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f655c109e00 0x7f655c1a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 --2- 172.21.15.66:0/1947323446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f655c109450 0x7f655c1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:20.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 >> 172.21.15.66:0/1947323446 conn(0x7f655c06e2d0 msgr2=0x7f655c10c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:20.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 shutdown_connections 2024-09-15T23:02:20.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:20.872+0000 7f6562830640 1 -- 172.21.15.66:0/1947323446 wait complete. 2024-09-15T23:02:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:21 smithi087 ceph-mon[35290]: pgmap v535: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 235 KiB/s wr, 94 op/s 2024-09-15T23:02:21.662 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:21 smithi066 ceph-mon[31185]: pgmap v535: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 235 KiB/s wr, 94 op/s 2024-09-15T23:02:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:21 smithi184 ceph-mon[35203]: pgmap v535: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 235 KiB/s wr, 94 op/s 2024-09-15T23:02:21.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T23:02:22.231 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:22.378 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:02:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:02:22.030+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T23:02:22.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.848+0000 7f15bc496640 1 -- 172.21.15.66:0/674865443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4101410 msgr2=0x7f15b410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.849+0000 7f15bc496640 1 --2- 172.21.15.66:0/674865443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4101410 0x7f15b410d940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009cd0 tx=0x7f15ac02a910 comp rx=0 tx=0).stop 2024-09-15T23:02:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.850+0000 7f15bc496640 1 -- 172.21.15.66:0/674865443 shutdown_connections 2024-09-15T23:02:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.850+0000 7f15bc496640 1 --2- 172.21.15.66:0/674865443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4101410 0x7f15b410d940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.850+0000 7f15bc496640 1 --2- 172.21.15.66:0/674865443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4100a70 0x7f15b4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.850+0000 7f15bc496640 1 --2- 172.21.15.66:0/674865443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4106a70 0x7f15b4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.850+0000 7f15bc496640 1 -- 172.21.15.66:0/674865443 >> 172.21.15.66:0/674865443 conn(0x7f15b40fc790 msgr2=0x7f15b40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.853+0000 7f15bc496640 1 -- 172.21.15.66:0/674865443 shutdown_connections 2024-09-15T23:02:22.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.853+0000 7f15bc496640 1 -- 172.21.15.66:0/674865443 wait complete. 2024-09-15T23:02:22.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.854+0000 7f15bc496640 1 Processor -- start 2024-09-15T23:02:22.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.854+0000 7f15bc496640 1 -- start start 2024-09-15T23:02:22.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4100a70 0x7f15b4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4101410 0x7f15b41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4110eb0 con 0x7f15b4106a70 2024-09-15T23:02:22.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4110d30 con 0x7f15b4101410 2024-09-15T23:02:22.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.855+0000 7f15bc496640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4111030 con 0x7f15b4100a70 2024-09-15T23:02:22.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.858+0000 7f15baa33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.858+0000 7f15baa33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34194/0 (socket says 172.21.15.66:34194) 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.858+0000 7f15baa33640 1 -- 172.21.15.66:0/2348806042 learned_addr learned my addr 172.21.15.66:0/2348806042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15b9a31640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4101410 0x7f15b41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 -- 172.21.15.66:0/2348806042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4100a70 msgr2=0x7f15b4197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4100a70 0x7f15b4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 -- 172.21.15.66:0/2348806042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4101410 msgr2=0x7f15b41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4101410 0x7f15b41979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 -- 172.21.15.66:0/2348806042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b419c440 con 0x7f15b4106a70 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.859+0000 7f15baa33640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f15ac005e30 tx=0x7f15ac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.860+0000 7f15ab7fe640 1 -- 172.21.15.66:0/2348806042 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac031660 con 0x7f15b4106a70 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.860+0000 7f15ab7fe640 1 -- 172.21.15.66:0/2348806042 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15ac031800 con 0x7f15b4106a70 2024-09-15T23:02:22.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.860+0000 7f15ab7fe640 1 -- 172.21.15.66:0/2348806042 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac02fac0 con 0x7f15b4106a70 2024-09-15T23:02:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.862+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b419c6d0 con 0x7f15b4106a70 2024-09-15T23:02:22.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.862+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b419cb90 con 0x7f15b4106a70 2024-09-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.867+0000 7f15be86f740 1 Processor -- start 2024-09-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 -- start start 2024-09-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e499c0 0x555f83e49da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e5ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f83dae2f0 con 0x555f83e4a2e0 2024-09-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555f83d55cf0 con 0x555f83e5b9d0 2024-09-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.868+0000 7f15be86f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555f83daa2b0 con 0x555f83e499c0 2024-09-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.870+0000 7f15ba232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.870+0000 7f15ba232640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34200/0 (socket says 172.21.15.66:34200) 2024-09-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.870+0000 7f15ba232640 1 -- 172.21.15.66:0/3270106697 learned_addr learned my addr 172.21.15.66:0/3270106697 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.871+0000 7f15b9a31640 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e5ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.871+0000 7f15b9a31640 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e499c0 0x555f83e49da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.876+0000 7f15ba232640 1 -- 172.21.15.66:0/3270106697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e499c0 msgr2=0x555f83e49da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.876+0000 7f15ba232640 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e499c0 0x555f83e49da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.876+0000 7f15ba232640 1 -- 172.21.15.66:0/3270106697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 msgr2=0x555f83e5ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.876+0000 7f15ba232640 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e5ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.876+0000 7f15ba232640 1 -- 172.21.15.66:0/3270106697 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f83d3a3a0 con 0x555f83e4a2e0 2024-09-15T23:02:22.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.879+0000 7f15ab7fe640 1 -- 172.21.15.66:0/2348806042 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f15ac02fc60 con 0x7f15b4106a70 2024-09-15T23:02:22.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.880+0000 7f15ba232640 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f15b00097c0 tx=0x7f15b0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca223996f1604a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.881+0000 7f15ab7fe640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 0x7f15a00b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.881+0000 7f15ab7fe640 1 -- 172.21.15.66:0/2348806042 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f15ac0f1750 con 0x7f15b4106a70 2024-09-15T23:02:22.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.882+0000 7f15a8ff9640 1 -- 172.21.15.66:0/3270106697 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0015020 con 0x555f83e4a2e0 2024-09-15T23:02:22.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.882+0000 7f15a8ff9640 1 -- 172.21.15.66:0/3270106697 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15b0011420 con 0x555f83e4a2e0 2024-09-15T23:02:22.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.882+0000 7f15a8ff9640 1 -- 172.21.15.66:0/3270106697 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0015020 con 0x555f83e4a2e0 2024-09-15T23:02:22.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.884+0000 7f15be86f740 1 -- 172.21.15.66:0/3270106697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 msgr2=0x555f83e5b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.884+0000 7f15be86f740 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f15b00097c0 tx=0x7f15b0009c80 comp rx=0 tx=0).stop 2024-09-15T23:02:22.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.884+0000 7f15b9a31640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 0x7f15a00b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.886+0000 7f15be86f740 1 -- 172.21.15.66:0/3270106697 shutdown_connections 2024-09-15T23:02:22.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.886+0000 7f15be86f740 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e5ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.886+0000 7f15be86f740 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e4a2e0 0x555f83e5b440 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.886+0000 7f15be86f740 1 --2- 172.21.15.66:0/3270106697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e499c0 0x555f83e49da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.886+0000 7f15be86f740 1 -- 172.21.15.66:0/3270106697 >> 172.21.15.66:0/3270106697 conn(0x555f83e11310 msgr2=0x555f83e446a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.887+0000 7f15b9a31640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 0x7f15a00b6950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f15a40058c0 tx=0x7f15a4005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.887+0000 7f15be86f740 1 -- 172.21.15.66:0/3270106697 shutdown_connections 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.887+0000 7f15be86f740 1 -- 172.21.15.66:0/3270106697 wait complete. 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.887+0000 7f15be86f740 1 -- start start 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 Processor -- start 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e58530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555f83e5e8e0 con 0x555f83e5b9d0 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555f83d69060 con 0x555f83e499c0 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555f83e5ea60 con 0x555f83e4a2e0 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.888+0000 7f15be86f740 10 client.0 _ll_register_callbacks cb 0x555f83abc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:22.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.890+0000 7f15baa33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.890+0000 7f15baa33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34214/0 (socket says 172.21.15.66:34214) 2024-09-15T23:02:22.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.890+0000 7f15baa33640 1 -- 172.21.15.66:0/760162657 learned_addr learned my addr 172.21.15.66:0/760162657 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:22.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.891+0000 7f15ba232640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.891+0000 7f15b9a31640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e58530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.892+0000 7f15baa33640 1 -- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 msgr2=0x555f83e58530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.892+0000 7f15baa33640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e58530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.892+0000 7f15baa33640 1 -- 172.21.15.66:0/760162657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 msgr2=0x555f83e5b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.892+0000 7f15baa33640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.892+0000 7f15baa33640 1 -- 172.21.15.66:0/760162657 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f83b1f3c0 con 0x555f83e5b9d0 2024-09-15T23:02:22.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.895+0000 7f15baa33640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0bd590 tx=0x7f15ac0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238a6b379ae10c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.895+0000 7f159dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:22.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.895+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0d5020 con 0x555f83e5b9d0 2024-09-15T23:02:22.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.895+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f15ac0eebe0 con 0x555f83e5b9d0 2024-09-15T23:02:22.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.896+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15b0011420 con 0x555f83e5b9d0 2024-09-15T23:02:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.900+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f15ac0db050 con 0x555f83e5b9d0 2024-09-15T23:02:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.901+0000 7f15be86f740 10 client.18879 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.901+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x555f83e6a240 con 0x555f83e5b9d0 2024-09-15T23:02:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.905+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15b0011420 con 0x555f83e5b9d0 2024-09-15T23:02:22.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f15ac0c5de0 con 0x555f83e5b9d0 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 10 client.18879 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 10 client.18879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 20 client.18879 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83e6b9c0 0x555f83e6de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 4 client.18879 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:22.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.906+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f83dbb860 con 0x555f83e6b9c0 2024-09-15T23:02:22.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.908+0000 7f15ba232640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83e6b9c0 0x555f83e6de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.912+0000 7f159dffb640 10 client.18879 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:02:22.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.912+0000 7f15ba232640 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83e6b9c0 0x555f83e6de40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5cf75e5274c6e14e server_cookie=7e4f8bc1b78475e3 in_seq=0 out_seq=0 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.913+0000 7f159dffb640 1 -- 172.21.15.66:0/760162657 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f83dbb860 con 0x555f83e6b9c0 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.913+0000 7f159dffb640 10 client.18879 handle_command_reply: tid=0 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.913+0000 7f15be86f740 1 client.18879 shutdown 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.913+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 msgr2=0x555f83e58a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.913+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0bd590 tx=0x7f15ac0319b0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 shutdown_connections 2024-09-15T23:02:22.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83e6b9c0 0x555f83e6de40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83e58a70 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e58530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 --2- 172.21.15.66:0/760162657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 >> 172.21.15.66:0/760162657 conn(0x555f83e11310 msgr2=0x555f83e43d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.914+0000 7f159dffb640 0 client.18879 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:02:22.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.915+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 shutdown_connections 2024-09-15T23:02:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.916+0000 7f15be86f740 1 -- 172.21.15.66:0/760162657 wait complete. 2024-09-15T23:02:22.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.917+0000 7f15be86f740 20 client.18879 trim_cache size 0 max 16384 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 Processor -- start 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 -- start start 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e499c0 0x555f83e67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e73710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e73c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a4830 con 0x555f83e499c0 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a6640 con 0x555f83e5b9d0 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.942+0000 7f15be86f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a4f90 con 0x555f83e4a2e0 2024-09-15T23:02:22.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.943+0000 7f15baa33640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e73c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.943+0000 7f15b9a31640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e73710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15b9a31640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e73710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:58840/0 (socket says 172.21.15.66:58840) 2024-09-15T23:02:22.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15b9a31640 1 -- 172.21.15.66:0/3344020607 learned_addr learned my addr 172.21.15.66:0/3344020607 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15baa33640 1 -- 172.21.15.66:0/3344020607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 msgr2=0x555f83e73710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15baa33640 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e73710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15baa33640 1 -- 172.21.15.66:0/3344020607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e499c0 msgr2=0x555f83e67b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15baa33640 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e499c0 0x555f83e67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.944+0000 7f15baa33640 1 -- 172.21.15.66:0/3344020607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f83e5ea20 con 0x555f83e5b9d0 2024-09-15T23:02:22.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.945+0000 7f15baa33640 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e73c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b9a60 tx=0x7f15ac031ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f395c3500c580a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.945+0000 7f159ffff640 1 -- 172.21.15.66:0/3344020607 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0d5070 con 0x555f83e5b9d0 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.945+0000 7f159ffff640 1 -- 172.21.15.66:0/3344020607 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15ac036030 con 0x555f83e5b9d0 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.946+0000 7f15be86f740 1 -- 172.21.15.66:0/3344020607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 msgr2=0x555f83e73c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.946+0000 7f15be86f740 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e73c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b9a60 tx=0x7f15ac031ae0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.947+0000 7f15be86f740 1 -- 172.21.15.66:0/3344020607 shutdown_connections 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.947+0000 7f15be86f740 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e5b9d0 0x555f83e73c50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.947+0000 7f15be86f740 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e73710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.947+0000 7f15be86f740 1 --2- 172.21.15.66:0/3344020607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e499c0 0x555f83e67b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.947+0000 7f15be86f740 1 -- 172.21.15.66:0/3344020607 >> 172.21.15.66:0/3344020607 conn(0x555f83e11310 msgr2=0x555f83e57620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.950+0000 7f15be86f740 1 -- 172.21.15.66:0/3344020607 shutdown_connections 2024-09-15T23:02:22.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.954+0000 7f15be86f740 1 -- 172.21.15.66:0/3344020607 wait complete. 2024-09-15T23:02:22.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.954+0000 7f15be86f740 1 -- start start 2024-09-15T23:02:22.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.954+0000 7f15be86f740 1 Processor -- start 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e5f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83ece6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a5eb0 con 0x555f83e5b9d0 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a5720 con 0x555f83e499c0 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4072cd0 con 0x555f83e4a2e0 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.955+0000 7f15be86f740 10 client.0 _ll_register_callbacks cb 0x7f15ac009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.956+0000 7f15ba232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.956+0000 7f15ba232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55610/0 (socket says 172.21.15.66:55610) 2024-09-15T23:02:22.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.956+0000 7f15ba232640 1 -- 172.21.15.66:0/3962076739 learned_addr learned my addr 172.21.15.66:0/3962076739 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:22.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.959+0000 7f15baa33640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83ece6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.960+0000 7f15baa33640 1 -- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 msgr2=0x555f83e5f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:22.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.960+0000 7f15baa33640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e5f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.960+0000 7f15baa33640 1 -- 172.21.15.66:0/3962076739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 msgr2=0x555f83e5f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:22.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.960+0000 7f15baa33640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.960+0000 7f15baa33640 1 -- 172.21.15.66:0/3962076739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f83ecece0 con 0x555f83e5b9d0 2024-09-15T23:02:22.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.961+0000 7f15baa33640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83ece6a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009bf0 tx=0x7f15ac009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fecf4f4dbffbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:22.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.961+0000 7f159dffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:22.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.961+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0d5040 con 0x555f83e5b9d0 2024-09-15T23:02:22.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.961+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15ac036030 con 0x555f83e5b9d0 2024-09-15T23:02:22.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.962+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f15ac0eebe0 con 0x555f83e5b9d0 2024-09-15T23:02:22.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.962+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f15ac0b9040 con 0x555f83e5b9d0 2024-09-15T23:02:22.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.962+0000 7f15be86f740 10 client.18882 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:22.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.962+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x555f83ed6070 con 0x555f83e5b9d0 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.963+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15ac036030 con 0x555f83e5b9d0 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.963+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f15ac0bca50 con 0x555f83e5b9d0 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 10 client.18882 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 10 client.18882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 20 client.18882 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83ed65a0 0x555f83ed89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 4 client.18882 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:02:22.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.964+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f83db5d70 con 0x555f83ed65a0 2024-09-15T23:02:22.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.965+0000 7f15ba232640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83ed65a0 0x555f83ed89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:22.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.973+0000 7f15ba232640 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83ed65a0 0x555f83ed89c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e067cb277af96697 server_cookie=bc3de8a997f70d6c in_seq=0 out_seq=0 2024-09-15T23:02:22.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.973+0000 7f159dffb640 10 client.18882 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:02:22.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.977+0000 7f159dffb640 1 -- 172.21.15.66:0/3962076739 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f83db5d70 con 0x555f83ed65a0 2024-09-15T23:02:22.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.977+0000 7f159dffb640 10 client.18882 handle_command_reply: tid=0 2024-09-15T23:02:22.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.977+0000 7f15be86f740 1 client.18882 shutdown 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.978+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 msgr2=0x555f83ece6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.978+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83ece6a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009bf0 tx=0x7f15ac009540 comp rx=0 tx=0).stop 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 shutdown_connections 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x555f83ed65a0 0x555f83ed89c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555f83e5b9d0 0x555f83ece6a0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555f83e4a2e0 0x555f83e5f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 --2- 172.21.15.66:0/3962076739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f83e499c0 0x555f83e5f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f159dffb640 0 client.18882 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:02:22.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 >> 172.21.15.66:0/3962076739 conn(0x555f83e11310 msgr2=0x555f83e434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 shutdown_connections 2024-09-15T23:02:22.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.979+0000 7f15be86f740 1 -- 172.21.15.66:0/3962076739 wait complete. 2024-09-15T23:02:22.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.981+0000 7f15be86f740 20 client.18882 trim_cache size 0 max 16384 2024-09-15T23:02:22.987 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:02:22.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 msgr2=0x7f15a00b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 0x7f15a00b6950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f15a40058c0 tx=0x7f15a4005850 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 msgr2=0x7f15b419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f15ac005e30 tx=0x7f15ac003f10 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 shutdown_connections 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f15a00b4490 0x7f15a00b6950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15b4106a70 0x7f15b419bd60 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15b4101410 0x7f15b41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 --2- 172.21.15.66:0/2348806042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15b4100a70 0x7f15b4197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.982+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 >> 172.21.15.66:0/2348806042 conn(0x7f15b40fc790 msgr2=0x7f15b40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:22.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.983+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 shutdown_connections 2024-09-15T23:02:22.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:22.983+0000 7f15bc496640 1 -- 172.21.15.66:0/2348806042 wait complete. 2024-09-15T23:02:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:23 smithi087 ceph-mon[35290]: pgmap v536: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 215 KiB/s wr, 74 op/s 2024-09-15T23:02:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:23 smithi184 ceph-mon[35203]: pgmap v536: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 215 KiB/s wr, 74 op/s 2024-09-15T23:02:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:23 smithi066 ceph-mon[31185]: pgmap v536: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 215 KiB/s wr, 74 op/s 2024-09-15T23:02:23.795 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T23:02:24.319 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:25.522 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:25 smithi066 ceph-mon[31185]: pgmap v537: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 420 KiB/s wr, 93 op/s 2024-09-15T23:02:25.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:25 smithi087 ceph-mon[35290]: pgmap v537: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 420 KiB/s wr, 93 op/s 2024-09-15T23:02:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:25 smithi184 ceph-mon[35203]: pgmap v537: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 420 KiB/s wr, 93 op/s 2024-09-15T23:02:25.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.804+0000 7fa717fff640 1 -- 172.21.15.66:0/2269971016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa71806ea30 msgr2=0x7fa71806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 --2- 172.21.15.66:0/2269971016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa71806ea30 0x7fa71806ee70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009900 tx=0x7fa70c02a420 comp rx=0 tx=0).stop 2024-09-15T23:02:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 -- 172.21.15.66:0/2269971016 shutdown_connections 2024-09-15T23:02:25.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 --2- 172.21.15.66:0/2269971016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71811b140 0x7fa71811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 --2- 172.21.15.66:0/2269971016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa71806ea30 0x7fa71806ee70 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009900 tx=0x7fa70c02a420 comp rx=0 tx=0).stop 2024-09-15T23:02:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 --2- 172.21.15.66:0/2269971016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718110190 0x7fa71806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.807+0000 7fa717fff640 1 -- 172.21.15.66:0/2269971016 >> 172.21.15.66:0/2269971016 conn(0x7fa718073180 msgr2=0x7fa718073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.809+0000 7fa717fff640 1 -- 172.21.15.66:0/2269971016 shutdown_connections 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.809+0000 7fa717fff640 1 -- 172.21.15.66:0/2269971016 wait complete. 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 Processor -- start 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 -- start start 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718110190 0x7fa718115080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 0x7fa7181bba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa718111880 con 0x7fa71811b140 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa718111700 con 0x7fa718115b00 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.810+0000 7fa717fff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa718111a00 con 0x7fa718110190 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34240/0 (socket says 172.21.15.66:34240) 2024-09-15T23:02:25.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 -- 172.21.15.66:0/729269171 learned_addr learned my addr 172.21.15.66:0/729269171 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa716ffd640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718110190 0x7fa718115080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7177fe640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 0x7fa7181bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 -- 172.21.15.66:0/729269171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718110190 msgr2=0x7fa718115080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718110190 0x7fa718115080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 -- 172.21.15.66:0/729269171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 msgr2=0x7fa7181bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 0x7fa7181bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.811+0000 7fa7167fc640 1 -- 172.21.15.66:0/729269171 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7181bc1d0 con 0x7fa71811b140 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.812+0000 7fa7177fe640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 0x7fa7181bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:02:25.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.812+0000 7fa7167fc640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa70c033000 tx=0x7fa70c003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.815+0000 7fa6fffff640 1 -- 172.21.15.66:0/729269171 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c03f030 con 0x7fa71811b140 2024-09-15T23:02:25.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.815+0000 7fa6fffff640 1 -- 172.21.15.66:0/729269171 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70c003cb0 con 0x7fa71811b140 2024-09-15T23:02:25.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.815+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7181bc460 con 0x7fa71811b140 2024-09-15T23:02:25.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.815+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7181bc8f0 con 0x7fa71811b140 2024-09-15T23:02:25.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.815+0000 7fa6fffff640 1 -- 172.21.15.66:0/729269171 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c035070 con 0x7fa71811b140 2024-09-15T23:02:25.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.821+0000 7fa71f755740 1 Processor -- start 2024-09-15T23:02:25.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.823+0000 7fa71f755740 1 -- start start 2024-09-15T23:02:25.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48dcf0 0x56421e48c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e499910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56421e3f22f0 con 0x56421e48c780 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56421e399cf0 con 0x56421e48dcf0 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa71f755740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56421e3ee2b0 con 0x56421e497520 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa6fffff640 1 -- 172.21.15.66:0/729269171 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa70c042030 con 0x7fa71811b140 2024-09-15T23:02:25.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.824+0000 7fa7177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48dcf0 0x56421e48c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.825+0000 7fa6fffff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 0x7fa7000a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.825+0000 7fa6fffff640 1 -- 172.21.15.66:0/729269171 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa70c0f0630 con 0x7fa71811b140 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34246/0 (socket says 172.21.15.66:34246) 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 -- 172.21.15.66:0/2296222902 learned_addr learned my addr 172.21.15.66:0/2296222902 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 -- 172.21.15.66:0/2296222902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 msgr2=0x56421e499910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e499910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 -- 172.21.15.66:0/2296222902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48dcf0 msgr2=0x56421e48c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48dcf0 0x56421e48c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 -- 172.21.15.66:0/2296222902 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56421e37e3a0 con 0x56421e48c780 2024-09-15T23:02:25.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.826+0000 7fa716ffd640 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cbf0 tx=0x7fa70800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633e27e6fe646bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.830+0000 7fa6fd7fa640 1 -- 172.21.15.66:0/2296222902 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708010630 con 0x56421e48c780 2024-09-15T23:02:25.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.830+0000 7fa6fd7fa640 1 -- 172.21.15.66:0/2296222902 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa708010cb0 con 0x56421e48c780 2024-09-15T23:02:25.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.830+0000 7fa7177fe640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 0x7fa7000a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.831+0000 7fa71f755740 1 -- 172.21.15.66:0/2296222902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 msgr2=0x56421e48cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.831+0000 7fa71f755740 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa70800cbf0 tx=0x7fa70800e720 comp rx=0 tx=0).stop 2024-09-15T23:02:25.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.832+0000 7fa71f755740 1 -- 172.21.15.66:0/2296222902 shutdown_connections 2024-09-15T23:02:25.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.832+0000 7fa71f755740 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e499910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.832+0000 7fa71f755740 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e48cbc0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.832+0000 7fa71f755740 1 --2- 172.21.15.66:0/2296222902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48dcf0 0x56421e48c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.832+0000 7fa71f755740 1 -- 172.21.15.66:0/2296222902 >> 172.21.15.66:0/2296222902 conn(0x56421e455310 msgr2=0x56421e488e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.834+0000 7fa71f755740 1 -- 172.21.15.66:0/2296222902 shutdown_connections 2024-09-15T23:02:25.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.834+0000 7fa71f755740 1 -- 172.21.15.66:0/2296222902 wait complete. 2024-09-15T23:02:25.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.834+0000 7fa71f755740 1 -- start start 2024-09-15T23:02:25.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.834+0000 7fa71f755740 1 Processor -- start 2024-09-15T23:02:25.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.835+0000 7fa7177fe640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 0x7fa7000a5ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa71806b4a0 tx=0x7fa710004ad0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e496e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e497520 0x56421e494630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56421e49a270 con 0x56421e48c780 2024-09-15T23:02:25.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56421e3ad060 con 0x56421e497520 2024-09-15T23:02:25.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56421e49a3f0 con 0x56421e48dcf0 2024-09-15T23:02:25.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.837+0000 7fa71f755740 10 client.0 _ll_register_callbacks cb 0x56421e1008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:25.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.838+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.838+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e496e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.838+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:58890/0 (socket says 172.21.15.66:58890) 2024-09-15T23:02:25.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.838+0000 7fa7167fc640 1 -- 172.21.15.66:0/3071993064 learned_addr learned my addr 172.21.15.66:0/3071993064 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:25.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.838+0000 7fa7177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e497520 0x56421e494630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.840+0000 7fa7167fc640 1 -- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e497520 msgr2=0x56421e494630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.840+0000 7fa7167fc640 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e497520 0x56421e494630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.840+0000 7fa7167fc640 1 -- 172.21.15.66:0/3071993064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 msgr2=0x56421e496e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.840+0000 7fa7167fc640 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e496e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.841+0000 7fa7167fc640 1 -- 172.21.15.66:0/3071993064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56421e1633c0 con 0x56421e48dcf0 2024-09-15T23:02:25.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.850+0000 7fa7167fc640 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0bc0d0 tx=0x7fa70c0bc1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b39df6bbc695b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.850+0000 7fa6faff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:25.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.854+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c000e60 con 0x56421e48dcf0 2024-09-15T23:02:25.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.854+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa70c0f01b0 con 0x56421e48dcf0 2024-09-15T23:02:25.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.855+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa708010cb0 con 0x56421e48dcf0 2024-09-15T23:02:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.857+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fa70c031700 con 0x56421e48dcf0 2024-09-15T23:02:25.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.858+0000 7fa71f755740 10 client.28042 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:25.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.858+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x56421e49a270 con 0x56421e48dcf0 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa708010cb0 con 0x56421e48dcf0 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fa70c0c4bb0 con 0x56421e48dcf0 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 10 client.28042 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 10 client.28042 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 20 client.28042 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e4a7460 0x56421e4a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 4 client.28042 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:25.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.864+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56421e3ff860 con 0x56421e4a7460 2024-09-15T23:02:25.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.865+0000 7fa716ffd640 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e4a7460 0x56421e4a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.874+0000 7fa716ffd640 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e4a7460 0x56421e4a9880 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5bfeeabe0a01b67 server_cookie=4bb0c5f156676f7 in_seq=0 out_seq=0 2024-09-15T23:02:25.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.875+0000 7fa6faff5640 10 client.28042 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:02:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.878+0000 7fa6faff5640 1 -- 172.21.15.66:0/3071993064 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56421e3ff860 con 0x56421e4a7460 2024-09-15T23:02:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.878+0000 7fa6faff5640 10 client.28042 handle_command_reply: tid=0 2024-09-15T23:02:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.878+0000 7fa71f755740 1 client.28042 shutdown 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 msgr2=0x56421e4940f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0bc0d0 tx=0x7fa70c0bc1a0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 shutdown_connections 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e4a7460 0x56421e4a9880 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e497520 0x56421e494630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e48dcf0 0x56421e4940f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 --2- 172.21.15.66:0/3071993064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48c780 0x56421e496e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 >> 172.21.15.66:0/3071993064 conn(0x56421e455310 msgr2=0x56421e48eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.879+0000 7fa6faff5640 0 client.28042 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:02:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.880+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 shutdown_connections 2024-09-15T23:02:25.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.884+0000 7fa71f755740 1 -- 172.21.15.66:0/3071993064 wait complete. 2024-09-15T23:02:25.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.884+0000 7fa71f755740 20 client.28042 trim_cache size 0 max 16384 2024-09-15T23:02:25.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.911+0000 7fa71f755740 1 Processor -- start 2024-09-15T23:02:25.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.911+0000 7fa71f755740 1 -- start start 2024-09-15T23:02:25.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.911+0000 7fa71f755740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e4a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa71f755740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa7167fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34268/0 (socket says 172.21.15.66:34268) 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa71f755740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e498e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa7167fc640 1 -- 172.21.15.66:0/1273390784 learned_addr learned my addr 172.21.15.66:0/1273390784 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa704010260 con 0x56421e48dcf0 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa704012070 con 0x56421e48c780 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040109c0 con 0x56421e497520 2024-09-15T23:02:25.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.912+0000 7fa716ffd640 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e4a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 -- 172.21.15.66:0/1273390784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 msgr2=0x56421e498e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e498e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 -- 172.21.15.66:0/1273390784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 msgr2=0x56421e4a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e4a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 -- 172.21.15.66:0/1273390784 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56421e489080 con 0x56421e48dcf0 2024-09-15T23:02:25.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.913+0000 7fa7167fc640 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0038f0 tx=0x7fa70c031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75853487a2644675 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.916+0000 7fa6fcff9640 1 -- 172.21.15.66:0/1273390784 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c000e60 con 0x56421e48dcf0 2024-09-15T23:02:25.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.916+0000 7fa6fcff9640 1 -- 172.21.15.66:0/1273390784 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70c0bcad0 con 0x56421e48dcf0 2024-09-15T23:02:25.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.916+0000 7fa6fcff9640 1 -- 172.21.15.66:0/1273390784 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0f0410 con 0x56421e48dcf0 2024-09-15T23:02:25.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.917+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 msgr2=0x56421e498910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.917+0000 7fa71f755740 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0038f0 tx=0x7fa70c031510 comp rx=0 tx=0).stop 2024-09-15T23:02:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.920+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 shutdown_connections 2024-09-15T23:02:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.921+0000 7fa71f755740 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e498e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.921+0000 7fa71f755740 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e498910 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.921+0000 7fa71f755740 1 --2- 172.21.15.66:0/1273390784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e4a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.921+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 >> 172.21.15.66:0/1273390784 conn(0x56421e455310 msgr2=0x56421e4940b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.926+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 shutdown_connections 2024-09-15T23:02:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.926+0000 7fa71f755740 1 -- 172.21.15.66:0/1273390784 wait complete. 2024-09-15T23:02:25.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.926+0000 7fa71f755740 1 -- start start 2024-09-15T23:02:25.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.926+0000 7fa71f755740 1 Processor -- start 2024-09-15T23:02:25.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e49ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e4ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040118e0 con 0x56421e48dcf0 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa704011150 con 0x56421e48c780 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa70400e260 con 0x56421e497520 2024-09-15T23:02:25.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.928+0000 7fa71f755740 10 client.0 _ll_register_callbacks cb 0x7fa70c03bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:25.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.930+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.930+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55668/0 (socket says 172.21.15.66:55668) 2024-09-15T23:02:25.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.930+0000 7fa716ffd640 1 -- 172.21.15.66:0/623685372 learned_addr learned my addr 172.21.15.66:0/623685372 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:25.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.930+0000 7fa7167fc640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e49ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.932+0000 7fa7177fe640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e4ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.934+0000 7fa7177fe640 1 -- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 msgr2=0x56421e49fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.934+0000 7fa7177fe640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.934+0000 7fa7177fe640 1 -- 172.21.15.66:0/623685372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 msgr2=0x56421e49ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:25.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.934+0000 7fa7177fe640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e49ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.934+0000 7fa7177fe640 1 -- 172.21.15.66:0/623685372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56421e4971b0 con 0x56421e497520 2024-09-15T23:02:25.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.935+0000 7fa716ffd640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:02:25.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.937+0000 7fa7177fe640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e4ae7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa710007fd0 tx=0x7fa710007340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c09c6217b5b225 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:25.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.937+0000 7fa6faff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:25.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.940+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71001ac10 con 0x56421e497520 2024-09-15T23:02:25.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.940+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fa71001adb0 con 0x56421e497520 2024-09-15T23:02:25.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.940+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa70c0bcad0 con 0x56421e497520 2024-09-15T23:02:25.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.942+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fa710003a10 con 0x56421e497520 2024-09-15T23:02:25.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.942+0000 7fa71f755740 10 client.28045 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:25.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.942+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x56421e49f250 con 0x56421e497520 2024-09-15T23:02:25.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70c0bcad0 con 0x56421e497520 2024-09-15T23:02:25.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fa710024770 con 0x56421e497520 2024-09-15T23:02:25.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 10 client.28045 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:25.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 10 client.28045 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:02:25.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 20 client.28045 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:25.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e512430 0x56421e514850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:25.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 4 client.28045 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:02:25.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.944+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56421e495240 con 0x56421e512430 2024-09-15T23:02:25.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.946+0000 7fa716ffd640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e512430 0x56421e514850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:25.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.952+0000 7fa716ffd640 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e512430 0x56421e514850 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80a45a15c99d5a36 server_cookie=9ab53a0575160053 in_seq=0 out_seq=0 2024-09-15T23:02:25.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.952+0000 7fa6faff5640 10 client.28045 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:02:25.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.952+0000 7fa6faff5640 1 -- 172.21.15.66:0/623685372 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56421e495240 con 0x56421e512430 2024-09-15T23:02:25.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.952+0000 7fa6faff5640 10 client.28045 handle_command_reply: tid=0 2024-09-15T23:02:25.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.952+0000 7fa71f755740 1 client.28045 shutdown 2024-09-15T23:02:25.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.956+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 msgr2=0x56421e4ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.956+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e4ae7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa710007fd0 tx=0x7fa710007340 comp rx=0 tx=0).stop 2024-09-15T23:02:25.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 shutdown_connections 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x56421e512430 0x56421e514850 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56421e497520 0x56421e4ae7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56421e48dcf0 0x56421e49ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 --2- 172.21.15.66:0/623685372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56421e48c780 0x56421e49fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa6faff5640 0 client.28045 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.958+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 >> 172.21.15.66:0/623685372 conn(0x56421e455310 msgr2=0x56421e4931e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.959+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 shutdown_connections 2024-09-15T23:02:25.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.960+0000 7fa71f755740 1 -- 172.21.15.66:0/623685372 wait complete. 2024-09-15T23:02:25.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.960+0000 7fa71f755740 20 client.28045 trim_cache size 0 max 16384 2024-09-15T23:02:25.963 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:02:25.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.961+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 msgr2=0x7fa7000a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.961+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 0x7fa7000a5ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa71806b4a0 tx=0x7fa710004ad0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.961+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 msgr2=0x7fa7181155c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:25.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.961+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa70c033000 tx=0x7fa70c003880 comp rx=0 tx=0).stop 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.961+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 shutdown_connections 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.962+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7000a35f0 0x7fa7000a5ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.962+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718115b00 0x7fa7181bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.962+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa71811b140 0x7fa7181155c0 secure :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa70c033000 tx=0x7fa70c003880 comp rx=0 tx=0).stop 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.962+0000 7fa717fff640 1 --2- 172.21.15.66:0/729269171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718110190 0x7fa718115080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.962+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 >> 172.21.15.66:0/729269171 conn(0x7fa718073180 msgr2=0x7fa71811b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:25.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.964+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 shutdown_connections 2024-09-15T23:02:25.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:25.964+0000 7fa717fff640 1 -- 172.21.15.66:0/729269171 wait complete. 2024-09-15T23:02:26.836 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T23:02:27.337 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:27 smithi087 ceph-mon[35290]: pgmap v538: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 618 KiB/s wr, 91 op/s 2024-09-15T23:02:27.612 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:27 smithi066 ceph-mon[31185]: pgmap v538: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 618 KiB/s wr, 91 op/s 2024-09-15T23:02:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:27 smithi184 ceph-mon[35203]: pgmap v538: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 618 KiB/s wr, 91 op/s 2024-09-15T23:02:28.767 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:02:28.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 -- 172.21.15.66:0/3167660858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 msgr2=0x7fc974107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/3167660858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974107b90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc964009930 tx=0x7fc96402a420 comp rx=0 tx=0).stop 2024-09-15T23:02:28.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 -- 172.21.15.66:0/3167660858 shutdown_connections 2024-09-15T23:02:28.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/3167660858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9741082a0 0x7fc97410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/3167660858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974107b90 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/3167660858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc974102d30 0x7fc974103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 -- 172.21.15.66:0/3167660858 >> 172.21.15.66:0/3167660858 conn(0x7fc9740fc7d0 msgr2=0x7fc9740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 -- 172.21.15.66:0/3167660858 shutdown_connections 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.907+0000 7fc97b7c7640 1 -- 172.21.15.66:0/3167660858 wait complete. 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 Processor -- start 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 -- start start 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 0x7fc9741985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9741082a0 0x7fc97419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc974112060 con 0x7fc9741036e0 2024-09-15T23:02:28.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc974111ee0 con 0x7fc9741082a0 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc97b7c7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741121e0 con 0x7fc974102d30 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc978d62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc978d62640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34284/0 (socket says 172.21.15.66:34284) 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc978d62640 1 -- 172.21.15.66:0/2413772147 learned_addr learned my addr 172.21.15.66:0/2413772147 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc979d64640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9741082a0 0x7fc97419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.908+0000 7fc979563640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 0x7fc9741985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 -- 172.21.15.66:0/2413772147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 msgr2=0x7fc9741985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 0x7fc9741985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 -- 172.21.15.66:0/2413772147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9741082a0 msgr2=0x7fc97419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9741082a0 0x7fc97419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 -- 172.21.15.66:0/2413772147 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97419d570 con 0x7fc9741036e0 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc979563640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 0x7fc9741985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:02:28.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc978d62640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc964005940 tx=0x7fc9640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc96a7fc640 1 -- 172.21.15.66:0/2413772147 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96403f030 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc96a7fc640 1 -- 172.21.15.66:0/2413772147 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc964003ce0 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc96a7fc640 1 -- 172.21.15.66:0/2413772147 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964035070 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97419d800 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.909+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741a5140 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.911+0000 7fc96a7fc640 1 -- 172.21.15.66:0/2413772147 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc964042030 con 0x7fc9741036e0 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 Processor -- start 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 -- start start 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x56345888ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563458896370 0x563458898760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5634587f12f0 con 0x56345888cb40 2024-09-15T23:02:28.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563458798cf0 con 0x563458896370 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc97dba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5634587ed2b0 con 0x56345888b5d0 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc979d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc979d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34300/0 (socket says 172.21.15.66:34300) 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc979d64640 1 -- 172.21.15.66:0/4270775925 learned_addr learned my addr 172.21.15.66:0/4270775925 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc96a7fc640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 0x7fc9600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc978d62640 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563458896370 0x563458898760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.912+0000 7fc979563640 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x56345888ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 0x7fc9600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 -- 172.21.15.66:0/4270775925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 msgr2=0x56345888ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x56345888ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 -- 172.21.15.66:0/4270775925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563458896370 msgr2=0x563458898760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563458896370 0x563458898760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 -- 172.21.15.66:0/4270775925 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56345877d3a0 con 0x56345888cb40 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc96a7fc640 1 -- 172.21.15.66:0/2413772147 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fc9640f0600 con 0x7fc9741036e0 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc96c014590 tx=0x7fc96c014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6571a9bd7cb8b994 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc95f7fe640 1 -- 172.21.15.66:0/4270775925 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c029070 con 0x56345888cb40 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc95f7fe640 1 -- 172.21.15.66:0/4270775925 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96c012c70 con 0x56345888cb40 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc95f7fe640 1 -- 172.21.15.66:0/4270775925 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00e360 con 0x56345888cb40 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.913+0000 7fc979d64640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 0x7fc9600a58f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc96c026000 tx=0x7fc96c022000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- 172.21.15.66:0/4270775925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 msgr2=0x56345888b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc96c014590 tx=0x7fc96c014ef0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- 172.21.15.66:0/4270775925 shutdown_connections 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563458896370 0x563458898760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x56345888ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 --2- 172.21.15.66:0/4270775925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888cb40 0x56345888b090 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- 172.21.15.66:0/4270775925 >> 172.21.15.66:0/4270775925 conn(0x563458854310 msgr2=0x563458887c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- 172.21.15.66:0/4270775925 shutdown_connections 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- 172.21.15.66:0/4270775925 wait complete. 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 -- start start 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.914+0000 7fc97dba0740 1 Processor -- start 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x563458895d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458893030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563458899070 con 0x563458896370 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5634587ac060 con 0x56345888cb40 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5634588991f0 con 0x56345888b5d0 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc97dba0740 10 client.0 _ll_register_callbacks cb 0x5634584ff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc979d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458893030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc979d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34316/0 (socket says 172.21.15.66:34316) 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc979d64640 1 -- 172.21.15.66:0/1739450535 learned_addr learned my addr 172.21.15.66:0/1739450535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc979563640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x563458895d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 -- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 msgr2=0x563458895d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x563458895d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 -- 172.21.15.66:0/1739450535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 msgr2=0x563458893640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc978d62640 1 -- 172.21.15.66:0/1739450535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634585623c0 con 0x56345888cb40 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.915+0000 7fc979d64640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc978d62640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458893030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ed870 tx=0x7fc9640bc070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1cc5ed799a6fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964049070 con 0x56345888cb40 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c012c70 con 0x56345888cb40 2024-09-15T23:02:28.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fc9640edaf0 con 0x56345888cb40 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fc9640bcb00 con 0x56345888cb40 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc97dba0740 10 client.28160 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x5634588a4b40 con 0x56345888cb40 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96c012c70 con 0x56345888cb40 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.916+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fc9640b8a70 con 0x56345888cb40 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 10 client.28160 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 10 client.28160 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 20 client.28160 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5634588a60b0 0x5634588a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 4 client.28160 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634587fe860 con 0x5634588a60b0 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.917+0000 7fc979563640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5634588a60b0 0x5634588a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.921+0000 7fc95cff9640 10 client.28160 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:02:28.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.921+0000 7fc979563640 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5634588a60b0 0x5634588a84f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d46590575e4f25d server_cookie=fb46e6db6aa4e1d5 in_seq=0 out_seq=0 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc95cff9640 1 -- 172.21.15.66:0/1739450535 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634587fe860 con 0x5634588a60b0 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc95cff9640 10 client.28160 handle_command_reply: tid=0 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 client.28160 shutdown 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 msgr2=0x563458893030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458893030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ed870 tx=0x7fc9640bc070 comp rx=0 tx=0).stop 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 shutdown_connections 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x5634588a60b0 0x5634588a84f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x563458893640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458893030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc95cff9640 0 client.28160 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 --2- 172.21.15.66:0/1739450535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888b5d0 0x563458895d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 >> 172.21.15.66:0/1739450535 conn(0x563458854310 msgr2=0x56345888d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 shutdown_connections 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 1 -- 172.21.15.66:0/1739450535 wait complete. 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.927+0000 7fc97dba0740 20 client.28160 trim_cache size 0 max 16384 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 Processor -- start 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 -- start start 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 0x5634588a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888cb40 0x56345888e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x56345888e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ad0d0 con 0x563458896370 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741aeee0 con 0x56345888b5d0 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.940+0000 7fc97dba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ad830 con 0x56345888cb40 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x56345888e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979563640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 0x5634588a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979563640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 0x5634588a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55726/0 (socket says 172.21.15.66:55726) 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979563640 1 -- 172.21.15.66:0/897002002 learned_addr learned my addr 172.21.15.66:0/897002002 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc978d62640 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888cb40 0x56345888e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 -- 172.21.15.66:0/897002002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888cb40 msgr2=0x56345888e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888cb40 0x56345888e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 -- 172.21.15.66:0/897002002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 msgr2=0x5634588a2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 0x5634588a2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 -- 172.21.15.66:0/897002002 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56345888b2d0 con 0x563458896370 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc979d64640 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x56345888e660 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc96c024b30 tx=0x7fc96c024c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372438da7990fa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc95effd640 1 -- 172.21.15.66:0/897002002 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c03b070 con 0x563458896370 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc95effd640 1 -- 172.21.15.66:0/897002002 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96c01cd40 con 0x563458896370 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.941+0000 7fc95effd640 1 -- 172.21.15.66:0/897002002 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c029050 con 0x563458896370 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- 172.21.15.66:0/897002002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 msgr2=0x56345888e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x56345888e660 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc96c024b30 tx=0x7fc96c024c30 comp rx=0 tx=0).stop 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- 172.21.15.66:0/897002002 shutdown_connections 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563458896370 0x56345888e660 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56345888cb40 0x56345888e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 --2- 172.21.15.66:0/897002002 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888b5d0 0x5634588a2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- 172.21.15.66:0/897002002 >> 172.21.15.66:0/897002002 conn(0x563458854310 msgr2=0x563458892120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- 172.21.15.66:0/897002002 shutdown_connections 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- 172.21.15.66:0/897002002 wait complete. 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 -- start start 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.942+0000 7fc97dba0740 1 Processor -- start 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458899d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 0x56345889a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ae750 con 0x56345888b5d0 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741adfc0 con 0x56345888cb40 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ab0d0 con 0x563458896370 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc97dba0740 10 client.0 _ll_register_callbacks cb 0x7fc964005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34324/0 (socket says 172.21.15.66:34324) 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 -- 172.21.15.66:0/2570898512 learned_addr learned my addr 172.21.15.66:0/2570898512 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc978d62640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458899d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979d64640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 0x56345889a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 -- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 msgr2=0x56345889a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 0x56345889a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 -- 172.21.15.66:0/2570898512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 msgr2=0x563458899d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458899d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 -- 172.21.15.66:0/2570898512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56345889a8d0 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979d64640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 0x56345889a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc979563640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x5634588a8d60 tx=0x7fc97001da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ca73e9f21058f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.943+0000 7fc95cff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970004440 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7fc9700118f0 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c01cd40 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fc97002e050 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 10 client.18915 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x563458910c40 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96c01cd40 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7fc970026400 con 0x56345888b5d0 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 10 client.18915 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 10 client.18915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:02:28.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 20 client.18915 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563458911480 0x5634589138a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 4 client.18915 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.944+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634587f8d70 con 0x563458911480 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.946+0000 7fc978d62640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563458911480 0x5634589138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.946+0000 7fc978d62640 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563458911480 0x5634589138a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72393acdcda426f5 server_cookie=4aeda09041db6d14 in_seq=0 out_seq=0 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.946+0000 7fc95cff9640 10 client.18915 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc95cff9640 1 -- 172.21.15.66:0/2570898512 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634587f8d70 con 0x563458911480 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc95cff9640 10 client.18915 handle_command_reply: tid=0 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 client.18915 shutdown 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 msgr2=0x56345889ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x5634588a8d60 tx=0x7fc97001da00 comp rx=0 tx=0).stop 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 shutdown_connections 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563458911480 0x5634589138a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563458896370 0x56345889a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc95cff9640 0 client.18915 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56345888cb40 0x563458899d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 --2- 172.21.15.66:0/2570898512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56345888b5d0 0x56345889ea20 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 >> 172.21.15.66:0/2570898512 conn(0x563458854310 msgr2=0x563458894890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 shutdown_connections 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 1 -- 172.21.15.66:0/2570898512 wait complete. 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.948+0000 7fc97dba0740 20 client.18915 trim_cache size 0 max 16384 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 msgr2=0x7fc9600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 0x7fc9600a58f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc96c026000 tx=0x7fc96c022000 comp rx=0 tx=0).stop 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 msgr2=0x7fc974198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc964005940 tx=0x7fc9640042f0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 shutdown_connections 2024-09-15T23:02:28.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9600a3430 0x7fc9600a58f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9741082a0 0x7fc97419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9741036e0 0x7fc974198b00 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 --2- 172.21.15.66:0/2413772147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc974102d30 0x7fc9741985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 >> 172.21.15.66:0/2413772147 conn(0x7fc9740fc7d0 msgr2=0x7fc974105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 shutdown_connections 2024-09-15T23:02:28.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:27.949+0000 7fc97b7c7640 1 -- 172.21.15.66:0/2413772147 wait complete. 2024-09-15T23:02:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:29 smithi087 ceph-mon[35290]: pgmap v539: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 787 KiB/s wr, 87 op/s 2024-09-15T23:02:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:29 smithi184 ceph-mon[35203]: pgmap v539: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 787 KiB/s wr, 87 op/s 2024-09-15T23:02:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:29 smithi066 ceph-mon[31185]: pgmap v539: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 787 KiB/s wr, 87 op/s 2024-09-15T23:02:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:31 smithi087 ceph-mon[35290]: pgmap v540: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-09-15T23:02:31.632 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:31 smithi066 ceph-mon[31185]: pgmap v540: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-09-15T23:02:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:31 smithi184 ceph-mon[35203]: pgmap v540: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-09-15T23:02:32.102 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:02:32.617 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:33.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.271+0000 7f01b5903640 1 -- 172.21.15.66:0/179823990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b01083f0 msgr2=0x7f01b01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.271+0000 7f01b5903640 1 --2- 172.21.15.66:0/179823990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b01083f0 0x7f01b01087d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009860 tx=0x7f01a002a380 comp rx=0 tx=0).stop 2024-09-15T23:02:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.279+0000 7f01b5903640 1 -- 172.21.15.66:0/179823990 shutdown_connections 2024-09-15T23:02:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.279+0000 7f01b5903640 1 --2- 172.21.15.66:0/179823990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b01150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.279+0000 7f01b5903640 1 --2- 172.21.15.66:0/179823990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b0108da0 0x7f01b010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.279+0000 7f01b5903640 1 --2- 172.21.15.66:0/179823990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b01083f0 0x7f01b01087d0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.280+0000 7f01b5903640 1 -- 172.21.15.66:0/179823990 >> 172.21.15.66:0/179823990 conn(0x7f01b0077af0 msgr2=0x7f01b0079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.289+0000 7f01b5903640 1 -- 172.21.15.66:0/179823990 shutdown_connections 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.293+0000 7f01b5903640 1 -- 172.21.15.66:0/179823990 wait complete. 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 Processor -- start 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 -- start start 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b01083f0 0x7f01b0114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 0x7f01b0110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01b006e650 con 0x7f01b0108da0 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01b006e4d0 con 0x7f01b01083f0 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.294+0000 7f01b5903640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01b006e7d0 con 0x7f01b010d520 2024-09-15T23:02:33.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.295+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.295+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45730/0 (socket says 172.21.15.66:45730) 2024-09-15T23:02:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.295+0000 7f01af7fe640 1 -- 172.21.15.66:0/2318159740 learned_addr learned my addr 172.21.15.66:0/2318159740 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.296+0000 7f01aeffd640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b01083f0 0x7f01b0114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.296+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 0x7f01b0110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01af7fe640 1 -- 172.21.15.66:0/2318159740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b01083f0 msgr2=0x7f01b0114d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b01083f0 0x7f01b0114d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01af7fe640 1 -- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 msgr2=0x7f01b0110e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 0x7f01b0110e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01af7fe640 1 -- 172.21.15.66:0/2318159740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b0111370 con 0x7f01b010d520 2024-09-15T23:02:33.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.297+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 0x7f01b0110e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:02:33.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.301+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b970 tx=0x7f01a800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.307+0000 7f01b4901640 1 -- 172.21.15.66:0/2318159740 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8019070 con 0x7f01b010d520 2024-09-15T23:02:33.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.307+0000 7f01b4901640 1 -- 172.21.15.66:0/2318159740 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a800cb40 con 0x7f01b010d520 2024-09-15T23:02:33.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.307+0000 7f01b4901640 1 -- 172.21.15.66:0/2318159740 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a80076a0 con 0x7f01b010d520 2024-09-15T23:02:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.311+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b0111660 con 0x7f01b010d520 2024-09-15T23:02:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.311+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b0111b50 con 0x7f01b010d520 2024-09-15T23:02:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.314+0000 7f01b7cdc740 1 Processor -- start 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 -- start start 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab0349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab03f340 0x55b1ab041730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b1aaf9a2f0 con 0x55b1ab0345a0 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b1aaf41cf0 con 0x55b1ab03f340 2024-09-15T23:02:33.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.319+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b1aaf962b0 con 0x55b1ab035b10 2024-09-15T23:02:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.321+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.321+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab03f340 0x55b1ab041730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.321+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45734/0 (socket says 172.21.15.66:45734) 2024-09-15T23:02:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.321+0000 7f01ae7fc640 1 -- 172.21.15.66:0/1040803783 learned_addr learned my addr 172.21.15.66:0/1040803783 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.325+0000 7f01aeffd640 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab0349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.325+0000 7f01b4901640 1 -- 172.21.15.66:0/2318159740 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f01a800ccf0 con 0x7f01b010d520 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01ae7fc640 1 -- 172.21.15.66:0/1040803783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab03f340 msgr2=0x55b1ab041730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab03f340 0x55b1ab041730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01ae7fc640 1 -- 172.21.15.66:0/1040803783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 msgr2=0x55b1ab0349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab0349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01ae7fc640 1 -- 172.21.15.66:0/1040803783 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1aaf263a0 con 0x55b1ab035b10 2024-09-15T23:02:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01b4901640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 0x7f01980a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.326+0000 7f01b4901640 1 -- 172.21.15.66:0/2318159740 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f01a80cf5c0 con 0x7f01b010d520 2024-09-15T23:02:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.327+0000 7f01aeffd640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 0x7f01980a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.328+0000 7f01aeffd640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 0x7f01980a5a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009830 tx=0x7f01a002a880 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.334+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005ab0 tx=0x7f01a4005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7bf68bcaff0195e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.337+0000 7f019dffb640 1 -- 172.21.15.66:0/1040803783 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4021900 con 0x55b1ab035b10 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.337+0000 7f019dffb640 1 -- 172.21.15.66:0/1040803783 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a4023430 con 0x55b1ab035b10 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.338+0000 7f01b7cdc740 1 -- 172.21.15.66:0/1040803783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 msgr2=0x55b1ab034060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.338+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005ab0 tx=0x7f01a4005a00 comp rx=0 tx=0).stop 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.339+0000 7f01b7cdc740 1 -- 172.21.15.66:0/1040803783 shutdown_connections 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.339+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab03f340 0x55b1ab041730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.339+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab0349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.339+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/1040803783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab035b10 0x55b1ab034060 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.339+0000 7f01b7cdc740 1 -- 172.21.15.66:0/1040803783 >> 172.21.15.66:0/1040803783 conn(0x55b1aaffd310 msgr2=0x55b1ab030c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.340+0000 7f01b7cdc740 1 -- 172.21.15.66:0/1040803783 shutdown_connections 2024-09-15T23:02:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.345+0000 7f01b7cdc740 1 -- 172.21.15.66:0/1040803783 wait complete. 2024-09-15T23:02:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.345+0000 7f01b7cdc740 1 -- start start 2024-09-15T23:02:33.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.345+0000 7f01b7cdc740 1 Processor -- start 2024-09-15T23:02:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.349+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab03ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.349+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab03bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b1ab042090 con 0x55b1ab035b10 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b1aaf55060 con 0x55b1ab0345a0 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45744/0 (socket says 172.21.15.66:45744) 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 -- 172.21.15.66:0/2925172772 learned_addr learned my addr 172.21.15.66:0/2925172772 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b1ab042210 con 0x55b1ab03f340 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01b7cdc740 10 client.0 _ll_register_callbacks cb 0x55b1aaca88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 -- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 msgr2=0x55b1ab03ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab03ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 -- 172.21.15.66:0/2925172772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 msgr2=0x55b1ab03bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab03bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.350+0000 7f01af7fe640 1 -- 172.21.15.66:0/2925172772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1aad0b3c0 con 0x55b1ab03f340 2024-09-15T23:02:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.354+0000 7f01af7fe640 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01a8097e40 tx=0x7f01a809ae90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4499479dc3f598fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.355+0000 7f0192ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:33.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.361+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a80ccc60 con 0x55b1ab03f340 2024-09-15T23:02:33.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.361+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f01a80cf360 con 0x55b1ab03f340 2024-09-15T23:02:33.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.361+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01a4023430 con 0x55b1ab03f340 2024-09-15T23:02:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.365+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f01a809f820 con 0x55b1ab03f340 2024-09-15T23:02:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.365+0000 7f01b7cdc740 10 client.28072 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.365+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55b1ab04db20 con 0x55b1ab03f340 2024-09-15T23:02:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a4023430 con 0x55b1ab03f340 2024-09-15T23:02:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f01a809a8c0 con 0x55b1ab03f340 2024-09-15T23:02:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 10 client.28072 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 10 client.28072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 20 client.28072 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab04f4e0 0x55b1ab0519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.373 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:33 smithi066 ceph-mon[31185]: pgmap v541: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-15T23:02:33.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 4 client.28072 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:33.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.366+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1aafa7860 con 0x55b1ab04f4e0 2024-09-15T23:02:33.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.368+0000 7f01aeffd640 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab04f4e0 0x55b1ab0519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.377+0000 7f01aeffd640 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab04f4e0 0x55b1ab0519a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf1fddd5edf8e12 server_cookie=c560b15e88b9fbc4 in_seq=0 out_seq=0 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.377+0000 7f0192ffd640 10 client.28072 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.379+0000 7f0192ffd640 1 -- 172.21.15.66:0/2925172772 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1aafa7860 con 0x55b1ab04f4e0 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.379+0000 7f0192ffd640 10 client.28072 handle_command_reply: tid=0 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.379+0000 7f01b7cdc740 1 client.28072 shutdown 2024-09-15T23:02:33.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.385+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 msgr2=0x55b1ab03c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.385+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01a8097e40 tx=0x7f01a809ae90 comp rx=0 tx=0).stop 2024-09-15T23:02:33.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 shutdown_connections 2024-09-15T23:02:33.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab03c450 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab03bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab04f4e0 0x55b1ab0519a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/2925172772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab03ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 >> 172.21.15.66:0/2925172772 conn(0x55b1aaffd310 msgr2=0x55b1ab036930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.386+0000 7f0192ffd640 0 client.28072 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.390+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 shutdown_connections 2024-09-15T23:02:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.390+0000 7f01b7cdc740 1 -- 172.21.15.66:0/2925172772 wait complete. 2024-09-15T23:02:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.390+0000 7f01b7cdc740 20 client.28072 trim_cache size 0 max 16384 2024-09-15T23:02:33.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.416+0000 7f01b7cdc740 1 Processor -- start 2024-09-15T23:02:33.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.417+0000 7f01b7cdc740 1 -- start start 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.417+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab04b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.417+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.418+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.418+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a49a0 con 0x55b1ab0345a0 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.418+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a67b0 con 0x55b1ab035b10 2024-09-15T23:02:33.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.418+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a5100 con 0x55b1ab03f340 2024-09-15T23:02:33.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.419+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.419+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57258/0 (socket says 172.21.15.66:57258) 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.419+0000 7f01ae7fc640 1 -- 172.21.15.66:0/755888105 learned_addr learned my addr 172.21.15.66:0/755888105 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.419+0000 7f01af7fe640 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 -- 172.21.15.66:0/755888105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 msgr2=0x55b1ab0577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab0577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 -- 172.21.15.66:0/755888105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 msgr2=0x55b1ab04b3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab04b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 -- 172.21.15.66:0/755888105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ab03efd0 con 0x55b1ab035b10 2024-09-15T23:02:33.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.420+0000 7f01ae7fc640 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005d50 tx=0x7f01a4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97042f74cb80fd45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.422+0000 7f019d7fa640 1 -- 172.21.15.66:0/755888105 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a40265a0 con 0x55b1ab035b10 2024-09-15T23:02:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.422+0000 7f019d7fa640 1 -- 172.21.15.66:0/755888105 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a4021900 con 0x55b1ab035b10 2024-09-15T23:02:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.422+0000 7f019d7fa640 1 -- 172.21.15.66:0/755888105 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a40052a0 con 0x55b1ab035b10 2024-09-15T23:02:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.423+0000 7f01b7cdc740 1 -- 172.21.15.66:0/755888105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 msgr2=0x55b1ab0572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.424+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005d50 tx=0x7f01a4005850 comp rx=0 tx=0).stop 2024-09-15T23:02:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.427+0000 7f01b7cdc740 1 -- 172.21.15.66:0/755888105 shutdown_connections 2024-09-15T23:02:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.427+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab0577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.427+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab035b10 0x55b1ab0572b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.427+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/755888105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab0345a0 0x55b1ab04b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.427+0000 7f01b7cdc740 1 -- 172.21.15.66:0/755888105 >> 172.21.15.66:0/755888105 conn(0x55b1aaffd310 msgr2=0x55b1ab03a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.428+0000 7f01b7cdc740 1 -- 172.21.15.66:0/755888105 shutdown_connections 2024-09-15T23:02:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.428+0000 7f01b7cdc740 1 -- 172.21.15.66:0/755888105 wait complete. 2024-09-15T23:02:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.428+0000 7f01b7cdc740 1 -- start start 2024-09-15T23:02:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.429+0000 7f01b7cdc740 1 Processor -- start 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.429+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab0479f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.429+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab042d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01aeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab0479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01aeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab0479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57264/0 (socket says 172.21.15.66:57264) 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01b7cdc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab043260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a6020 con 0x55b1ab035b10 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a5890 con 0x55b1ab0345a0 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01b7cdc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01b01a29a0 con 0x55b1ab03f340 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01b7cdc740 10 client.0 _ll_register_callbacks cb 0x7f01a8014a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab042d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab042d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52878/0 (socket says 172.21.15.66:52878) 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01ae7fc640 1 -- 172.21.15.66:0/3410818590 learned_addr learned my addr 172.21.15.66:0/3410818590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.430+0000 7f01af7fe640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab043260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.431+0000 7f01af7fe640 1 -- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 msgr2=0x55b1ab0479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.431+0000 7f01af7fe640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab0479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.431+0000 7f01af7fe640 1 -- 172.21.15.66:0/3410818590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 msgr2=0x55b1ab042d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.431+0000 7f01af7fe640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab042d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.431+0000 7f01af7fe640 1 -- 172.21.15.66:0/3410818590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ab043820 con 0x55b1ab03f340 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.432+0000 7f01af7fe640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab043260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b940 tx=0x7f01a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1843d7af3afb81c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.432+0000 7f0192ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.434+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a80ccc60 con 0x55b1ab03f340 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.435+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01a4021900 con 0x55b1ab03f340 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.439+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9775+0+0 (secure 0 0 0) 0x7f01a80cf160 con 0x55b1ab03f340 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.439+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f01a809afb0 con 0x55b1ab03f340 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.439+0000 7f01b7cdc740 10 client.28078 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.439+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55b1ab0b9ff0 con 0x55b1ab03f340 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.440+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01a4021900 con 0x55b1ab03f340 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f01a80a09b0 con 0x55b1ab03f340 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 10 client.28078 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 10 client.28078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 20 client.28078 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab0ba660 0x55b1ab0bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 4 client.28078 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.442+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1aafa1d70 con 0x55b1ab0ba660 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.445+0000 7f01aeffd640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab0ba660 0x55b1ab0bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:33.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.453+0000 7f01aeffd640 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab0ba660 0x55b1ab0bca80 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d8607231e66a14b server_cookie=796977261076a7c4 in_seq=0 out_seq=0 2024-09-15T23:02:33.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.453+0000 7f0192ffd640 10 client.28078 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:33.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.456+0000 7f0192ffd640 1 -- 172.21.15.66:0/3410818590 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1aafa1d70 con 0x55b1ab0ba660 2024-09-15T23:02:33.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.456+0000 7f0192ffd640 10 client.28078 handle_command_reply: tid=0 2024-09-15T23:02:33.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.457+0000 7f01b7cdc740 1 client.28078 shutdown 2024-09-15T23:02:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.461+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 msgr2=0x55b1ab043260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.461+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab043260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b940 tx=0x7f01a8009780 comp rx=0 tx=0).stop 2024-09-15T23:02:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 shutdown_connections 2024-09-15T23:02:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b1ab03f340 0x55b1ab043260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b1ab035b10 0x55b1ab042d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55b1ab0ba660 0x55b1ab0bca80 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 --2- 172.21.15.66:0/3410818590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1ab0345a0 0x55b1ab0479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 >> 172.21.15.66:0/3410818590 conn(0x55b1aaffd310 msgr2=0x55b1ab03d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f0192ffd640 0 client.28078 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 shutdown_connections 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 1 -- 172.21.15.66:0/3410818590 wait complete. 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.466+0000 7f01b7cdc740 20 client.28078 trim_cache size 0 max 16384 2024-09-15T23:02:33.469 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:02:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 msgr2=0x7f01980a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 0x7f01980a5a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009830 tx=0x7f01a002a880 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 msgr2=0x7f01b0082a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b970 tx=0x7f01a800be30 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 shutdown_connections 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01980a35c0 0x7f01980a5a80 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009830 tx=0x7f01a002a880 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01b010d520 0x7f01b0082a90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01b0108da0 0x7f01b0110e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 --2- 172.21.15.66:0/2318159740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01b01083f0 0x7f01b0114d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 >> 172.21.15.66:0/2318159740 conn(0x7f01b0077af0 msgr2=0x7f01b0078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.467+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 shutdown_connections 2024-09-15T23:02:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:33.469+0000 7f01b5903640 1 -- 172.21.15.66:0/2318159740 wait complete. 2024-09-15T23:02:33.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:33 smithi087 ceph-mon[35290]: pgmap v541: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-15T23:02:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:33 smithi184 ceph-mon[35203]: pgmap v541: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-15T23:02:35.323 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:02:35.323 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:02:35.373 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:35 smithi066 ceph-mon[31185]: pgmap v542: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 95 op/s 2024-09-15T23:02:35.373 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:35 smithi066 ceph-mon[31185]: osdmap e114: 12 total, 12 up, 12 in 2024-09-15T23:02:35.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:35 smithi184 ceph-mon[35203]: pgmap v542: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 95 op/s 2024-09-15T23:02:35.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:35 smithi184 ceph-mon[35203]: osdmap e114: 12 total, 12 up, 12 in 2024-09-15T23:02:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:35 smithi087 ceph-mon[35290]: pgmap v542: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 95 op/s 2024-09-15T23:02:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:35 smithi087 ceph-mon[35290]: osdmap e114: 12 total, 12 up, 12 in 2024-09-15T23:02:35.859 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:37.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:37 smithi184 ceph-mon[35203]: pgmap v544: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-09-15T23:02:37.447 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:37 smithi066 ceph-mon[31185]: pgmap v544: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-09-15T23:02:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:37 smithi087 ceph-mon[35290]: pgmap v544: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-09-15T23:02:37.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.908+0000 7ff5cd59a640 1 -- 172.21.15.66:0/292947505 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80395e0 con 0x7ff5d0102ef0 2024-09-15T23:02:37.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.908+0000 7ff5d4e05640 1 -- 172.21.15.66:0/292947505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0102ef0 msgr2=0x7ff5d010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:37.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.908+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/292947505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0102ef0 0x7ff5d010da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009cd0 tx=0x7ff5c8032e90 comp rx=0 tx=0).stop 2024-09-15T23:02:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.912+0000 7ff5d4e05640 1 -- 172.21.15.66:0/292947505 shutdown_connections 2024-09-15T23:02:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.912+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/292947505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0102ef0 0x7ff5d010da40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.912+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/292947505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d0102570 0x7ff5d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.912+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/292947505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0100e20 0x7ff5d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.912+0000 7ff5d4e05640 1 -- 172.21.15.66:0/292947505 >> 172.21.15.66:0/292947505 conn(0x7ff5d00fc7d0 msgr2=0x7ff5d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:37.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.918+0000 7ff5d4e05640 1 -- 172.21.15.66:0/292947505 shutdown_connections 2024-09-15T23:02:37.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.919+0000 7ff5d4e05640 1 -- 172.21.15.66:0/292947505 wait complete. 2024-09-15T23:02:37.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 Processor -- start 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 -- start start 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0102570 0x7ff5d0073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0120f10 con 0x7ff5d0102570 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0120d90 con 0x7ff5d0100e20 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5d4e05640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d0121090 con 0x7ff5d0102ef0 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57276/0 (socket says 172.21.15.66:57276) 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.920+0000 7ff5ce59c640 1 -- 172.21.15.66:0/3756022357 learned_addr learned my addr 172.21.15.66:0/3756022357 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:37.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0102570 0x7ff5d0073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5ce59c640 1 -- 172.21.15.66:0/3756022357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d0102ef0 msgr2=0x7ff5d006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:37.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5ce59c640 1 -- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0102570 msgr2=0x7ff5d0073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:37.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0102570 0x7ff5d0073ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.921+0000 7ff5ce59c640 1 -- 172.21.15.66:0/3756022357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d006d4d0 con 0x7ff5d0100e20 2024-09-15T23:02:37.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.922+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0007860 tx=0x7ff5c0007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:37.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.923+0000 7ff5bf7fe640 1 -- 172.21.15.66:0/3756022357 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0019020 con 0x7ff5d0100e20 2024-09-15T23:02:37.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.923+0000 7ff5bf7fe640 1 -- 172.21.15.66:0/3756022357 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c0015470 con 0x7ff5d0100e20 2024-09-15T23:02:37.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.923+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d006d7c0 con 0x7ff5d0100e20 2024-09-15T23:02:37.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.923+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d00717b0 con 0x7ff5d0100e20 2024-09-15T23:02:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.925+0000 7ff5bf7fe640 1 -- 172.21.15.66:0/3756022357 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0014630 con 0x7ff5d0100e20 2024-09-15T23:02:37.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.929+0000 7ff5d71de740 1 Processor -- start 2024-09-15T23:02:37.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.929+0000 7ff5bf7fe640 1 -- 172.21.15.66:0/3756022357 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff5c001c020 con 0x7ff5d0100e20 2024-09-15T23:02:37.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.931+0000 7ff5bf7fe640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 0x7ff5b80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.931+0000 7ff5bf7fe640 1 -- 172.21.15.66:0/3756022357 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7ff5c00d1550 con 0x7ff5d0100e20 2024-09-15T23:02:37.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 -- start start 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5ced9d640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 0x7ff5b80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e40f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fb21da6280 con 0x55fb21e41480 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fb21d4db10 con 0x55fb21e40b60 2024-09-15T23:02:37.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.932+0000 7ff5d71de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fb21da2240 con 0x55fb21e4bd40 2024-09-15T23:02:37.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.935+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e40f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52906/0 (socket says 172.21.15.66:52906) 2024-09-15T23:02:37.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/2913500583 learned_addr learned my addr 172.21.15.66:0/2913500583 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/2913500583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 msgr2=0x55fb21e4e130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4e130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/2913500583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 msgr2=0x55fb21e40f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e40f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.936+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/2913500583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb21d5a1f0 con 0x55fb21e41480 2024-09-15T23:02:37.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.937+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400b7c0 tx=0x7ff5c400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea76979275e1b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:37.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.939+0000 7ff5bcff9640 1 -- 172.21.15.66:0/2913500583 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400d950 con 0x55fb21e41480 2024-09-15T23:02:37.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.939+0000 7ff5bcff9640 1 -- 172.21.15.66:0/2913500583 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4018070 con 0x55fb21e41480 2024-09-15T23:02:37.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.939+0000 7ff5bcff9640 1 -- 172.21.15.66:0/2913500583 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40123e0 con 0x55fb21e41480 2024-09-15T23:02:37.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.940+0000 7ff5d71de740 1 -- 172.21.15.66:0/2913500583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 msgr2=0x55fb21e4b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:37.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.940+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400b7c0 tx=0x7ff5c400bc80 comp rx=0 tx=0).stop 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5ced9d640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 0x7ff5b80a5a80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55fb21e3e470 tx=0x7ff5c8033a80 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5d71de740 1 -- 172.21.15.66:0/2913500583 shutdown_connections 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4b800 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2913500583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e40f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.941+0000 7ff5d71de740 1 -- 172.21.15.66:0/2913500583 >> 172.21.15.66:0/2913500583 conn(0x55fb21e3d0f0 msgr2=0x55fb21e3d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:37.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.944+0000 7ff5d71de740 1 -- 172.21.15.66:0/2913500583 shutdown_connections 2024-09-15T23:02:37.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.944+0000 7ff5d71de740 1 -- 172.21.15.66:0/2913500583 wait complete. 2024-09-15T23:02:37.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.944+0000 7ff5d71de740 1 -- start start 2024-09-15T23:02:37.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.944+0000 7ff5d71de740 1 Processor -- start 2024-09-15T23:02:37.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e4bd40 0x55fb21e496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fb21e4e910 con 0x55fb21e41480 2024-09-15T23:02:37.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fb21d60f10 con 0x55fb21e4bd40 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fb21e4ea90 con 0x55fb21e40b60 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5d71de740 10 client.0 _ll_register_callbacks cb 0x55fb21d29a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45792/0 (socket says 172.21.15.66:45792) 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5ce59c640 1 -- 172.21.15.66:0/1429941250 learned_addr learned my addr 172.21.15.66:0/1429941250 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:37.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.945+0000 7ff5ced9d640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e4bd40 0x55fb21e496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 -- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e4bd40 msgr2=0x55fb21e496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e4bd40 0x55fb21e496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 -- 172.21.15.66:0/1429941250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 msgr2=0x55fb21e49160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 -- 172.21.15.66:0/1429941250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb21b176a0 con 0x55fb21e40b60 2024-09-15T23:02:37.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.948+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0015ea0 tx=0x7ff5c009d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb0083bf51962fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:37.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.951+0000 7ff5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:02:37.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.951+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00cec20 con 0x55fb21e40b60 2024-09-15T23:02:37.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.951+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7ff5c0025bb0 con 0x55fb21e40b60 2024-09-15T23:02:37.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.953+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c4018070 con 0x55fb21e40b60 2024-09-15T23:02:37.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.958+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7ff5c0025db0 con 0x55fb21e40b60 2024-09-15T23:02:37.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.959+0000 7ff5d71de740 10 client.28081 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:37.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.959+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55fb21e5a600 con 0x55fb21e40b60 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.960+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4018070 con 0x55fb21e40b60 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.960+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7ff5c0099080 con 0x55fb21e40b60 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 10 client.28081 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 10 client.28081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 20 client.28081 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21e5bf90 0x55fb21e5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 4 client.28081 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:37.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.961+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb21db37f0 con 0x55fb21e5bf90 2024-09-15T23:02:37.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.962+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21e5bf90 0x55fb21e5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:37.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.966+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21e5bf90 0x55fb21e5e430 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03ce1d7d92e3687 server_cookie=8026096b01d2c8ec in_seq=0 out_seq=0 2024-09-15T23:02:37.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.966+0000 7ff5b5ffb640 10 client.28081 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:37.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.969+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/1429941250 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb21db37f0 con 0x55fb21e5bf90 2024-09-15T23:02:37.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.969+0000 7ff5b5ffb640 10 client.28081 handle_command_reply: tid=0 2024-09-15T23:02:37.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.969+0000 7ff5d71de740 1 client.28081 shutdown 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.972+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 msgr2=0x55fb21e48c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.972+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0015ea0 tx=0x7ff5c009d470 comp rx=0 tx=0).stop 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 shutdown_connections 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21e5bf90 0x55fb21e5e430 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e4bd40 0x55fb21e496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 --2- 172.21.15.66:0/1429941250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e48c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:37.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5b5ffb640 0 client.28081 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:37.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 >> 172.21.15.66:0/1429941250 conn(0x55fb21e3d0f0 msgr2=0x55fb21e42e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:37.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.973+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 shutdown_connections 2024-09-15T23:02:37.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.977+0000 7ff5d71de740 1 -- 172.21.15.66:0/1429941250 wait complete. 2024-09-15T23:02:37.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:37.978+0000 7ff5d71de740 20 client.28081 trim_cache size 0 max 16384 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 Processor -- start 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 -- start start 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e4aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e4bd40 0x55fb21e64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.011+0000 7ff5d71de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00102a0 con 0x55fb21e4bd40 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.012+0000 7ff5d71de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00120b0 con 0x55fb21e41480 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.012+0000 7ff5d71de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0010a00 con 0x55fb21e40b60 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.012+0000 7ff5cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.012+0000 7ff5cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57286/0 (socket says 172.21.15.66:57286) 2024-09-15T23:02:38.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.012+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/843073369 learned_addr learned my addr 172.21.15.66:0/843073369 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:38.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5ced9d640 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e4bd40 0x55fb21e64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/843073369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 msgr2=0x55fb21e4aa80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:02:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e4aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/843073369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e4bd40 msgr2=0x55fb21e64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e4bd40 0x55fb21e64280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.013+0000 7ff5cdd9b640 1 -- 172.21.15.66:0/843073369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb21e4b4f0 con 0x55fb21e41480 2024-09-15T23:02:38.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.018+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4014bd0 tx=0x7ff5c4013b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acad1ed300d3a04e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.021+0000 7ff5b7fff640 1 -- 172.21.15.66:0/843073369 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400db50 con 0x55fb21e41480 2024-09-15T23:02:38.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.021+0000 7ff5b7fff640 1 -- 172.21.15.66:0/843073369 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4018050 con 0x55fb21e41480 2024-09-15T23:02:38.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.022+0000 7ff5d71de740 1 -- 172.21.15.66:0/843073369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 msgr2=0x55fb21e63d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:38.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.022+0000 7ff5d71de740 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4014bd0 tx=0x7ff5c4013b50 comp rx=0 tx=0).stop 2024-09-15T23:02:38.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.025+0000 7ff5d71de740 1 -- 172.21.15.66:0/843073369 shutdown_connections 2024-09-15T23:02:38.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.025+0000 7ff5d71de740 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e4bd40 0x55fb21e64280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.025+0000 7ff5d71de740 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e41480 0x55fb21e63d40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.025+0000 7ff5d71de740 1 --2- 172.21.15.66:0/843073369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e40b60 0x55fb21e4aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.025+0000 7ff5d71de740 1 -- 172.21.15.66:0/843073369 >> 172.21.15.66:0/843073369 conn(0x55fb21e3d0f0 msgr2=0x55fb21e4a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:38.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.031+0000 7ff5d71de740 1 -- 172.21.15.66:0/843073369 shutdown_connections 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.032+0000 7ff5d71de740 1 -- 172.21.15.66:0/843073369 wait complete. 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 -- start start 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 Processor -- start 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0011920 con 0x55fb21e41480 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0011190 con 0x55fb21e40b60 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b000e280 con 0x55fb21e4bd40 2024-09-15T23:02:38.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.033+0000 7ff5d71de740 10 client.0 _ll_register_callbacks cb 0x7ff5c009d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.034+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.034+0000 7ff5ced9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.034+0000 7ff5ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57300/0 (socket says 172.21.15.66:57300) 2024-09-15T23:02:38.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.034+0000 7ff5ce59c640 1 -- 172.21.15.66:0/2755688193 learned_addr learned my addr 172.21.15.66:0/2755688193 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:38.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.037+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.038+0000 7ff5ce59c640 1 -- 172.21.15.66:0/2755688193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 msgr2=0x55fb21e4ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:38.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.038+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.038+0000 7ff5ce59c640 1 -- 172.21.15.66:0/2755688193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 msgr2=0x55fb21e4f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:38.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.038+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.038+0000 7ff5ce59c640 1 -- 172.21.15.66:0/2755688193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb21e50770 con 0x55fb21e40b60 2024-09-15T23:02:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.042+0000 7ff5ce59c640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0099790 tx=0x7ff5c00cecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da841644c1972f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:38.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.042+0000 7ff5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:02:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.043+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00bb080 con 0x55fb21e40b60 2024-09-15T23:02:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.043+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7ff5c009c990 con 0x55fb21e40b60 2024-09-15T23:02:38.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.044+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c4018050 con 0x55fb21e40b60 2024-09-15T23:02:38.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.049+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7ff5c009da30 con 0x55fb21e40b60 2024-09-15T23:02:38.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.049+0000 7ff5d71de740 10 client.28196 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:38.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.049+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55fb21ee8e90 con 0x55fb21e40b60 2024-09-15T23:02:38.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.050+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4018050 con 0x55fb21e40b60 2024-09-15T23:02:38.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7ff5c009c1f0 con 0x55fb21e40b60 2024-09-15T23:02:38.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 10 client.28196 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:38.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 10 client.28196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:38.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 20 client.28196 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:38.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21ee94b0 0x55fb21eeb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:38.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 4 client.28196 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:02:38.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.051+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fb21dadd00 con 0x55fb21ee94b0 2024-09-15T23:02:38.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.055+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21ee94b0 0x55fb21eeb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:38.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.063+0000 7ff5cdd9b640 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21ee94b0 0x55fb21eeb8d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765c4bf5f18e98c3 server_cookie=bd6627268592d418 in_seq=0 out_seq=0 2024-09-15T23:02:38.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.064+0000 7ff5b5ffb640 10 client.28196 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:38.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.068+0000 7ff5b5ffb640 1 -- 172.21.15.66:0/2755688193 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fb21dadd00 con 0x55fb21ee94b0 2024-09-15T23:02:38.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.068+0000 7ff5b5ffb640 10 client.28196 handle_command_reply: tid=0 2024-09-15T23:02:38.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.068+0000 7ff5d71de740 1 client.28196 shutdown 2024-09-15T23:02:38.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.070+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 msgr2=0x55fb21e54600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:38.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.070+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0099790 tx=0x7ff5c00cecd0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 shutdown_connections 2024-09-15T23:02:38.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb21e4bd40 0x55fb21e4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fb21e41480 0x55fb21e4f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fb21ee94b0 0x55fb21eeb8d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 --2- 172.21.15.66:0/2755688193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb21e40b60 0x55fb21e54600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 >> 172.21.15.66:0/2755688193 conn(0x55fb21e3d0f0 msgr2=0x55fb21e493a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5b5ffb640 0 client.28196 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 shutdown_connections 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 1 -- 172.21.15.66:0/2755688193 wait complete. 2024-09-15T23:02:38.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.074+0000 7ff5d71de740 20 client.28196 trim_cache size 0 max 16384 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "7d92e62a-401f-4592-9a25-4074de60ac49", 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 msgr2=0x7ff5b80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 0x7ff5b80a5a80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55fb21e3e470 tx=0x7ff5c8033a80 comp rx=0 tx=0).stop 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 msgr2=0x7ff5d00739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0007860 tx=0x7ff5c0007d20 comp rx=0 tx=0).stop 2024-09-15T23:02:38.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 shutdown_connections 2024-09-15T23:02:38.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff5b80a35c0 0x7ff5b80a5a80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5d0102570 0x7ff5d0073ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 --2- 172.21.15.66:0/3756022357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5d0100e20 0x7ff5d00739a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:38.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.075+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 >> 172.21.15.66:0/3756022357 conn(0x7ff5d00fc7d0 msgr2=0x7ff5d01048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:38.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.082+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 shutdown_connections 2024-09-15T23:02:38.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:38.082+0000 7ff5d4e05640 1 -- 172.21.15.66:0/3756022357 wait complete. 2024-09-15T23:02:38.908 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:02:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:39 smithi184 ceph-mon[35203]: pgmap v545: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 94 op/s 2024-09-15T23:02:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:39 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T23:02:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:39 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:39 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:02:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:39 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:02:39.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:39 smithi066 ceph-mon[31185]: pgmap v545: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 94 op/s 2024-09-15T23:02:39.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:39 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T23:02:39.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:39 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:39.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:39 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:02:39.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:39 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:02:39.480 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:02:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:39 smithi087 ceph-mon[35290]: pgmap v545: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 94 op/s 2024-09-15T23:02:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:39 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T23:02:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:39 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:39 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:02:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:39 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:02:41.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:41 smithi184 ceph-mon[35203]: pgmap v546: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-09-15T23:02:41.438 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:41 smithi066 ceph-mon[31185]: pgmap v546: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-09-15T23:02:41.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.492+0000 7f234fd0f640 1 -- 172.21.15.66:0/594685560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2348108b50 msgr2=0x7f2348115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.492+0000 7f234fd0f640 1 --2- 172.21.15.66:0/594685560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2348108b50 0x7f2348115070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2340009ca0 tx=0x7f234002a8e0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.496+0000 7f234fd0f640 1 -- 172.21.15.66:0/594685560 shutdown_connections 2024-09-15T23:02:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.496+0000 7f234fd0f640 1 --2- 172.21.15.66:0/594685560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2348108b50 0x7f2348115070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.496+0000 7f234fd0f640 1 --2- 172.21.15.66:0/594685560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23481081f0 0x7f2348108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.496+0000 7f234fd0f640 1 --2- 172.21.15.66:0/594685560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f234810e230 0x7f234810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.496+0000 7f234fd0f640 1 -- 172.21.15.66:0/594685560 >> 172.21.15.66:0/594685560 conn(0x7f2348077bb0 msgr2=0x7f2348079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.497+0000 7f234fd0f640 1 -- 172.21.15.66:0/594685560 shutdown_connections 2024-09-15T23:02:41.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.497+0000 7f234fd0f640 1 -- 172.21.15.66:0/594685560 wait complete. 2024-09-15T23:02:41.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 Processor -- start 2024-09-15T23:02:41.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 -- start start 2024-09-15T23:02:41.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 0x7f23481a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 0x7f23481a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f234810e230 0x7f234819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2348118600 con 0x7f234810e230 2024-09-15T23:02:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2348118480 con 0x7f23481081f0 2024-09-15T23:02:41.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.498+0000 7f234fd0f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2348118780 con 0x7f2348108b50 2024-09-15T23:02:41.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.499+0000 7f234daab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 0x7f23481a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.500+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 0x7f23481a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.500+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 0x7f23481a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:45840/0 (socket says 172.21.15.66:45840) 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.500+0000 7f234d2aa640 1 -- 172.21.15.66:0/3034240738 learned_addr learned my addr 172.21.15.66:0/3034240738 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.501+0000 7f234daab640 1 -- 172.21.15.66:0/3034240738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 msgr2=0x7f23481a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.501+0000 7f234daab640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 0x7f23481a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.501+0000 7f234daab640 1 -- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f234810e230 msgr2=0x7f234819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.501+0000 7f234daab640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f234810e230 0x7f234819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.501+0000 7f234daab640 1 -- 172.21.15.66:0/3034240738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234819efc0 con 0x7f23481081f0 2024-09-15T23:02:41.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.505+0000 7f234daab640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 0x7f23481a46d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f234400d6d0 tx=0x7f234400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.511+0000 7f233effd640 1 -- 172.21.15.66:0/3034240738 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344017070 con 0x7f23481081f0 2024-09-15T23:02:41.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.512+0000 7f233effd640 1 -- 172.21.15.66:0/3034240738 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2344009820 con 0x7f23481081f0 2024-09-15T23:02:41.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.512+0000 7f233effd640 1 -- 172.21.15.66:0/3034240738 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344004d00 con 0x7f23481081f0 2024-09-15T23:02:41.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.512+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234819f2b0 con 0x7f23481081f0 2024-09-15T23:02:41.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.512+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23481ab5a0 con 0x7f23481081f0 2024-09-15T23:02:41.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.518+0000 7f233effd640 1 -- 172.21.15.66:0/3034240738 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2344010460 con 0x7f23481081f0 2024-09-15T23:02:41.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.519+0000 7f233effd640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 0x7f23340a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.520+0000 7f233effd640 1 -- 172.21.15.66:0/3034240738 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7f23440d0ab0 con 0x7f23481081f0 2024-09-15T23:02:41.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.520+0000 7f234d2aa640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 0x7f23340a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.523+0000 7f23520e8740 1 Processor -- start 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 -- start start 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c24c0 0x5623870c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c2de0 0x5623870cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5623870282e0 con 0x5623870cd6a0 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562386fcfce0 con 0x5623870c24c0 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f23520e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5623870242a0 con 0x5623870c2de0 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.524+0000 7f234d2aa640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 0x7f23340a5a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f234810d860 tx=0x7f23380091c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.525+0000 7f234e2ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.525+0000 7f234e2ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52968/0 (socket says 172.21.15.66:52968) 2024-09-15T23:02:41.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.525+0000 7f234e2ac640 1 -- 172.21.15.66:0/3658231155 learned_addr learned my addr 172.21.15.66:0/3658231155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:41.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.526+0000 7f234daab640 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c24c0 0x5623870c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 -- 172.21.15.66:0/3658231155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c2de0 msgr2=0x5623870cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c2de0 0x5623870cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 -- 172.21.15.66:0/3658231155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c24c0 msgr2=0x5623870c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c24c0 0x5623870c28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 -- 172.21.15.66:0/3658231155 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562386fb4440 con 0x5623870cd6a0 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.528+0000 7f234e2ac640 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2340004af0 tx=0x7f2340009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552e1e5a38de73a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.529+0000 7f2333fff640 1 -- 172.21.15.66:0/3658231155 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2340031770 con 0x5623870cd6a0 2024-09-15T23:02:41.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.530+0000 7f2333fff640 1 -- 172.21.15.66:0/3658231155 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2340036040 con 0x5623870cd6a0 2024-09-15T23:02:41.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.530+0000 7f2333fff640 1 -- 172.21.15.66:0/3658231155 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23400043e0 con 0x5623870cd6a0 2024-09-15T23:02:41.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.531+0000 7f23520e8740 1 -- 172.21.15.66:0/3658231155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 msgr2=0x5623870cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.531+0000 7f23520e8740 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2340004af0 tx=0x7f2340009a20 comp rx=0 tx=0).stop 2024-09-15T23:02:41.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.534+0000 7f23520e8740 1 -- 172.21.15.66:0/3658231155 shutdown_connections 2024-09-15T23:02:41.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.534+0000 7f23520e8740 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870cfa90 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.534+0000 7f23520e8740 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c2de0 0x5623870cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.534+0000 7f23520e8740 1 --2- 172.21.15.66:0/3658231155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c24c0 0x5623870c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.534+0000 7f23520e8740 1 -- 172.21.15.66:0/3658231155 >> 172.21.15.66:0/3658231155 conn(0x5623870bea50 msgr2=0x5623870bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.539+0000 7f23520e8740 1 -- 172.21.15.66:0/3658231155 shutdown_connections 2024-09-15T23:02:41.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.541+0000 7f23520e8740 1 -- 172.21.15.66:0/3658231155 wait complete. 2024-09-15T23:02:41.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.541+0000 7f23520e8740 1 -- start start 2024-09-15T23:02:41.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.541+0000 7f23520e8740 1 Processor -- start 2024-09-15T23:02:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5623870d0270 con 0x5623870c24c0 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x562386fe3050 con 0x5623870c2de0 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5623870d03f0 con 0x5623870cd6a0 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.543+0000 7f23520e8740 10 client.0 _ll_register_callbacks cb 0x562387023160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.544+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.544+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57344/0 (socket says 172.21.15.66:57344) 2024-09-15T23:02:41.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.544+0000 7f234d2aa640 1 -- 172.21.15.66:0/581683689 learned_addr learned my addr 172.21.15.66:0/581683689 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:41.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.545+0000 7f234e2ac640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.547+0000 7f234daab640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.548+0000 7f234d2aa640 1 -- 172.21.15.66:0/581683689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 msgr2=0x5623870ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.548+0000 7f234d2aa640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.548+0000 7f234d2aa640 1 -- 172.21.15.66:0/581683689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 msgr2=0x5623870cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.548+0000 7f234d2aa640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.548+0000 7f234d2aa640 1 -- 172.21.15.66:0/581683689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562386d993c0 con 0x5623870c2de0 2024-09-15T23:02:41.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.551+0000 7f234d2aa640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f23380157f0 tx=0x7f2338015bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f904a2475a6550bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.551+0000 7f23317fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:02:41.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.554+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23380138d0 con 0x5623870c2de0 2024-09-15T23:02:41.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.554+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7f2338013a70 con 0x5623870c2de0 2024-09-15T23:02:41.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.555+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2340036040 con 0x5623870c2de0 2024-09-15T23:02:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.558+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f2338013c70 con 0x5623870c2de0 2024-09-15T23:02:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.559+0000 7f23520e8740 10 client.28205 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:41.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.559+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x5623870ecd70 con 0x5623870c2de0 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.565+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2340036040 con 0x5623870c2de0 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.565+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f23380144f0 con 0x5623870c2de0 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 10 client.28205 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 10 client.28205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 20 client.28205 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5623870ee280 0x5623870f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 4 client.28205 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:02:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.567+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562387035850 con 0x5623870ee280 2024-09-15T23:02:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.569+0000 7f234daab640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5623870ee280 0x5623870f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.574+0000 7f234daab640 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5623870ee280 0x5623870f0670 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17bf7c9b5a1df176 server_cookie=ec65a62e596f9990 in_seq=0 out_seq=0 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.575+0000 7f23317fa640 10 client.28205 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.575+0000 7f23317fa640 1 -- 172.21.15.66:0/581683689 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562387035850 con 0x5623870ee280 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.575+0000 7f23317fa640 10 client.28205 handle_command_reply: tid=0 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 client.28205 shutdown 2024-09-15T23:02:41.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 msgr2=0x5623870ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f23380157f0 tx=0x7f2338015bf0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 shutdown_connections 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5623870ee280 0x5623870f0670 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870ca370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 --2- 172.21.15.66:0/581683689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.576+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 >> 172.21.15.66:0/581683689 conn(0x5623870bea50 msgr2=0x5623870bdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.577+0000 7f23317fa640 0 client.28205 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:41.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.578+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 shutdown_connections 2024-09-15T23:02:41.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.579+0000 7f23520e8740 1 -- 172.21.15.66:0/581683689 wait complete. 2024-09-15T23:02:41.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.579+0000 7f23520e8740 20 client.28205 trim_cache size 0 max 16384 2024-09-15T23:02:41.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:41 smithi087 ceph-mon[35290]: pgmap v546: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-09-15T23:02:41.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.617+0000 7f23520e8740 1 Processor -- start 2024-09-15T23:02:41.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.620+0000 7f23520e8740 1 -- start start 2024-09-15T23:02:41.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.620+0000 7f23520e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.620+0000 7f23520e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.620+0000 7f23520e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.621+0000 7f23520e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23481ad340 con 0x5623870c24c0 2024-09-15T23:02:41.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.621+0000 7f23520e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23481af150 con 0x5623870c2de0 2024-09-15T23:02:41.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.621+0000 7f23520e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f23481adaa0 con 0x5623870cd6a0 2024-09-15T23:02:41.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.622+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.623+0000 7f234e2ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.625+0000 7f234d2aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:57356/0 (socket says 172.21.15.66:57356) 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.625+0000 7f234d2aa640 1 -- 172.21.15.66:0/3096655553 learned_addr learned my addr 172.21.15.66:0/3096655553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.626+0000 7f234daab640 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 -- 172.21.15.66:0/3096655553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 msgr2=0x5623870f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 -- 172.21.15.66:0/3096655553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 msgr2=0x5623870cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 -- 172.21.15.66:0/3096655553 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623870c2240 con 0x5623870c24c0 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.627+0000 7f234daab640 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870c92b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f23440cdd00 tx=0x7f23440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e915ab2376df01b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.628+0000 7f23337fe640 1 -- 172.21.15.66:0/3096655553 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440ba070 con 0x5623870c24c0 2024-09-15T23:02:41.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.628+0000 7f23337fe640 1 -- 172.21.15.66:0/3096655553 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23440a5500 con 0x5623870c24c0 2024-09-15T23:02:41.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.629+0000 7f23337fe640 1 -- 172.21.15.66:0/3096655553 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344014030 con 0x5623870c24c0 2024-09-15T23:02:41.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.629+0000 7f23520e8740 1 -- 172.21.15.66:0/3096655553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 msgr2=0x5623870c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.629+0000 7f23520e8740 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870c92b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f23440cdd00 tx=0x7f23440057f0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.634+0000 7f23520e8740 1 -- 172.21.15.66:0/3096655553 shutdown_connections 2024-09-15T23:02:41.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.634+0000 7f23520e8740 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870cd6a0 0x5623870f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.634+0000 7f23520e8740 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.634+0000 7f23520e8740 1 --2- 172.21.15.66:0/3096655553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870c24c0 0x5623870c92b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.634+0000 7f23520e8740 1 -- 172.21.15.66:0/3096655553 >> 172.21.15.66:0/3096655553 conn(0x5623870bea50 msgr2=0x5623870cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.640+0000 7f23520e8740 1 -- 172.21.15.66:0/3096655553 shutdown_connections 2024-09-15T23:02:41.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.641+0000 7f23520e8740 1 -- 172.21.15.66:0/3096655553 wait complete. 2024-09-15T23:02:41.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.641+0000 7f23520e8740 1 -- start start 2024-09-15T23:02:41.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.641+0000 7f23520e8740 1 Processor -- start 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.645+0000 7f23520e8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c24c0 0x5623870d5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.645+0000 7f23520e8740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.645+0000 7f23520e8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f23520e8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23481ae9c0 con 0x5623870cd6a0 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f23520e8740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23481ae230 con 0x5623870c2de0 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f23520e8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2348082da0 con 0x5623870c24c0 2024-09-15T23:02:41.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f23520e8740 10 client.0 _ll_register_callbacks cb 0x7f233800e820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:02:41.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f234e2ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f234e2ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53002/0 (socket says 172.21.15.66:53002) 2024-09-15T23:02:41.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.646+0000 7f234e2ac640 1 -- 172.21.15.66:0/1567924721 learned_addr learned my addr 172.21.15.66:0/1567924721 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:02:41.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.648+0000 7f234d2aa640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.650+0000 7f234daab640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c24c0 0x5623870d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.652+0000 7f234e2ac640 1 -- 172.21.15.66:0/1567924721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c24c0 msgr2=0x5623870d5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.652+0000 7f234e2ac640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c24c0 0x5623870d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.652+0000 7f234e2ac640 1 -- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 msgr2=0x5623870d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.652+0000 7f234e2ac640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.652+0000 7f234e2ac640 1 -- 172.21.15.66:0/1567924721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623870d14d0 con 0x5623870cd6a0 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.653+0000 7f234e2ac640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x5623870bfdd0 tx=0x7f2340031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b423a812520406 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:02:41.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.653+0000 7f23317fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:02:41.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.655+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23400305e0 con 0x5623870cd6a0 2024-09-15T23:02:41.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.655+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9699+0+0 (secure 0 0 0) 0x7f2340030780 con 0x5623870cd6a0 2024-09-15T23:02:41.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.658+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23440a5500 con 0x5623870cd6a0 2024-09-15T23:02:41.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.660+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f2340030980 con 0x5623870cd6a0 2024-09-15T23:02:41.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.660+0000 7f23520e8740 10 client.18951 fetch_fsmap learned FSMap version 64 2024-09-15T23:02:41.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.660+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x562387158ae0 con 0x5623870cd6a0 2024-09-15T23:02:41.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23440a5500 con 0x5623870cd6a0 2024-09-15T23:02:41.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 64) ==== 8446+0+0 (secure 0 0 0) 0x7f2340054030 con 0x5623870cd6a0 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 10 client.18951 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 10 client.18951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 20 client.18951 populate_metadata read hostname 'smithi066' 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562387159110 0x56238715b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 4 client.18951 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:02:41.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.661+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56238702fd60 con 0x562387159110 2024-09-15T23:02:41.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.670+0000 7f234daab640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562387159110 0x56238715b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:02:41.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.677+0000 7f234daab640 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562387159110 0x56238715b530 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66321b89ae950351 server_cookie=afa04743c8cf26ff in_seq=0 out_seq=0 2024-09-15T23:02:41.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.677+0000 7f23317fa640 10 client.18951 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:41.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.677+0000 7f23317fa640 1 -- 172.21.15.66:0/1567924721 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x56238702fd60 con 0x562387159110 2024-09-15T23:02:41.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.677+0000 7f23317fa640 10 client.18951 handle_command_reply: tid=0 2024-09-15T23:02:41.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.677+0000 7f23520e8740 1 client.18951 shutdown 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 msgr2=0x5623870d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x5623870bfdd0 tx=0x7f2340031c40 comp rx=0 tx=0).stop 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 shutdown_connections 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5623870cd6a0 0x5623870d0ca0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x562387159110 0x56238715b530 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5623870c2de0 0x5623870d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 --2- 172.21.15.66:0/1567924721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623870c24c0 0x5623870d5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23317fa640 0 client.18951 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:02:41.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.678+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 >> 172.21.15.66:0/1567924721 conn(0x5623870bea50 msgr2=0x5623870c4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.681+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 shutdown_connections 2024-09-15T23:02:41.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.681+0000 7f23520e8740 1 -- 172.21.15.66:0/1567924721 wait complete. 2024-09-15T23:02:41.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.681+0000 7f23520e8740 20 client.18951 trim_cache size 0 max 16384 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (7432 inodes in the stack)", 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "7d92e62a-401f-4592-9a25-4074de60ac49": { 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "7d92e62a-401f-4592-9a25-4074de60ac49", 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:02:41.684 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 msgr2=0x7f23340a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 0x7f23340a5a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f234810d860 tx=0x7f23380091c0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 msgr2=0x7f23481a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 0x7f23481a46d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f234400d6d0 tx=0x7f234400db90 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 shutdown_connections 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f23340a3580 0x7f23340a5a40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f234810e230 0x7f234819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348108b50 0x7f23481a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 --2- 172.21.15.66:0/3034240738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23481081f0 0x7f23481a46d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 >> 172.21.15.66:0/3034240738 conn(0x7f2348077bb0 msgr2=0x7f23480792c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.682+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 shutdown_connections 2024-09-15T23:02:41.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:02:41.683+0000 7f234fd0f640 1 -- 172.21.15.66:0/3034240738 wait complete. 2024-09-15T23:02:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:43 smithi184 ceph-mon[35203]: pgmap v547: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 100 op/s 2024-09-15T23:02:43.440 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:43 smithi066 ceph-mon[31185]: pgmap v547: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 100 op/s 2024-09-15T23:02:43.498 INFO:tasks.cephfs.filesystem:scrub status for tag:7d92e62a-401f-4592-9a25-4074de60ac49 - {'path': '/', 'tag': '7d92e62a-401f-4592-9a25-4074de60ac49', 'options': 'recursive,force'} 2024-09-15T23:02:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:43 smithi087 ceph-mon[35290]: pgmap v547: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 100 op/s 2024-09-15T23:02:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:45 smithi184 ceph-mon[35203]: pgmap v548: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 106 op/s 2024-09-15T23:02:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:45 smithi066 ceph-mon[31185]: pgmap v548: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 106 op/s 2024-09-15T23:02:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:45 smithi087 ceph-mon[35290]: pgmap v548: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 106 op/s 2024-09-15T23:02:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:47 smithi184 ceph-mon[35203]: pgmap v549: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:47 smithi066 ceph-mon[31185]: pgmap v549: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:47 smithi087 ceph-mon[35290]: pgmap v549: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-09-15T23:02:49.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:49 smithi066 ceph-mon[31185]: pgmap v550: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2024-09-15T23:02:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:49 smithi087 ceph-mon[35290]: pgmap v550: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2024-09-15T23:02:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:49 smithi184 ceph-mon[35203]: pgmap v550: 129 pgs: 17 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 69 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 111 op/s 2024-09-15T23:02:51.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:51 smithi066 ceph-mon[31185]: pgmap v551: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-15T23:02:51.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:51 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:51 smithi087 ceph-mon[35290]: pgmap v551: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-15T23:02:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:51 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:51 smithi184 ceph-mon[35203]: pgmap v551: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-15T23:02:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:51 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:53.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:53 smithi066 ceph-mon[31185]: pgmap v552: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-15T23:02:53.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:02:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:53 smithi087 ceph-mon[35290]: pgmap v552: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-15T23:02:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:02:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:53 smithi184 ceph-mon[35203]: pgmap v552: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-09-15T23:02:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:02:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:54 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:54 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:02:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:54 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:02:54.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:54 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:02:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:54 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:54 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:02:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:54 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:02:54.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:54 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:02:54.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:54 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:02:54.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:54 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:02:54.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:54 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:02:54.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:54 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:02:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:55 smithi087 ceph-mon[35290]: pgmap v553: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-15T23:02:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:55 smithi184 ceph-mon[35203]: pgmap v553: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-15T23:02:55.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:55 smithi066 ceph-mon[31185]: pgmap v553: 129 pgs: 15 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 74 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-15T23:02:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:57 smithi087 ceph-mon[35290]: pgmap v554: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 187 op/s 2024-09-15T23:02:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:57 smithi184 ceph-mon[35203]: pgmap v554: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 187 op/s 2024-09-15T23:02:57.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:57 smithi066 ceph-mon[31185]: pgmap v554: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 187 op/s 2024-09-15T23:02:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:59 smithi087 ceph-mon[35290]: pgmap v555: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2024-09-15T23:02:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:02:59 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:02:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:59 smithi184 ceph-mon[35203]: pgmap v555: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2024-09-15T23:02:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:02:59 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:02:59.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:59 smithi066 ceph-mon[31185]: pgmap v555: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2024-09-15T23:02:59.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:02:59 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:03:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:00 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:03:00.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:03:00.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:00 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:03:00.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:03:00.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:00 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:03:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:01 smithi087 ceph-mon[35290]: pgmap v556: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-15T23:03:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:01 smithi184 ceph-mon[35203]: pgmap v556: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-15T23:03:01.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:01 smithi066 ceph-mon[31185]: pgmap v556: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-15T23:03:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:03 smithi087 ceph-mon[35290]: pgmap v557: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-09-15T23:03:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:03 smithi184 ceph-mon[35203]: pgmap v557: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-09-15T23:03:03.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:03 smithi066 ceph-mon[31185]: pgmap v557: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-09-15T23:03:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:05 smithi087 ceph-mon[35290]: pgmap v558: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 123 op/s 2024-09-15T23:03:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:05 smithi184 ceph-mon[35203]: pgmap v558: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 123 op/s 2024-09-15T23:03:05.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:05 smithi066 ceph-mon[31185]: pgmap v558: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 123 op/s 2024-09-15T23:03:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:07 smithi087 ceph-mon[35290]: pgmap v559: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 148 op/s 2024-09-15T23:03:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:07 smithi184 ceph-mon[35203]: pgmap v559: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 148 op/s 2024-09-15T23:03:07.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:07 smithi066 ceph-mon[31185]: pgmap v559: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 148 op/s 2024-09-15T23:03:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:09 smithi087 ceph-mon[35290]: pgmap v560: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-15T23:03:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:09 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:09 smithi184 ceph-mon[35203]: pgmap v560: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-15T23:03:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:09 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:09.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:09 smithi066 ceph-mon[31185]: pgmap v560: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-09-15T23:03:09.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:09 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:11 smithi087 ceph-mon[35290]: pgmap v561: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 177 op/s 2024-09-15T23:03:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:11 smithi087 ceph-mon[35290]: osdmap e115: 12 total, 12 up, 12 in 2024-09-15T23:03:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:11 smithi184 ceph-mon[35203]: pgmap v561: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 177 op/s 2024-09-15T23:03:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:11 smithi184 ceph-mon[35203]: osdmap e115: 12 total, 12 up, 12 in 2024-09-15T23:03:11.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:11 smithi066 ceph-mon[31185]: pgmap v561: 129 pgs: 12 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 81 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 177 op/s 2024-09-15T23:03:11.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:11 smithi066 ceph-mon[31185]: osdmap e115: 12 total, 12 up, 12 in 2024-09-15T23:03:13.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:03:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:13 smithi087 ceph-mon[35290]: pgmap v563: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 173 op/s 2024-09-15T23:03:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:13 smithi184 ceph-mon[35203]: pgmap v563: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 173 op/s 2024-09-15T23:03:13.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:13 smithi066 ceph-mon[31185]: pgmap v563: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 173 op/s 2024-09-15T23:03:14.037 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:14.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.800+0000 7f7fb98e9640 1 -- 172.21.15.66:0/970897757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb4109450 msgr2=0x7f7fb4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.800+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/970897757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb4109450 0x7f7fb4110250 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009860 tx=0x7f7fa802a360 comp rx=0 tx=0).stop 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.801+0000 7f7fb98e9640 1 -- 172.21.15.66:0/970897757 shutdown_connections 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.801+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/970897757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb411b140 0x7f7fb411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.801+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/970897757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109830 0x7f7fb4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.801+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/970897757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb4109450 0x7f7fb4110250 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.801+0000 7f7fb98e9640 1 -- 172.21.15.66:0/970897757 >> 172.21.15.66:0/970897757 conn(0x7f7fb406e140 msgr2=0x7f7fb406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.802+0000 7f7fb98e9640 1 -- 172.21.15.66:0/970897757 shutdown_connections 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.802+0000 7f7fb98e9640 1 -- 172.21.15.66:0/970897757 wait complete. 2024-09-15T23:03:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 Processor -- start 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 -- start start 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109450 0x7f7fb41186f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb4109830 0x7f7fb4111780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4120dc0 con 0x7f7fb411b140 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4120c40 con 0x7f7fb4109830 2024-09-15T23:03:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.803+0000 7f7fb98e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4120f40 con 0x7f7fb4109450 2024-09-15T23:03:14.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.806+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.806+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51090/0 (socket says 172.21.15.66:51090) 2024-09-15T23:03:14.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.806+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2894421976 learned_addr learned my addr 172.21.15.66:0/2894421976 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:14.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.807+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109450 0x7f7fb41186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.808+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2894421976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109450 msgr2=0x7f7fb41186f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.808+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109450 0x7f7fb41186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.808+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2894421976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb4109830 msgr2=0x7f7fb4111780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:03:14.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.808+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb4109830 0x7f7fb4111780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.808+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2894421976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb4112280 con 0x7f7fb411b140 2024-09-15T23:03:14.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.811+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00caf0 tx=0x7f7fac00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.815+0000 7f7fb88e7640 1 -- 172.21.15.66:0/2894421976 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac016030 con 0x7f7fb411b140 2024-09-15T23:03:14.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.815+0000 7f7fb88e7640 1 -- 172.21.15.66:0/2894421976 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fac003970 con 0x7f7fb411b140 2024-09-15T23:03:14.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.815+0000 7f7fb88e7640 1 -- 172.21.15.66:0/2894421976 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004650 con 0x7f7fb411b140 2024-09-15T23:03:14.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.816+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb4112570 con 0x7f7fb411b140 2024-09-15T23:03:14.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.816+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb4116540 con 0x7f7fb411b140 2024-09-15T23:03:14.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.820+0000 7f7fbbcc2740 1 Processor -- start 2024-09-15T23:03:14.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 -- start start 2024-09-15T23:03:14.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b248140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b24aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56114b1a32e0 con 0x56114b23d4a0 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56114b14ace0 con 0x56114b23ddc0 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.821+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56114b19f2a0 con 0x56114b248680 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb88e7640 1 -- 172.21.15.66:0/2894421976 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7fac019070 con 0x7f7fb411b140 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b24aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51094/0 (socket says 172.21.15.66:51094) 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb27fc640 1 -- 172.21.15.66:0/3614317261 learned_addr learned my addr 172.21.15.66:0/3614317261 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:14.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.822+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b248140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 -- 172.21.15.66:0/3614317261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 msgr2=0x56114b24aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b24aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 -- 172.21.15.66:0/3614317261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 msgr2=0x56114b248140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b248140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 -- 172.21.15.66:0/3614317261 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114b12f440 con 0x56114b23d4a0 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.823+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x56114b23adb0 tx=0x7f7fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9a3954e5ee8351 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.824+0000 7f7fb88e7640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 0x7f7f9c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.824+0000 7f7fb88e7640 1 -- 172.21.15.66:0/2894421976 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7fac0cfd30 con 0x7f7fb411b140 2024-09-15T23:03:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.825+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 0x7f7f9c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.825+0000 7f7f99ffb640 1 -- 172.21.15.66:0/3614317261 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4004050 con 0x56114b23d4a0 2024-09-15T23:03:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.825+0000 7f7f99ffb640 1 -- 172.21.15.66:0/3614317261 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa4005500 con 0x56114b23d4a0 2024-09-15T23:03:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.825+0000 7f7f99ffb640 1 -- 172.21.15.66:0/3614317261 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4004b90 con 0x56114b23d4a0 2024-09-15T23:03:14.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.826+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3614317261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 msgr2=0x56114b23d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.826+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x56114b23adb0 tx=0x7f7fa40046c0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.827+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 0x7f7f9c0a5a40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56114b23a890 tx=0x7f7fa8005850 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.828+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3614317261 shutdown_connections 2024-09-15T23:03:14.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.828+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b24aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.828+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b248140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.828+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3614317261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b23d880 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.828+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3614317261 >> 172.21.15.66:0/3614317261 conn(0x56114b239a30 msgr2=0x56114b239e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.831+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3614317261 shutdown_connections 2024-09-15T23:03:14.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.831+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3614317261 wait complete. 2024-09-15T23:03:14.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.831+0000 7f7fbbcc2740 1 -- start start 2024-09-15T23:03:14.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 Processor -- start 2024-09-15T23:03:14.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b2453e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b248680 0x56114b245b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56114b24b250 con 0x56114b248680 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56114b15e050 con 0x56114b23ddc0 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56114b24b3d0 con 0x56114b23d4a0 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.832+0000 7f7fbbcc2740 10 client.0 _ll_register_callbacks cb 0x56114b19e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.833+0000 7f7fb27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b2453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.833+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.833+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35594/0 (socket says 172.21.15.66:35594) 2024-09-15T23:03:14.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.834+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/384174458 learned_addr learned my addr 172.21.15.66:0/384174458 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:14.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.834+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b248680 0x56114b245b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.835+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 msgr2=0x56114b2453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.835+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b2453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.836+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/384174458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b248680 msgr2=0x56114b245b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.836+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b248680 0x56114b245b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.836+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/384174458 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114af143c0 con 0x56114b23d4a0 2024-09-15T23:03:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.839+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009230 tx=0x7f7fa802a360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2729d54a3a3d30dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.839+0000 7f7f92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.839+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8037050 con 0x56114b23d4a0 2024-09-15T23:03:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.839+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa4005500 con 0x56114b23d4a0 2024-09-15T23:03:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.839+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7fa8005040 con 0x56114b23d4a0 2024-09-15T23:03:14.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.840+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7fa8056050 con 0x56114b23d4a0 2024-09-15T23:03:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.843+0000 7f7fbbcc2740 10 client.28102 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:14.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.843+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56114b256dd0 con 0x56114b23d4a0 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa4005500 con 0x56114b23d4a0 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f7fa80035f0 con 0x56114b23d4a0 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 10 client.28102 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 10 client.28102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 20 client.28102 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b258700 0x56114b25ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 4 client.28102 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.846+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56114b1b0850 con 0x56114b258700 2024-09-15T23:03:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.852+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b258700 0x56114b25ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.865+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b258700 0x56114b25ab60 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a987df530890c214 server_cookie=47ed05cb947c1fb3 in_seq=0 out_seq=0 2024-09-15T23:03:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.865+0000 7f7f92ffd640 10 client.28102 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.868+0000 7f7f92ffd640 1 -- 172.21.15.66:0/384174458 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56114b1b0850 con 0x56114b258700 2024-09-15T23:03:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.868+0000 7f7f92ffd640 10 client.28102 handle_command_reply: tid=0 2024-09-15T23:03:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.868+0000 7f7fbbcc2740 1 client.28102 shutdown 2024-09-15T23:03:14.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.871+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 msgr2=0x56114b248130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.871+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009230 tx=0x7f7fa802a360 comp rx=0 tx=0).stop 2024-09-15T23:03:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 shutdown_connections 2024-09-15T23:03:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b248680 0x56114b245b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b258700 0x56114b25ab60 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b2453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/384174458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23d4a0 0x56114b248130 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 >> 172.21.15.66:0/384174458 conn(0x56114b239a30 msgr2=0x56114b238b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.876+0000 7f7f92ffd640 0 client.28102 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.877+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 shutdown_connections 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.877+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/384174458 wait complete. 2024-09-15T23:03:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.877+0000 7f7fbbcc2740 20 client.28102 trim_cache size 0 max 16384 2024-09-15T23:03:14.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 Processor -- start 2024-09-15T23:03:14.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 -- start start 2024-09-15T23:03:14.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b239e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b238a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c6b70 con 0x56114b23d4a0 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c8920 con 0x56114b23ddc0 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.912+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c72a0 con 0x56114b248680 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.913+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.913+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35596/0 (socket says 172.21.15.66:35596) 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.913+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2825539513 learned_addr learned my addr 172.21.15.66:0/2825539513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.914+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2825539513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 msgr2=0x56114b238a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.914+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b238a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.914+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2825539513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 msgr2=0x56114b239e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.914+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b239e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.914+0000 7f7fb37fe640 1 -- 172.21.15.66:0/2825539513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114b243930 con 0x56114b248680 2024-09-15T23:03:14.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.917+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7fac098010 tx=0x7f7fac00af50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3acb2eb4f7e06a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.919+0000 7f7f997fa640 1 -- 172.21.15.66:0/2825539513 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0b2070 con 0x56114b248680 2024-09-15T23:03:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.919+0000 7f7f997fa640 1 -- 172.21.15.66:0/2825539513 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fac0b4030 con 0x56114b248680 2024-09-15T23:03:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/2825539513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 msgr2=0x56114b260470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7fac098010 tx=0x7f7fac00af50 comp rx=0 tx=0).stop 2024-09-15T23:03:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/2825539513 shutdown_connections 2024-09-15T23:03:14.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b248680 0x56114b260470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b23ddc0 0x56114b238a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/2825539513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b239e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.920+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/2825539513 >> 172.21.15.66:0/2825539513 conn(0x56114b239a30 msgr2=0x56114b238350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.922+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/2825539513 shutdown_connections 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.922+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/2825539513 wait complete. 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.922+0000 7f7fbbcc2740 1 -- start start 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.922+0000 7f7fbbcc2740 1 Processor -- start 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23ddc0 0x56114b24e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b248680 0x56114b2bb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c8190 con 0x56114b23d4a0 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c7a00 con 0x56114b248680 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41c4b70 con 0x56114b23ddc0 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fbbcc2740 10 client.0 _ll_register_callbacks cb 0x7f7fa8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.923+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51104/0 (socket says 172.21.15.66:51104) 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb27fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23ddc0 0x56114b24e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb37fe640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b248680 0x56114b2bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/3781895762 learned_addr learned my addr 172.21.15.66:0/3781895762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/3781895762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23ddc0 msgr2=0x56114b24e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23ddc0 0x56114b24e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b248680 msgr2=0x56114b2bb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.924+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b248680 0x56114b2bb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.925+0000 7f7fb2ffd640 1 -- 172.21.15.66:0/3781895762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114b2bbaf0 con 0x56114b23d4a0 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.925+0000 7f7fb2ffd640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8035040 tx=0x7f7fa8003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a5c021893d74ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.925+0000 7f7f92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.926+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8037040 con 0x56114b23d4a0 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.926+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fac0b4030 con 0x56114b23d4a0 2024-09-15T23:03:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.926+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7fa8005040 con 0x56114b23d4a0 2024-09-15T23:03:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.927+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7fa8067050 con 0x56114b23d4a0 2024-09-15T23:03:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.927+0000 7f7fbbcc2740 10 client.18966 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.927+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56114b2c2e80 con 0x56114b23d4a0 2024-09-15T23:03:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.928+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fac0b4030 con 0x56114b23d4a0 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f7fa8062030 con 0x56114b23d4a0 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 10 client.18966 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 10 client.18966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 20 client.18966 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b2c36b0 0x56114b2c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 4 client.18966 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:03:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.929+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7fac0983b0 con 0x56114b2c36b0 2024-09-15T23:03:14.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.933+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b2c36b0 0x56114b2c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:14.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.940+0000 7f7fb27fc640 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b2c36b0 0x56114b2c5b70 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8584f16c1ffa61b8 server_cookie=a40f7785d6a49290 in_seq=0 out_seq=0 2024-09-15T23:03:14.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.940+0000 7f7f92ffd640 10 client.18966 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:14.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.942+0000 7f7f92ffd640 1 -- 172.21.15.66:0/3781895762 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7fac0983b0 con 0x56114b2c36b0 2024-09-15T23:03:14.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.942+0000 7f7f92ffd640 10 client.18966 handle_command_reply: tid=0 2024-09-15T23:03:14.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.942+0000 7f7fbbcc2740 1 client.18966 shutdown 2024-09-15T23:03:14.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.942+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 msgr2=0x56114b24dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.942+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8035040 tx=0x7f7fa8003e90 comp rx=0 tx=0).stop 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 shutdown_connections 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56114b2c36b0 0x56114b2c5b70 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56114b248680 0x56114b2bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56114b23ddc0 0x56114b24e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 --2- 172.21.15.66:0/3781895762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56114b23d4a0 0x56114b24dc60 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 >> 172.21.15.66:0/3781895762 conn(0x56114b239a30 msgr2=0x56114b238b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7f92ffd640 0 client.18966 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 shutdown_connections 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 1 -- 172.21.15.66:0/3781895762 wait complete. 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.950+0000 7f7fbbcc2740 20 client.18966 trim_cache size 0 max 16384 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T23:03:14.952 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:03:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.951+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 msgr2=0x7f7f9c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.951+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 0x7f7f9c0a5a40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56114b23a890 tx=0x7f7fa8005850 comp rx=0 tx=0).stop 2024-09-15T23:03:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.951+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 msgr2=0x7f7fb4111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.951+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00caf0 tx=0x7f7fac00cef0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 shutdown_connections 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f9c0a3580 0x7f7f9c0a5a40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb411b140 0x7f7fb4111cc0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb4109830 0x7f7fb4111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 --2- 172.21.15.66:0/2894421976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4109450 0x7f7fb41186f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 >> 172.21.15.66:0/2894421976 conn(0x7f7fb406e140 msgr2=0x7f7fb411be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.953+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 shutdown_connections 2024-09-15T23:03:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:14.955+0000 7f7fb98e9640 1 -- 172.21.15.66:0/2894421976 wait complete. 2024-09-15T23:03:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:15 smithi087 ceph-mon[35290]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 176 op/s 2024-09-15T23:03:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:15 smithi184 ceph-mon[35203]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 176 op/s 2024-09-15T23:03:15.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:15 smithi066 ceph-mon[31185]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 176 op/s 2024-09-15T23:03:15.789 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:03:15.790 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:03:16.283 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:16.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.945+0000 7fbb58e96640 1 -- 172.21.15.66:0/2497468520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 msgr2=0x7fbb54106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:16.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.945+0000 7fbb58e96640 1 --2- 172.21.15.66:0/2497468520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 0x7fbb54106c90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400d940 tx=0x7fbb4402e620 comp rx=0 tx=0).stop 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 -- 172.21.15.66:0/2497468520 shutdown_connections 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 --2- 172.21.15.66:0/2497468520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 --2- 172.21.15.66:0/2497468520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb541008b0 0x7fbb54100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 --2- 172.21.15.66:0/2497468520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 0x7fbb54106c90 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 -- 172.21.15.66:0/2497468520 >> 172.21.15.66:0/2497468520 conn(0x7fbb540fc5d0 msgr2=0x7fbb540fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:16.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 -- 172.21.15.66:0/2497468520 shutdown_connections 2024-09-15T23:03:16.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.950+0000 7fbb58e96640 1 -- 172.21.15.66:0/2497468520 wait complete. 2024-09-15T23:03:16.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.951+0000 7fbb58e96640 1 Processor -- start 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 -- start start 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb541008b0 0x7fbb540739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 0x7fbb5406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54120c50 con 0x7fbb541068b0 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54120ad0 con 0x7fbb541008b0 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.958+0000 7fbb58e96640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54120dd0 con 0x7fbb54101250 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35620/0 (socket says 172.21.15.66:35620) 2024-09-15T23:03:16.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 -- 172.21.15.66:0/890978603 learned_addr learned my addr 172.21.15.66:0/890978603 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 -- 172.21.15.66:0/890978603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb541008b0 msgr2=0x7fbb540739e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb541008b0 0x7fbb540739e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 -- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 msgr2=0x7fbb5406cfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 0x7fbb5406cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.959+0000 7fbb52ffd640 1 -- 172.21.15.66:0/890978603 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5406d570 con 0x7fbb54101250 2024-09-15T23:03:16.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.960+0000 7fbb52ffd640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800b4a0 tx=0x7fbb4800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:16.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.960+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48014070 con 0x7fbb54101250 2024-09-15T23:03:16.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.960+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5406d860 con 0x7fbb54101250 2024-09-15T23:03:16.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.960+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb54071880 con 0x7fbb54101250 2024-09-15T23:03:16.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.960+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb48010af0 con 0x7fbb54101250 2024-09-15T23:03:16.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.962+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb48017d20 con 0x7fbb54101250 2024-09-15T23:03:16.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.964+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fbb48017070 con 0x7fbb54101250 2024-09-15T23:03:16.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.966+0000 7fbb50ff9640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 0x7fbb3c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:16.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.966+0000 7fbb537fe640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 0x7fbb3c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:16.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.966+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fbb480cf5b0 con 0x7fbb54101250 2024-09-15T23:03:16.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.966+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40005290 con 0x7fbb54101250 2024-09-15T23:03:16.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.967+0000 7fbb537fe640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 0x7fbb3c0a5810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005dc0 tx=0x7fbb44005fd0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:16.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:16.974+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb4809bb30 con 0x7fbb54101250 2024-09-15T23:03:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.401+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb40005850 con 0x7fbb54101250 2024-09-15T23:03:17.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.404+0000 7fbb50ff9640 1 -- 172.21.15.66:0/890978603 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+12003 (secure 0 0 0) 0x7fbb4809b430 con 0x7fbb54101250 2024-09-15T23:03:17.405 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:03:17.405 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":66,"btime":"2024-09-15T23:03:08:255218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:03:07.686177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:03:17.406 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 66 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.407+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 msgr2=0x7fbb3c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.407+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 0x7fbb3c0a5810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005dc0 tx=0x7fbb44005fd0 comp rx=0 tx=0).stop 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.407+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 msgr2=0x7fbb5406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.407+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800b4a0 tx=0x7fbb4800b960 comp rx=0 tx=0).stop 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 shutdown_connections 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fbb3c0a3350 0x7fbb3c0a5810 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb541068b0 0x7fbb5406cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:17.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb54101250 0x7fbb5406ca70 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800b4a0 tx=0x7fbb4800b960 comp rx=0 tx=0).stop 2024-09-15T23:03:17.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 --2- 172.21.15.66:0/890978603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb541008b0 0x7fbb540739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:17.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 >> 172.21.15.66:0/890978603 conn(0x7fbb540fc5d0 msgr2=0x7fbb540fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:17.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.408+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 shutdown_connections 2024-09-15T23:03:17.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:17.409+0000 7fbb58e96640 1 -- 172.21.15.66:0/890978603 wait complete. 2024-09-15T23:03:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:17 smithi087 ceph-mon[35290]: pgmap v565: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T23:03:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:17 smithi184 ceph-mon[35203]: pgmap v565: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T23:03:17.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:17 smithi066 ceph-mon[31185]: pgmap v565: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 155 op/s 2024-09-15T23:03:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/890978603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:18.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/890978603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:18.691 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/890978603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:18.741 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T23:03:19.290 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:19 smithi087 ceph-mon[35290]: pgmap v566: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-15T23:03:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:19 smithi184 ceph-mon[35203]: pgmap v566: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-15T23:03:19.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:19 smithi066 ceph-mon[31185]: pgmap v566: 129 pgs: 19 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 52 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-15T23:03:20.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 -- 172.21.15.66:0/1669304305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 msgr2=0x7f331c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 --2- 172.21.15.66:0/1669304305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c10ec30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3304009900 tx=0x7f330402a440 comp rx=0 tx=0).stop 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 -- 172.21.15.66:0/1669304305 shutdown_connections 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 --2- 172.21.15.66:0/1669304305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c10ec30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 --2- 172.21.15.66:0/1669304305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f331c109d70 0x7f331c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 --2- 172.21.15.66:0/1669304305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109450 0x7f331c109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.503+0000 7f3321ca8640 1 -- 172.21.15.66:0/1669304305 >> 172.21.15.66:0/1669304305 conn(0x7f331c06e2d0 msgr2=0x7f331c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.504+0000 7f3321ca8640 1 -- 172.21.15.66:0/1669304305 shutdown_connections 2024-09-15T23:03:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.506+0000 7f3321ca8640 1 -- 172.21.15.66:0/1669304305 wait complete. 2024-09-15T23:03:20.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.507+0000 7f3321ca8640 1 Processor -- start 2024-09-15T23:03:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.507+0000 7f3321ca8640 1 -- start start 2024-09-15T23:03:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f331c109450 0x7f331c11a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109d70 0x7f331c11a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f331c113ed0 con 0x7f331c109450 2024-09-15T23:03:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f331c113d50 con 0x7f331c109d70 2024-09-15T23:03:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.508+0000 7f3321ca8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f331c114050 con 0x7f331c10e780 2024-09-15T23:03:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.512+0000 7f331bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.512+0000 7f331bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:35638/0 (socket says 172.21.15.66:35638) 2024-09-15T23:03:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.512+0000 7f331bfff640 1 -- 172.21.15.66:0/1379986968 learned_addr learned my addr 172.21.15.66:0/1379986968 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:20.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.512+0000 7f331affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109d70 0x7f331c11a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.513+0000 7f331bfff640 1 -- 172.21.15.66:0/1379986968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109d70 msgr2=0x7f331c11a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.513+0000 7f331bfff640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109d70 0x7f331c11a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.513+0000 7f331bfff640 1 -- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f331c109450 msgr2=0x7f331c11a270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:03:20.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.513+0000 7f331bfff640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f331c109450 0x7f331c11a270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.513+0000 7f331bfff640 1 -- 172.21.15.66:0/1379986968 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c11ec80 con 0x7f331c10e780 2024-09-15T23:03:20.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.519+0000 7f331bfff640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3304005940 tx=0x7f3304003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.523+0000 7f3318ff9640 1 -- 172.21.15.66:0/1379986968 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304040030 con 0x7f331c10e780 2024-09-15T23:03:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.523+0000 7f3318ff9640 1 -- 172.21.15.66:0/1379986968 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330403c920 con 0x7f331c10e780 2024-09-15T23:03:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.523+0000 7f3318ff9640 1 -- 172.21.15.66:0/1379986968 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33040318a0 con 0x7f331c10e780 2024-09-15T23:03:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.524+0000 7f3321ca8640 1 -- 172.21.15.66:0/1379986968 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c11ef10 con 0x7f331c10e780 2024-09-15T23:03:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.524+0000 7f3321ca8640 1 -- 172.21.15.66:0/1379986968 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c11f3a0 con 0x7f331c10e780 2024-09-15T23:03:20.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.527+0000 7f3324081740 1 Processor -- start 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 -- start start 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207d3e0 0x55e22207d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e22208a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e221fe32f0 con 0x55e22207d3e0 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e221f8acf0 con 0x55e22207eb40 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.528+0000 7f3324081740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e221fdf2b0 con 0x55e22207de60 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.529+0000 7f331affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.529+0000 7f331affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e22208a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.529+0000 7f331affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48170/0 (socket says 172.21.15.66:48170) 2024-09-15T23:03:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.529+0000 7f331affd640 1 -- 172.21.15.66:0/2318163822 learned_addr learned my addr 172.21.15.66:0/2318163822 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:20.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f3318ff9640 1 -- 172.21.15.66:0/1379986968 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3304043030 con 0x7f331c10e780 2024-09-15T23:03:20.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f331affd640 1 -- 172.21.15.66:0/2318163822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 msgr2=0x55e22208a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f331affd640 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e22208a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f331affd640 1 -- 172.21.15.66:0/2318163822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207d3e0 msgr2=0x55e22207d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f331affd640 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207d3e0 0x55e22207d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.530+0000 7f331affd640 1 -- 172.21.15.66:0/2318163822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e221f6f3a0 con 0x55e22207eb40 2024-09-15T23:03:20.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.531+0000 7f331affd640 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f330c0148a0 tx=0x7f330c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a3bfae0a6d25e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.534+0000 7f3318ff9640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 0x7f33080a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.534+0000 7f3318ff9640 1 -- 172.21.15.66:0/1379986968 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f33040f06d0 con 0x7f331c10e780 2024-09-15T23:03:20.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.536+0000 7f3321ca8640 1 -- 172.21.15.66:0/2318163822 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c004020 con 0x55e22207eb40 2024-09-15T23:03:20.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.536+0000 7f3321ca8640 1 -- 172.21.15.66:0/2318163822 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330c005500 con 0x55e22207eb40 2024-09-15T23:03:20.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.536+0000 7f3321ca8640 1 -- 172.21.15.66:0/2318163822 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c004a00 con 0x55e22207eb40 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 -- 172.21.15.66:0/2318163822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 msgr2=0x55e22207ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f330c0148a0 tx=0x7f330c005850 comp rx=0 tx=0).stop 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 -- 172.21.15.66:0/2318163822 shutdown_connections 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e22208a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207d3e0 0x55e22207d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 --2- 172.21.15.66:0/2318163822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207eb40 0x55e22207ef20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f3324081740 1 -- 172.21.15.66:0/2318163822 >> 172.21.15.66:0/2318163822 conn(0x55e222046310 msgr2=0x55e222079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.537+0000 7f331b7fe640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 0x7f33080a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.538+0000 7f3324081740 1 -- 172.21.15.66:0/2318163822 shutdown_connections 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.540+0000 7f331b7fe640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 0x7f33080a5a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55e22207ae80 tx=0x7f3314009710 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.540+0000 7f3324081740 1 -- 172.21.15.66:0/2318163822 wait complete. 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.540+0000 7f3324081740 1 -- start start 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 Processor -- start 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22208a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e222087ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e22208b070 con 0x55e22207de60 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e221f9e060 con 0x55e22207d3e0 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e22208b1f0 con 0x55e22207eb40 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.541+0000 7f3324081740 10 client.0 _ll_register_callbacks cb 0x55e221cf18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51134/0 (socket says 172.21.15.66:51134) 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 -- 172.21.15.66:0/2387935277 learned_addr learned my addr 172.21.15.66:0/2387935277 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 -- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 msgr2=0x55e222087ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e222087ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 -- 172.21.15.66:0/2387935277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 msgr2=0x55e22208a5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22208a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.542+0000 7f331affd640 1 -- 172.21.15.66:0/2387935277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e221d543c0 con 0x55e22207de60 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.543+0000 7f331affd640 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f330c014870 tx=0x7f330c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f21278976d12bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.543+0000 7f32faffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.543+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c011950 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.544+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f330c005500 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.544+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f330c011af0 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.544+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f330c031050 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.544+0000 7f3324081740 10 client.18975 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.544+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55e2220b8b60 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.545+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330c005500 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.545+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f330c026020 con 0x55e22207de60 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 10 client.18975 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 10 client.18975 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 20 client.18975 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e2220ba2a0 0x55e2220bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 4 client.18975 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:20.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.546+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e221ff0860 con 0x55e2220ba2a0 2024-09-15T23:03:20.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.552+0000 7f331b7fe640 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e2220ba2a0 0x55e2220bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.552+0000 7f331b7fe640 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e2220ba2a0 0x55e2220bc720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=18f97804e0879bb7 server_cookie=4eb7ec445f12b0a5 in_seq=0 out_seq=0 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.552+0000 7f32faffd640 10 client.18975 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.553+0000 7f32faffd640 1 -- 172.21.15.66:0/2387935277 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e221ff0860 con 0x55e2220ba2a0 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.553+0000 7f32faffd640 10 client.18975 handle_command_reply: tid=0 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.553+0000 7f3324081740 1 client.18975 shutdown 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 msgr2=0x55e222087860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f330c014870 tx=0x7f330c0043d0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 shutdown_connections 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e2220ba2a0 0x55e2220bc720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e222087ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222087860 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f32faffd640 0 client.18975 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:03:20.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 --2- 172.21.15.66:0/2387935277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22208a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 >> 172.21.15.66:0/2387935277 conn(0x55e222046310 msgr2=0x55e2220791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.554+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 shutdown_connections 2024-09-15T23:03:20.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.556+0000 7f3324081740 1 -- 172.21.15.66:0/2387935277 wait complete. 2024-09-15T23:03:20.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.557+0000 7f3324081740 20 client.18975 trim_cache size 0 max 16384 2024-09-15T23:03:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.584+0000 7f3324081740 1 Processor -- start 2024-09-15T23:03:20.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 -- start start 2024-09-15T23:03:20.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22207ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e2220897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 0x55e222081590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f331c07e8e0 con 0x55e22207eb40 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f331c080690 con 0x55e22207d3e0 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.585+0000 7f3324081740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f331c07f010 con 0x55e22207de60 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 0x55e222081590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22207ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 0x55e222081590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51148/0 (socket says 172.21.15.66:51148) 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331bfff640 1 -- 172.21.15.66:0/3870662530 learned_addr learned my addr 172.21.15.66:0/3870662530 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331affd640 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e2220897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 -- 172.21.15.66:0/3870662530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 msgr2=0x55e2220897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e2220897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 -- 172.21.15.66:0/3870662530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 msgr2=0x55e222081590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 0x55e222081590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.586+0000 7f331b7fe640 1 -- 172.21.15.66:0/3870662530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2220bcda0 con 0x55e22207d3e0 2024-09-15T23:03:20.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.587+0000 7f331b7fe640 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22207ff30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55e2220ba680 tx=0x7f3314011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39d13d60c91a769 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.587+0000 7f33117fa640 1 -- 172.21.15.66:0/3870662530 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331401f460 con 0x55e22207d3e0 2024-09-15T23:03:20.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.587+0000 7f33117fa640 1 -- 172.21.15.66:0/3870662530 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f331402d070 con 0x55e22207d3e0 2024-09-15T23:03:20.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.587+0000 7f33117fa640 1 -- 172.21.15.66:0/3870662530 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314028970 con 0x55e22207d3e0 2024-09-15T23:03:20.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.588+0000 7f3324081740 1 -- 172.21.15.66:0/3870662530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 msgr2=0x55e22207ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.588+0000 7f3324081740 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22207ff30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55e2220ba680 tx=0x7f3314011000 comp rx=0 tx=0).stop 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 -- 172.21.15.66:0/3870662530 shutdown_connections 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207eb40 0x55e222081590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207de60 0x55e2220897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 --2- 172.21.15.66:0/3870662530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e22207ff30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 -- 172.21.15.66:0/3870662530 >> 172.21.15.66:0/3870662530 conn(0x55e222046310 msgr2=0x55e2220890c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 -- 172.21.15.66:0/3870662530 shutdown_connections 2024-09-15T23:03:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 -- 172.21.15.66:0/3870662530 wait complete. 2024-09-15T23:03:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.589+0000 7f3324081740 1 -- start start 2024-09-15T23:03:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 Processor -- start 2024-09-15T23:03:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e222081960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222081ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e22208f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f331c07ff00 con 0x55e22207de60 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f331c07f770 con 0x55e22207d3e0 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f331c07c8e0 con 0x55e22207eb40 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.590+0000 7f3324081740 10 client.0 _ll_register_callbacks cb 0x7f330c00eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.592+0000 7f331affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222081ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.592+0000 7f331affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222081ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51162/0 (socket says 172.21.15.66:51162) 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.592+0000 7f331affd640 1 -- 172.21.15.66:0/2290229416 learned_addr learned my addr 172.21.15.66:0/2290229416 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:20.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.592+0000 7f331bfff640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e22208f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.592+0000 7f331b7fe640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e222081960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.593+0000 7f331bfff640 1 -- 172.21.15.66:0/2290229416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 msgr2=0x55e222081960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.593+0000 7f331bfff640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e222081960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.593+0000 7f331bfff640 1 -- 172.21.15.66:0/2290229416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 msgr2=0x55e222081ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.593+0000 7f331bfff640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222081ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.593+0000 7f331bfff640 1 -- 172.21.15.66:0/2290229416 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22208f9c0 con 0x55e22207eb40 2024-09-15T23:03:20.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.595+0000 7f331bfff640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e22208f480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f33040b8d90 tx=0x7f33040bc560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f77cb4ea5aaf63d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:20.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.595+0000 7f32faffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:20.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.595+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33040d5060 con 0x55e22207eb40 2024-09-15T23:03:20.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.595+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f3304004360 con 0x55e22207eb40 2024-09-15T23:03:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.596+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f331402d070 con 0x55e22207eb40 2024-09-15T23:03:20.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.600+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f330404a040 con 0x55e22207eb40 2024-09-15T23:03:20.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.602+0000 7f3324081740 10 client.28126 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:20.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.602+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55e222090d20 con 0x55e22207eb40 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f331402d070 con 0x55e22207eb40 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f33040d5200 con 0x55e22207eb40 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 10 client.28126 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 10 client.28126 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 20 client.28126 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e222125110 0x55e222127530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 4 client.28126 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:03:20.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.607+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e221fead70 con 0x55e222125110 2024-09-15T23:03:20.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.608+0000 7f331b7fe640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e222125110 0x55e222127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.623+0000 7f32faffd640 10 client.28126 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:03:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.623+0000 7f331b7fe640 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e222125110 0x55e222127530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=daef6fd5cf7446ec server_cookie=f853008fc14baa7b in_seq=0 out_seq=0 2024-09-15T23:03:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f32faffd640 1 -- 172.21.15.66:0/2290229416 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e221fead70 con 0x55e222125110 2024-09-15T23:03:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f32faffd640 10 client.28126 handle_command_reply: tid=0 2024-09-15T23:03:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 client.28126 shutdown 2024-09-15T23:03:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 msgr2=0x55e22208f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e22208f480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f33040b8d90 tx=0x7f33040bc560 comp rx=0 tx=0).stop 2024-09-15T23:03:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 shutdown_connections 2024-09-15T23:03:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55e222125110 0x55e222127530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e22207eb40 0x55e22208f480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e22207de60 0x55e222081ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 --2- 172.21.15.66:0/2290229416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e22207d3e0 0x55e222081960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 >> 172.21.15.66:0/2290229416 conn(0x55e222046310 msgr2=0x55e2220791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f32faffd640 0 client.28126 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 shutdown_connections 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.625+0000 7f3324081740 1 -- 172.21.15.66:0/2290229416 wait complete. 2024-09-15T23:03:20.630 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:03:20.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.626+0000 7f3324081740 20 client.28126 trim_cache size 0 max 16384 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.626+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 msgr2=0x7f33080a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.626+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 0x7f33080a5a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55e22207ae80 tx=0x7f3314009710 comp rx=0 tx=0).stop 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.626+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 msgr2=0x7f331c11e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.626+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3304005940 tx=0x7f3304003f60 comp rx=0 tx=0).stop 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 shutdown_connections 2024-09-15T23:03:20.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f33080a3580 0x7f33080a5a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f331c10e780 0x7f331c11e610 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f331c109d70 0x7f331c11a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 --2- 172.21.15.66:0/1379986968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f331c109450 0x7f331c11a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.627+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 >> 172.21.15.66:0/1379986968 conn(0x7f331c06e2d0 msgr2=0x7f331c10a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:20.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.628+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 shutdown_connections 2024-09-15T23:03:20.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:20.628+0000 7f33127fc640 1 -- 172.21.15.66:0/1379986968 wait complete. 2024-09-15T23:03:21.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T23:03:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:21 smithi087 ceph-mon[35290]: pgmap v567: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-09-15T23:03:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:21 smithi184 ceph-mon[35203]: pgmap v567: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-09-15T23:03:21.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:21 smithi066 ceph-mon[31185]: pgmap v567: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-09-15T23:03:21.920 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:22.438 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:03:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:03:22.078+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T23:03:22.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.583+0000 7fa0fe941640 1 -- 172.21.15.66:0/2582619720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f8105120 msgr2=0x7fa0f810cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.583+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2582619720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f8105120 0x7fa0f810cca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009ca0 tx=0x7fa0f002ba00 comp rx=0 tx=0).stop 2024-09-15T23:03:22.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.587+0000 7fa0fe941640 1 -- 172.21.15.66:0/2582619720 shutdown_connections 2024-09-15T23:03:22.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.587+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2582619720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f8105120 0x7fa0f810cca0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.587+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2582619720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f81009a0 0x7fa0f81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.587+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2582619720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 0x7fa0f81003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.587+0000 7fa0fe941640 1 -- 172.21.15.66:0/2582619720 >> 172.21.15.66:0/2582619720 conn(0x7fa0f80fba90 msgr2=0x7fa0f80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.593+0000 7fa0fe941640 1 -- 172.21.15.66:0/2582619720 shutdown_connections 2024-09-15T23:03:22.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.596+0000 7fa0fe941640 1 -- 172.21.15.66:0/2582619720 wait complete. 2024-09-15T23:03:22.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.596+0000 7fa0fe941640 1 Processor -- start 2024-09-15T23:03:22.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 -- start start 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 0x7fa0f8116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f81009a0 0x7fa0f81167d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f810fa00 con 0x7fa0f8105120 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f810f880 con 0x7fa0f81009a0 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fe941640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f810fb80 con 0x7fa0f80ffff0 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fcede640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fcede640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41692/0 (socket says 172.21.15.66:41692) 2024-09-15T23:03:22.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.597+0000 7fa0fcede640 1 -- 172.21.15.66:0/2944265655 learned_addr learned my addr 172.21.15.66:0/2944265655 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 0x7fa0f8116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0fcede640 1 -- 172.21.15.66:0/2944265655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 msgr2=0x7fa0f8116290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0fcede640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 0x7fa0f8116290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0fcede640 1 -- 172.21.15.66:0/2944265655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f81009a0 msgr2=0x7fa0f81167d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0fcede640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f81009a0 0x7fa0f81167d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.601+0000 7fa0fcede640 1 -- 172.21.15.66:0/2944265655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f811c870 con 0x7fa0f8105120 2024-09-15T23:03:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.602+0000 7fa0fcede640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005e30 tx=0x7fa0f0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.604+0000 7fa0f57fa640 1 -- 172.21.15.66:0/2944265655 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0034040 con 0x7fa0f8105120 2024-09-15T23:03:22.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.604+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f811cb00 con 0x7fa0f8105120 2024-09-15T23:03:22.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.604+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f8111580 con 0x7fa0f8105120 2024-09-15T23:03:22.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.608+0000 7fa0f57fa640 1 -- 172.21.15.66:0/2944265655 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0f002f890 con 0x7fa0f8105120 2024-09-15T23:03:22.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.608+0000 7fa0f57fa640 1 -- 172.21.15.66:0/2944265655 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0004800 con 0x7fa0f8105120 2024-09-15T23:03:22.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.608+0000 7fa100d1a740 1 Processor -- start 2024-09-15T23:03:22.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.608+0000 7fa0f57fa640 1 -- 172.21.15.66:0/2944265655 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa0f004b020 con 0x7fa0f8105120 2024-09-15T23:03:22.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.609+0000 7fa100d1a740 1 -- start start 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d36912e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d36912ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d3690942f0 con 0x55d369139370 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d36903bcf0 con 0x55d36912fb40 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa100d1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3690902b0 con 0x55d36912e5d0 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.610+0000 7fa0f57fa640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 0x7fa0e00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41702/0 (socket says 172.21.15.66:41702) 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 -- 172.21.15.66:0/4000681580 learned_addr learned my addr 172.21.15.66:0/4000681580 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f57fa640 1 -- 172.21.15.66:0/2944265655 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fa0f00f2370 con 0x7fa0f8105120 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 -- 172.21.15.66:0/4000681580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 msgr2=0x55d36912ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d36912ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 -- 172.21.15.66:0/4000681580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 msgr2=0x55d36912e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d36912e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0f77fe640 1 -- 172.21.15.66:0/4000681580 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3690203a0 con 0x55d369139370 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.611+0000 7fa0fcede640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 0x7fa0e00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.612+0000 7fa0fcede640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 0x7fa0e00a5a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002bf70 tx=0x7fa0f003c040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.616+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b840 tx=0x7fa0ec00bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f81b03598aa0a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.618+0000 7fa0de7fc640 1 -- 172.21.15.66:0/4000681580 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec018070 con 0x55d369139370 2024-09-15T23:03:22.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.618+0000 7fa0de7fc640 1 -- 172.21.15.66:0/4000681580 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ec004840 con 0x55d369139370 2024-09-15T23:03:22.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.619+0000 7fa100d1a740 1 -- 172.21.15.66:0/4000681580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 msgr2=0x55d36913b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.619+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b840 tx=0x7fa0ec00bd00 comp rx=0 tx=0).stop 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 -- 172.21.15.66:0/4000681580 shutdown_connections 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d36913b760 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d36912ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4000681580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d36912e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 -- 172.21.15.66:0/4000681580 >> 172.21.15.66:0/4000681580 conn(0x55d3690f7310 msgr2=0x55d36912ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 -- 172.21.15.66:0/4000681580 shutdown_connections 2024-09-15T23:03:22.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 -- 172.21.15.66:0/4000681580 wait complete. 2024-09-15T23:03:22.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.622+0000 7fa100d1a740 1 -- start start 2024-09-15T23:03:22.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 Processor -- start 2024-09-15T23:03:22.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d369138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d369136560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d36913c0c0 con 0x55d369139370 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d36904f060 con 0x55d36912fb40 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d36913c240 con 0x55d36912e5d0 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.623+0000 7fa100d1a740 10 client.0 _ll_register_callbacks cb 0x55d368da28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49302/0 (socket says 172.21.15.66:49302) 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 -- 172.21.15.66:0/4270955495 learned_addr learned my addr 172.21.15.66:0/4270955495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d369138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d369136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 -- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 msgr2=0x55d369138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d369138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 -- 172.21.15.66:0/4270955495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 msgr2=0x55d369136560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d369136560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.624+0000 7fa0f7fff640 1 -- 172.21.15.66:0/4270955495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d368e053c0 con 0x55d36912fb40 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.625+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800e630 tx=0x7fa0e800eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555c7c4f005d512 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.625+0000 7fa0d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.626+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800ca10 con 0x55d36912fb40 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.626+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fa0e800cbb0 con 0x55d36912fb40 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.627+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0ec004840 con 0x55d36912fb40 2024-09-15T23:03:22.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.628+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fa0e800cdb0 con 0x55d36912fb40 2024-09-15T23:03:22.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.630+0000 7fa100d1a740 10 client.28238 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:22.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.630+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55d369158c90 con 0x55d36912fb40 2024-09-15T23:03:22.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ec004840 con 0x55d36912fb40 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7fa0e80246c0 con 0x55d36912fb40 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 10 client.28238 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 10 client.28238 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 20 client.28238 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d36915a670 0x55d36915ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 4 client.28238 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:22.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.631+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3690a1860 con 0x55d36915a670 2024-09-15T23:03:22.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.634+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d36915a670 0x55d36915ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.636+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d36915a670 0x55d36915ca90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aaf3b98b22687fb9 server_cookie=7e5c8b886228f8d1 in_seq=0 out_seq=0 2024-09-15T23:03:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.636+0000 7fa0d77fe640 10 client.28238 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:03:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.637+0000 7fa0d77fe640 1 -- 172.21.15.66:0/4270955495 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3690a1860 con 0x55d36915a670 2024-09-15T23:03:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.637+0000 7fa0d77fe640 10 client.28238 handle_command_reply: tid=0 2024-09-15T23:03:22.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.638+0000 7fa100d1a740 1 client.28238 shutdown 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.641+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 msgr2=0x55d369135fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.641+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800e630 tx=0x7fa0e800eaf0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 shutdown_connections 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d36915a670 0x55d36915ca90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d369139370 0x55d369136560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369135fc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 --2- 172.21.15.66:0/4270955495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d36912e5d0 0x55d369138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 >> 172.21.15.66:0/4270955495 conn(0x55d3690f7310 msgr2=0x55d369130960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.642+0000 7fa0d77fe640 0 client.28238 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:03:22.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.644+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 shutdown_connections 2024-09-15T23:03:22.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.647+0000 7fa100d1a740 1 -- 172.21.15.66:0/4270955495 wait complete. 2024-09-15T23:03:22.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.650+0000 7fa100d1a740 20 client.28238 trim_cache size 0 max 16384 2024-09-15T23:03:22.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.679+0000 7fa100d1a740 1 Processor -- start 2024-09-15T23:03:22.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.679+0000 7fa100d1a740 1 -- start start 2024-09-15T23:03:22.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.679+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912e5d0 0x55d36912a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.679+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.679+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912e5d0 0x55d36912a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa100d1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4010430 con 0x55d36912e5d0 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa100d1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40121e0 con 0x55d36912fb40 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa100d1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4010b60 con 0x55d369139370 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa0f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49310/0 (socket says 172.21.15.66:49310) 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa0f7fff640 1 -- 172.21.15.66:0/108243418 learned_addr learned my addr 172.21.15.66:0/108243418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:22.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.680+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.681+0000 7fa0f7fff640 1 -- 172.21.15.66:0/108243418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 msgr2=0x55d369162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.681+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.681+0000 7fa0f7fff640 1 -- 172.21.15.66:0/108243418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912e5d0 msgr2=0x55d36912a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.681+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912e5d0 0x55d36912a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.681+0000 7fa0f7fff640 1 -- 172.21.15.66:0/108243418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d369131120 con 0x55d36912fb40 2024-09-15T23:03:22.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.682+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e800cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6cd58ac6be4a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.685+0000 7fa0ddffb640 1 -- 172.21.15.66:0/108243418 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8024620 con 0x55d36912fb40 2024-09-15T23:03:22.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.685+0000 7fa0ddffb640 1 -- 172.21.15.66:0/108243418 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0e80247c0 con 0x55d36912fb40 2024-09-15T23:03:22.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.685+0000 7fa0ddffb640 1 -- 172.21.15.66:0/108243418 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004a00 con 0x55d36912fb40 2024-09-15T23:03:22.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.686+0000 7fa100d1a740 1 -- 172.21.15.66:0/108243418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 msgr2=0x55d369162320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.686+0000 7fa100d1a740 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e800cf50 comp rx=0 tx=0).stop 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.687+0000 7fa100d1a740 1 -- 172.21.15.66:0/108243418 shutdown_connections 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.687+0000 7fa100d1a740 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.687+0000 7fa100d1a740 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912fb40 0x55d369162320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.687+0000 7fa100d1a740 1 --2- 172.21.15.66:0/108243418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912e5d0 0x55d36912a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.688+0000 7fa100d1a740 1 -- 172.21.15.66:0/108243418 >> 172.21.15.66:0/108243418 conn(0x55d3690f7310 msgr2=0x55d369134890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.688+0000 7fa100d1a740 1 -- 172.21.15.66:0/108243418 shutdown_connections 2024-09-15T23:03:22.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.688+0000 7fa100d1a740 1 -- 172.21.15.66:0/108243418 wait complete. 2024-09-15T23:03:22.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.688+0000 7fa100d1a740 1 -- start start 2024-09-15T23:03:22.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.689+0000 7fa100d1a740 1 Processor -- start 2024-09-15T23:03:22.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912fb40 0x55d369132d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369133290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4011a50 con 0x55d36912fb40 2024-09-15T23:03:22.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40112c0 con 0x55d36912e5d0 2024-09-15T23:03:22.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e400e430 con 0x55d369139370 2024-09-15T23:03:22.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.690+0000 7fa100d1a740 10 client.0 _ll_register_callbacks cb 0x7fa0e8008350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:22.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.691+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.691+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49318/0 (socket says 172.21.15.66:49318) 2024-09-15T23:03:22.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.691+0000 7fa0f77fe640 1 -- 172.21.15.66:0/332660574 learned_addr learned my addr 172.21.15.66:0/332660574 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:22.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.692+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369133290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912fb40 0x55d369132d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f77fe640 1 -- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 msgr2=0x55d369133290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369133290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f77fe640 1 -- 172.21.15.66:0/332660574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912fb40 msgr2=0x55d369132d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:22.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912fb40 0x55d369132d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.695+0000 7fa0f77fe640 1 -- 172.21.15.66:0/332660574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d369133ae0 con 0x55d36912e5d0 2024-09-15T23:03:22.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.697+0000 7fa0f77fe640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec016040 tx=0x7fa0ec00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a79b8d730c67413 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:22.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.698+0000 7fa0d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:03:22.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.698+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec018040 con 0x55d36912e5d0 2024-09-15T23:03:22.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.698+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fa0ec006500 con 0x55d36912e5d0 2024-09-15T23:03:22.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.699+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0e80247c0 con 0x55d36912e5d0 2024-09-15T23:03:22.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.702+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec006720 con 0x55d36912e5d0 2024-09-15T23:03:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.704+0000 7fa100d1a740 10 client.28244 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:22.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.705+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55d3691c5320 con 0x55d36912e5d0 2024-09-15T23:03:22.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.705+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0ec019040 con 0x55d36912e5d0 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7fa0ec01e070 con 0x55d36912e5d0 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 10 client.28244 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 10 client.28244 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 20 client.28244 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d3691c5820 0x55d3691c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 4 client.28244 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:03:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.706+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa0e80247c0 con 0x55d3691c5820 2024-09-15T23:03:22.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.708+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d3691c5820 0x55d3691c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:22.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.712+0000 7fa0f7fff640 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d3691c5820 0x55d3691c7c40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=51238d8825b4db23 server_cookie=4a0b686bbdbc841f in_seq=0 out_seq=0 2024-09-15T23:03:22.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.712+0000 7fa0d77fe640 10 client.28244 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:03:22.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.715+0000 7fa0d77fe640 1 -- 172.21.15.66:0/332660574 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa0e80247c0 con 0x55d3691c5820 2024-09-15T23:03:22.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.715+0000 7fa0d77fe640 10 client.28244 handle_command_reply: tid=0 2024-09-15T23:03:22.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.715+0000 7fa100d1a740 1 client.28244 shutdown 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 msgr2=0x55d369141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec016040 tx=0x7fa0ec00b260 comp rx=0 tx=0).stop 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 shutdown_connections 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55d3691c5820 0x55d3691c7c40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d369139370 0x55d369133290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d36912fb40 0x55d369132d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 --2- 172.21.15.66:0/332660574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d36912e5d0 0x55d369141d20 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec016040 tx=0x7fa0ec00b260 comp rx=0 tx=0).stop 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 >> 172.21.15.66:0/332660574 conn(0x55d3690f7310 msgr2=0x55d369137820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.722+0000 7fa0d77fe640 0 client.28244 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.724+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 shutdown_connections 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.724+0000 7fa100d1a740 1 -- 172.21.15.66:0/332660574 wait complete. 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.724+0000 7fa100d1a740 20 client.28244 trim_cache size 0 max 16384 2024-09-15T23:03:22.726 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:03:22.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 msgr2=0x7fa0e00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 0x7fa0e00a5a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002bf70 tx=0x7fa0f003c040 comp rx=0 tx=0).stop 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 msgr2=0x7fa0f811bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005e30 tx=0x7fa0f0003f10 comp rx=0 tx=0).stop 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 shutdown_connections 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa0e00a35c0 0x7fa0e00a5a80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0f8105120 0x7fa0f811bfb0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f81009a0 0x7fa0f81167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 --2- 172.21.15.66:0/2944265655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0f80ffff0 0x7fa0f8116290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:22.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 >> 172.21.15.66:0/2944265655 conn(0x7fa0f80fba90 msgr2=0x7fa0f80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:22.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 shutdown_connections 2024-09-15T23:03:22.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:22.733+0000 7fa0fe941640 1 -- 172.21.15.66:0/2944265655 wait complete. 2024-09-15T23:03:23.423 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:23 smithi066 ceph-mon[31185]: pgmap v568: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-15T23:03:23.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T23:03:23.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:23 smithi087 ceph-mon[35290]: pgmap v568: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-15T23:03:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:23 smithi184 ceph-mon[35203]: pgmap v568: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-15T23:03:24.002 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:25.598 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T23:03:25.599 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.95 2024-09-15T23:03:25.599 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:03:25.667 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:25 smithi066 ceph-mon[31185]: pgmap v569: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-09-15T23:03:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:25 smithi184 ceph-mon[35203]: pgmap v569: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-09-15T23:03:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:25 smithi087 ceph-mon[35290]: pgmap v569: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-09-15T23:03:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1322951015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74102dd0 msgr2=0x7f7a741031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1322951015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74102dd0 0x7f7a741031b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009930 tx=0x7f7a6402a420 comp rx=0 tx=0).stop 2024-09-15T23:03:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1322951015 shutdown_connections 2024-09-15T23:03:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1322951015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74108300 0x7f7a7410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1322951015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74103780 0x7f7a74107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1322951015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74102dd0 0x7f7a741031b0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1322951015 >> 172.21.15.66:0/1322951015 conn(0x7f7a740fc7d0 msgr2=0x7f7a740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1322951015 shutdown_connections 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.573+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1322951015 wait complete. 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 Processor -- start 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 -- start start 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74102dd0 0x7f7a74198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74103780 0x7f7a74198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74112090 con 0x7f7a74108300 2024-09-15T23:03:26.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74111f10 con 0x7f7a74102dd0 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a79a2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74112210 con 0x7f7a74103780 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41742/0 (socket says 172.21.15.66:41742) 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a737fe640 1 -- 172.21.15.66:0/1353142404 learned_addr learned my addr 172.21.15.66:0/1353142404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a727fc640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74103780 0x7f7a74198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.574+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74102dd0 0x7f7a74198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 -- 172.21.15.66:0/1353142404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74103780 msgr2=0x7f7a74198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74103780 0x7f7a74198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 -- 172.21.15.66:0/1353142404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74102dd0 msgr2=0x7f7a74198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74102dd0 0x7f7a74198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 -- 172.21.15.66:0/1353142404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7419d600 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a737fe640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a78a28640 1 -- 172.21.15.66:0/1353142404 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c017070 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7419d8f0 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a78a28640 1 -- 172.21.15.66:0/1353142404 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c003e50 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a78a28640 1 -- 172.21.15.66:0/1353142404 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0106c0 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.575+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741a51d0 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.577+0000 7f7a7be03740 1 Processor -- start 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a78a28640 1 -- 172.21.15.66:0/1353142404 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7a6c003970 con 0x7f7a74108300 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 -- start start 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c40f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a9c3752f0 con 0x555a9c40f5d0 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555a9c31ccf0 con 0x555a9c410b40 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a7be03740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555a9c3712b0 con 0x555a9c41a370 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41758/0 (socket says 172.21.15.66:41758) 2024-09-15T23:03:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 -- 172.21.15.66:0/3054834413 learned_addr learned my addr 172.21.15.66:0/3054834413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a727fc640 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a727fc640 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c40f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 -- 172.21.15.66:0/3054834413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 msgr2=0x555a9c41c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 -- 172.21.15.66:0/3054834413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 msgr2=0x555a9c40f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.578+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c40f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a72ffd640 1 -- 172.21.15.66:0/3054834413 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9c3013a0 con 0x555a9c40f5d0 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a78a28640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 0x7f7a5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402a940 tx=0x7f7a64005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21d4d47db07a73d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a727fc640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 0x7f7a5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a78a28640 1 -- 172.21.15.66:0/1353142404 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7a6c0cff10 con 0x7f7a74108300 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a59ffb640 1 -- 172.21.15.66:0/3054834413 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64040070 con 0x555a9c40f5d0 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.579+0000 7f7a59ffb640 1 -- 172.21.15.66:0/3054834413 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a640318f0 con 0x555a9c40f5d0 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a59ffb640 1 -- 172.21.15.66:0/3054834413 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64035040 con 0x555a9c40f5d0 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- 172.21.15.66:0/3054834413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 msgr2=0x555a9c40fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a727fc640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 0x7f7a5c0a5870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x555a9c410070 tx=0x7f7a68013040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402a940 tx=0x7f7a64005c00 comp rx=0 tx=0).stop 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- 172.21.15.66:0/3054834413 shutdown_connections 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c40fa10 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3054834413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c40f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- 172.21.15.66:0/3054834413 >> 172.21.15.66:0/3054834413 conn(0x555a9c3d8310 msgr2=0x555a9c40bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- 172.21.15.66:0/3054834413 shutdown_connections 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- 172.21.15.66:0/3054834413 wait complete. 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.580+0000 7f7a7be03740 1 -- start start 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 Processor -- start 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c40f5d0 0x555a9c419c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c410b40 0x555a9c416f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555a9c41d060 con 0x555a9c41a370 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x555a9c330060 con 0x555a9c40f5d0 2024-09-15T23:03:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555a9c41d1e0 con 0x555a9c410b40 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a7be03740 10 client.0 _ll_register_callbacks cb 0x555a9c0838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41770/0 (socket says 172.21.15.66:41770) 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c410b40 0x555a9c416f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c40f5d0 0x555a9c419c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.581+0000 7f7a737fe640 1 -- 172.21.15.66:0/3335601250 learned_addr learned my addr 172.21.15.66:0/3335601250 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 -- 172.21.15.66:0/3335601250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c410b40 msgr2=0x555a9c416f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c410b40 0x555a9c416f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 -- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c40f5d0 msgr2=0x555a9c419c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c40f5d0 0x555a9c419c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 -- 172.21.15.66:0/3335601250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9c0e63c0 con 0x555a9c41a370 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a737fe640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0981f0 tx=0x7f7a6c09b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4fcfb2845d221d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c020040 con 0x555a9c41a370 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7a6c098400 con 0x555a9c41a370 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a640318f0 con 0x555a9c41a370 2024-09-15T23:03:26.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7a6c0a0090 con 0x555a9c41a370 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a7be03740 10 client.19008 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x555a9c428a60 con 0x555a9c41a370 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.582+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a640318f0 con 0x555a9c41a370 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f7a6c0b3060 con 0x555a9c41a370 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 10 client.19008 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 10 client.19008 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 20 client.19008 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c42c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 4 client.19008 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a9c382860 con 0x555a9c429f60 2024-09-15T23:03:26.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c42c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c42c400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67abb3785479fb45 server_cookie=b7f1292613c720da in_seq=0 out_seq=0 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.583+0000 7f7a52ffd640 10 client.19008 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.584+0000 7f7a52ffd640 1 -- 172.21.15.66:0/3335601250 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a9c382860 con 0x555a9c429f60 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.584+0000 7f7a52ffd640 10 client.19008 handle_command_reply: tid=0 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.584+0000 7f7a7be03740 1 client.19008 shutdown 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 msgr2=0x555a9c417450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0981f0 tx=0x7f7a6c09b990 comp rx=0 tx=0).stop 2024-09-15T23:03:26.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 shutdown_connections 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c42c400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c41a370 0x555a9c417450 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a52ffd640 0 client.19008 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c410b40 0x555a9c416f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 --2- 172.21.15.66:0/3335601250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c40f5d0 0x555a9c419c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 >> 172.21.15.66:0/3335601250 conn(0x555a9c3d8310 msgr2=0x555a9c411930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 shutdown_connections 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 1 -- 172.21.15.66:0/3335601250 wait complete. 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.585+0000 7f7a7be03740 20 client.19008 trim_cache size 0 max 16384 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 Processor -- start 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 -- start start 2024-09-15T23:03:26.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c40f5d0 0x555a9c418e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c41a370 0x555a9c412660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741af420 con 0x555a9c410b40 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741b11d0 con 0x555a9c41a370 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a7be03740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741afb50 con 0x555a9c40f5d0 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41772/0 (socket says 172.21.15.66:41772) 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 -- 172.21.15.66:0/2476352972 learned_addr learned my addr 172.21.15.66:0/2476352972 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c40f5d0 0x555a9c418e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 -- 172.21.15.66:0/2476352972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c40f5d0 msgr2=0x555a9c418e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c40f5d0 0x555a9c418e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 -- 172.21.15.66:0/2476352972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c41a370 msgr2=0x555a9c412660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c41a370 0x555a9c412660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.603+0000 7f7a727fc640 1 -- 172.21.15.66:0/2476352972 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9c40f3d0 con 0x555a9c410b40 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.604+0000 7f7a727fc640 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7a7406a2d0 tx=0x7f7a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1042b30b54e6f628 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.604+0000 7f7a597fa640 1 -- 172.21.15.66:0/2476352972 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6802f070 con 0x555a9c410b40 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.604+0000 7f7a597fa640 1 -- 172.21.15.66:0/2476352972 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68003c40 con 0x555a9c410b40 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.604+0000 7f7a597fa640 1 -- 172.21.15.66:0/2476352972 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f6e0 con 0x555a9c410b40 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- 172.21.15.66:0/2476352972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 msgr2=0x555a9c412120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7a7406a2d0 tx=0x7f7a680046c0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- 172.21.15.66:0/2476352972 shutdown_connections 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c41a370 0x555a9c412660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c410b40 0x555a9c412120 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 --2- 172.21.15.66:0/2476352972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c40f5d0 0x555a9c418e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- 172.21.15.66:0/2476352972 >> 172.21.15.66:0/2476352972 conn(0x555a9c3d8310 msgr2=0x555a9c418770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- 172.21.15.66:0/2476352972 shutdown_connections 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- 172.21.15.66:0/2476352972 wait complete. 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 -- start start 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.605+0000 7f7a7be03740 1 Processor -- start 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c41dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741b0a40 con 0x555a9c40f5d0 2024-09-15T23:03:26.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741b02b0 con 0x555a9c410b40 2024-09-15T23:03:26.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741ad420 con 0x555a9c41a370 2024-09-15T23:03:26.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a7be03740 10 client.0 _ll_register_callbacks cb 0x7f7a6c0092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:26.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41774/0 (socket says 172.21.15.66:41774) 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 -- 172.21.15.66:0/4268018183 learned_addr learned my addr 172.21.15.66:0/4268018183 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a727fc640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c41dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a737fe640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 -- 172.21.15.66:0/4268018183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 msgr2=0x555a9c41e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 -- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 msgr2=0x555a9c41dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c41dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 -- 172.21.15.66:0/4268018183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9c41e710 con 0x555a9c40f5d0 2024-09-15T23:03:26.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a72ffd640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402a940 tx=0x7f7a64005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74c5484ab5398b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:26.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:26.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.606+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64040040 con 0x555a9c40f5d0 2024-09-15T23:03:26.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f7a64004040 con 0x555a9c40f5d0 2024-09-15T23:03:26.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a68003c40 con 0x555a9c40f5d0 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7a6405d050 con 0x555a9c40f5d0 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 10 client.19014 fetch_fsmap learned FSMap version 66 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x555a9c4949f0 con 0x555a9c40f5d0 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68003c40 con 0x555a9c40f5d0 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 66) ==== 8438+0+0 (secure 0 0 0) 0x7f7a6404f420 con 0x555a9c40f5d0 2024-09-15T23:03:26.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 10 client.19014 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:03:26.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 10 client.19014 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:03:26.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 20 client.19014 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:26.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c496e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:26.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 4 client.19014 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:03:26.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.607+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a9c37cd70 con 0x555a9c429f60 2024-09-15T23:03:26.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a727fc640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c496e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:26.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a727fc640 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c496e50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c66b8f6fe580e0bf server_cookie=eb16eea030c09d87 in_seq=0 out_seq=0 2024-09-15T23:03:26.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a52ffd640 10 client.19014 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:03:26.109 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:03:26.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a52ffd640 1 -- 172.21.15.66:0/4268018183 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a9c37cd70 con 0x555a9c429f60 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a52ffd640 10 client.19014 handle_command_reply: tid=0 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.608+0000 7f7a7be03740 1 client.19014 shutdown 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 msgr2=0x555a9c422960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402a940 tx=0x7f7a64005720 comp rx=0 tx=0).stop 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 shutdown_connections 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x555a9c429f60 0x555a9c496e50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555a9c41a370 0x555a9c41e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a9c410b40 0x555a9c41dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 --2- 172.21.15.66:0/4268018183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555a9c40f5d0 0x555a9c422960 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 >> 172.21.15.66:0/4268018183 conn(0x555a9c3d8310 msgr2=0x555a9c418f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a52ffd640 0 client.19014 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 shutdown_connections 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 1 -- 172.21.15.66:0/4268018183 wait complete. 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a7be03740 20 client.19014 trim_cache size 0 max 16384 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 msgr2=0x7f7a5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 0x7f7a5c0a5870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x555a9c410070 tx=0x7f7a68013040 comp rx=0 tx=0).stop 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 msgr2=0x7f7a7419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.609+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c00b260 comp rx=0 tx=0).stop 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 shutdown_connections 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7a5c0a33b0 0x7f7a5c0a5870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a74108300 0x7f7a7419cf20 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74103780 0x7f7a74198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 --2- 172.21.15.66:0/1353142404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a74102dd0 0x7f7a74198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:26.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 >> 172.21.15.66:0/1353142404 conn(0x7f7a740fc7d0 msgr2=0x7f7a74105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:26.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 shutdown_connections 2024-09-15T23:03:26.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:24.610+0000 7f7a79a2a640 1 -- 172.21.15.66:0/1353142404 wait complete. 2024-09-15T23:03:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:27 smithi184 ceph-mon[35203]: pgmap v570: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-15T23:03:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:27 smithi066 ceph-mon[31185]: pgmap v570: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-15T23:03:27.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:27 smithi087 ceph-mon[35290]: pgmap v570: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-09-15T23:03:28.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:28 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:28.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:28 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:28.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:28 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:29.311 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T23:03:29.409 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:29.566 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:29 smithi066 ceph-mon[31185]: pgmap v571: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 138 op/s 2024-09-15T23:03:29.566 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:29 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:29 smithi184 ceph-mon[35203]: pgmap v571: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 138 op/s 2024-09-15T23:03:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:29 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:29.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:29 smithi087 ceph-mon[35290]: pgmap v571: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 138 op/s 2024-09-15T23:03:29.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:29 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:30.129 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:30.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.134+0000 7f6fcf33e640 1 -- 172.21.15.66:0/479593711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8102ef0 msgr2=0x7f6fc8069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.134+0000 7f6fcf33e640 1 --2- 172.21.15.66:0/479593711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8069f70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009900 tx=0x7f6fc402a4d0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.140+0000 7f6fcf33e640 1 -- 172.21.15.66:0/479593711 shutdown_connections 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.140+0000 7f6fcf33e640 1 --2- 172.21.15.66:0/479593711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8069f70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.140+0000 7f6fcf33e640 1 --2- 172.21.15.66:0/479593711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102570 0x7f6fc81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.140+0000 7f6fcf33e640 1 --2- 172.21.15.66:0/479593711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8100e20 0x7f6fc8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.140+0000 7f6fcf33e640 1 -- 172.21.15.66:0/479593711 >> 172.21.15.66:0/479593711 conn(0x7f6fc80fc7d0 msgr2=0x7f6fc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.142+0000 7f6fcf33e640 1 -- 172.21.15.66:0/479593711 shutdown_connections 2024-09-15T23:03:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.142+0000 7f6fcf33e640 1 -- 172.21.15.66:0/479593711 wait complete. 2024-09-15T23:03:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.143+0000 7f6fcf33e640 1 Processor -- start 2024-09-15T23:03:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.143+0000 7f6fcf33e640 1 -- start start 2024-09-15T23:03:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8100e20 0x7f6fc8113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 0x7f6fc8110a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8110f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc81142d0 con 0x7f6fc8102ef0 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcd8db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8110f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcd8db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8110f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41794/0 (socket says 172.21.15.66:41794) 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcd8db640 1 -- 172.21.15.66:0/3747015463 learned_addr learned my addr 172.21.15.66:0/3747015463 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc8114150 con 0x7f6fc8102570 2024-09-15T23:03:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.144+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc8114450 con 0x7f6fc8100e20 2024-09-15T23:03:30.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.147+0000 7f6fcd0da640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8100e20 0x7f6fc8113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.147+0000 7f6fcc8d9640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 0x7f6fc8110a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.155+0000 7f6fcc8d9640 1 -- 172.21.15.66:0/3747015463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8100e20 msgr2=0x7f6fc8113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.155+0000 7f6fcc8d9640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8100e20 0x7f6fc8113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.156+0000 7f6fcc8d9640 1 -- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 msgr2=0x7f6fc8110f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.156+0000 7f6fcc8d9640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8110f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.156+0000 7f6fcc8d9640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc8111800 con 0x7f6fc8102570 2024-09-15T23:03:30.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.156+0000 7f6fcc8d9640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 0x7f6fc8110a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d6d0 tx=0x7f6fb800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.158+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8017070 con 0x7f6fc8102570 2024-09-15T23:03:30.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.159+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb8009820 con 0x7f6fc8102570 2024-09-15T23:03:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.159+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8004cd0 con 0x7f6fc8102570 2024-09-15T23:03:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.160+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc81a0810 con 0x7f6fc8102570 2024-09-15T23:03:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.160+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc81a0d00 con 0x7f6fc8102570 2024-09-15T23:03:30.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.164+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc81021b0 con 0x7f6fc8102570 2024-09-15T23:03:30.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.167+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f6fb8005220 con 0x7f6fc8102570 2024-09-15T23:03:30.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.168+0000 7f6fbe7fc640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 0x7f6fb40a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.168+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f6fb80cfff0 con 0x7f6fc8102570 2024-09-15T23:03:30.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.170+0000 7f6fcd0da640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 0x7f6fb40a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.171+0000 7f6fcd0da640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 0x7f6fb40a5940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0005fd0 tx=0x7f6fc0009680 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.173+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fb8020030 con 0x7f6fc8102570 2024-09-15T23:03:30.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.601+0000 7f6fcf33e640 1 -- 172.21.15.66:0/3747015463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fc81a1020 con 0x7f6fc8102570 2024-09-15T23:03:30.608 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:03:30.608 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":68,"btime":"2024-09-15T23:03:28:374700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":68,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:03:27.686535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:03:30.608 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 68 2024-09-15T23:03:30.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.606+0000 7f6fbe7fc640 1 -- 172.21.15.66:0/3747015463 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+11997 (secure 0 0 0) 0x7f6fb809c540 con 0x7f6fc8102570 2024-09-15T23:03:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.611+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 msgr2=0x7f6fb40a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.611+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 0x7f6fb40a5940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0005fd0 tx=0x7f6fc0009680 comp rx=0 tx=0).stop 2024-09-15T23:03:30.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.611+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 msgr2=0x7f6fc8110a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.611+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 0x7f6fc8110a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d6d0 tx=0x7f6fb800db90 comp rx=0 tx=0).stop 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 shutdown_connections 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f6fb40a3480 0x7f6fb40a5940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fc8102ef0 0x7f6fc8110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fc8102570 0x7f6fc8110a00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 --2- 172.21.15.66:0/3747015463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fc8100e20 0x7f6fc8113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.614+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 >> 172.21.15.66:0/3747015463 conn(0x7f6fc80fc7d0 msgr2=0x7f6fc8103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.618+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 shutdown_connections 2024-09-15T23:03:30.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.619+0000 7f6fb3fff640 1 -- 172.21.15.66:0/3747015463 wait complete. 2024-09-15T23:03:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.809+0000 7f2dfbb10640 1 -- 172.21.15.66:0/3703281433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 msgr2=0x7f2df411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.809+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/3703281433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df411d530 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f2df001a910 tx=0x7f2df003b470 comp rx=0 tx=0).stop 2024-09-15T23:03:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.812+0000 7f2dfbb10640 1 -- 172.21.15.66:0/3703281433 shutdown_connections 2024-09-15T23:03:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.812+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/3703281433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df411d530 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.812+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/3703281433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.812+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/3703281433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 0x7f2df4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.812+0000 7f2dfbb10640 1 -- 172.21.15.66:0/3703281433 >> 172.21.15.66:0/3703281433 conn(0x7f2df406e140 msgr2=0x7f2df406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.813+0000 7f2dfbb10640 1 -- 172.21.15.66:0/3703281433 shutdown_connections 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.813+0000 7f2dfbb10640 1 -- 172.21.15.66:0/3703281433 wait complete. 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 Processor -- start 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 -- start start 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 0x7f2df411a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df41168e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2df41133e0 con 0x7f2df411b140 2024-09-15T23:03:30.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4113260 con 0x7f2df4109450 2024-09-15T23:03:30.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.814+0000 7f2dfbb10640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4113560 con 0x7f2df4109830 2024-09-15T23:03:30.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.815+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.815+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41808/0 (socket says 172.21.15.66:41808) 2024-09-15T23:03:30.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.815+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/1776435900 learned_addr learned my addr 172.21.15.66:0/1776435900 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.815+0000 7f2df98ac640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 0x7f2df411a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2df90ab640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df41168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/1776435900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 msgr2=0x7f2df41168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df41168e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/1776435900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 msgr2=0x7f2df411a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 0x7f2df411a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/1776435900 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df4117550 con 0x7f2df411b140 2024-09-15T23:03:30.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.816+0000 7f2df90ab640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df41168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:03:30.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.817+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2df0004920 tx=0x7f2df0004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.817+0000 7f2deaffd640 1 -- 172.21.15.66:0/1776435900 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df004f070 con 0x7f2df411b140 2024-09-15T23:03:30.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.817+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df407a450 con 0x7f2df411b140 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.817+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df407a930 con 0x7f2df411b140 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.818+0000 7f2deaffd640 1 -- 172.21.15.66:0/1776435900 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2df0040ec0 con 0x7f2df411b140 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.818+0000 7f2deaffd640 1 -- 172.21.15.66:0/1776435900 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0046070 con 0x7f2df411b140 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.821+0000 7f2deaffd640 1 -- 172.21.15.66:0/1776435900 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2df0052070 con 0x7f2df411b140 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.822+0000 7f2deaffd640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 0x7f2de00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.823+0000 7f2deaffd640 1 -- 172.21.15.66:0/1776435900 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2df0101ee0 con 0x7f2df411b140 2024-09-15T23:03:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.830+0000 7f2df98ac640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 0x7f2de00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.836+0000 7f2df98ac640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 0x7f2de00a5a80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.840+0000 7f2dfdee9740 1 Processor -- start 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.840+0000 7f2dfdee9740 1 -- start start 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 0x563bfb9c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563bfb9292f0 con 0x563bfb9ce370 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563bfb8d0cf0 con 0x563bfb9c4b40 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563bfb9252b0 con 0x563bfb9c35d0 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9d0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41820/0 (socket says 172.21.15.66:41820) 2024-09-15T23:03:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.841+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/3175875022 learned_addr learned my addr 172.21.15.66:0/3175875022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.845+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 0x563bfb9c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.846+0000 7f2df98ac640 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.847+0000 7f2df90ab640 1 -- 172.21.15.66:0/3175875022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 msgr2=0x563bfb9c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.847+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.847+0000 7f2df90ab640 1 -- 172.21.15.66:0/3175875022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 msgr2=0x563bfb9d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.847+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.847+0000 7f2df90ab640 1 -- 172.21.15.66:0/3175875022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfb8b53a0 con 0x563bfb9c35d0 2024-09-15T23:03:30.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.849+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 0x563bfb9c3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2df4118130 tx=0x7f2dec00c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e4faf1b49a57a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.855+0000 7f2ddffff640 1 -- 172.21.15.66:0/3175875022 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec014070 con 0x563bfb9c35d0 2024-09-15T23:03:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.855+0000 7f2ddffff640 1 -- 172.21.15.66:0/3175875022 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dec00fb00 con 0x563bfb9c35d0 2024-09-15T23:03:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3175875022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 msgr2=0x563bfb9c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 0x563bfb9c3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2df4118130 tx=0x7f2dec00c670 comp rx=0 tx=0).stop 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3175875022 shutdown_connections 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c35d0 0x563bfb9c3a10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3175875022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.856+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3175875022 >> 172.21.15.66:0/3175875022 conn(0x563bfb98c310 msgr2=0x563bfb9bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.858+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3175875022 shutdown_connections 2024-09-15T23:03:30.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.858+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3175875022 wait complete. 2024-09-15T23:03:30.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.858+0000 7f2dfdee9740 1 -- start start 2024-09-15T23:03:30.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 Processor -- start 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c35d0 0x563bfb9cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563bfb9d10c0 con 0x563bfb9ce370 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x563bfb8e4060 con 0x563bfb9c35d0 2024-09-15T23:03:30.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563bfb9d1240 con 0x563bfb9c4b40 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.859+0000 7f2dfdee9740 10 client.0 _ll_register_callbacks cb 0x563bfb6378c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39476/0 (socket says 172.21.15.66:39476) 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 -- 172.21.15.66:0/3588431713 learned_addr learned my addr 172.21.15.66:0/3588431713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df98ac640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c35d0 0x563bfb9cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 -- 172.21.15.66:0/3588431713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c35d0 msgr2=0x563bfb9cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c35d0 0x563bfb9cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 -- 172.21.15.66:0/3588431713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 msgr2=0x563bfb9cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.860+0000 7f2df90ab640 1 -- 172.21.15.66:0/3588431713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfb69a3c0 con 0x563bfb9c4b40 2024-09-15T23:03:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.861+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00ffc0 tx=0x7f2dec00e500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87bc8d5bb8d905b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.862+0000 7f2ddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.862+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec014050 con 0x563bfb9c4b40 2024-09-15T23:03:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.862+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dec00fb00 con 0x563bfb9c4b40 2024-09-15T23:03:30.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.862+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2dec00f830 con 0x563bfb9c4b40 2024-09-15T23:03:30.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.867+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2dec02e050 con 0x563bfb9c4b40 2024-09-15T23:03:30.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.867+0000 7f2dfdee9740 10 client.28168 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:30.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.867+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x563bfb9dcaa0 con 0x563bfb9c4b40 2024-09-15T23:03:30.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.871+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dec007ac0 con 0x563bfb9c4b40 2024-09-15T23:03:30.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7f2dec029030 con 0x563bfb9c4b40 2024-09-15T23:03:30.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 10 client.28168 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 10 client.28168 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:03:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 20 client.28168 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9de2f0 0x563bfb9e0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 4 client.28168 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.872+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2dec00fb00 con 0x563bfb9de2f0 2024-09-15T23:03:30.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.876+0000 7f2df98ac640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9de2f0 0x563bfb9e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.889+0000 7f2ddd7fa640 10 client.28168 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:03:30.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.889+0000 7f2df98ac640 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9de2f0 0x563bfb9e0710 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35cfcecc64e5271c server_cookie=2c4af118a709eb50 in_seq=0 out_seq=0 2024-09-15T23:03:30.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.891+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/3588431713 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2dec00fb00 con 0x563bfb9de2f0 2024-09-15T23:03:30.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.891+0000 7f2ddd7fa640 10 client.28168 handle_command_reply: tid=0 2024-09-15T23:03:30.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.891+0000 7f2dfdee9740 1 client.28168 shutdown 2024-09-15T23:03:30.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.892+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 msgr2=0x563bfb9cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.892+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00ffc0 tx=0x7f2dec00e500 comp rx=0 tx=0).stop 2024-09-15T23:03:30.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 shutdown_connections 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9de2f0 0x563bfb9e0710 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9ce370 0x563bfb9cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cae80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3588431713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c35d0 0x563bfb9cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2ddd7fa640 0 client.28168 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 >> 172.21.15.66:0/3588431713 conn(0x563bfb98c310 msgr2=0x563bfb9c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 shutdown_connections 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.896+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3588431713 wait complete. 2024-09-15T23:03:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.897+0000 7f2dfdee9740 20 client.28168 trim_cache size 0 max 16384 2024-09-15T23:03:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.926+0000 7f2dfdee9740 1 Processor -- start 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 -- start start 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb98c310 0x563bfb9c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80103f0 con 0x563bfb9c35d0 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8012170 con 0x563bfb98c310 2024-09-15T23:03:30.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.927+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8010b50 con 0x563bfb9c4b40 2024-09-15T23:03:30.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df98ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb98c310 0x563bfb9c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41826/0 (socket says 172.21.15.66:41826) 2024-09-15T23:03:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 -- 172.21.15.66:0/3503399305 learned_addr learned my addr 172.21.15.66:0/3503399305 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 -- 172.21.15.66:0/3503399305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 msgr2=0x563bfb9cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 -- 172.21.15.66:0/3503399305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb98c310 msgr2=0x563bfb9c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.931+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb98c310 0x563bfb9c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.932+0000 7f2df90ab640 1 -- 172.21.15.66:0/3503399305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfb9e0d90 con 0x563bfb9c35d0 2024-09-15T23:03:30.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.934+0000 7f2df90ab640 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0022f0 tx=0x7f2dec003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da3dbfb8aeffb50 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.937+0000 7f2ddf7fe640 1 -- 172.21.15.66:0/3503399305 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec037070 con 0x563bfb9c35d0 2024-09-15T23:03:30.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.937+0000 7f2ddf7fe640 1 -- 172.21.15.66:0/3503399305 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dec007460 con 0x563bfb9c35d0 2024-09-15T23:03:30.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.937+0000 7f2ddf7fe640 1 -- 172.21.15.66:0/3503399305 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec014070 con 0x563bfb9c35d0 2024-09-15T23:03:30.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.939+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3503399305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 msgr2=0x563bfb9cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.939+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0022f0 tx=0x7f2dec003c40 comp rx=0 tx=0).stop 2024-09-15T23:03:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.940+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3503399305 shutdown_connections 2024-09-15T23:03:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.940+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb9c4b40 0x563bfb9cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.940+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf760 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.940+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/3503399305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb98c310 0x563bfb9c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.940+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3503399305 >> 172.21.15.66:0/3503399305 conn(0x563bfb9cb520 msgr2=0x563bfb9c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.943+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3503399305 shutdown_connections 2024-09-15T23:03:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.943+0000 7f2dfdee9740 1 -- 172.21.15.66:0/3503399305 wait complete. 2024-09-15T23:03:30.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.944+0000 7f2dfdee9740 1 -- start start 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.944+0000 7f2dfdee9740 1 Processor -- start 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.944+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb98c310 0x563bfb9d6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfdee9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80119e0 con 0x563bfb9c35d0 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8011250 con 0x563bfb9c4b40 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfdee9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd800e3f0 con 0x563bfb98c310 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfa0ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49440/0 (socket says 172.21.15.66:49440) 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.945+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/2836228780 learned_addr learned my addr 172.21.15.66:0/2836228780 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb98c310 msgr2=0x563bfb9d6dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb98c310 0x563bfb9d6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/2836228780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 msgr2=0x563bfb9cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 -- 172.21.15.66:0/2836228780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfb9cbec0 con 0x563bfb9c4b40 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.946+0000 7f2dfa0ad640 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2df0004ef0 tx=0x7f2df0040920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4037c83f1b9cfed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.947+0000 7f2dfdee9740 10 client.0 _ll_register_callbacks cb 0x7f2dec007d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.947+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dec007460 con 0x563bfb9c4b40 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.947+0000 7f2ddd7fa640 10 client.28277 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.947+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/2836228780 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0059040 con 0x563bfb9c4b40 2024-09-15T23:03:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.948+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/2836228780 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2df00ce9c0 con 0x563bfb9c4b40 2024-09-15T23:03:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.948+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/2836228780 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2df00ff5a0 con 0x563bfb9c4b40 2024-09-15T23:03:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.949+0000 7f2dfdee9740 10 client.28277 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.949+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({fsmap=68}) -- 0x563bfb9c0960 con 0x563bfb9c4b40 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.950+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/2836228780 <== mon.2 v2:172.21.15.87:3300/0 4 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7f2df00d6f40 con 0x563bfb9c4b40 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 10 client.28277 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 10 client.28277 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 20 client.28277 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9ce370 0x563bfba4b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 4 client.28277 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:03:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bfb936860 con 0x563bfb9ce370 2024-09-15T23:03:30.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.951+0000 7f2df98ac640 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9ce370 0x563bfba4b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:30.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.952+0000 7f2df98ac640 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9ce370 0x563bfba4b3c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1dcfd251f6b321ef server_cookie=7035c461f30aa5ac in_seq=0 out_seq=0 2024-09-15T23:03:30.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.952+0000 7f2ddd7fa640 10 client.28277 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:03:30.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.952+0000 7f2ddd7fa640 1 -- 172.21.15.66:0/2836228780 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bfb936860 con 0x563bfb9ce370 2024-09-15T23:03:30.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.953+0000 7f2ddd7fa640 10 client.28277 handle_command_reply: tid=0 2024-09-15T23:03:30.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.953+0000 7f2dfdee9740 1 client.28277 shutdown 2024-09-15T23:03:30.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.956+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 msgr2=0x563bfb9cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.956+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2df0004ef0 tx=0x7f2df0040920 comp rx=0 tx=0).stop 2024-09-15T23:03:30.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 shutdown_connections 2024-09-15T23:03:30.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x563bfb9ce370 0x563bfba4b3c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563bfb9c4b40 0x563bfb9cffb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bfb9c35d0 0x563bfb9cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 --2- 172.21.15.66:0/2836228780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563bfb98c310 0x563bfb9d6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 >> 172.21.15.66:0/2836228780 conn(0x563bfb9cb520 msgr2=0x563bfb9bed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2ddd7fa640 0 client.28277 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 shutdown_connections 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 1 -- 172.21.15.66:0/2836228780 wait complete. 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.960+0000 7f2dfdee9740 20 client.28277 trim_cache size 0 max 16384 2024-09-15T23:03:30.962 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:03:30.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 msgr2=0x7f2de00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 0x7f2de00a5a80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4008040 comp rx=0 tx=0).stop 2024-09-15T23:03:30.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 msgr2=0x7f2df4116e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2df0004920 tx=0x7f2df0004950 comp rx=0 tx=0).stop 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 shutdown_connections 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2de00a35c0 0x7f2de00a5a80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2df411b140 0x7f2df4116e20 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df4109830 0x7f2df41168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 --2- 172.21.15.66:0/1776435900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2df4109450 0x7f2df411a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 >> 172.21.15.66:0/1776435900 conn(0x7f2df406e140 msgr2=0x7f2df4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 shutdown_connections 2024-09-15T23:03:30.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:30.962+0000 7f2dfbb10640 1 -- 172.21.15.66:0/1776435900 wait complete. 2024-09-15T23:03:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:31 smithi184 ceph-mon[35203]: pgmap v572: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-15T23:03:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:31 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3747015463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:31 smithi066 ceph-mon[31185]: pgmap v572: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-15T23:03:31.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:31 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3747015463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:31.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:31 smithi087 ceph-mon[35290]: pgmap v572: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-15T23:03:31.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:31 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3747015463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:32.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:03:33.424 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 142.95 --await-for 45.0' 2024-09-15T23:03:33.424 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 142.95 --await-for 45.0 2024-09-15T23:03:33.539 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:33 smithi184 ceph-mon[35203]: pgmap v573: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-15T23:03:33.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:33 smithi066 ceph-mon[31185]: pgmap v573: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-15T23:03:33.881 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:33 smithi087 ceph-mon[35290]: pgmap v573: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-15T23:03:34.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.988+0000 7fc45ba18640 1 -- 172.21.15.66:0/669925073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 msgr2=0x7fc45411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:34.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.988+0000 7fc45ba18640 1 --2- 172.21.15.66:0/669925073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc45411d530 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009be0 tx=0x7fc44c02a6d0 comp rx=0 tx=0).stop 2024-09-15T23:03:34.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.990+0000 7fc45ba18640 1 -- 172.21.15.66:0/669925073 shutdown_connections 2024-09-15T23:03:34.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.990+0000 7fc45ba18640 1 --2- 172.21.15.66:0/669925073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc45411d530 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.990+0000 7fc45ba18640 1 --2- 172.21.15.66:0/669925073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 0x7fc454109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.990+0000 7fc45ba18640 1 --2- 172.21.15.66:0/669925073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc454109450 0x7fc454110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:34.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.990+0000 7fc45ba18640 1 -- 172.21.15.66:0/669925073 >> 172.21.15.66:0/669925073 conn(0x7fc45406e140 msgr2=0x7fc45406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.992+0000 7fc45ba18640 1 -- 172.21.15.66:0/669925073 shutdown_connections 2024-09-15T23:03:34.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.993+0000 7fc45ba18640 1 -- 172.21.15.66:0/669925073 wait complete. 2024-09-15T23:03:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.994+0000 7fc45ba18640 1 Processor -- start 2024-09-15T23:03:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 -- start start 2024-09-15T23:03:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc454109450 0x7fc4541186f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 0x7fc454111780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:34.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc454120da0 con 0x7fc45411b140 2024-09-15T23:03:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc454120c20 con 0x7fc454109450 2024-09-15T23:03:34.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc45ba18640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc454120f20 con 0x7fc454109830 2024-09-15T23:03:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.996+0000 7fc458fb3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 0x7fc454111780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.997+0000 7fc459fb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.997+0000 7fc459fb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38474/0 (socket says 172.21.15.66:38474) 2024-09-15T23:03:34.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.997+0000 7fc459fb5640 1 -- 172.21.15.66:0/2404076841 learned_addr learned my addr 172.21.15.66:0/2404076841 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 -- 172.21.15.66:0/2404076841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 msgr2=0x7fc454111780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 0x7fc454111780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 -- 172.21.15.66:0/2404076841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc454109450 msgr2=0x7fc4541186f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc454109450 0x7fc4541186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 -- 172.21.15.66:0/2404076841 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc454112280 con 0x7fc45411b140 2024-09-15T23:03:35.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:34.998+0000 7fc459fb5640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc44c034040 tx=0x7fc44c030cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.000+0000 7fc44a7fc640 1 -- 172.21.15.66:0/2404076841 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c041020 con 0x7fc45411b140 2024-09-15T23:03:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.000+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc454112510 con 0x7fc45411b140 2024-09-15T23:03:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.000+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541164a0 con 0x7fc45411b140 2024-09-15T23:03:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.000+0000 7fc44a7fc640 1 -- 172.21.15.66:0/2404076841 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc44c003e50 con 0x7fc45411b140 2024-09-15T23:03:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.000+0000 7fc44a7fc640 1 -- 172.21.15.66:0/2404076841 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c036040 con 0x7fc45411b140 2024-09-15T23:03:35.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.004+0000 7fc44a7fc640 1 -- 172.21.15.66:0/2404076841 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc44c044020 con 0x7fc45411b140 2024-09-15T23:03:35.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.007+0000 7fc44a7fc640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 0x7fc4400a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.008+0000 7fc44a7fc640 1 -- 172.21.15.66:0/2404076841 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fc44c0f0940 con 0x7fc45411b140 2024-09-15T23:03:35.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.010+0000 7fc45ddf1740 1 Processor -- start 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.010+0000 7fc45ddf1740 1 -- start start 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.010+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c0d5d0 0x559e00c0da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e00b732f0 con 0x559e00c18370 2024-09-15T23:03:35.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559e00b1acf0 con 0x559e00c0d5d0 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559e00b6f2b0 con 0x559e00c0eb40 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc4597b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc4597b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34878/0 (socket says 172.21.15.66:34878) 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.011+0000 7fc4597b4640 1 -- 172.21.15.66:0/2786997164 learned_addr learned my addr 172.21.15.66:0/2786997164 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.012+0000 7fc4597b4640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 0x7fc4400a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.012+0000 7fc459fb5640 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 -- 172.21.15.66:0/2786997164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c0d5d0 msgr2=0x559e00c0da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:03:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c0d5d0 0x559e00c0da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 -- 172.21.15.66:0/2786997164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 msgr2=0x559e00c1a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 -- 172.21.15.66:0/2786997164 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e00aff3a0 con 0x559e00c0eb40 2024-09-15T23:03:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.013+0000 7fc4597b4640 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc450014700 tx=0x7fc450014bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ffcea580b1bde server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.016+0000 7fc4597b4640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 0x7fc4400a5a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d000 tx=0x7fc450019000 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.016+0000 7fc43f7fe640 1 -- 172.21.15.66:0/2786997164 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450005230 con 0x559e00c0eb40 2024-09-15T23:03:35.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.016+0000 7fc43f7fe640 1 -- 172.21.15.66:0/2786997164 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450011e50 con 0x559e00c0eb40 2024-09-15T23:03:35.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.017+0000 7fc45ddf1740 1 -- 172.21.15.66:0/2786997164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 msgr2=0x559e00c0d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.017+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc450014700 tx=0x7fc450014bc0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.018+0000 7fc45ddf1740 1 -- 172.21.15.66:0/2786997164 shutdown_connections 2024-09-15T23:03:35.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.018+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.018+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c0d5d0 0x559e00c0da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.018+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/2786997164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0eb40 0x559e00c0d090 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc450014700 tx=0x7fc450014bc0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.018+0000 7fc45ddf1740 1 -- 172.21.15.66:0/2786997164 >> 172.21.15.66:0/2786997164 conn(0x559e00bd6310 msgr2=0x559e00c09c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:35.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.020+0000 7fc45ddf1740 1 -- 172.21.15.66:0/2786997164 shutdown_connections 2024-09-15T23:03:35.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.020+0000 7fc45ddf1740 1 -- 172.21.15.66:0/2786997164 wait complete. 2024-09-15T23:03:35.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 -- start start 2024-09-15T23:03:35.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 Processor -- start 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c0d5d0 0x559e00c15100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 0x559e00c15640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 0x559e00c24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.021+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559e00c1b000 con 0x559e00c0d5d0 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.022+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559e00b2e060 con 0x559e00c18370 2024-09-15T23:03:35.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.022+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559e00c1b180 con 0x559e00c15b80 2024-09-15T23:03:35.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.022+0000 7fc45ddf1740 10 client.0 _ll_register_callbacks cb 0x559e008818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:35.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.023+0000 7fc459fb5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 0x559e00c24560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.023+0000 7fc458fb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 0x559e00c15640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.023+0000 7fc458fb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 0x559e00c15640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37050/0 (socket says 172.21.15.66:37050) 2024-09-15T23:03:35.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.023+0000 7fc458fb3640 1 -- 172.21.15.66:0/1560756814 learned_addr learned my addr 172.21.15.66:0/1560756814 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:35.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.027+0000 7fc4597b4640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c0d5d0 0x559e00c15100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.029+0000 7fc459fb5640 1 -- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 msgr2=0x559e00c15640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.029+0000 7fc459fb5640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 0x559e00c15640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.029+0000 7fc459fb5640 1 -- 172.21.15.66:0/1560756814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c0d5d0 msgr2=0x559e00c15100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.029+0000 7fc459fb5640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c0d5d0 0x559e00c15100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.029+0000 7fc459fb5640 1 -- 172.21.15.66:0/1560756814 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e008e43c0 con 0x559e00c15b80 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.030+0000 7fc459fb5640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 0x559e00c24560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0edc90 tx=0x7fc44c0bc240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b50584a627b6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.030+0000 7fc43cff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:35.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.031+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0d4020 con 0x559e00c15b80 2024-09-15T23:03:35.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.031+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fc44c0bca80 con 0x559e00c15b80 2024-09-15T23:03:35.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.038+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc450011e50 con 0x559e00c15b80 2024-09-15T23:03:35.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.041+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc44c0c0bd0 con 0x559e00c15b80 2024-09-15T23:03:35.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.045+0000 7fc45ddf1740 10 client.28183 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:35.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.045+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x559e00c1b000 con 0x559e00c15b80 2024-09-15T23:03:35.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450011e50 con 0x559e00c15b80 2024-09-15T23:03:35.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7fc44c0c5000 con 0x559e00c15b80 2024-09-15T23:03:35.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 10 client.28183 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:35.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 10 client.28183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:35.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 20 client.28183 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:35.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00c4a520 0x559e00c4c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 4 client.28183 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:35.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.047+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e00b80860 con 0x559e00c4a520 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.050+0000 7fc4597b4640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00c4a520 0x559e00c4c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.055+0000 7fc4597b4640 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00c4a520 0x559e00c4c9a0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1946dd9a928302 server_cookie=74ae3ad9e27c50f2 in_seq=0 out_seq=0 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.056+0000 7fc43cff9640 10 client.28183 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.056+0000 7fc43cff9640 1 -- 172.21.15.66:0/1560756814 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e00b80860 con 0x559e00c4a520 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.056+0000 7fc43cff9640 10 client.28183 handle_command_reply: tid=0 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.056+0000 7fc45ddf1740 1 client.28183 shutdown 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.057+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 msgr2=0x559e00c24560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.057+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 0x559e00c24560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0edc90 tx=0x7fc44c0bc240 comp rx=0 tx=0).stop 2024-09-15T23:03:35.059 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 shutdown_connections 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c15b80 0x559e00c24560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00c4a520 0x559e00c4c9a0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c18370 0x559e00c15640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1560756814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c0d5d0 0x559e00c15100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 >> 172.21.15.66:0/1560756814 conn(0x559e00bd6310 msgr2=0x559e00c0f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:35.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.058+0000 7fc43cff9640 0 client.28183 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:35.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.061+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 shutdown_connections 2024-09-15T23:03:35.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.062+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1560756814 wait complete. 2024-09-15T23:03:35.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.063+0000 7fc45ddf1740 20 client.28183 trim_cache size 0 max 16384 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.094+0000 7fc45ddf1740 1 Processor -- start 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 -- start start 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c10660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c52270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc438010440 con 0x559e00c18370 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4380121c0 con 0x559e00c15b80 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.095+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc438010ba0 con 0x559e00c0d5d0 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34900/0 (socket says 172.21.15.66:34900) 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 -- 172.21.15.66:0/3154003069 learned_addr learned my addr 172.21.15.66:0/3154003069 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:35.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc458fb3640 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c10660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 -- 172.21.15.66:0/3154003069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 msgr2=0x559e00c10660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c10660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 -- 172.21.15.66:0/3154003069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 msgr2=0x559e00c52270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c52270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.096+0000 7fc4597b4640 1 -- 172.21.15.66:0/3154003069 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e00c17810 con 0x559e00c0d5d0 2024-09-15T23:03:35.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.097+0000 7fc4597b4640 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc450004700 tx=0x7fc450016040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a92ef35d6e1dec42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.099+0000 7fc43effd640 1 -- 172.21.15.66:0/3154003069 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45000fda0 con 0x559e00c0d5d0 2024-09-15T23:03:35.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.099+0000 7fc43effd640 1 -- 172.21.15.66:0/3154003069 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450034030 con 0x559e00c0d5d0 2024-09-15T23:03:35.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.100+0000 7fc45ddf1740 1 -- 172.21.15.66:0/3154003069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 msgr2=0x559e00c10120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.100+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc450004700 tx=0x7fc450016040 comp rx=0 tx=0).stop 2024-09-15T23:03:35.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.107+0000 7fc45ddf1740 1 -- 172.21.15.66:0/3154003069 shutdown_connections 2024-09-15T23:03:35.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.107+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c52270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.107+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c10660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.107+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/3154003069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c10120 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.107+0000 7fc45ddf1740 1 -- 172.21.15.66:0/3154003069 >> 172.21.15.66:0/3154003069 conn(0x559e00bd6310 msgr2=0x559e00c151e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:35.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.111+0000 7fc45ddf1740 1 -- 172.21.15.66:0/3154003069 shutdown_connections 2024-09-15T23:03:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.115+0000 7fc45ddf1740 1 -- 172.21.15.66:0/3154003069 wait complete. 2024-09-15T23:03:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.115+0000 7fc45ddf1740 1 -- start start 2024-09-15T23:03:35.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.115+0000 7fc45ddf1740 1 Processor -- start 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c1bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc438011a30 con 0x559e00c18370 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4380112a0 con 0x559e00c15b80 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc43800e440 con 0x559e00c0d5d0 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.116+0000 7fc45ddf1740 10 client.0 _ll_register_callbacks cb 0x7fc44c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.119+0000 7fc4597b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.120+0000 7fc459fb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.120+0000 7fc459fb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38508/0 (socket says 172.21.15.66:38508) 2024-09-15T23:03:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.120+0000 7fc459fb5640 1 -- 172.21.15.66:0/1288093755 learned_addr learned my addr 172.21.15.66:0/1288093755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:35.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.122+0000 7fc458fb3640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c1bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.124+0000 7fc458fb3640 1 -- 172.21.15.66:0/1288093755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 msgr2=0x559e00c208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.124+0000 7fc458fb3640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.124+0000 7fc458fb3640 1 -- 172.21.15.66:0/1288093755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 msgr2=0x559e00c1c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.124+0000 7fc458fb3640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.124+0000 7fc458fb3640 1 -- 172.21.15.66:0/1288093755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e00c1c6f0 con 0x559e00c15b80 2024-09-15T23:03:35.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.130+0000 7fc458fb3640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c1bc70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x559e00c1ad80 tx=0x7fc444012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfed594c6f50c7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:35.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.135+0000 7fc43cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:03:35.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.135+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444004030 con 0x559e00c15b80 2024-09-15T23:03:35.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.135+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fc444018070 con 0x559e00c15b80 2024-09-15T23:03:35.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.140+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc450034030 con 0x559e00c15b80 2024-09-15T23:03:35.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.142+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc4440041d0 con 0x559e00c15b80 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.142+0000 7fc45ddf1740 10 client.28289 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.142+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x559e00cb4f30 con 0x559e00c15b80 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450034030 con 0x559e00c15b80 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7fc444010770 con 0x559e00c15b80 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 10 client.28289 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 10 client.28289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 20 client.28289 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00cb56f0 0x559e00cb7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 4 client.28289 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:03:35.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.143+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e00b7ad70 con 0x559e00cb56f0 2024-09-15T23:03:35.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.144+0000 7fc4597b4640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00cb56f0 0x559e00cb7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:35.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.149+0000 7fc43cff9640 10 client.28289 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:35.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.149+0000 7fc4597b4640 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00cb56f0 0x559e00cb7b10 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b437fc60be6f781 server_cookie=9305a5b1e36e5dce in_seq=0 out_seq=0 2024-09-15T23:03:35.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.158+0000 7fc43cff9640 1 -- 172.21.15.66:0/1288093755 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e00b7ad70 con 0x559e00cb56f0 2024-09-15T23:03:35.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.158+0000 7fc43cff9640 10 client.28289 handle_command_reply: tid=0 2024-09-15T23:03:35.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.158+0000 7fc45ddf1740 1 client.28289 shutdown 2024-09-15T23:03:35.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 msgr2=0x559e00c1bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c1bc70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x559e00c1ad80 tx=0x7fc444012820 comp rx=0 tx=0).stop 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 shutdown_connections 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559e00c18370 0x559e00c1c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559e00cb56f0 0x559e00cb7b10 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e00c15b80 0x559e00c1bc70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 --2- 172.21.15.66:0/1288093755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e00c0d5d0 0x559e00c208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc43cff9640 0 client.28289 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 >> 172.21.15.66:0/1288093755 conn(0x559e00bd6310 msgr2=0x559e00c084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 shutdown_connections 2024-09-15T23:03:35.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 1 -- 172.21.15.66:0/1288093755 wait complete. 2024-09-15T23:03:35.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.159+0000 7fc45ddf1740 20 client.28289 trim_cache size 0 max 16384 2024-09-15T23:03:35.163 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:03:35.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.160+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 msgr2=0x7fc4400a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.160+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 0x7fc4400a5a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d000 tx=0x7fc450019000 comp rx=0 tx=0).stop 2024-09-15T23:03:35.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.160+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 msgr2=0x7fc454111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:35.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.160+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc44c034040 tx=0x7fc44c030cd0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 shutdown_connections 2024-09-15T23:03:35.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc4400a3540 0x7fc4400a5a00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc45411b140 0x7fc454111cc0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc454109830 0x7fc454111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 --2- 172.21.15.66:0/2404076841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc454109450 0x7fc4541186f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:35.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.164+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 >> 172.21.15.66:0/2404076841 conn(0x7fc45406e140 msgr2=0x7fc45411c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:35.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.168+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 shutdown_connections 2024-09-15T23:03:35.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:35.168+0000 7fc45ba18640 1 -- 172.21.15.66:0/2404076841 wait complete. 2024-09-15T23:03:35.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:35 smithi066 ceph-mon[31185]: pgmap v574: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 146 op/s 2024-09-15T23:03:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:35 smithi184 ceph-mon[35203]: pgmap v574: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 146 op/s 2024-09-15T23:03:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:35 smithi087 ceph-mon[35290]: pgmap v574: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 146 op/s 2024-09-15T23:03:36.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.403+0000 7f8ac6c94640 1 -- 172.21.15.66:0/844767674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01012d0 msgr2=0x7f8ac0104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.404+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/844767674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01012d0 0x7f8ac0104e70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8ab401a910 tx=0x7f8ab403b470 comp rx=0 tx=0).stop 2024-09-15T23:03:36.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.407+0000 7f8ac6c94640 1 -- 172.21.15.66:0/844767674 shutdown_connections 2024-09-15T23:03:36.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.407+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/844767674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01055a0 0x7f8ac010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.407+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/844767674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01012d0 0x7f8ac0104e70 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.407+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/844767674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac0100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.407+0000 7f8ac6c94640 1 -- 172.21.15.66:0/844767674 >> 172.21.15.66:0/844767674 conn(0x7f8ac0075f70 msgr2=0x7f8ac0076380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:36.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.410+0000 7f8ac6c94640 1 -- 172.21.15.66:0/844767674 shutdown_connections 2024-09-15T23:03:36.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.410+0000 7f8ac6c94640 1 -- 172.21.15.66:0/844767674 wait complete. 2024-09-15T23:03:36.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.411+0000 7f8ac6c94640 1 Processor -- start 2024-09-15T23:03:36.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.414+0000 7f8ac6c94640 1 -- start start 2024-09-15T23:03:36.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.414+0000 7f8ac6c94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac010cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.415+0000 7f8ac6c94640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 0x7f8ac0108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.415+0000 7f8ac6c94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01055a0 0x7f8ac0109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.415+0000 7f8ac6c94640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac006e6d0 con 0x7f8ac01055a0 2024-09-15T23:03:36.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.415+0000 7f8ac6c94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac006e550 con 0x7f8ac0100920 2024-09-15T23:03:36.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.415+0000 7f8ac6c94640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac006e850 con 0x7f8ac01012d0 2024-09-15T23:03:36.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.416+0000 7f8ac4a30640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac010cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.416+0000 7f8ac4a30640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac010cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37084/0 (socket says 172.21.15.66:37084) 2024-09-15T23:03:36.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.416+0000 7f8ac4a30640 1 -- 172.21.15.66:0/13120893 learned_addr learned my addr 172.21.15.66:0/13120893 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:36.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.416+0000 7f8abffff640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 0x7f8ac0108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.418+0000 7f8abffff640 1 -- 172.21.15.66:0/13120893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 msgr2=0x7f8ac010cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.418+0000 7f8abffff640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac010cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.418+0000 7f8abffff640 1 -- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01055a0 msgr2=0x7f8ac0109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.418+0000 7f8abffff640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01055a0 0x7f8ac0109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.418+0000 7f8abffff640 1 -- 172.21.15.66:0/13120893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac0109d10 con 0x7f8ac01012d0 2024-09-15T23:03:36.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.419+0000 7f8abffff640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 0x7f8ac0108f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ab401a860 tx=0x7f8ab4004c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.421+0000 7f8abdffb640 1 -- 172.21.15.66:0/13120893 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab404f070 con 0x7f8ac01012d0 2024-09-15T23:03:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.421+0000 7f8abdffb640 1 -- 172.21.15.66:0/13120893 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab4004d70 con 0x7f8ac01012d0 2024-09-15T23:03:36.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.421+0000 7f8abdffb640 1 -- 172.21.15.66:0/13120893 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4046030 con 0x7f8ac01012d0 2024-09-15T23:03:36.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.421+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac019a9b0 con 0x7f8ac01012d0 2024-09-15T23:03:36.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.422+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac019af20 con 0x7f8ac01012d0 2024-09-15T23:03:36.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.425+0000 7f8ac906d740 1 Processor -- start 2024-09-15T23:03:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 -- start start 2024-09-15T23:03:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe55040 0x5576efe55420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe54260 0x5576efe6c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576efdbb160 con 0x5576efe538e0 2024-09-15T23:03:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5576efd62720 con 0x5576efe54260 2024-09-15T23:03:36.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.426+0000 7f8ac906d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5576efdb7120 con 0x5576efe55040 2024-09-15T23:03:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.428+0000 7f8ac4a30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.428+0000 7f8ac4a30640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38538/0 (socket says 172.21.15.66:38538) 2024-09-15T23:03:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.429+0000 7f8ac4a30640 1 -- 172.21.15.66:0/536537280 learned_addr learned my addr 172.21.15.66:0/536537280 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:36.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.429+0000 7f8abdffb640 1 -- 172.21.15.66:0/13120893 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8ab4052070 con 0x7f8ac01012d0 2024-09-15T23:03:36.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.430+0000 7f8ac5231640 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe55040 0x5576efe55420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.444+0000 7f8abffff640 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe54260 0x5576efe6c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.445+0000 7f8ac4a30640 1 -- 172.21.15.66:0/536537280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe55040 msgr2=0x5576efe55420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.445+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe55040 0x5576efe55420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.445+0000 7f8ac4a30640 1 -- 172.21.15.66:0/536537280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe54260 msgr2=0x5576efe6c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.445+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe54260 0x5576efe6c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.445+0000 7f8ac4a30640 1 -- 172.21.15.66:0/536537280 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576efb2cba0 con 0x5576efe538e0 2024-09-15T23:03:36.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.446+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009b10 tx=0x7f8ab000e1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2194664ea56cc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.447+0000 7f8aa6ffd640 1 -- 172.21.15.66:0/536537280 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0017070 con 0x5576efe538e0 2024-09-15T23:03:36.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.447+0000 7f8aa6ffd640 1 -- 172.21.15.66:0/536537280 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab000eb80 con 0x5576efe538e0 2024-09-15T23:03:36.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.447+0000 7f8aa6ffd640 1 -- 172.21.15.66:0/536537280 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00125f0 con 0x5576efe538e0 2024-09-15T23:03:36.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.446+0000 7f8abdffb640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 0x7f8aa80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.447+0000 7f8abdffb640 1 -- 172.21.15.66:0/13120893 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f8ab4101440 con 0x7f8ac01012d0 2024-09-15T23:03:36.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.448+0000 7f8ac5231640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 0x7f8aa80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.449+0000 7f8ac5231640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 0x7f8aa80a5a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009f00 tx=0x7f8ab800d040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 -- 172.21.15.66:0/536537280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 msgr2=0x5576efe53d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009b10 tx=0x7f8ab000e1d0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 -- 172.21.15.66:0/536537280 shutdown_connections 2024-09-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe54260 0x5576efe6c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe53d20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 --2- 172.21.15.66:0/536537280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe55040 0x5576efe55420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.455+0000 7f8ac906d740 1 -- 172.21.15.66:0/536537280 >> 172.21.15.66:0/536537280 conn(0x5576efe55b50 msgr2=0x5576efe57f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:36.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.460+0000 7f8ac906d740 1 -- 172.21.15.66:0/536537280 shutdown_connections 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.460+0000 7f8ac906d740 1 -- 172.21.15.66:0/536537280 wait complete. 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.460+0000 7f8ac906d740 1 -- start start 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.460+0000 7f8ac906d740 1 Processor -- start 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe66710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe66c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576efe5e130 con 0x5576efe538e0 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5576efd43900 con 0x5576efe55040 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5576efe5e2b0 con 0x5576efe54260 2024-09-15T23:03:36.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.461+0000 7f8ac906d740 10 client.0 _ll_register_callbacks cb 0x5576efd41780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:36.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.462+0000 7f8ac5231640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.462+0000 7f8abffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe66c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.462+0000 7f8ac5231640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37100/0 (socket says 172.21.15.66:37100) 2024-09-15T23:03:36.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.462+0000 7f8ac5231640 1 -- 172.21.15.66:0/3801912205 learned_addr learned my addr 172.21.15.66:0/3801912205 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.464+0000 7f8ac5231640 1 -- 172.21.15.66:0/3801912205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 msgr2=0x5576efe66c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.464+0000 7f8ac5231640 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe66c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.464+0000 7f8ac5231640 1 -- 172.21.15.66:0/3801912205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 msgr2=0x5576efe66710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.464+0000 7f8ac5231640 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe66710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.464+0000 7f8ac5231640 1 -- 172.21.15.66:0/3801912205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576efd83c50 con 0x5576efe55040 2024-09-15T23:03:36.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.465+0000 7f8ac5231640 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8016cc0 tx=0x7f8ab8004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e91c532ae15120 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.468+0000 7f8a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:03:36.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.468+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8025060 con 0x5576efe55040 2024-09-15T23:03:36.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.468+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab000eb80 con 0x5576efe55040 2024-09-15T23:03:36.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.468+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f8ab80205f0 con 0x5576efe55040 2024-09-15T23:03:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.472+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f8ab800ae30 con 0x5576efe55040 2024-09-15T23:03:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.472+0000 7f8ac906d740 10 client.28298 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:36.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.472+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x5576efe813f0 con 0x5576efe55040 2024-09-15T23:03:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab000eb80 con 0x5576efe55040 2024-09-15T23:03:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7f8ab80299f0 con 0x5576efe55040 2024-09-15T23:03:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 10 client.28298 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:36.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 10 client.28298 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:03:36.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 20 client.28298 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:36.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efe82910 0x5576efe84dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 4 client.28298 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:36.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.474+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576efdc8890 con 0x5576efe82910 2024-09-15T23:03:36.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.476+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efe82910 0x5576efe84dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.482+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efe82910 0x5576efe84dd0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee5cc06bdd4aa9db server_cookie=9ef51db96112f2b7 in_seq=0 out_seq=0 2024-09-15T23:03:36.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.482+0000 7f8a9ffff640 10 client.28298 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:36.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.488+0000 7f8a9ffff640 1 -- 172.21.15.66:0/3801912205 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576efdc8890 con 0x5576efe82910 2024-09-15T23:03:36.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.488+0000 7f8a9ffff640 10 client.28298 handle_command_reply: tid=0 2024-09-15T23:03:36.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.488+0000 7f8ac906d740 1 client.28298 shutdown 2024-09-15T23:03:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 msgr2=0x5576efe6c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8016cc0 tx=0x7f8ab8004b60 comp rx=0 tx=0).stop 2024-09-15T23:03:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 shutdown_connections 2024-09-15T23:03:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efe82910 0x5576efe84dd0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe6c420 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe66c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 --2- 172.21.15.66:0/3801912205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe66710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8a9ffff640 0 client.28298 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 >> 172.21.15.66:0/3801912205 conn(0x5576efe55b50 msgr2=0x5576efe57f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 shutdown_connections 2024-09-15T23:03:36.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.492+0000 7f8ac906d740 1 -- 172.21.15.66:0/3801912205 wait complete. 2024-09-15T23:03:36.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.493+0000 7f8ac906d740 20 client.28298 trim_cache size 0 max 16384 2024-09-15T23:03:36.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.526+0000 7f8ac906d740 1 Processor -- start 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 -- start start 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe6c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe5f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe4df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0103b0 con 0x5576efe538e0 2024-09-15T23:03:36.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac012130 con 0x5576efe55040 2024-09-15T23:03:36.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.527+0000 7f8ac906d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac010b10 con 0x5576efe54260 2024-09-15T23:03:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.531+0000 7f8abffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe5f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.531+0000 7f8abffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe5f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34954/0 (socket says 172.21.15.66:34954) 2024-09-15T23:03:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.531+0000 7f8abffff640 1 -- 172.21.15.66:0/2753448537 learned_addr learned my addr 172.21.15.66:0/2753448537 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:36.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.533+0000 7f8ac5231640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe4df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.536+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe6c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.537+0000 7f8ac5231640 1 -- 172.21.15.66:0/2753448537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 msgr2=0x5576efe5f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.537+0000 7f8ac5231640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe5f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.537+0000 7f8ac5231640 1 -- 172.21.15.66:0/2753448537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 msgr2=0x5576efe6c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.537+0000 7f8ac5231640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe6c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.537+0000 7f8ac5231640 1 -- 172.21.15.66:0/2753448537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576efe5c900 con 0x5576efe55040 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.538+0000 7f8ac5231640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe4df60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8029e40 tx=0x7f8ab800be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21294197b2ba650 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.541+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:03:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.541+0000 7f8aa67fc640 1 -- 172.21.15.66:0/2753448537 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab802f080 con 0x5576efe55040 2024-09-15T23:03:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.541+0000 7f8aa67fc640 1 -- 172.21.15.66:0/2753448537 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab8029880 con 0x5576efe55040 2024-09-15T23:03:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.541+0000 7f8aa67fc640 1 -- 172.21.15.66:0/2753448537 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8034a70 con 0x5576efe55040 2024-09-15T23:03:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.542+0000 7f8ac906d740 1 -- 172.21.15.66:0/2753448537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 msgr2=0x5576efe4df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.543+0000 7f8ac906d740 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe4df60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8029e40 tx=0x7f8ab800be80 comp rx=0 tx=0).stop 2024-09-15T23:03:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.546+0000 7f8ac906d740 1 -- 172.21.15.66:0/2753448537 shutdown_connections 2024-09-15T23:03:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.546+0000 7f8ac906d740 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe4df60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.546+0000 7f8ac906d740 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe54260 0x5576efe5f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.546+0000 7f8ac906d740 1 --2- 172.21.15.66:0/2753448537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe538e0 0x5576efe6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.546+0000 7f8ac906d740 1 -- 172.21.15.66:0/2753448537 >> 172.21.15.66:0/2753448537 conn(0x5576efe55b50 msgr2=0x5576efe60300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.547+0000 7f8ac906d740 1 -- 172.21.15.66:0/2753448537 shutdown_connections 2024-09-15T23:03:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.547+0000 7f8ac906d740 1 -- 172.21.15.66:0/2753448537 wait complete. 2024-09-15T23:03:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.548+0000 7f8ac906d740 1 -- start start 2024-09-15T23:03:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.548+0000 7f8ac906d740 1 Processor -- start 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.549+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 0x5576efe96410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.549+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 0x5576efe96950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.549+0000 7f8ac906d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe5a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.550+0000 7f8ac906d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0119a0 con 0x5576efe54260 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.550+0000 7f8ac906d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac011210 con 0x5576efe55040 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.550+0000 7f8ac906d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac00e3b0 con 0x5576efe538e0 2024-09-15T23:03:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.550+0000 7f8ac906d740 10 client.0 _ll_register_callbacks cb 0x7f8ab8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:36.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.552+0000 7f8abffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 0x5576efe96950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.552+0000 7f8abffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 0x5576efe96950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38550/0 (socket says 172.21.15.66:38550) 2024-09-15T23:03:36.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.552+0000 7f8abffff640 1 -- 172.21.15.66:0/1316940142 learned_addr learned my addr 172.21.15.66:0/1316940142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 0x5576efe96410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac5231640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe5a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 -- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 msgr2=0x5576efe5a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe5a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 -- 172.21.15.66:0/1316940142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 msgr2=0x5576efe96950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 0x5576efe96950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.553+0000 7f8ac4a30640 1 -- 172.21.15.66:0/1316940142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576efe5ab30 con 0x5576efe538e0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.554+0000 7f8ac4a30640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 0x5576efe96410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0006a50 tx=0x7f8ab0013e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b2343f503f8b35e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.554+0000 7f8a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.554+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0017040 con 0x5576efe538e0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.554+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f8ab0004040 con 0x5576efe538e0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.555+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab8029880 con 0x5576efe538e0 2024-09-15T23:03:36.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.555+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f8ab0004240 con 0x5576efe538e0 2024-09-15T23:03:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.558+0000 7f8ac906d740 10 client.28204 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:36.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.558+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x5576efeedb60 con 0x5576efe538e0 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab8029880 con 0x5576efe538e0 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7f8ab00037a0 con 0x5576efe538e0 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8ac906d740 10 client.28204 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8ac906d740 10 client.28204 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8ac906d740 20 client.28204 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.559+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efeee020 0x5576efef0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.560+0000 7f8ac906d740 4 client.28204 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.95, "await_for": 45.0}] 2024-09-15T23:03:36.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.560+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.95, "await_for": 45.0}) -- 0x5576efdc2be0 con 0x5576efeee020 2024-09-15T23:03:36.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.560+0000 7f8abffff640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efeee020 0x5576efef0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:36.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.565+0000 7f8abffff640 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efeee020 0x5576efef0440 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c7e5e41e6e373 server_cookie=c7f82094c668c608 in_seq=0 out_seq=0 2024-09-15T23:03:36.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:36.566+0000 7f8a9ffff640 10 client.28204 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:37.065 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:03:37.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:03:37.568 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:37.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:37 smithi066 ceph-mon[31185]: pgmap v575: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 156 op/s 2024-09-15T23:03:37.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:37 smithi087 ceph-mon[35290]: pgmap v575: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 156 op/s 2024-09-15T23:03:37.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:37 smithi184 ceph-mon[35203]: pgmap v575: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 156 op/s 2024-09-15T23:03:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.373+0000 7f8a9ffff640 1 -- 172.21.15.66:0/1316940142 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5576efdc2be0 con 0x5576efeee020 2024-09-15T23:03:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.373+0000 7f8a9ffff640 10 client.28204 handle_command_reply: tid=0 2024-09-15T23:03:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.373+0000 7f8ac906d740 1 client.28204 shutdown 2024-09-15T23:03:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 msgr2=0x5576efe96410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:39.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 0x5576efe96410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0006a50 tx=0x7f8ab0013e20 comp rx=0 tx=0).stop 2024-09-15T23:03:39.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 shutdown_connections 2024-09-15T23:03:39.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5576efeee020 0x5576efef0440 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8a9ffff640 0 client.28204 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5576efe55040 0x5576efe5a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576efe54260 0x5576efe96950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 --2- 172.21.15.66:0/1316940142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5576efe538e0 0x5576efe96410 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 >> 172.21.15.66:0/1316940142 conn(0x5576efe55b50 msgr2=0x5576efe60b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 shutdown_connections 2024-09-15T23:03:39.377 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 68, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 62, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "3e612877": { 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 62, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.9, 2024-09-15T23:03:39.378 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:39.379 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.374+0000 7f8ac906d740 1 -- 172.21.15.66:0/1316940142 wait complete. 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.375+0000 7f8ac906d740 20 client.28204 trim_cache size 0 max 16384 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 msgr2=0x7f8aa80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 0x7f8aa80a5a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009f00 tx=0x7f8ab800d040 comp rx=0 tx=0).stop 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 msgr2=0x7f8ac0108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 0x7f8ac0108f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8ab401a860 tx=0x7f8ab4004c00 comp rx=0 tx=0).stop 2024-09-15T23:03:39.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 shutdown_connections 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8aa80a35c0 0x7f8aa80a5a80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac01055a0 0x7f8ac0109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac01012d0 0x7f8ac0108f40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 --2- 172.21.15.66:0/13120893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ac0100920 0x7f8ac010cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 >> 172.21.15.66:0/13120893 conn(0x7f8ac0075f70 msgr2=0x7f8ac00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 shutdown_connections 2024-09-15T23:03:39.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.376+0000 7f8ac6c94640 1 -- 172.21.15.66:0/13120893 wait complete. 2024-09-15T23:03:39.660 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:39 smithi066 ceph-mon[31185]: pgmap v576: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-15T23:03:39.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:39 smithi087 ceph-mon[35290]: pgmap v576: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-15T23:03:39.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:39 smithi184 ceph-mon[35203]: pgmap v576: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-15T23:03:40.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/1713868126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec101de0 msgr2=0x7fdaec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/1713868126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec101de0 0x7fdaec1021c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad402a410 comp rx=0 tx=0).stop 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/1713868126 shutdown_connections 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/1713868126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 0x7fdaec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/1713868126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec102790 0x7fdaec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/1713868126 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec101de0 0x7fdaec1021c0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/1713868126 >> 172.21.15.66:0/1713868126 conn(0x7fdaec0fd8c0 msgr2=0x7fdaec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/1713868126 shutdown_connections 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.659+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/1713868126 wait complete. 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.660+0000 7fdaf0f8a640 1 Processor -- start 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.660+0000 7fdaf0f8a640 1 -- start start 2024-09-15T23:03:40.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec101de0 0x7fdaec1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 0x7fdaec19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec111f70 con 0x7fdaec102790 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec111df0 con 0x7fdaec106f10 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1120f0 con 0x7fdaec101de0 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38570/0 (socket says 172.21.15.66:38570) 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 -- 172.21.15.66:0/385451510 learned_addr learned my addr 172.21.15.66:0/385451510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaea59c640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec101de0 0x7fdaec1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaead9d640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 0x7fdaec19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 -- 172.21.15.66:0/385451510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec101de0 msgr2=0x7fdaec1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec101de0 0x7fdaec1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 -- 172.21.15.66:0/385451510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 msgr2=0x7fdaec19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 0x7fdaec19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 -- 172.21.15.66:0/385451510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec19d480 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00e9f0 tx=0x7fdadc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae37fe640 1 -- 172.21.15.66:0/385451510 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00ccc0 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec19d770 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.661+0000 7fdae37fe640 1 -- 172.21.15.66:0/385451510 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdadc010910 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.662+0000 7fdae37fe640 1 -- 172.21.15.66:0/385451510 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0188a0 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.662+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec1a5050 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.664+0000 7fdae37fe640 1 -- 172.21.15.66:0/385451510 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fdadc010ac0 con 0x7fdaec102790 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.664+0000 7fdaf3363740 1 Processor -- start 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 -- start start 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866089f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866097130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560865fef280 con 0x560866094d40 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560865f96b10 con 0x56086608a480 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaf3363740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560865feb240 con 0x560866089b60 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaea59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866097130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaea59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:37142/0 (socket says 172.21.15.66:37142) 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaea59c640 1 -- 172.21.15.66:0/4203470900 learned_addr learned my addr 172.21.15.66:0/4203470900 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaead9d640 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866089f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdae37fe640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 0x7fdad80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaea59c640 1 -- 172.21.15.66:0/4203470900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 msgr2=0x560866089f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.665+0000 7fdaea59c640 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866089f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaea59c640 1 -- 172.21.15.66:0/4203470900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 msgr2=0x560866097130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaea59c640 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866097130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaea59c640 1 -- 172.21.15.66:0/4203470900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560865fa31f0 con 0x56086608a480 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaead9d640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 0x7fdad80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdae37fe640 1 -- 172.21.15.66:0/385451510 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fdadc0d0660 con 0x7fdaec102790 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaea59c640 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad4005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a03ee4a081528ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdaead9d640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 0x7fdad80a5870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009b80 tx=0x7fdae4004a40 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdae0ff9640 1 -- 172.21.15.66:0/4203470900 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4040070 con 0x56086608a480 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdae0ff9640 1 -- 172.21.15.66:0/4203470900 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad4031870 con 0x56086608a480 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.666+0000 7fdae0ff9640 1 -- 172.21.15.66:0/4203470900 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4035040 con 0x56086608a480 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- 172.21.15.66:0/4203470900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 msgr2=0x560866094800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad4005be0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- 172.21.15.66:0/4203470900 shutdown_connections 2024-09-15T23:03:40.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866097130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56086608a480 0x560866094800 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 --2- 172.21.15.66:0/4203470900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866089f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- 172.21.15.66:0/4203470900 >> 172.21.15.66:0/4203470900 conn(0x5608660860f0 msgr2=0x5608660864d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- 172.21.15.66:0/4203470900 shutdown_connections 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- 172.21.15.66:0/4203470900 wait complete. 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.667+0000 7fdaf3363740 1 -- start start 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 Processor -- start 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x560866092120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866092660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560866097910 con 0x56086608a480 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560865fa9f10 con 0x560866094d40 2024-09-15T23:03:40.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560866097a90 con 0x560866089b60 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaf3363740 10 client.0 _ll_register_callbacks cb 0x560865f72a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x560866092120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34996/0 (socket says 172.21.15.66:34996) 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 -- 172.21.15.66:0/724008905 learned_addr learned my addr 172.21.15.66:0/724008905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaead9d640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866092660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 -- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 msgr2=0x560866092660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866092660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 -- 172.21.15.66:0/724008905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 msgr2=0x560866092120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x560866092120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 -- 172.21.15.66:0/724008905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560865d606a0 con 0x560866089b60 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x560866092120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:03:40.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdaea59c640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad402ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8a471acc5bbec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.668+0000 7fdad1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad404b020 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fdad4004250 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad4031870 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fdad4056050 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 10 client.28216 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x560866097910 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad4031870 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7fdad40035f0 con 0x560866089b60 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 10 client.28216 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 10 client.28216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:40.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 20 client.28216 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608660a46b0 0x5608660a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 4 client.28216 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.669+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560865ffc7f0 con 0x5608660a46b0 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.670+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608660a46b0 0x5608660a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.670+0000 7fdad1ffb640 10 client.28216 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.670+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608660a46b0 0x5608660a6aa0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed98db2b665a62ed server_cookie=ec0e4f518ebd6654 in_seq=0 out_seq=0 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdad1ffb640 1 -- 172.21.15.66:0/724008905 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560865ffc7f0 con 0x5608660a46b0 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdad1ffb640 10 client.28216 handle_command_reply: tid=0 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 client.28216 shutdown 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 msgr2=0x560866091be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad402ab90 comp rx=0 tx=0).stop 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 shutdown_connections 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5608660a46b0 0x5608660a6aa0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866092660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x560866092120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 --2- 172.21.15.66:0/724008905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866091be0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdad1ffb640 0 client.28216 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 >> 172.21.15.66:0/724008905 conn(0x5608660860f0 msgr2=0x56086608bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 shutdown_connections 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 1 -- 172.21.15.66:0/724008905 wait complete. 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.671+0000 7fdaf3363740 20 client.28216 trim_cache size 0 max 16384 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 Processor -- start 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 -- start start 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 0x5608660ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56086608a480 0x5608660ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1af2e0 con 0x560866094d40 2024-09-15T23:03:40.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1b1060 con 0x560866089b60 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.688+0000 7fdaf3363740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1afa40 con 0x56086608a480 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38588/0 (socket says 172.21.15.66:38588) 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 -- 172.21.15.66:0/764769820 learned_addr learned my addr 172.21.15.66:0/764769820 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaea59c640 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 0x5608660ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 -- 172.21.15.66:0/764769820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56086608a480 msgr2=0x5608660ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56086608a480 0x5608660ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 -- 172.21.15.66:0/764769820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 msgr2=0x5608660ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 0x5608660ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 -- 172.21.15.66:0/764769820 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608660a70d0 con 0x560866094d40 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaea59c640 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 0x5608660ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdaead9d640 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fdae400f7c0 tx=0x7fdae401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b275990fc35432df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdad3fff640 1 -- 172.21.15.66:0/764769820 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae402d070 con 0x560866094d40 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdad3fff640 1 -- 172.21.15.66:0/764769820 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae4003e50 con 0x560866094d40 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.689+0000 7fdad3fff640 1 -- 172.21.15.66:0/764769820 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4004390 con 0x560866094d40 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- 172.21.15.66:0/764769820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 msgr2=0x560866084a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fdae400f7c0 tx=0x7fdae401a000 comp rx=0 tx=0).stop 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- 172.21.15.66:0/764769820 shutdown_connections 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560866094d40 0x560866084a50 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56086608a480 0x5608660ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- 172.21.15.66:0/764769820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866089b60 0x5608660ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- 172.21.15.66:0/764769820 >> 172.21.15.66:0/764769820 conn(0x5608660860f0 msgr2=0x560866093b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- 172.21.15.66:0/764769820 shutdown_connections 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- 172.21.15.66:0/764769820 wait complete. 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- start start 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 Processor -- start 2024-09-15T23:03:40.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866099630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1b08d0 con 0x56086608a480 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1b0140 con 0x560866094d40 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1ad2e0 con 0x560866089b60 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.690+0000 7fdaf3363740 10 client.0 _ll_register_callbacks cb 0x7fdadc0d6420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdae9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38592/0 (socket says 172.21.15.66:38592) 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdae9d9b640 1 -- 172.21.15.66:0/3581279147 learned_addr learned my addr 172.21.15.66:0/3581279147 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaead9d640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866099630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 -- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 msgr2=0x560866099630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866099630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 -- 172.21.15.66:0/3581279147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 msgr2=0x5608660990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 -- 172.21.15.66:0/3581279147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560866085f20 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaea59c640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866098bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad4003e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b1cd00b54dd3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdad1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad405f060 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdae4003e50 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7fdad4004450 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fdad4066050 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaf3363740 10 client.28219 fetch_fsmap learned FSMap version 68 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.691+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x56086610f580 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae4003e50 con 0x560866089b60 2024-09-15T23:03:40.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 68) ==== 8426+0+0 (secure 0 0 0) 0x7fdad40048c0 con 0x560866089b60 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 10 client.28219 fetch_fsmap finished waiting for FSMap version 68 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 10 client.28219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 20 client.28219 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56086610fc40 0x560866112060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 4 client.28219 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560865ff6d00 con 0x56086610fc40 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56086610fc40 0x560866112060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdad1ffb640 10 client.28219 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.692+0000 7fdae9d9b640 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56086610fc40 0x560866112060 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aadf4155a2fa5fad server_cookie=7efe2b76c5b83fe8 in_seq=0 out_seq=0 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.693+0000 7fdad1ffb640 1 -- 172.21.15.66:0/3581279147 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560865ff6d00 con 0x56086610fc40 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.693+0000 7fdad1ffb640 10 client.28219 handle_command_reply: tid=0 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.693+0000 7fdaf3363740 1 client.28219 shutdown 2024-09-15T23:03:40.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 msgr2=0x560866098bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866098bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad4003e90 comp rx=0 tx=0).stop 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 shutdown_connections 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56086610fc40 0x560866112060 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560866094d40 0x560866099630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56086608a480 0x5608660990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 --2- 172.21.15.66:0/3581279147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560866089b60 0x560866098bb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdad1ffb640 0 client.28219 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 >> 172.21.15.66:0/3581279147 conn(0x5608660860f0 msgr2=0x560866084a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 shutdown_connections 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 1 -- 172.21.15.66:0/3581279147 wait complete. 2024-09-15T23:03:40.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf3363740 20 client.28219 trim_cache size 0 max 16384 2024-09-15T23:03:40.546 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:03:40.546 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T23:03:40.546 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "e93b9564-5217-4cad-ad0d-bc13124798a0", 2024-09-15T23:03:40.546 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T23:03:40.546 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 msgr2=0x7fdad80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 0x7fdad80a5870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009b80 tx=0x7fdae4004a40 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 msgr2=0x7fdaec198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00e9f0 tx=0x7fdadc00edf0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 shutdown_connections 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fdad80a33b0 0x7fdad80a5870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdaec106f10 0x7fdaec19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdaec102790 0x7fdaec198a10 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 --2- 172.21.15.66:0/385451510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaec101de0 0x7fdaec1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 >> 172.21.15.66:0/385451510 conn(0x7fdaec0fd8c0 msgr2=0x7fdaec0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:40.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 shutdown_connections 2024-09-15T23:03:40.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:39.694+0000 7fdaf0f8a640 1 -- 172.21.15.66:0/385451510 wait complete. 2024-09-15T23:03:40.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:40 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T23:03:40.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:40 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:40.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:40 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:03:40.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:40 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T23:03:40.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:40 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:40.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:40 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:03:40.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:40 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T23:03:40.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:40 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:40.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:40 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:03:41.498 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:41 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:03:41.498 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:41 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:41.498 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:41 smithi066 ceph-mon[31185]: pgmap v577: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T23:03:41.554 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e612877', quiesce took 16.0 seconds. Will release after: 6.949999999999999 2024-09-15T23:03:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:41 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:03:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:41 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:41 smithi087 ceph-mon[35290]: pgmap v577: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T23:03:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:41 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:03:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:41 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:41 smithi184 ceph-mon[35203]: pgmap v577: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-09-15T23:03:42.013 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:03:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:43.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 -- 172.21.15.66:0/2080316156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e94109830 msgr2=0x7f2e94109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 --2- 172.21.15.66:0/2080316156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e94109830 0x7f2e94109c90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009860 tx=0x7f2e8802a380 comp rx=0 tx=0).stop 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 -- 172.21.15.66:0/2080316156 shutdown_connections 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 --2- 172.21.15.66:0/2080316156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e9411b140 0x7f2e9411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 --2- 172.21.15.66:0/2080316156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e94109830 0x7f2e94109c90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 --2- 172.21.15.66:0/2080316156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109450 0x7f2e94110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 -- 172.21.15.66:0/2080316156 >> 172.21.15.66:0/2080316156 conn(0x7f2e9406e140 msgr2=0x7f2e9406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.253+0000 7f2e99056640 1 -- 172.21.15.66:0/2080316156 shutdown_connections 2024-09-15T23:03:43.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.255+0000 7f2e99056640 1 -- 172.21.15.66:0/2080316156 wait complete. 2024-09-15T23:03:43.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.256+0000 7f2e99056640 1 Processor -- start 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 -- start start 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e94109450 0x7f2e941a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e9411b140 0x7f2e941abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94120df0 con 0x7f2e94109830 2024-09-15T23:03:43.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94120c70 con 0x7f2e9411b140 2024-09-15T23:03:43.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.259+0000 7f2e99056640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94120f70 con 0x7f2e94109450 2024-09-15T23:03:43.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.264+0000 7f2e92d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e94109450 0x7f2e941a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.264+0000 7f2e9359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e9411b140 0x7f2e941abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.264+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.264+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35354/0 (socket says 172.21.15.66:35354) 2024-09-15T23:03:43.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.264+0000 7f2e9259c640 1 -- 172.21.15.66:0/1692820723 learned_addr learned my addr 172.21.15.66:0/1692820723 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:43.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 -- 172.21.15.66:0/1692820723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e94109450 msgr2=0x7f2e941a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e94109450 0x7f2e941a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 -- 172.21.15.66:0/1692820723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e9411b140 msgr2=0x7f2e941abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e9411b140 0x7f2e941abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 -- 172.21.15.66:0/1692820723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e941ac2a0 con 0x7f2e94109830 2024-09-15T23:03:43.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.267+0000 7f2e9259c640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f2e88035040 tx=0x7f2e88033ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.269+0000 7f2e7bfff640 1 -- 172.21.15.66:0/1692820723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88037040 con 0x7f2e94109830 2024-09-15T23:03:43.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.269+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e941ac530 con 0x7f2e94109830 2024-09-15T23:03:43.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.269+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e941b3e70 con 0x7f2e94109830 2024-09-15T23:03:43.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.269+0000 7f2e7bfff640 1 -- 172.21.15.66:0/1692820723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e88033d90 con 0x7f2e94109830 2024-09-15T23:03:43.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.269+0000 7f2e7bfff640 1 -- 172.21.15.66:0/1692820723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880053c0 con 0x7f2e94109830 2024-09-15T23:03:43.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.279+0000 7f2e9b42f740 1 Processor -- start 2024-09-15T23:03:43.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.280+0000 7f2e7bfff640 1 -- 172.21.15.66:0/1692820723 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2e88044030 con 0x7f2e94109830 2024-09-15T23:03:43.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.281+0000 7f2e7bfff640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 0x7f2e7c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.281+0000 7f2e7bfff640 1 -- 172.21.15.66:0/1692820723 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2e880f0010 con 0x7f2e94109830 2024-09-15T23:03:43.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 -- start start 2024-09-15T23:03:43.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c404a0 0x5591d7c40880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c4b680 0x5591d7c4da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5591d7ba62e0 con 0x5591d7c40dc0 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5591d7b4dce0 con 0x5591d7c404a0 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5591d7ba22a0 con 0x5591d7c4b680 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35370/0 (socket says 172.21.15.66:35370) 2024-09-15T23:03:43.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.282+0000 7f2e9259c640 1 -- 172.21.15.66:0/3417366693 learned_addr learned my addr 172.21.15.66:0/3417366693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 -- 172.21.15.66:0/3417366693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c4b680 msgr2=0x5591d7c4da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c4b680 0x5591d7c4da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 -- 172.21.15.66:0/3417366693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c404a0 msgr2=0x5591d7c40880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c404a0 0x5591d7c40880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 -- 172.21.15.66:0/3417366693 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d7b32440 con 0x5591d7c40dc0 2024-09-15T23:03:43.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9359e640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 0x7f2e7c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.284+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2e880c5280 tx=0x7f2e880bc5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55da88b3a548ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.286+0000 7f2e797fa640 1 -- 172.21.15.66:0/3417366693 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880bcbd0 con 0x5591d7c40dc0 2024-09-15T23:03:43.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.286+0000 7f2e9359e640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 0x7f2e7c0a5a80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5591d7c3ddb0 tx=0x7f2e8c0095a0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.286+0000 7f2e797fa640 1 -- 172.21.15.66:0/3417366693 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e880c0f80 con 0x5591d7c40dc0 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3417366693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 msgr2=0x5591d7c4b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2e880c5280 tx=0x7f2e880bc5f0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3417366693 shutdown_connections 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c4b680 0x5591d7c4da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c4b140 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3417366693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c404a0 0x5591d7c40880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3417366693 >> 172.21.15.66:0/3417366693 conn(0x5591d7c3ca30 msgr2=0x5591d7c3ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.287+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3417366693 shutdown_connections 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.288+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3417366693 wait complete. 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.288+0000 7f2e9b42f740 1 -- start start 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.288+0000 7f2e9b42f740 1 Processor -- start 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c4b680 0x5591d7c486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5591d7c4e010 con 0x5591d7c40dc0 2024-09-15T23:03:43.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5591d7b61050 con 0x5591d7c4b680 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5591d7c4e190 con 0x5591d7c404a0 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.289+0000 7f2e9b42f740 10 client.0 _ll_register_callbacks cb 0x5591d7ba1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c4b680 0x5591d7c486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35382/0 (socket says 172.21.15.66:35382) 2024-09-15T23:03:43.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 -- 172.21.15.66:0/3412798774 learned_addr learned my addr 172.21.15.66:0/3412798774 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:43.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 -- 172.21.15.66:0/3412798774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 msgr2=0x5591d7c4af00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:03:43.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 -- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c4b680 msgr2=0x5591d7c486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:43.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c4b680 0x5591d7c486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.290+0000 7f2e9259c640 1 -- 172.21.15.66:0/3412798774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d79173c0 con 0x5591d7c40dc0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.291+0000 7f2e9259c640 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2e880bcb60 tx=0x7f2e8802a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e44cda0151d0302 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.291+0000 7f2e76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.291+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880bcbd0 con 0x5591d7c40dc0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.291+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e880c0f80 con 0x5591d7c40dc0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.291+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2e880bc020 con 0x5591d7c40dc0 2024-09-15T23:03:43.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.292+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f2e880cb020 con 0x5591d7c40dc0 2024-09-15T23:03:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.296+0000 7f2e9b42f740 10 client.19089 fetch_fsmap learned FSMap version 69 2024-09-15T23:03:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.296+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x5591d7c4e010 con 0x5591d7c40dc0 2024-09-15T23:03:43.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.298+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e880c0f80 con 0x5591d7c40dc0 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 69) ==== 8422+0+0 (secure 0 0 0) 0x7f2e8803a030 con 0x5591d7c40dc0 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 10 client.19089 fetch_fsmap finished waiting for FSMap version 69 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 10 client.19089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 20 client.19089 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c5ae50 0x5591d7c5d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 4 client.19089 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.299+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d7bb3850 con 0x5591d7c5ae50 2024-09-15T23:03:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.303+0000 7f2e92d9d640 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c5ae50 0x5591d7c5d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.317+0000 7f2e76ff5640 10 client.19089 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:43.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.317+0000 7f2e92d9d640 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c5ae50 0x5591d7c5d2d0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7e52f22cf93026 server_cookie=ae77d77341e6e064 in_seq=0 out_seq=0 2024-09-15T23:03:43.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.318+0000 7f2e76ff5640 1 -- 172.21.15.66:0/3412798774 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591d7bb3850 con 0x5591d7c5ae50 2024-09-15T23:03:43.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.318+0000 7f2e76ff5640 10 client.19089 handle_command_reply: tid=0 2024-09-15T23:03:43.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.318+0000 7f2e9b42f740 1 client.19089 shutdown 2024-09-15T23:03:43.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 msgr2=0x5591d7c481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2e880bcb60 tx=0x7f2e8802a380 comp rx=0 tx=0).stop 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 shutdown_connections 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c5ae50 0x5591d7c5d2d0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c4b680 0x5591d7c486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c40dc0 0x5591d7c481b0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/3412798774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 >> 172.21.15.66:0/3412798774 conn(0x5591d7c3ca30 msgr2=0x5591d7c42760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e76ff5640 0 client.19089 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:43.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.322+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 shutdown_connections 2024-09-15T23:03:43.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.326+0000 7f2e9b42f740 1 -- 172.21.15.66:0/3412798774 wait complete. 2024-09-15T23:03:43.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.326+0000 7f2e9b42f740 20 client.19089 trim_cache size 0 max 16384 2024-09-15T23:03:43.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.359+0000 7f2e9b42f740 1 Processor -- start 2024-09-15T23:03:43.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.361+0000 7f2e9b42f740 1 -- start start 2024-09-15T23:03:43.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.361+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c3ca30 0x5591d7c4a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.361+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c40dc0 0x5591d7c630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80010230 con 0x5591d7c404a0 2024-09-15T23:03:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80011fb0 con 0x5591d7c3ca30 2024-09-15T23:03:43.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80010990 con 0x5591d7c40dc0 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35398/0 (socket says 172.21.15.66:35398) 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 -- 172.21.15.66:0/2513075162 learned_addr learned my addr 172.21.15.66:0/2513075162 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 -- 172.21.15.66:0/2513075162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c40dc0 msgr2=0x5591d7c630e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c40dc0 0x5591d7c630e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 -- 172.21.15.66:0/2513075162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c3ca30 msgr2=0x5591d7c4a120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c3ca30 0x5591d7c4a120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.362+0000 7f2e9259c640 1 -- 172.21.15.66:0/2513075162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d7c4b270 con 0x5591d7c404a0 2024-09-15T23:03:43.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.363+0000 7f2e9259c640 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009830 tx=0x7f2e880bb0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c3470cadd0f75e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.368+0000 7f2e78ff9640 1 -- 172.21.15.66:0/2513075162 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880ed360 con 0x5591d7c404a0 2024-09-15T23:03:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.368+0000 7f2e78ff9640 1 -- 172.21.15.66:0/2513075162 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e880c0f80 con 0x5591d7c404a0 2024-09-15T23:03:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.368+0000 7f2e78ff9640 1 -- 172.21.15.66:0/2513075162 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880bcbd0 con 0x5591d7c404a0 2024-09-15T23:03:43.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.369+0000 7f2e9b42f740 1 -- 172.21.15.66:0/2513075162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 msgr2=0x5591d7c62ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.369+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009830 tx=0x7f2e880bb0e0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 -- 172.21.15.66:0/2513075162 shutdown_connections 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c40dc0 0x5591d7c630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c404a0 0x5591d7c62ba0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/2513075162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c3ca30 0x5591d7c4a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 -- 172.21.15.66:0/2513075162 >> 172.21.15.66:0/2513075162 conn(0x5591d7c48850 msgr2=0x5591d7c49a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.371+0000 7f2e9b42f740 1 -- 172.21.15.66:0/2513075162 shutdown_connections 2024-09-15T23:03:43.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.375+0000 7f2e9b42f740 1 -- 172.21.15.66:0/2513075162 wait complete. 2024-09-15T23:03:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.375+0000 7f2e9b42f740 1 -- start start 2024-09-15T23:03:43.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.375+0000 7f2e9b42f740 1 Processor -- start 2024-09-15T23:03:43.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.376+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c3ca30 0x5591d7c53920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.376+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.376+0000 7f2e9b42f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c40dc0 0x5591d7c4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:44598/0 (socket says 172.21.15.66:44598) 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9259c640 1 -- 172.21.15.66:0/19624362 learned_addr learned my addr 172.21.15.66:0/19624362 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9b42f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80011820 con 0x5591d7c3ca30 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80011090 con 0x5591d7c40dc0 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8000e2c0 con 0x5591d7c404a0 2024-09-15T23:03:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.377+0000 7f2e9b42f740 10 client.0 _ll_register_callbacks cb 0x7f2e880bc710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:43.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.379+0000 7f2e92d9d640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c3ca30 0x5591d7c53920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.379+0000 7f2e9259c640 1 -- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c40dc0 msgr2=0x5591d7c4f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:43.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.379+0000 7f2e9259c640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c40dc0 0x5591d7c4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.379+0000 7f2e9259c640 1 -- 172.21.15.66:0/19624362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c3ca30 msgr2=0x5591d7c53920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:43.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.379+0000 7f2e9259c640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c3ca30 0x5591d7c53920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.380+0000 7f2e9259c640 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d7c4f7a0 con 0x5591d7c404a0 2024-09-15T23:03:43.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.382+0000 7f2e9259c640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e880b8c60 tx=0x7f2e880057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b1d073c512a6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:43.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.384+0000 7f2e76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.386+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880ed360 con 0x5591d7c404a0 2024-09-15T23:03:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.386+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9823+0+0 (secure 0 0 0) 0x7f2e880bc230 con 0x5591d7c404a0 2024-09-15T23:03:43.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.386+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e880c0f80 con 0x5591d7c404a0 2024-09-15T23:03:43.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.386+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f2e880bcbd0 con 0x5591d7c404a0 2024-09-15T23:03:43.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.387+0000 7f2e9b42f740 10 client.28225 fetch_fsmap learned FSMap version 69 2024-09-15T23:03:43.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.387+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x5591d7c4f7a0 con 0x5591d7c404a0 2024-09-15T23:03:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.389+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e880c0f80 con 0x5591d7c404a0 2024-09-15T23:03:43.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.389+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 69) ==== 8422+0+0 (secure 0 0 0) 0x7f2e880ce070 con 0x5591d7c404a0 2024-09-15T23:03:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 10 client.28225 fetch_fsmap finished waiting for FSMap version 69 2024-09-15T23:03:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 10 client.28225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:03:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 20 client.28225 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c4b680 0x5591d7cc7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:43.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 4 client.28225 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:03:43.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.391+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591d7badd60 con 0x5591d7c4b680 2024-09-15T23:03:43.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.392+0000 7f2e92d9d640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c4b680 0x5591d7cc7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.398+0000 7f2e92d9d640 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c4b680 0x5591d7cc7cc0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6497a08ead5172 server_cookie=123ed4676cdab0c9 in_seq=0 out_seq=0 2024-09-15T23:03:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.398+0000 7f2e76ff5640 10 client.28225 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:43.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.399+0000 7f2e76ff5640 1 -- 172.21.15.66:0/19624362 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5591d7badd60 con 0x5591d7c4b680 2024-09-15T23:03:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.399+0000 7f2e76ff5640 10 client.28225 handle_command_reply: tid=0 2024-09-15T23:03:43.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.400+0000 7f2e9b42f740 1 client.28225 shutdown 2024-09-15T23:03:43.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 msgr2=0x5591d7c4eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e880b8c60 tx=0x7f2e880057e0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 shutdown_connections 2024-09-15T23:03:43.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5591d7c4b680 0x5591d7cc7cc0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591d7c40dc0 0x5591d7c4f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591d7c404a0 0x5591d7c4eca0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 --2- 172.21.15.66:0/19624362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5591d7c3ca30 0x5591d7c53920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e76ff5640 0 client.28225 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 >> 172.21.15.66:0/19624362 conn(0x5591d7c48850 msgr2=0x5591d7c46650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 shutdown_connections 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 1 -- 172.21.15.66:0/19624362 wait complete. 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.405+0000 7f2e9b42f740 20 client.28225 trim_cache size 0 max 16384 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:03:43.407 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "scrub active (2312 inodes in the stack)", 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": { 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: "e93b9564-5217-4cad-ad0d-bc13124798a0": { 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: "path": "/", 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: "tag": "e93b9564-5217-4cad-ad0d-bc13124798a0", 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: "options": "recursive,force" 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:43.408 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 msgr2=0x7f2e7c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 0x7f2e7c0a5a80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5591d7c3ddb0 tx=0x7f2e8c0095a0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 msgr2=0x7f2e941a7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f2e88035040 tx=0x7f2e88033ae0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 shutdown_connections 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f2e7c0a35c0 0x7f2e7c0a5a80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e9411b140 0x7f2e941abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e94109830 0x7f2e941a7830 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 --2- 172.21.15.66:0/1692820723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e94109450 0x7f2e941a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 >> 172.21.15.66:0/1692820723 conn(0x7f2e9406e140 msgr2=0x7f2e9411c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 shutdown_connections 2024-09-15T23:03:43.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:43.407+0000 7f2e99056640 1 -- 172.21.15.66:0/1692820723 wait complete. 2024-09-15T23:03:43.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:43 smithi066 ceph-mon[31185]: pgmap v578: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T23:03:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:43 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:43 smithi087 ceph-mon[35290]: pgmap v578: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T23:03:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:43 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:43 smithi184 ceph-mon[35203]: pgmap v578: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-15T23:03:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:43 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:44.169 INFO:tasks.cephfs.filesystem:scrub status for tag:e93b9564-5217-4cad-ad0d-bc13124798a0 - {'path': '/', 'tag': 'e93b9564-5217-4cad-ad0d-bc13124798a0', 'options': 'recursive,force'} 2024-09-15T23:03:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:45 smithi184 ceph-mon[35203]: pgmap v579: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 152 op/s 2024-09-15T23:03:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:45 smithi184 ceph-mon[35203]: osdmap e116: 12 total, 12 up, 12 in 2024-09-15T23:03:45.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:45 smithi066 ceph-mon[31185]: pgmap v579: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 152 op/s 2024-09-15T23:03:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:45 smithi066 ceph-mon[31185]: osdmap e116: 12 total, 12 up, 12 in 2024-09-15T23:03:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:45 smithi087 ceph-mon[35290]: pgmap v579: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 152 op/s 2024-09-15T23:03:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:45 smithi087 ceph-mon[35290]: osdmap e116: 12 total, 12 up, 12 in 2024-09-15T23:03:47.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:47 smithi184 ceph-mon[35203]: pgmap v581: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 321 KiB/s wr, 178 op/s 2024-09-15T23:03:47.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:47 smithi066 ceph-mon[31185]: pgmap v581: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 321 KiB/s wr, 178 op/s 2024-09-15T23:03:47.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:47 smithi087 ceph-mon[35290]: pgmap v581: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 321 KiB/s wr, 178 op/s 2024-09-15T23:03:48.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:48 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:48.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:03:48.600 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:48 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:48 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:03:49.071 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:49.438 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:49 smithi066 ceph-mon[31185]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 321 KiB/s wr, 184 op/s 2024-09-15T23:03:49.439 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:49 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:49 smithi087 ceph-mon[35290]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 321 KiB/s wr, 184 op/s 2024-09-15T23:03:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:49 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:49 smithi184 ceph-mon[35203]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 321 KiB/s wr, 184 op/s 2024-09-15T23:03:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:49 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:03:49.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.699+0000 7fdea162b640 1 -- 172.21.15.66:0/2840556815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 msgr2=0x7fde9c1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:49.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.699+0000 7fdea162b640 1 --2- 172.21.15.66:0/2840556815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c1063c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fde94009ca0 tx=0x7fde9402a960 comp rx=0 tx=0).stop 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 -- 172.21.15.66:0/2840556815 shutdown_connections 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 --2- 172.21.15.66:0/2840556815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c1063c0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 --2- 172.21.15.66:0/2840556815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9c101440 0x7fde9c105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 --2- 172.21.15.66:0/2840556815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde9c100b20 0x7fde9c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 -- 172.21.15.66:0/2840556815 >> 172.21.15.66:0/2840556815 conn(0x7fde9c0fc7d0 msgr2=0x7fde9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 -- 172.21.15.66:0/2840556815 shutdown_connections 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.706+0000 7fdea162b640 1 -- 172.21.15.66:0/2840556815 wait complete. 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 Processor -- start 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 -- start start 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde9c100b20 0x7fde9c073820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9c101440 0x7fde9c073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c1185a0 con 0x7fde9c105f30 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c118420 con 0x7fde9c100b20 2024-09-15T23:03:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.707+0000 7fdea162b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c118720 con 0x7fde9c101440 2024-09-15T23:03:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.713+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.713+0000 7fde9b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35440/0 (socket says 172.21.15.66:35440) 2024-09-15T23:03:49.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.713+0000 7fde9b7fe640 1 -- 172.21.15.66:0/2361617513 learned_addr learned my addr 172.21.15.66:0/2361617513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 -- 172.21.15.66:0/2361617513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9c101440 msgr2=0x7fde9c073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9c101440 0x7fde9c073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 -- 172.21.15.66:0/2361617513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde9c100b20 msgr2=0x7fde9c073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde9c100b20 0x7fde9c073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:49.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 -- 172.21.15.66:0/2361617513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c06d1d0 con 0x7fde9c105f30 2024-09-15T23:03:49.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.714+0000 7fde9b7fe640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fde94009dc0 tx=0x7fde940395f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:49.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.715+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94034040 con 0x7fde9c105f30 2024-09-15T23:03:49.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.715+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c06d460 con 0x7fde9c105f30 2024-09-15T23:03:49.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.715+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c071520 con 0x7fde9c105f30 2024-09-15T23:03:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.716+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94030b20 con 0x7fde9c105f30 2024-09-15T23:03:49.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.716+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9403a910 con 0x7fde9c105f30 2024-09-15T23:03:49.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.718+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde80005290 con 0x7fde9c105f30 2024-09-15T23:03:49.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.720+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fde94037020 con 0x7fde9c105f30 2024-09-15T23:03:49.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.721+0000 7fde8bfff640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 0x7fde840a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:49.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.722+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7fde940f1540 con 0x7fde9c105f30 2024-09-15T23:03:49.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.722+0000 7fde9affd640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 0x7fde840a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:49.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.723+0000 7fde9affd640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 0x7fde840a59b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00a990 tx=0x7fde8c005c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:49.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:49.729+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde940bdb00 con 0x7fde9c105f30 2024-09-15T23:03:50.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.153+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde80005850 con 0x7fde9c105f30 2024-09-15T23:03:50.162 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:03:50.162 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"btime":"2024-09-15T23:03:47:150507+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:03:46.508015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:03:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 70 2024-09-15T23:03:50.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.161+0000 7fde8bfff640 1 -- 172.21.15.66:0/2361617513 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+11994 (secure 0 0 0) 0x7fde940bd400 con 0x7fde9c105f30 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 msgr2=0x7fde840a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 0x7fde840a59b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00a990 tx=0x7fde8c005c70 comp rx=0 tx=0).stop 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 msgr2=0x7fde9c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fde94009dc0 tx=0x7fde940395f0 comp rx=0 tx=0).stop 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 shutdown_connections 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fde840a34f0 0x7fde840a59b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde9c105f30 0x7fde9c06c910 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.167+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9c101440 0x7fde9c073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.168+0000 7fdea162b640 1 --2- 172.21.15.66:0/2361617513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde9c100b20 0x7fde9c073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.168+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 >> 172.21.15.66:0/2361617513 conn(0x7fde9c0fc7d0 msgr2=0x7fde9c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.170+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 shutdown_connections 2024-09-15T23:03:50.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:50.170+0000 7fdea162b640 1 -- 172.21.15.66:0/2361617513 wait complete. 2024-09-15T23:03:50.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:50 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2361617513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:50.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:50 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2361617513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:50 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2361617513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:03:50.918 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id 3e612877 --release --await' 2024-09-15T23:03:50.919 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id 3e612877 --release --await 2024-09-15T23:03:51.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:51 smithi066 ceph-mon[31185]: pgmap v583: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 32 KiB/s wr, 177 op/s 2024-09-15T23:03:51.494 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:51 smithi087 ceph-mon[35290]: pgmap v583: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 32 KiB/s wr, 177 op/s 2024-09-15T23:03:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:51 smithi184 ceph-mon[35203]: pgmap v583: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 32 KiB/s wr, 177 op/s 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.165+0000 7f00e9980640 1 -- 172.21.15.66:0/1744016551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4101df0 msgr2=0x7f00e41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.165+0000 7f00e9980640 1 --2- 172.21.15.66:0/1744016551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4101df0 0x7f00e41021d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009900 tx=0x7f00d402a3f0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.166+0000 7f00e9980640 1 -- 172.21.15.66:0/1744016551 shutdown_connections 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.166+0000 7f00e9980640 1 --2- 172.21.15.66:0/1744016551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4106f20 0x7f00e410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.166+0000 7f00e9980640 1 --2- 172.21.15.66:0/1744016551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.166+0000 7f00e9980640 1 --2- 172.21.15.66:0/1744016551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4101df0 0x7f00e41021d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.166+0000 7f00e9980640 1 -- 172.21.15.66:0/1744016551 >> 172.21.15.66:0/1744016551 conn(0x7f00e40fd8b0 msgr2=0x7f00e40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.168+0000 7f00e9980640 1 -- 172.21.15.66:0/1744016551 shutdown_connections 2024-09-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.168+0000 7f00e9980640 1 -- 172.21.15.66:0/1744016551 wait complete. 2024-09-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.169+0000 7f00e9980640 1 Processor -- start 2024-09-15T23:03:52.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e9980640 1 -- start start 2024-09-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e9980640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e9980640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e4076010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e9980640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 0x7f00e406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35470/0 (socket says 172.21.15.66:35470) 2024-09-15T23:03:52.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.171+0000 7f00e2ffd640 1 -- 172.21.15.66:0/2906299336 learned_addr learned my addr 172.21.15.66:0/2906299336 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:52.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.172+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4111f90 con 0x7f00e4101df0 2024-09-15T23:03:52.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.172+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4111e10 con 0x7f00e41027a0 2024-09-15T23:03:52.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.172+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4112110 con 0x7f00e4106f20 2024-09-15T23:03:52.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.174+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 0x7f00e406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.174+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e4076010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.178+0000 7f00e2ffd640 1 -- 172.21.15.66:0/2906299336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 msgr2=0x7f00e406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.178+0000 7f00e2ffd640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 0x7f00e406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.178+0000 7f00e2ffd640 1 -- 172.21.15.66:0/2906299336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 msgr2=0x7f00e4076010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.178+0000 7f00e2ffd640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e4076010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.178+0000 7f00e2ffd640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e406d510 con 0x7f00e4101df0 2024-09-15T23:03:52.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.179+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 0x7f00e406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:03:52.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.179+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e4076010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:03:52.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.186+0000 7f00e2ffd640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f00d4004770 tx=0x7f00d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.190+0000 7f00e897e640 1 -- 172.21.15.66:0/2906299336 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d403f070 con 0x7f00e4101df0 2024-09-15T23:03:52.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.190+0000 7f00e897e640 1 -- 172.21.15.66:0/2906299336 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d4031ca0 con 0x7f00e4101df0 2024-09-15T23:03:52.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.190+0000 7f00e897e640 1 -- 172.21.15.66:0/2906299336 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4035030 con 0x7f00e4101df0 2024-09-15T23:03:52.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.192+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e406d7a0 con 0x7f00e4101df0 2024-09-15T23:03:52.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.192+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e4071760 con 0x7f00e4101df0 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.196+0000 7f00ebd59740 1 Processor -- start 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 -- start start 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c87d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c8a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe45bd1620 con 0x55fe45c6c840 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fe45b78e50 con 0x55fe45c6bf20 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.197+0000 7f00ebd59740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fe45bcd5e0 con 0x55fe45c88250 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.200+0000 7f00e897e640 1 -- 172.21.15.66:0/2906299336 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f00d4042070 con 0x7f00e4101df0 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39794/0 (socket says 172.21.15.66:39794) 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 -- 172.21.15.66:0/2815038910 learned_addr learned my addr 172.21.15.66:0/2815038910 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:52.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c8a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 -- 172.21.15.66:0/2815038910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 msgr2=0x55fe45c8a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c8a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 -- 172.21.15.66:0/2815038910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 msgr2=0x55fe45c87d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c87d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.201+0000 7f00e37fe640 1 -- 172.21.15.66:0/2815038910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe45b69d40 con 0x55fe45c6bf20 2024-09-15T23:03:52.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.202+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00dc010710 tx=0x7f00dc010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=805ac1500b2a2054 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.202+0000 7f00d9ffb640 1 -- 172.21.15.66:0/2815038910 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00e8d0 con 0x55fe45c6bf20 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.202+0000 7f00d9ffb640 1 -- 172.21.15.66:0/2815038910 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00dc012450 con 0x55fe45c6bf20 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.202+0000 7f00d9ffb640 1 -- 172.21.15.66:0/2815038910 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc01c650 con 0x55fe45c6bf20 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.202+0000 7f00e897e640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 0x7f00c40a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00e897e640 1 -- 172.21.15.66:0/2906299336 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f00d40f08e0 con 0x7f00e4101df0 2024-09-15T23:03:52.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 -- 172.21.15.66:0/2815038910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 msgr2=0x55fe45c6c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00dc010710 tx=0x7f00dc010bd0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 -- 172.21.15.66:0/2815038910 shutdown_connections 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c8a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c87d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2815038910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c6c300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.203+0000 7f00ebd59740 1 -- 172.21.15.66:0/2815038910 >> 172.21.15.66:0/2815038910 conn(0x55fe45c685f0 msgr2=0x55fe45c689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.210+0000 7f00ebd59740 1 -- 172.21.15.66:0/2815038910 shutdown_connections 2024-09-15T23:03:52.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.210+0000 7f00e2ffd640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 0x7f00c40a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.211+0000 7f00ebd59740 1 -- 172.21.15.66:0/2815038910 wait complete. 2024-09-15T23:03:52.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 -- start start 2024-09-15T23:03:52.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 Processor -- start 2024-09-15T23:03:52.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c85300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c85d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe45c8ae20 con 0x55fe45c6c840 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55fe45b59f10 con 0x55fe45c6bf20 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.212+0000 7f00ebd59740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fe45c8afa0 con 0x55fe45c88250 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.213+0000 7f00ebd59740 10 client.0 _ll_register_callbacks cb 0x55fe45b7ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.213+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.213+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35486/0 (socket says 172.21.15.66:35486) 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.213+0000 7f00dbfff640 1 -- 172.21.15.66:0/2680113956 learned_addr learned my addr 172.21.15.66:0/2680113956 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.214+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c85300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.214+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c85d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.216+0000 7f00dbfff640 1 -- 172.21.15.66:0/2680113956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 msgr2=0x55fe45c85d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.216+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c85d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.216+0000 7f00dbfff640 1 -- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 msgr2=0x55fe45c85300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.216+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c85300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.216+0000 7f00dbfff640 1 -- 172.21.15.66:0/2680113956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe458e0580 con 0x55fe45c6c840 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.217+0000 7f00dbfff640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f00cc012ae0 tx=0x7f00cc0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf0d7c7720d3a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.217+0000 7f00d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:03:52.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.217+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc010e10 con 0x55fe45c6c840 2024-09-15T23:03:52.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.217+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f00cc004020 con 0x55fe45c6c840 2024-09-15T23:03:52.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.218+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00dc012450 con 0x55fe45c6c840 2024-09-15T23:03:52.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.221+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f00cc004220 con 0x55fe45c6c840 2024-09-15T23:03:52.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.221+0000 7f00ebd59740 10 client.19110 fetch_fsmap learned FSMap version 70 2024-09-15T23:03:52.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.221+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55fe459aa960 con 0x55fe45c6c840 2024-09-15T23:03:52.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.221+0000 7f00e2ffd640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 0x7f00c40a5a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f00d40c4ee0 tx=0x7f00d4009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00dc012450 con 0x55fe45c6c840 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 8418+0+0 (secure 0 0 0) 0x7f00cc01a590 con 0x55fe45c6c840 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 10 client.19110 fetch_fsmap finished waiting for FSMap version 70 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 10 client.19110 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 20 client.19110 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45c984b0 0x55fe45c9a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 4 client.19110 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:03:52.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe45bdeb90 con 0x55fe45c984b0 2024-09-15T23:03:52.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.222+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45c984b0 0x55fe45c9a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.228+0000 7f00e37fe640 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45c984b0 0x55fe45c9a8d0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b242e9b1c78d33 server_cookie=95b8a480c38ff569 in_seq=0 out_seq=0 2024-09-15T23:03:52.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.228+0000 7f00d2ffd640 10 client.19110 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:52.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.238+0000 7f00d2ffd640 1 -- 172.21.15.66:0/2680113956 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe45bdeb90 con 0x55fe45c984b0 2024-09-15T23:03:52.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.238+0000 7f00d2ffd640 10 client.19110 handle_command_reply: tid=0 2024-09-15T23:03:52.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.238+0000 7f00ebd59740 1 client.19110 shutdown 2024-09-15T23:03:52.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 msgr2=0x55fe45c85840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f00cc012ae0 tx=0x7f00cc0103d0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 shutdown_connections 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c88250 0x55fe45c85d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c6c840 0x55fe45c85840 secure :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f00cc012ae0 tx=0x7f00cc0103d0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45c984b0 0x55fe45c9a8d0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 --2- 172.21.15.66:0/2680113956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c6bf20 0x55fe45c85300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 >> 172.21.15.66:0/2680113956 conn(0x55fe45c685f0 msgr2=0x55fe45c6e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.246+0000 7f00d2ffd640 0 client.19110 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:52.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.247+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 shutdown_connections 2024-09-15T23:03:52.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.247+0000 7f00ebd59740 1 -- 172.21.15.66:0/2680113956 wait complete. 2024-09-15T23:03:52.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.249+0000 7f00ebd59740 20 client.19110 trim_cache size 0 max 16384 2024-09-15T23:03:52.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.286+0000 7f00ebd59740 1 Processor -- start 2024-09-15T23:03:52.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.287+0000 7f00ebd59740 1 -- start start 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.287+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45ca01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.287+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c80ce0 0x55fe45c82560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00ebd59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41b5af0 con 0x55fe45c88250 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00ebd59740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41b7870 con 0x55fe45c80ce0 2024-09-15T23:03:52.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00ebd59740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41b6250 con 0x55fe45c6bf20 2024-09-15T23:03:52.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48242/0 (socket says 172.21.15.66:48242) 2024-09-15T23:03:52.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 -- 172.21.15.66:0/1999579075 learned_addr learned my addr 172.21.15.66:0/1999579075 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:52.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00e37fe640 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45ca01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00e37fe640 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c80ce0 0x55fe45c82560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 -- 172.21.15.66:0/1999579075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 msgr2=0x55fe45ca01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45ca01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 -- 172.21.15.66:0/1999579075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c80ce0 msgr2=0x55fe45c82560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c80ce0 0x55fe45c82560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.288+0000 7f00dbfff640 1 -- 172.21.15.66:0/1999579075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe45c842b0 con 0x55fe45c88250 2024-09-15T23:03:52.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.289+0000 7f00dbfff640 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f00cc01a980 tx=0x7f00cc00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ac59ca6dc5fed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.289+0000 7f00d97fa640 1 -- 172.21.15.66:0/1999579075 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc000e60 con 0x55fe45c88250 2024-09-15T23:03:52.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.289+0000 7f00d97fa640 1 -- 172.21.15.66:0/1999579075 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00cc0043c0 con 0x55fe45c88250 2024-09-15T23:03:52.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.290+0000 7f00d97fa640 1 -- 172.21.15.66:0/1999579075 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc028070 con 0x55fe45c88250 2024-09-15T23:03:52.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.290+0000 7f00ebd59740 1 -- 172.21.15.66:0/1999579075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 msgr2=0x55fe45ca0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.290+0000 7f00ebd59740 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f00cc01a980 tx=0x7f00cc00af10 comp rx=0 tx=0).stop 2024-09-15T23:03:52.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.291+0000 7f00ebd59740 1 -- 172.21.15.66:0/1999579075 shutdown_connections 2024-09-15T23:03:52.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.291+0000 7f00ebd59740 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c80ce0 0x55fe45c82560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.291+0000 7f00ebd59740 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45c88250 0x55fe45ca0700 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.291+0000 7f00ebd59740 1 --2- 172.21.15.66:0/1999579075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45ca01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.291+0000 7f00ebd59740 1 -- 172.21.15.66:0/1999579075 >> 172.21.15.66:0/1999579075 conn(0x55fe45c685f0 msgr2=0x55fe45c87380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.293+0000 7f00ebd59740 1 -- 172.21.15.66:0/1999579075 shutdown_connections 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.293+0000 7f00ebd59740 1 -- 172.21.15.66:0/1999579075 wait complete. 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.293+0000 7f00ebd59740 1 -- start start 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.293+0000 7f00ebd59740 1 Processor -- start 2024-09-15T23:03:52.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45c8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 0x55fe45c8cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45d00180 0x55fe45d02570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41b70e0 con 0x55fe45d00180 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41b6950 con 0x55fe45c88250 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41afaa0 con 0x55fe45c6bf20 2024-09-15T23:03:52.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00ebd59740 10 client.0 _ll_register_callbacks cb 0x7f00cc0126f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 0x55fe45c8cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 0x55fe45c8cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55624/0 (socket says 172.21.15.66:55624) 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00dbfff640 1 -- 172.21.15.66:0/3572915199 learned_addr learned my addr 172.21.15.66:0/3572915199 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.294+0000 7f00e37fe640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45c8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 -- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 msgr2=0x55fe45c8cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 0x55fe45c8cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 -- 172.21.15.66:0/3572915199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45d00180 msgr2=0x55fe45d02570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:03:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45d00180 0x55fe45d02570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 -- 172.21.15.66:0/3572915199 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe45d02b60 con 0x55fe45c6bf20 2024-09-15T23:03:52.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.295+0000 7f00e37fe640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45c8c760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0092f0 tx=0x7f00dc010f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=204bfdf638ecef89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:52.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.300+0000 7f00d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:03:52.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.300+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc026040 con 0x55fe45c6bf20 2024-09-15T23:03:52.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.300+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f00dc012af0 con 0x55fe45c6bf20 2024-09-15T23:03:52.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.300+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00cc0043c0 con 0x55fe45c6bf20 2024-09-15T23:03:52.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.301+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f00dc0049a0 con 0x55fe45c6bf20 2024-09-15T23:03:52.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.302+0000 7f00ebd59740 10 client.28243 fetch_fsmap learned FSMap version 70 2024-09-15T23:03:52.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.302+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55fe45d03ea0 con 0x55fe45c6bf20 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00cc0043c0 con 0x55fe45c6bf20 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 70) ==== 8418+0+0 (secure 0 0 0) 0x7f00dc034070 con 0x55fe45c6bf20 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 10 client.28243 fetch_fsmap finished waiting for FSMap version 70 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 10 client.28243 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 20 client.28243 populate_metadata read hostname 'smithi066' 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45d04530 0x55fe45d069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 4 client.28243 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e612877", "release": true, "await": true}] 2024-09-15T23:03:52.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.308+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e612877", "release": true, "await": true}) -- 0x55fe45bd90a0 con 0x55fe45d04530 2024-09-15T23:03:52.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.317+0000 7f00dbfff640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45d04530 0x55fe45d069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:52.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.321+0000 7f00dbfff640 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45d04530 0x55fe45d069b0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214c3b6e22731d40 server_cookie=f3e54dd657210fd1 in_seq=0 out_seq=0 2024-09-15T23:03:52.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.322+0000 7f00d2ffd640 10 client.28243 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:52.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.600+0000 7f00d2ffd640 1 -- 172.21.15.66:0/3572915199 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fe45bd90a0 con 0x55fe45d04530 2024-09-15T23:03:52.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.600+0000 7f00d2ffd640 10 client.28243 handle_command_reply: tid=0 2024-09-15T23:03:52.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.600+0000 7f00ebd59740 1 client.28243 shutdown 2024-09-15T23:03:52.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 msgr2=0x55fe45c8c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45c8c760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0092f0 tx=0x7f00dc010f00 comp rx=0 tx=0).stop 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 shutdown_connections 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe45d00180 0x55fe45d02570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55fe45d04530 0x55fe45d069b0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fe45c88250 0x55fe45c8cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 --2- 172.21.15.66:0/3572915199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fe45c6bf20 0x55fe45c8c760 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 >> 172.21.15.66:0/3572915199 conn(0x55fe45c685f0 msgr2=0x55fe45c6da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00d2ffd640 0 client.28243 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 shutdown_connections 2024-09-15T23:03:52.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 1 -- 172.21.15.66:0/3572915199 wait complete. 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 70, 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 64, 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "3e612877": { 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 64, 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:03:52.604 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.9, 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:03:52.605 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:03:52.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.601+0000 7f00ebd59740 20 client.28243 trim_cache size 0 max 16384 2024-09-15T23:03:52.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.602+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 msgr2=0x7f00c40a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.602+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 0x7f00c40a5a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f00d40c4ee0 tx=0x7f00d4009260 comp rx=0 tx=0).stop 2024-09-15T23:03:52.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.602+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 msgr2=0x7f00e4075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:52.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.602+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f00d4004770 tx=0x7f00d4003c10 comp rx=0 tx=0).stop 2024-09-15T23:03:52.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 shutdown_connections 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f00c40a3580 0x7f00c40a5a40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00e4106f20 0x7f00e406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e41027a0 0x7f00e4076010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 --2- 172.21.15.66:0/2906299336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00e4101df0 0x7f00e4075ad0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 >> 172.21.15.66:0/2906299336 conn(0x7f00e40fd8b0 msgr2=0x7f00e40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 shutdown_connections 2024-09-15T23:03:52.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:52.605+0000 7f00e9980640 1 -- 172.21.15.66:0/2906299336 wait complete. 2024-09-15T23:03:53.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:53 smithi066 ceph-mon[31185]: pgmap v584: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 30 KiB/s wr, 176 op/s 2024-09-15T23:03:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:53 smithi087 ceph-mon[35290]: pgmap v584: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 30 KiB/s wr, 176 op/s 2024-09-15T23:03:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:53 smithi184 ceph-mon[35203]: pgmap v584: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 30 KiB/s wr, 176 op/s 2024-09-15T23:03:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:55 smithi087 ceph-mon[35290]: pgmap v585: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 171 op/s 2024-09-15T23:03:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:55 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:03:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:55 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:03:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:55 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:03:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:55 smithi184 ceph-mon[35203]: pgmap v585: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 171 op/s 2024-09-15T23:03:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:55 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:03:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:55 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:03:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:55 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:03:55.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:55 smithi066 ceph-mon[31185]: pgmap v585: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 171 op/s 2024-09-15T23:03:55.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:55 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:03:55.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:55 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:03:55.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:55 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:03:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:56 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:03:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:56 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:03:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:56 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:03:56.630 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:56 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:03:56.630 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:56 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:03:56.630 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:56 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:03:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:56 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:03:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:56 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:03:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:56 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:03:56.683 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e612877', total seconds elapsed: 31.1 2024-09-15T23:03:56.683 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.95 2024-09-15T23:03:56.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:03:57.204 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:03:57.460 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:57 smithi066 ceph-mon[31185]: pgmap v586: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 366 KiB/s wr, 165 op/s 2024-09-15T23:03:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:57 smithi087 ceph-mon[35290]: pgmap v586: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 366 KiB/s wr, 165 op/s 2024-09-15T23:03:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:57 smithi184 ceph-mon[35203]: pgmap v586: 129 pgs: 17 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 57 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 366 KiB/s wr, 165 op/s 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 -- 172.21.15.66:0/17702228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 msgr2=0x7fe02c112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 --2- 172.21.15.66:0/17702228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c112650 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009900 tx=0x7fe01c02a4d0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 -- 172.21.15.66:0/17702228 shutdown_connections 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 --2- 172.21.15.66:0/17702228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c112b90 0x7fe02c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 --2- 172.21.15.66:0/17702228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c112650 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 --2- 172.21.15.66:0/17702228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c074590 0x7fe02c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.168+0000 7fe034459640 1 -- 172.21.15.66:0/17702228 >> 172.21.15.66:0/17702228 conn(0x7fe02c0fd8c0 msgr2=0x7fe02c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:59.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.169+0000 7fe034459640 1 -- 172.21.15.66:0/17702228 shutdown_connections 2024-09-15T23:03:59.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.169+0000 7fe034459640 1 -- 172.21.15.66:0/17702228 wait complete. 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.169+0000 7fe034459640 1 Processor -- start 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.169+0000 7fe034459640 1 -- start start 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c074590 0x7fe02c112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c10c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 0x7fe02c10c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c106870 con 0x7fe02c074eb0 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1066f0 con 0x7fe02c112b90 2024-09-15T23:03:59.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe034459640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1069f0 con 0x7fe02c074590 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe0329f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 0x7fe02c10c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe0329f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 0x7fe02c10c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55630/0 (socket says 172.21.15.66:55630) 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe0329f6640 1 -- 172.21.15.66:0/2537523087 learned_addr learned my addr 172.21.15.66:0/2537523087 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe0321f5640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c074590 0x7fe02c112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.170+0000 7fe0319f4640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c10c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.171+0000 7fe0319f4640 1 -- 172.21.15.66:0/2537523087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c074590 msgr2=0x7fe02c112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.171+0000 7fe0319f4640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c074590 0x7fe02c112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.171+0000 7fe0319f4640 1 -- 172.21.15.66:0/2537523087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 msgr2=0x7fe02c10c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.171+0000 7fe0319f4640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 0x7fe02c10c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.171+0000 7fe0319f4640 1 -- 172.21.15.66:0/2537523087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c10d100 con 0x7fe02c074eb0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.172+0000 7fe0319f4640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c10c420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe01c02aa40 tx=0x7fe01c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.173+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c061070 con 0x7fe02c074eb0 2024-09-15T23:03:59.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.173+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe01c031c90 con 0x7fe02c074eb0 2024-09-15T23:03:59.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.174+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c06bbf0 con 0x7fe02c074eb0 2024-09-15T23:03:59.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.174+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c06c0a0 con 0x7fe02c074eb0 2024-09-15T23:03:59.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.174+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c035030 con 0x7fe02c074eb0 2024-09-15T23:03:59.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.178+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe01c064070 con 0x7fe02c074eb0 2024-09-15T23:03:59.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.179+0000 7fe0237fe640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 0x7fe0180a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:03:59.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.179+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7fe01c112730 con 0x7fe02c074eb0 2024-09-15T23:03:59.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.181+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c075cd0 con 0x7fe02c074eb0 2024-09-15T23:03:59.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.181+0000 7fe0321f5640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 0x7fe0180a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:03:59.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.189+0000 7fe0321f5640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 0x7fe0180a58e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe0280058c0 tx=0x7fe02800a4c0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:03:59.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.192+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe01c06b020 con 0x7fe02c074eb0 2024-09-15T23:03:59.512 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:03:59 smithi066 ceph-mon[31185]: pgmap v587: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 419 KiB/s wr, 138 op/s 2024-09-15T23:03:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:03:59 smithi087 ceph-mon[35290]: pgmap v587: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 419 KiB/s wr, 138 op/s 2024-09-15T23:03:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.620+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe02c074970 con 0x7fe02c074eb0 2024-09-15T23:03:59.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.627+0000 7fe0237fe640 1 -- 172.21.15.66:0/2537523087 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+11994 (secure 0 0 0) 0x7fe01c0debe0 con 0x7fe02c074eb0 2024-09-15T23:03:59.628 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:03:59.628 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":70,"btime":"2024-09-15T23:03:47:150507+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:03:46.508015+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:03:59.629 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 70 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 msgr2=0x7fe0180a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 0x7fe0180a58e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe0280058c0 tx=0x7fe02800a4c0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 msgr2=0x7fe02c10c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c10c420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe01c02aa40 tx=0x7fe01c003b90 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 shutdown_connections 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe0180a3420 0x7fe0180a58e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02c112b90 0x7fe02c10c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe02c074eb0 0x7fe02c10c420 secure :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe01c02aa40 tx=0x7fe01c003b90 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.634+0000 7fe034459640 1 --2- 172.21.15.66:0/2537523087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c074590 0x7fe02c112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:03:59.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.635+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 >> 172.21.15.66:0/2537523087 conn(0x7fe02c0fd8c0 msgr2=0x7fe02c0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:03:59.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.636+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 shutdown_connections 2024-09-15T23:03:59.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:03:59.639+0000 7fe034459640 1 -- 172.21.15.66:0/2537523087 wait complete. 2024-09-15T23:03:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:03:59 smithi184 ceph-mon[35203]: pgmap v587: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 419 KiB/s wr, 138 op/s 2024-09-15T23:04:00.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:00 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2537523087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:00.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:00 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2537523087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:00.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:00 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2537523087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:00.840 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db / --timeout 90 --expiration 142.95 --await-for 45.0' 2024-09-15T23:04:00.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db / --timeout 90 --expiration 142.95 --await-for 45.0 2024-09-15T23:04:01.407 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:01.575 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:01 smithi066 ceph-mon[31185]: pgmap v588: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 146 op/s 2024-09-15T23:04:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:01 smithi087 ceph-mon[35290]: pgmap v588: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 146 op/s 2024-09-15T23:04:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:01 smithi184 ceph-mon[35203]: pgmap v588: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 146 op/s 2024-09-15T23:04:02.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.174+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/3003601984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc1023a0 msgr2=0x7f5abc10e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.174+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/3003601984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc1023a0 0x7f5abc10e8d0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009890 tx=0x7f5ab402a3b0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.176+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/3003601984 shutdown_connections 2024-09-15T23:04:02.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.176+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/3003601984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc1023a0 0x7f5abc10e8d0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.176+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/3003601984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc101a00 0x7f5abc101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.176+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/3003601984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5abc107a00 0x7f5abc107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.176+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/3003601984 >> 172.21.15.66:0/3003601984 conn(0x7f5abc0fd6e0 msgr2=0x7f5abc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:02.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.179+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/3003601984 shutdown_connections 2024-09-15T23:04:02.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.180+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/3003601984 wait complete. 2024-09-15T23:04:02.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.181+0000 7f5ac3ebf640 1 Processor -- start 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.181+0000 7f5ac3ebf640 1 -- start start 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc101a00 0x7f5abc073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5abc1023a0 0x7f5abc06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc10fc10 con 0x7f5abc101a00 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc10fa90 con 0x7f5abc1023a0 2024-09-15T23:04:02.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac3ebf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc10fd90 con 0x7f5abc107a00 2024-09-15T23:04:02.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac245c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac245c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:42348/0 (socket says 172.21.15.66:42348) 2024-09-15T23:04:02.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac245c640 1 -- 172.21.15.66:0/1667039767 learned_addr learned my addr 172.21.15.66:0/1667039767 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:02.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.182+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc101a00 0x7f5abc073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.185+0000 7f5ac245c640 1 -- 172.21.15.66:0/1667039767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5abc1023a0 msgr2=0x7f5abc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.185+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5abc1023a0 0x7f5abc06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.185+0000 7f5ac245c640 1 -- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc101a00 msgr2=0x7f5abc073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.185+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc101a00 0x7f5abc073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.185+0000 7f5ac245c640 1 -- 172.21.15.66:0/1667039767 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc06d5f0 con 0x7f5abc107a00 2024-09-15T23:04:02.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.190+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4035040 tx=0x7f5ab4033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.195+0000 7f5abaffd640 1 -- 172.21.15.66:0/1667039767 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab403f030 con 0x7f5abc107a00 2024-09-15T23:04:02.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.195+0000 7f5abaffd640 1 -- 172.21.15.66:0/1667039767 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab4033e00 con 0x7f5abc107a00 2024-09-15T23:04:02.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.195+0000 7f5abaffd640 1 -- 172.21.15.66:0/1667039767 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4037040 con 0x7f5abc107a00 2024-09-15T23:04:02.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.196+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc06d880 con 0x7f5abc107a00 2024-09-15T23:04:02.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.196+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc0717f0 con 0x7f5abc107a00 2024-09-15T23:04:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.206+0000 7f5abaffd640 1 -- 172.21.15.66:0/1667039767 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f5ab4042070 con 0x7f5abc107a00 2024-09-15T23:04:02.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.208+0000 7f5abaffd640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 0x7f5aa40a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.208+0000 7f5abaffd640 1 -- 172.21.15.66:0/1667039767 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f5ab40ef340 con 0x7f5abc107a00 2024-09-15T23:04:02.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.210+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 0x7f5aa40a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.211+0000 7f5ac6298740 1 Processor -- start 2024-09-15T23:04:02.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.215+0000 7f5ac6298740 1 -- start start 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.215+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911020e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.215+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c91102b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.216+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c91102dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.216+0000 7f5ac6298740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c910f85160 con 0x55c911021340 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.216+0000 7f5ac6298740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c910f2c720 con 0x55c91102bc00 2024-09-15T23:04:02.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.216+0000 7f5ac6298740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c910f81120 con 0x55c911020a20 2024-09-15T23:04:02.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac1c5b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911020e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac1c5b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911020e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:42358/0 (socket says 172.21.15.66:42358) 2024-09-15T23:04:02.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac1c5b640 1 -- 172.21.15.66:0/3080064747 learned_addr learned my addr 172.21.15.66:0/3080064747 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:02.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 0x7f5aa40a5aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009890 tx=0x7f5ab0008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c91102b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 -- 172.21.15.66:0/3080064747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 msgr2=0x55c911020e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911020e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 -- 172.21.15.66:0/3080064747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 msgr2=0x55c91102dff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c91102dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.218+0000 7f5ac145a640 1 -- 172.21.15.66:0/3080064747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c910cf6ba0 con 0x55c911021340 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.219+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c91102b6c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f5abc06e310 tx=0x7f5aac00e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5953fa05cb753f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.219+0000 7f5aa3fff640 1 -- 172.21.15.66:0/3080064747 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac004d20 con 0x55c911021340 2024-09-15T23:04:02.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.219+0000 7f5aa3fff640 1 -- 172.21.15.66:0/3080064747 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac003e50 con 0x55c911021340 2024-09-15T23:04:02.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.220+0000 7f5ac6298740 1 -- 172.21.15.66:0/3080064747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 msgr2=0x55c91102b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.220+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c91102b6c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f5abc06e310 tx=0x7f5aac00e880 comp rx=0 tx=0).stop 2024-09-15T23:04:02.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.224+0000 7f5ac6298740 1 -- 172.21.15.66:0/3080064747 shutdown_connections 2024-09-15T23:04:02.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.224+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c91102dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.224+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c91102b6c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.224+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3080064747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911020e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.224+0000 7f5ac6298740 1 -- 172.21.15.66:0/3080064747 >> 172.21.15.66:0/3080064747 conn(0x55c91101cfb0 msgr2=0x55c91101d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:02.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.227+0000 7f5ac6298740 1 -- 172.21.15.66:0/3080064747 shutdown_connections 2024-09-15T23:04:02.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.231+0000 7f5ac6298740 1 -- 172.21.15.66:0/3080064747 wait complete. 2024-09-15T23:04:02.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.231+0000 7f5ac6298740 1 -- start start 2024-09-15T23:04:02.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 Processor -- start 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911028c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 0x55c911029170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110296b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c91102e820 con 0x55c91102bc00 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c910f0d900 con 0x55c911021340 2024-09-15T23:04:02.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c91102e9a0 con 0x55c911020a20 2024-09-15T23:04:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.232+0000 7f5ac6298740 10 client.0 _ll_register_callbacks cb 0x55c910f0b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.233+0000 7f5ac145a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 0x55c911029170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.233+0000 7f5ac145a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 0x55c911029170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:55676/0 (socket says 172.21.15.66:55676) 2024-09-15T23:04:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.233+0000 7f5ac145a640 1 -- 172.21.15.66:0/2531309796 learned_addr learned my addr 172.21.15.66:0/2531309796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.234+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911028c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.236+0000 7f5ac245c640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.239+0000 7f5ac245c640 1 -- 172.21.15.66:0/2531309796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 msgr2=0x55c911028c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.239+0000 7f5ac245c640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911028c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.239+0000 7f5ac245c640 1 -- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 msgr2=0x55c911029170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.239+0000 7f5ac245c640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 0x55c911029170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.239+0000 7f5ac245c640 1 -- 172.21.15.66:0/2531309796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c910f4dc50 con 0x55c91102bc00 2024-09-15T23:04:02.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.242+0000 7f5ac245c640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110296b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40ec670 tx=0x7f5ab40badc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8410c86ec396dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.242+0000 7f5aa17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:02.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.250+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40d4060 con 0x55c91102bc00 2024-09-15T23:04:02.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.250+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f5ab40ec7e0 con 0x55c91102bc00 2024-09-15T23:04:02.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.250+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c910f92890 con 0x55c91102bc00 2024-09-15T23:04:02.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.253+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f5ab40db050 con 0x55c91102bc00 2024-09-15T23:04:02.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.253+0000 7f5ac6298740 10 client.19131 fetch_fsmap learned FSMap version 70 2024-09-15T23:04:02.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.253+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55c91103a6f0 con 0x55c91102bc00 2024-09-15T23:04:02.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.257+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c910f92890 con 0x55c91102bc00 2024-09-15T23:04:02.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.257+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 8418+0+0 (secure 0 0 0) 0x7f5ab403a030 con 0x55c91102bc00 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 10 client.19131 fetch_fsmap finished waiting for FSMap version 70 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 10 client.19131 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 20 client.19131 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c91103bb10 0x55c91103df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 4 client.19131 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.260+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c910f8cbe0 con 0x55c91103bb10 2024-09-15T23:04:02.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.261+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c91103bb10 0x55c91103df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.270+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c91103bb10 0x55c91103df30 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaae92d62b9cb020 server_cookie=2e3cc50ff668d95a in_seq=0 out_seq=0 2024-09-15T23:04:02.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.270+0000 7f5aa17fa640 10 client.19131 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:02.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.274+0000 7f5aa17fa640 1 -- 172.21.15.66:0/2531309796 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c910f8cbe0 con 0x55c91103bb10 2024-09-15T23:04:02.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.274+0000 7f5aa17fa640 10 client.19131 handle_command_reply: tid=0 2024-09-15T23:04:02.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.274+0000 7f5ac6298740 1 client.19131 shutdown 2024-09-15T23:04:02.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 msgr2=0x55c9110296b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110296b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40ec670 tx=0x7f5ab40badc0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 shutdown_connections 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110296b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c91103bb10 0x55c91103df30 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911021340 0x55c911029170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 --2- 172.21.15.66:0/2531309796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911028c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.276+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 >> 172.21.15.66:0/2531309796 conn(0x55c91101cfb0 msgr2=0x55c911022d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.277+0000 7f5aa17fa640 0 client.19131 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:02.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.277+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 shutdown_connections 2024-09-15T23:04:02.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.280+0000 7f5ac6298740 1 -- 172.21.15.66:0/2531309796 wait complete. 2024-09-15T23:04:02.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.281+0000 7f5ac6298740 20 client.19131 trim_cache size 0 max 16384 2024-09-15T23:04:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.314+0000 7f5ac6298740 1 Processor -- start 2024-09-15T23:04:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 -- start start 2024-09-15T23:04:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911029500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c911043820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c911043d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1be0e0 con 0x55c911021340 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1bfe60 con 0x55c91102bc00 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.315+0000 7f5ac6298740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1be840 con 0x55c911020a20 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.316+0000 7f5ac1c5b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911029500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.317+0000 7f5ac1c5b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911029500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:48356/0 (socket says 172.21.15.66:48356) 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.317+0000 7f5ac1c5b640 1 -- 172.21.15.66:0/3635231490 learned_addr learned my addr 172.21.15.66:0/3635231490 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.317+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c911043820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 -- 172.21.15.66:0/3635231490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 msgr2=0x55c911029500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911029500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 -- 172.21.15.66:0/3635231490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 msgr2=0x55c911043d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c911043d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 -- 172.21.15.66:0/3635231490 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c911027180 con 0x55c911021340 2024-09-15T23:04:02.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.318+0000 7f5ac145a640 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c911043820 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c91102a270 tx=0x7f5aac005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adad7599f755928 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.320+0000 7f5aa37fe640 1 -- 172.21.15.66:0/3635231490 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac024070 con 0x55c911021340 2024-09-15T23:04:02.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.320+0000 7f5aa37fe640 1 -- 172.21.15.66:0/3635231490 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac00ca00 con 0x55c911021340 2024-09-15T23:04:02.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.320+0000 7f5aa37fe640 1 -- 172.21.15.66:0/3635231490 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac004040 con 0x55c911021340 2024-09-15T23:04:02.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.322+0000 7f5ac6298740 1 -- 172.21.15.66:0/3635231490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 msgr2=0x55c911043820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:02.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.322+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c911043820 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c91102a270 tx=0x7f5aac005cf0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.324+0000 7f5ac6298740 1 -- 172.21.15.66:0/3635231490 shutdown_connections 2024-09-15T23:04:02.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.324+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c91102bc00 0x55c911043d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.324+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c911021340 0x55c911043820 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.324+0000 7f5ac6298740 1 --2- 172.21.15.66:0/3635231490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911020a20 0x55c911029500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.324+0000 7f5ac6298740 1 -- 172.21.15.66:0/3635231490 >> 172.21.15.66:0/3635231490 conn(0x55c91101cfb0 msgr2=0x55c911027500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:02.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.327+0000 7f5ac6298740 1 -- 172.21.15.66:0/3635231490 shutdown_connections 2024-09-15T23:04:02.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.327+0000 7f5ac6298740 1 -- 172.21.15.66:0/3635231490 wait complete. 2024-09-15T23:04:02.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.327+0000 7f5ac6298740 1 -- start start 2024-09-15T23:04:02.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.327+0000 7f5ac6298740 1 Processor -- start 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911020a20 0x55c911032c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911021340 0x55c911033180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1bf6d0 con 0x55c91102bc00 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1bef40 con 0x55c911020a20 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1bc0c0 con 0x55c911021340 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.328+0000 7f5ac6298740 10 client.0 _ll_register_callbacks cb 0x7f5ab4030950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:02.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.330+0000 7f5ac1c5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911020a20 0x55c911032c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.330+0000 7f5ac245c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.330+0000 7f5ac245c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35466/0 (socket says 172.21.15.66:35466) 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.330+0000 7f5ac245c640 1 -- 172.21.15.66:0/1597234061 learned_addr learned my addr 172.21.15.66:0/1597234061 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 -- 172.21.15.66:0/1597234061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911021340 msgr2=0x55c911033180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911021340 0x55c911033180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 -- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911020a20 msgr2=0x55c911032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:02.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911020a20 0x55c911032c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:02.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 -- 172.21.15.66:0/1597234061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c911033ec0 con 0x55c91102bc00 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5ac245c640 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4033fd0 tx=0x7f5ab4005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9967f33a8c7482 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.331+0000 7f5aa17fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.332+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40c3ef0 con 0x55c91102bc00 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.332+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9759+0+0 (secure 0 0 0) 0x7f5ab40c3a60 con 0x55c91102bc00 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.332+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aac00ca00 con 0x55c91102bc00 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.332+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f5ab40d4260 con 0x55c91102bc00 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.333+0000 7f5ac6298740 10 client.19137 fetch_fsmap learned FSMap version 70 2024-09-15T23:04:02.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.333+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55c9110b7f00 con 0x55c91102bc00 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac00ca00 con 0x55c91102bc00 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 70) ==== 8418+0+0 (secure 0 0 0) 0x7f5ab40bf170 con 0x55c91102bc00 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 10 client.19137 fetch_fsmap finished waiting for FSMap version 70 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 10 client.19137 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 20 client.19137 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9110b84e0 0x55c9110ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 4 client.19137 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.95, "await_for": 45.0}] 2024-09-15T23:04:02.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.95, "await_for": 45.0}) -- 0x55c910f08f40 con 0x55c9110b84e0 2024-09-15T23:04:02.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.337+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9110b84e0 0x55c9110ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:02.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.340+0000 7f5ac1c5b640 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9110b84e0 0x55c9110ba900 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fe957f4a18d844 server_cookie=a8016482c6d88ebe in_seq=0 out_seq=0 2024-09-15T23:04:02.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:02.340+0000 7f5aa17fa640 10 client.19137 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:03.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.520+0000 7f5aa17fa640 1 -- 172.21.15.66:0/1597234061 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c910f08f40 con 0x55c9110b84e0 2024-09-15T23:04:03.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.520+0000 7f5aa17fa640 10 client.19137 handle_command_reply: tid=0 2024-09-15T23:04:03.522 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:03 smithi066 ceph-mon[31185]: pgmap v589: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.520+0000 7f5ac6298740 1 client.19137 shutdown 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.520+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 msgr2=0x55c9110336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.520+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4033fd0 tx=0x7f5ab4005bf0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 shutdown_connections 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c91102bc00 0x55c9110336c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c911021340 0x55c911033180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55c9110b84e0 0x55c9110ba900 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 --2- 172.21.15.66:0/1597234061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c911020a20 0x55c911032c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 >> 172.21.15.66:0/1597234061 conn(0x55c91101cfb0 msgr2=0x55c91101b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5aa17fa640 0 client.19137 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 shutdown_connections 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 71, 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 66, 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:04:03.524 INFO:teuthology.orchestra.run.smithi066.stdout: "fa5b1b50": { 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 66, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.9, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:04:03.525 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "QUIESCED", 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:03.526 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 1 -- 172.21.15.66:0/1597234061 wait complete. 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.521+0000 7f5ac6298740 20 client.19137 trim_cache size 0 max 16384 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.522+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 msgr2=0x7f5aa40a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.522+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 0x7f5aa40a5aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009890 tx=0x7f5ab0008040 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 msgr2=0x7f5abc06d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4035040 tx=0x7f5ab4033d10 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 shutdown_connections 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f5aa40a35e0 0x7f5aa40a5aa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc107a00 0x7f5abc06d000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5abc1023a0 0x7f5abc06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 --2- 172.21.15.66:0/1667039767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5abc101a00 0x7f5abc073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:03.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 >> 172.21.15.66:0/1667039767 conn(0x7f5abc0fd6e0 msgr2=0x7f5abc0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:03.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 shutdown_connections 2024-09-15T23:04:03.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:03.523+0000 7f5ac3ebf640 1 -- 172.21.15.66:0/1667039767 wait complete. 2024-09-15T23:04:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:03 smithi087 ceph-mon[35290]: pgmap v589: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-15T23:04:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:03 smithi184 ceph-mon[35203]: pgmap v589: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-15T23:04:04.316 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fa5b1b50', quiesce took 7.6 seconds. Will release after: 15.35 2024-09-15T23:04:04.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:04 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:04.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:04 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:04.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:04 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:05 smithi087 ceph-mon[35290]: pgmap v590: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-09-15T23:04:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:05 smithi184 ceph-mon[35203]: pgmap v590: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-09-15T23:04:05.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:05 smithi066 ceph-mon[31185]: pgmap v590: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-09-15T23:04:06.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:06 smithi087 ceph-mon[35290]: osdmap e117: 12 total, 12 up, 12 in 2024-09-15T23:04:06.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:06 smithi184 ceph-mon[35203]: osdmap e117: 12 total, 12 up, 12 in 2024-09-15T23:04:06.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:06 smithi066 ceph-mon[31185]: osdmap e117: 12 total, 12 up, 12 in 2024-09-15T23:04:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:07 smithi087 ceph-mon[35290]: pgmap v592: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-15T23:04:07.599 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:07 smithi066 ceph-mon[31185]: pgmap v592: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-15T23:04:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:07 smithi184 ceph-mon[35203]: pgmap v592: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-15T23:04:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:09 smithi087 ceph-mon[35290]: pgmap v593: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 177 op/s 2024-09-15T23:04:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:09 smithi184 ceph-mon[35203]: pgmap v593: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 177 op/s 2024-09-15T23:04:09.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:09 smithi066 ceph-mon[31185]: pgmap v593: 129 pgs: 16 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 58 active+clean; 2.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 177 op/s 2024-09-15T23:04:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:11 smithi087 ceph-mon[35290]: pgmap v594: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-09-15T23:04:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:11 smithi184 ceph-mon[35203]: pgmap v594: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-09-15T23:04:11.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:11 smithi066 ceph-mon[31185]: pgmap v594: 129 pgs: 18 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 56 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-09-15T23:04:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:13 smithi087 ceph-mon[35290]: pgmap v595: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 560 KiB/s wr, 149 op/s 2024-09-15T23:04:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:13 smithi184 ceph-mon[35203]: pgmap v595: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 560 KiB/s wr, 149 op/s 2024-09-15T23:04:13.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:13 smithi066 ceph-mon[31185]: pgmap v595: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 560 KiB/s wr, 149 op/s 2024-09-15T23:04:14.170 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:04:14.700 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:15.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.492+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/683230026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102ef0 msgr2=0x7f0dd410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.492+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/683230026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102ef0 0x7f0dd410da40 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009ca0 tx=0x7f0dcc02a660 comp rx=0 tx=0).stop 2024-09-15T23:04:15.497 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:15 smithi066 ceph-mon[31185]: pgmap v596: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 234 KiB/s wr, 134 op/s 2024-09-15T23:04:15.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.496+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/683230026 shutdown_connections 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.496+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/683230026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102ef0 0x7f0dd410da40 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.496+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/683230026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102570 0x7f0dd41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.496+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/683230026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.496+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/683230026 >> 172.21.15.66:0/683230026 conn(0x7f0dd40fc7d0 msgr2=0x7f0dd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.497+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/683230026 shutdown_connections 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.497+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/683230026 wait complete. 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.497+0000 7f0ddbe8c640 1 Processor -- start 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 -- start start 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 0x7f0dd4073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102ef0 0x7f0dd406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410fec0 con 0x7f0dd4102570 2024-09-15T23:04:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd410fd40 con 0x7f0dd4100e20 2024-09-15T23:04:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0ddbe8c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4110040 con 0x7f0dd4102ef0 2024-09-15T23:04:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0dd9c28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0dd9c28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd40738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49804/0 (socket says 172.21.15.66:49804) 2024-09-15T23:04:15.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0dd9c28640 1 -- 172.21.15.66:0/3044788833 learned_addr learned my addr 172.21.15.66:0/3044788833 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:15.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.498+0000 7f0dd9427640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 0x7f0dd4073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dda429640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102ef0 0x7f0dd406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 -- 172.21.15.66:0/3044788833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102ef0 msgr2=0x7f0dd406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102ef0 0x7f0dd406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 -- 172.21.15.66:0/3044788833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 msgr2=0x7f0dd40738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd40738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 -- 172.21.15.66:0/3044788833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd406d340 con 0x7f0dd4102570 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.500+0000 7f0dd9427640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 0x7f0dd4073e10 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c970 tx=0x7f0dd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.501+0000 7f0dc6ffd640 1 -- 172.21.15.66:0/3044788833 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0007bb0 con 0x7f0dd4102570 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.501+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd406d630 con 0x7f0dd4102570 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.501+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd4071620 con 0x7f0dd4102570 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.501+0000 7f0dc6ffd640 1 -- 172.21.15.66:0/3044788833 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd0007d50 con 0x7f0dd4102570 2024-09-15T23:04:15.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.501+0000 7f0dc6ffd640 1 -- 172.21.15.66:0/3044788833 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000f450 con 0x7f0dd4102570 2024-09-15T23:04:15.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.505+0000 7f0dde265740 1 Processor -- start 2024-09-15T23:04:15.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.507+0000 7f0dc6ffd640 1 -- 172.21.15.66:0/3044788833 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0dd000f5f0 con 0x7f0dd4102570 2024-09-15T23:04:15.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dc6ffd640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 0x7f0dc00a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 -- start start 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157b4a0 0x55905157b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051588a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5590514e12e0 con 0x559051586680 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x559051488ce0 con 0x55905157b4a0 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.508+0000 7f0dde265740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5590514dd2a0 con 0x55905157bdc0 2024-09-15T23:04:15.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.509+0000 7f0dc6ffd640 1 -- 172.21.15.66:0/3044788833 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f0dd00046c0 con 0x7f0dd4102570 2024-09-15T23:04:15.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.510+0000 7f0dd9427640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.510+0000 7f0dd9427640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54334/0 (socket says 172.21.15.66:54334) 2024-09-15T23:04:15.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.510+0000 7f0dd9427640 1 -- 172.21.15.66:0/1141462678 learned_addr learned my addr 172.21.15.66:0/1141462678 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:15.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.512+0000 7f0dd9c28640 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157b4a0 0x55905157b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.512+0000 7f0dda429640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 0x7f0dc00a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.513+0000 7f0dd9427640 1 -- 172.21.15.66:0/1141462678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157b4a0 msgr2=0x55905157b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.513+0000 7f0dd9427640 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157b4a0 0x55905157b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.513+0000 7f0dd9427640 1 -- 172.21.15.66:0/1141462678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 msgr2=0x559051588a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.513+0000 7f0dd9427640 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051588a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.513+0000 7f0dd9427640 1 -- 172.21.15.66:0/1141462678 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905146d440 con 0x55905157bdc0 2024-09-15T23:04:15.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.515+0000 7f0dd9427640 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00a5350 tx=0x7f0dd009cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b21de09ac69aa60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.518+0000 7f0dbffff640 1 -- 172.21.15.66:0/1141462678 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd001d040 con 0x55905157bdc0 2024-09-15T23:04:15.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.519+0000 7f0dbffff640 1 -- 172.21.15.66:0/1141462678 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd00a5880 con 0x55905157bdc0 2024-09-15T23:04:15.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.519+0000 7f0dbffff640 1 -- 172.21.15.66:0/1141462678 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd009c060 con 0x55905157bdc0 2024-09-15T23:04:15.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.522+0000 7f0dde265740 1 -- 172.21.15.66:0/1141462678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 msgr2=0x559051586140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.522+0000 7f0dde265740 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00a5350 tx=0x7f0dd009cb10 comp rx=0 tx=0).stop 2024-09-15T23:04:15.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.526+0000 7f0dde265740 1 -- 172.21.15.66:0/1141462678 shutdown_connections 2024-09-15T23:04:15.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.526+0000 7f0dde265740 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051588a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.526+0000 7f0dde265740 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157bdc0 0x559051586140 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.526+0000 7f0dde265740 1 --2- 172.21.15.66:0/1141462678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157b4a0 0x55905157b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.526+0000 7f0dde265740 1 -- 172.21.15.66:0/1141462678 >> 172.21.15.66:0/1141462678 conn(0x559051577a30 msgr2=0x559051577e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.527+0000 7f0dda429640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 0x7f0dc00a59b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x559051578db0 tx=0x7f0dcc005dc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.528+0000 7f0dde265740 1 -- 172.21.15.66:0/1141462678 shutdown_connections 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.533+0000 7f0dde265740 1 -- 172.21.15.66:0/1141462678 wait complete. 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 -- start start 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 Processor -- start 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051586030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x5590515832e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051583880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559051589250 con 0x559051586680 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55905149c050 con 0x55905157bdc0 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.534+0000 7f0dde265740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5590515893d0 con 0x55905157b4a0 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.535+0000 7f0dde265740 10 client.0 _ll_register_callbacks cb 0x5590514dc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.535+0000 7f0dd9c28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051586030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.535+0000 7f0dd9c28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051586030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54348/0 (socket says 172.21.15.66:54348) 2024-09-15T23:04:15.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.535+0000 7f0dd9c28640 1 -- 172.21.15.66:0/2683743892 learned_addr learned my addr 172.21.15.66:0/2683743892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:15.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051583880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 -- 172.21.15.66:0/2683743892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 msgr2=0x559051586030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051586030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 -- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 msgr2=0x5590515832e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x5590515832e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.536+0000 7f0dda429640 1 -- 172.21.15.66:0/2683743892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590512523c0 con 0x559051586680 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.537+0000 7f0dda429640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051583880 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc02ac50 tx=0x7f0dcc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba337cd82bdae7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.538+0000 7f0dbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.538+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc04d070 con 0x559051586680 2024-09-15T23:04:15.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.538+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd00a5880 con 0x559051586680 2024-09-15T23:04:15.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.542+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f0dcc004450 con 0x559051586680 2024-09-15T23:04:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.543+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f0dcc059050 con 0x559051586680 2024-09-15T23:04:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.543+0000 7f0dde265740 10 client.19146 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.543+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x559051594d10 con 0x559051586680 2024-09-15T23:04:15.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd00a5880 con 0x559051586680 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f0dcc03d430 con 0x559051586680 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 10 client.19146 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 10 client.19146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 20 client.19146 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051596600 0x559051598aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 4 client.19146 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.544+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590514ee850 con 0x559051596600 2024-09-15T23:04:15.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.545+0000 7f0dd9c28640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051596600 0x559051598aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.552+0000 7f0dd9c28640 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051596600 0x559051598aa0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07ab1c5cc727773 server_cookie=23d03443e4ee4e0b in_seq=0 out_seq=0 2024-09-15T23:04:15.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.552+0000 7f0dbd7fa640 10 client.19146 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:15.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.553+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/2683743892 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590514ee850 con 0x559051596600 2024-09-15T23:04:15.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.553+0000 7f0dbd7fa640 10 client.19146 handle_command_reply: tid=0 2024-09-15T23:04:15.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.553+0000 7f0dde265740 1 client.19146 shutdown 2024-09-15T23:04:15.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.554+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 msgr2=0x559051583880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.554+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051583880 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc02ac50 tx=0x7f0dcc0095c0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 shutdown_connections 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x559051583880 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051596600 0x559051598aa0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x5590515832e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 --2- 172.21.15.66:0/2683743892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051586030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 >> 172.21.15.66:0/2683743892 conn(0x559051577a30 msgr2=0x55905157d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.557+0000 7f0dbd7fa640 0 client.19146 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:15.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.561+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 shutdown_connections 2024-09-15T23:04:15.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.562+0000 7f0dde265740 1 -- 172.21.15.66:0/2683743892 wait complete. 2024-09-15T23:04:15.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.562+0000 7f0dde265740 20 client.19146 trim_cache size 0 max 16384 2024-09-15T23:04:15.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.596+0000 7f0dde265740 1 Processor -- start 2024-09-15T23:04:15.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 -- start start 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051592510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905159e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8010360 con 0x559051586680 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8012110 con 0x55905157bdc0 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dde265740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8010ac0 con 0x55905157b4a0 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dda429640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dda429640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34174/0 (socket says 172.21.15.66:34174) 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.597+0000 7f0dda429640 1 -- 172.21.15.66:0/4111089450 learned_addr learned my addr 172.21.15.66:0/4111089450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:15.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dd9427640 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905159e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:15 smithi087 ceph-mon[35290]: pgmap v596: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 234 KiB/s wr, 134 op/s 2024-09-15T23:04:15.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 -- 172.21.15.66:0/4111089450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 msgr2=0x559051592510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:15.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051592510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 -- 172.21.15.66:0/4111089450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 msgr2=0x55905159e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905159e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 -- 172.21.15.66:0/4111089450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559051588de0 con 0x559051586680 2024-09-15T23:04:15.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.598+0000 7f0dda429640 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc02ab80 tx=0x7f0dcc003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bace079d6eb5de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.601+0000 7f0dbf7fe640 1 -- 172.21.15.66:0/4111089450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc061030 con 0x559051586680 2024-09-15T23:04:15.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.601+0000 7f0dbf7fe640 1 -- 172.21.15.66:0/4111089450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc041070 con 0x559051586680 2024-09-15T23:04:15.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.601+0000 7f0dbf7fe640 1 -- 172.21.15.66:0/4111089450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc04d050 con 0x559051586680 2024-09-15T23:04:15.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.602+0000 7f0dde265740 1 -- 172.21.15.66:0/4111089450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 msgr2=0x55905159e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.602+0000 7f0dde265740 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc02ab80 tx=0x7f0dcc003fd0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.604+0000 7f0dde265740 1 -- 172.21.15.66:0/4111089450 shutdown_connections 2024-09-15T23:04:15.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.604+0000 7f0dde265740 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905159e8f0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.604+0000 7f0dde265740 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905159e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.604+0000 7f0dde265740 1 --2- 172.21.15.66:0/4111089450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x559051592510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.604+0000 7f0dde265740 1 -- 172.21.15.66:0/4111089450 >> 172.21.15.66:0/4111089450 conn(0x559051577a30 msgr2=0x559051581bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.608+0000 7f0dde265740 1 -- 172.21.15.66:0/4111089450 shutdown_connections 2024-09-15T23:04:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.609+0000 7f0dde265740 1 -- 172.21.15.66:0/4111089450 wait complete. 2024-09-15T23:04:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.609+0000 7f0dde265740 1 -- start start 2024-09-15T23:04:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.609+0000 7f0dde265740 1 Processor -- start 2024-09-15T23:04:15.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x55905158e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905158ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905158b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8011980 con 0x559051586680 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80111f0 con 0x55905157bdc0 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0db800e360 con 0x55905157b4a0 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.610+0000 7f0dde265740 10 client.0 _ll_register_callbacks cb 0x7f0dcc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.611+0000 7f0dd9427640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905158ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.611+0000 7f0dd9427640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905158ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49834/0 (socket says 172.21.15.66:49834) 2024-09-15T23:04:15.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.611+0000 7f0dd9427640 1 -- 172.21.15.66:0/800126804 learned_addr learned my addr 172.21.15.66:0/800126804 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:15.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.611+0000 7f0dda429640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905158b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.612+0000 7f0dda429640 1 -- 172.21.15.66:0/800126804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 msgr2=0x55905158e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.612+0000 7f0dda429640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x55905158e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.612+0000 7f0dda429640 1 -- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 msgr2=0x55905158ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.612+0000 7f0dda429640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905158ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.612+0000 7f0dda429640 1 -- 172.21.15.66:0/800126804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905158bb90 con 0x559051586680 2024-09-15T23:04:15.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.615+0000 7f0dda429640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905158b650 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc03d800 tx=0x7f0dcc03dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538ad08d2ed9cc0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:15.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.615+0000 7f0dbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:15.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.617+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc06a030 con 0x559051586680 2024-09-15T23:04:15.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.617+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dcc041070 con 0x559051586680 2024-09-15T23:04:15.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.617+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f0dcc003d10 con 0x559051586680 2024-09-15T23:04:15.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.619+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f0dcc077050 con 0x559051586680 2024-09-15T23:04:15.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.621+0000 7f0dde265740 10 client.19152 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:15.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.621+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5590516019a0 con 0x559051586680 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc041070 con 0x559051586680 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f0dcc02f9f0 con 0x559051586680 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 10 client.19152 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 10 client.19152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 20 client.19152 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051602090 0x5590516044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 4 client.19152 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:04:15.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.622+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590514e8d60 con 0x559051602090 2024-09-15T23:04:15.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.623+0000 7f0dd9c28640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051602090 0x5590516044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:15.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.627+0000 7f0dd9c28640 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051602090 0x5590516044b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2433af4be9a4f6c1 server_cookie=a6a15f463e691458 in_seq=0 out_seq=0 2024-09-15T23:04:15.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.627+0000 7f0dbd7fa640 10 client.19152 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:15.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.630+0000 7f0dbd7fa640 1 -- 172.21.15.66:0/800126804 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f0dc800d7d0 con 0x559051602090 2024-09-15T23:04:15.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.630+0000 7f0dbd7fa640 10 client.19152 handle_command_reply: tid=0 2024-09-15T23:04:15.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.631+0000 7f0dde265740 1 client.19152 shutdown 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 msgr2=0x55905158b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905158b650 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc03d800 tx=0x7f0dcc03dca0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 shutdown_connections 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559051586680 0x55905158b650 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x559051602090 0x5590516044b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905157bdc0 0x55905158ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.633+0000 7f0dde265740 1 --2- 172.21.15.66:0/800126804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55905157b4a0 0x55905158e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.634+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 >> 172.21.15.66:0/800126804 conn(0x559051577a30 msgr2=0x559051584b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.635+0000 7f0dbd7fa640 0 client.19152 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:15.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.635+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 shutdown_connections 2024-09-15T23:04:15.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.637+0000 7f0dde265740 1 -- 172.21.15.66:0/800126804 wait complete. 2024-09-15T23:04:15.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.637+0000 7f0dde265740 20 client.19152 trim_cache size 0 max 16384 2024-09-15T23:04:15.639 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:15.639 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T23:04:15.639 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T23:04:15.639 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:15.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.639+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 msgr2=0x7f0dc00a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.639+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 0x7f0dc00a59b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x559051578db0 tx=0x7f0dcc005dc0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.639+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 msgr2=0x7f0dd4073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:15.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.639+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 0x7f0dd4073e10 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000c970 tx=0x7f0dd000ce30 comp rx=0 tx=0).stop 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 shutdown_connections 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0dc00a34f0 0x7f0dc00a59b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dd4102ef0 0x7f0dd406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dd4102570 0x7f0dd4073e10 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 --2- 172.21.15.66:0/3044788833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dd4100e20 0x7f0dd40738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:15.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.640+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 >> 172.21.15.66:0/3044788833 conn(0x7f0dd40fc7d0 msgr2=0x7f0dd4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:15.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.644+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 shutdown_connections 2024-09-15T23:04:15.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:15.644+0000 7f0ddbe8c640 1 -- 172.21.15.66:0/3044788833 wait complete. 2024-09-15T23:04:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:15 smithi184 ceph-mon[35203]: pgmap v596: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 234 KiB/s wr, 134 op/s 2024-09-15T23:04:16.508 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:04:16.509 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:04:17.019 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:17.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:17 smithi066 ceph-mon[31185]: pgmap v597: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 KiB/s wr, 113 op/s 2024-09-15T23:04:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:17 smithi087 ceph-mon[35290]: pgmap v597: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 KiB/s wr, 113 op/s 2024-09-15T23:04:17.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.666+0000 7f87eb17f640 1 -- 172.21.15.66:0/2732464787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 msgr2=0x7f87e41003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:17.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.666+0000 7f87eb17f640 1 --2- 172.21.15.66:0/2732464787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e41003d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f87d80074e0 tx=0x7f87d802b0a0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:17 smithi184 ceph-mon[35203]: pgmap v597: 129 pgs: 19 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 55 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 27 KiB/s wr, 113 op/s 2024-09-15T23:04:17.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.674+0000 7f87eb17f640 1 -- 172.21.15.66:0/2732464787 shutdown_connections 2024-09-15T23:04:17.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.674+0000 7f87eb17f640 1 --2- 172.21.15.66:0/2732464787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 0x7f87e410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.674+0000 7f87eb17f640 1 --2- 172.21.15.66:0/2732464787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.674+0000 7f87eb17f640 1 --2- 172.21.15.66:0/2732464787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e41003d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.674+0000 7f87eb17f640 1 -- 172.21.15.66:0/2732464787 >> 172.21.15.66:0/2732464787 conn(0x7f87e40fba90 msgr2=0x7f87e40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.682+0000 7f87eb17f640 1 -- 172.21.15.66:0/2732464787 shutdown_connections 2024-09-15T23:04:17.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.682+0000 7f87eb17f640 1 -- 172.21.15.66:0/2732464787 wait complete. 2024-09-15T23:04:17.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.682+0000 7f87eb17f640 1 Processor -- start 2024-09-15T23:04:17.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.687+0000 7f87eb17f640 1 -- start start 2024-09-15T23:04:17.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.687+0000 7f87eb17f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e4109f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:17.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.688+0000 7f87eb17f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e410a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:17.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.688+0000 7f87eb17f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 0x7f87e410aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:17.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.688+0000 7f87eb17f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f87e410faf0 con 0x7f87e40ffff0 2024-09-15T23:04:17.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.688+0000 7f87eb17f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87e410f970 con 0x7f87e41009a0 2024-09-15T23:04:17.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.688+0000 7f87eb17f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87e410fc70 con 0x7f87e4105120 2024-09-15T23:04:17.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.689+0000 7f87e8f1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e4109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:17.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.689+0000 7f87e8f1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e4109f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34202/0 (socket says 172.21.15.66:34202) 2024-09-15T23:04:17.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.689+0000 7f87e8f1b640 1 -- 172.21.15.66:0/3175012884 learned_addr learned my addr 172.21.15.66:0/3175012884 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:17.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.690+0000 7f87e3fff640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e410a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:17.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.691+0000 7f87e971c640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 0x7f87e410aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.694+0000 7f87e3fff640 1 -- 172.21.15.66:0/3175012884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 msgr2=0x7f87e410aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.694+0000 7f87e3fff640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 0x7f87e410aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.694+0000 7f87e3fff640 1 -- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 msgr2=0x7f87e4109f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.694+0000 7f87e3fff640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e4109f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.694+0000 7f87e3fff640 1 -- 172.21.15.66:0/3175012884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e41aae50 con 0x7f87e41009a0 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.695+0000 7f87e3fff640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e410a4d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f87d000b3f0 tx=0x7f87d000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.696+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0015020 con 0x7f87e41009a0 2024-09-15T23:04:17.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.696+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d0011d10 con 0x7f87e41009a0 2024-09-15T23:04:17.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.696+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d000f2e0 con 0x7f87e41009a0 2024-09-15T23:04:17.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.696+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e41ab140 con 0x7f87e41009a0 2024-09-15T23:04:17.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.696+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e41ab630 con 0x7f87e41009a0 2024-09-15T23:04:17.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.698+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e41014d0 con 0x7f87e41009a0 2024-09-15T23:04:17.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.702+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f87d0018020 con 0x7f87e41009a0 2024-09-15T23:04:17.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.703+0000 7f87e1ffb640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 0x7f87d40a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:17.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.704+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f87d00cf8d0 con 0x7f87e41009a0 2024-09-15T23:04:17.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.704+0000 7f87e8f1b640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 0x7f87d40a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:17.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.705+0000 7f87e8f1b640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 0x7f87d40a5a80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005c40 tx=0x7f87d802d040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:17.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:17.711+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87d001f020 con 0x7f87e41009a0 2024-09-15T23:04:18.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.134+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87e4111de0 con 0x7f87e41009a0 2024-09-15T23:04:18.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.139+0000 7f87e1ffb640 1 -- 172.21.15.66:0/3175012884 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11996 (secure 0 0 0) 0x7f87d009be30 con 0x7f87e41009a0 2024-09-15T23:04:18.152 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:04:18.153 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":71,"btime":"2024-09-15T23:04:03:227100+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:02.686781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:04:18.153 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 71 2024-09-15T23:04:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 msgr2=0x7f87d40a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 0x7f87d40a5a80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005c40 tx=0x7f87d802d040 comp rx=0 tx=0).stop 2024-09-15T23:04:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 msgr2=0x7f87e410a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e410a4d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f87d000b3f0 tx=0x7f87d000b8b0 comp rx=0 tx=0).stop 2024-09-15T23:04:18.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 shutdown_connections 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f87d40a35c0 0x7f87d40a5a80 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005c40 tx=0x7f87d802d040 comp rx=0 tx=0).stop 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e4105120 0x7f87e410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e41009a0 0x7f87e410a4d0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f87d000b3f0 tx=0x7f87d000b8b0 comp rx=0 tx=0).stop 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 --2- 172.21.15.66:0/3175012884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87e40ffff0 0x7f87e4109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.143+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 >> 172.21.15.66:0/3175012884 conn(0x7f87e40fba90 msgr2=0x7f87e40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.144+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 shutdown_connections 2024-09-15T23:04:18.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:18.148+0000 7f87eb17f640 1 -- 172.21.15.66:0/3175012884 wait complete. 2024-09-15T23:04:18.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:18 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3175012884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:18.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:18 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3175012884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:18.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:18 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3175012884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:18.895 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T23:04:19.437 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:19 smithi087 ceph-mon[35290]: pgmap v598: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 KiB/s wr, 114 op/s 2024-09-15T23:04:19.610 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:19 smithi066 ceph-mon[31185]: pgmap v598: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 KiB/s wr, 114 op/s 2024-09-15T23:04:19.667 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:04:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:19 smithi184 ceph-mon[35203]: pgmap v598: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 24 KiB/s wr, 114 op/s 2024-09-15T23:04:20.572 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:20.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.587+0000 7f37c5bc0640 1 -- 172.21.15.66:0/186691100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 msgr2=0x7f37c0106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.587+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/186691100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c0106220 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009900 tx=0x7f37b802a490 comp rx=0 tx=0).stop 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.589+0000 7f37c5bc0640 1 -- 172.21.15.66:0/186691100 shutdown_connections 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.589+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/186691100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c0106220 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.589+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/186691100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c01012a0 0x7f37c0105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.589+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/186691100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c0100980 0x7f37c0100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.589+0000 7f37c5bc0640 1 -- 172.21.15.66:0/186691100 >> 172.21.15.66:0/186691100 conn(0x7f37c00fc630 msgr2=0x7f37c00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.590+0000 7f37c5bc0640 1 -- 172.21.15.66:0/186691100 shutdown_connections 2024-09-15T23:04:20.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.594+0000 7f37c5bc0640 1 -- 172.21.15.66:0/186691100 wait complete. 2024-09-15T23:04:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.594+0000 7f37c5bc0640 1 Processor -- start 2024-09-15T23:04:20.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 -- start start 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c0100980 0x7f37c0106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c01012a0 0x7f37c0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37c006c660 con 0x7f37c0105d90 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f37c006c4e0 con 0x7f37c01012a0 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.595+0000 7f37c5bc0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37c006c7e0 con 0x7f37c0100980 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.597+0000 7f37c53bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.597+0000 7f37c53bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34230/0 (socket says 172.21.15.66:34230) 2024-09-15T23:04:20.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.597+0000 7f37c53bf640 1 -- 172.21.15.66:0/3006124075 learned_addr learned my addr 172.21.15.66:0/3006124075 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.599+0000 7f37c53bf640 1 -- 172.21.15.66:0/3006124075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c0100980 msgr2=0x7f37c0106f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.599+0000 7f37c53bf640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c0100980 0x7f37c0106f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.599+0000 7f37c53bf640 1 -- 172.21.15.66:0/3006124075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c01012a0 msgr2=0x7f37c0107450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.599+0000 7f37c53bf640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c01012a0 0x7f37c0107450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.599+0000 7f37c53bf640 1 -- 172.21.15.66:0/3006124075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c010b790 con 0x7f37c0105d90 2024-09-15T23:04:20.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.600+0000 7f37c53bf640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f37b802aa00 tx=0x7f37b8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.601+0000 7f37bdffb640 1 -- 172.21.15.66:0/3006124075 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b803f070 con 0x7f37c0105d90 2024-09-15T23:04:20.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.601+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c010ba20 con 0x7f37c0105d90 2024-09-15T23:04:20.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.601+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c01133a0 con 0x7f37c0105d90 2024-09-15T23:04:20.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.601+0000 7f37bdffb640 1 -- 172.21.15.66:0/3006124075 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37b8031c90 con 0x7f37c0105d90 2024-09-15T23:04:20.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.601+0000 7f37bdffb640 1 -- 172.21.15.66:0/3006124075 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8035030 con 0x7f37c0105d90 2024-09-15T23:04:20.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.605+0000 7f37bdffb640 1 -- 172.21.15.66:0/3006124075 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f37b8042070 con 0x7f37c0105d90 2024-09-15T23:04:20.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.606+0000 7f37bdffb640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 0x7f37ac0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.607+0000 7f37bdffb640 1 -- 172.21.15.66:0/3006124075 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f37b80f1800 con 0x7f37c0105d90 2024-09-15T23:04:20.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.610+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 0x7f37ac0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.621+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 0x7f37ac0a5a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005fd0 tx=0x7f37b0009500 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.622+0000 7f37c91fb740 1 Processor -- start 2024-09-15T23:04:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.622+0000 7f37c91fb740 1 -- start start 2024-09-15T23:04:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.622+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7d9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.622+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7d9780 0x55eb9e7d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 0x55eb9e7e6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c91fb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e73f2f0 con 0x55eb9e7e4520 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c91fb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e6e6cf0 con 0x55eb9e7d9780 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c91fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e73b2b0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c4bbe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7d9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c4bbe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7d9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54400/0 (socket says 172.21.15.66:54400) 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c4bbe640 1 -- 172.21.15.66:0/2209620077 learned_addr learned my addr 172.21.15.66:0/2209620077 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37bffff640 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7d9780 0x55eb9e7d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.623+0000 7f37c53bf640 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 0x55eb9e7e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.624+0000 7f37c53bf640 1 -- 172.21.15.66:0/2209620077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 msgr2=0x55eb9e7d9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.624+0000 7f37c53bf640 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7d9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.624+0000 7f37c53bf640 1 -- 172.21.15.66:0/2209620077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7d9780 msgr2=0x55eb9e7d9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.624+0000 7f37c53bf640 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7d9780 0x55eb9e7d9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.624+0000 7f37c53bf640 1 -- 172.21.15.66:0/2209620077 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9e6cb3a0 con 0x55eb9e7e4520 2024-09-15T23:04:20.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.630+0000 7f37c53bf640 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 0x55eb9e7e6910 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f37b80eea20 tx=0x7f37b80bd0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a3aee94dd264df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.632+0000 7f37b6ffd640 1 -- 172.21.15.66:0/2209620077 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b80d6070 con 0x55eb9e7e4520 2024-09-15T23:04:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.632+0000 7f37b6ffd640 1 -- 172.21.15.66:0/2209620077 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37b80bdcb0 con 0x55eb9e7e4520 2024-09-15T23:04:20.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 -- 172.21.15.66:0/2209620077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 msgr2=0x55eb9e7e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 0x55eb9e7e6910 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f37b80eea20 tx=0x7f37b80bd0f0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 -- 172.21.15.66:0/2209620077 shutdown_connections 2024-09-15T23:04:20.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7e4520 0x55eb9e7e6910 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7d9780 0x55eb9e7d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2209620077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.633+0000 7f37c91fb740 1 -- 172.21.15.66:0/2209620077 >> 172.21.15.66:0/2209620077 conn(0x55eb9e7a2310 msgr2=0x55eb9e7d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.636+0000 7f37c91fb740 1 -- 172.21.15.66:0/2209620077 shutdown_connections 2024-09-15T23:04:20.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.636+0000 7f37c91fb740 1 -- 172.21.15.66:0/2209620077 wait complete. 2024-09-15T23:04:20.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.636+0000 7f37c91fb740 1 -- start start 2024-09-15T23:04:20.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.636+0000 7f37c91fb740 1 Processor -- start 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e7e6fe0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e6fa060 con 0x55eb9e7e3e50 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55eb9e7e7160 con 0x55eb9e7d9780 2024-09-15T23:04:20.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.637+0000 7f37c91fb740 10 client.0 _ll_register_callbacks cb 0x55eb9e44d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:20.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.643+0000 7f37c53bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.643+0000 7f37c53bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49866/0 (socket says 172.21.15.66:49866) 2024-09-15T23:04:20.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.643+0000 7f37c53bf640 1 -- 172.21.15.66:0/4028935523 learned_addr learned my addr 172.21.15.66:0/4028935523 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:20.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.643+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.643+0000 7f37bffff640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.644+0000 7f37c4bbe640 1 -- 172.21.15.66:0/4028935523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 msgr2=0x55eb9e7e42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.644+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.645+0000 7f37c4bbe640 1 -- 172.21.15.66:0/4028935523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7dacf0 msgr2=0x55eb9e7e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.645+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.645+0000 7f37c4bbe640 1 -- 172.21.15.66:0/4028935523 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9e4b03c0 con 0x55eb9e7d9780 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.646+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e6660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37b00098e0 tx=0x7f37b0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d73512065db7188 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.647+0000 7f379ffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.647+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b000f810 con 0x55eb9e7d9780 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.647+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f37b000f9b0 con 0x55eb9e7d9780 2024-09-15T23:04:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.647+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb9e74c860 con 0x55eb9e7d9780 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.649+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f37b000fbb0 con 0x55eb9e7d9780 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.649+0000 7f37c91fb740 10 client.28285 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.649+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55eb9e7f2db0 con 0x55eb9e7d9780 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.651+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55eb9e74c860 con 0x55eb9e7d9780 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f37b00304b0 con 0x55eb9e7d9780 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 10 client.28285 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 10 client.28285 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:04:20.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 20 client.28285 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:20.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e7f4630 0x55eb9e7f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 4 client.28285 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:20.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.652+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb9e746d70 con 0x55eb9e7f4630 2024-09-15T23:04:20.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.656+0000 7f37bffff640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e7f4630 0x55eb9e7f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.657+0000 7f37bffff640 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e7f4630 0x55eb9e7f6af0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=524c4e1a56077e2d server_cookie=39410728d376cae1 in_seq=0 out_seq=0 2024-09-15T23:04:20.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.657+0000 7f379ffff640 10 client.28285 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:20.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.657+0000 7f379ffff640 1 -- 172.21.15.66:0/4028935523 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb9e746d70 con 0x55eb9e7f4630 2024-09-15T23:04:20.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.657+0000 7f379ffff640 10 client.28285 handle_command_reply: tid=0 2024-09-15T23:04:20.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.658+0000 7f37c91fb740 1 client.28285 shutdown 2024-09-15T23:04:20.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.665+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 msgr2=0x55eb9e7e6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.665+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e6660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37b00098e0 tx=0x7f37b0004ab0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 shutdown_connections 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e7f4630 0x55eb9e7f6af0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4028935523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e6660 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f379ffff640 0 client.28285 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 >> 172.21.15.66:0/4028935523 conn(0x55eb9e7a2310 msgr2=0x55eb9e7dbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.666+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 shutdown_connections 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.667+0000 7f37c91fb740 1 -- 172.21.15.66:0/4028935523 wait complete. 2024-09-15T23:04:20.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.667+0000 7f37c91fb740 20 client.28285 trim_cache size 0 max 16384 2024-09-15T23:04:20.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.696+0000 7f37c91fb740 1 Processor -- start 2024-09-15T23:04:20.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.696+0000 7f37c91fb740 1 -- start start 2024-09-15T23:04:20.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7debe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7fc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0010420 con 0x55eb9e7d9780 2024-09-15T23:04:20.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f37a00121d0 con 0x55eb9e7e3e50 2024-09-15T23:04:20.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c91fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0010b80 con 0x55eb9e7dacf0 2024-09-15T23:04:20.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37bffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37bffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:54416/0 (socket says 172.21.15.66:54416) 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37bffff640 1 -- 172.21.15.66:0/4015245852 learned_addr learned my addr 172.21.15.66:0/4015245852 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c53bf640 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7fc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.697+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7debe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.698+0000 7f37bffff640 1 -- 172.21.15.66:0/4015245852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 msgr2=0x55eb9e7fc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.698+0000 7f37bffff640 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7fc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.698+0000 7f37bffff640 1 -- 172.21.15.66:0/4015245852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 msgr2=0x55eb9e7debe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.698+0000 7f37bffff640 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7debe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.698+0000 7f37bffff640 1 -- 172.21.15.66:0/4015245852 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9e7f7170 con 0x55eb9e7dacf0 2024-09-15T23:04:20.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.700+0000 7f37bffff640 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55eb9e7d6c70 tx=0x7f37a8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad16498470128af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.707+0000 7f37b67fc640 1 -- 172.21.15.66:0/4015245852 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8009dc0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.707+0000 7f37b67fc640 1 -- 172.21.15.66:0/4015245852 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37a8014110 con 0x55eb9e7dacf0 2024-09-15T23:04:20.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.707+0000 7f37b67fc640 1 -- 172.21.15.66:0/4015245852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8004a00 con 0x55eb9e7dacf0 2024-09-15T23:04:20.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.709+0000 7f37c91fb740 1 -- 172.21.15.66:0/4015245852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 msgr2=0x55eb9e7fc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.709+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55eb9e7d6c70 tx=0x7f37a8005f90 comp rx=0 tx=0).stop 2024-09-15T23:04:20.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.712+0000 7f37c91fb740 1 -- 172.21.15.66:0/4015245852 shutdown_connections 2024-09-15T23:04:20.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.712+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.712+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7fc400 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.712+0000 7f37c91fb740 1 --2- 172.21.15.66:0/4015245852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7debe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.712+0000 7f37c91fb740 1 -- 172.21.15.66:0/4015245852 >> 172.21.15.66:0/4015245852 conn(0x55eb9e7a2310 msgr2=0x55eb9e7de4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.713+0000 7f37c91fb740 1 -- 172.21.15.66:0/4015245852 shutdown_connections 2024-09-15T23:04:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.713+0000 7f37c91fb740 1 -- 172.21.15.66:0/4015245852 wait complete. 2024-09-15T23:04:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.714+0000 7f37c91fb740 1 -- start start 2024-09-15T23:04:20.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.714+0000 7f37c91fb740 1 Processor -- start 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.715+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.715+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.715+0000 7f37c91fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.715+0000 7f37c91fb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0011a40 con 0x55eb9e7d9780 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37c91fb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f37a00112b0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37c91fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37a000e420 con 0x55eb9e7e3e50 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37c53bf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:49884/0 (socket says 172.21.15.66:49884) 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37bffff640 1 -- 172.21.15.66:0/2965829877 learned_addr learned my addr 172.21.15.66:0/2965829877 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37c91fb740 10 client.0 _ll_register_callbacks cb 0x7f37b0014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37bffff640 1 -- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7e3e50 msgr2=0x55eb9e7e8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.716+0000 7f37bffff640 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f37bffff640 1 -- 172.21.15.66:0/2965829877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 msgr2=0x55eb9e7e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f37bffff640 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f37bffff640 1 -- 172.21.15.66:0/2965829877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9e7d56c0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37a8014110 con 0x55eb9e7dacf0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f37bffff640 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f37a8005480 tx=0x7f37a80054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570db6d8ae89459f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f379ffff640 10 client.28379 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.717+0000 7f379ffff640 1 -- 172.21.15.66:0/2965829877 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8004030 con 0x55eb9e7dacf0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.718+0000 7f379ffff640 1 -- 172.21.15.66:0/2965829877 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f37a80041d0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.718+0000 7f379ffff640 1 -- 172.21.15.66:0/2965829877 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f37a8004450 con 0x55eb9e7dacf0 2024-09-15T23:04:20.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.721+0000 7f37c91fb740 10 client.28379 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:20.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.721+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({fsmap=71}) -- 0x55eb9e7f2be0 con 0x55eb9e7dacf0 2024-09-15T23:04:20.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.727+0000 7f379ffff640 1 -- 172.21.15.66:0/2965829877 <== mon.2 v2:172.21.15.87:3300/0 4 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f37a802d030 con 0x55eb9e7dacf0 2024-09-15T23:04:20.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 10 client.28379 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:20.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 10 client.28379 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:04:20.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 20 client.28379 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:20.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e85f7f0 0x55eb9e861c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:20.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 4 client.28379 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:20.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.728+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f37a8014110 con 0x55eb9e85f7f0 2024-09-15T23:04:20.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.729+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e85f7f0 0x55eb9e861c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:20.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.736+0000 7f37c4bbe640 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e85f7f0 0x55eb9e861c10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cce16e3a1494ed69 server_cookie=3383842330a4e08 in_seq=0 out_seq=0 2024-09-15T23:04:20.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.736+0000 7f379ffff640 10 client.28379 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:20.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.740+0000 7f379ffff640 1 -- 172.21.15.66:0/2965829877 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f37a8014110 con 0x55eb9e85f7f0 2024-09-15T23:04:20.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.740+0000 7f379ffff640 10 client.28379 handle_command_reply: tid=0 2024-09-15T23:04:20.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.741+0000 7f37c91fb740 1 client.28379 shutdown 2024-09-15T23:04:20.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.744+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 msgr2=0x55eb9e7e8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.744+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f37a8005480 tx=0x7f37a80054b0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 shutdown_connections 2024-09-15T23:04:20.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x55eb9e85f7f0 0x55eb9e861c10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f379ffff640 0 client.28379 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:20.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55eb9e7e3e50 0x55eb9e7e8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eb9e7dacf0 0x55eb9e7e8740 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 --2- 172.21.15.66:0/2965829877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eb9e7d9780 0x55eb9e7e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.747+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 >> 172.21.15.66:0/2965829877 conn(0x55eb9e7a2310 msgr2=0x55eb9e7d4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.748+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 shutdown_connections 2024-09-15T23:04:20.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.748+0000 7f37c91fb740 1 -- 172.21.15.66:0/2965829877 wait complete. 2024-09-15T23:04:20.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.748+0000 7f37c91fb740 20 client.28379 trim_cache size 0 max 16384 2024-09-15T23:04:20.751 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 msgr2=0x7f37ac0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 0x7f37ac0a5a00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005fd0 tx=0x7f37b0009500 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 msgr2=0x7f37c010b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f37b802aa00 tx=0x7f37b8003b90 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 shutdown_connections 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37ac0a3540 0x7f37ac0a5a00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c0105d90 0x7f37c010b0b0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37c01012a0 0x7f37c0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 --2- 172.21.15.66:0/3006124075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c0100980 0x7f37c0106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:20.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.751+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 >> 172.21.15.66:0/3006124075 conn(0x7f37c00fc630 msgr2=0x7f37c00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:20.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.752+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 shutdown_connections 2024-09-15T23:04:20.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:20.752+0000 7f37c5bc0640 1 -- 172.21.15.66:0/3006124075 wait complete. 2024-09-15T23:04:21.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:21 smithi066 ceph-mon[31185]: pgmap v599: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 96 op/s 2024-09-15T23:04:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:21 smithi087 ceph-mon[35290]: pgmap v599: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 96 op/s 2024-09-15T23:04:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:21 smithi184 ceph-mon[35203]: pgmap v599: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 96 op/s 2024-09-15T23:04:21.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T23:04:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.115+0000 7f50bf2c1640 1 -- 172.21.15.66:0/1562580974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109450 msgr2=0x7f50b8110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:22.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.115+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/1562580974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109450 0x7f50b8110250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009860 tx=0x7f50b402a340 comp rx=0 tx=0).stop 2024-09-15T23:04:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.117+0000 7f50bf2c1640 1 -- 172.21.15.66:0/1562580974 shutdown_connections 2024-09-15T23:04:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.117+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/1562580974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b811b140 0x7f50b811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.117+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/1562580974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b8109830 0x7f50b8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.117+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/1562580974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109450 0x7f50b8110250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.117+0000 7f50bf2c1640 1 -- 172.21.15.66:0/1562580974 >> 172.21.15.66:0/1562580974 conn(0x7f50b806e140 msgr2=0x7f50b806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.123+0000 7f50bf2c1640 1 -- 172.21.15.66:0/1562580974 shutdown_connections 2024-09-15T23:04:22.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.124+0000 7f50bf2c1640 1 -- 172.21.15.66:0/1562580974 wait complete. 2024-09-15T23:04:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.124+0000 7f50bf2c1640 1 Processor -- start 2024-09-15T23:04:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 -- start start 2024-09-15T23:04:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b8109450 0x7f50b811a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 0x7f50b8113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:22.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8120df0 con 0x7f50b811b140 2024-09-15T23:04:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8120c70 con 0x7f50b8109450 2024-09-15T23:04:22.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.125+0000 7f50bf2c1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8120f70 con 0x7f50b8109830 2024-09-15T23:04:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.130+0000 7f50bd85e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.130+0000 7f50bd85e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34298/0 (socket says 172.21.15.66:34298) 2024-09-15T23:04:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.130+0000 7f50bd85e640 1 -- 172.21.15.66:0/103686691 learned_addr learned my addr 172.21.15.66:0/103686691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.131+0000 7f50bd05d640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b8109450 0x7f50b811a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:22.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.132+0000 7f50bc85c640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 0x7f50b8113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 -- 172.21.15.66:0/103686691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 msgr2=0x7f50b8113830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 0x7f50b8113830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 -- 172.21.15.66:0/103686691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b8109450 msgr2=0x7f50b811a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b8109450 0x7f50b811a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 -- 172.21.15.66:0/103686691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b81143b0 con 0x7f50b811b140 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.133+0000 7f50bd85e640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f50a800d720 tx=0x7f50a800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:22.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.137+0000 7f50bc85c640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 0x7f50b8113830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:04:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.139+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8017030 con 0x7f50b811b140 2024-09-15T23:04:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.139+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b81182d0 con 0x7f50b811b140 2024-09-15T23:04:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.139+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b8118810 con 0x7f50b811b140 2024-09-15T23:04:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.139+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a800de30 con 0x7f50b811b140 2024-09-15T23:04:22.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.139+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8017030 con 0x7f50b811b140 2024-09-15T23:04:22.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.143+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f50a801a070 con 0x7f50b811b140 2024-09-15T23:04:22.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.144+0000 7f50ae7fc640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 0x7f50a40a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:22.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.145+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b8073b00 con 0x7f50b811b140 2024-09-15T23:04:22.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.145+0000 7f50bd05d640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 0x7f50a40a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:22.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.145+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f50a8018070 con 0x7f50b811b140 2024-09-15T23:04:22.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.155+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50a809bbd0 con 0x7f50b811b140 2024-09-15T23:04:22.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.155+0000 7f50bd05d640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 0x7f50a40a5cb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50b402a930 tx=0x7f50b402a840 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:22.405 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:22.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:04:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:04:22.133+0000 7f856dc2f640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-15T23:04:22.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.577+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50b8114d60 con 0x7f50b811b140 2024-09-15T23:04:22.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.579+0000 7f50ae7fc640 1 -- 172.21.15.66:0/103686691 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11996 (secure 0 0 0) 0x7f50a8014090 con 0x7f50b811b140 2024-09-15T23:04:22.581 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:04:22.582 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":71,"btime":"2024-09-15T23:04:03:227100+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:02.686781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24421,24427,24437,24442,24461]},"id":1}]} 2024-09-15T23:04:22.582 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 71 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 msgr2=0x7f50a40a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 0x7f50a40a5cb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50b402a930 tx=0x7f50b402a840 comp rx=0 tx=0).stop 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 msgr2=0x7f50b8113d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f50a800d720 tx=0x7f50a800dbe0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 shutdown_connections 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f50a40a37f0 0x7f50a40a5cb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50b811b140 0x7f50b8113d70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b8109830 0x7f50b8113830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 --2- 172.21.15.66:0/103686691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50b8109450 0x7f50b811a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:22.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 >> 172.21.15.66:0/103686691 conn(0x7f50b806e140 msgr2=0x7f50b8070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:22.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 shutdown_connections 2024-09-15T23:04:22.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:22.589+0000 7f50bf2c1640 1 -- 172.21.15.66:0/103686691 wait complete. 2024-09-15T23:04:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:23 smithi184 ceph-mon[35203]: pgmap v600: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 92 op/s 2024-09-15T23:04:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:23 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/103686691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:23.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:23 smithi066 ceph-mon[31185]: pgmap v600: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 92 op/s 2024-09-15T23:04:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:23 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/103686691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:23.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:23 smithi087 ceph-mon[35290]: pgmap v600: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 92 op/s 2024-09-15T23:04:23.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:23 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/103686691' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:24.392 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --set-id fa5b1b50 --release --await' 2024-09-15T23:04:24.393 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --set-id fa5b1b50 --release --await 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.012+0000 7fc2573c6640 1 -- 172.21.15.66:0/135069257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25011b140 msgr2=0x7fc25011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.012+0000 7fc2573c6640 1 --2- 172.21.15.66:0/135069257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25011b140 0x7fc25011d530 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc248009ca0 tx=0x7fc24802a8f0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 -- 172.21.15.66:0/135069257 shutdown_connections 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 --2- 172.21.15.66:0/135069257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc25011b140 0x7fc25011d530 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 --2- 172.21.15.66:0/135069257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc250109830 0x7fc250109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 --2- 172.21.15.66:0/135069257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109450 0x7fc250110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 -- 172.21.15.66:0/135069257 >> 172.21.15.66:0/135069257 conn(0x7fc25006e140 msgr2=0x7fc25006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 -- 172.21.15.66:0/135069257 shutdown_connections 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.017+0000 7fc2573c6640 1 -- 172.21.15.66:0/135069257 wait complete. 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.018+0000 7fc2573c6640 1 Processor -- start 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.023+0000 7fc2573c6640 1 -- start start 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc250109450 0x7fc2501a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25011b140 0x7fc2501abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc250120da0 con 0x7fc250109450 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc250120c20 con 0x7fc250109830 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.026+0000 7fc2573c6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc250120f20 con 0x7fc25011b140 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.028+0000 7fc254961640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.028+0000 7fc254961640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46420/0 (socket says 172.21.15.66:46420) 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.028+0000 7fc254961640 1 -- 172.21.15.66:0/3400608926 learned_addr learned my addr 172.21.15.66:0/3400608926 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.028+0000 7fc254961640 1 -- 172.21.15.66:0/3400608926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25011b140 msgr2=0x7fc2501abb30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc254961640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25011b140 0x7fc2501abb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc254961640 1 -- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc250109450 msgr2=0x7fc2501a7260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc254961640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc250109450 0x7fc2501a7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc254961640 1 -- 172.21.15.66:0/3400608926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2501ac210 con 0x7fc250109830 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc254961640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d950 tx=0x7fc24000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc2467fc640 1 -- 172.21.15.66:0/3400608926 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240017070 con 0x7fc250109830 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.029+0000 7fc2467fc640 1 -- 172.21.15.66:0/3400608926 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc240009c30 con 0x7fc250109830 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.030+0000 7fc2467fc640 1 -- 172.21.15.66:0/3400608926 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f6b0 con 0x7fc250109830 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.031+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2501ac500 con 0x7fc250109830 2024-09-15T23:04:24.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.031+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2501b3de0 con 0x7fc250109830 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.034+0000 7fc25979f740 1 Processor -- start 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.036+0000 7fc2467fc640 1 -- 172.21.15.66:0/3400608926 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc240005020 con 0x7fc250109830 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.038+0000 7fc2467fc640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 0x7fc23c0a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.038+0000 7fc2467fc640 1 -- 172.21.15.66:0/3400608926 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fc2400cf4f0 con 0x7fc250109830 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.039+0000 7fc25979f740 1 -- start start 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.039+0000 7fc25979f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.039+0000 7fc25979f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.039+0000 7fc25979f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc255162640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc255162640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52278/0 (socket says 172.21.15.66:52278) 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc255963640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 0x7fc23c0a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc25979f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c0fb0112f0 con 0x55c0fb0ab5d0 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc255162640 1 -- 172.21.15.66:0/1366674738 learned_addr learned my addr 172.21.15.66:0/1366674738 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c0fafb8cf0 con 0x55c0fb0b6370 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.040+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c0fb00d2b0 con 0x55c0fb0acb40 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.041+0000 7fc255963640 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.043+0000 7fc254961640 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.044+0000 7fc255963640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 0x7fc23c0a58a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc248004af0 tx=0x7fc248009800 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.045+0000 7fc255162640 1 -- 172.21.15.66:0/1366674738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 msgr2=0x55c0fb0b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.045+0000 7fc255162640 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.045+0000 7fc255162640 1 -- 172.21.15.66:0/1366674738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 msgr2=0x55c0fb0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:24.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.045+0000 7fc255162640 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.045+0000 7fc255162640 1 -- 172.21.15.66:0/1366674738 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0faf9d3a0 con 0x55c0fb0acb40 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.046+0000 7fc255162640 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00ba80 tx=0x7fc24c00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543ebe5375891ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.047+0000 7fc23b7fe640 1 -- 172.21.15.66:0/1366674738 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c016070 con 0x55c0fb0acb40 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.047+0000 7fc23b7fe640 1 -- 172.21.15.66:0/1366674738 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c005500 con 0x55c0fb0acb40 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.048+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 msgr2=0x55c0fb0ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.048+0000 7fc25979f740 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00ba80 tx=0x7fc24c00be80 comp rx=0 tx=0).stop 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.051+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 shutdown_connections 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.051+0000 7fc25979f740 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.051+0000 7fc25979f740 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.051+0000 7fc25979f740 1 --2- 172.21.15.66:0/1366674738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0ab090 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.051+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 >> 172.21.15.66:0/1366674738 conn(0x55c0fb074310 msgr2=0x55c0fb0a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.056+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 shutdown_connections 2024-09-15T23:04:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.060+0000 7fc25979f740 1 -- 172.21.15.66:0/1366674738 wait complete. 2024-09-15T23:04:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.060+0000 7fc25979f740 1 -- start start 2024-09-15T23:04:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.061+0000 7fc25979f740 1 Processor -- start 2024-09-15T23:04:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c0fb0b90c0 con 0x55c0fb0ab5d0 2024-09-15T23:04:24.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55c0fafcc060 con 0x55c0fb0acb40 2024-09-15T23:04:24.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c0fb0b9240 con 0x55c0fb0b6370 2024-09-15T23:04:24.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.063+0000 7fc25979f740 10 client.0 _ll_register_callbacks cb 0x55c0fad1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.066+0000 7fc255963640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.066+0000 7fc255963640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52286/0 (socket says 172.21.15.66:52286) 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.066+0000 7fc255963640 1 -- 172.21.15.66:0/351818192 learned_addr learned my addr 172.21.15.66:0/351818192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.066+0000 7fc255162640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.070+0000 7fc255963640 1 -- 172.21.15.66:0/351818192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 msgr2=0x55c0fb0b2f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.070+0000 7fc255963640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0b2f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.070+0000 7fc255963640 1 -- 172.21.15.66:0/351818192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 msgr2=0x55c0fb0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.070+0000 7fc255963640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.070+0000 7fc255963640 1 -- 172.21.15.66:0/351818192 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fad823c0 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.074+0000 7fc255963640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc24802f520 tx=0x7fc2480095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c43c22737f16919 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.074+0000 7fc238ff9640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.078+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248031680 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.078+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fc248031820 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.079+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc24c005500 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.082+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc248030ec0 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.091+0000 7fc25979f740 10 client.28306 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.091+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55c0fb0c4b10 con 0x55c0fb0b6370 2024-09-15T23:04:24.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.093+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c005500 con 0x55c0fb0b6370 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.093+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7fc24802f8e0 con 0x55c0fb0b6370 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 10 client.28306 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 10 client.28306 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 20 client.28306 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb0c5fd0 0x55c0fb0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 4 client.28306 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:24.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0fb01e860 con 0x55c0fb0c5fd0 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.095+0000 7fc255162640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb0c5fd0 0x55c0fb0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.096+0000 7fc255162640 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb0c5fd0 0x55c0fb0c83e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2fd73aaff73fbb3f server_cookie=2c2c195b55b9d78f in_seq=0 out_seq=0 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.098+0000 7fc238ff9640 10 client.28306 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.100+0000 7fc238ff9640 1 -- 172.21.15.66:0/351818192 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0fb01e860 con 0x55c0fb0c5fd0 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.100+0000 7fc238ff9640 10 client.28306 handle_command_reply: tid=0 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 client.28306 shutdown 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 msgr2=0x55c0fb0b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc24802f520 tx=0x7fc2480095c0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 shutdown_connections 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb0c5fd0 0x55c0fb0c83e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b3440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 --2- 172.21.15.66:0/351818192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.101+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 >> 172.21.15.66:0/351818192 conn(0x55c0fb074310 msgr2=0x55c0fb0ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.104+0000 7fc238ff9640 0 client.28306 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.106+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 shutdown_connections 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.106+0000 7fc25979f740 1 -- 172.21.15.66:0/351818192 wait complete. 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.106+0000 7fc25979f740 20 client.28306 trim_cache size 0 max 16384 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.131+0000 7fc25979f740 1 Processor -- start 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 -- start start 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501be100 con 0x55c0fb0b6370 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501bfeb0 con 0x55c0fb0acb40 2024-09-15T23:04:24.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.132+0000 7fc25979f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501be860 con 0x55c0fb0ab5d0 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43234/0 (socket says 172.21.15.66:43234) 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 -- 172.21.15.66:0/3348674228 learned_addr learned my addr 172.21.15.66:0/3348674228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 -- 172.21.15.66:0/3348674228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0ab5d0 msgr2=0x55c0fb0c23b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0c23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 -- 172.21.15.66:0/3348674228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 msgr2=0x55c0fb0c7fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.133+0000 7fc255963640 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0c7fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.134+0000 7fc255963640 1 -- 172.21.15.66:0/3348674228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fb0a8960 con 0x55c0fb0b6370 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.134+0000 7fc255963640 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc24802fea0 tx=0x7fc24802ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ef8203dec612ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.142+0000 7fc23affd640 1 -- 172.21.15.66:0/3348674228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248030ec0 con 0x55c0fb0b6370 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.142+0000 7fc23affd640 1 -- 172.21.15.66:0/3348674228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248036050 con 0x55c0fb0b6370 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.142+0000 7fc23affd640 1 -- 172.21.15.66:0/3348674228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480044c0 con 0x55c0fb0b6370 2024-09-15T23:04:24.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.143+0000 7fc25979f740 1 -- 172.21.15.66:0/3348674228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 msgr2=0x55c0fb0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.143+0000 7fc25979f740 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc24802fea0 tx=0x7fc24802ffd0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.144+0000 7fc25979f740 1 -- 172.21.15.66:0/3348674228 shutdown_connections 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.144+0000 7fc25979f740 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0b6370 0x55c0fb0b7760 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.144+0000 7fc25979f740 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0acb40 0x55c0fb0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.144+0000 7fc25979f740 1 --2- 172.21.15.66:0/3348674228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.144+0000 7fc25979f740 1 -- 172.21.15.66:0/3348674228 >> 172.21.15.66:0/3348674228 conn(0x55c0fb074310 msgr2=0x55c0fb0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.152+0000 7fc25979f740 1 -- 172.21.15.66:0/3348674228 shutdown_connections 2024-09-15T23:04:24.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.152+0000 7fc25979f740 1 -- 172.21.15.66:0/3348674228 wait complete. 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.153+0000 7fc25979f740 1 -- start start 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.153+0000 7fc25979f740 1 Processor -- start 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.153+0000 7fc25979f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc255162640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc255162640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43248/0 (socket says 172.21.15.66:43248) 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc255162640 1 -- 172.21.15.66:0/4094994257 learned_addr learned my addr 172.21.15.66:0/4094994257 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501bf720 con 0x55c0fb0ab5d0 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501bef90 con 0x55c0fb0b6370 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501bc100 con 0x55c0fb0acb40 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc25979f740 10 client.0 _ll_register_callbacks cb 0x7fc250110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.154+0000 7fc255963640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.156+0000 7fc254961640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.161+0000 7fc255963640 1 -- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 msgr2=0x55c0fb0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.161+0000 7fc255963640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.161+0000 7fc255963640 1 -- 172.21.15.66:0/4094994257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 msgr2=0x55c0fb0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.161+0000 7fc255963640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.161+0000 7fc255963640 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0fb0bc970 con 0x55c0fb0b6370 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.164+0000 7fc255963640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0ce220 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc24802fd30 tx=0x7fc248004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1870697216742bac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.164+0000 7fc238ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.168+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24802f840 con 0x55c0fb0b6370 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.169+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc248036050 con 0x55c0fb0b6370 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.169+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fc24802f9e0 con 0x55c0fb0b6370 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.173+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc248004b40 con 0x55c0fb0b6370 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.174+0000 7fc25979f740 10 client.28394 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:24.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.174+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55c0fb130e90 con 0x55c0fb0b6370 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.177+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248036050 con 0x55c0fb0b6370 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.177+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7fc248066470 con 0x55c0fb0b6370 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 10 client.28394 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 10 client.28394 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 20 client.28394 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb1314a0 0x55c0fb133890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 4 client.28394 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.178+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0fb018d70 con 0x55c0fb1314a0 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.179+0000 7fc255162640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb1314a0 0x55c0fb133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.180+0000 7fc255162640 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb1314a0 0x55c0fb133890 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f6baad52d8c0ab1 server_cookie=44eb9b1dfc7c7df7 in_seq=0 out_seq=0 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.180+0000 7fc238ff9640 10 client.28394 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.180+0000 7fc238ff9640 1 -- 172.21.15.66:0/4094994257 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0fb018d70 con 0x55c0fb1314a0 2024-09-15T23:04:24.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.180+0000 7fc238ff9640 10 client.28394 handle_command_reply: tid=0 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.185+0000 7fc25979f740 1 client.28394 shutdown 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.188+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 msgr2=0x55c0fb0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.188+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0ce220 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc24802fd30 tx=0x7fc248004a40 comp rx=0 tx=0).stop 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 shutdown_connections 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55c0fb1314a0 0x55c0fb133890 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0fb0b6370 0x55c0fb0ce220 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0fb0acb40 0x55c0fb0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 --2- 172.21.15.66:0/4094994257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c0fb0ab5d0 0x55c0fb0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc238ff9640 0 client.28394 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.191+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 >> 172.21.15.66:0/4094994257 conn(0x55c0fb074310 msgr2=0x55c0fb0b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.192+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 shutdown_connections 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.194+0000 7fc25979f740 1 -- 172.21.15.66:0/4094994257 wait complete. 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.195+0000 7fc25979f740 20 client.28394 trim_cache size 0 max 16384 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.195+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 msgr2=0x7fc23c0a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.195+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 0x7fc23c0a58a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc248004af0 tx=0x7fc248009800 comp rx=0 tx=0).stop 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.195+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 msgr2=0x7fc2501a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:24.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.195+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc24000d950 tx=0x7fc24000de10 comp rx=0 tx=0).stop 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 shutdown_connections 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc23c0a33e0 0x7fc23c0a58a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25011b140 0x7fc2501abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc250109830 0x7fc2501a77a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 --2- 172.21.15.66:0/3400608926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc250109450 0x7fc2501a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 >> 172.21.15.66:0/3400608926 conn(0x7fc25006e140 msgr2=0x7fc25011bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 shutdown_connections 2024-09-15T23:04:24.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:24.196+0000 7fc2573c6640 1 -- 172.21.15.66:0/3400608926 wait complete. 2024-09-15T23:04:25.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T23:04:25.424 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:25.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:25 smithi066 ceph-mon[31185]: pgmap v601: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 90 op/s 2024-09-15T23:04:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:25 smithi184 ceph-mon[35203]: pgmap v601: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 90 op/s 2024-09-15T23:04:25.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:25 smithi087 ceph-mon[35290]: pgmap v601: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 90 op/s 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 71, 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 68, 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": { 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "fa5b1b50": { 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "version": 68, 2024-09-15T23:04:27.119 INFO:teuthology.orchestra.run.smithi066.stdout: "age_ref": 0.0, 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "timeout": 90.0, 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "expiration": 142.9, 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "members": { 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "file:/": { 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "excluded": false, 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "state": { 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RELEASED", 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: "age": 0.0 2024-09-15T23:04:27.120 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:27.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.134+0000 7f98b2cce640 1 -- 172.21.15.66:0/2570975964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 msgr2=0x7f98ac0742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.134+0000 7f98b2cce640 1 --2- 172.21.15.66:0/2570975964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0742d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f989c009860 tx=0x7f989c02a340 comp rx=0 tx=0).stop 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 -- 172.21.15.66:0/2570975964 shutdown_connections 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 --2- 172.21.15.66:0/2570975964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98ac074990 0x7f98ac07b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 --2- 172.21.15.66:0/2570975964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0742d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 --2- 172.21.15.66:0/2570975964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 -- 172.21.15.66:0/2570975964 >> 172.21.15.66:0/2570975964 conn(0x7f98ac06e140 msgr2=0x7f98ac06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 -- 172.21.15.66:0/2570975964 shutdown_connections 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.135+0000 7f98b2cce640 1 -- 172.21.15.66:0/2570975964 wait complete. 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.136+0000 7f98b2cce640 1 Processor -- start 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 -- start start 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98ac074990 0x7f98ac07b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0767d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac07e730 con 0x7f98ac074990 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac07e5b0 con 0x7f98ac109e00 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.138+0000 7f98b2cce640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac07e8b0 con 0x7f98ac109450 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.140+0000 7f98b126b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.141+0000 7f98abfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.141+0000 7f98abfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac076290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52304/0 (socket says 172.21.15.66:52304) 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.141+0000 7f98abfff640 1 -- 172.21.15.66:0/2362820896 learned_addr learned my addr 172.21.15.66:0/2362820896 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.144+0000 7f98b126b640 1 -- 172.21.15.66:0/2362820896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 msgr2=0x7f98ac076290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.144+0000 7f98b126b640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac076290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.144+0000 7f98b126b640 1 -- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98ac074990 msgr2=0x7f98ac07b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.144+0000 7f98b126b640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98ac074990 0x7f98ac07b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.144+0000 7f98b126b640 1 -- 172.21.15.66:0/2362820896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac076e10 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.145+0000 7f98b126b640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0767d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98a000d680 tx=0x7f98a000db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.146+0000 7f98a9ffb640 1 -- 172.21.15.66:0/2362820896 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0017070 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.146+0000 7f98a9ffb640 1 -- 172.21.15.66:0/2362820896 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a0009820 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.146+0000 7f98a9ffb640 1 -- 172.21.15.66:0/2362820896 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0004e00 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.146+0000 7f98b2cce640 1 -- 172.21.15.66:0/2362820896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac1bc1a0 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.146+0000 7f98b2cce640 1 -- 172.21.15.66:0/2362820896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac1bc660 con 0x7f98ac109e00 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.150+0000 7f98b50a7740 1 Processor -- start 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.150+0000 7f98b50a7740 1 -- start start 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1747670 0x5606f1747ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f17543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606f16ac620 con 0x5606f1748960 2024-09-15T23:04:27.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5606f1653e50 con 0x5606f1751fd0 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.151+0000 7f98b50a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5606f16a85e0 con 0x5606f1747670 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.152+0000 7f98abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f17543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.152+0000 7f98abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.153+0000 7f98abfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43264/0 (socket says 172.21.15.66:43264) 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.153+0000 7f98abfff640 1 -- 172.21.15.66:0/1612480226 learned_addr learned my addr 172.21.15.66:0/1612480226 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.153+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1747670 0x5606f1747ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.156+0000 7f98abfff640 1 -- 172.21.15.66:0/1612480226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1747670 msgr2=0x5606f1747ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.156+0000 7f98abfff640 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1747670 0x5606f1747ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.156+0000 7f98abfff640 1 -- 172.21.15.66:0/1612480226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 msgr2=0x5606f17543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.156+0000 7f98abfff640 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f17543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.156+0000 7f98abfff640 1 -- 172.21.15.66:0/1612480226 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f1644d40 con 0x5606f1748960 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.157+0000 7f98a9ffb640 1 -- 172.21.15.66:0/2362820896 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f98a00099d0 con 0x7f98ac109e00 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.158+0000 7f98a9ffb640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 0x7f98940a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.158+0000 7f98a9ffb640 1 -- 172.21.15.66:0/2362820896 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f98a0099c20 con 0x7f98ac109e00 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.158+0000 7f98abfff640 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f989c030750 tx=0x7f989c0306c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2a6ee8450785e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.159+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 0x7f98940a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.159+0000 7f98b2cce640 1 -- 172.21.15.66:0/1612480226 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c047070 con 0x5606f1748960 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.159+0000 7f98b2cce640 1 -- 172.21.15.66:0/1612480226 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f989c030d00 con 0x5606f1748960 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.159+0000 7f98b2cce640 1 -- 172.21.15.66:0/1612480226 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c037070 con 0x5606f1748960 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 -- 172.21.15.66:0/1612480226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 msgr2=0x5606f1747130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f989c030750 tx=0x7f989c0306c0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 0x7f98940a59c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5606f1744720 tx=0x7f98a400c040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 -- 172.21.15.66:0/1612480226 shutdown_connections 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f17543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1747670 0x5606f1747ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1612480226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1748960 0x5606f1747130 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.160+0000 7f98b50a7740 1 -- 172.21.15.66:0/1612480226 >> 172.21.15.66:0/1612480226 conn(0x5606f17438c0 msgr2=0x5606f1743ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.161+0000 7f98b50a7740 1 -- 172.21.15.66:0/1612480226 shutdown_connections 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.161+0000 7f98b50a7740 1 -- 172.21.15.66:0/1612480226 wait complete. 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.162+0000 7f98b50a7740 1 -- start start 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.162+0000 7f98b50a7740 1 Processor -- start 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 0x5606f174f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1751fd0 0x5606f174f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606f1765df0 con 0x5606f1747670 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5606f1634f10 con 0x5606f1748960 2024-09-15T23:04:27.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5606f1765f70 con 0x5606f1751fd0 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98b50a7740 10 client.0 _ll_register_callbacks cb 0x5606f1658db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.163+0000 7f98abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 0x5606f174f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.165+0000 7f98abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 0x5606f174f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46500/0 (socket says 172.21.15.66:46500) 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.165+0000 7f98abfff640 1 -- 172.21.15.66:0/405099921 learned_addr learned my addr 172.21.15.66:0/405099921 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.165+0000 7f98b126b640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1751fd0 0x5606f174f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.166+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.167+0000 7f98b0a6a640 1 -- 172.21.15.66:0/405099921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1751fd0 msgr2=0x5606f174f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.167+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1751fd0 0x5606f174f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.167+0000 7f98b0a6a640 1 -- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 msgr2=0x5606f174f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.167+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 0x5606f174f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.167+0000 7f98b0a6a640 1 -- 172.21.15.66:0/405099921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f13bb580 con 0x5606f1747670 2024-09-15T23:04:27.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.168+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174ef10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f98a400afd0 tx=0x7f98a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add0f2c6aaa4805c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.168+0000 7f988bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.168+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4019d90 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.169+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f989c030d00 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.169+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f98a4023420 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.169+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f98a4003970 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.169+0000 7f98b50a7740 10 client.19200 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.169+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5606f1485960 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f989c030d00 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f98a40227b0 con 0x5606f1747670 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 10 client.19200 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 10 client.19200 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 20 client.19200 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:27.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f1773320 0x5606f17757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 4 client.19200 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.171+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606f16b9b90 con 0x5606f1773320 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.175+0000 7f98abfff640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f1773320 0x5606f17757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.178+0000 7f988bfff640 10 client.19200 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.178+0000 7f98abfff640 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f1773320 0x5606f17757c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0e2e9a53f34809 server_cookie=69da0eb92e94f03 in_seq=0 out_seq=0 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.183+0000 7f988bfff640 1 -- 172.21.15.66:0/405099921 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606f16b9b90 con 0x5606f1773320 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.183+0000 7f988bfff640 10 client.19200 handle_command_reply: tid=0 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.183+0000 7f98b50a7740 1 client.19200 shutdown 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.185+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 msgr2=0x5606f174ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.185+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174ef10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f98a400afd0 tx=0x7f98a4004a40 comp rx=0 tx=0).stop 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 shutdown_connections 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1751fd0 0x5606f174f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f1773320 0x5606f17757c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1748960 0x5606f174f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 --2- 172.21.15.66:0/405099921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174ef10 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 >> 172.21.15.66:0/405099921 conn(0x5606f17438c0 msgr2=0x5606f1742b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.188+0000 7f988bfff640 0 client.19200 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.189+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 shutdown_connections 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.191+0000 7f98b50a7740 1 -- 172.21.15.66:0/405099921 wait complete. 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.192+0000 7f98b50a7740 20 client.19200 trim_cache size 0 max 16384 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.226+0000 7f98b50a7740 1 Processor -- start 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.226+0000 7f98b50a7740 1 -- start start 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1747670 0x5606f174a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f1750e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 0x5606f177b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c6bb0 con 0x5606f1751fd0 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c8960 con 0x5606f1747670 2024-09-15T23:04:27.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b50a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c7310 con 0x5606f1748960 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98abfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f1750e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98abfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f1750e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52314/0 (socket says 172.21.15.66:52314) 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98abfff640 1 -- 172.21.15.66:0/1754873964 learned_addr learned my addr 172.21.15.66:0/1754873964 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1747670 0x5606f174a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.227+0000 7f98b126b640 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 0x5606f177b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 -- 172.21.15.66:0/1754873964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 msgr2=0x5606f1750e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f1750e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 -- 172.21.15.66:0/1754873964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1747670 msgr2=0x5606f174a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1747670 0x5606f174a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 -- 172.21.15.66:0/1754873964 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f1765f60 con 0x5606f1751fd0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.228+0000 7f98b126b640 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 0x5606f177b0d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f98a00ccf70 tx=0x7f98a00a1050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48daac85f57fc210 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.229+0000 7f98927fc640 1 -- 172.21.15.66:0/1754873964 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00985b0 con 0x5606f1751fd0 2024-09-15T23:04:27.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.229+0000 7f98927fc640 1 -- 172.21.15.66:0/1754873964 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a0012e50 con 0x5606f1751fd0 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.230+0000 7f98927fc640 1 -- 172.21.15.66:0/1754873964 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0098750 con 0x5606f1751fd0 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.230+0000 7f98b50a7740 1 -- 172.21.15.66:0/1754873964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 msgr2=0x5606f177b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.231+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 0x5606f177b0d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f98a00ccf70 tx=0x7f98a00a1050 comp rx=0 tx=0).stop 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 -- 172.21.15.66:0/1754873964 shutdown_connections 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1751fd0 0x5606f177b0d0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f1750e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 --2- 172.21.15.66:0/1754873964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1747670 0x5606f174a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 -- 172.21.15.66:0/1754873964 >> 172.21.15.66:0/1754873964 conn(0x5606f17438c0 msgr2=0x5606f1750770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.233+0000 7f98b50a7740 1 -- 172.21.15.66:0/1754873964 shutdown_connections 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.234+0000 7f98b50a7740 1 -- 172.21.15.66:0/1754873964 wait complete. 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.234+0000 7f98b50a7740 1 -- start start 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.234+0000 7f98b50a7740 1 Processor -- start 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f174c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f174c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c81d0 con 0x5606f1747670 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c7a40 con 0x5606f1751fd0 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac1c4bb0 con 0x5606f1748960 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b50a7740 10 client.0 _ll_register_callbacks cb 0x7f98a401b650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b0a6a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b0a6a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43296/0 (socket says 172.21.15.66:43296) 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98b0a6a640 1 -- 172.21.15.66:0/3534361466 learned_addr learned my addr 172.21.15.66:0/3534361466 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.235+0000 7f98abfff640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f174c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b126b640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f174c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 -- 172.21.15.66:0/3534361466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 msgr2=0x5606f174c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f174c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 -- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 msgr2=0x5606f174c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:27.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f174c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 -- 172.21.15.66:0/3534361466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f17dd0a0 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f98b0a6a640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c010 tx=0x7f98a4022600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c8104b162cc85a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.236+0000 7f988bfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.237+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4038070 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.237+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f98a40175a0 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.237+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a0012e50 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.238+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f98a40173a0 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.238+0000 7f98b50a7740 10 client.19206 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.238+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5606f17de320 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.239+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a0012e50 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.240+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f98a40324e0 con 0x5606f1747670 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 10 client.19206 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:27.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 10 client.19206 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 20 client.19206 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f17deb30 0x5606f17e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 4 client.19206 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fa5b1b50", "release": true, "await": true}] 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fa5b1b50", "release": true, "await": true}) -- 0x5606f16b40a0 con 0x5606f17deb30 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.242+0000 7f98abfff640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f17deb30 0x5606f17e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.246+0000 7f98abfff640 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f17deb30 0x5606f17e0f50 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579adb0010d5ae75 server_cookie=b84eeb8da95c8b4b in_seq=0 out_seq=0 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.246+0000 7f988bfff640 10 client.19206 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f988bfff640 1 -- 172.21.15.66:0/3534361466 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5606f16b40a0 con 0x5606f17deb30 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f988bfff640 10 client.19206 handle_command_reply: tid=0 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 client.19206 shutdown 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 msgr2=0x5606f174bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c010 tx=0x7f98a4022600 comp rx=0 tx=0).stop 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 shutdown_connections 2024-09-15T23:04:27.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5606f17deb30 0x5606f17e0f50 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5606f1751fd0 0x5606f174c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606f1748960 0x5606f174c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.436+0000 7f98b50a7740 1 --2- 172.21.15.66:0/3534361466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606f1747670 0x5606f174bea0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.437+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 >> 172.21.15.66:0/3534361466 conn(0x5606f17438c0 msgr2=0x5606f1748dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.437+0000 7f988bfff640 0 client.19206 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.437+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 shutdown_connections 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.437+0000 7f98b50a7740 1 -- 172.21.15.66:0/3534361466 wait complete. 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.437+0000 7f98b50a7740 20 client.19206 trim_cache size 0 max 16384 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 msgr2=0x7f98940a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 0x7f98940a59c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5606f1744720 tx=0x7f98a400c040 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 msgr2=0x7f98ac0767d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0767d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98a000d680 tx=0x7f98a000db40 comp rx=0 tx=0).stop 2024-09-15T23:04:27.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 shutdown_connections 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98940a3500 0x7f98940a59c0 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5606f1744720 tx=0x7f98a400c040 comp rx=0 tx=0).stop 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ac109e00 0x7f98ac0767d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98ac109450 0x7f98ac076290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 --2- 172.21.15.66:0/2362820896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98ac074990 0x7f98ac07b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.438+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 >> 172.21.15.66:0/2362820896 conn(0x7f98ac06e140 msgr2=0x7f98ac072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.439+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 shutdown_connections 2024-09-15T23:04:27.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:26.439+0000 7f98937fe640 1 -- 172.21.15.66:0/2362820896 wait complete. 2024-09-15T23:04:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:27 smithi184 ceph-mon[35203]: pgmap v602: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 89 op/s 2024-09-15T23:04:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:27 smithi066 ceph-mon[31185]: pgmap v602: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 89 op/s 2024-09-15T23:04:27.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:27 smithi087 ceph-mon[35290]: pgmap v602: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 89 op/s 2024-09-15T23:04:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:29 smithi184 ceph-mon[35203]: pgmap v603: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 85 op/s 2024-09-15T23:04:29.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:29 smithi066 ceph-mon[31185]: pgmap v603: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 85 op/s 2024-09-15T23:04:29.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:29 smithi087 ceph-mon[35290]: pgmap v603: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 85 op/s 2024-09-15T23:04:30.854 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:30.869 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fa5b1b50', total seconds elapsed: 34.2 2024-09-15T23:04:31.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:31 smithi066 ceph-mon[31185]: pgmap v604: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 86 op/s 2024-09-15T23:04:31.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.532+0000 7fe553dee640 1 -- 172.21.15.66:0/1692993437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109450 msgr2=0x7fe54c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.532+0000 7fe553dee640 1 --2- 172.21.15.66:0/1692993437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109450 0x7fe54c110250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe548009900 tx=0x7fe54802a440 comp rx=0 tx=0).stop 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 -- 172.21.15.66:0/1692993437 shutdown_connections 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 --2- 172.21.15.66:0/1692993437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 --2- 172.21.15.66:0/1692993437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109830 0x7fe54c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 --2- 172.21.15.66:0/1692993437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109450 0x7fe54c110250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 -- 172.21.15.66:0/1692993437 >> 172.21.15.66:0/1692993437 conn(0x7fe54c06e140 msgr2=0x7fe54c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.538+0000 7fe553dee640 1 -- 172.21.15.66:0/1692993437 shutdown_connections 2024-09-15T23:04:31.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.539+0000 7fe553dee640 1 -- 172.21.15.66:0/1692993437 wait complete. 2024-09-15T23:04:31.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.539+0000 7fe553dee640 1 Processor -- start 2024-09-15T23:04:31.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 -- start start 2024-09-15T23:04:31.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 0x7fe54c111780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c120e30 con 0x7fe54c11b140 2024-09-15T23:04:31.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c120cb0 con 0x7fe54c109450 2024-09-15T23:04:31.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.540+0000 7fe553dee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c120fb0 con 0x7fe54c109830 2024-09-15T23:04:31.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.541+0000 7fe551b8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.541+0000 7fe551b8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46524/0 (socket says 172.21.15.66:46524) 2024-09-15T23:04:31.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.541+0000 7fe551b8a640 1 -- 172.21.15.66:0/224158336 learned_addr learned my addr 172.21.15.66:0/224158336 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:31.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.542+0000 7fe55238b640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.542+0000 7fe551389640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 0x7fe54c111780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551b8a640 1 -- 172.21.15.66:0/224158336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 msgr2=0x7fe54c111780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551b8a640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 0x7fe54c111780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551b8a640 1 -- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 msgr2=0x7fe54c111cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551b8a640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c111cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551b8a640 1 -- 172.21.15.66:0/224158336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c112280 con 0x7fe54c109450 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe55238b640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:04:31.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.543+0000 7fe551389640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 0x7fe54c111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:04:31.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.546+0000 7fe551b8a640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe548009a20 tx=0x7fe548003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.551+0000 7fe542ffd640 1 -- 172.21.15.66:0/224158336 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54803f070 con 0x7fe54c109450 2024-09-15T23:04:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.551+0000 7fe542ffd640 1 -- 172.21.15.66:0/224158336 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe548031c90 con 0x7fe54c109450 2024-09-15T23:04:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.551+0000 7fe542ffd640 1 -- 172.21.15.66:0/224158336 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548035030 con 0x7fe54c109450 2024-09-15T23:04:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.551+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c112510 con 0x7fe54c109450 2024-09-15T23:04:31.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.551+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c116450 con 0x7fe54c109450 2024-09-15T23:04:31.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.557+0000 7fe542ffd640 1 -- 172.21.15.66:0/224158336 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe548042070 con 0x7fe54c109450 2024-09-15T23:04:31.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.558+0000 7fe5561c7740 1 Processor -- start 2024-09-15T23:04:31.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.558+0000 7fe5561c7740 1 -- start start 2024-09-15T23:04:31.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.559+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.559+0000 7fe542ffd640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 0x7fe5380a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe542ffd640 1 -- 172.21.15.66:0/224158336 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fe5480f09e0 con 0x7fe54c109450 2024-09-15T23:04:31.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe5561c7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed171292f0 con 0x55ed171ce370 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe5561c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed170d0cf0 con 0x55ed171c4b40 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.560+0000 7fe5561c7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed171252b0 con 0x55ed171c35d0 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe55238b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe551b8a640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 0x7fe5380a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe55238b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46538/0 (socket says 172.21.15.66:46538) 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe55238b640 1 -- 172.21.15.66:0/1165583131 learned_addr learned my addr 172.21.15.66:0/1165583131 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe55238b640 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.561+0000 7fe551389640 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe551b8a640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 0x7fe5380a5a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe548000c00 tx=0x7fe548031490 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe55238b640 1 -- 172.21.15.66:0/1165583131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 msgr2=0x55ed171c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe55238b640 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe55238b640 1 -- 172.21.15.66:0/1165583131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 msgr2=0x55ed171d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe55238b640 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.562+0000 7fe55238b640 1 -- 172.21.15.66:0/1165583131 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed170b53a0 con 0x55ed171c4b40 2024-09-15T23:04:31.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.570+0000 7fe55238b640 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe544002230 tx=0x7fe544001b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56e832e1f15d04d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.575+0000 7fe537fff640 1 -- 172.21.15.66:0/1165583131 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54401e070 con 0x55ed171c4b40 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.575+0000 7fe537fff640 1 -- 172.21.15.66:0/1165583131 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe544011040 con 0x55ed171c4b40 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.575+0000 7fe537fff640 1 -- 172.21.15.66:0/1165583131 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54400d070 con 0x55ed171c4b40 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 -- 172.21.15.66:0/1165583131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 msgr2=0x55ed171c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe544002230 tx=0x7fe544001b40 comp rx=0 tx=0).stop 2024-09-15T23:04:31.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 -- 172.21.15.66:0/1165583131 shutdown_connections 2024-09-15T23:04:31.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 --2- 172.21.15.66:0/1165583131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171c4b40 0x55ed171c3090 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.576+0000 7fe5561c7740 1 -- 172.21.15.66:0/1165583131 >> 172.21.15.66:0/1165583131 conn(0x55ed1718c310 msgr2=0x55ed171bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.581+0000 7fe5561c7740 1 -- 172.21.15.66:0/1165583131 shutdown_connections 2024-09-15T23:04:31.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.582+0000 7fe5561c7740 1 -- 172.21.15.66:0/1165583131 wait complete. 2024-09-15T23:04:31.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.582+0000 7fe5561c7740 1 -- start start 2024-09-15T23:04:31.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.583+0000 7fe5561c7740 1 Processor -- start 2024-09-15T23:04:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ed171d1060 con 0x55ed171c35d0 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55ed170e4060 con 0x55ed171ce370 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.585+0000 7fe5561c7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ed171d11e0 con 0x55ed171cb210 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.586+0000 7fe5561c7740 10 client.0 _ll_register_callbacks cb 0x55ed16e378c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.586+0000 7fe55238b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:52370/0 (socket says 172.21.15.66:52370) 2024-09-15T23:04:31.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 -- 172.21.15.66:0/953273849 learned_addr learned my addr 172.21.15.66:0/953273849 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:31.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 -- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 msgr2=0x55ed171cacd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171cacd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 -- 172.21.15.66:0/953273849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 msgr2=0x55ed171cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.588+0000 7fe55238b640 1 -- 172.21.15.66:0/953273849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed16e9a3c0 con 0x55ed171cb210 2024-09-15T23:04:31.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.591+0000 7fe55238b640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe544014010 tx=0x7fe544001720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27890c320edbc84e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.591+0000 7fe5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.592+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54401e070 con 0x55ed171cb210 2024-09-15T23:04:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.592+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fe544015d70 con 0x55ed171cb210 2024-09-15T23:04:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.592+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe544011040 con 0x55ed171cb210 2024-09-15T23:04:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.597+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fe54400d040 con 0x55ed171cb210 2024-09-15T23:04:31.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.599+0000 7fe5561c7740 10 client.28333 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:31.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.599+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55ed171dcbe0 con 0x55ed171cb210 2024-09-15T23:04:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe544011040 con 0x55ed171cb210 2024-09-15T23:04:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7fe544019420 con 0x55ed171cb210 2024-09-15T23:04:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 10 client.28333 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 10 client.28333 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:04:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 20 client.28333 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed171de040 0x55ed171e0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 4 client.28333 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.606+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed17136860 con 0x55ed171de040 2024-09-15T23:04:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.607+0000 7fe551389640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed171de040 0x55ed171e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.611+0000 7fe551389640 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed171de040 0x55ed171e0430 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9f428beb17156bd server_cookie=272a7d239052023c in_seq=0 out_seq=0 2024-09-15T23:04:31.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.612+0000 7fe5357fa640 10 client.28333 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:31.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.612+0000 7fe5357fa640 1 -- 172.21.15.66:0/953273849 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed17136860 con 0x55ed171de040 2024-09-15T23:04:31.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.612+0000 7fe5357fa640 10 client.28333 handle_command_reply: tid=0 2024-09-15T23:04:31.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.613+0000 7fe5561c7740 1 client.28333 shutdown 2024-09-15T23:04:31.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.614+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 msgr2=0x55ed171cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.614+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe544014010 tx=0x7fe544001720 comp rx=0 tx=0).stop 2024-09-15T23:04:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 shutdown_connections 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed171de040 0x55ed171e0430 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171cb690 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 --2- 172.21.15.66:0/953273849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 >> 172.21.15.66:0/953273849 conn(0x55ed1718c310 msgr2=0x55ed171c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.615+0000 7fe5357fa640 0 client.28333 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.620+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 shutdown_connections 2024-09-15T23:04:31.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.622+0000 7fe5561c7740 1 -- 172.21.15.66:0/953273849 wait complete. 2024-09-15T23:04:31.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.622+0000 7fe5561c7740 20 client.28333 trim_cache size 0 max 16384 2024-09-15T23:04:31.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.647+0000 7fe5561c7740 1 Processor -- start 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 -- start start 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 0x55ed171c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171da350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c6bf0 con 0x55ed171ce370 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c89a0 con 0x55ed171cb210 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe5561c7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c7350 con 0x55ed171c35d0 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe55238b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe55238b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171da350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43356/0 (socket says 172.21.15.66:43356) 2024-09-15T23:04:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe55238b640 1 -- 172.21.15.66:0/4275372085 learned_addr learned my addr 172.21.15.66:0/4275372085 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.649+0000 7fe55238b640 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.650+0000 7fe551389640 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 0x55ed171c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 -- 172.21.15.66:0/4275372085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 msgr2=0x55ed171caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 -- 172.21.15.66:0/4275372085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 msgr2=0x55ed171da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171da350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 -- 172.21.15.66:0/4275372085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed171da890 con 0x55ed171cb210 2024-09-15T23:04:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.651+0000 7fe551389640 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 0x55ed171c9c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ed171ca560 tx=0x7fe53c0094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a25292ed2d1b387 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.654+0000 7fe5377fe640 1 -- 172.21.15.66:0/4275372085 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c005020 con 0x55ed171cb210 2024-09-15T23:04:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.654+0000 7fe5377fe640 1 -- 172.21.15.66:0/4275372085 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe53c0047a0 con 0x55ed171cb210 2024-09-15T23:04:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.655+0000 7fe5561c7740 1 -- 172.21.15.66:0/4275372085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 msgr2=0x55ed171c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.655+0000 7fe5561c7740 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 0x55ed171c9c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ed171ca560 tx=0x7fe53c0094a0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.662+0000 7fe5561c7740 1 -- 172.21.15.66:0/4275372085 shutdown_connections 2024-09-15T23:04:31.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.662+0000 7fe5561c7740 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171ce370 0x55ed171da350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.662+0000 7fe5561c7740 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171cb210 0x55ed171c9c10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.662+0000 7fe5561c7740 1 --2- 172.21.15.66:0/4275372085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171c35d0 0x55ed171caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.662+0000 7fe5561c7740 1 -- 172.21.15.66:0/4275372085 >> 172.21.15.66:0/4275372085 conn(0x55ed1718c310 msgr2=0x55ed171ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.666+0000 7fe5561c7740 1 -- 172.21.15.66:0/4275372085 shutdown_connections 2024-09-15T23:04:31.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.667+0000 7fe5561c7740 1 -- 172.21.15.66:0/4275372085 wait complete. 2024-09-15T23:04:31.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.667+0000 7fe5561c7740 1 -- start start 2024-09-15T23:04:31.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.667+0000 7fe5561c7740 1 Processor -- start 2024-09-15T23:04:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:31 smithi184 ceph-mon[35203]: pgmap v604: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 86 op/s 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c8210 con 0x55ed171c35d0 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c7a80 con 0x55ed171ce370 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1c4bf0 con 0x55ed171cb210 2024-09-15T23:04:31.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.673+0000 7fe5561c7740 10 client.0 _ll_register_callbacks cb 0x7fe54401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43370/0 (socket says 172.21.15.66:43370) 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 -- 172.21.15.66:0/3174877293 learned_addr learned my addr 172.21.15.66:0/3174877293 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe551389640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 -- 172.21.15.66:0/3174877293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 msgr2=0x55ed171d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.674+0000 7fe55238b640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe55238b640 1 -- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 msgr2=0x55ed171d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe55238b640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe55238b640 1 -- 172.21.15.66:0/3174877293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed17246a20 con 0x55ed171c35d0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe55238b640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe544001220 tx=0x7fe5440012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c82fb23a4899c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544036040 con 0x55ed171c35d0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.675+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7fe544019c60 con 0x55ed171c35d0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.676+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe53c0047a0 con 0x55ed171c35d0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.676+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fe54401e040 con 0x55ed171c35d0 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.677+0000 7fe5561c7740 10 client.19221 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:31.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.677+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55ed17247c60 con 0x55ed171c35d0 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.682+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe53c0047a0 con 0x55ed171c35d0 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.683+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7fe54403ebd0 con 0x55ed171c35d0 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 10 client.19221 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 10 client.19221 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 20 client.19221 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed17248220 0x55ed1724a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 4 client.19221 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.684+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed17130d70 con 0x55ed17248220 2024-09-15T23:04:31.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.687+0000 7fe551389640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed17248220 0x55ed1724a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.701+0000 7fe5357fa640 10 client.19221 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.701+0000 7fe551389640 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed17248220 0x55ed1724a640 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55f64b9fe1e61b06 server_cookie=c1c82b6872161b52 in_seq=0 out_seq=0 2024-09-15T23:04:31.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.702+0000 7fe5357fa640 1 -- 172.21.15.66:0/3174877293 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed17130d70 con 0x55ed17248220 2024-09-15T23:04:31.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.702+0000 7fe5357fa640 10 client.19221 handle_command_reply: tid=0 2024-09-15T23:04:31.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.703+0000 7fe5561c7740 1 client.19221 shutdown 2024-09-15T23:04:31.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.706+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 msgr2=0x55ed171d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.706+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe544001220 tx=0x7fe5440012f0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 shutdown_connections 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55ed17248220 0x55ed1724a640 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed171ce370 0x55ed171d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ed171cb210 0x55ed171d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 --2- 172.21.15.66:0/3174877293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ed171c35d0 0x55ed171d1480 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 >> 172.21.15.66:0/3174877293 conn(0x55ed1718c310 msgr2=0x55ed171ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5357fa640 0 client.19221 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.707+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 shutdown_connections 2024-09-15T23:04:31.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.711+0000 7fe5561c7740 1 -- 172.21.15.66:0/3174877293 wait complete. 2024-09-15T23:04:31.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.711+0000 7fe5561c7740 20 client.19221 trim_cache size 0 max 16384 2024-09-15T23:04:31.712 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 msgr2=0x7fe5380a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 0x7fe5380a5a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe548000c00 tx=0x7fe548031490 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 msgr2=0x7fe54c1186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe548009a20 tx=0x7fe548003b90 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 shutdown_connections 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe5380a3580 0x7fe5380a5a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe54c11b140 0x7fe54c111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54c109830 0x7fe54c111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 --2- 172.21.15.66:0/224158336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe54c109450 0x7fe54c1186f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 >> 172.21.15.66:0/224158336 conn(0x7fe54c06e140 msgr2=0x7fe54c11bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:31.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 shutdown_connections 2024-09-15T23:04:31.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:31.712+0000 7fe553dee640 1 -- 172.21.15.66:0/224158336 wait complete. 2024-09-15T23:04:31.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:31 smithi087 ceph-mon[35290]: pgmap v604: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 86 op/s 2024-09-15T23:04:32.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T23:04:32.998 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:33.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:33 smithi066 ceph-mon[31185]: pgmap v605: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 194 KiB/s wr, 78 op/s 2024-09-15T23:04:33.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.705+0000 7f999f46c640 1 -- 172.21.15.66:0/2345674054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f999009b600 msgr2=0x7f999009b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.705+0000 7f999f46c640 1 --2- 172.21.15.66:0/2345674054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f999009b600 0x7f999009b9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9998050280 tx=0x7f9998096c80 comp rx=0 tx=0).stop 2024-09-15T23:04:33.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.709+0000 7f999f46c640 1 -- 172.21.15.66:0/2345674054 shutdown_connections 2024-09-15T23:04:33.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.709+0000 7f999f46c640 1 --2- 172.21.15.66:0/2345674054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99900050e0 0x7f99900a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.709+0000 7f999f46c640 1 --2- 172.21.15.66:0/2345674054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f9990004ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.709+0000 7f999f46c640 1 --2- 172.21.15.66:0/2345674054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f999009b600 0x7f999009b9e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.709+0000 7f999f46c640 1 -- 172.21.15.66:0/2345674054 >> 172.21.15.66:0/2345674054 conn(0x7f999000a1b0 msgr2=0x7f999000a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.710+0000 7f999f46c640 1 -- 172.21.15.66:0/2345674054 shutdown_connections 2024-09-15T23:04:33.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.712+0000 7f999f46c640 1 -- 172.21.15.66:0/2345674054 wait complete. 2024-09-15T23:04:33.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.713+0000 7f999f46c640 1 Processor -- start 2024-09-15T23:04:33.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.717+0000 7f999f46c640 1 -- start start 2024-09-15T23:04:33.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.717+0000 7f999f46c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.718+0000 7f999f46c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99900050e0 0x7f999012ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.718+0000 7f999f46c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999009b600 0x7f99900a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.718+0000 7f999f46c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99900a58f0 con 0x7f9990004740 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.718+0000 7f999f46c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f99900a5770 con 0x7f99900050e0 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.718+0000 7f999f46c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f99900a5a70 con 0x7f999009b600 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.719+0000 7f999e46a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.719+0000 7f999e46a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39024/0 (socket says 172.21.15.66:39024) 2024-09-15T23:04:33.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.719+0000 7f999e46a640 1 -- 172.21.15.66:0/3921281798 learned_addr learned my addr 172.21.15.66:0/3921281798 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:33.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.721+0000 7f999e46a640 1 -- 172.21.15.66:0/3921281798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999009b600 msgr2=0x7f99900a0330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:04:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.721+0000 7f999e46a640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999009b600 0x7f99900a0330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.721+0000 7f999e46a640 1 -- 172.21.15.66:0/3921281798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99900050e0 msgr2=0x7f999012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.721+0000 7f999e46a640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99900050e0 0x7f999012ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.721+0000 7f999e46a640 1 -- 172.21.15.66:0/3921281798 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99900a0bf0 con 0x7f9990004740 2024-09-15T23:04:33.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.722+0000 7f999e46a640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9998068040 tx=0x7f99980977b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.722+0000 7f998f7fe640 1 -- 172.21.15.66:0/3921281798 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99980ad020 con 0x7f9990004740 2024-09-15T23:04:33.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.722+0000 7f999f46c640 1 -- 172.21.15.66:0/3921281798 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99900a0e80 con 0x7f9990004740 2024-09-15T23:04:33.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.722+0000 7f999f46c640 1 -- 172.21.15.66:0/3921281798 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99901326c0 con 0x7f9990004740 2024-09-15T23:04:33.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.725+0000 7f998f7fe640 1 -- 172.21.15.66:0/3921281798 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9998097db0 con 0x7f9990004740 2024-09-15T23:04:33.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.725+0000 7f998f7fe640 1 -- 172.21.15.66:0/3921281798 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999809f790 con 0x7f9990004740 2024-09-15T23:04:33.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.726+0000 7f99a2aa7740 1 Processor -- start 2024-09-15T23:04:33.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.726+0000 7f99a2aa7740 1 -- start start 2024-09-15T23:04:33.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e50020 0x558060e4e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558060db42f0 con 0x558060e59850 2024-09-15T23:04:33.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558060d5bcf0 con 0x558060e4eab0 2024-09-15T23:04:33.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.727+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558060db02b0 con 0x558060e50020 2024-09-15T23:04:33.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.728+0000 7f999dc69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.728+0000 7f999dc69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39030/0 (socket says 172.21.15.66:39030) 2024-09-15T23:04:33.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.728+0000 7f999dc69640 1 -- 172.21.15.66:0/1646825817 learned_addr learned my addr 172.21.15.66:0/1646825817 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:33.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 -- 172.21.15.66:0/1646825817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e50020 msgr2=0x558060e4e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:33.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e50020 0x558060e4e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 -- 172.21.15.66:0/1646825817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 msgr2=0x558060e4eef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 -- 172.21.15.66:0/1646825817 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558060d403a0 con 0x558060e59850 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f999dc69640 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9988009ae0 tx=0x7f998800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ac2c1fbc597c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f9983fff640 1 -- 172.21.15.66:0/1646825817 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998800ed20 con 0x558060e59850 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.730+0000 7f9983fff640 1 -- 172.21.15.66:0/1646825817 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9988005020 con 0x558060e59850 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.732+0000 7f99a2aa7740 1 -- 172.21.15.66:0/1646825817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 msgr2=0x558060e5bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.732+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9988009ae0 tx=0x7f998800e350 comp rx=0 tx=0).stop 2024-09-15T23:04:33.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.732+0000 7f998f7fe640 1 -- 172.21.15.66:0/3921281798 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f99980b0020 con 0x7f9990004740 2024-09-15T23:04:33.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.733+0000 7f998f7fe640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 0x7f99840a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.733+0000 7f998f7fe640 1 -- 172.21.15.66:0/3921281798 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f999815d780 con 0x7f9990004740 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f99a2aa7740 1 -- 172.21.15.66:0/1646825817 shutdown_connections 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e59850 0x558060e5bc40 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/1646825817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e50020 0x558060e4e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f99a2aa7740 1 -- 172.21.15.66:0/1646825817 >> 172.21.15.66:0/1646825817 conn(0x558060e17310 msgr2=0x558060e4b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.734+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 0x7f99840a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.735+0000 7f99a2aa7740 1 -- 172.21.15.66:0/1646825817 shutdown_connections 2024-09-15T23:04:33.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.737+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 0x7f99840a5980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99900927b0 tx=0x7f9994005ad0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.742+0000 7f99a2aa7740 1 -- 172.21.15.66:0/1646825817 wait complete. 2024-09-15T23:04:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.742+0000 7f99a2aa7740 1 -- start start 2024-09-15T23:04:33.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.742+0000 7f99a2aa7740 1 Processor -- start 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e58e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558060e5c5a0 con 0x558060e4eab0 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x558060d6f060 con 0x558060e50020 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558060e5c720 con 0x558060e59850 2024-09-15T23:04:33.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.746+0000 7f99a2aa7740 10 client.0 _ll_register_callbacks cb 0x558060ac28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.747+0000 7f999ec6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.747+0000 7f999ec6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34310/0 (socket says 172.21.15.66:34310) 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.748+0000 7f999ec6b640 1 -- 172.21.15.66:0/3788475919 learned_addr learned my addr 172.21.15.66:0/3788475919 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.749+0000 7f999ec6b640 1 -- 172.21.15.66:0/3788475919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 msgr2=0x558060e560c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.749+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e560c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.749+0000 7f999ec6b640 1 -- 172.21.15.66:0/3788475919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 msgr2=0x558060e58e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.749+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e58e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.750+0000 7f999ec6b640 1 -- 172.21.15.66:0/3788475919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558060b253c0 con 0x558060e59850 2024-09-15T23:04:33.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.755+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f999400f700 tx=0x7f99940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6e5839030b6ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.756+0000 7f9981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:33.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.756+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994020070 con 0x558060e59850 2024-09-15T23:04:33.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.756+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9988005020 con 0x558060e59850 2024-09-15T23:04:33.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.758+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f999400e880 con 0x558060e59850 2024-09-15T23:04:33.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.758+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9994027ad0 con 0x558060e59850 2024-09-15T23:04:33.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.759+0000 7f99a2aa7740 10 client.28342 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:33.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.759+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x558060e67de0 con 0x558060e59850 2024-09-15T23:04:33.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.764+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9988005020 con 0x558060e59850 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f999401b070 con 0x558060e59850 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 10 client.28342 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 10 client.28342 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 20 client.28342 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060e69810 0x558060e6bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 4 client.28342 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:33.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.765+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558060dc1860 con 0x558060e69810 2024-09-15T23:04:33.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.766+0000 7f999e46a640 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060e69810 0x558060e6bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.771+0000 7f999e46a640 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060e69810 0x558060e6bcd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8de6a1aa098f591 server_cookie=6627d6de6a79a8d9 in_seq=0 out_seq=0 2024-09-15T23:04:33.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.772+0000 7f9981ffb640 10 client.28342 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:33.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.772+0000 7f9981ffb640 1 -- 172.21.15.66:0/3788475919 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558060dc1860 con 0x558060e69810 2024-09-15T23:04:33.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.772+0000 7f9981ffb640 10 client.28342 handle_command_reply: tid=0 2024-09-15T23:04:33.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.772+0000 7f99a2aa7740 1 client.28342 shutdown 2024-09-15T23:04:33.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.776+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 msgr2=0x558060e56600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.777+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f999400f700 tx=0x7f99940046c0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 shutdown_connections 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060e69810 0x558060e6bcd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e56600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3788475919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e58e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f9981ffb640 0 client.28342 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:33.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.778+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 >> 172.21.15.66:0/3788475919 conn(0x558060e17310 msgr2=0x558060e50e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.779+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 shutdown_connections 2024-09-15T23:04:33.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.779+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3788475919 wait complete. 2024-09-15T23:04:33.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.779+0000 7f99a2aa7740 20 client.28342 trim_cache size 0 max 16384 2024-09-15T23:04:33.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.805+0000 7f99a2aa7740 1 Processor -- start 2024-09-15T23:04:33.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 -- start start 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 0x558060e51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99780102b0 con 0x558060e50020 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9978012060 con 0x558060e4eab0 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f999dc69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 0x558060e51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9978010a10 con 0x558060e59850 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f999dc69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 0x558060e51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39042/0 (socket says 172.21.15.66:39042) 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f999dc69640 1 -- 172.21.15.66:0/2967174541 learned_addr learned my addr 172.21.15.66:0/2967174541 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.806+0000 7f999e46a640 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.807+0000 7f999e46a640 1 -- 172.21.15.66:0/2967174541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 msgr2=0x558060e715e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:33.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.807+0000 7f999e46a640 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e715e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.807+0000 7f999e46a640 1 -- 172.21.15.66:0/2967174541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 msgr2=0x558060e51600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:33.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.807+0000 7f999e46a640 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 0x558060e51600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.807+0000 7f999e46a640 1 -- 172.21.15.66:0/2967174541 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558060e55070 con 0x558060e4eab0 2024-09-15T23:04:33.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.812+0000 7f999e46a640 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4a1f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f999815aa50 tx=0x7f9998096c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd1931a28db214a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.813+0000 7f99837fe640 1 -- 172.21.15.66:0/2967174541 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998127720 con 0x558060e4eab0 2024-09-15T23:04:33.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.813+0000 7f99837fe640 1 -- 172.21.15.66:0/2967174541 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f999809b040 con 0x558060e4eab0 2024-09-15T23:04:33.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.813+0000 7f99837fe640 1 -- 172.21.15.66:0/2967174541 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99980a9ab0 con 0x558060e4eab0 2024-09-15T23:04:33.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.814+0000 7f99a2aa7740 1 -- 172.21.15.66:0/2967174541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 msgr2=0x558060e4a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.814+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4a1f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f999815aa50 tx=0x7f9998096c80 comp rx=0 tx=0).stop 2024-09-15T23:04:33.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.817+0000 7f99a2aa7740 1 -- 172.21.15.66:0/2967174541 shutdown_connections 2024-09-15T23:04:33.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.817+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.817+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e50020 0x558060e51600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.817+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/2967174541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e4eab0 0x558060e4a1f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.817+0000 7f99a2aa7740 1 -- 172.21.15.66:0/2967174541 >> 172.21.15.66:0/2967174541 conn(0x558060e17310 msgr2=0x558060e49ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.826+0000 7f99a2aa7740 1 -- 172.21.15.66:0/2967174541 shutdown_connections 2024-09-15T23:04:33.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.826+0000 7f99a2aa7740 1 -- 172.21.15.66:0/2967174541 wait complete. 2024-09-15T23:04:33.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.826+0000 7f99a2aa7740 1 -- start start 2024-09-15T23:04:33.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.826+0000 7f99a2aa7740 1 Processor -- start 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.827+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e5da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.827+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e5dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.827+0000 7f99a2aa7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.827+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99780118d0 con 0x558060e4eab0 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.827+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9978011140 con 0x558060e50020 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.828+0000 7f99a2aa7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f997800e340 con 0x558060e59850 2024-09-15T23:04:33.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.828+0000 7f99a2aa7740 10 client.0 _ll_register_callbacks cb 0x7f999400cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.828+0000 7f999ec6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.828+0000 7f999ec6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34334/0 (socket says 172.21.15.66:34334) 2024-09-15T23:04:33.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.828+0000 7f999ec6b640 1 -- 172.21.15.66:0/3805271389 learned_addr learned my addr 172.21.15.66:0/3805271389 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:33.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.830+0000 7f999ec6b640 1 -- 172.21.15.66:0/3805271389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 msgr2=0x558060e5dfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:33.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.830+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e5dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.830+0000 7f999ec6b640 1 -- 172.21.15.66:0/3805271389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 msgr2=0x558060e5da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:33.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.830+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e5da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.830+0000 7f999ec6b640 1 -- 172.21.15.66:0/3805271389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558060e5bfb0 con 0x558060e59850 2024-09-15T23:04:33.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.832+0000 7f999ec6b640 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9994011040 tx=0x7f9994005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=345dcc7d22c1cc25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:33.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.835+0000 7f9981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:33.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.835+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994035020 con 0x558060e59850 2024-09-15T23:04:33.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.835+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f99940270f0 con 0x558060e59850 2024-09-15T23:04:33.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.835+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999809b040 con 0x558060e59850 2024-09-15T23:04:33.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.839+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9994020040 con 0x558060e59850 2024-09-15T23:04:33.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.841+0000 7f99a2aa7740 10 client.28345 fetch_fsmap learned FSMap version 71 2024-09-15T23:04:33.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.841+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x558060cef1e0 con 0x558060e59850 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f999809b040 con 0x558060e59850 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 71) ==== 8422+0+0 (secure 0 0 0) 0x7f999401b040 con 0x558060e59850 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f99a2aa7740 10 client.28345 fetch_fsmap finished waiting for FSMap version 71 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f99a2aa7740 10 client.28345 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f99a2aa7740 20 client.28345 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:33.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.842+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060ed4fb0 0x558060ed7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:33.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.844+0000 7f99a2aa7740 4 client.28345 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:33.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.844+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558060dbbd70 con 0x558060ed4fb0 2024-09-15T23:04:33.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.847+0000 7f999e46a640 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060ed4fb0 0x558060ed7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:33.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:33 smithi087 ceph-mon[35290]: pgmap v605: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 194 KiB/s wr, 78 op/s 2024-09-15T23:04:33.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.851+0000 7f999e46a640 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060ed4fb0 0x558060ed7400 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f31246789da6b6 server_cookie=e42bc8c35c678d8c in_seq=0 out_seq=0 2024-09-15T23:04:33.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.851+0000 7f9981ffb640 10 client.28345 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:33.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.851+0000 7f9981ffb640 1 -- 172.21.15.66:0/3805271389 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558060dbbd70 con 0x558060ed4fb0 2024-09-15T23:04:33.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.851+0000 7f9981ffb640 10 client.28345 handle_command_reply: tid=0 2024-09-15T23:04:33.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.853+0000 7f99a2aa7740 1 client.28345 shutdown 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 msgr2=0x558060e5e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9994011040 tx=0x7f9994005270 comp rx=0 tx=0).stop 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 shutdown_connections 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x558060ed4fb0 0x558060ed7400 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558060e59850 0x558060e5e4e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558060e50020 0x558060e5dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f9981ffb640 0 client.28345 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:33.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 --2- 172.21.15.66:0/3805271389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558060e4eab0 0x558060e5da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.855+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 >> 172.21.15.66:0/3805271389 conn(0x558060e17310 msgr2=0x558060e58140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.856+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 shutdown_connections 2024-09-15T23:04:33.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.856+0000 7f99a2aa7740 1 -- 172.21.15.66:0/3805271389 wait complete. 2024-09-15T23:04:33.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.856+0000 7f99a2aa7740 20 client.28345 trim_cache size 0 max 16384 2024-09-15T23:04:33.861 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 msgr2=0x7f99840a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 0x7f99840a5980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99900927b0 tx=0x7f9994005ad0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 msgr2=0x7f999012e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9998068040 tx=0x7f99980977b0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 shutdown_connections 2024-09-15T23:04:33.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f99840a34c0 0x7f99840a5980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999009b600 0x7f99900a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99900050e0 0x7f999012ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 --2- 172.21.15.66:0/3921281798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9990004740 0x7f999012e7e0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:33.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.861+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 >> 172.21.15.66:0/3921281798 conn(0x7f999000a1b0 msgr2=0x7f9990095340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:33.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.864+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 shutdown_connections 2024-09-15T23:04:33.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:33.864+0000 7f998d7fa640 1 -- 172.21.15.66:0/3921281798 wait complete. 2024-09-15T23:04:33.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:33 smithi184 ceph-mon[35203]: pgmap v605: 129 pgs: 19 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 58 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 194 KiB/s wr, 78 op/s 2024-09-15T23:04:35.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:35 smithi066 ceph-mon[31185]: pgmap v606: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 569 KiB/s wr, 91 op/s 2024-09-15T23:04:35.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:35 smithi087 ceph-mon[35290]: pgmap v606: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 569 KiB/s wr, 91 op/s 2024-09-15T23:04:35.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:35 smithi184 ceph-mon[35203]: pgmap v606: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 569 KiB/s wr, 91 op/s 2024-09-15T23:04:37.073 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:04:37.586 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:37.733 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:37 smithi066 ceph-mon[31185]: pgmap v607: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 971 KiB/s wr, 99 op/s 2024-09-15T23:04:37.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:37 smithi087 ceph-mon[35290]: pgmap v607: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 971 KiB/s wr, 99 op/s 2024-09-15T23:04:37.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:37 smithi184 ceph-mon[35203]: pgmap v607: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 971 KiB/s wr, 99 op/s 2024-09-15T23:04:38.825 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:38 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:38.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:38 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:38.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:38 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:38.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 -- 172.21.15.66:0/1872246897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 msgr2=0x7f9290109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 --2- 172.21.15.66:0/1872246897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f9290109830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9288005fd0 tx=0x7f928802e720 comp rx=0 tx=0).stop 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 -- 172.21.15.66:0/1872246897 shutdown_connections 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 --2- 172.21.15.66:0/1872246897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 0x7f9290115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 --2- 172.21.15.66:0/1872246897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.991+0000 7f928f59e640 1 --2- 172.21.15.66:0/1872246897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f9290109830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:38.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.992+0000 7f928f59e640 1 -- 172.21.15.66:0/1872246897 >> 172.21.15.66:0/1872246897 conn(0x7f9290073180 msgr2=0x7f9290073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:38.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.992+0000 7f928f59e640 1 -- 172.21.15.66:0/1872246897 shutdown_connections 2024-09-15T23:04:38.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.992+0000 7f928f59e640 1 -- 172.21.15.66:0/1872246897 wait complete. 2024-09-15T23:04:38.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 Processor -- start 2024-09-15T23:04:38.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 -- start start 2024-09-15T23:04:38.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f92901a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:38.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:38.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 0x7f929019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92901183c0 con 0x7f929010e970 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9290118240 con 0x7f9290109450 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.993+0000 7f928f59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9290118540 con 0x7f9290109e00 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.994+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.994+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:34354/0 (socket says 172.21.15.66:34354) 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.995+0000 7f928dd9b640 1 -- 172.21.15.66:0/586887955 learned_addr learned my addr 172.21.15.66:0/586887955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:38.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.995+0000 7f928ed9d640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 0x7f929019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:38.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928e59c640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f92901a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928dd9b640 1 -- 172.21.15.66:0/586887955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 msgr2=0x7f92901a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928dd9b640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f92901a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928dd9b640 1 -- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 msgr2=0x7f929019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928dd9b640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 0x7f929019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:38.997+0000 7f928dd9b640 1 -- 172.21.15.66:0/586887955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929019f3d0 con 0x7f9290109e00 2024-09-15T23:04:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.005+0000 7f928dd9b640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9280007830 tx=0x7f9280007cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.006+0000 7f927f7fe640 1 -- 172.21.15.66:0/586887955 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280019030 con 0x7f9290109e00 2024-09-15T23:04:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.006+0000 7f927f7fe640 1 -- 172.21.15.66:0/586887955 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928000fe00 con 0x7f9290109e00 2024-09-15T23:04:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.006+0000 7f927f7fe640 1 -- 172.21.15.66:0/586887955 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280004ad0 con 0x7f9290109e00 2024-09-15T23:04:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.006+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92901a3290 con 0x7f9290109e00 2024-09-15T23:04:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.006+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901a3780 con 0x7f9290109e00 2024-09-15T23:04:39.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.010+0000 7f9296dc1740 1 Processor -- start 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.011+0000 7f9296dc1740 1 -- start start 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.011+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.011+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d7780 0x5610d05d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.012+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 0x5610d05e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.012+0000 7f9296dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5610d053d2f0 con 0x5610d05d7780 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.012+0000 7f9296dc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5610d04e4cf0 con 0x5610d05d8cf0 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.012+0000 7f9296dc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5610d05392b0 con 0x5610d05e2520 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39364/0 (socket says 172.21.15.66:39364) 2024-09-15T23:04:39.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 -- 172.21.15.66:0/880918446 learned_addr learned my addr 172.21.15.66:0/880918446 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 -- 172.21.15.66:0/880918446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 msgr2=0x5610d05e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928dd9b640 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 0x5610d05e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 0x5610d05e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 -- 172.21.15.66:0/880918446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d7780 msgr2=0x5610d05d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d7780 0x5610d05d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.014+0000 7f928ed9d640 1 -- 172.21.15.66:0/880918446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610d04c93a0 con 0x5610d05d8cf0 2024-09-15T23:04:39.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.015+0000 7f928dd9b640 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 0x5610d05e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:04:39.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.015+0000 7f928ed9d640 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb90 tx=0x7f928400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae2acfce40e349c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.016+0000 7f927cff9640 1 -- 172.21.15.66:0/880918446 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284015070 con 0x5610d05d8cf0 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.016+0000 7f927cff9640 1 -- 172.21.15.66:0/880918446 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9284011920 con 0x5610d05d8cf0 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.017+0000 7f927cff9640 1 -- 172.21.15.66:0/880918446 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284010870 con 0x5610d05d8cf0 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.017+0000 7f9296dc1740 1 -- 172.21.15.66:0/880918446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 msgr2=0x5610d05d7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.017+0000 7f9296dc1740 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb90 tx=0x7f928400f730 comp rx=0 tx=0).stop 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.018+0000 7f9296dc1740 1 -- 172.21.15.66:0/880918446 shutdown_connections 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.018+0000 7f9296dc1740 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05e2520 0x5610d05e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.018+0000 7f9296dc1740 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d7780 0x5610d05d7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.018+0000 7f9296dc1740 1 --2- 172.21.15.66:0/880918446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05d8cf0 0x5610d05d7240 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.018+0000 7f9296dc1740 1 -- 172.21.15.66:0/880918446 >> 172.21.15.66:0/880918446 conn(0x5610d05a0310 msgr2=0x5610d05d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:39.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.020+0000 7f927f7fe640 1 -- 172.21.15.66:0/586887955 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f928001c070 con 0x7f9290109e00 2024-09-15T23:04:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.021+0000 7f927f7fe640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 0x7f92780a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.025+0000 7f927f7fe640 1 -- 172.21.15.66:0/586887955 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f9280099fb0 con 0x7f9290109e00 2024-09-15T23:04:39.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.027+0000 7f9296dc1740 1 -- 172.21.15.66:0/880918446 shutdown_connections 2024-09-15T23:04:39.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.028+0000 7f928e59c640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 0x7f92780a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.031+0000 7f9296dc1740 1 -- 172.21.15.66:0/880918446 wait complete. 2024-09-15T23:04:39.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.031+0000 7f9296dc1740 1 -- start start 2024-09-15T23:04:39.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.031+0000 7f9296dc1740 1 Processor -- start 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.032+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5610d05e52c0 con 0x5610d05d8cf0 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5610d04f8060 con 0x5610d05e2520 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5610d05e5440 con 0x5610d05df770 2024-09-15T23:04:39.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f9296dc1740 10 client.0 _ll_register_callbacks cb 0x5610d024b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:39.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39376/0 (socket says 172.21.15.66:39376) 2024-09-15T23:04:39.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.033+0000 7f928dd9b640 1 -- 172.21.15.66:0/3615817103 learned_addr learned my addr 172.21.15.66:0/3615817103 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.035+0000 7f928dd9b640 1 -- 172.21.15.66:0/3615817103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 msgr2=0x5610d05dfbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:04:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.035+0000 7f928dd9b640 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05dfbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.035+0000 7f928dd9b640 1 -- 172.21.15.66:0/3615817103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 msgr2=0x5610d05e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.035+0000 7f928dd9b640 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.035+0000 7f928dd9b640 1 -- 172.21.15.66:0/3615817103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610d02ae3c0 con 0x5610d05e2520 2024-09-15T23:04:39.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.036+0000 7f928dd9b640 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92800a43f0 tx=0x7f92800a4420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fcf6b3255d13cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.038+0000 7f9275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:39.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.038+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280098650 con 0x5610d05e2520 2024-09-15T23:04:39.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.038+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f9280099fb0 con 0x5610d05e2520 2024-09-15T23:04:39.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.039+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9284011920 con 0x5610d05e2520 2024-09-15T23:04:39.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.043+0000 7f928e59c640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 0x7f92780a59b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5610d05d4c70 tx=0x7f9288008300 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.043+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f92800987f0 con 0x5610d05e2520 2024-09-15T23:04:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.043+0000 7f9296dc1740 10 client.28445 fetch_fsmap learned FSMap version 73 2024-09-15T23:04:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.043+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5610d05f1150 con 0x5610d05e2520 2024-09-15T23:04:39.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.045+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9284011920 con 0x5610d05e2520 2024-09-15T23:04:39.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f9280098290 con 0x5610d05e2520 2024-09-15T23:04:39.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 10 client.28445 fetch_fsmap finished waiting for FSMap version 73 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 10 client.28445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 20 client.28445 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d05f2680 0x5610d05f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 4 client.28445 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610d054a860 con 0x5610d05f2680 2024-09-15T23:04:39.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.046+0000 7f928e59c640 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d05f2680 0x5610d05f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.055+0000 7f928e59c640 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d05f2680 0x5610d05f4b00 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e0677511d0fbf server_cookie=31cd7126864a1f03 in_seq=0 out_seq=0 2024-09-15T23:04:39.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.055+0000 7f9275ffb640 10 client.28445 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:39.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.060+0000 7f9275ffb640 1 -- 172.21.15.66:0/3615817103 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610d054a860 con 0x5610d05f2680 2024-09-15T23:04:39.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.060+0000 7f9275ffb640 10 client.28445 handle_command_reply: tid=0 2024-09-15T23:04:39.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.060+0000 7f9296dc1740 1 client.28445 shutdown 2024-09-15T23:04:39.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.060+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 msgr2=0x5610d05df1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.060+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f92800a43f0 tx=0x7f92800a4420 comp rx=0 tx=0).stop 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.061+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 shutdown_connections 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d05f2680 0x5610d05f4b00 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05df1e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3615817103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05e1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 >> 172.21.15.66:0/3615817103 conn(0x5610d05a0310 msgr2=0x5610d05d9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:39.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.062+0000 7f9275ffb640 0 client.28445 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:39.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.065+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 shutdown_connections 2024-09-15T23:04:39.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.067+0000 7f9296dc1740 1 -- 172.21.15.66:0/3615817103 wait complete. 2024-09-15T23:04:39.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.067+0000 7f9296dc1740 20 client.28445 trim_cache size 0 max 16384 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.093+0000 7f9296dc1740 1 Processor -- start 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.093+0000 7f9296dc1740 1 -- start start 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05d8cf0 0x5610d05deaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05df770 0x5610d05e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c68e0 con 0x5610d05e2520 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c86f0 con 0x5610d05df770 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.094+0000 7f9296dc1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c7070 con 0x5610d05d8cf0 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39096/0 (socket says 172.21.15.66:39096) 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05d8cf0 0x5610d05deaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 -- 172.21.15.66:0/3959553295 learned_addr learned my addr 172.21.15.66:0/3959553295 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928dd9b640 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05df770 0x5610d05e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 -- 172.21.15.66:0/3959553295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05d8cf0 msgr2=0x5610d05deaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05d8cf0 0x5610d05deaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 -- 172.21.15.66:0/3959553295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05df770 msgr2=0x5610d05e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05df770 0x5610d05e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.095+0000 7f928ed9d640 1 -- 172.21.15.66:0/3959553295 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610d05dff40 con 0x5610d05e2520 2024-09-15T23:04:39.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.096+0000 7f928ed9d640 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f928400b7b0 tx=0x7f928400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e3c3176eadcb75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.096+0000 7f9277fff640 1 -- 172.21.15.66:0/3959553295 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284015070 con 0x5610d05e2520 2024-09-15T23:04:39.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.096+0000 7f9277fff640 1 -- 172.21.15.66:0/3959553295 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92840035f0 con 0x5610d05e2520 2024-09-15T23:04:39.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.096+0000 7f9277fff640 1 -- 172.21.15.66:0/3959553295 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928401a6c0 con 0x5610d05e2520 2024-09-15T23:04:39.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.097+0000 7f9296dc1740 1 -- 172.21.15.66:0/3959553295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 msgr2=0x5610d05e3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.097+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f928400b7b0 tx=0x7f928400b7e0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 -- 172.21.15.66:0/3959553295 shutdown_connections 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05e2520 0x5610d05e3e50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05df770 0x5610d05e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 --2- 172.21.15.66:0/3959553295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05d8cf0 0x5610d05deaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 -- 172.21.15.66:0/3959553295 >> 172.21.15.66:0/3959553295 conn(0x5610d05a0310 msgr2=0x5610d05da4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 -- 172.21.15.66:0/3959553295 shutdown_connections 2024-09-15T23:04:39.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.102+0000 7f9296dc1740 1 -- 172.21.15.66:0/3959553295 wait complete. 2024-09-15T23:04:39.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.103+0000 7f9296dc1740 1 -- start start 2024-09-15T23:04:39.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.103+0000 7f9296dc1740 1 Processor -- start 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.104+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05ea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.104+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.104+0000 7f9296dc1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.104+0000 7f9296dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c7f60 con 0x5610d05d8cf0 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f928dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f928ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:39400/0 (socket says 172.21.15.66:39400) 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f928ed9d640 1 -- 172.21.15.66:0/2420633460 learned_addr learned my addr 172.21.15.66:0/2420633460 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c77d0 con 0x5610d05e2520 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f928e59c640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f92901c48e0 con 0x5610d05df770 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.105+0000 7f9296dc1740 10 client.0 _ll_register_callbacks cb 0x7f928001c730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 -- 172.21.15.66:0/2420633460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 msgr2=0x5610d05eac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05eac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 -- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 msgr2=0x5610d05dc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610d05eb2d0 con 0x5610d05d8cf0 2024-09-15T23:04:39.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928ed9d640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f928e59c640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05ea750 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f9288008790 tx=0x7f928800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7fded135ff7339 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.106+0000 7f9275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.107+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928804f070 con 0x5610d05d8cf0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.107+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f9288003d40 con 0x5610d05d8cf0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.108+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92840035f0 con 0x5610d05d8cf0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.108+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f928803a030 con 0x5610d05d8cf0 2024-09-15T23:04:39.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.108+0000 7f9296dc1740 10 client.19245 fetch_fsmap learned FSMap version 73 2024-09-15T23:04:39.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.108+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5610d05f9990 con 0x5610d05d8cf0 2024-09-15T23:04:39.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928803c050 con 0x5610d05d8cf0 2024-09-15T23:04:39.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 73) ==== 8434+0+0 (secure 0 0 0) 0x7f928800a0d0 con 0x5610d05d8cf0 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 10 client.19245 fetch_fsmap finished waiting for FSMap version 73 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 10 client.19245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 20 client.19245 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d065d3a0 0x5610d065f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 4 client.19245 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.109+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f92840035f0 con 0x5610d065d3a0 2024-09-15T23:04:39.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.110+0000 7f928dd9b640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d065d3a0 0x5610d065f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:39.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.121+0000 7f928dd9b640 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d065d3a0 0x5610d065f790 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc5b1cf652553eb server_cookie=18098050cf68e4b9 in_seq=0 out_seq=0 2024-09-15T23:04:39.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.121+0000 7f9275ffb640 10 client.19245 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.127+0000 7f9275ffb640 1 -- 172.21.15.66:0/2420633460 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f92840035f0 con 0x5610d065d3a0 2024-09-15T23:04:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.127+0000 7f9275ffb640 10 client.19245 handle_command_reply: tid=0 2024-09-15T23:04:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.127+0000 7f9296dc1740 1 client.19245 shutdown 2024-09-15T23:04:39.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.128+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 msgr2=0x5610d05ea750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.128+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05ea750 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f9288008790 tx=0x7f928800aec0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 shutdown_connections 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5610d065d3a0 0x5610d065f790 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d05e2520 0x5610d05dc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5610d05df770 0x5610d05eac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 --2- 172.21.15.66:0/2420633460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5610d05d8cf0 0x5610d05ea750 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 >> 172.21.15.66:0/2420633460 conn(0x5610d05a0310 msgr2=0x5610d05d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9275ffb640 0 client.19245 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 shutdown_connections 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 1 -- 172.21.15.66:0/2420633460 wait complete. 2024-09-15T23:04:39.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.129+0000 7f9296dc1740 20 client.19245 trim_cache size 0 max 16384 2024-09-15T23:04:39.132 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:39.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 msgr2=0x7f92780a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 0x7f92780a59b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5610d05d4c70 tx=0x7f9288008300 comp rx=0 tx=0).stop 2024-09-15T23:04:39.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 msgr2=0x7f929019e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:39.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9280007830 tx=0x7f9280007cf0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 shutdown_connections 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f92780a34f0 0x7f92780a59b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f929010e970 0x7f929019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9290109e00 0x7f929019e7f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 --2- 172.21.15.66:0/586887955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9290109450 0x7f92901a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.131+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 >> 172.21.15.66:0/586887955 conn(0x7f9290073180 msgr2=0x7f929010c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:39.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.132+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 shutdown_connections 2024-09-15T23:04:39.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:39.132+0000 7f928f59e640 1 -- 172.21.15.66:0/586887955 wait complete. 2024-09-15T23:04:39.816 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:39 smithi066 ceph-mon[31185]: pgmap v608: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:04:39.816 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:39 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:39.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:39 smithi087 ceph-mon[35290]: pgmap v608: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:04:39.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:39 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:39.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:39 smithi184 ceph-mon[35203]: pgmap v608: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:04:39.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:39 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:40.974 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-15T23:04:40.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T23:04:41.277 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:04:41.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:04:41.602 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:41 smithi066 ceph-mon[31185]: pgmap v609: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-09-15T23:04:41.604 DEBUG:teuthology.parallel:result is None 2024-09-15T23:04:41.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:04:41.721 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:04:41.722 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-15T23:04:41.736 INFO:tasks.quiescer:joining Quiescers 2024-09-15T23:04:41.736 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-15T23:04:41.736 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:04:41.833 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:41.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:41 smithi087 ceph-mon[35290]: pgmap v609: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-09-15T23:04:41.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:41 smithi184 ceph-mon[35203]: pgmap v609: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.543+0000 7f3788e2e640 1 -- 172.21.15.66:0/1034541559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784100b20 msgr2=0x7f3784100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.543+0000 7f3788e2e640 1 --2- 172.21.15.66:0/1034541559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784100b20 0x7f3784100f00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f3774009900 tx=0x7f377402a4b0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.544+0000 7f3788e2e640 1 -- 172.21.15.66:0/1034541559 shutdown_connections 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.544+0000 7f3788e2e640 1 --2- 172.21.15.66:0/1034541559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784105f30 0x7f37841063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.544+0000 7f3788e2e640 1 --2- 172.21.15.66:0/1034541559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784101440 0x7f3784105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.544+0000 7f3788e2e640 1 --2- 172.21.15.66:0/1034541559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784100b20 0x7f3784100f00 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.544+0000 7f3788e2e640 1 -- 172.21.15.66:0/1034541559 >> 172.21.15.66:0/1034541559 conn(0x7f37840fc7d0 msgr2=0x7f37840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.546+0000 7f3788e2e640 1 -- 172.21.15.66:0/1034541559 shutdown_connections 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.546+0000 7f3788e2e640 1 -- 172.21.15.66:0/1034541559 wait complete. 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 Processor -- start 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 -- start start 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 0x7f3784073930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 0x7f3784073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784105f30 0x7f3784071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f37841186c0 con 0x7f3784105f30 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3784118540 con 0x7f3784101440 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.547+0000 7f3788e2e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3784118840 con 0x7f3784100b20 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.548+0000 7f378259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 0x7f3784073930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.548+0000 7f378259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 0x7f3784073930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39510/0 (socket says 172.21.15.66:39510) 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.548+0000 7f378259c640 1 -- 172.21.15.66:0/3677936163 learned_addr learned my addr 172.21.15.66:0/3677936163 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:42.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.548+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 0x7f3784073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.548+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784105f30 0x7f3784071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.549+0000 7f3781d9b640 1 -- 172.21.15.66:0/3677936163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 msgr2=0x7f3784073930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.549+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 0x7f3784073930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.549+0000 7f3781d9b640 1 -- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784105f30 msgr2=0x7f3784071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.549+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784105f30 0x7f3784071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.549+0000 7f3781d9b640 1 -- 172.21.15.66:0/3677936163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784072500 con 0x7f3784101440 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.550+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 0x7f3784073e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b410 tx=0x7f376c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.552+0000 7f377b7fe640 1 -- 172.21.15.66:0/3677936163 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c015020 con 0x7f3784101440 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.553+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37840727f0 con 0x7f3784101440 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.553+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3784112300 con 0x7f3784101440 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.553+0000 7f377b7fe640 1 -- 172.21.15.66:0/3677936163 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f376c011d10 con 0x7f3784101440 2024-09-15T23:04:42.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.553+0000 7f377b7fe640 1 -- 172.21.15.66:0/3677936163 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c00f2e0 con 0x7f3784101440 2024-09-15T23:04:42.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.558+0000 7f378b207740 1 Processor -- start 2024-09-15T23:04:42.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.558+0000 7f378b207740 1 -- start start 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fcff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 0x55d9a3fda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3f35280 con 0x55d9a3fcfb60 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3edcb10 con 0x55d9a3fdad40 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378b207740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3f31240 con 0x55d9a3fd0480 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.559+0000 7f378259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 0x55d9a3fda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.560+0000 7f378259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 0x55d9a3fda800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:39526/0 (socket says 172.21.15.66:39526) 2024-09-15T23:04:42.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.560+0000 7f378259c640 1 -- 172.21.15.66:0/3973402097 learned_addr learned my addr 172.21.15.66:0/3973402097 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:42.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.562+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fcff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f3782d9d640 1 -- 172.21.15.66:0/3973402097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 msgr2=0x55d9a3fda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 0x55d9a3fda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f3782d9d640 1 -- 172.21.15.66:0/3973402097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fdad40 msgr2=0x55d9a3fdd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f3782d9d640 1 -- 172.21.15.66:0/3973402097 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a3ee91f0 con 0x55d9a3fcfb60 2024-09-15T23:04:42.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.564+0000 7f377b7fe640 1 -- 172.21.15.66:0/3677936163 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f376c018020 con 0x7f3784101440 2024-09-15T23:04:42.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.565+0000 7f377b7fe640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 0x7f37700a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.566+0000 7f377b7fe640 1 -- 172.21.15.66:0/3677936163 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f376c0cf700 con 0x7f3784101440 2024-09-15T23:04:42.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.566+0000 7f378259c640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 0x7f37700a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.567+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fcff40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f90 tx=0x7f377c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6b3386bc5d14fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.567+0000 7f3778ff9640 1 -- 172.21.15.66:0/3973402097 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c00a8b0 con 0x55d9a3fcfb60 2024-09-15T23:04:42.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.568+0000 7f3778ff9640 1 -- 172.21.15.66:0/3973402097 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f377c019070 con 0x55d9a3fcfb60 2024-09-15T23:04:42.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.569+0000 7f378b207740 1 -- 172.21.15.66:0/3973402097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 msgr2=0x55d9a3fcff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.569+0000 7f378b207740 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fcff40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f90 tx=0x7f377c009630 comp rx=0 tx=0).stop 2024-09-15T23:04:42.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.569+0000 7f378b207740 1 -- 172.21.15.66:0/3973402097 shutdown_connections 2024-09-15T23:04:42.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.569+0000 7f378b207740 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.570+0000 7f378b207740 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fd0480 0x55d9a3fda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.570+0000 7f378b207740 1 --2- 172.21.15.66:0/3973402097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fcff40 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.570+0000 7f378b207740 1 -- 172.21.15.66:0/3973402097 >> 172.21.15.66:0/3973402097 conn(0x55d9a3fcc0f0 msgr2=0x55d9a3fcc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.571+0000 7f378259c640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 0x7f37700a5a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d9a3fccf50 tx=0x7f3774005c00 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.573+0000 7f378b207740 1 -- 172.21.15.66:0/3973402097 shutdown_connections 2024-09-15T23:04:42.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.576+0000 7f378b207740 1 -- 172.21.15.66:0/3973402097 wait complete. 2024-09-15T23:04:42.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.577+0000 7f378b207740 1 -- start start 2024-09-15T23:04:42.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.577+0000 7f378b207740 1 Processor -- start 2024-09-15T23:04:42.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fd8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3fdd960 con 0x55d9a3fd0480 2024-09-15T23:04:42.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3eeff10 con 0x55d9a3fcfb60 2024-09-15T23:04:42.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d9a3fddae0 con 0x55d9a3fdad40 2024-09-15T23:04:42.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.580+0000 7f378b207740 10 client.0 _ll_register_callbacks cb 0x55d9a3eb8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:42.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.582+0000 7f3782d9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fd8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.582+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.582+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54264/0 (socket says 172.21.15.66:54264) 2024-09-15T23:04:42.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.582+0000 7f3781d9b640 1 -- 172.21.15.66:0/912397970 learned_addr learned my addr 172.21.15.66:0/912397970 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:42.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 -- 172.21.15.66:0/912397970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 msgr2=0x55d9a3fd8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fd8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 -- 172.21.15.66:0/912397970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 msgr2=0x55d9a3fd8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.583+0000 7f378259c640 1 -- 172.21.15.66:0/912397970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a3ca66a0 con 0x55d9a3fcfb60 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.584+0000 7f378259c640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd7be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f377402aaa0 tx=0x7f3774009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b22b085205b521a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.586+0000 7f3769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.586+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377404e070 con 0x55d9a3fcfb60 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.586+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f377c019070 con 0x55d9a3fcfb60 2024-09-15T23:04:42.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.586+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f3774003a00 con 0x55d9a3fcfb60 2024-09-15T23:04:42.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.588+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3774058050 con 0x55d9a3fcfb60 2024-09-15T23:04:42.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.588+0000 7f378b207740 10 client.28457 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:42.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.588+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d9a3fe9610 con 0x55d9a3fcfb60 2024-09-15T23:04:42.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.589+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f377c019070 con 0x55d9a3fcfb60 2024-09-15T23:04:42.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f377404a450 con 0x55d9a3fcfb60 2024-09-15T23:04:42.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 10 client.28457 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:42.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 10 client.28457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 20 client.28457 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a3feaf80 0x55d9a3fed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 4 client.28457 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.590+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9a3f427f0 con 0x55d9a3feaf80 2024-09-15T23:04:42.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.592+0000 7f3781d9b640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a3feaf80 0x55d9a3fed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.599 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.600+0000 7f3781d9b640 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a3feaf80 0x55d9a3fed400 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a0e617344146ae server_cookie=deb0a556c3aec510 in_seq=0 out_seq=0 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.600+0000 7f3769ffb640 10 client.28457 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.601+0000 7f3769ffb640 1 -- 172.21.15.66:0/912397970 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9a3f427f0 con 0x55d9a3feaf80 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.601+0000 7f3769ffb640 10 client.28457 handle_command_reply: tid=0 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.601+0000 7f378b207740 1 client.28457 shutdown 2024-09-15T23:04:42.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.604+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 msgr2=0x55d9a3fd7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.604+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd7be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f377402aaa0 tx=0x7f3774009260 comp rx=0 tx=0).stop 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 shutdown_connections 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fd8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a3feaf80 0x55d9a3fed400 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 --2- 172.21.15.66:0/912397970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd7be0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 >> 172.21.15.66:0/912397970 conn(0x55d9a3fcc0f0 msgr2=0x55d9a3fd1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f3769ffb640 0 client.28457 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:42.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 shutdown_connections 2024-09-15T23:04:42.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.608+0000 7f378b207740 1 -- 172.21.15.66:0/912397970 wait complete. 2024-09-15T23:04:42.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.612+0000 7f378b207740 20 client.28457 trim_cache size 0 max 16384 2024-09-15T23:04:42.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.647+0000 7f378b207740 1 Processor -- start 2024-09-15T23:04:42.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.651+0000 7f378b207740 1 -- start start 2024-09-15T23:04:42.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.651+0000 7f378b207740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.651+0000 7f378b207740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.651+0000 7f378b207740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3ff2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.651+0000 7f378b207740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3764010420 con 0x55d9a3fd0480 2024-09-15T23:04:42.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.652+0000 7f378b207740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3764012230 con 0x55d9a3fcfb60 2024-09-15T23:04:42.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.652+0000 7f378b207740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3764010bb0 con 0x55d9a3fdad40 2024-09-15T23:04:42.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.653+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.653+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54270/0 (socket says 172.21.15.66:54270) 2024-09-15T23:04:42.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.653+0000 7f3781d9b640 1 -- 172.21.15.66:0/3394599595 learned_addr learned my addr 172.21.15.66:0/3394599595 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:42.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.655+0000 7f378259c640 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.656+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3ff2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.659+0000 7f3781d9b640 1 -- 172.21.15.66:0/3394599595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 msgr2=0x55d9a3ff2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.659+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3ff2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.659+0000 7f3781d9b640 1 -- 172.21.15.66:0/3394599595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 msgr2=0x55d9a3fd6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.659+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.659+0000 7f3781d9b640 1 -- 172.21.15.66:0/3394599595 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9a3fcbf20 con 0x55d9a3fd0480 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.660+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f376c006dc0 tx=0x7f376c0d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09ddac7b4990cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.661+0000 7f376bfff640 1 -- 172.21.15.66:0/3394599595 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c09f910 con 0x55d9a3fd0480 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.661+0000 7f376bfff640 1 -- 172.21.15.66:0/3394599595 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9a3f427f0 con 0x55d9a3fd0480 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.661+0000 7f376bfff640 1 -- 172.21.15.66:0/3394599595 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0ccb40 con 0x55d9a3fd0480 2024-09-15T23:04:42.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.662+0000 7f378b207740 1 -- 172.21.15.66:0/3394599595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 msgr2=0x55d9a3fd84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.662+0000 7f378b207740 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f376c006dc0 tx=0x7f376c0d1040 comp rx=0 tx=0).stop 2024-09-15T23:04:42.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.670+0000 7f378b207740 1 -- 172.21.15.66:0/3394599595 shutdown_connections 2024-09-15T23:04:42.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.670+0000 7f378b207740 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3ff2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.670+0000 7f378b207740 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fd84b0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.670+0000 7f378b207740 1 --2- 172.21.15.66:0/3394599595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fd6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.670+0000 7f378b207740 1 -- 172.21.15.66:0/3394599595 >> 172.21.15.66:0/3394599595 conn(0x55d9a3fcc0f0 msgr2=0x55d9a3fd9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.671+0000 7f378b207740 1 -- 172.21.15.66:0/3394599595 shutdown_connections 2024-09-15T23:04:42.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.672+0000 7f378b207740 1 -- 172.21.15.66:0/3394599595 wait complete. 2024-09-15T23:04:42.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.672+0000 7f378b207740 1 -- start start 2024-09-15T23:04:42.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.673+0000 7f378b207740 1 Processor -- start 2024-09-15T23:04:42.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.673+0000 7f378b207740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fe2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.673+0000 7f378b207740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fe3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fe2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fe2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46592/0 (socket says 172.21.15.66:46592) 2024-09-15T23:04:42.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378259c640 1 -- 172.21.15.66:0/3609239298 learned_addr learned my addr 172.21.15.66:0/3609239298 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f3781d9b640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fe3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3764011aa0 con 0x55d9a3fd0480 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3764011310 con 0x55d9a3fcfb60 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f376400e420 con 0x55d9a3fdad40 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.674+0000 7f378b207740 10 client.0 _ll_register_callbacks cb 0x7f3774004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:42.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.675+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.682+0000 7f3782d9d640 1 -- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 msgr2=0x55d9a3fe2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.682+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fe2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.682+0000 7f3782d9d640 1 -- 172.21.15.66:0/3609239298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 msgr2=0x55d9a3fe3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:42.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.682+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fe3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.682+0000 7f3782d9d640 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9a3fd5b50 con 0x55d9a3fdad40 2024-09-15T23:04:42.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.683+0000 7f3782d9d640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdfde0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f377c00bd70 tx=0x7f377c003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba0105e84a6cd75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:42.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.683+0000 7f3769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:42.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.683+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c014420 con 0x55d9a3fdad40 2024-09-15T23:04:42.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.684+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9855+0+0 (secure 0 0 0) 0x7f377c0145c0 con 0x55d9a3fdad40 2024-09-15T23:04:42.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.685+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9a3f427f0 con 0x55d9a3fdad40 2024-09-15T23:04:42.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.687+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f377c014800 con 0x55d9a3fdad40 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.687+0000 7f378b207740 10 client.28369 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.687+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55d9a4056210 con 0x55d9a3fdad40 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.689+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d9a3f427f0 con 0x55d9a3fdad40 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f377c025070 con 0x55d9a3fdad40 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 10 client.28369 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 10 client.28369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 20 client.28369 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a4056970 0x55d9a4058d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 4 client.28369 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d9a3f3cd00 con 0x55d9a4056970 2024-09-15T23:04:42.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.690+0000 7f378259c640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a4056970 0x55d9a4058d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:42.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.697+0000 7f3769ffb640 10 client.28369 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:42.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.697+0000 7f378259c640 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a4056970 0x55d9a4058d90 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17beb38e73022cb3 server_cookie=fde0445325cdcdf in_seq=0 out_seq=0 2024-09-15T23:04:42.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.701+0000 7f3769ffb640 1 -- 172.21.15.66:0/3609239298 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d9a3f3cd00 con 0x55d9a4056970 2024-09-15T23:04:42.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.701+0000 7f3769ffb640 10 client.28369 handle_command_reply: tid=0 2024-09-15T23:04:42.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.701+0000 7f378b207740 1 client.28369 shutdown 2024-09-15T23:04:42.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 msgr2=0x55d9a3fdfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdfde0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f377c00bd70 tx=0x7f377c003c60 comp rx=0 tx=0).stop 2024-09-15T23:04:42.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 shutdown_connections 2024-09-15T23:04:42.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d9a3fdad40 0x55d9a3fdfde0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d9a3fd0480 0x55d9a3fe3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x55d9a4056970 0x55d9a4058d90 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 --2- 172.21.15.66:0/3609239298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9a3fcfb60 0x55d9a3fe2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 >> 172.21.15.66:0/3609239298 conn(0x55d9a3fcc0f0 msgr2=0x55d9a3fcaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f3769ffb640 0 client.28369 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 shutdown_connections 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.703+0000 7f378b207740 1 -- 172.21.15.66:0/3609239298 wait complete. 2024-09-15T23:04:42.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f378b207740 20 client.28369 trim_cache size 0 max 16384 2024-09-15T23:04:42.707 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:42.707 INFO:teuthology.orchestra.run.smithi066.stdout: "return_code": 0, 2024-09-15T23:04:42.707 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_tag": "30708662-1c1f-4a89-b6e3-326ccbb3b043", 2024-09-15T23:04:42.707 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": "asynchronous" 2024-09-15T23:04:42.707 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:42.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 msgr2=0x7f37700a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 0x7f37700a5a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d9a3fccf50 tx=0x7f3774005c00 comp rx=0 tx=0).stop 2024-09-15T23:04:42.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 msgr2=0x7f3784073e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:42.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 0x7f3784073e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b410 tx=0x7f376c00b8d0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 shutdown_connections 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f37700a35c0 0x7f37700a5a80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3784105f30 0x7f3784071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3784101440 0x7f3784073e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.704+0000 7f3788e2e640 1 --2- 172.21.15.66:0/3677936163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3784100b20 0x7f3784073930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.705+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 >> 172.21.15.66:0/3677936163 conn(0x7f37840fc7d0 msgr2=0x7f3784106ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.705+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 shutdown_connections 2024-09-15T23:04:42.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:42.705+0000 7f3788e2e640 1 -- 172.21.15.66:0/3677936163 wait complete. 2024-09-15T23:04:43.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: pgmap v610: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 130 op/s 2024-09-15T23:04:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: scrub queued for path: / 2024-09-15T23:04:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: scrub summary: active paths [/] 2024-09-15T23:04:43.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:43 smithi066 ceph-mon[31185]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: pgmap v610: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 130 op/s 2024-09-15T23:04:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: scrub queued for path: / 2024-09-15T23:04:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:43.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: scrub summary: active paths [/] 2024-09-15T23:04:43.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:43 smithi087 ceph-mon[35290]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: pgmap v610: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 130 op/s 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: scrub queued for path: / 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: scrub summary: active paths [/] 2024-09-15T23:04:43.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:43 smithi184 ceph-mon[35203]: scrub summary: idle+waiting paths [/] 2024-09-15T23:04:44.002 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.247+0000 7fe867fff640 1 -- 172.21.15.66:0/2749885007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 msgr2=0x7fe86811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.247+0000 7fe867fff640 1 --2- 172.21.15.66:0/2749885007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe86811d530 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe86001acb0 tx=0x7fe86003b920 comp rx=0 tx=0).stop 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.247+0000 7fe867fff640 1 -- 172.21.15.66:0/2749885007 shutdown_connections 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.247+0000 7fe867fff640 1 --2- 172.21.15.66:0/2749885007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe86811d530 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.248+0000 7fe867fff640 1 --2- 172.21.15.66:0/2749885007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86806ea30 0x7fe86806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.248+0000 7fe867fff640 1 --2- 172.21.15.66:0/2749885007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe868110190 0x7fe86806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.248+0000 7fe867fff640 1 -- 172.21.15.66:0/2749885007 >> 172.21.15.66:0/2749885007 conn(0x7fe868073180 msgr2=0x7fe868073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:44.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.248+0000 7fe867fff640 1 -- 172.21.15.66:0/2749885007 shutdown_connections 2024-09-15T23:04:44.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.248+0000 7fe867fff640 1 -- 172.21.15.66:0/2749885007 wait complete. 2024-09-15T23:04:44.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.249+0000 7fe867fff640 1 Processor -- start 2024-09-15T23:04:44.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 -- start start 2024-09-15T23:04:44.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe86806ea30 0x7fe86811a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe868110190 0x7fe8681168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8681132b0 con 0x7fe86811b140 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe868113130 con 0x7fe868110190 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.252+0000 7fe867fff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe868113430 con 0x7fe86806ea30 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.253+0000 7fe8677fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.253+0000 7fe8677fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54308/0 (socket says 172.21.15.66:54308) 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.253+0000 7fe8677fe640 1 -- 172.21.15.66:0/2962338534 learned_addr learned my addr 172.21.15.66:0/2962338534 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.254+0000 7fe8667fc640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe868110190 0x7fe8681168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:44.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.254+0000 7fe866ffd640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe86806ea30 0x7fe86811a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.257+0000 7fe8677fe640 1 -- 172.21.15.66:0/2962338534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe86806ea30 msgr2=0x7fe86811a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.257+0000 7fe8677fe640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe86806ea30 0x7fe86811a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.257+0000 7fe8677fe640 1 -- 172.21.15.66:0/2962338534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe868110190 msgr2=0x7fe8681168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.257+0000 7fe8677fe640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe868110190 0x7fe8681168c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.257+0000 7fe8677fe640 1 -- 172.21.15.66:0/2962338534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe868117530 con 0x7fe86811b140 2024-09-15T23:04:44.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.261+0000 7fe8677fe640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe86001ac00 tx=0x7fe860040a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:44.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.263+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860045070 con 0x7fe86811b140 2024-09-15T23:04:44.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.263+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe86004b430 con 0x7fe86811b140 2024-09-15T23:04:44.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.263+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86004a690 con 0x7fe86811b140 2024-09-15T23:04:44.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.264+0000 7fe867fff640 1 -- 172.21.15.66:0/2962338534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8681aaf60 con 0x7fe86811b140 2024-09-15T23:04:44.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.264+0000 7fe867fff640 1 -- 172.21.15.66:0/2962338534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681ab300 con 0x7fe86811b140 2024-09-15T23:04:44.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.270+0000 7fe867fff640 1 -- 172.21.15.66:0/2962338534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8681096f0 con 0x7fe86811b140 2024-09-15T23:04:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.276+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe860048020 con 0x7fe86811b140 2024-09-15T23:04:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.277+0000 7fe84ffff640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 0x7fe8500a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:44.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.277+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fe860102e90 con 0x7fe86811b140 2024-09-15T23:04:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.281+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe86003e070 con 0x7fe86811b140 2024-09-15T23:04:44.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.291+0000 7fe866ffd640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 0x7fe8500a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:44.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.297+0000 7fe866ffd640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 0x7fe8500a5a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe858009ae0 tx=0x7fe858005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:44.550 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:44.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.712+0000 7fe867fff640 1 -- 172.21.15.66:0/2962338534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8681ab530 con 0x7fe86811b140 2024-09-15T23:04:44.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.719+0000 7fe84ffff640 1 -- 172.21.15.66:0/2962338534 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+12005 (secure 0 0 0) 0x7fe8600cf430 con 0x7fe86811b140 2024-09-15T23:04:44.721 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:04:44.721 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"btime":"2024-09-15T23:04:42:485338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":74,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:41.510710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:04:44.722 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 74 2024-09-15T23:04:44.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.724+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 msgr2=0x7fe8500a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:44.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.724+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 0x7fe8500a5a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe858009ae0 tx=0x7fe858005f90 comp rx=0 tx=0).stop 2024-09-15T23:04:44.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.724+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 msgr2=0x7fe868116e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:44.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.724+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe86001ac00 tx=0x7fe860040a60 comp rx=0 tx=0).stop 2024-09-15T23:04:44.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 shutdown_connections 2024-09-15T23:04:44.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe8500a35c0 0x7fe8500a5a80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe86811b140 0x7fe868116e00 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe868110190 0x7fe8681168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 --2- 172.21.15.66:0/2962338534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe86806ea30 0x7fe86811a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 >> 172.21.15.66:0/2962338534 conn(0x7fe868073180 msgr2=0x7fe86811b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:44.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.729+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 shutdown_connections 2024-09-15T23:04:44.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:44.732+0000 7fe84dffb640 1 -- 172.21.15.66:0/2962338534 wait complete. 2024-09-15T23:04:45.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.356+0000 7f1af9ada640 1 -- 172.21.15.66:0/724245508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 msgr2=0x7f1af4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.356+0000 7f1af9ada640 1 --2- 172.21.15.66:0/724245508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4109c90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009ca0 tx=0x7f1ae402a8f0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.360+0000 7f1af9ada640 1 -- 172.21.15.66:0/724245508 shutdown_connections 2024-09-15T23:04:45.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.360+0000 7f1af9ada640 1 --2- 172.21.15.66:0/724245508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af411b140 0x7f1af411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.360+0000 7f1af9ada640 1 --2- 172.21.15.66:0/724245508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4109c90 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.360+0000 7f1af9ada640 1 --2- 172.21.15.66:0/724245508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4109450 0x7f1af4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.360+0000 7f1af9ada640 1 -- 172.21.15.66:0/724245508 >> 172.21.15.66:0/724245508 conn(0x7f1af406e140 msgr2=0x7f1af406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.362+0000 7f1af9ada640 1 -- 172.21.15.66:0/724245508 shutdown_connections 2024-09-15T23:04:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.366+0000 7f1af9ada640 1 -- 172.21.15.66:0/724245508 wait complete. 2024-09-15T23:04:45.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.367+0000 7f1af9ada640 1 Processor -- start 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 -- start start 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af4109450 0x7f1af4118720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af411b140 0x7f1af4111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1af4120ed0 con 0x7f1af4109830 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1af4120d50 con 0x7f1af411b140 2024-09-15T23:04:45.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.370+0000 7f1af9ada640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1af4121050 con 0x7f1af4109450 2024-09-15T23:04:45.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.373+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.373+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54334/0 (socket says 172.21.15.66:54334) 2024-09-15T23:04:45.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.373+0000 7f1af2ffd640 1 -- 172.21.15.66:0/1856697820 learned_addr learned my addr 172.21.15.66:0/1856697820 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:45.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.377+0000 7f1af37fe640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af4109450 0x7f1af4118720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.377+0000 7f1af3fff640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af411b140 0x7f1af4111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.379+0000 7f1af2ffd640 1 -- 172.21.15.66:0/1856697820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af4109450 msgr2=0x7f1af4118720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.379+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af4109450 0x7f1af4118720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.379+0000 7f1af2ffd640 1 -- 172.21.15.66:0/1856697820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af411b140 msgr2=0x7f1af4111cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.379+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af411b140 0x7f1af4111cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.379+0000 7f1af2ffd640 1 -- 172.21.15.66:0/1856697820 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af41122c0 con 0x7f1af4109830 2024-09-15T23:04:45.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.385+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1ae402aee0 tx=0x7f1ae40316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.386+0000 7f1af0ff9640 1 -- 172.21.15.66:0/1856697820 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4003e20 con 0x7f1af4109830 2024-09-15T23:04:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.386+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af4112550 con 0x7f1af4109830 2024-09-15T23:04:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.386+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af4116560 con 0x7f1af4109830 2024-09-15T23:04:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.386+0000 7f1af0ff9640 1 -- 172.21.15.66:0/1856697820 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae402d070 con 0x7f1af4109830 2024-09-15T23:04:45.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.386+0000 7f1af0ff9640 1 -- 172.21.15.66:0/1856697820 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae402fbf0 con 0x7f1af4109830 2024-09-15T23:04:45.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.393+0000 7f1afbeb3740 1 Processor -- start 2024-09-15T23:04:45.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.395+0000 7f1af0ff9640 1 -- 172.21.15.66:0/1856697820 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1ae40305f0 con 0x7f1af4109830 2024-09-15T23:04:45.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.396+0000 7f1af0ff9640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 0x7f1ae00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.397+0000 7f1af0ff9640 1 -- 172.21.15.66:0/1856697820 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f1ae40f16e0 con 0x7f1af4109830 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 -- start start 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477322880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5654772882e0 con 0x565477322dc0 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56547722fce0 con 0x56547732d680 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5654772842a0 con 0x5654773224a0 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477322880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.400+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.401+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54346/0 (socket says 172.21.15.66:54346) 2024-09-15T23:04:45.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.401+0000 7f1af2ffd640 1 -- 172.21.15.66:0/3927354109 learned_addr learned my addr 172.21.15.66:0/3927354109 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:45.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.401+0000 7f1af3fff640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 0x7f1ae00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.401+0000 7f1af3fff640 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.402+0000 7f1af2ffd640 1 -- 172.21.15.66:0/3927354109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 msgr2=0x565477322880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.402+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477322880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.402+0000 7f1af2ffd640 1 -- 172.21.15.66:0/3927354109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 msgr2=0x56547732fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.402+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.402+0000 7f1af2ffd640 1 -- 172.21.15.66:0/3927354109 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565477214440 con 0x565477322dc0 2024-09-15T23:04:45.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.403+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40b99e0 tx=0x7f1ae402f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f840dc8cf6f1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.404+0000 7f1ae9ffb640 1 -- 172.21.15.66:0/3927354109 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40d5070 con 0x565477322dc0 2024-09-15T23:04:45.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.404+0000 7f1ae9ffb640 1 -- 172.21.15.66:0/3927354109 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4036030 con 0x565477322dc0 2024-09-15T23:04:45.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.404+0000 7f1ae9ffb640 1 -- 172.21.15.66:0/3927354109 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40eeb60 con 0x565477322dc0 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.405+0000 7f1afbeb3740 1 -- 172.21.15.66:0/3927354109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 msgr2=0x56547732d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.405+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40b99e0 tx=0x7f1ae402f6c0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1af3fff640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 0x7f1ae00a5a80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x56547731fdb0 tx=0x7f1aec00a0d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 -- 172.21.15.66:0/3927354109 shutdown_connections 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732d140 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/3927354109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477322880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 -- 172.21.15.66:0/3927354109 >> 172.21.15.66:0/3927354109 conn(0x56547731ea30 msgr2=0x56547731ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 -- 172.21.15.66:0/3927354109 shutdown_connections 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.406+0000 7f1afbeb3740 1 -- 172.21.15.66:0/3927354109 wait complete. 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 -- start start 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 Processor -- start 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x56547732cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.407+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x565477330010 con 0x565477322dc0 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x565477243050 con 0x56547732d680 2024-09-15T23:04:45.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565477330190 con 0x5654773224a0 2024-09-15T23:04:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1afbeb3740 10 client.0 _ll_register_callbacks cb 0x565477283160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54358/0 (socket says 172.21.15.66:54358) 2024-09-15T23:04:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.408+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2146952700 learned_addr learned my addr 172.21.15.66:0/2146952700 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:45.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.409+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x56547732cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.411+0000 7f1af3fff640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.412+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2146952700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 msgr2=0x56547732cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.412+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x56547732cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.412+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 msgr2=0x56547732a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.412+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.412+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2146952700 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565476ff93c0 con 0x565477322dc0 2024-09-15T23:04:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.415+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f80 tx=0x7f1ae40eea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f662a07a30a4e1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.415+0000 7f1ad2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40da070 con 0x565477322dc0 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae4036030 con 0x565477322dc0 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f1ae40c5f70 con 0x565477322dc0 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f1ae40d5040 con 0x565477322dc0 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1afbeb3740 10 client.19281 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:45.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.416+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x565477330010 con 0x565477322dc0 2024-09-15T23:04:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:45 smithi184 ceph-mon[35203]: pgmap v611: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-15T23:04:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:45 smithi184 ceph-mon[35203]: osdmap e118: 12 total, 12 up, 12 in 2024-09-15T23:04:45.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:45 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2962338534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4036030 con 0x565477322dc0 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f1ae4004b40 con 0x565477322dc0 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 10 client.19281 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 10 client.19281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 20 client.19281 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56547735efc0 0x5654773613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 4 client.19281 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.421+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565477295850 con 0x56547735efc0 2024-09-15T23:04:45.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.422+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56547735efc0 0x5654773613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.426 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:45 smithi066 ceph-mon[31185]: pgmap v611: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-15T23:04:45.426 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:45 smithi066 ceph-mon[31185]: osdmap e118: 12 total, 12 up, 12 in 2024-09-15T23:04:45.426 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:45 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2962338534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.426+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56547735efc0 0x5654773613e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc72855f935e82d6 server_cookie=c7bc18ee7d249dcf in_seq=0 out_seq=0 2024-09-15T23:04:45.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.427+0000 7f1ad2ffd640 10 client.19281 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:45.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.431+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2146952700 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565477295850 con 0x56547735efc0 2024-09-15T23:04:45.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.431+0000 7f1ad2ffd640 10 client.19281 handle_command_reply: tid=0 2024-09-15T23:04:45.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.431+0000 7f1afbeb3740 1 client.19281 shutdown 2024-09-15T23:04:45.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.431+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 msgr2=0x56547732a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.431+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000f80 tx=0x7f1ae40eea60 comp rx=0 tx=0).stop 2024-09-15T23:04:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 shutdown_connections 2024-09-15T23:04:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x56547735efc0 0x5654773613e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x56547732a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x56547732a290 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2146952700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x56547732cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1ad2ffd640 0 client.19281 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:45.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.438+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 >> 172.21.15.66:0/2146952700 conn(0x56547731ea30 msgr2=0x565477324760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.444+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 shutdown_connections 2024-09-15T23:04:45.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.447+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2146952700 wait complete. 2024-09-15T23:04:45.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.447+0000 7f1afbeb3740 20 client.19281 trim_cache size 0 max 16384 2024-09-15T23:04:45.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.480+0000 7f1afbeb3740 1 Processor -- start 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 -- start start 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654773224a0 0x5654773391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 0x565477366c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4010360 con 0x5654773224a0 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4012170 con 0x56547732d680 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4010af0 con 0x565477322dc0 2024-09-15T23:04:45.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1af2ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 0x565477366c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1af3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1af3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46650/0 (socket says 172.21.15.66:46650) 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.481+0000 7f1af3fff640 1 -- 172.21.15.66:0/2286948319 learned_addr learned my addr 172.21.15.66:0/2286948319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654773224a0 0x5654773391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2286948319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 msgr2=0x5654773671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2286948319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654773224a0 msgr2=0x5654773391e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654773224a0 0x5654773391e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 -- 172.21.15.66:0/2286948319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565477361750 con 0x565477322dc0 2024-09-15T23:04:45.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.482+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 0x565477366c90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56547732b840 tx=0x7f1ae402ffe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ad28d741f6d943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.484+0000 7f1ae97fa640 1 -- 172.21.15.66:0/2286948319 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40da070 con 0x565477322dc0 2024-09-15T23:04:45.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.485+0000 7f1ae97fa640 1 -- 172.21.15.66:0/2286948319 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4036070 con 0x565477322dc0 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.489+0000 7f1ae97fa640 1 -- 172.21.15.66:0/2286948319 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40bdc80 con 0x565477322dc0 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2286948319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 msgr2=0x565477366c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 0x565477366c90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56547732b840 tx=0x7f1ae402ffe0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2286948319 shutdown_connections 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565477322dc0 0x565477366c90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2286948319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5654773224a0 0x5654773391e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.490+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2286948319 >> 172.21.15.66:0/2286948319 conn(0x56547731ea30 msgr2=0x5654773293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.498+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2286948319 shutdown_connections 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.502+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2286948319 wait complete. 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.502+0000 7f1afbeb3740 1 -- start start 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 Processor -- start 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477335870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x565477330ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773310e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad40119e0 con 0x565477322dc0 2024-09-15T23:04:45.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4011250 con 0x56547732d680 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad400e340 con 0x5654773224a0 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.503+0000 7f1afbeb3740 10 client.0 _ll_register_callbacks cb 0x7f1adc0093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.504+0000 7f1af3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.504+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477335870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.504+0000 7f1af3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773310e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46662/0 (socket says 172.21.15.66:46662) 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.504+0000 7f1af3fff640 1 -- 172.21.15.66:0/2334969275 learned_addr learned my addr 172.21.15.66:0/2334969275 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:45.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.505+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x565477330ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af37fe640 1 -- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 msgr2=0x5654773310e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773310e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af37fe640 1 -- 172.21.15.66:0/2334969275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 msgr2=0x565477330ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x565477330ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af37fe640 1 -- 172.21.15.66:0/2334969275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547732d350 con 0x5654773224a0 2024-09-15T23:04:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.508+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x565477330ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:04:45.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.511+0000 7f1af37fe640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477335870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5654773619c0 tx=0x7f1adc009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b83852da147cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:45.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.513+0000 7f1ad2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:45.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.513+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc01f340 con 0x5654773224a0 2024-09-15T23:04:45.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.513+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae4036070 con 0x5654773224a0 2024-09-15T23:04:45.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.513+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f1adc01f4e0 con 0x5654773224a0 2024-09-15T23:04:45.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.516+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f1adc02f050 con 0x5654773224a0 2024-09-15T23:04:45.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.518+0000 7f1afbeb3740 10 client.28390 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:45.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.518+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5654773c98d0 con 0x5654773224a0 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.525+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae4036070 con 0x5654773224a0 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.525+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f1adc028bb0 con 0x5654773224a0 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 10 client.28390 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 10 client.28390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 20 client.28390 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5654773ca040 0x5654773cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 4 client.28390 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56547728fd60 con 0x5654773ca040 2024-09-15T23:04:45.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.526+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5654773ca040 0x5654773cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:45.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.533+0000 7f1af2ffd640 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5654773ca040 0x5654773cc460 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d825df865c57de95 server_cookie=6c30efbed0d5c16f in_seq=0 out_seq=0 2024-09-15T23:04:45.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.533+0000 7f1ad2ffd640 10 client.28390 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:45.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.534+0000 7f1ad2ffd640 1 -- 172.21.15.66:0/2334969275 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56547728fd60 con 0x5654773ca040 2024-09-15T23:04:45.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.534+0000 7f1ad2ffd640 10 client.28390 handle_command_reply: tid=0 2024-09-15T23:04:45.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.534+0000 7f1afbeb3740 1 client.28390 shutdown 2024-09-15T23:04:45.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.539+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 msgr2=0x565477335870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.539+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477335870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5654773619c0 tx=0x7f1adc009f80 comp rx=0 tx=0).stop 2024-09-15T23:04:45.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 shutdown_connections 2024-09-15T23:04:45.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5654773ca040 0x5654773cc460 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56547732d680 0x5654773310e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565477322dc0 0x565477330ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 --2- 172.21.15.66:0/2334969275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654773224a0 0x565477335870 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1ad2ffd640 0 client.28390 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:45.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 >> 172.21.15.66:0/2334969275 conn(0x56547731ea30 msgr2=0x56547732baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 shutdown_connections 2024-09-15T23:04:45.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.544+0000 7f1afbeb3740 1 -- 172.21.15.66:0/2334969275 wait complete. 2024-09-15T23:04:45.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.545+0000 7f1afbeb3740 20 client.28390 trim_cache size 0 max 16384 2024-09-15T23:04:45.550 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:45.550 INFO:teuthology.orchestra.run.smithi066.stdout: "status": "no active scrubs running", 2024-09-15T23:04:45.550 INFO:teuthology.orchestra.run.smithi066.stdout: "scrubs": {} 2024-09-15T23:04:45.551 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:45.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 msgr2=0x7f1ae00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 0x7f1ae00a5a80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x56547731fdb0 tx=0x7f1aec00a0d0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 msgr2=0x7f1af4111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:45.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1ae402aee0 tx=0x7f1ae40316b0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 shutdown_connections 2024-09-15T23:04:45.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1ae00a35c0 0x7f1ae00a5a80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af411b140 0x7f1af4111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1af4109830 0x7f1af4111790 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 --2- 172.21.15.66:0/1856697820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1af4109450 0x7f1af4118720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:45.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.546+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 >> 172.21.15.66:0/1856697820 conn(0x7f1af406e140 msgr2=0x7f1af411bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:45.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.547+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 shutdown_connections 2024-09-15T23:04:45.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:45.548+0000 7f1af9ada640 1 -- 172.21.15.66:0/1856697820 wait complete. 2024-09-15T23:04:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:45 smithi087 ceph-mon[35290]: pgmap v611: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-15T23:04:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:45 smithi087 ceph-mon[35290]: osdmap e118: 12 total, 12 up, 12 in 2024-09-15T23:04:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:45 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2962338534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:46.003 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24461 quiesce db --cancel --all' 2024-09-15T23:04:46.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24461 quiesce db --cancel --all 2024-09-15T23:04:46.320 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:46 smithi066 ceph-mon[31185]: scrub summary: idle 2024-09-15T23:04:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:46 smithi087 ceph-mon[35290]: scrub summary: idle 2024-09-15T23:04:46.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:46 smithi184 ceph-mon[35203]: scrub summary: idle 2024-09-15T23:04:46.679 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:04:46.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:04:46.925 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:47.433 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:47 smithi066 ceph-mon[31185]: pgmap v613: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-09-15T23:04:47.500 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:47 smithi087 ceph-mon[35290]: pgmap v613: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-09-15T23:04:47.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.605+0000 7ff05bed3640 1 -- 172.21.15.66:0/2575934696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054102ef0 msgr2=0x7ff05410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.605+0000 7ff05bed3640 1 --2- 172.21.15.66:0/2575934696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054102ef0 0x7ff05410da40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff04c01ace0 tx=0x7ff04c03ba20 comp rx=0 tx=0).stop 2024-09-15T23:04:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 -- 172.21.15.66:0/2575934696 shutdown_connections 2024-09-15T23:04:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 --2- 172.21.15.66:0/2575934696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054102ef0 0x7ff05410da40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 --2- 172.21.15.66:0/2575934696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff0541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 --2- 172.21.15.66:0/2575934696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff054100e20 0x7ff054101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 -- 172.21.15.66:0/2575934696 >> 172.21.15.66:0/2575934696 conn(0x7ff0540fc7d0 msgr2=0x7ff0540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 -- 172.21.15.66:0/2575934696 shutdown_connections 2024-09-15T23:04:47.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.608+0000 7ff05bed3640 1 -- 172.21.15.66:0/2575934696 wait complete. 2024-09-15T23:04:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.609+0000 7ff05bed3640 1 Processor -- start 2024-09-15T23:04:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.609+0000 7ff05bed3640 1 -- start start 2024-09-15T23:04:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.609+0000 7ff05bed3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054100e20 0x7ff054193340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.609+0000 7ff05bed3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05bed3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff054102ef0 0x7ff054193dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05bed3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff05406e580 con 0x7ff054102ef0 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05bed3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff05406e400 con 0x7ff054102570 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05bed3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff05406e700 con 0x7ff054100e20 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46688/0 (socket says 172.21.15.66:46688) 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 -- 172.21.15.66:0/3946187349 learned_addr learned my addr 172.21.15.66:0/3946187349 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:47.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff059c6f640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054100e20 0x7ff054193340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 -- 172.21.15.66:0/3946187349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054100e20 msgr2=0x7ff054193340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054100e20 0x7ff054193340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 -- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff054102ef0 msgr2=0x7ff054193dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff054102ef0 0x7ff054193dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.610+0000 7ff05946e640 1 -- 172.21.15.66:0/3946187349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05410c3c0 con 0x7ff054102570 2024-09-15T23:04:47.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.611+0000 7ff05946e640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff04400ea20 tx=0x7ff04400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.613+0000 7ff04affd640 1 -- 172.21.15.66:0/3946187349 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04400ccc0 con 0x7ff054102570 2024-09-15T23:04:47.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.613+0000 7ff04affd640 1 -- 172.21.15.66:0/3946187349 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff04400ce60 con 0x7ff054102570 2024-09-15T23:04:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.614+0000 7ff04affd640 1 -- 172.21.15.66:0/3946187349 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0440187e0 con 0x7ff054102570 2024-09-15T23:04:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.615+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05410c6b0 con 0x7ff054102570 2024-09-15T23:04:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.615+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05410cbf0 con 0x7ff054102570 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.618+0000 7ff05e2ac740 1 Processor -- start 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 -- start start 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084762bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 0x5608476366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560847636be0 0x560847638fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560847590200 con 0x560847636be0 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560847536dc0 con 0x56084762ba00 2024-09-15T23:04:47.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.619+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56084758c1c0 con 0x56084762c320 2024-09-15T23:04:47.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.622+0000 7ff05a470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084762bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.622+0000 7ff05a470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084762bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46700/0 (socket says 172.21.15.66:46700) 2024-09-15T23:04:47.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.622+0000 7ff05a470640 1 -- 172.21.15.66:0/2433430438 learned_addr learned my addr 172.21.15.66:0/2433430438 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:47.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.622+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 0x5608476366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff04affd640 1 -- 172.21.15.66:0/3946187349 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff04401f020 con 0x7ff054102570 2024-09-15T23:04:47.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff059c6f640 1 -- 172.21.15.66:0/2433430438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 msgr2=0x56084762bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084762bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff059c6f640 1 -- 172.21.15.66:0/2433430438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560847636be0 msgr2=0x560847638fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560847636be0 0x560847638fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.623+0000 7ff059c6f640 1 -- 172.21.15.66:0/2433430438 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560847301620 con 0x56084762c320 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.624+0000 7ff04affd640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 0x7ff0400a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.624+0000 7ff04affd640 1 -- 172.21.15.66:0/3946187349 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7ff0440d0300 con 0x7ff054102570 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.624+0000 7ff05a470640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 0x7ff0400a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.625+0000 7ff05a470640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 0x7ff0400a58e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005df0 tx=0x7ff04c005d80 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.628+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 0x5608476366a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0500099a0 tx=0x7ff050009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9e0ff95de0bc62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.632+0000 7ff03ffff640 1 -- 172.21.15.66:0/2433430438 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050017070 con 0x56084762c320 2024-09-15T23:04:47.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.632+0000 7ff03ffff640 1 -- 172.21.15.66:0/2433430438 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff050013470 con 0x56084762c320 2024-09-15T23:04:47.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.632+0000 7ff03ffff640 1 -- 172.21.15.66:0/2433430438 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050012630 con 0x56084762c320 2024-09-15T23:04:47.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.634+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2433430438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 msgr2=0x5608476366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.634+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 0x5608476366a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0500099a0 tx=0x7ff050009e60 comp rx=0 tx=0).stop 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2433430438 shutdown_connections 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560847636be0 0x560847638fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762c320 0x5608476366a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2433430438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084762bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2433430438 >> 172.21.15.66:0/2433430438 conn(0x560847627f90 msgr2=0x560847628370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.635+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2433430438 shutdown_connections 2024-09-15T23:04:47.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.641+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2433430438 wait complete. 2024-09-15T23:04:47.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.642+0000 7ff05e2ac740 1 -- start start 2024-09-15T23:04:47.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.642+0000 7ff05e2ac740 1 Processor -- start 2024-09-15T23:04:47.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.642+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x5608476365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.642+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x5608476338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.642+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.643+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5608476397b0 con 0x56084762c320 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.643+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56084752ac50 con 0x560847636be0 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.643+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560847639930 con 0x56084762ba00 2024-09-15T23:04:47.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.643+0000 7ff05e2ac740 10 client.0 _ll_register_callbacks cb 0x56084753cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:47.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.644+0000 7ff05a470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.644+0000 7ff05a470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46708/0 (socket says 172.21.15.66:46708) 2024-09-15T23:04:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.644+0000 7ff05a470640 1 -- 172.21.15.66:0/1359314593 learned_addr learned my addr 172.21.15.66:0/1359314593 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:47.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.645+0000 7ff059c6f640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x5608476365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05946e640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x5608476338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 -- 172.21.15.66:0/1359314593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 msgr2=0x5608476365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x5608476365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 -- 172.21.15.66:0/1359314593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 msgr2=0x5608476338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x5608476338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 -- 172.21.15.66:0/1359314593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608476346e0 con 0x560847636be0 2024-09-15T23:04:47.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff05a470640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff04c003bd0 tx=0x7ff04c03bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce3f1169e43ebf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.648+0000 7ff03d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:47.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.649+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c044040 con 0x560847636be0 2024-09-15T23:04:47.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.649+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff050013470 con 0x560847636be0 2024-09-15T23:04:47.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.649+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7ff04c019040 con 0x560847636be0 2024-09-15T23:04:47.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.649+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff04c040910 con 0x560847636be0 2024-09-15T23:04:47.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.650+0000 7ff05e2ac740 10 client.28496 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:47.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.650+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5608476454d0 con 0x560847636be0 2024-09-15T23:04:47.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.652+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff050013470 con 0x560847636be0 2024-09-15T23:04:47.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.652+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7ff04c05f070 con 0x560847636be0 2024-09-15T23:04:47.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 10 client.28496 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 10 client.28496 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 20 client.28496 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847646930 0x560847648db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 4 client.28496 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.656+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56084759d770 con 0x560847646930 2024-09-15T23:04:47.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.657+0000 7ff059c6f640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847646930 0x560847648db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.664 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:47.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.664+0000 7ff03d7fa640 10 client.28496 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:47.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.664+0000 7ff059c6f640 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847646930 0x560847648db0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93288e184a71ff13 server_cookie=1ba3b0e640d77422 in_seq=0 out_seq=0 2024-09-15T23:04:47.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.666+0000 7ff03d7fa640 1 -- 172.21.15.66:0/1359314593 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56084759d770 con 0x560847646930 2024-09-15T23:04:47.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.666+0000 7ff03d7fa640 10 client.28496 handle_command_reply: tid=0 2024-09-15T23:04:47.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.667+0000 7ff05e2ac740 1 client.28496 shutdown 2024-09-15T23:04:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:47 smithi184 ceph-mon[35203]: pgmap v613: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-09-15T23:04:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 msgr2=0x560847633eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff04c003bd0 tx=0x7ff04c03bf20 comp rx=0 tx=0).stop 2024-09-15T23:04:47.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 shutdown_connections 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847646930 0x560847648db0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847636be0 0x560847633eb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x5608476338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/1359314593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x5608476365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 >> 172.21.15.66:0/1359314593 conn(0x560847627f90 msgr2=0x5608476271d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff03d7fa640 0 client.28496 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:47.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 shutdown_connections 2024-09-15T23:04:47.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.671+0000 7ff05e2ac740 1 -- 172.21.15.66:0/1359314593 wait complete. 2024-09-15T23:04:47.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.672+0000 7ff05e2ac740 20 client.28496 trim_cache size 0 max 16384 2024-09-15T23:04:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.707+0000 7ff05e2ac740 1 Processor -- start 2024-09-15T23:04:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 -- start start 2024-09-15T23:04:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x56084764ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x560847630b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541b5800 con 0x56084762c320 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541b7610 con 0x560847627f90 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff059c6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.708+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541b5f90 con 0x56084762ba00 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46716/0 (socket says 172.21.15.66:46716) 2024-09-15T23:04:47.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 -- 172.21.15.66:0/2689873894 learned_addr learned my addr 172.21.15.66:0/2689873894 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff05a470640 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x560847630b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 -- 172.21.15.66:0/2689873894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 msgr2=0x56084764ebc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x56084764ebc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 -- 172.21.15.66:0/2689873894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 msgr2=0x560847630b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x560847630b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.709+0000 7ff059c6f640 1 -- 172.21.15.66:0/2689873894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560847639340 con 0x560847627f90 2024-09-15T23:04:47.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.710+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff050013fd0 tx=0x7ff050008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5939e5da6b8faae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.710+0000 7ff03f7fe640 1 -- 172.21.15.66:0/2689873894 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050017040 con 0x560847627f90 2024-09-15T23:04:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.710+0000 7ff03f7fe640 1 -- 172.21.15.66:0/2689873894 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff05002b070 con 0x560847627f90 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.711+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2689873894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 msgr2=0x56084764e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.711+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff050013fd0 tx=0x7ff050008040 comp rx=0 tx=0).stop 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.712+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2689873894 shutdown_connections 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.712+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x560847630b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.712+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56084762ba00 0x56084764ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.712+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2689873894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560847627f90 0x56084764e680 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.712+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2689873894 >> 172.21.15.66:0/2689873894 conn(0x560847623520 msgr2=0x560847635920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.718+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2689873894 shutdown_connections 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.718+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2689873894 wait complete. 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 -- start start 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 Processor -- start 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560847627f90 0x56084763ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084763f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541b6e80 con 0x56084762c320 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541b66f0 con 0x56084762ba00 2024-09-15T23:04:47.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff05419e7b0 con 0x560847627f90 2024-09-15T23:04:47.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.719+0000 7ff05e2ac740 10 client.0 _ll_register_callbacks cb 0x7ff04c0010a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:47.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.721+0000 7ff05a470640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.721+0000 7ff05a470640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54438/0 (socket says 172.21.15.66:54438) 2024-09-15T23:04:47.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.721+0000 7ff05a470640 1 -- 172.21.15.66:0/2208085878 learned_addr learned my addr 172.21.15.66:0/2208085878 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:47.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.721+0000 7ff05946e640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084763f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.723+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560847627f90 0x56084763ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.725+0000 7ff05a470640 1 -- 172.21.15.66:0/2208085878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560847627f90 msgr2=0x56084763ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.725+0000 7ff05a470640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560847627f90 0x56084763ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.725+0000 7ff05a470640 1 -- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 msgr2=0x56084763f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.725+0000 7ff05a470640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084763f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.725+0000 7ff05a470640 1 -- 172.21.15.66:0/2208085878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608476317b0 con 0x56084762c320 2024-09-15T23:04:47.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.730+0000 7ff05a470640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff04c01aa70 tx=0x7ff04c040d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d1571222120d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.730+0000 7ff03d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:47.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.731+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c044030 con 0x56084762c320 2024-09-15T23:04:47.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.731+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7ff04c057d90 con 0x56084762c320 2024-09-15T23:04:47.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.731+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff05002b070 con 0x56084762c320 2024-09-15T23:04:47.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.731+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7ff04c077050 con 0x56084762c320 2024-09-15T23:04:47.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.733+0000 7ff05e2ac740 10 client.19296 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:47.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.733+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5608476b1b80 con 0x56084762c320 2024-09-15T23:04:47.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.735+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff05002b070 con 0x56084762c320 2024-09-15T23:04:47.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.735+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7ff04c05f040 con 0x56084762c320 2024-09-15T23:04:47.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 10 client.19296 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:47.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 10 client.19296 resolve_mds: validated gid 24461 aka daemon mds.b 2024-09-15T23:04:47.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 20 client.19296 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:47.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847636be0 0x5608476b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 4 client.19296 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-15T23:04:47.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.736+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x560847597c80 con 0x560847636be0 2024-09-15T23:04:47.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.741+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847636be0 0x5608476b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.741+0000 7ff059c6f640 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847636be0 0x5608476b43a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63f2a1e60d23e63 server_cookie=d29f95cf8bcde504 in_seq=0 out_seq=0 2024-09-15T23:04:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.741+0000 7ff03d7fa640 10 client.19296 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.742+0000 7ff03d7fa640 1 -- 172.21.15.66:0/2208085878 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x560847597c80 con 0x560847636be0 2024-09-15T23:04:47.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.742+0000 7ff03d7fa640 10 client.19296 handle_command_reply: tid=0 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.742+0000 7ff05e2ac740 1 client.19296 shutdown 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.743+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 msgr2=0x56084763bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.743+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff04c01aa70 tx=0x7ff04c040d60 comp rx=0 tx=0).stop 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 shutdown_connections 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56084762c320 0x56084763bbd0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560847636be0 0x5608476b43a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56084762ba00 0x56084763f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 --2- 172.21.15.66:0/2208085878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560847627f90 0x56084763ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff03d7fa640 0 client.19296 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 >> 172.21.15.66:0/2208085878 conn(0x560847623520 msgr2=0x56084762e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 shutdown_connections 2024-09-15T23:04:47.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.744+0000 7ff05e2ac740 1 -- 172.21.15.66:0/2208085878 wait complete. 2024-09-15T23:04:47.750 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:04:47.750 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 74, 2024-09-15T23:04:47.751 INFO:teuthology.orchestra.run.smithi066.stdout: "leader": 24461, 2024-09-15T23:04:47.751 INFO:teuthology.orchestra.run.smithi066.stdout: "set_version": 68, 2024-09-15T23:04:47.751 INFO:teuthology.orchestra.run.smithi066.stdout: "sets": {} 2024-09-15T23:04:47.751 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:04:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.745+0000 7ff05e2ac740 20 client.19296 trim_cache size 0 max 16384 2024-09-15T23:04:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.750+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 msgr2=0x7ff0400a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.750+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 0x7ff0400a58e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005df0 tx=0x7ff04c005d80 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.750+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 msgr2=0x7ff054193880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.750+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff04400ea20 tx=0x7ff04400ee20 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 shutdown_connections 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0400a3420 0x7ff0400a58e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff054102ef0 0x7ff054193dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff054102570 0x7ff054193880 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 --2- 172.21.15.66:0/3946187349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff054100e20 0x7ff054193340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 >> 172.21.15.66:0/3946187349 conn(0x7ff0540fc7d0 msgr2=0x7ff054103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 shutdown_connections 2024-09-15T23:04:47.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:47.751+0000 7ff05bed3640 1 -- 172.21.15.66:0/3946187349 wait complete. 2024-09-15T23:04:48.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.598+0000 7fa70ffff640 1 -- 172.21.15.66:0/3794078993 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708030980 con 0x7fa718074990 2024-09-15T23:04:48.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 -- 172.21.15.66:0/3794078993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718074990 msgr2=0x7fa71807b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:48.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/3794078993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718074990 0x7fa71807b3c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa708009860 tx=0x7fa70802a360 comp rx=0 tx=0).stop 2024-09-15T23:04:48.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 -- 172.21.15.66:0/3794078993 shutdown_connections 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/3794078993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718074990 0x7fa71807b3c0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/3794078993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718109e00 0x7fa7180742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/3794078993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718109450 0x7fa718109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.600+0000 7fa71f7cb640 1 -- 172.21.15.66:0/3794078993 >> 172.21.15.66:0/3794078993 conn(0x7fa71806e140 msgr2=0x7fa71806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.601+0000 7fa71f7cb640 1 -- 172.21.15.66:0/3794078993 shutdown_connections 2024-09-15T23:04:48.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.601+0000 7fa71f7cb640 1 -- 172.21.15.66:0/3794078993 wait complete. 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.601+0000 7fa71f7cb640 1 Processor -- start 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 -- start start 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718109450 0x7fa718076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718109e00 0x7fa718076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa718082c40 con 0x7fa718109e00 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa718082ac0 con 0x7fa718074990 2024-09-15T23:04:48.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71f7cb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa718082dc0 con 0x7fa718109450 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71d567640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71d567640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46744/0 (socket says 172.21.15.66:46744) 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.602+0000 7fa71d567640 1 -- 172.21.15.66:0/1824259578 learned_addr learned my addr 172.21.15.66:0/1824259578 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.603+0000 7fa71d567640 1 -- 172.21.15.66:0/1824259578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718109450 msgr2=0x7fa718076250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.603+0000 7fa71d567640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718109450 0x7fa718076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.603+0000 7fa71d567640 1 -- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718109e00 msgr2=0x7fa718076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.603+0000 7fa71d567640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718109e00 0x7fa718076790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.603+0000 7fa71d567640 1 -- 172.21.15.66:0/1824259578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa718077020 con 0x7fa718074990 2024-09-15T23:04:48.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.604+0000 7fa71d567640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa71000ba50 tx=0x7fa71000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:48.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.604+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa710019070 con 0x7fa718074990 2024-09-15T23:04:48.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.604+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa71000cc10 con 0x7fa718074990 2024-09-15T23:04:48.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.604+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7181372f0 con 0x7fa718074990 2024-09-15T23:04:48.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.605+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa710007710 con 0x7fa718074990 2024-09-15T23:04:48.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.608+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa718137830 con 0x7fa718074990 2024-09-15T23:04:48.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.608+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fa71001c070 con 0x7fa718074990 2024-09-15T23:04:48.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.609+0000 7fa70e7fc640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 0x7fa7040a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.609+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fa7100cf240 con 0x7fa718074990 2024-09-15T23:04:48.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.610+0000 7fa71cd66640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 0x7fa7040a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:48.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.613+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa718073b00 con 0x7fa718074990 2024-09-15T23:04:48.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.616+0000 7fa71cd66640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 0x7fa7040a5820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa714005fd0 tx=0x7fa714005a00 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:48.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:48.622+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa71009bc20 con 0x7fa718074990 2024-09-15T23:04:49.036 INFO:tasks.quiescer:done joining Quiescers 2024-09-15T23:04:49.036 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-15T23:04:49.047 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-15T23:04:49.047 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T23:04:49.047 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T23:04:49.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-15T23:04:49.055 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:04:49.055 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"btime":"2024-09-15T23:04:42:485338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":74,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:41.510710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:04:49.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.047+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa718137b20 con 0x7fa718074990 2024-09-15T23:04:49.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.052+0000 7fa70e7fc640 1 -- 172.21.15.66:0/1824259578 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+12005 (secure 0 0 0) 0x7fa71009b520 con 0x7fa718074990 2024-09-15T23:04:49.055 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 74 2024-09-15T23:04:49.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.057+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 msgr2=0x7fa7040a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:49.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.057+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 0x7fa7040a5820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa714005fd0 tx=0x7fa714005a00 comp rx=0 tx=0).stop 2024-09-15T23:04:49.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.057+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 msgr2=0x7fa71807b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:49.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.057+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa71000ba50 tx=0x7fa71000bf10 comp rx=0 tx=0).stop 2024-09-15T23:04:49.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 shutdown_connections 2024-09-15T23:04:49.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fa7040a3360 0x7fa7040a5820 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa718109e00 0x7fa718076790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa718109450 0x7fa718076250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 --2- 172.21.15.66:0/1824259578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa718074990 0x7fa71807b1c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.058+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 >> 172.21.15.66:0/1824259578 conn(0x7fa71806e140 msgr2=0x7fa718071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:49.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.059+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 shutdown_connections 2024-09-15T23:04:49.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.059+0000 7fa71f7cb640 1 -- 172.21.15.66:0/1824259578 wait complete. 2024-09-15T23:04:49.125 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-15T23:04:49.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T23:04:49.270 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:49 smithi066 ceph-mon[31185]: pgmap v614: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 734 KiB/s wr, 134 op/s 2024-09-15T23:04:49.270 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:49 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1824259578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:49 smithi087 ceph-mon[35290]: pgmap v614: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 734 KiB/s wr, 134 op/s 2024-09-15T23:04:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:49 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1824259578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:49 smithi184 ceph-mon[35203]: pgmap v614: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 734 KiB/s wr, 134 op/s 2024-09-15T23:04:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:49 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1824259578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:04:49.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.677+0000 7ff061be4640 1 -- 172.21.15.66:0/1791605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1095d0 msgr2=0x7ff05c109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:49.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.677+0000 7ff061be4640 1 --2- 172.21.15.66:0/1791605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1095d0 0x7ff05c109a10 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff050009900 tx=0x7ff05002a440 comp rx=0 tx=0).stop 2024-09-15T23:04:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.681+0000 7ff061be4640 1 -- 172.21.15.66:0/1791605950 shutdown_connections 2024-09-15T23:04:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.681+0000 7ff061be4640 1 --2- 172.21.15.66:0/1791605950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05c11b140 0x7ff05c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.681+0000 7ff061be4640 1 --2- 172.21.15.66:0/1791605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1095d0 0x7ff05c109a10 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.681+0000 7ff061be4640 1 --2- 172.21.15.66:0/1791605950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1091f0 0x7ff05c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.681+0000 7ff061be4640 1 -- 172.21.15.66:0/1791605950 >> 172.21.15.66:0/1791605950 conn(0x7ff05c06ce00 msgr2=0x7ff05c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.686+0000 7ff061be4640 1 -- 172.21.15.66:0/1791605950 shutdown_connections 2024-09-15T23:04:49.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.688+0000 7ff061be4640 1 -- 172.21.15.66:0/1791605950 wait complete. 2024-09-15T23:04:49.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.689+0000 7ff061be4640 1 Processor -- start 2024-09-15T23:04:49.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 -- start start 2024-09-15T23:04:49.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1095d0 0x7ff05c1a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05c11b140 0x7ff05c1aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c120d50 con 0x7ff05c1091f0 2024-09-15T23:04:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c120bd0 con 0x7ff05c1095d0 2024-09-15T23:04:49.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.694+0000 7ff061be4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c120ed0 con 0x7ff05c11b140 2024-09-15T23:04:49.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.698+0000 7ff05b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:49.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.698+0000 7ff05b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54486/0 (socket says 172.21.15.66:54486) 2024-09-15T23:04:49.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 -- 172.21.15.66:0/1160146621 learned_addr learned my addr 172.21.15.66:0/1160146621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:49.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05affd640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1095d0 0x7ff05c1a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:49.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 -- 172.21.15.66:0/1160146621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05c11b140 msgr2=0x7ff05c1aba40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05c11b140 0x7ff05c1aba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 -- 172.21.15.66:0/1160146621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1095d0 msgr2=0x7ff05c1a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1095d0 0x7ff05c1a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.699+0000 7ff05b7fe640 1 -- 172.21.15.66:0/1160146621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1ac140 con 0x7ff05c1091f0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.700+0000 7ff05b7fe640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff05400ebc0 tx=0x7ff05400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.701+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff054010630 con 0x7ff05c1091f0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.701+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff054010cb0 con 0x7ff05c1091f0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.701+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff054018c70 con 0x7ff05c1091f0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.701+0000 7ff061be4640 1 -- 172.21.15.66:0/1160146621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c1ac430 con 0x7ff05c1091f0 2024-09-15T23:04:49.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.701+0000 7ff061be4640 1 -- 172.21.15.66:0/1160146621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c110920 con 0x7ff05c1091f0 2024-09-15T23:04:49.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.706+0000 7ff061be4640 1 -- 172.21.15.66:0/1160146621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff048005290 con 0x7ff05c1091f0 2024-09-15T23:04:49.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.709+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7ff0540213f0 con 0x7ff05c1091f0 2024-09-15T23:04:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.710+0000 7ff058ff9640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 0x7ff0440a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:49.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.710+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7ff0540d09c0 con 0x7ff05c1091f0 2024-09-15T23:04:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.711+0000 7ff05affd640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 0x7ff0440a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:49.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.712+0000 7ff05affd640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 0x7ff0440a5b40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff050000c00 tx=0x7ff05002a940 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:49.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:49.720+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0540541b0 con 0x7ff05c1091f0 2024-09-15T23:04:50.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-15T23:04:50.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.128+0000 7ff061be4640 1 -- 172.21.15.66:0/1160146621 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ff048000bc0 con 0x7ff0440a3680 2024-09-15T23:04:50.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.262+0000 7ff058ff9640 1 -- 172.21.15.66:0/1160146621 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7ff048000bc0 con 0x7ff0440a3680 2024-09-15T23:04:50.268 INFO:teuthology.orchestra.run.smithi066.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T22:45:29", "first": "2024-09-15T22:46:00", "last": "2024-09-15T23:04:00", "last_pruned": "2024-09-15T23:04:01", "created_count": 19, "pruned_count": 13, "active": true} 2024-09-15T23:04:50.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.266+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 msgr2=0x7ff0440a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.266+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 0x7ff0440a5b40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff050000c00 tx=0x7ff05002a940 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.266+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 msgr2=0x7ff05c1a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.266+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff05400ebc0 tx=0x7ff05400c6a0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 shutdown_connections 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7ff0440a3680 0x7ff0440a5b40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff05c11b140 0x7ff05c1aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1095d0 0x7ff05c1a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 --2- 172.21.15.66:0/1160146621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff05c1091f0 0x7ff05c1a7180 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.267+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 >> 172.21.15.66:0/1160146621 conn(0x7ff05c06ce00 msgr2=0x7ff05c11b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:50.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.271+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 shutdown_connections 2024-09-15T23:04:50.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.271+0000 7ff0427fc640 1 -- 172.21.15.66:0/1160146621 wait complete. 2024-09-15T23:04:50.294 DEBUG:teuthology.orchestra.run.smithi066:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T23:04:50.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.565+0000 7f727455f640 1 -- 172.21.15.66:0/1576705015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1095d0 msgr2=0x7f726c109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:50.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.565+0000 7f727455f640 1 --2- 172.21.15.66:0/1576705015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1095d0 0x7f726c109a10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7268009900 tx=0x7f726802a440 comp rx=0 tx=0).stop 2024-09-15T23:04:50.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.569+0000 7f727455f640 1 -- 172.21.15.66:0/1576705015 shutdown_connections 2024-09-15T23:04:50.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.569+0000 7f727455f640 1 --2- 172.21.15.66:0/1576705015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.569+0000 7f727455f640 1 --2- 172.21.15.66:0/1576705015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1095d0 0x7f726c109a10 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.569+0000 7f727455f640 1 --2- 172.21.15.66:0/1576705015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f726c1091f0 0x7f726c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.569+0000 7f727455f640 1 -- 172.21.15.66:0/1576705015 >> 172.21.15.66:0/1576705015 conn(0x7f726c06ce00 msgr2=0x7f726c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:50.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.573+0000 7f727455f640 1 -- 172.21.15.66:0/1576705015 shutdown_connections 2024-09-15T23:04:50.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.575+0000 7f727455f640 1 -- 172.21.15.66:0/1576705015 wait complete. 2024-09-15T23:04:50.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 Processor -- start 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 -- start start 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 0x7f726c1a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f726c1095d0 0x7f726c1a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c1abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f726c120df0 con 0x7f726c1091f0 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f726c120c70 con 0x7f726c11b140 2024-09-15T23:04:50.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.576+0000 7f727455f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f726c120f70 con 0x7f726c1095d0 2024-09-15T23:04:50.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.578+0000 7f7272afc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c1abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:50.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.578+0000 7f7272afc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c1abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46772/0 (socket says 172.21.15.66:46772) 2024-09-15T23:04:50.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.578+0000 7f7272afc640 1 -- 172.21.15.66:0/3337063222 learned_addr learned my addr 172.21.15.66:0/3337063222 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:50.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.579+0000 7f72722fb640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 0x7f726c1a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:50.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 -- 172.21.15.66:0/3337063222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f726c1095d0 msgr2=0x7f726c1a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f726c1095d0 0x7f726c1a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 -- 172.21.15.66:0/3337063222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 msgr2=0x7f726c1abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c1abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 -- 172.21.15.66:0/3337063222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c1ac2d0 con 0x7f726c1091f0 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.580+0000 7f72722fb640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 0x7f726c1a72e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f725c009fd0 tx=0x7f725c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:50.583 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:50.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.583+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c015020 con 0x7f726c1091f0 2024-09-15T23:04:50.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.583+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f725c011d10 con 0x7f726c1091f0 2024-09-15T23:04:50.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.583+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c00f2e0 con 0x7f726c1091f0 2024-09-15T23:04:50.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.586+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c1ac5c0 con 0x7f726c1091f0 2024-09-15T23:04:50.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.586+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1b3e50 con 0x7f726c1091f0 2024-09-15T23:04:50.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.588+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c073a20 con 0x7f726c1091f0 2024-09-15T23:04:50.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.591+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f725c018020 con 0x7f726c1091f0 2024-09-15T23:04:50.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.592+0000 7f72637fe640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 0x7f72580a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:50.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.592+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f725c0cf7c0 con 0x7f726c1091f0 2024-09-15T23:04:50.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.600+0000 7f7271afa640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 0x7f72580a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:50.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.608+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f725c09bd60 con 0x7f726c1091f0 2024-09-15T23:04:50.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.611+0000 7f7271afa640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 0x7f72580a5b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7268005c20 tx=0x7f7268000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:50.995+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 --> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f726c062630 con 0x7f72580a3690 2024-09-15T23:04:51.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.084+0000 7f72637fe640 1 -- 172.21.15.66:0/3337063222 <== mgr.15312 v2:172.21.15.66:6800/1388370487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f726c062630 con 0x7f72580a3690 2024-09-15T23:04:51.086 INFO:teuthology.orchestra.run.smithi066.stdout:/ 1m 6m3h 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 msgr2=0x7f72580a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 0x7f72580a5b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7268005c20 tx=0x7f7268000bc0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 msgr2=0x7f726c1a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 0x7f726c1a72e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f725c009fd0 tx=0x7f725c00b870 comp rx=0 tx=0).stop 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 shutdown_connections 2024-09-15T23:04:51.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f72580a3690 0x7f72580a5b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f726c11b140 0x7f726c1abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f726c1095d0 0x7f726c1a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 --2- 172.21.15.66:0/3337063222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f726c1091f0 0x7f726c1a72e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 >> 172.21.15.66:0/3337063222 conn(0x7f726c06ce00 msgr2=0x7f726c11b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.087+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 shutdown_connections 2024-09-15T23:04:51.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.088+0000 7f727455f640 1 -- 172.21.15.66:0/3337063222 wait complete. 2024-09-15T23:04:51.114 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-15T23:04:51.127 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-15T23:04:51.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.248+0000 7fab816f2640 1 -- 172.21.15.66:0/3565729394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c109450 msgr2=0x7fab7c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.248+0000 7fab816f2640 1 --2- 172.21.15.66:0/3565729394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c109450 0x7fab7c110250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab74009ca0 tx=0x7fab7402a8e0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 -- 172.21.15.66:0/3565729394 shutdown_connections 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 --2- 172.21.15.66:0/3565729394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c11b140 0x7fab7c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 --2- 172.21.15.66:0/3565729394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 0x7fab7c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 --2- 172.21.15.66:0/3565729394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c109450 0x7fab7c110250 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 -- 172.21.15.66:0/3565729394 >> 172.21.15.66:0/3565729394 conn(0x7fab7c06e140 msgr2=0x7fab7c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.250+0000 7fab816f2640 1 -- 172.21.15.66:0/3565729394 shutdown_connections 2024-09-15T23:04:51.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.253+0000 7fab816f2640 1 -- 172.21.15.66:0/3565729394 wait complete. 2024-09-15T23:04:51.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.253+0000 7fab816f2640 1 Processor -- start 2024-09-15T23:04:51.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 -- start start 2024-09-15T23:04:51.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 0x7fab7c111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c11b140 0x7fab7c111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c120e30 con 0x7fab7c109450 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c120cb0 con 0x7fab7c11b140 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.254+0000 7fab816f2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c120fb0 con 0x7fab7c109830 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.255+0000 7fab7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.255+0000 7fab7affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54524/0 (socket says 172.21.15.66:54524) 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.255+0000 7fab7affd640 1 -- 172.21.15.66:0/1173399486 learned_addr learned my addr 172.21.15.66:0/1173399486 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:51.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.256+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 0x7fab7c111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 -- 172.21.15.66:0/1173399486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 msgr2=0x7fab7c111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 0x7fab7c111790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 -- 172.21.15.66:0/1173399486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c11b140 msgr2=0x7fab7c111cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c11b140 0x7fab7c111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 -- 172.21.15.66:0/1173399486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c112290 con 0x7fab7c109450 2024-09-15T23:04:51.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.257+0000 7fab7affd640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fab74009dc0 tx=0x7fab74003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.261+0000 7fab73fff640 1 -- 172.21.15.66:0/1173399486 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740308a0 con 0x7fab7c109450 2024-09-15T23:04:51.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.261+0000 7fab73fff640 1 -- 172.21.15.66:0/1173399486 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7403b400 con 0x7fab7c109450 2024-09-15T23:04:51.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.261+0000 7fab73fff640 1 -- 172.21.15.66:0/1173399486 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74043610 con 0x7fab7c109450 2024-09-15T23:04:51.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.261+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c112520 con 0x7fab7c109450 2024-09-15T23:04:51.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.261+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c116510 con 0x7fab7c109450 2024-09-15T23:04:51.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.265+0000 7fab73fff640 1 -- 172.21.15.66:0/1173399486 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fab7403b5b0 con 0x7fab7c109450 2024-09-15T23:04:51.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.266+0000 7fab73fff640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 0x7fab680a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.267+0000 7fab73fff640 1 -- 172.21.15.66:0/1173399486 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fab740f10a0 con 0x7fab7c109450 2024-09-15T23:04:51.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.271+0000 7fab83acb740 1 Processor -- start 2024-09-15T23:04:51.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.271+0000 7fab83acb740 1 -- start start 2024-09-15T23:04:51.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab83acb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab83acb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab83acb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab83acb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56120c44b2f0 con 0x56120c4f0370 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.272+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54526/0 (socket says 172.21.15.66:54526) 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.273+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 0x7fab680a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.273+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2713053805 learned_addr learned my addr 172.21.15.66:0/2713053805 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.273+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56120c3f2cf0 con 0x56120c4e55d0 2024-09-15T23:04:51.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.273+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56120c4472b0 con 0x56120c4e6b40 2024-09-15T23:04:51.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.276+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2713053805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 msgr2=0x56120c4e5090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.276+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4e5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.276+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2713053805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 msgr2=0x56120c4e5a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.276+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4e5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.276+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2713053805 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120c3d73a0 con 0x56120c4f0370 2024-09-15T23:04:51.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.277+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fab640015f0 tx=0x7fab64001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7138d8efd17341c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.278+0000 7fab717fa640 1 -- 172.21.15.66:0/2713053805 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64001d00 con 0x56120c4f0370 2024-09-15T23:04:51.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.278+0000 7fab717fa640 1 -- 172.21.15.66:0/2713053805 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab6400c8d0 con 0x56120c4f0370 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.279+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 msgr2=0x56120c4f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.279+0000 7fab83acb740 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fab640015f0 tx=0x7fab64001ab0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.280+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 shutdown_connections 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.280+0000 7fab83acb740 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4f0370 0x56120c4f2760 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.280+0000 7fab83acb740 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.280+0000 7fab83acb740 1 --2- 172.21.15.66:0/2713053805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.280+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 >> 172.21.15.66:0/2713053805 conn(0x56120c4ae310 msgr2=0x56120c4e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.284+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 shutdown_connections 2024-09-15T23:04:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.286+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 0x7fab680a5a00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56120c4e2ac0 tx=0x7fab6c00b5e0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.287+0000 7fab83acb740 1 -- 172.21.15.66:0/2713053805 wait complete. 2024-09-15T23:04:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.287+0000 7fab83acb740 1 -- start start 2024-09-15T23:04:51.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.287+0000 7fab83acb740 1 Processor -- start 2024-09-15T23:04:51.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c4ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56120c4f3110 con 0x56120c4e6b40 2024-09-15T23:04:51.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56120c406060 con 0x56120c4efc20 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56120c4f3290 con 0x56120c4e55d0 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab83acb740 10 client.0 _ll_register_callbacks cb 0x56120c1598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.289+0000 7fab7affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.290+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.290+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46812/0 (socket says 172.21.15.66:46812) 2024-09-15T23:04:51.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.290+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2036405498 learned_addr learned my addr 172.21.15.66:0/2036405498 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.291+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c4ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.292+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 msgr2=0x56120c4f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.292+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.292+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2036405498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 msgr2=0x56120c4ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.292+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c4ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.292+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2036405498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120c1bc3c0 con 0x56120c4efc20 2024-09-15T23:04:51.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.298+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab64015000 tx=0x7fab64003940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a17e163c355056 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.298+0000 7fab627fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.298+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6401f070 con 0x56120c4efc20 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.298+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56120c458860 con 0x56120c4efc20 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.298+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fab6400cd50 con 0x56120c4efc20 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.299+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fab6402b050 con 0x56120c4efc20 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.299+0000 7fab83acb740 10 client.28520 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.299+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x56120c4fee00 con 0x56120c4efc20 2024-09-15T23:04:51.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.301+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab64004360 con 0x56120c4efc20 2024-09-15T23:04:51.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.301+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7fab64012cb0 con 0x56120c4efc20 2024-09-15T23:04:51.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 10 client.28520 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:51.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 10 client.28520 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:04:51.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 20 client.28520 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:51.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c5001b0 0x56120c5025a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 4 client.28520 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:51.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120c458860 con 0x56120c5001b0 2024-09-15T23:04:51.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.303+0000 7fab7affd640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c5001b0 0x56120c5025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.305+0000 7fab7affd640 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c5001b0 0x56120c5025a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b4d569517a97ecbd server_cookie=335b94b6b59359f in_seq=0 out_seq=0 2024-09-15T23:04:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.305+0000 7fab627fc640 10 client.28520 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:51.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.306+0000 7fab627fc640 1 -- 172.21.15.66:0/2036405498 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120c458860 con 0x56120c5001b0 2024-09-15T23:04:51.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.306+0000 7fab627fc640 10 client.28520 handle_command_reply: tid=0 2024-09-15T23:04:51.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.306+0000 7fab83acb740 1 client.28520 shutdown 2024-09-15T23:04:51.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.311+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 msgr2=0x56120c4f00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.311+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fab64015000 tx=0x7fab64003940 comp rx=0 tx=0).stop 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 shutdown_connections 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c5001b0 0x56120c5025a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c4f00a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c4ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 --2- 172.21.15.66:0/2036405498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 >> 172.21.15.66:0/2036405498 conn(0x56120c4ae310 msgr2=0x56120c4e7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.313+0000 7fab627fc640 0 client.28520 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:51.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.314+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 shutdown_connections 2024-09-15T23:04:51.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.317+0000 7fab83acb740 1 -- 172.21.15.66:0/2036405498 wait complete. 2024-09-15T23:04:51.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.317+0000 7fab83acb740 20 client.28520 trim_cache size 0 max 16384 2024-09-15T23:04:51.347 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:51 smithi066 ceph-mon[31185]: pgmap v615: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 598 KiB/s wr, 119 op/s 2024-09-15T23:04:51.348 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:51 smithi066 ceph-mon[31185]: from='client.19305 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:51.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.345+0000 7fab83acb740 1 Processor -- start 2024-09-15T23:04:51.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 -- start start 2024-09-15T23:04:51.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c507d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c6b30 con 0x56120c4e6b40 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c8940 con 0x56120c4efc20 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab83acb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c72c0 con 0x56120c4e55d0 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46822/0 (socket says 172.21.15.66:46822) 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2510861778 learned_addr learned my addr 172.21.15.66:0/2510861778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:51.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.353+0000 7fab7affd640 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.354+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2510861778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 msgr2=0x56120c4ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.354+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4ef6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.354+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2510861778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 msgr2=0x56120c507d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.354+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c507d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.354+0000 7fab7b7fe640 1 -- 172.21.15.66:0/2510861778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120c4edc30 con 0x56120c4efc20 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.355+0000 7fab7b7fe640 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab6401b4c0 tx=0x7fab6400c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ff0ad1a643036f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.355+0000 7fab70ff9640 1 -- 172.21.15.66:0/2510861778 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64028030 con 0x56120c4efc20 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.355+0000 7fab70ff9640 1 -- 172.21.15.66:0/2510861778 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab64006e40 con 0x56120c4efc20 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.355+0000 7fab70ff9640 1 -- 172.21.15.66:0/2510861778 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6401f040 con 0x56120c4efc20 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.356+0000 7fab83acb740 1 -- 172.21.15.66:0/2510861778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 msgr2=0x56120c508250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.356+0000 7fab83acb740 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab6401b4c0 tx=0x7fab6400c560 comp rx=0 tx=0).stop 2024-09-15T23:04:51.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.359+0000 7fab83acb740 1 -- 172.21.15.66:0/2510861778 shutdown_connections 2024-09-15T23:04:51.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.359+0000 7fab83acb740 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4efc20 0x56120c508250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.359+0000 7fab83acb740 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4e6b40 0x56120c507d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.359+0000 7fab83acb740 1 --2- 172.21.15.66:0/2510861778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e55d0 0x56120c4ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.359+0000 7fab83acb740 1 -- 172.21.15.66:0/2510861778 >> 172.21.15.66:0/2510861778 conn(0x56120c4ae310 msgr2=0x56120c4eefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.367+0000 7fab83acb740 1 -- 172.21.15.66:0/2510861778 shutdown_connections 2024-09-15T23:04:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.368+0000 7fab83acb740 1 -- 172.21.15.66:0/2510861778 wait complete. 2024-09-15T23:04:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.368+0000 7fab83acb740 1 -- start start 2024-09-15T23:04:51.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.369+0000 7fab83acb740 1 Processor -- start 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.369+0000 7fab83acb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.369+0000 7fab83acb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.369+0000 7fab83acb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4efc20 0x56120c568cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab83acb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c81b0 con 0x56120c4efc20 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab83acb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c7a20 con 0x56120c4e55d0 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab83acb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1c4b10 con 0x56120c4e6b40 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab7affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab83acb740 10 client.0 _ll_register_callbacks cb 0x7fab64001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab7affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46838/0 (socket says 172.21.15.66:46838) 2024-09-15T23:04:51.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.370+0000 7fab7affd640 1 -- 172.21.15.66:0/470840219 learned_addr learned my addr 172.21.15.66:0/470840219 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7affd640 1 -- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 msgr2=0x56120c4f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7affd640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7affd640 1 -- 172.21.15.66:0/470840219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4efc20 msgr2=0x56120c568cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7affd640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4efc20 0x56120c568cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.371+0000 7fab7affd640 1 -- 172.21.15.66:0/470840219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120c569210 con 0x56120c4e55d0 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.375+0000 7fab7affd640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fab7402aed0 tx=0x7fab74009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b230b68c6f816e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.376+0000 7fab627fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.376+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740c5e60 con 0x56120c4e55d0 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.376+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fab740b9610 con 0x56120c4e55d0 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.376+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56120c452d70 con 0x56120c4e55d0 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.377+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fab740c5c10 con 0x56120c4e55d0 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.377+0000 7fab83acb740 10 client.28526 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:51.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.377+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x56120c56a4b0 con 0x56120c4e55d0 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.379+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56120c452d70 con 0x56120c4e55d0 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.379+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7fab7404b030 con 0x56120c4e55d0 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 10 client.28526 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 10 client.28526 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 20 client.28526 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c56aa50 0x56120c56ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 4 client.28526 mds_command: new command op to 24421 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:51.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.380+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 --> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56120c3cf170 con 0x56120c56aa50 2024-09-15T23:04:51.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.385+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c56aa50 0x56120c56ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.386+0000 7fab7a7fc640 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c56aa50 0x56120c56ce90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dce3aa4259f2b1ca server_cookie=586e3119f2fbe0d2 in_seq=0 out_seq=0 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.386+0000 7fab627fc640 10 client.28526 ms_handle_connect on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.387+0000 7fab627fc640 1 -- 172.21.15.66:0/470840219 <== mds.4 v2:172.21.15.184:6834/253738152 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56120c3cf170 con 0x56120c56aa50 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.387+0000 7fab627fc640 10 client.28526 handle_command_reply: tid=0 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.387+0000 7fab83acb740 1 client.28526 shutdown 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.387+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 msgr2=0x56120c4f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.387+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fab7402aed0 tx=0x7fab74009990 comp rx=0 tx=0).stop 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.390+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 shutdown_connections 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.390+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:6834/253738152,v1:172.21.15.184:6835/253738152] conn(0x56120c56aa50 0x56120c56ce90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.390+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56120c4efc20 0x56120c568cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.390+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56120c4e6b40 0x56120c4f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.390+0000 7fab83acb740 1 --2- 172.21.15.66:0/470840219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56120c4e55d0 0x56120c4f36f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.391+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 >> 172.21.15.66:0/470840219 conn(0x56120c4ae310 msgr2=0x56120c4e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.391+0000 7fab627fc640 0 client.28526 ms_handle_reset on v2:172.21.15.184:6834/253738152 2024-09-15T23:04:51.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.391+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 shutdown_connections 2024-09-15T23:04:51.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.391+0000 7fab83acb740 1 -- 172.21.15.66:0/470840219 wait complete. 2024-09-15T23:04:51.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.391+0000 7fab83acb740 20 client.28526 trim_cache size 0 max 16384 2024-09-15T23:04:51.394 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 msgr2=0x7fab680a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 0x7fab680a5a00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56120c4e2ac0 tx=0x7fab6c00b5e0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 msgr2=0x7fab7c118700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fab74009dc0 tx=0x7fab74003970 comp rx=0 tx=0).stop 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 shutdown_connections 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fab680a3540 0x7fab680a5a00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab7c11b140 0x7fab7c111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab7c109830 0x7fab7c111790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 --2- 172.21.15.66:0/1173399486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab7c109450 0x7fab7c118700 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 >> 172.21.15.66:0/1173399486 conn(0x7fab7c06e140 msgr2=0x7fab7c11bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 shutdown_connections 2024-09-15T23:04:51.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:51.392+0000 7fab816f2640 1 -- 172.21.15.66:0/1173399486 wait complete. 2024-09-15T23:04:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:51 smithi087 ceph-mon[35290]: pgmap v615: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 598 KiB/s wr, 119 op/s 2024-09-15T23:04:51.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:51 smithi087 ceph-mon[35290]: from='client.19305 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:51 smithi184 ceph-mon[35203]: pgmap v615: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 598 KiB/s wr, 119 op/s 2024-09-15T23:04:51.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:51 smithi184 ceph-mon[35203]: from='client.19305 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:52.143 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-15T23:04:52.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:52 smithi066 ceph-mon[31185]: from='client.19311 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:52.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:52 smithi087 ceph-mon[35290]: from='client.19311 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:52.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:52 smithi184 ceph-mon[35203]: from='client.19311 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:04:52.680 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 -- 172.21.15.66:0/774772412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10ef30 msgr2=0x7f74dc10d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 --2- 172.21.15.66:0/774772412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10ef30 0x7f74dc10d2a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f74d0007510 tx=0x7f74d002b0c0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 -- 172.21.15.66:0/774772412 shutdown_connections 2024-09-15T23:04:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 --2- 172.21.15.66:0/774772412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10d9b0 0x7f74dc115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 --2- 172.21.15.66:0/774772412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10ef30 0x7f74dc10d2a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 --2- 172.21.15.66:0/774772412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10e580 0x7f74dc10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.327+0000 7f74e308f640 1 -- 172.21.15.66:0/774772412 >> 172.21.15.66:0/774772412 conn(0x7f74dc06e140 msgr2=0x7f74dc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.328+0000 7f74e308f640 1 -- 172.21.15.66:0/774772412 shutdown_connections 2024-09-15T23:04:53.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.328+0000 7f74e308f640 1 -- 172.21.15.66:0/774772412 wait complete. 2024-09-15T23:04:53.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.329+0000 7f74e308f640 1 Processor -- start 2024-09-15T23:04:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.335+0000 7f74e308f640 1 -- start start 2024-09-15T23:04:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.336+0000 7f74e308f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10d9b0 0x7f74dc1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.336+0000 7f74e308f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.336+0000 7f74e308f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 0x7f74dc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.337+0000 7f74e308f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc1185f0 con 0x7f74dc10e580 2024-09-15T23:04:53.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.337+0000 7f74e308f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc118470 con 0x7f74dc10d9b0 2024-09-15T23:04:53.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.337+0000 7f74e308f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc118770 con 0x7f74dc10ef30 2024-09-15T23:04:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.344+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.344+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57262/0 (socket says 172.21.15.66:57262) 2024-09-15T23:04:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.344+0000 7f74dbfff640 1 -- 172.21.15.66:0/898954955 learned_addr learned my addr 172.21.15.66:0/898954955 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:53.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.345+0000 7f74e162c640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 0x7f74dc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.346+0000 7f74dbfff640 1 -- 172.21.15.66:0/898954955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 msgr2=0x7f74dc19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.346+0000 7f74dbfff640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 0x7f74dc19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.346+0000 7f74dbfff640 1 -- 172.21.15.66:0/898954955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10d9b0 msgr2=0x7f74dc1a4760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.346+0000 7f74dbfff640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10d9b0 0x7f74dc1a4760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.346+0000 7f74dbfff640 1 -- 172.21.15.66:0/898954955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc19f050 con 0x7f74dc10e580 2024-09-15T23:04:53.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.347+0000 7f74e162c640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 0x7f74dc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:04:53.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.349+0000 7f74dbfff640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f74d002b5e0 tx=0x7f74d0004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.350+0000 7f74d9ffb640 1 -- 172.21.15.66:0/898954955 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d003e070 con 0x7f74dc10e580 2024-09-15T23:04:53.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.350+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc19f2e0 con 0x7f74dc10e580 2024-09-15T23:04:53.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.350+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc1ab630 con 0x7f74dc10e580 2024-09-15T23:04:53.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.352+0000 7f74d9ffb640 1 -- 172.21.15.66:0/898954955 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d0004ea0 con 0x7f74dc10e580 2024-09-15T23:04:53.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.352+0000 7f74d9ffb640 1 -- 172.21.15.66:0/898954955 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003c40 con 0x7f74dc10e580 2024-09-15T23:04:53.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.357+0000 7f74d9ffb640 1 -- 172.21.15.66:0/898954955 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f74d0008040 con 0x7f74dc10e580 2024-09-15T23:04:53.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.360+0000 7f74e5468740 1 Processor -- start 2024-09-15T23:04:53.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.360+0000 7f74d9ffb640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 0x7f74c40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.361+0000 7f74d9ffb640 1 -- 172.21.15.66:0/898954955 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f74d00f05c0 con 0x7f74dc10e580 2024-09-15T23:04:53.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 -- start start 2024-09-15T23:04:53.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a2196f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2196fa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a219704b80 0x55a219706f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a2196572f0 con 0x55a219704b80 2024-09-15T23:04:53.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a2195fecf0 con 0x55a2196fb350 2024-09-15T23:04:53.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.362+0000 7f74e5468740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a2196532b0 con 0x55a2196f9de0 2024-09-15T23:04:53.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.364+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2196fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.364+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2196fa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60764/0 (socket says 172.21.15.66:60764) 2024-09-15T23:04:53.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.364+0000 7f74dbfff640 1 -- 172.21.15.66:0/2448451699 learned_addr learned my addr 172.21.15.66:0/2448451699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:53.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.364+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a2196f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.366+0000 7f74e162c640 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a219704b80 0x55a219706f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.366+0000 7f74e162c640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 0x7f74c40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.368+0000 7f74e0e2b640 1 -- 172.21.15.66:0/2448451699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 msgr2=0x55a2196fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.368+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2196fa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.368+0000 7f74e0e2b640 1 -- 172.21.15.66:0/2448451699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a219704b80 msgr2=0x55a219706f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.368+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a219704b80 0x55a219706f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.368+0000 7f74e0e2b640 1 -- 172.21.15.66:0/2448451699 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2195e33a0 con 0x55a2196fb350 2024-09-15T23:04:53.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.369+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a2196f98a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a890 tx=0x7f74cc00ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c3aa01cc8fe88b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.369+0000 7f74c2ffd640 1 -- 172.21.15.66:0/2448451699 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00ccc0 con 0x55a2196fb350 2024-09-15T23:04:53.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.369+0000 7f74c2ffd640 1 -- 172.21.15.66:0/2448451699 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc00f930 con 0x55a2196fb350 2024-09-15T23:04:53.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.369+0000 7f74c2ffd640 1 -- 172.21.15.66:0/2448451699 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc018a70 con 0x55a2196fb350 2024-09-15T23:04:53.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.371+0000 7f74e5468740 1 -- 172.21.15.66:0/2448451699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 msgr2=0x55a2196f98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.371+0000 7f74e5468740 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a2196f98a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a890 tx=0x7f74cc00ad50 comp rx=0 tx=0).stop 2024-09-15T23:04:53.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.372+0000 7f74e162c640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 0x7f74c40a5900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f74d40083d0 tx=0x7f74d4009f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.376+0000 7f74e5468740 1 -- 172.21.15.66:0/2448451699 shutdown_connections 2024-09-15T23:04:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.376+0000 7f74e5468740 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a219704b80 0x55a219706f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.376+0000 7f74e5468740 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2196fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.376+0000 7f74e5468740 1 --2- 172.21.15.66:0/2448451699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a2196f98a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.376+0000 7f74e5468740 1 -- 172.21.15.66:0/2448451699 >> 172.21.15.66:0/2448451699 conn(0x55a2196ba310 msgr2=0x55a2196f6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.378+0000 7f74e5468740 1 -- 172.21.15.66:0/2448451699 shutdown_connections 2024-09-15T23:04:53.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.378+0000 7f74e5468740 1 -- 172.21.15.66:0/2448451699 wait complete. 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.378+0000 7f74e5468740 1 -- start start 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.378+0000 7f74e5468740 1 Processor -- start 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.379+0000 7f74e5468740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e5468740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219701890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e5468740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 0x55a219702020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e5468740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a219707880 con 0x55a2196fb350 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e162c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 0x55a219702020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e162c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 0x55a219702020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48010/0 (socket says 172.21.15.66:48010) 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e162c640 1 -- 172.21.15.66:0/2890122779 learned_addr learned my addr 172.21.15.66:0/2890122779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.380+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55a219612060 con 0x55a219704b80 2024-09-15T23:04:53.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.381+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a219707a00 con 0x55a2196f9de0 2024-09-15T23:04:53.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.381+0000 7f74e5468740 10 client.0 _ll_register_callbacks cb 0x55a2193658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:53.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.382+0000 7f74dbfff640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219701890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.385+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.387+0000 7f74dbfff640 1 -- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 msgr2=0x55a2197045e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.387+0000 7f74dbfff640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.387+0000 7f74dbfff640 1 -- 172.21.15.66:0/2890122779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 msgr2=0x55a219702020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.387+0000 7f74dbfff640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 0x55a219702020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.387+0000 7f74dbfff640 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2193c83c0 con 0x55a2196fb350 2024-09-15T23:04:53.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.393+0000 7f74dbfff640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219701890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f74d00b89c0 tx=0x7f74d00bbec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5976d303aa8cd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.393+0000 7f74bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-09-15T23:04:53.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.394+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0047040 con 0x55a2196fb350 2024-09-15T23:04:53.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.394+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc00f930 con 0x55a2196fb350 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.394+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mon.0 v2:172.21.15.66:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f74d00c4d40 con 0x55a2196fb350 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.394+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f74d00c4f60 con 0x55a2196fb350 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.395+0000 7f74e5468740 10 client.19329 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.395+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55a219713400 con 0x55a2196fb350 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.395+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mon.0 v2:172.21.15.66:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc00f930 con 0x55a2196fb350 2024-09-15T23:04:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mon.0 v2:172.21.15.66:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f74d00f0170 con 0x55a2196fb350 2024-09-15T23:04:53.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 10 client.19329 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:53.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 10 client.19329 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:04:53.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 20 client.19329 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:53.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a219714b80 0x55a219717000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 4 client.19329 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:53.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.396+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a219664860 con 0x55a219714b80 2024-09-15T23:04:53.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.397+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a219714b80 0x55a219717000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.398+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a219714b80 0x55a219717000 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4e051208a5b2e695 server_cookie=c16095a3528100f6 in_seq=0 out_seq=0 2024-09-15T23:04:53.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.398+0000 7f74bbfff640 10 client.19329 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.399+0000 7f74bbfff640 1 -- 172.21.15.66:0/2890122779 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a219664860 con 0x55a219714b80 2024-09-15T23:04:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.399+0000 7f74bbfff640 10 client.19329 handle_command_reply: tid=0 2024-09-15T23:04:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.400+0000 7f74e5468740 1 client.19329 shutdown 2024-09-15T23:04:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.400+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 msgr2=0x55a219701890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.400+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219701890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f74d00b89c0 tx=0x7f74d00bbec0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 shutdown_connections 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a219714b80 0x55a219717000 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a219704b80 0x55a219702020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219701890 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 --2- 172.21.15.66:0/2890122779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 >> 172.21.15.66:0/2890122779 conn(0x55a2196ba310 msgr2=0x55a2196fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74bbfff640 0 client.19329 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:53.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.402+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 shutdown_connections 2024-09-15T23:04:53.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.407+0000 7f74e5468740 1 -- 172.21.15.66:0/2890122779 wait complete. 2024-09-15T23:04:53.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.407+0000 7f74e5468740 20 client.19329 trim_cache size 0 max 16384 2024-09-15T23:04:53.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.439+0000 7f74e5468740 1 Processor -- start 2024-09-15T23:04:53.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.439+0000 7f74e5468740 1 -- start start 2024-09-15T23:04:53.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.442 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:53 smithi066 ceph-mon[31185]: pgmap v616: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 149 KiB/s wr, 109 op/s 2024-09-15T23:04:53.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a219716b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a2196fc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74c8010220 con 0x55a2196f9de0 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74c8012030 con 0x55a2196fb350 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.440+0000 7f74e5468740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74c80109b0 con 0x55a219704b80 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a219716b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74e162c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a2196fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74e0e2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a219716b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48012/0 (socket says 172.21.15.66:48012) 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74dbfff640 1 -- 172.21.15.66:0/3408225183 learned_addr learned my addr 172.21.15.66:0/3408225183 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:53.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.441+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57280/0 (socket says 172.21.15.66:57280) 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 -- 172.21.15.66:0/3408225183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 msgr2=0x55a2196fc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a2196fc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 -- 172.21.15.66:0/3408225183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 msgr2=0x55a219716b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a219716b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 -- 172.21.15.66:0/3408225183 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2196f7170 con 0x55a2196f9de0 2024-09-15T23:04:53.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.442+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f74cc018570 tx=0x7f74cc018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a752b85fb50d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.444+0000 7f74c27fc640 1 -- 172.21.15.66:0/3408225183 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc027070 con 0x55a2196f9de0 2024-09-15T23:04:53.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.444+0000 7f74c27fc640 1 -- 172.21.15.66:0/3408225183 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc00a4a0 con 0x55a2196f9de0 2024-09-15T23:04:53.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.444+0000 7f74c27fc640 1 -- 172.21.15.66:0/3408225183 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0186e0 con 0x55a2196f9de0 2024-09-15T23:04:53.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.445+0000 7f74e5468740 1 -- 172.21.15.66:0/3408225183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 msgr2=0x55a2197045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.445+0000 7f74e5468740 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f74cc018570 tx=0x7f74cc018400 comp rx=0 tx=0).stop 2024-09-15T23:04:53.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.446+0000 7f74e5468740 1 -- 172.21.15.66:0/3408225183 shutdown_connections 2024-09-15T23:04:53.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.446+0000 7f74e5468740 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a2196fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.446+0000 7f74e5468740 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196fb350 0x55a219716b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.446+0000 7f74e5468740 1 --2- 172.21.15.66:0/3408225183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196f9de0 0x55a2197045e0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.446+0000 7f74e5468740 1 -- 172.21.15.66:0/3408225183 >> 172.21.15.66:0/3408225183 conn(0x55a2196ba310 msgr2=0x55a2196e8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.452+0000 7f74e5468740 1 -- 172.21.15.66:0/3408225183 shutdown_connections 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.455+0000 7f74e5468740 1 -- 172.21.15.66:0/3408225183 wait complete. 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.456+0000 7f74e5468740 1 -- start start 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.456+0000 7f74e5468740 1 Processor -- start 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.456+0000 7f74e5468740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196f9de0 0x55a219708250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219708790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74c80118a0 con 0x55a2196fb350 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74c8011110 con 0x55a2196f9de0 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800e200 con 0x55a219704b80 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e5468740 10 client.0 _ll_register_callbacks cb 0x7f74d00b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60778/0 (socket says 172.21.15.66:60778) 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 -- 172.21.15.66:0/2581882101 learned_addr learned my addr 172.21.15.66:0/2581882101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196f9de0 0x55a219708250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 -- 172.21.15.66:0/2581882101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196f9de0 msgr2=0x55a219708250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196f9de0 0x55a219708250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 -- 172.21.15.66:0/2581882101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 msgr2=0x55a219708790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219708790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.457+0000 7f74e162c640 1 -- 172.21.15.66:0/2581882101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a21977ded0 con 0x55a219704b80 2024-09-15T23:04:53.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.459+0000 7f74e162c640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f74d401a980 tx=0x7f74d4009e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=190e871fad58ca9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.459+0000 7f74bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:53.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.462+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4014040 con 0x55a219704b80 2024-09-15T23:04:53.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.462+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc00a4a0 con 0x55a219704b80 2024-09-15T23:04:53.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.462+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f74d4019960 con 0x55a219704b80 2024-09-15T23:04:53.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.462+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f74d4034050 con 0x55a219704b80 2024-09-15T23:04:53.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.466+0000 7f74e5468740 10 client.28435 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:53.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.466+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55a21977f170 con 0x55a219704b80 2024-09-15T23:04:53.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.466+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d402b070 con 0x55a219704b80 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f74d4026c40 con 0x55a219704b80 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 10 client.28435 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 10 client.28435 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 20 client.28435 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a21977f9d0 0x55a219781e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 4 client.28435 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:53.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.467+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 --> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f74cc00a4a0 con 0x55a21977f9d0 2024-09-15T23:04:53.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.470+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a21977f9d0 0x55a219781e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.475+0000 7f74e0e2b640 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a21977f9d0 0x55a219781e50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=30ba905d8dcf0dd server_cookie=9ca1a8da0024c939 in_seq=0 out_seq=0 2024-09-15T23:04:53.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.475+0000 7f74bbfff640 10 client.28435 ms_handle_connect on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:53.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.478+0000 7f74bbfff640 1 -- 172.21.15.66:0/2581882101 <== mds.3 v2:172.21.15.184:6836/2237794156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f74cc00a4a0 con 0x55a21977f9d0 2024-09-15T23:04:53.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.478+0000 7f74bbfff640 10 client.28435 handle_command_reply: tid=0 2024-09-15T23:04:53.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.478+0000 7f74e5468740 1 client.28435 shutdown 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 msgr2=0x55a21977d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f74d401a980 tx=0x7f74d4009e80 comp rx=0 tx=0).stop 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 shutdown_connections 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:6836/2237794156,v1:172.21.15.184:6837/2237794156] conn(0x55a21977f9d0 0x55a219781e50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a219704b80 0x55a21977d890 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a2196fb350 0x55a219708790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 --2- 172.21.15.66:0/2581882101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2196f9de0 0x55a219708250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 >> 172.21.15.66:0/2581882101 conn(0x55a2196ba310 msgr2=0x55a2196ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74bbfff640 0 client.28435 ms_handle_reset on v2:172.21.15.184:6836/2237794156 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.481+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 shutdown_connections 2024-09-15T23:04:53.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.482+0000 7f74e5468740 1 -- 172.21.15.66:0/2581882101 wait complete. 2024-09-15T23:04:53.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.482+0000 7f74e5468740 20 client.28435 trim_cache size 0 max 16384 2024-09-15T23:04:53.485 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:53.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.485+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 msgr2=0x7f74c40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.485+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 0x7f74c40a5900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f74d40083d0 tx=0x7f74d4009f90 comp rx=0 tx=0).stop 2024-09-15T23:04:53.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.485+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 msgr2=0x7f74dc1a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.485+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f74d002b5e0 tx=0x7f74d0004cb0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 shutdown_connections 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f74c40a3440 0x7f74c40a5900 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74dc10ef30 0x7f74dc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74dc10e580 0x7f74dc1a4ca0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 --2- 172.21.15.66:0/898954955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc10d9b0 0x7f74dc1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.486+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 >> 172.21.15.66:0/898954955 conn(0x7f74dc06e140 msgr2=0x7f74dc10b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.487+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 shutdown_connections 2024-09-15T23:04:53.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:53.487+0000 7f74e308f640 1 -- 172.21.15.66:0/898954955 wait complete. 2024-09-15T23:04:53.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:53 smithi087 ceph-mon[35290]: pgmap v616: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 149 KiB/s wr, 109 op/s 2024-09-15T23:04:53.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:53 smithi184 ceph-mon[35203]: pgmap v616: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 149 KiB/s wr, 109 op/s 2024-09-15T23:04:54.361 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-15T23:04:54.884 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:55.300 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:55 smithi066 ceph-mon[31185]: pgmap v617: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 103 KiB/s wr, 103 op/s 2024-09-15T23:04:55.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:55 smithi087 ceph-mon[35290]: pgmap v617: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 103 KiB/s wr, 103 op/s 2024-09-15T23:04:55.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.659+0000 7fe5b6efb640 1 -- 172.21.15.66:0/1976259640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 msgr2=0x7fe5b0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.659+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/1976259640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b0109c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe598009900 tx=0x7fe59802a440 comp rx=0 tx=0).stop 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 -- 172.21.15.66:0/1976259640 shutdown_connections 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/1976259640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b011b140 0x7fe5b011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/1976259640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b0109c90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/1976259640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b0109450 0x7fe5b0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 -- 172.21.15.66:0/1976259640 >> 172.21.15.66:0/1976259640 conn(0x7fe5b006e140 msgr2=0x7fe5b006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 -- 172.21.15.66:0/1976259640 shutdown_connections 2024-09-15T23:04:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.662+0000 7fe5b6efb640 1 -- 172.21.15.66:0/1976259640 wait complete. 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 Processor -- start 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 -- start start 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b01109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b011b140 0x7fe5b0110f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0120ed0 con 0x7fe5b0109450 2024-09-15T23:04:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0120d50 con 0x7fe5b0109830 2024-09-15T23:04:55.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.663+0000 7fe5b6efb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b0121050 con 0x7fe5b011b140 2024-09-15T23:04:55.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.665+0000 7fe5b4c97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.665+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b011b140 0x7fe5b0110f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.667+0000 7fe5b4c97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57296/0 (socket says 172.21.15.66:57296) 2024-09-15T23:04:55.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.667+0000 7fe5b4c97640 1 -- 172.21.15.66:0/3102611083 learned_addr learned my addr 172.21.15.66:0/3102611083 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:55.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.667+0000 7fe5affff640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b01109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:55 smithi184 ceph-mon[35203]: pgmap v617: 129 pgs: 16 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 66 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 103 KiB/s wr, 103 op/s 2024-09-15T23:04:55.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.670+0000 7fe5b4c97640 1 -- 172.21.15.66:0/3102611083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b011b140 msgr2=0x7fe5b0110f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.670+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b011b140 0x7fe5b0110f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.670+0000 7fe5b4c97640 1 -- 172.21.15.66:0/3102611083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 msgr2=0x7fe5b01109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.670+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b01109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.670+0000 7fe5b4c97640 1 -- 172.21.15.66:0/3102611083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b0111750 con 0x7fe5b0109450 2024-09-15T23:04:55.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.671+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000b450 tx=0x7fe5a000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.672+0000 7fe5adffb640 1 -- 172.21.15.66:0/3102611083 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0015020 con 0x7fe5b0109450 2024-09-15T23:04:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.672+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b01bc200 con 0x7fe5b0109450 2024-09-15T23:04:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.673+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b01bc760 con 0x7fe5b0109450 2024-09-15T23:04:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.673+0000 7fe5adffb640 1 -- 172.21.15.66:0/3102611083 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a0011d70 con 0x7fe5b0109450 2024-09-15T23:04:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.673+0000 7fe5adffb640 1 -- 172.21.15.66:0/3102611083 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000f340 con 0x7fe5b0109450 2024-09-15T23:04:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.676+0000 7fe5adffb640 1 -- 172.21.15.66:0/3102611083 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fe5a0018020 con 0x7fe5b0109450 2024-09-15T23:04:55.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.678+0000 7fe5adffb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 0x7fe59c0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.678+0000 7fe5adffb640 1 -- 172.21.15.66:0/3102611083 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fe5a00d0b10 con 0x7fe5b0109450 2024-09-15T23:04:55.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.679+0000 7fe5affff640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 0x7fe59c0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.684+0000 7fe5b92d4740 1 Processor -- start 2024-09-15T23:04:55.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.684+0000 7fe5affff640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 0x7fe59c0a5940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe59802aa30 tx=0x7fe59802a940 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.686+0000 7fe5b92d4740 1 -- start start 2024-09-15T23:04:55.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acc68492f0 con 0x55acc68ee370 2024-09-15T23:04:55.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55acc67f0cf0 con 0x55acc68e4b40 2024-09-15T23:04:55.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.687+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55acc68452b0 con 0x55acc68e35d0 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.691+0000 7fe5b4c97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.691+0000 7fe5b4c97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48060/0 (socket says 172.21.15.66:48060) 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.691+0000 7fe5b4c97640 1 -- 172.21.15.66:0/1867216111 learned_addr learned my addr 172.21.15.66:0/1867216111 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.691+0000 7fe5affff640 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.692+0000 7fe5b5498640 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 -- 172.21.15.66:0/1867216111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 msgr2=0x55acc68e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 -- 172.21.15.66:0/1867216111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 msgr2=0x55acc68f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 -- 172.21.15.66:0/1867216111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc67d53a0 con 0x55acc68e4b40 2024-09-15T23:04:55.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.693+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00993e0 tx=0x7fe5a009d250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402e4d3b3ee8cc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.695+0000 7fe5a6ffd640 1 -- 172.21.15.66:0/1867216111 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00a5680 con 0x55acc68e4b40 2024-09-15T23:04:55.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.695+0000 7fe5a6ffd640 1 -- 172.21.15.66:0/1867216111 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a009ad10 con 0x55acc68e4b40 2024-09-15T23:04:55.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.695+0000 7fe5a6ffd640 1 -- 172.21.15.66:0/1867216111 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00a5450 con 0x55acc68e4b40 2024-09-15T23:04:55.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.696+0000 7fe5b92d4740 1 -- 172.21.15.66:0/1867216111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 msgr2=0x55acc68e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.696+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00993e0 tx=0x7fe5a009d250 comp rx=0 tx=0).stop 2024-09-15T23:04:55.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.701+0000 7fe5b92d4740 1 -- 172.21.15.66:0/1867216111 shutdown_connections 2024-09-15T23:04:55.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.701+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.701+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.701+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/1867216111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68e4b40 0x55acc68e3090 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00993e0 tx=0x7fe5a009d250 comp rx=0 tx=0).stop 2024-09-15T23:04:55.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.701+0000 7fe5b92d4740 1 -- 172.21.15.66:0/1867216111 >> 172.21.15.66:0/1867216111 conn(0x55acc68ac310 msgr2=0x55acc68dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.705+0000 7fe5b92d4740 1 -- 172.21.15.66:0/1867216111 shutdown_connections 2024-09-15T23:04:55.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.706+0000 7fe5b92d4740 1 -- 172.21.15.66:0/1867216111 wait complete. 2024-09-15T23:04:55.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.707+0000 7fe5b92d4740 1 -- start start 2024-09-15T23:04:55.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.707+0000 7fe5b92d4740 1 Processor -- start 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.707+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68eb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acc68f1070 con 0x55acc68ee370 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55acc6804060 con 0x55acc68ebca0 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55acc68f11f0 con 0x55acc68e35d0 2024-09-15T23:04:55.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.708+0000 7fe5b92d4740 10 client.0 _ll_register_callbacks cb 0x55acc65578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:55.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.711+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.711+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48072/0 (socket says 172.21.15.66:48072) 2024-09-15T23:04:55.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.711+0000 7fe5b5498640 1 -- 172.21.15.66:0/3543826893 learned_addr learned my addr 172.21.15.66:0/3543826893 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:55.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.711+0000 7fe5affff640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 -- 172.21.15.66:0/3543826893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 msgr2=0x55acc68eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68eb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 -- 172.21.15.66:0/3543826893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 msgr2=0x55acc68eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 -- 172.21.15.66:0/3543826893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc65ba3c0 con 0x55acc68ebca0 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe5b5498640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800baf0 tx=0x7fe5a800bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3cea13b363ed354 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe58ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:55.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8016410 con 0x55acc68ebca0 2024-09-15T23:04:55.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.712+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fe5a80165b0 con 0x55acc68ebca0 2024-09-15T23:04:55.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.713+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a009ad10 con 0x55acc68ebca0 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.716+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe5a80167b0 con 0x55acc68ebca0 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.716+0000 7fe5b92d4740 10 client.28550 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.716+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55acc691f180 con 0x55acc68ebca0 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mon.2 v2:172.21.15.87:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a009ad10 con 0x55acc68ebca0 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mon.2 v2:172.21.15.87:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7fe5a8015b70 con 0x55acc68ebca0 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 10 client.28550 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 10 client.28550 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 20 client.28550 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc69206b0 0x55acc6922b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 4 client.28550 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:55.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.717+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acc6856860 con 0x55acc69206b0 2024-09-15T23:04:55.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.718+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc69206b0 0x55acc6922b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.719+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc69206b0 0x55acc6922b10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a3e477e5497772c server_cookie=e9cb93d741838319 in_seq=0 out_seq=0 2024-09-15T23:04:55.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.719+0000 7fe58ffff640 10 client.28550 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:55.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.720+0000 7fe58ffff640 1 -- 172.21.15.66:0/3543826893 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acc6856860 con 0x55acc69206b0 2024-09-15T23:04:55.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.720+0000 7fe58ffff640 10 client.28550 handle_command_reply: tid=0 2024-09-15T23:04:55.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.720+0000 7fe5b92d4740 1 client.28550 shutdown 2024-09-15T23:04:55.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.724+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 msgr2=0x55acc68fa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.724+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800baf0 tx=0x7fe5a800bef0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 shutdown_connections 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc69206b0 0x55acc6922b10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa550 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68ee370 0x55acc68eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/3543826893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68e35d0 0x55acc68eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 >> 172.21.15.66:0/3543826893 conn(0x55acc68ac310 msgr2=0x55acc68e59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe58ffff640 0 client.28550 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 shutdown_connections 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 1 -- 172.21.15.66:0/3543826893 wait complete. 2024-09-15T23:04:55.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.725+0000 7fe5b92d4740 20 client.28550 trim_cache size 0 max 16384 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 Processor -- start 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 -- start start 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68fa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe590010360 con 0x55acc68e35d0 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe590012170 con 0x55acc68ebca0 2024-09-15T23:04:55.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.751+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe590010af0 con 0x55acc68ee370 2024-09-15T23:04:55.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.755+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.755+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60840/0 (socket says 172.21.15.66:60840) 2024-09-15T23:04:55.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.755+0000 7fe5b5498640 1 -- 172.21.15.66:0/2259709648 learned_addr learned my addr 172.21.15.66:0/2259709648 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:55.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.756+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.757+0000 7fe5b4c97640 1 -- 172.21.15.66:0/2259709648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 msgr2=0x55acc68ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.757+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.757+0000 7fe5b4c97640 1 -- 172.21.15.66:0/2259709648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 msgr2=0x55acc68fa880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:55.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.757+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.757+0000 7fe5b4c97640 1 -- 172.21.15.66:0/2259709648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc68df4f0 con 0x55acc68e35d0 2024-09-15T23:04:55.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.758+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68fa340 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x55acc68e5170 tx=0x7fe5a00a0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cc757317351b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.760+0000 7fe5a67fc640 1 -- 172.21.15.66:0/2259709648 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0081070 con 0x55acc68e35d0 2024-09-15T23:04:55.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.761+0000 7fe5a67fc640 1 -- 172.21.15.66:0/2259709648 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a00a5680 con 0x55acc68e35d0 2024-09-15T23:04:55.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.761+0000 7fe5a67fc640 1 -- 172.21.15.66:0/2259709648 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00cdff0 con 0x55acc68e35d0 2024-09-15T23:04:55.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.763+0000 7fe5b92d4740 1 -- 172.21.15.66:0/2259709648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 msgr2=0x55acc68fa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.763+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68fa340 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x55acc68e5170 tx=0x7fe5a00a0f00 comp rx=0 tx=0).stop 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.767+0000 7fe5b92d4740 1 -- 172.21.15.66:0/2259709648 shutdown_connections 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.767+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.767+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.767+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/2259709648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68fa340 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.767+0000 7fe5b92d4740 1 -- 172.21.15.66:0/2259709648 >> 172.21.15.66:0/2259709648 conn(0x55acc68ac310 msgr2=0x55acc68ed2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.768+0000 7fe5b92d4740 1 -- 172.21.15.66:0/2259709648 shutdown_connections 2024-09-15T23:04:55.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.769+0000 7fe5b92d4740 1 -- 172.21.15.66:0/2259709648 wait complete. 2024-09-15T23:04:55.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.770+0000 7fe5b92d4740 1 -- start start 2024-09-15T23:04:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.770+0000 7fe5b92d4740 1 Processor -- start 2024-09-15T23:04:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68f6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900119e0 con 0x55acc68e35d0 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe590011250 con 0x55acc68ebca0 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b92d4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe59000e340 con 0x55acc68ee370 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b5498640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60846/0 (socket says 172.21.15.66:60846) 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.771+0000 7fe5b5498640 1 -- 172.21.15.66:0/946315070 learned_addr learned my addr 172.21.15.66:0/946315070 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:55.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.772+0000 7fe5b92d4740 10 client.0 _ll_register_callbacks cb 0x7fe5b0119080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.772+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.773+0000 7fe5b5498640 1 -- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 msgr2=0x55acc68f6bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.773+0000 7fe5b5498640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68f6bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.773+0000 7fe5b5498640 1 -- 172.21.15.66:0/946315070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 msgr2=0x55acc68f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.773+0000 7fe5b5498640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.773+0000 7fe5b5498640 1 -- 172.21.15.66:0/946315070 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc68e8cd0 con 0x55acc68ee370 2024-09-15T23:04:55.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.774+0000 7fe5b5498640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8002390 tx=0x7fe5a800af80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f99e0e24091062b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:55.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.774+0000 7fe58ffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:55.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.774+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8003ce0 con 0x55acc68ee370 2024-09-15T23:04:55.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.775+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7fe5a8016950 con 0x55acc68ee370 2024-09-15T23:04:55.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.775+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a00a5680 con 0x55acc68ee370 2024-09-15T23:04:55.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.781+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8016b50 con 0x55acc68ee370 2024-09-15T23:04:55.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.781+0000 7fe5b92d4740 10 client.28447 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:55.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.781+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55acc68ef5b0 con 0x55acc68ee370 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.782+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a801b070 con 0x55acc68ee370 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7fe5a8016220 con 0x55acc68ee370 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 10 client.28447 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 10 client.28447 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 20 client.28447 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc698b6f0 0x55acc698db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 4 client.28447 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.783+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 --> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe5a00a5680 con 0x55acc698b6f0 2024-09-15T23:04:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.787+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc698b6f0 0x55acc698db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.796+0000 7fe5b4c97640 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc698b6f0 0x55acc698db10 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e5c1c2e890ca3cb server_cookie=5bd72b21274600fd in_seq=0 out_seq=0 2024-09-15T23:04:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.797+0000 7fe58ffff640 10 client.28447 ms_handle_connect on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.801+0000 7fe58ffff640 1 -- 172.21.15.66:0/946315070 <== mds.2 v2:172.21.15.87:6836/2256594812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe5a00a5680 con 0x55acc698b6f0 2024-09-15T23:04:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.801+0000 7fe58ffff640 10 client.28447 handle_command_reply: tid=0 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.801+0000 7fe5b92d4740 1 client.28447 shutdown 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.801+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 msgr2=0x55acc68e84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8002390 tx=0x7fe5a800af80 comp rx=0 tx=0).stop 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 shutdown_connections 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:6836/2256594812,v1:172.21.15.87:6837/2256594812] conn(0x55acc698b6f0 0x55acc698db10 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acc68ee370 0x55acc68e84a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe58ffff640 0 client.28447 ms_handle_reset on v2:172.21.15.87:6836/2256594812 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55acc68ebca0 0x55acc68f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 --2- 172.21.15.66:0/946315070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acc68e35d0 0x55acc68f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 >> 172.21.15.66:0/946315070 conn(0x55acc68ac310 msgr2=0x55acc68e51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 shutdown_connections 2024-09-15T23:04:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.802+0000 7fe5b92d4740 1 -- 172.21.15.66:0/946315070 wait complete. 2024-09-15T23:04:55.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.803+0000 7fe5b92d4740 20 client.28447 trim_cache size 0 max 16384 2024-09-15T23:04:55.806 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.806+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 msgr2=0x7fe59c0a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.806+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 0x7fe59c0a5940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe59802aa30 tx=0x7fe59802a940 comp rx=0 tx=0).stop 2024-09-15T23:04:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.806+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 msgr2=0x7fe5b0118a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.806+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000b450 tx=0x7fe5a000b910 comp rx=0 tx=0).stop 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 shutdown_connections 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fe59c0a3480 0x7fe59c0a5940 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5b011b140 0x7fe5b0110f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5b0109830 0x7fe5b01109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 --2- 172.21.15.66:0/3102611083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5b0109450 0x7fe5b0118a20 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:55.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.810+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 >> 172.21.15.66:0/3102611083 conn(0x7fe5b006e140 msgr2=0x7fe5b011be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.814+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 shutdown_connections 2024-09-15T23:04:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:55.814+0000 7fe5b6efb640 1 -- 172.21.15.66:0/3102611083 wait complete. 2024-09-15T23:04:56.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:56 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:04:56.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:56 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:04:56.652 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-15T23:04:56.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:56 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:04:57.217 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:57.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:57 smithi066 ceph-mon[31185]: pgmap v618: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 88 KiB/s wr, 108 op/s 2024-09-15T23:04:57.533 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:57 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:04:57.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:57 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:04:57.534 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:57 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:04:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:57 smithi087 ceph-mon[35290]: pgmap v618: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 88 KiB/s wr, 108 op/s 2024-09-15T23:04:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:57 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:04:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:57 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:04:57.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:57 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:04:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:57 smithi184 ceph-mon[35203]: pgmap v618: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 88 KiB/s wr, 108 op/s 2024-09-15T23:04:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:57 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:04:57.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:57 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:04:57.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:57 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:04:57.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 -- 172.21.15.66:0/1339075570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a6010e3b0 msgr2=0x7f3a60110800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a5dffb640 1 -- 172.21.15.66:0/1339075570 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50035020 con 0x7f3a6010e3b0 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1339075570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a6010e3b0 0x7f3a60110800 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009900 tx=0x7f3a5002a4a0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 -- 172.21.15.66:0/1339075570 shutdown_connections 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1339075570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a6010e3b0 0x7f3a60110800 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1339075570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60074f40 0x7f3a6010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1339075570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a60074620 0x7f3a60074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.834+0000 7f3a65a15640 1 -- 172.21.15.66:0/1339075570 >> 172.21.15.66:0/1339075570 conn(0x7f3a600fd8b0 msgr2=0x7f3a600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.835+0000 7f3a65a15640 1 -- 172.21.15.66:0/1339075570 shutdown_connections 2024-09-15T23:04:57.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.835+0000 7f3a65a15640 1 -- 172.21.15.66:0/1339075570 wait complete. 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 Processor -- start 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 -- start start 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 0x7f3a60101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6010e3b0 0x7f3a60102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 0x7f3a60072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60114210 con 0x7f3a60074620 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60114090 con 0x7f3a60102550 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.836+0000 7f3a65a15640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60114390 con 0x7f3a6010e3b0 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.837+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 0x7f3a60101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.837+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 0x7f3a60072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.837+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 0x7f3a60072ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48106/0 (socket says 172.21.15.66:48106) 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.837+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/1482791465 learned_addr learned my addr 172.21.15.66:0/1482791465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.837+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6010e3b0 0x7f3a60102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 -- 172.21.15.66:0/1482791465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6010e3b0 msgr2=0x7f3a60102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6010e3b0 0x7f3a60102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 -- 172.21.15.66:0/1482791465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 msgr2=0x7f3a60072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 0x7f3a60072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 -- 172.21.15.66:0/1482791465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a60073020 con 0x7f3a60074620 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 0x7f3a60101ad0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800ec80 tx=0x7f3a5800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.838+0000 7f3a64a13640 1 -- 172.21.15.66:0/1482791465 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58003b70 con 0x7f3a60074620 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.839+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a60073310 con 0x7f3a60074620 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.839+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a60073850 con 0x7f3a60074620 2024-09-15T23:04:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.839+0000 7f3a64a13640 1 -- 172.21.15.66:0/1482791465 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a58003d10 con 0x7f3a60074620 2024-09-15T23:04:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.839+0000 7f3a64a13640 1 -- 172.21.15.66:0/1482791465 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58010990 con 0x7f3a60074620 2024-09-15T23:04:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.842+0000 7f3a64a13640 1 -- 172.21.15.66:0/1482791465 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f3a58010b30 con 0x7f3a60074620 2024-09-15T23:04:57.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.847+0000 7f3a64a13640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 0x7f3a480a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.847+0000 7f3a64a13640 1 -- 172.21.15.66:0/1482791465 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f3a580d03c0 con 0x7f3a60074620 2024-09-15T23:04:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.850+0000 7f3a67dee740 1 Processor -- start 2024-09-15T23:04:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.850+0000 7f3a67dee740 1 -- start start 2024-09-15T23:04:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac05d0 0x55b543ac0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57354/0 (socket says 172.21.15.66:57354) 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a5effd640 1 -- 172.21.15.66:0/197983204 learned_addr learned my addr 172.21.15.66:0/197983204 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543acb370 0x55b543acd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b543a262f0 con 0x55b543ac1b40 2024-09-15T23:04:57.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b5439cdcf0 con 0x55b543ac05d0 2024-09-15T23:04:57.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.851+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b543a222b0 con 0x55b543acb370 2024-09-15T23:04:57.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.852+0000 7f3a5f7fe640 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543acb370 0x55b543acd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.852+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 0x7f3a480a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac05d0 0x55b543ac0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 -- 172.21.15.66:0/197983204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543acb370 msgr2=0x55b543acd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543acb370 0x55b543acd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 -- 172.21.15.66:0/197983204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac05d0 msgr2=0x55b543ac0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac05d0 0x55b543ac0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 -- 172.21.15.66:0/197983204 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5439b23a0 con 0x55b543ac1b40 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.853+0000 7f3a5effd640 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3a5809c0e0 tx=0x7f3a5809bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60a7a8c3bc0be28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.854+0000 7f3a45ffb640 1 -- 172.21.15.66:0/197983204 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a4dc0 con 0x55b543ac1b40 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.854+0000 7f3a45ffb640 1 -- 172.21.15.66:0/197983204 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a580b5070 con 0x55b543ac1b40 2024-09-15T23:04:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.854+0000 7f3a45ffb640 1 -- 172.21.15.66:0/197983204 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580988a0 con 0x55b543ac1b40 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 msgr2=0x55b543ac0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3a5809c0e0 tx=0x7f3a5809bdc0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 0x7f3a480a5a80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55b543abdac0 tx=0x7f3a54009260 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 shutdown_connections 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543acb370 0x55b543acd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac05d0 0x55b543ac0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 --2- 172.21.15.66:0/197983204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac1b40 0x55b543ac0090 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.855+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 >> 172.21.15.66:0/197983204 conn(0x55b543a89310 msgr2=0x55b543abcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.862+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 shutdown_connections 2024-09-15T23:04:57.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.862+0000 7f3a67dee740 1 -- 172.21.15.66:0/197983204 wait complete. 2024-09-15T23:04:57.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.862+0000 7f3a67dee740 1 -- start start 2024-09-15T23:04:57.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.863+0000 7f3a67dee740 1 Processor -- start 2024-09-15T23:04:57.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.863+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543acace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ac7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a67dee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b543ace060 con 0x55b543ac05d0 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a67dee740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b5439e1060 con 0x55b543acb370 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48132/0 (socket says 172.21.15.66:48132) 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/4063081315 learned_addr learned my addr 172.21.15.66:0/4063081315 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b543ace1e0 con 0x55b543ac1b40 2024-09-15T23:04:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.864+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ac7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5effd640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543acace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 msgr2=0x55b543ac7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ac7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/4063081315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 msgr2=0x55b543acace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543acace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/4063081315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5437973c0 con 0x55b543acb370 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a67dee740 10 client.0 _ll_register_callbacks cb 0x55b5437348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.865+0000 7f3a5f7fe640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a50004270 tx=0x7f3a500042a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec137af4b5906c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a3effd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a3effd640 1 -- 172.21.15.66:0/4063081315 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50035070 con 0x55b543acb370 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a580b5070 con 0x55b543acb370 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a3effd640 1 -- 172.21.15.66:0/4063081315 <== mon.2 v2:172.21.15.87:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f3a50005220 con 0x55b543acb370 2024-09-15T23:04:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a3effd640 1 -- 172.21.15.66:0/4063081315 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3a5004d050 con 0x55b543acb370 2024-09-15T23:04:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a67dee740 10 client.28559 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.866+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({fsmap=74}) -- 0x55b543ad99d0 con 0x55b543acb370 2024-09-15T23:04:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a3effd640 1 -- 172.21.15.66:0/4063081315 <== mon.2 v2:172.21.15.87:3300/0 4 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f3a50005420 con 0x55b543acb370 2024-09-15T23:04:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 10 client.28559 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:57.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 10 client.28559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:04:57.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 20 client.28559 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:57.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543adadf0 0x55b543add250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 4 client.28559 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:04:57.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.869+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3a580b5070 con 0x55b543adadf0 2024-09-15T23:04:57.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.872+0000 7f3a5effd640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543adadf0 0x55b543add250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.873+0000 7f3a5effd640 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543adadf0 0x55b543add250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f92747971f3c06 server_cookie=14b3abdcece21bc5 in_seq=0 out_seq=0 2024-09-15T23:04:57.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.873+0000 7f3a3effd640 10 client.28559 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:57.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.874+0000 7f3a3effd640 1 -- 172.21.15.66:0/4063081315 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3a580b5070 con 0x55b543adadf0 2024-09-15T23:04:57.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.874+0000 7f3a3effd640 10 client.28559 handle_command_reply: tid=0 2024-09-15T23:04:57.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.874+0000 7f3a67dee740 1 client.28559 shutdown 2024-09-15T23:04:57.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 msgr2=0x55b543ac84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a50004270 tx=0x7f3a500042a0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 shutdown_connections 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543adadf0 0x55b543add250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ac84f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ac7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 --2- 172.21.15.66:0/4063081315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543acace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 >> 172.21.15.66:0/4063081315 conn(0x55b543a89310 msgr2=0x55b543ac2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.877+0000 7f3a3effd640 0 client.28559 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:57.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.879+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 shutdown_connections 2024-09-15T23:04:57.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.880+0000 7f3a67dee740 1 -- 172.21.15.66:0/4063081315 wait complete. 2024-09-15T23:04:57.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.881+0000 7f3a67dee740 20 client.28559 trim_cache size 0 max 16384 2024-09-15T23:04:57.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.903+0000 7f3a67dee740 1 Processor -- start 2024-09-15T23:04:57.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.903+0000 7f3a67dee740 1 -- start start 2024-09-15T23:04:57.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543ad7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ae2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ae30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0101b0 con 0x55b543ac05d0 2024-09-15T23:04:57.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c011fc0 con 0x55b543acb370 2024-09-15T23:04:57.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a67dee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c010940 con 0x55b543ac1b40 2024-09-15T23:04:57.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.904+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ae30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.905+0000 7f3a5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ae30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48146/0 (socket says 172.21.15.66:48146) 2024-09-15T23:04:57.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.905+0000 7f3a5f7fe640 1 -- 172.21.15.66:0/105823530 learned_addr learned my addr 172.21.15.66:0/105823530 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:57.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.907+0000 7f3a5effd640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543ad7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.907+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ae2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.908+0000 7f3a5e7fc640 1 -- 172.21.15.66:0/105823530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 msgr2=0x55b543ae30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.908+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ae30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.908+0000 7f3a5e7fc640 1 -- 172.21.15.66:0/105823530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 msgr2=0x55b543ad7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.908+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543ad7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.908+0000 7f3a5e7fc640 1 -- 172.21.15.66:0/105823530 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b543ac8860 con 0x55b543ac1b40 2024-09-15T23:04:57.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.910+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ae2bb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3a54006fd0 tx=0x7f3a54004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db8ed7c98fdb867 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.911+0000 7f3a5effd640 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543ad7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:04:57.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.911+0000 7f3a457fa640 1 -- 172.21.15.66:0/105823530 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54028070 con 0x55b543ac1b40 2024-09-15T23:04:57.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.911+0000 7f3a457fa640 1 -- 172.21.15.66:0/105823530 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a54010040 con 0x55b543ac1b40 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.912+0000 7f3a67dee740 1 -- 172.21.15.66:0/105823530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 msgr2=0x55b543ae2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.912+0000 7f3a67dee740 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ae2bb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3a54006fd0 tx=0x7f3a54004700 comp rx=0 tx=0).stop 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.915+0000 7f3a67dee740 1 -- 172.21.15.66:0/105823530 shutdown_connections 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.915+0000 7f3a67dee740 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543acb370 0x55b543ae30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.915+0000 7f3a67dee740 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac1b40 0x55b543ae2bb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.915+0000 7f3a67dee740 1 --2- 172.21.15.66:0/105823530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543ac05d0 0x55b543ad7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.915+0000 7f3a67dee740 1 -- 172.21.15.66:0/105823530 >> 172.21.15.66:0/105823530 conn(0x55b543a89310 msgr2=0x55b543aca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.921+0000 7f3a67dee740 1 -- 172.21.15.66:0/105823530 shutdown_connections 2024-09-15T23:04:57.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.923+0000 7f3a67dee740 1 -- 172.21.15.66:0/105823530 wait complete. 2024-09-15T23:04:57.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.923+0000 7f3a67dee740 1 -- start start 2024-09-15T23:04:57.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.923+0000 7f3a67dee740 1 Processor -- start 2024-09-15T23:04:57.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac1b40 0x55b543ad3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543acb370 0x55b543ad04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c011830 con 0x55b543acb370 2024-09-15T23:04:57.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0110a0 con 0x55b543ac1b40 2024-09-15T23:04:57.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c00e190 con 0x55b543ac05d0 2024-09-15T23:04:57.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.924+0000 7f3a67dee740 10 client.0 _ll_register_callbacks cb 0x7f3a50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:04:57.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60906/0 (socket says 172.21.15.66:60906) 2024-09-15T23:04:57.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 -- 172.21.15.66:0/1414325382 learned_addr learned my addr 172.21.15.66:0/1414325382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:04:57.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 -- 172.21.15.66:0/1414325382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac1b40 msgr2=0x55b543ad3bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:04:57.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac1b40 0x55b543ad3bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 -- 172.21.15.66:0/1414325382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543acb370 msgr2=0x55b543ad04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:04:57.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543acb370 0x55b543ad04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.928+0000 7f3a5effd640 1 -- 172.21.15.66:0/1414325382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b543ad0cd0 con 0x55b543ac05d0 2024-09-15T23:04:57.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.929+0000 7f3a5effd640 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3a58010540 tx=0x7f3a58005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421112b25581c7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:57.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.929+0000 7f3a3effd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:04:57.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.930+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580d0120 con 0x55b543ac05d0 2024-09-15T23:04:57.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.930+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9779+0+0 (secure 0 0 0) 0x7f3a580988a0 con 0x55b543ac05d0 2024-09-15T23:04:57.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.930+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a54010040 con 0x55b543ac05d0 2024-09-15T23:04:57.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.936+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3a580a4dc0 con 0x55b543ac05d0 2024-09-15T23:04:57.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.936+0000 7f3a67dee740 10 client.28462 fetch_fsmap learned FSMap version 74 2024-09-15T23:04:57.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.936+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x55b543b46650 con 0x55b543ac05d0 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.936+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a54010040 con 0x55b543ac05d0 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f3a5801f020 con 0x55b543ac05d0 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 10 client.28462 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 10 client.28462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 20 client.28462 populate_metadata read hostname 'smithi066' 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543b46f30 0x55b543b493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 4 client.28462 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:04:57.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 --> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3a54023e50 con 0x55b543b46f30 2024-09-15T23:04:57.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.937+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543b46f30 0x55b543b493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:57.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.939+0000 7f3a3effd640 10 client.28462 ms_handle_connect on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:57.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.941+0000 7f3a5e7fc640 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543b46f30 0x55b543b493b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2e9615e644ce9a6 server_cookie=79859abafece2ff3 in_seq=0 out_seq=0 2024-09-15T23:04:57.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.941+0000 7f3a3effd640 1 -- 172.21.15.66:0/1414325382 <== mds.1 v2:172.21.15.184:6838/2085772810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3a54023e50 con 0x55b543b46f30 2024-09-15T23:04:57.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.941+0000 7f3a3effd640 10 client.28462 handle_command_reply: tid=0 2024-09-15T23:04:57.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.941+0000 7f3a67dee740 1 client.28462 shutdown 2024-09-15T23:04:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.944+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 msgr2=0x55b543ad36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.944+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3a58010540 tx=0x7f3a58005f10 comp rx=0 tx=0).stop 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 shutdown_connections 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:6838/2085772810,v1:172.21.15.184:6839/2085772810] conn(0x55b543b46f30 0x55b543b493b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b543acb370 0x55b543ad04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b543ac1b40 0x55b543ad3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 --2- 172.21.15.66:0/1414325382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b543ac05d0 0x55b543ad36b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 >> 172.21.15.66:0/1414325382 conn(0x55b543a89310 msgr2=0x55b543ac2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.945+0000 7f3a3effd640 0 client.28462 ms_handle_reset on v2:172.21.15.184:6838/2085772810 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.946+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 shutdown_connections 2024-09-15T23:04:57.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.946+0000 7f3a67dee740 1 -- 172.21.15.66:0/1414325382 wait complete. 2024-09-15T23:04:57.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.946+0000 7f3a67dee740 20 client.28462 trim_cache size 0 max 16384 2024-09-15T23:04:57.949 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:04:57.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 msgr2=0x7f3a480a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 0x7f3a480a5a80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55b543abdac0 tx=0x7f3a54009260 comp rx=0 tx=0).stop 2024-09-15T23:04:57.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 msgr2=0x7f3a60101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:57.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 0x7f3a60101ad0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800ec80 tx=0x7f3a5800c6a0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 shutdown_connections 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f3a480a35c0 0x7f3a480a5a80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a60102550 0x7f3a60072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6010e3b0 0x7f3a60102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 --2- 172.21.15.66:0/1482791465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a60074620 0x7f3a60101ad0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.947+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 >> 172.21.15.66:0/1482791465 conn(0x7f3a600fd8b0 msgr2=0x7f3a600ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.949+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 shutdown_connections 2024-09-15T23:04:57.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:57.949+0000 7f3a65a15640 1 -- 172.21.15.66:0/1482791465 wait complete. 2024-09-15T23:04:58.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:04:59.224 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:04:59.531 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:59 smithi066 ceph-mon[31185]: pgmap v619: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 KiB/s wr, 101 op/s 2024-09-15T23:04:59.532 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:04:59 smithi066 ceph-mon[31185]: osdmap e119: 12 total, 12 up, 12 in 2024-09-15T23:04:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:59 smithi087 ceph-mon[35290]: pgmap v619: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 KiB/s wr, 101 op/s 2024-09-15T23:04:59.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:04:59 smithi087 ceph-mon[35290]: osdmap e119: 12 total, 12 up, 12 in 2024-09-15T23:04:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:59 smithi184 ceph-mon[35203]: pgmap v619: 129 pgs: 15 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 67 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 KiB/s wr, 101 op/s 2024-09-15T23:04:59.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:04:59 smithi184 ceph-mon[35203]: osdmap e119: 12 total, 12 up, 12 in 2024-09-15T23:05:00.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.848+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1182873987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90102ef0 msgr2=0x7f7e9010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.848+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1182873987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90102ef0 0x7f7e9010da40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009ca0 tx=0x7f7e8802a970 comp rx=0 tx=0).stop 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.849+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1182873987 shutdown_connections 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.849+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1182873987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90102ef0 0x7f7e9010da40 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.849+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1182873987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.849+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1182873987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90100e20 0x7f7e90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.849+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1182873987 >> 172.21.15.66:0/1182873987 conn(0x7f7e900fc7d0 msgr2=0x7f7e900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.854+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1182873987 shutdown_connections 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.857+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1182873987 wait complete. 2024-09-15T23:05:00.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.857+0000 7f7e95d8d640 1 Processor -- start 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 -- start start 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90100e20 0x7f7e901a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 0x7f7e901abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90120e90 con 0x7f7e90100e20 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90120d10 con 0x7f7e90102570 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e95d8d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90121010 con 0x7f7e90102ef0 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.858+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.859+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:48182/0 (socket says 172.21.15.66:48182) 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.859+0000 7f7e8effd640 1 -- 172.21.15.66:0/1662198069 learned_addr learned my addr 172.21.15.66:0/1662198069 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:00.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.859+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 0x7f7e901abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.860+0000 7f7e8ffff640 1 -- 172.21.15.66:0/1662198069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 msgr2=0x7f7e901a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.860+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.860+0000 7f7e8ffff640 1 -- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90100e20 msgr2=0x7f7e901a7250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.860+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90100e20 0x7f7e901a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.860+0000 7f7e8ffff640 1 -- 172.21.15.66:0/1662198069 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e901ac200 con 0x7f7e90102ef0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.867+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 0x7f7e901abb20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802af60 tx=0x7f7e88003ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.868+0000 7f7e8cff9640 1 -- 172.21.15.66:0/1662198069 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88047070 con 0x7f7e90102ef0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.868+0000 7f7e8cff9640 1 -- 172.21.15.66:0/1662198069 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e8802f8a0 con 0x7f7e90102ef0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.868+0000 7f7e8cff9640 1 -- 172.21.15.66:0/1662198069 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88034070 con 0x7f7e90102ef0 2024-09-15T23:05:00.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.868+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e901ac490 con 0x7f7e90102ef0 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.868+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e901ac920 con 0x7f7e90102ef0 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.872+0000 7f7e98166740 1 Processor -- start 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.872+0000 7f7e98166740 1 -- start start 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x560391465090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 0x560391465a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391470370 0x560391472760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5603913cb2f0 con 0x5603914655d0 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560391372cf0 con 0x560391466b40 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.874+0000 7f7e98166740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5603913c72b0 con 0x560391470370 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.875+0000 7f7e8cff9640 1 -- 172.21.15.66:0/1662198069 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7e88037020 con 0x7f7e90102ef0 2024-09-15T23:05:00.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.875+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x560391465090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.875+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 0x560391465a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 0x560391465a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57414/0 (socket says 172.21.15.66:57414) 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8f7fe640 1 -- 172.21.15.66:0/1521467138 learned_addr learned my addr 172.21.15.66:0/1521467138 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391470370 0x560391472760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8cff9640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 0x7f7e780a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8cff9640 1 -- 172.21.15.66:0/1662198069 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f7e880f09f0 con 0x7f7e90102ef0 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.876+0000 7f7e8effd640 1 -- 172.21.15.66:0/1521467138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391470370 msgr2=0x560391472760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.877+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391470370 0x560391472760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.877+0000 7f7e8effd640 1 -- 172.21.15.66:0/1521467138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 msgr2=0x560391465a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.877+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 0x560391465a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.877+0000 7f7e8effd640 1 -- 172.21.15.66:0/1521467138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603913573a0 con 0x560391466b40 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.877+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 0x7f7e780a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.878+0000 7f7e8ffff640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 0x7f7e780a5a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7e880b91c0 tx=0x7f7e8802a970 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.879+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x560391465090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e900fec10 tx=0x7f7e8400a470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58dbd1d82bedd3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.893+0000 7f7e75ffb640 1 -- 172.21.15.66:0/1521467138 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84016040 con 0x560391466b40 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.893+0000 7f7e75ffb640 1 -- 172.21.15.66:0/1521467138 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e8400de40 con 0x560391466b40 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.893+0000 7f7e75ffb640 1 -- 172.21.15.66:0/1521467138 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84003850 con 0x560391466b40 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.894+0000 7f7e98166740 1 -- 172.21.15.66:0/1521467138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 msgr2=0x560391465090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x560391465090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e900fec10 tx=0x7f7e8400a470 comp rx=0 tx=0).stop 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 -- 172.21.15.66:0/1521467138 shutdown_connections 2024-09-15T23:05:00.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391470370 0x560391472760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603914655d0 0x560391465a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 --2- 172.21.15.66:0/1521467138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x560391465090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.895+0000 7f7e98166740 1 -- 172.21.15.66:0/1521467138 >> 172.21.15.66:0/1521467138 conn(0x56039142e310 msgr2=0x560391461c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.897+0000 7f7e98166740 1 -- 172.21.15.66:0/1521467138 shutdown_connections 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.898+0000 7f7e98166740 1 -- 172.21.15.66:0/1521467138 wait complete. 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.899+0000 7f7e98166740 1 -- start start 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.899+0000 7f7e98166740 1 Processor -- start 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x56039146d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x56039146d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60936/0 (socket says 172.21.15.66:60936) 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e8effd640 1 -- 172.21.15.66:0/1564243905 learned_addr learned my addr 172.21.15.66:0/1564243905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560391473070 con 0x560391470370 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x560391386060 con 0x560391466b40 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.900+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5603914731f0 con 0x5603914655d0 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e98166740 10 client.0 _ll_register_callbacks cb 0x5603910d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e8effd640 1 -- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 msgr2=0x56039146d0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x56039146d0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e8effd640 1 -- 172.21.15.66:0/1564243905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 msgr2=0x56039146d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x56039146d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e8effd640 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56039113c3c0 con 0x5603914655d0 2024-09-15T23:05:00.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.901+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603913d8860 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.904+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e84006010 tx=0x7f7e8400d5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c103dbc4c4966ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.904+0000 7f7e6effd640 10 client.28474 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.905+0000 7f7e6effd640 1 -- 172.21.15.66:0/1564243905 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400cd40 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.905+0000 7f7e6effd640 1 -- 172.21.15.66:0/1564243905 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f7e84029470 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.905+0000 7f7e6effd640 1 -- 172.21.15.66:0/1564243905 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f7e840296b0 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.905+0000 7f7e98166740 10 client.28474 fetch_fsmap learned FSMap version 74 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.905+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=74}) -- 0x56039147ea40 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e6effd640 1 -- 172.21.15.66:0/1564243905 <== mon.1 v2:172.21.15.184:3300/0 4 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f7e8401d430 con 0x5603914655d0 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 10 client.28474 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:05:00.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 10 client.28474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 20 client.28474 populate_metadata read hostname 'smithi066' 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560391480090 0x560391482550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 4 client.28474 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.906+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603913d2d70 con 0x560391480090 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.908+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560391480090 0x560391482550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.910+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560391480090 0x560391482550 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d5336d9ef20beee server_cookie=6bfe3411cc21b893 in_seq=0 out_seq=0 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.910+0000 7f7e6effd640 10 client.28474 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.914+0000 7f7e6effd640 1 -- 172.21.15.66:0/1564243905 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603913d2d70 con 0x560391480090 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.914+0000 7f7e6effd640 10 client.28474 handle_command_reply: tid=0 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.914+0000 7f7e98166740 1 client.28474 shutdown 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 msgr2=0x56039146fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e84006010 tx=0x7f7e8400d5a0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 shutdown_connections 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x56039146d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x560391480090 0x560391482550 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391466b40 0x56039146d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 --2- 172.21.15.66:0/1564243905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603914655d0 0x56039146fda0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e84006010 tx=0x7f7e8400d5a0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 >> 172.21.15.66:0/1564243905 conn(0x56039142e310 msgr2=0x560391467930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.915+0000 7f7e6effd640 0 client.28474 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.916+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 shutdown_connections 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.916+0000 7f7e98166740 1 -- 172.21.15.66:0/1564243905 wait complete. 2024-09-15T23:05:00.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.916+0000 7f7e98166740 20 client.28474 trim_cache size 0 max 16384 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.942+0000 7f7e98166740 1 Processor -- start 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 -- start start 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 0x560391468120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391461f20 0x560391468660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60944/0 (socket says 172.21.15.66:60944) 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e8effd640 1 -- 172.21.15.66:0/3764909384 learned_addr learned my addr 172.21.15.66:0/3764909384 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901be130 con 0x560391461f20 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 0x560391468120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901bff40 con 0x560391470370 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.943+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901be8c0 con 0x560391466b40 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.946+0000 7f7e8effd640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391461f20 0x560391468660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 -- 172.21.15.66:0/3764909384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 msgr2=0x560391468120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 0x560391468120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 -- 172.21.15.66:0/3764909384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391461f20 msgr2=0x560391468660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391461f20 0x560391468660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 -- 172.21.15.66:0/3764909384 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039146dba0 con 0x560391466b40 2024-09-15T23:05:00.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.948+0000 7f7e8effd640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400a2e0 tx=0x7f7e84023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a0b08a06ca4dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.950+0000 7f7e757fa640 1 -- 172.21.15.66:0/3764909384 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8403b040 con 0x560391466b40 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.950+0000 7f7e757fa640 1 -- 172.21.15.66:0/3764909384 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5603913d8860 con 0x560391466b40 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.950+0000 7f7e757fa640 1 -- 172.21.15.66:0/3764909384 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84005530 con 0x560391466b40 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.950+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 0x560391468120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 msgr2=0x56039146c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400a2e0 tx=0x7f7e84023000 comp rx=0 tx=0).stop 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 shutdown_connections 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391461f20 0x560391468660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391470370 0x560391468120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 --2- 172.21.15.66:0/3764909384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x56039146c080 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.951+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 >> 172.21.15.66:0/3764909384 conn(0x56039142e310 msgr2=0x56039146b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.953+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 shutdown_connections 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.953+0000 7f7e98166740 1 -- 172.21.15.66:0/3764909384 wait complete. 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.953+0000 7f7e98166740 1 -- start start 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 Processor -- start 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391461f20 0x5603914784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x5603914696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901bf7b0 con 0x560391470370 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901bf020 con 0x560391461f20 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901bc110 con 0x560391466b40 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e98166740 10 client.0 _ll_register_callbacks cb 0x7f7e8400af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:60954/0 (socket says 172.21.15.66:60954) 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e8f7fe640 1 -- 172.21.15.66:0/1051757670 learned_addr learned my addr 172.21.15.66:0/1051757670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.954+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x5603914696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391461f20 0x5603914784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 -- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391461f20 msgr2=0x5603914784b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391461f20 0x5603914784b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 -- 172.21.15.66:0/1051757670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 msgr2=0x5603914696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x5603914696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 -- 172.21.15.66:0/1051757670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560391469c10 con 0x560391466b40 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e8f7fe640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x56039146c930 tx=0x7f7e80004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd08bec09e4f7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.955+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80003c20 con 0x560391466b40 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f7e80003dc0 con 0x560391466b40 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603913d8860 con 0x560391466b40 2024-09-15T23:05:00.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f7e80005020 con 0x560391466b40 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e98166740 10 client.28480 fetch_fsmap learned FSMap version 74 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x5603914fb600 con 0x560391466b40 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.956+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5603913d8860 con 0x560391466b40 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 74) ==== 8442+0+0 (secure 0 0 0) 0x7f7e80015ce0 con 0x560391466b40 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 10 client.28480 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 10 client.28480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 20 client.28480 populate_metadata read hostname 'smithi066' 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5603914fbd60 0x5603914fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:00.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 4 client.28480 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 --> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56039134f170 con 0x5603914fbd60 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5603914fbd60 0x5603914fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e6effd640 10 client.28480 ms_handle_connect on v2:172.21.15.87:6838/426418588 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.957+0000 7f7e8effd640 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5603914fbd60 0x5603914fe180 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62ac3c40a8db14c server_cookie=615d3343d62e0820 in_seq=0 out_seq=0 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e6effd640 1 -- 172.21.15.66:0/1051757670 <== mds.0 v2:172.21.15.87:6838/426418588 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56039134f170 con 0x5603914fbd60 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e6effd640 10 client.28480 handle_command_reply: tid=0 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 client.28480 shutdown 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 msgr2=0x5603914789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x56039146c930 tx=0x7f7e80004410 comp rx=0 tx=0).stop 2024-09-15T23:05:00.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 shutdown_connections 2024-09-15T23:05:00.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560391470370 0x5603914696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560391466b40 0x5603914789f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:6838/426418588,v1:172.21.15.87:6839/426418588] conn(0x5603914fbd60 0x5603914fe180 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 --2- 172.21.15.66:0/1051757670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560391461f20 0x5603914784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.853 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e6effd640 0 client.28480 ms_handle_reset on v2:172.21.15.87:6838/426418588 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 >> 172.21.15.66:0/1051757670 conn(0x56039142e310 msgr2=0x56039147b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 shutdown_connections 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 1 -- 172.21.15.66:0/1051757670 wait complete. 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.959+0000 7f7e98166740 20 client.28480 trim_cache size 0 max 16384 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 msgr2=0x7f7e780a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 0x7f7e780a5a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7e880b91c0 tx=0x7f7e8802a970 comp rx=0 tx=0).stop 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 msgr2=0x7f7e901abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 0x7f7e901abb20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802af60 tx=0x7f7e88003ef0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 shutdown_connections 2024-09-15T23:05:00.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7e780a3540 0x7f7e780a5a00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e90102ef0 0x7f7e901abb20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e90102570 0x7f7e901a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 --2- 172.21.15.66:0/1662198069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e90100e20 0x7f7e901a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 >> 172.21.15.66:0/1662198069 conn(0x7f7e900fc7d0 msgr2=0x7f7e90106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 shutdown_connections 2024-09-15T23:05:00.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:04:59.960+0000 7f7e95d8d640 1 -- 172.21.15.66:0/1662198069 wait complete. 2024-09-15T23:05:01.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:01 smithi087 ceph-mon[35290]: pgmap v621: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 104 op/s 2024-09-15T23:05:01.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:01 smithi184 ceph-mon[35203]: pgmap v621: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 104 op/s 2024-09-15T23:05:01.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:01 smithi066 ceph-mon[31185]: pgmap v621: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 104 op/s 2024-09-15T23:05:03.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:03 smithi087 ceph-mon[35290]: pgmap v622: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-09-15T23:05:03.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:03 smithi184 ceph-mon[35203]: pgmap v622: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-09-15T23:05:03.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:03 smithi066 ceph-mon[31185]: pgmap v622: 129 pgs: 15 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 69 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 KiB/s wr, 100 op/s 2024-09-15T23:05:05.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:05 smithi087 ceph-mon[35290]: pgmap v623: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 KiB/s wr, 103 op/s 2024-09-15T23:05:05.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:05 smithi184 ceph-mon[35203]: pgmap v623: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 KiB/s wr, 103 op/s 2024-09-15T23:05:05.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:05 smithi066 ceph-mon[31185]: pgmap v623: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 KiB/s wr, 103 op/s 2024-09-15T23:05:07.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:07 smithi087 ceph-mon[35290]: pgmap v624: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 91 op/s 2024-09-15T23:05:07.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:07 smithi184 ceph-mon[35203]: pgmap v624: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 91 op/s 2024-09-15T23:05:07.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:07 smithi066 ceph-mon[31185]: pgmap v624: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 91 op/s 2024-09-15T23:05:07.767 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-15T23:05:07.768 INFO:tasks.fwd_scrub:done joining 2024-09-15T23:05:07.768 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T23:05:07.779 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:05:07.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.991+0000 7f90ba124640 1 -- 172.21.15.66:0/1997431040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 msgr2=0x7f90ac0a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:07.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.991+0000 7f90ba124640 1 --2- 172.21.15.66:0/1997431040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a46b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009930 tx=0x7f90b002a460 comp rx=0 tx=0).stop 2024-09-15T23:05:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.992+0000 7f90ba124640 1 -- 172.21.15.66:0/1997431040 shutdown_connections 2024-09-15T23:05:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.992+0000 7f90ba124640 1 --2- 172.21.15.66:0/1997431040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a46b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.992+0000 7f90ba124640 1 --2- 172.21.15.66:0/1997431040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac0977e0 0x7f90ac097c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.992+0000 7f90ba124640 1 --2- 172.21.15.66:0/1997431040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac09d7f0 0x7f90ac09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.992+0000 7f90ba124640 1 -- 172.21.15.66:0/1997431040 >> 172.21.15.66:0/1997431040 conn(0x7f90ac0934c0 msgr2=0x7f90ac0958e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:07.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.994+0000 7f90ba124640 1 -- 172.21.15.66:0/1997431040 shutdown_connections 2024-09-15T23:05:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.997+0000 7f90ba124640 1 -- 172.21.15.66:0/1997431040 wait complete. 2024-09-15T23:05:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:07.997+0000 7f90ba124640 1 Processor -- start 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 -- start start 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 0x7f90ac0a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0a7c30 con 0x7f90ac098180 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0a7ab0 con 0x7f90ac09d7f0 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.001+0000 7f90ba124640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0a7db0 con 0x7f90ac0977e0 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.002+0000 7f90b9923640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.002+0000 7f90b9923640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46184/0 (socket says 172.21.15.66:46184) 2024-09-15T23:05:08.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.002+0000 7f90b9923640 1 -- 172.21.15.66:0/1081933106 learned_addr learned my addr 172.21.15.66:0/1081933106 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.007+0000 7f90b8921640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.007+0000 7f90b9122640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 0x7f90ac0a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.007+0000 7f90b9923640 1 -- 172.21.15.66:0/1081933106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 msgr2=0x7f90ac0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9923640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 0x7f90ac0a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9923640 1 -- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 msgr2=0x7f90ac0a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9923640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9923640 1 -- 172.21.15.66:0/1081933106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac134150 con 0x7f90ac09d7f0 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9122640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 0x7f90ac0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b8921640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:05:08.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.011+0000 7f90b9923640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f90b002a9d0 tx=0x7f90b0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.013+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b003f070 con 0x7f90ac09d7f0 2024-09-15T23:05:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.013+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b0031c90 con 0x7f90ac09d7f0 2024-09-15T23:05:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.013+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0035030 con 0x7f90ac09d7f0 2024-09-15T23:05:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.015+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac1343e0 con 0x7f90ac09d7f0 2024-09-15T23:05:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.015+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac134880 con 0x7f90ac09d7f0 2024-09-15T23:05:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.017+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac098f20 con 0x7f90ac09d7f0 2024-09-15T23:05:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.020+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f90b0042070 con 0x7f90ac09d7f0 2024-09-15T23:05:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.021+0000 7f90aa7fc640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 0x7f90a00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.022+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f90b00f0de0 con 0x7f90ac09d7f0 2024-09-15T23:05:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.025+0000 7f90b9122640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 0x7f90a00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.027+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90b0049030 con 0x7f90ac09d7f0 2024-09-15T23:05:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.028+0000 7f90b9122640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 0x7f90a00a5a80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90b4051790 tx=0x7f90b40504d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:08.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.382+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90ac097c40 con 0x7f90ac09d7f0 2024-09-15T23:05:08.388 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:05:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.384+0000 7f90aa7fc640 1 -- 172.21.15.66:0/1081933106 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+25768 (secure 0 0 0) 0x7f90b00bd300 con 0x7f90ac09d7f0 2024-09-15T23:05:08.389 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":119,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T23:04:59.166934+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3471066820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2430511108":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3162528820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1080608797":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3964165811":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1080608797":"2024-09-16T22:45:21.507897+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":20,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":33,"length":1}]},{"pool":4,"snaps":[{"begin":18,"length":1},{"begin":20,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":33,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:05:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.388+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 msgr2=0x7f90a00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.388+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 0x7f90a00a5a80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f90b4051790 tx=0x7f90b40504d0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.388+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 msgr2=0x7f90ac0a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.388+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f90b002a9d0 tx=0x7f90b0003b90 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 shutdown_connections 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f90a00a35c0 0x7f90a00a5a80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ac09d7f0 0x7f90ac0a1c00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90ac098180 0x7f90ac0a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 --2- 172.21.15.66:0/1081933106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90ac0977e0 0x7f90ac0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.389+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 >> 172.21.15.66:0/1081933106 conn(0x7f90ac0934c0 msgr2=0x7f90ac093ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:08.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.390+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 shutdown_connections 2024-09-15T23:05:08.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.392+0000 7f90ba124640 1 -- 172.21.15.66:0/1081933106 wait complete. 2024-09-15T23:05:08.417 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:38:16.784964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:42:50.396560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:42:52.518865+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T22:42:59.227216+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T23:05:08.418 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:05:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.630+0000 7f8b61d9b640 1 -- 172.21.15.66:0/4154421900 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c030920 con 0x7f8b64102450 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 -- 172.21.15.66:0/4154421900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64102450 msgr2=0x7f8b6410e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 --2- 172.21.15.66:0/4154421900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64102450 0x7f8b6410e980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009860 tx=0x7f8b5c02a360 comp rx=0 tx=0).stop 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 -- 172.21.15.66:0/4154421900 shutdown_connections 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 --2- 172.21.15.66:0/4154421900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64102450 0x7f8b6410e980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 --2- 172.21.15.66:0/4154421900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64101ab0 0x7f8b64101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 --2- 172.21.15.66:0/4154421900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b64107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.631+0000 7f8b689a6640 1 -- 172.21.15.66:0/4154421900 >> 172.21.15.66:0/4154421900 conn(0x7f8b640fd790 msgr2=0x7f8b640ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.633+0000 7f8b689a6640 1 -- 172.21.15.66:0/4154421900 shutdown_connections 2024-09-15T23:05:08.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.637+0000 7f8b689a6640 1 -- 172.21.15.66:0/4154421900 wait complete. 2024-09-15T23:05:08.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.638+0000 7f8b689a6640 1 Processor -- start 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.638+0000 7f8b689a6640 1 -- start start 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 0x7f8b6419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 0x7f8b6419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b6419ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64114150 con 0x7f8b64102450 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64113fd0 con 0x7f8b64101ab0 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b689a6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641142d0 con 0x7f8b64107ac0 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b59d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 0x7f8b6419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b59d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 0x7f8b6419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37098/0 (socket says 172.21.15.66:37098) 2024-09-15T23:05:08.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.639+0000 7f8b59d9b640 1 -- 172.21.15.66:0/2563917140 learned_addr learned my addr 172.21.15.66:0/2563917140 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:08.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.640+0000 7f8b62d9d640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b6419ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b6259c640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 0x7f8b6419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b62d9d640 1 -- 172.21.15.66:0/2563917140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 msgr2=0x7f8b6419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b62d9d640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 0x7f8b6419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b62d9d640 1 -- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 msgr2=0x7f8b6419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b62d9d640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 0x7f8b6419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b62d9d640 1 -- 172.21.15.66:0/2563917140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6419f520 con 0x7f8b64107ac0 2024-09-15T23:05:08.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.641+0000 7f8b6259c640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 0x7f8b6419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b62d9d640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b6419ee20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c02a950 tx=0x7f8b5c033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c037040 con 0x7f8b64107ac0 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6419f7b0 con 0x7f8b64107ac0 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6406bc10 con 0x7f8b64107ac0 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b5c02adc0 con 0x7f8b64107ac0 2024-09-15T23:05:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.642+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c005050 con 0x7f8b64107ac0 2024-09-15T23:05:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.645+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b44005290 con 0x7f8b64107ac0 2024-09-15T23:05:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.646+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f8b5c042030 con 0x7f8b64107ac0 2024-09-15T23:05:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.647+0000 7f8b5bfff640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 0x7f8b500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.647+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f8b5c0ef1e0 con 0x7f8b64107ac0 2024-09-15T23:05:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.648+0000 7f8b6259c640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 0x7f8b500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.649+0000 7f8b6259c640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 0x7f8b500a5900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005c40 tx=0x7f8b54008360 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:08.655+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b5c049060 con 0x7f8b64107ac0 2024-09-15T23:05:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.004+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b44005850 con 0x7f8b64107ac0 2024-09-15T23:05:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.014+0000 7f8b5bfff640 1 -- 172.21.15.66:0/2563917140 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) ==== 93+0+10 (secure 0 0 0) 0x7f8b5c0bb880 con 0x7f8b64107ac0 2024-09-15T23:05:09.016 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-09-15T23:05:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 msgr2=0x7f8b500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 0x7f8b500a5900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005c40 tx=0x7f8b54008360 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 msgr2=0x7f8b6419ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b6419ee20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c02a950 tx=0x7f8b5c033d10 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 shutdown_connections 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f8b500a3440 0x7f8b500a5900 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b64107ac0 0x7f8b6419ee20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b64102450 0x7f8b6419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 --2- 172.21.15.66:0/2563917140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b64101ab0 0x7f8b6419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.017+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 >> 172.21.15.66:0/2563917140 conn(0x7f8b640fd790 msgr2=0x7f8b640feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.018+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 shutdown_connections 2024-09-15T23:05:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.018+0000 7f8b689a6640 1 -- 172.21.15.66:0/2563917140 wait complete. 2024-09-15T23:05:09.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:05:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.271+0000 7f0e53303640 1 -- 172.21.15.66:0/2272345357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c101a90 msgr2=0x7f0e4c101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.271+0000 7f0e53303640 1 --2- 172.21.15.66:0/2272345357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c101a90 0x7f0e4c101ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009900 tx=0x7f0e3c02a410 comp rx=0 tx=0).stop 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.275+0000 7f0e53303640 1 -- 172.21.15.66:0/2272345357 shutdown_connections 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.275+0000 7f0e53303640 1 --2- 172.21.15.66:0/2272345357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.275+0000 7f0e53303640 1 --2- 172.21.15.66:0/2272345357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c101a90 0x7f0e4c101ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.275+0000 7f0e53303640 1 --2- 172.21.15.66:0/2272345357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c107aa0 0x7f0e4c107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.275+0000 7f0e53303640 1 -- 172.21.15.66:0/2272345357 >> 172.21.15.66:0/2272345357 conn(0x7f0e4c0fd7d0 msgr2=0x7f0e4c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:09.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.278+0000 7f0e53303640 1 -- 172.21.15.66:0/2272345357 shutdown_connections 2024-09-15T23:05:09.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.279+0000 7f0e53303640 1 -- 172.21.15.66:0/2272345357 wait complete. 2024-09-15T23:05:09.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.280+0000 7f0e53303640 1 Processor -- start 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.280+0000 7f0e53303640 1 -- start start 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 0x7f0e4c075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c076060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c107aa0 0x7f0e4c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c111ef0 con 0x7f0e4c101a90 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c111d70 con 0x7f0e4c107aa0 2024-09-15T23:05:09.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.281+0000 7f0e53303640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c112070 con 0x7f0e4c102430 2024-09-15T23:05:09.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.283+0000 7f0e5109f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 0x7f0e4c075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.283+0000 7f0e5109f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 0x7f0e4c075b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37112/0 (socket says 172.21.15.66:37112) 2024-09-15T23:05:09.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.283+0000 7f0e5109f640 1 -- 172.21.15.66:0/601924574 learned_addr learned my addr 172.21.15.66:0/601924574 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:09.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.283+0000 7f0e518a0640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c107aa0 0x7f0e4c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.283+0000 7f0e5089e640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.285+0000 7f0e5089e640 1 -- 172.21.15.66:0/601924574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c107aa0 msgr2=0x7f0e4c06cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.285+0000 7f0e5089e640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c107aa0 0x7f0e4c06cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.285+0000 7f0e5089e640 1 -- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 msgr2=0x7f0e4c075b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.285+0000 7f0e5089e640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 0x7f0e4c075b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.285+0000 7f0e5089e640 1 -- 172.21.15.66:0/601924574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c06d500 con 0x7f0e4c102430 2024-09-15T23:05:09.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.290+0000 7f0e5089e640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c076060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c02aa00 tx=0x7f0e3c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:09.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.293+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c03f070 con 0x7f0e4c102430 2024-09-15T23:05:09.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.294+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c06d790 con 0x7f0e4c102430 2024-09-15T23:05:09.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.294+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c071740 con 0x7f0e4c102430 2024-09-15T23:05:09.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.295+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e3c031c20 con 0x7f0e4c102430 2024-09-15T23:05:09.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.295+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c035030 con 0x7f0e4c102430 2024-09-15T23:05:09.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.297+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e30005290 con 0x7f0e4c102430 2024-09-15T23:05:09.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.302+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0e3c042070 con 0x7f0e4c102430 2024-09-15T23:05:09.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.303+0000 7f0e427fc640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 0x7f0e380a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.303+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f0e3c0f04d0 con 0x7f0e4c102430 2024-09-15T23:05:09.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.305+0000 7f0e5109f640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 0x7f0e380a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.306+0000 7f0e5109f640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 0x7f0e380a5a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009c10 tx=0x7f0e48005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:09.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.308+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e3c0bc970 con 0x7f0e4c102430 2024-09-15T23:05:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:09 smithi066 ceph-mon[31185]: pgmap v625: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 90 op/s 2024-09-15T23:05:09.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:09 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1081933106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:09.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:09 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2563917140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:05:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:09 smithi087 ceph-mon[35290]: pgmap v625: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 90 op/s 2024-09-15T23:05:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:09 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1081933106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:09.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:09 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2563917140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:05:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:09 smithi184 ceph-mon[35203]: pgmap v625: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 90 op/s 2024-09-15T23:05:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:09 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1081933106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:09.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:09 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2563917140' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:05:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.679+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0e30005850 con 0x7f0e4c102430 2024-09-15T23:05:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.683+0000 7f0e427fc640 1 -- 172.21.15.66:0/601924574 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) ==== 104+0+11 (secure 0 0 0) 0x7f0e3c031dd0 con 0x7f0e4c102430 2024-09-15T23:05:09.685 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-09-15T23:05:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.686+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 msgr2=0x7f0e380a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.686+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 0x7f0e380a5a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009c10 tx=0x7f0e48005f90 comp rx=0 tx=0).stop 2024-09-15T23:05:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.686+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 msgr2=0x7f0e4c076060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.686+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c076060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c02aa00 tx=0x7f0e3c003b90 comp rx=0 tx=0).stop 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 shutdown_connections 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e380a35c0 0x7f0e380a5a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c107aa0 0x7f0e4c06cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4c102430 0x7f0e4c076060 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 --2- 172.21.15.66:0/601924574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e4c101a90 0x7f0e4c075b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 >> 172.21.15.66:0/601924574 conn(0x7f0e4c0fd7d0 msgr2=0x7f0e4c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 shutdown_connections 2024-09-15T23:05:09.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.688+0000 7f0e53303640 1 -- 172.21.15.66:0/601924574 wait complete. 2024-09-15T23:05:09.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:05:09.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.919+0000 7f1eaf503640 1 -- 172.21.15.66:0/1687979129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea810ea10 msgr2=0x7f1ea81153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.919+0000 7f1eaf503640 1 --2- 172.21.15.66:0/1687979129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea810ea10 0x7f1ea81153c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009900 tx=0x7f1e9802c630 comp rx=0 tx=0).stop 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.923+0000 7f1eaf503640 1 -- 172.21.15.66:0/1687979129 shutdown_connections 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.923+0000 7f1eaf503640 1 --2- 172.21.15.66:0/1687979129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea810ea10 0x7f1ea81153c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.923+0000 7f1eaf503640 1 --2- 172.21.15.66:0/1687979129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea8109e10 0x7f1ea810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.923+0000 7f1eaf503640 1 --2- 172.21.15.66:0/1687979129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea8109460 0x7f1ea8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.923+0000 7f1eaf503640 1 -- 172.21.15.66:0/1687979129 >> 172.21.15.66:0/1687979129 conn(0x7f1ea806d230 msgr2=0x7f1ea806d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:09.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.927+0000 7f1eaf503640 1 -- 172.21.15.66:0/1687979129 shutdown_connections 2024-09-15T23:05:09.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.930+0000 7f1eaf503640 1 -- 172.21.15.66:0/1687979129 wait complete. 2024-09-15T23:05:09.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.930+0000 7f1eaf503640 1 Processor -- start 2024-09-15T23:05:09.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.930+0000 7f1eaf503640 1 -- start start 2024-09-15T23:05:09.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea8109460 0x7f1ea8113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea8114910 0x7f1ea81bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8117a90 con 0x7f1ea8114910 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8117910 con 0x7f1ea810ea10 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaf503640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8117c10 con 0x7f1ea8109460 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:46242/0 (socket says 172.21.15.66:46242) 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 -- 172.21.15.66:0/151361810 learned_addr learned my addr 172.21.15.66:0/151361810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 -- 172.21.15.66:0/151361810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea8109460 msgr2=0x7f1ea8113e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea8109460 0x7f1ea8113e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 -- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea8114910 msgr2=0x7f1ea81bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea8114910 0x7f1ea81bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:09.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.931+0000 7f1eaca9e640 1 -- 172.21.15.66:0/151361810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea81bbfe0 con 0x7f1ea810ea10 2024-09-15T23:05:09.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.933+0000 7f1eaca9e640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000ecc0 tx=0x7f1ea000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:09.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.936+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea001b070 con 0x7f1ea810ea10 2024-09-15T23:05:09.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.936+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea81bc2d0 con 0x7f1ea810ea10 2024-09-15T23:05:09.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.936+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea81bc820 con 0x7f1ea810ea10 2024-09-15T23:05:09.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.936+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea0016ad0 con 0x7f1ea810ea10 2024-09-15T23:05:09.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.936+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0014a60 con 0x7f1ea810ea10 2024-09-15T23:05:09.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.941+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8c005290 con 0x7f1ea810ea10 2024-09-15T23:05:09.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.946+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1ea001e070 con 0x7f1ea810ea10 2024-09-15T23:05:09.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.947+0000 7f1e9e7fc640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 0x7f1e940a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:09.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.947+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f1ea00cfd60 con 0x7f1ea810ea10 2024-09-15T23:05:09.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.952+0000 7f1ead29f640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 0x7f1e940a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:09.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.953+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ea0013070 con 0x7f1ea810ea10 2024-09-15T23:05:09.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:09.953+0000 7f1ead29f640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 0x7f1e940a5a80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400a890 tx=0x7f1ea4005b80 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:10.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.296+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1e8c005850 con 0x7f1ea810ea10 2024-09-15T23:05:10.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.298+0000 7f1e9e7fc640 1 -- 172.21.15.66:0/151361810 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) ==== 100+0+11 (secure 0 0 0) 0x7f1ea009c200 con 0x7f1ea810ea10 2024-09-15T23:05:10.300 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 64 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 msgr2=0x7f1e940a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 0x7f1e940a5a80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400a890 tx=0x7f1ea4005b80 comp rx=0 tx=0).stop 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 msgr2=0x7f1ea81143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000ecc0 tx=0x7f1ea000c6a0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 shutdown_connections 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f1e940a35c0 0x7f1e940a5a80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ea8114910 0x7f1ea81bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ea810ea10 0x7f1ea81143d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 --2- 172.21.15.66:0/151361810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ea8109460 0x7f1ea8113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 >> 172.21.15.66:0/151361810 conn(0x7f1ea806d230 msgr2=0x7f1ea8073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:10.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 shutdown_connections 2024-09-15T23:05:10.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.308+0000 7f1eaf503640 1 -- 172.21.15.66:0/151361810 wait complete. 2024-09-15T23:05:10.331 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T23:05:10.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.548+0000 7f9cc4496640 1 -- 172.21.15.66:0/289059613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc109e10 msgr2=0x7f9cbc10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.548+0000 7f9cc4496640 1 --2- 172.21.15.66:0/289059613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc109e10 0x7f9cbc10e2b0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8008570 tx=0x7f9cb802a1f0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.555+0000 7f9cc4496640 1 -- 172.21.15.66:0/289059613 shutdown_connections 2024-09-15T23:05:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.555+0000 7f9cc4496640 1 --2- 172.21.15.66:0/289059613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc10ea10 0x7f9cbc1153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.555+0000 7f9cc4496640 1 --2- 172.21.15.66:0/289059613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc109e10 0x7f9cbc10e2b0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.555+0000 7f9cc4496640 1 --2- 172.21.15.66:0/289059613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc109460 0x7f9cbc109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.555+0000 7f9cc4496640 1 -- 172.21.15.66:0/289059613 >> 172.21.15.66:0/289059613 conn(0x7f9cbc06d230 msgr2=0x7f9cbc06d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:10.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.558+0000 7f9cc4496640 1 -- 172.21.15.66:0/289059613 shutdown_connections 2024-09-15T23:05:10.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.559+0000 7f9cc4496640 1 -- 172.21.15.66:0/289059613 wait complete. 2024-09-15T23:05:10.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.560+0000 7f9cc4496640 1 Processor -- start 2024-09-15T23:05:10.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 -- start start 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc10ea10 0x7f9cbc1a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc1abaf0 0x7f9cbc1abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc118470 con 0x7f9cbc10ea10 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1182f0 con 0x7f9cbc1abaf0 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.561+0000 7f9cc4496640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1185f0 con 0x7f9cbc109460 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.563+0000 7f9cc2232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.563+0000 7f9cc2232640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47734/0 (socket says 172.21.15.66:47734) 2024-09-15T23:05:10.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.563+0000 7f9cc2232640 1 -- 172.21.15.66:0/3587447928 learned_addr learned my addr 172.21.15.66:0/3587447928 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:10.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.568+0000 7f9cc2a33640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc1abaf0 0x7f9cbc1abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.568+0000 7f9cc1a31640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc10ea10 0x7f9cbc1a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.569+0000 7f9cc2232640 1 -- 172.21.15.66:0/3587447928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc1abaf0 msgr2=0x7f9cbc1abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.569+0000 7f9cc2232640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc1abaf0 0x7f9cbc1abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.569+0000 7f9cc2232640 1 -- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc10ea10 msgr2=0x7f9cbc1a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.569+0000 7f9cc2232640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc10ea10 0x7f9cbc1a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.569+0000 7f9cc2232640 1 -- 172.21.15.66:0/3587447928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc1ac5e0 con 0x7f9cbc109460 2024-09-15T23:05:10.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.572+0000 7f9cc2232640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00daf0 tx=0x7f9cac00af60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:10.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.576+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac01a070 con 0x7f9cbc109460 2024-09-15T23:05:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.576+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cac00cc70 con 0x7f9cbc109460 2024-09-15T23:05:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.576+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac014710 con 0x7f9cbc109460 2024-09-15T23:05:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.577+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc1ac8d0 con 0x7f9cbc109460 2024-09-15T23:05:10.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.581+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc19ea40 con 0x7f9cbc109460 2024-09-15T23:05:10.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.582+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f9cac01d070 con 0x7f9cbc109460 2024-09-15T23:05:10.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.584+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc109840 con 0x7f9cbc109460 2024-09-15T23:05:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.585+0000 7f9cb37fe640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 0x7f9ca80a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:10.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.586+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7f9cac0cf1f0 con 0x7f9cbc109460 2024-09-15T23:05:10.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.587+0000 7f9cc1a31640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 0x7f9ca80a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:10.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.588+0000 7f9cc1a31640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 0x7f9ca80a5a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0732b0 tx=0x7f9cb8000bc0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:10.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:10 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/601924574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:05:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.598+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cac00ce20 con 0x7f9cbc109460 2024-09-15T23:05:10.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:10 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/601924574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:05:10.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:10 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/601924574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:05:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.952+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9cbc110ae0 con 0x7f9cbc109460 2024-09-15T23:05:10.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.953+0000 7f9cb37fe640 1 -- 172.21.15.66:0/3587447928 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v119) ==== 103+0+11 (secure 0 0 0) 0x7f9cac09bac0 con 0x7f9cbc109460 2024-09-15T23:05:10.956 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 32 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 msgr2=0x7f9ca80a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 0x7f9ca80a5a00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0732b0 tx=0x7f9cb8000bc0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 msgr2=0x7f9cbc1a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00daf0 tx=0x7f9cac00af60 comp rx=0 tx=0).stop 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 shutdown_connections 2024-09-15T23:05:10.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f9ca80a3540 0x7f9ca80a5a00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cbc1abaf0 0x7f9cbc1abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cbc10ea10 0x7f9cbc1a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 --2- 172.21.15.66:0/3587447928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cbc109460 0x7f9cbc1a7230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:10.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 >> 172.21.15.66:0/3587447928 conn(0x7f9cbc06d230 msgr2=0x7f9cbc10c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:10.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.958+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 shutdown_connections 2024-09-15T23:05:10.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:10.962+0000 7f9cc4496640 1 -- 172.21.15.66:0/3587447928 wait complete. 2024-09-15T23:05:10.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T23:05:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.182+0000 7feda3dfd640 1 -- 172.21.15.66:0/3130134959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed94099870 msgr2=0x7fed940a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.182+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3130134959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed94099870 0x7fed940a1410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed9c067950 tx=0x7fed9c0966e0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.186+0000 7feda3dfd640 1 -- 172.21.15.66:0/3130134959 shutdown_connections 2024-09-15T23:05:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.186+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3130134959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed94099870 0x7fed940a1410 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.186+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3130134959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94095510 0x7fed94099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.186+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3130134959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed94094b60 0x7fed94094f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.186+0000 7feda3dfd640 1 -- 172.21.15.66:0/3130134959 >> 172.21.15.66:0/3130134959 conn(0x7fed9400a1d0 msgr2=0x7fed9400a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.187+0000 7feda3dfd640 1 -- 172.21.15.66:0/3130134959 shutdown_connections 2024-09-15T23:05:11.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.188+0000 7feda3dfd640 1 -- 172.21.15.66:0/3130134959 wait complete. 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 Processor -- start 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 -- start start 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed94094b60 0x7fed940aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 0x7fed940a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 0x7fed940a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fed940abf10 con 0x7fed94094b60 2024-09-15T23:05:11.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed940abd90 con 0x7fed94099870 2024-09-15T23:05:11.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.189+0000 7feda3dfd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed940ac090 con 0x7fed940a37f0 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda239a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 0x7fed940a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda239a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 0x7fed940a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.66:47746/0 (socket says 172.21.15.66:47746) 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda239a640 1 -- 172.21.15.66:0/3598109269 learned_addr learned my addr 172.21.15.66:0/3598109269 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 0x7fed940a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 -- 172.21.15.66:0/3598109269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 msgr2=0x7fed940a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 0x7fed940a3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 -- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed94094b60 msgr2=0x7fed940aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed94094b60 0x7fed940aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.190+0000 7feda1398640 1 -- 172.21.15.66:0/3598109269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940a7d50 con 0x7fed94099870 2024-09-15T23:05:11.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.191+0000 7feda1398640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 0x7fed940a32b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fed98005fd0 tx=0x7fed9800be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:11.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.194+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980097c0 con 0x7fed94099870 2024-09-15T23:05:11.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.194+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed940a8040 con 0x7fed94099870 2024-09-15T23:05:11.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.194+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed940a8590 con 0x7fed94099870 2024-09-15T23:05:11.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.195+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed98009e40 con 0x7fed94099870 2024-09-15T23:05:11.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.196+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980153c0 con 0x7fed94099870 2024-09-15T23:05:11.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.196+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed80005290 con 0x7fed94099870 2024-09-15T23:05:11.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.208+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fed98009960 con 0x7fed94099870 2024-09-15T23:05:11.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.209+0000 7fed92ffd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 0x7fed880a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.209+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9763+0+0 (secure 0 0 0) 0x7fed980cff70 con 0x7fed94099870 2024-09-15T23:05:11.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.209+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed980d0430 con 0x7fed94099870 2024-09-15T23:05:11.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.210+0000 7feda1b99640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 0x7fed880a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.217+0000 7feda1b99640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 0x7fed880a5960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00a990 tx=0x7fed8c005c70 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:11.286 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:11 smithi066 ceph-mon[31185]: pgmap v626: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 93 op/s 2024-09-15T23:05:11.286 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:11 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/151361810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.286 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:11 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3587447928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:11 smithi087 ceph-mon[35290]: pgmap v626: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 93 op/s 2024-09-15T23:05:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:11 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/151361810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:11 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3587447928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.662+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fed80005850 con 0x7fed94099870 2024-09-15T23:05:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:11 smithi184 ceph-mon[35203]: pgmap v626: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 93 op/s 2024-09-15T23:05:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:11 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/151361810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:11 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3587447928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:05:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.673+0000 7fed92ffd640 1 -- 172.21.15.66:0/3598109269 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742872 (secure 0 0 0) 0x7fed9809c490 con 0x7fed94099870 2024-09-15T23:05:11.685 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:05:11.685 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:05:11.685 INFO:teuthology.orchestra.run.smithi066.stdout: "epoch": 26, 2024-09-15T23:05:11.685 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "active_gid": 15312, 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "active_name": "x", 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "active_addrs": { 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:6800", 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1388370487 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:6801", 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1388370487 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "active_addr": "172.21.15.66:6801/1388370487", 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi066.stdout: "active_change": "2024-09-15T22:45:21.508129+0000", 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "available": true, 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "standbys": [ 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "gid": 24941, 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "y", 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: "available_modules": [ 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "alerts", 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.693 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.694 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.695 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.696 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_destination": { 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_destination", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.697 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_from_name": { 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_from_name", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "Ceph", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.698 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email From: name", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_host": { 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_host", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.699 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP server", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_password": { 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_password", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.700 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.701 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Password to authenticate with", 2024-09-15T23:05:11.701 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.702 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.702 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.702 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.702 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_port": { 2024-09-15T23:05:11.702 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_port", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "465", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.704 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP port", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_sender": { 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_sender", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.705 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_ssl": { 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_ssl", 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.706 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_user": { 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_user", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.707 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "User to authenticate as", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "balancer", 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.708 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "active": { 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "active", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.709 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_time": { 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_time", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0000", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:05:11.710 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_weekday": { 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_weekday", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:05:11.711 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_max_iterations": { 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.712 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "25", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "250", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_metrics": { 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_metrics", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.713 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_step": { 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_step", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.714 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.5", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0.001", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "0.999", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "end_time": { 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_time", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2359", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "end_weekday": { 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_weekday", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.717 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.718 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.719 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.720 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "min_score": { 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_score", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "upmap", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "crush-compat", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "none", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "read", 2024-09-15T23:05:11.724 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap-read" 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Balancer mode", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_ids": { 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_ids", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.725 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:11.726 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_deviation": { 2024-09-15T23:05:11.727 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_deviation", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:05:11.728 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_optimizations": { 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.729 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.730 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_down_multiplier": { 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_down_multiplier", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.731 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_refresh_rate": { 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_refresh_rate", 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.732 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "20", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_starting_port": { 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_starting_port", 2024-09-15T23:05:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4721", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.734 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_ptrace": { 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_ptrace", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.735 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_interval": { 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_interval", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.736 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.7", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.737 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm_log_destination": { 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm_log_destination", 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.738 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "file", 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "file,syslog", 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "syslog" 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.739 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "cgroups_split": { 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cgroups_split", 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.740 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "config_checks_enabled": { 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_checks_enabled", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.741 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "config_dashboard": { 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_dashboard", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.742 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_alertmanager": { 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_alertmanager", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.743 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_base": { 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_base", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.744 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_elasticsearch": { 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.745 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "elasticsearch container image", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_grafana": { 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_grafana", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.746 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_haproxy": { 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_haproxy", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.747 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "HAproxy container image", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_agent": { 2024-09-15T23:05:11.748 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_collector": { 2024-09-15T23:05:11.749 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_query": { 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger query container image", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_keepalived": { 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_keepalived", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Keepalived container image", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.752 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_loki": { 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_loki", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Loki container image", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.753 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_node_exporter": { 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_node_exporter", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_nvmeof": { 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_nvmeof", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.755 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Nvme-of container image", 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_prometheus": { 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_prometheus", 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.756 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_promtail": { 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_promtail", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.757 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Promtail container image", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_samba": { 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_samba", 2024-09-15T23:05:11.758 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_snmp_gateway": { 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:05:11.759 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "container_init": { 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_init", 2024-09-15T23:05:11.760 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.761 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "daemon_cache_timeout": { 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:05:11.762 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "900", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.763 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "default_registry": { 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_registry", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io", 2024-09-15T23:05:11.764 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "device_cache_timeout": { 2024-09-15T23:05:11.765 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_cache_timeout", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1800", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.766 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "device_enhanced_scan": { 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_enhanced_scan", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.767 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "facts_cache_timeout": { 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "facts_cache_timeout", 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.768 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "grafana_dashboards_path": { 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:05:11.769 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.770 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "host_check_interval": { 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "host_check_interval", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "hw_monitoring": { 2024-09-15T23:05:11.772 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hw_monitoring", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.773 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "inventory_list_all": { 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "inventory_list_all", 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.774 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.775 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.776 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "log_refresh_metadata": { 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_refresh_metadata", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:05:11.777 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.778 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.779 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.780 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:05:11.781 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:05:11.782 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "*", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "max_count_per_host": { 2024-09-15T23:05:11.783 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_count_per_host", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "max_osd_draining_count": { 2024-09-15T23:05:11.784 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_osd_draining_count", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.785 INFO:teuthology.orchestra.run.smithi066.stdout: "migration_current": { 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "migration_current", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "internal - do not modify", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.786 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "root", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm-package", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "root" 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:05:11.787 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "oob_default_addr": { 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "oob_default_addr", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "169.254.1.1", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:05:11.788 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "prometheus_alerts_path": { 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:05:11.789 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_insecure": { 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_insecure", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.790 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_password": { 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_password", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.791 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_url": { 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_url", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.792 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_username": { 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_username", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.793 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "secure_monitoring_stack": { 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.794 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "service_discovery_port": { 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "service_discovery_port", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.795 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8765", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "ssh_config_file": { 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssh_config_file", 2024-09-15T23:05:11.796 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "use_agent": { 2024-09-15T23:05:11.797 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_agent", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.798 INFO:teuthology.orchestra.run.smithi066.stdout: "use_repo_digest": { 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_repo_digest", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:05:11.799 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_failed_host_check": { 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.800 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_daemons": { 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.801 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_hosts": { 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.802 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.803 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crash", 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.804 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.805 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.806 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.807 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.808 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.809 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "retain_interval": { 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retain_interval", 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.810 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "31536000", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.811 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_recent_interval": { 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_recent_interval", 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1209600", 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dashboard", 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.813 INFO:teuthology.orchestra.run.smithi066.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.816 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.817 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.818 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.819 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.820 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.821 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.822 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.823 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.824 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.825 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.826 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.827 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:11.828 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.829 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_URL": { 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.830 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.831 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.832 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:05:11.833 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.834 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.835 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.836 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.837 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:05:11.838 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.840 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.841 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.842 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.844 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.845 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:05:11.846 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:05:11.847 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.848 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.849 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.850 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.851 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.852 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "45", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.853 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.854 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:11.855 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.856 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.857 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:11.858 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.859 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:11.860 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "cross_origin_url": { 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cross_origin_url", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.861 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "crt_file": { 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crt_file", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.862 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "debug": { 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "debug", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.863 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "jwt_token_ttl": { 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "jwt_token_ttl", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.864 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "28800", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.865 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.866 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.867 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.869 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.870 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.871 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.872 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "motd": { 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "motd", 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.873 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "The message of the day", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:05:11.874 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:11.876 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:11.877 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8080", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.878 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.879 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl_server_port": { 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl_server_port", 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.880 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8443", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:11.881 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "redirect", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect" 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.882 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:11.883 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "url_prefix": { 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url_prefix", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.884 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "devicehealth", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_monitoring": { 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_monitoring", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.886 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "monitor device health metrics", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.887 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.888 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.889 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.890 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.891 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "mark_out_threshold": { 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mark_out_threshold", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.892 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2419200", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": { 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_name", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.893 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "device_health_metrics", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "retention_period": { 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retention_period", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.894 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15552000", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_frequency": { 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_frequency", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.895 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "self_heal": { 2024-09-15T23:05:11.896 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "self_heal", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.898 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_threshold": { 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_threshold", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7257600", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "diskprediction_local", 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.900 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.901 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.902 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.903 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.904 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "predict_interval": { 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predict_interval", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.905 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.906 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.908 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "predictor_model": { 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predictor_model", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "prophetstor", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.909 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.910 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "influx", 2024-09-15T23:05:11.911 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": false, 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "batch_size": { 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "batch_size", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5000", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.912 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "database": { 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "database", 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.913 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "ceph", 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": { 2024-09-15T23:05:11.914 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hostname", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.915 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "30", 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "5", 2024-09-15T23:05:11.916 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.917 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.918 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.919 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.920 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.921 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.922 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "password": { 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "password", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.923 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "port": { 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "port", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.924 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8086", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server port", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.925 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "false", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "threads": { 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threads", 2024-09-15T23:05:11.926 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "32", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "username": { 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "username", 2024-09-15T23:05:11.927 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.928 INFO:teuthology.orchestra.run.smithi066.stdout: "verify_ssl": { 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "verify_ssl", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "true", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.929 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "insights", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.930 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.931 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.933 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.934 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "iostat", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.935 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.936 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.937 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.938 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.940 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "k8sevents", 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.941 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_event_retention_days": { 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.942 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "config_check_secs": { 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_check_secs", 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:11.943 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "10", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.944 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.945 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.946 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.947 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.948 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.949 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.950 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "localpool", 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "failure_domain": { 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "failure_domain", 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.951 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "host", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.952 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.953 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.954 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.955 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.956 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": { 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_size", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.957 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "num_rep": { 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "num_rep", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.958 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3", 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:05:11.959 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": { 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_num", 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.960 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "128", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "prefix": { 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prefix", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.961 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "subtree": { 2024-09-15T23:05:11.962 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "subtree", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "rack", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mds_autoscaler", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.964 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.965 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.966 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.967 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.968 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirroring", 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.969 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.970 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.971 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.972 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.973 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.974 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "nfs", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.976 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.977 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.978 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.979 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.980 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.981 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.982 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "fail_fs": { 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "fail_fs", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.983 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.984 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.985 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.986 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.987 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.988 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.989 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.990 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator": { 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm", 2024-09-15T23:05:11.991 INFO:teuthology.orchestra.run.smithi066.stdout: "rook", 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "test_orchestrator" 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Orchestrator backend", 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_perf_query", 2024-09-15T23:05:11.992 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.993 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.994 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.995 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:11.996 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:11.997 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_support", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:11.998 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:11.999 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.000 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.001 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.002 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.003 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_autoscaler", 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.004 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.005 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.006 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.007 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.008 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.009 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.010 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "threshold": { 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threshold", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1.0", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "scaling threshold", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:05:12.011 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "progress", 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.012 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_pg_recovery_event": { 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.013 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.014 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.015 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.016 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.017 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.019 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.020 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "max_completed_events": { 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_completed_events", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.021 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "50", 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.022 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.023 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus", 2024-09-15T23:05:12.024 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "cache": { 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cache", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.025 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "exclude_perf_counters": { 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "exclude_perf_counters", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:05:12.026 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.027 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.028 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.030 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.031 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools": { 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.032 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.033 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "300", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_interval": { 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_interval", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.034 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15.0", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.035 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.036 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "9283", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "stale_cache_strategy": { 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stale_cache_strategy", 2024-09-15T23:05:12.037 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "log", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:12.038 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "default", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "default", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "error" 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.039 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.040 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_support", 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.041 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.042 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.043 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.044 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.045 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.046 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_snap_create": { 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.047 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.048 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "trash_purge_schedule": { 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "trash_purge_schedule", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.049 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "restful", 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.050 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_auth": { 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_auth", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.051 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.052 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.053 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.054 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.055 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.056 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.057 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.058 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.059 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.060 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.061 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.062 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rgw", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.063 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.064 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.065 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.066 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.067 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.068 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.069 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rook", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.070 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.072 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.073 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.074 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "storage_class": { 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "storage_class", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "local", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.075 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "selftest", 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.076 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.077 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.078 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.079 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.080 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.081 INFO:teuthology.orchestra.run.smithi066.stdout: "roption1": { 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption1", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "roption2": { 2024-09-15T23:05:12.082 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption2", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "xyz", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.083 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption1": { 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption1", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.084 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption2": { 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption2", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption3": { 2024-09-15T23:05:12.086 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption3", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption4": { 2024-09-15T23:05:12.087 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption4", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.088 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption5": { 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption5", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.089 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption6": { 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption6", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.090 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption7": { 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption7", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.091 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "42", 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "testkey": { 2024-09-15T23:05:12.092 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testkey", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.093 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "testlkey": { 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testlkey", 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.094 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "testnewline": { 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testnewline", 2024-09-15T23:05:12.095 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.096 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snap_schedule", 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_m_granularity": { 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_m_granularity", 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.097 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "dump_on_update": { 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dump_on_update", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.098 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.099 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.100 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.101 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.102 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.104 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stats", 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.105 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.106 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.107 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.108 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.109 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.110 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "status", 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.111 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.112 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.113 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.114 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.115 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.115 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.116 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.117 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telegraf", 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "address": { 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "address", 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.118 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.119 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.121 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.122 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.123 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.124 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.125 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.126 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telemetry", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_basic": { 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_basic", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.127 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_crash": { 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_crash", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.128 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_device": { 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_device", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.129 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_ident": { 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_ident", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.130 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_perf": { 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_perf", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "contact": { 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "contact", 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "description": { 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "description", 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "device_url": { 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_url", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:05:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "24", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "8", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "last_opt_revision": { 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "last_opt_revision", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard": { 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard_description": { 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard_description", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "organization": { 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "organization", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "proxy": { 2024-09-15T23:05:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "proxy", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "url": { 2024-09-15T23:05:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "test_orchestrator", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "volumes", 2024-09-15T23:05:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_clones": { 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_clones", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "periodic_async_work": { 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "periodic_async_work", 2024-09-15T23:05:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Periodically check for async work", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_delay": { 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:05:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix", 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "discovery_interval": { 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "discovery_interval", 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "100", 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "identifier": { 2024-09-15T23:05:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "identifier", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_host": { 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_host", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_port": { 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_port", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10051", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_sender": { 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_sender", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "gid": 24958, 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "z", 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "available_modules": [ 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "alerts", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:05:12.182 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.183 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.184 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.185 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.186 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.187 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_destination": { 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_destination", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.188 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_from_name": { 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_from_name", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "Ceph", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email From: name", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_host": { 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_host", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.190 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP server", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_password": { 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_password", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.191 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Password to authenticate with", 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.192 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_port": { 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_port", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "465", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP port", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.193 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_sender": { 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_sender", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.194 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_ssl": { 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_ssl", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.195 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_user": { 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_user", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.196 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "User to authenticate as", 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "balancer", 2024-09-15T23:05:12.197 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "active": { 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "active", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.198 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_time": { 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_time", 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.199 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0000", 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_weekday": { 2024-09-15T23:05:12.200 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_weekday", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_max_iterations": { 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "25", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "250", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.202 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_metrics": { 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_metrics", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:05:12.203 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_step": { 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_step", 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.5", 2024-09-15T23:05:12.204 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0.001", 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "0.999", 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "end_time": { 2024-09-15T23:05:12.205 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_time", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2359", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:05:12.206 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "end_weekday": { 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_weekday", 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.207 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.208 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.209 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.210 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.211 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.212 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "min_score": { 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_score", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:05:12.214 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "upmap", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "crush-compat", 2024-09-15T23:05:12.215 INFO:teuthology.orchestra.run.smithi066.stdout: "none", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "read", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap-read" 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Balancer mode", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_ids": { 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_ids", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.217 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_deviation": { 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_deviation", 2024-09-15T23:05:12.218 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_optimizations": { 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:05:12.219 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.220 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_down_multiplier": { 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_down_multiplier", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.221 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_refresh_rate": { 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_refresh_rate", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "20", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.222 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_starting_port": { 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_starting_port", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4721", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.223 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_ptrace": { 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_ptrace", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.224 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_interval": { 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_interval", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.225 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.7", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.226 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm_log_destination": { 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm_log_destination", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.227 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "file", 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "file,syslog", 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "syslog" 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "cgroups_split": { 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cgroups_split", 2024-09-15T23:05:12.228 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.229 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "config_checks_enabled": { 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_checks_enabled", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.230 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "config_dashboard": { 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_dashboard", 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.231 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_alertmanager": { 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_alertmanager", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:05:12.232 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_base": { 2024-09-15T23:05:12.233 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_base", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.234 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_elasticsearch": { 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.235 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "elasticsearch container image", 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_grafana": { 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_grafana", 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.236 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_haproxy": { 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_haproxy", 2024-09-15T23:05:12.237 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "HAproxy container image", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.238 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_agent": { 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.239 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_collector": { 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.240 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_query": { 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:05:12.241 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger query container image", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_keepalived": { 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_keepalived", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Keepalived container image", 2024-09-15T23:05:12.243 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_loki": { 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_loki", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.244 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Loki container image", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_node_exporter": { 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_node_exporter", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.245 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_nvmeof": { 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_nvmeof", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Nvme-of container image", 2024-09-15T23:05:12.246 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_prometheus": { 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_prometheus", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.247 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_promtail": { 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_promtail", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Promtail container image", 2024-09-15T23:05:12.248 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_samba": { 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_samba", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:05:12.249 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_snmp_gateway": { 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.250 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "container_init": { 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_init", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:05:12.251 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "daemon_cache_timeout": { 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.252 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "900", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.253 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "default_registry": { 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_registry", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.254 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "device_cache_timeout": { 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_cache_timeout", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1800", 2024-09-15T23:05:12.255 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "device_enhanced_scan": { 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_enhanced_scan", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.256 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "facts_cache_timeout": { 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "facts_cache_timeout", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.257 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "grafana_dashboards_path": { 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.258 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "host_check_interval": { 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "host_check_interval", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.259 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "hw_monitoring": { 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hw_monitoring", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.260 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "inventory_list_all": { 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "inventory_list_all", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.261 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.262 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.263 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "log_refresh_metadata": { 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_refresh_metadata", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.264 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.265 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.266 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.267 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.268 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.269 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.270 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.271 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "*", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "max_count_per_host": { 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_count_per_host", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.272 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "max_osd_draining_count": { 2024-09-15T23:05:12.273 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_osd_draining_count", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "migration_current": { 2024-09-15T23:05:12.274 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "migration_current", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "internal - do not modify", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:12.275 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "root", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm-package", 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "root" 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.276 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "oob_default_addr": { 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "oob_default_addr", 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.277 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "169.254.1.1", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.278 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "prometheus_alerts_path": { 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.279 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_insecure": { 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_insecure", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.280 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_password": { 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_password", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.281 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_url": { 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_url", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.282 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_username": { 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_username", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.283 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "secure_monitoring_stack": { 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.284 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "service_discovery_port": { 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "service_discovery_port", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8765", 2024-09-15T23:05:12.285 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "ssh_config_file": { 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssh_config_file", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.286 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "use_agent": { 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_agent", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.287 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "use_repo_digest": { 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_repo_digest", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.288 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_failed_host_check": { 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.289 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_daemons": { 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.290 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_hosts": { 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.291 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crash", 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.293 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.294 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.295 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.296 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.297 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "retain_interval": { 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retain_interval", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "31536000", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.298 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_recent_interval": { 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_recent_interval", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1209600", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.299 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dashboard", 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:05:12.300 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.301 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.302 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.305 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.306 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.307 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.308 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.309 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.310 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.311 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.312 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.313 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.314 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.315 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.316 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.317 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.318 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_URL": { 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.319 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.320 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.321 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:05:12.322 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:05:12.323 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:05:12.324 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:05:12.325 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.326 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.327 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.328 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.329 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.330 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.331 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.334 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.335 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.336 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.337 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.338 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8", 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.339 INFO:teuthology.orchestra.run.smithi066.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "45", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.340 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.342 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:05:12.343 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.345 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.346 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.347 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.348 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.349 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "cross_origin_url": { 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cross_origin_url", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.350 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "crt_file": { 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crt_file", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.351 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "debug": { 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "debug", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:05:12.352 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "jwt_token_ttl": { 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "jwt_token_ttl", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "28800", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.353 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.354 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.355 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.356 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.357 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.358 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.359 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "motd": { 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "motd", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.360 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "The message of the day", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.361 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.362 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.363 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8080", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.364 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl_server_port": { 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl_server_port", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.365 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8443", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.366 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "redirect", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect" 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.367 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.368 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "url_prefix": { 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url_prefix", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.369 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "devicehealth", 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_monitoring": { 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_monitoring", 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.370 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "monitor device health metrics", 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.371 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.372 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.373 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.374 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.375 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.376 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "mark_out_threshold": { 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mark_out_threshold", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2419200", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:05:12.378 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": { 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_name", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "device_health_metrics", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.379 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "retention_period": { 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retention_period", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.380 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15552000", 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.381 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_frequency": { 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_frequency", 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:12.382 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.383 INFO:teuthology.orchestra.run.smithi066.stdout: "self_heal": { 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "self_heal", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.384 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.385 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_threshold": { 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_threshold", 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.386 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7257600", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "diskprediction_local", 2024-09-15T23:05:12.387 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.388 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.389 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.390 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.391 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "predict_interval": { 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predict_interval", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "predictor_model": { 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predictor_model", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "prophetstor", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "influx", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": false, 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:05:12.396 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "batch_size": { 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "batch_size", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5000", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:05:12.397 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "database": { 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "database", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "ceph", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:05:12.398 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": { 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hostname", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:05:12.399 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "30", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "5", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:05:12.400 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.401 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.402 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.403 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.404 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.405 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "password": { 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "password", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.406 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "port": { 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "port", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.407 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8086", 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server port", 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.408 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "false", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.409 INFO:teuthology.orchestra.run.smithi066.stdout: "threads": { 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threads", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "32", 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.410 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "username": { 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "username", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.411 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "verify_ssl": { 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "verify_ssl", 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.412 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "true", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.413 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "insights", 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.414 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.416 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.417 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.418 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.419 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.420 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.421 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "iostat", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.422 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.423 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.424 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.425 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.426 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.427 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "k8sevents", 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_event_retention_days": { 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.428 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "config_check_secs": { 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_check_secs", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.429 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "10", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.430 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.431 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.432 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.433 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.434 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.435 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "localpool", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "failure_domain": { 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "failure_domain", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "host", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.436 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.437 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.438 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.439 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.440 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.441 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": { 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_size", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.442 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "num_rep": { 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "num_rep", 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.443 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3", 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": { 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_num", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "128", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.445 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "prefix": { 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prefix", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.446 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "subtree": { 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "subtree", 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.447 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "rack", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mds_autoscaler", 2024-09-15T23:05:12.448 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.449 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.450 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.451 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.452 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.454 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirroring", 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "nfs", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.462 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.463 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.464 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.465 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:12.467 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "fail_fs": { 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "fail_fs", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.468 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator": { 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "rook", 2024-09-15T23:05:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: "test_orchestrator" 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Orchestrator backend", 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_perf_query", 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_support", 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_autoscaler", 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.494 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "threshold": { 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threshold", 2024-09-15T23:05:12.495 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1.0", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "scaling threshold", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.496 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "progress", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_pg_recovery_event": { 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.497 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.498 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.499 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.500 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.501 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.502 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.503 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "max_completed_events": { 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_completed_events", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.504 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "50", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.505 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus", 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.506 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "cache": { 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cache", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.507 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "exclude_perf_counters": { 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "exclude_perf_counters", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:05:12.508 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.509 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.510 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.511 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.512 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.513 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools": { 2024-09-15T23:05:12.514 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.515 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "300", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.516 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_interval": { 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_interval", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15.0", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.517 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.518 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "9283", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.519 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "stale_cache_strategy": { 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stale_cache_strategy", 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.520 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "log", 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:12.521 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "default", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "default", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "error" 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.522 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.524 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_support", 2024-09-15T23:05:12.525 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.526 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.527 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.528 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.529 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.530 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.532 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_snap_create": { 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.533 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.534 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "trash_purge_schedule": { 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "trash_purge_schedule", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.535 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "restful", 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_auth": { 2024-09-15T23:05:12.536 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_auth", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.537 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.538 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.539 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.540 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.543 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.544 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.545 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rgw", 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.546 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.547 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.548 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.549 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.550 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:05:12.551 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.552 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rook", 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.553 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.554 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.555 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.556 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.557 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.558 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.559 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "storage_class": { 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "storage_class", 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "local", 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.560 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "selftest", 2024-09-15T23:05:12.561 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.562 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.563 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.564 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.565 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.566 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.567 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "roption1": { 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption1", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.568 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "roption2": { 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption2", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.569 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "xyz", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption1": { 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption1", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.570 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption2": { 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption2", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.571 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption3": { 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption3", 2024-09-15T23:05:12.572 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption4": { 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption4", 2024-09-15T23:05:12.573 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption5": { 2024-09-15T23:05:12.574 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption5", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.575 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption6": { 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption6", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.576 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption7": { 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption7", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "42", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.577 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "testkey": { 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testkey", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.578 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "testlkey": { 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testlkey", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.579 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "testnewline": { 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testnewline", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snap_schedule", 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_m_granularity": { 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_m_granularity", 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.581 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "dump_on_update": { 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dump_on_update", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.582 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.583 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.584 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.585 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.586 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.587 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.588 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.589 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stats", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.590 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.591 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.592 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.593 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.594 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.595 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "status", 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.596 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.597 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.598 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.599 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.600 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.601 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.602 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telegraf", 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "address": { 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "address", 2024-09-15T23:05:12.603 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.604 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.605 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.606 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.607 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.608 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.609 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.610 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telemetry", 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_basic": { 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_basic", 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.611 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_crash": { 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_crash", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.612 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_device": { 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_device", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.613 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_ident": { 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_ident", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.614 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_perf": { 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_perf", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.615 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "contact": { 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "contact", 2024-09-15T23:05:12.616 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "description": { 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "description", 2024-09-15T23:05:12.617 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "device_url": { 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_url", 2024-09-15T23:05:12.618 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:12.619 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.620 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "24", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "8", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.621 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "last_opt_revision": { 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "last_opt_revision", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.622 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard": { 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.623 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard_description": { 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard_description", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.624 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.626 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.627 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.628 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.629 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.630 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "organization": { 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "organization", 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.631 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.632 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "proxy": { 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "proxy", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.633 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "url": { 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url", 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.634 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.635 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "test_orchestrator", 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.636 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.637 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.638 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.639 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.640 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.641 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "volumes", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.642 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.643 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.644 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.645 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.646 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_clones": { 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_clones", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.647 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "periodic_async_work": { 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "periodic_async_work", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.648 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Periodically check for async work", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_delay": { 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.650 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix", 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.651 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "discovery_interval": { 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "discovery_interval", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "100", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.652 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "identifier": { 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "identifier", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.653 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.654 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.655 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.656 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.657 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.658 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.659 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_host": { 2024-09-15T23:05:12.660 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_host", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.661 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_port": { 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_port", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10051", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.662 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_sender": { 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_sender", 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.663 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.664 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "modules": [ 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm", 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "dashboard", 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "iostat", 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "nfs", 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "restful", 2024-09-15T23:05:12.665 INFO:teuthology.orchestra.run.smithi066.stdout: "snap_schedule" 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "available_modules": [ 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "alerts", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.666 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.667 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.668 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.670 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.671 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.672 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_destination": { 2024-09-15T23:05:12.673 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_destination", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_from_name": { 2024-09-15T23:05:12.674 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_from_name", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "Ceph", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Email From: name", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.675 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_host": { 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_host", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP server", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_password": { 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_password", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Password to authenticate with", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_port": { 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_port", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "465", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.678 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP port", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_sender": { 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_sender", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.679 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_ssl": { 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_ssl", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.680 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "smtp_user": { 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "smtp_user", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.681 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "User to authenticate as", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.682 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "balancer", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "active": { 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "active", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_time": { 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_time", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0000", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.684 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "begin_weekday": { 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "begin_weekday", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:12.685 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_max_iterations": { 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "25", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.686 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "250", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_metrics": { 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_metrics", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:05:12.687 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "crush_compat_step": { 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crush_compat_step", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.688 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.5", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0.001", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "0.999", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "end_time": { 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_time", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.689 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2359", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "end_weekday": { 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "end_weekday", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.690 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "0", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "6", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.691 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.692 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.693 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.694 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.695 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.696 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "min_score": { 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_score", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.697 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.698 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "upmap", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "crush-compat", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "none", 2024-09-15T23:05:12.699 INFO:teuthology.orchestra.run.smithi066.stdout: "read", 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap", 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap-read" 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Balancer mode", 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_ids": { 2024-09-15T23:05:12.700 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_ids", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.701 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:05:12.702 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_deviation": { 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_deviation", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.703 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "upmap_max_optimizations": { 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.704 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.705 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_down_multiplier": { 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_down_multiplier", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.706 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_refresh_rate": { 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_refresh_rate", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "20", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.707 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "agent_starting_port": { 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "agent_starting_port", 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4721", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.709 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_ptrace": { 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_ptrace", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:05:12.710 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_interval": { 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_interval", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0.7", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:05:12.712 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm_log_destination": { 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cephadm_log_destination", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "file", 2024-09-15T23:05:12.713 INFO:teuthology.orchestra.run.smithi066.stdout: "file,syslog", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "syslog" 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "cgroups_split": { 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cgroups_split", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.714 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "config_checks_enabled": { 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_checks_enabled", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.715 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "config_dashboard": { 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_dashboard", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.716 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_alertmanager": { 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_alertmanager", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.717 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_base": { 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_base", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.718 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_elasticsearch": { 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.719 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "elasticsearch container image", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.720 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_grafana": { 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_grafana", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.721 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_haproxy": { 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_haproxy", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "HAproxy container image", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.722 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_agent": { 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_collector": { 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.724 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.725 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.725 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.725 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_jaeger_query": { 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.728 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Jaeger query container image", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_keepalived": { 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_keepalived", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.729 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Keepalived container image", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_loki": { 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_loki", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:05:12.730 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Loki container image", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_node_exporter": { 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_node_exporter", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.731 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_nvmeof": { 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_nvmeof", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.732 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Nvme-of container image", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.733 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_prometheus": { 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_prometheus", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Prometheus container image", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.734 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_promtail": { 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_promtail", 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:05:12.735 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Promtail container image", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_samba": { 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_samba", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.736 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.737 INFO:teuthology.orchestra.run.smithi066.stdout: "container_image_snmp_gateway": { 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "container_init": { 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "container_init", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "daemon_cache_timeout": { 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "900", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "default_registry": { 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "default_registry", 2024-09-15T23:05:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "docker.io", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: "device_cache_timeout": { 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_cache_timeout", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1800", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.744 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "device_enhanced_scan": { 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_enhanced_scan", 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.745 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.746 INFO:teuthology.orchestra.run.smithi066.stdout: "facts_cache_timeout": { 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "facts_cache_timeout", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.747 INFO:teuthology.orchestra.run.smithi066.stdout: "grafana_dashboards_path": { 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.748 INFO:teuthology.orchestra.run.smithi066.stdout: "host_check_interval": { 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "host_check_interval", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.749 INFO:teuthology.orchestra.run.smithi066.stdout: "hw_monitoring": { 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hw_monitoring", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "inventory_list_all": { 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "inventory_list_all", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.752 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "log_refresh_metadata": { 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_refresh_metadata", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.753 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.754 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.755 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.757 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.758 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "*", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.759 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "max_count_per_host": { 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_count_per_host", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.760 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "max_osd_draining_count": { 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_osd_draining_count", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.761 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "migration_current": { 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "migration_current", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.762 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "internal - do not modify", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "mode": { 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mode", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "root", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.763 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm-package", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "root" 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "oob_default_addr": { 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "oob_default_addr", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.764 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "169.254.1.1", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "prometheus_alerts_path": { 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.765 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_insecure": { 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_insecure", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.766 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.767 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_password": { 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_password", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.768 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_url": { 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_url", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.769 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "registry_username": { 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "registry_username", 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.770 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "secure_monitoring_stack": { 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.771 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.772 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "service_discovery_port": { 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "service_discovery_port", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8765", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.773 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "ssh_config_file": { 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssh_config_file", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.774 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "use_agent": { 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_agent", 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.775 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "use_repo_digest": { 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "use_repo_digest", 2024-09-15T23:05:12.776 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.777 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_failed_host_check": { 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.778 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_daemons": { 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.779 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.780 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_on_stray_hosts": { 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.781 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crash", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.782 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.783 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.784 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.785 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.786 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "retain_interval": { 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retain_interval", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.787 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "31536000", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_recent_interval": { 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_recent_interval", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.788 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1209600", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.789 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dashboard", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.790 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.791 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.792 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.793 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.794 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.795 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.796 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.797 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.798 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.799 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.800 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:05:12.801 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.802 INFO:teuthology.orchestra.run.smithi066.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.803 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.804 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.805 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:05:12.806 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_URL": { 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.808 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.809 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.810 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.811 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.812 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.813 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.814 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.815 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.816 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.817 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.818 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.819 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.820 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.821 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.822 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.823 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.824 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.825 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.827 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.828 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "45", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.829 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.830 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "admin", 2024-09-15T23:05:12.831 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.832 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.833 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.834 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.835 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.836 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "cross_origin_url": { 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cross_origin_url", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.837 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "crt_file": { 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "crt_file", 2024-09-15T23:05:12.838 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.839 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "debug": { 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "debug", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.840 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "jwt_token_ttl": { 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "jwt_token_ttl", 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "28800", 2024-09-15T23:05:12.841 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.842 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.843 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.844 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.845 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.846 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.847 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.848 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.849 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "motd": { 2024-09-15T23:05:12.850 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "motd", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "The message of the day", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.851 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.852 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.853 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8080", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.854 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.855 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl_server_port": { 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl_server_port", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.856 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8443", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.857 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "redirect", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "redirect" 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.858 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.859 INFO:teuthology.orchestra.run.smithi066.stdout: "url_prefix": { 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url_prefix", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.860 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "devicehealth", 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_monitoring": { 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_monitoring", 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.861 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "monitor device health metrics", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.862 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.863 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.864 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.865 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.866 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.867 INFO:teuthology.orchestra.run.smithi066.stdout: "mark_out_threshold": { 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mark_out_threshold", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "2419200", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.868 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "pool_name": { 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pool_name", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "device_health_metrics", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.869 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "retention_period": { 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "retention_period", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15552000", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.870 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_frequency": { 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_frequency", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.871 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "self_heal": { 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "self_heal", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.872 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.873 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "warn_threshold": { 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "warn_threshold", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.874 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7257600", 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.875 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "diskprediction_local", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.876 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.877 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.878 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.879 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.880 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.881 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.882 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "predict_interval": { 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predict_interval", 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "86400", 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.883 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "predictor_model": { 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "predictor_model", 2024-09-15T23:05:12.884 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "prophetstor", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.885 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "600", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.886 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "influx", 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": false, 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "batch_size": { 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "batch_size", 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.887 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5000", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "database": { 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "database", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.888 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "ceph", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": { 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "hostname", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.889 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.890 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "30", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "5", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.891 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.892 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.893 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.894 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.895 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "password": { 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "password", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.896 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "port": { 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "port", 2024-09-15T23:05:12.897 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "8086", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "InfluxDB server port", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.898 INFO:teuthology.orchestra.run.smithi066.stdout: "ssl": { 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ssl", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "false", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "threads": { 2024-09-15T23:05:12.899 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threads", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "32", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.900 INFO:teuthology.orchestra.run.smithi066.stdout: "username": { 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "username", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.901 INFO:teuthology.orchestra.run.smithi066.stdout: "verify_ssl": { 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "verify_ssl", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "true", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.902 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "insights", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.903 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.904 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.905 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.906 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.907 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "iostat", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.908 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.909 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.910 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.911 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.912 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.913 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.914 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "k8sevents", 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_event_retention_days": { 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.915 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "7", 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.916 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "config_check_secs": { 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "config_check_secs", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "10", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:05:12.917 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.918 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.919 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.920 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.921 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.922 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.923 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.924 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "localpool", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "failure_domain": { 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "failure_domain", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "host", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:05:12.925 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.926 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.927 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.928 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.929 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.930 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "min_size": { 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "min_size", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.931 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "num_rep": { 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "num_rep", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.932 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_num": { 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_num", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "128", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.933 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "prefix": { 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prefix", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.934 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "subtree": { 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "subtree", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "rack", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.935 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mds_autoscaler", 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.936 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.937 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.938 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.939 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.940 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.941 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirroring", 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.942 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.943 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.944 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.945 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.946 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.947 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "nfs", 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.948 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.949 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.950 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.951 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.952 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.953 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.954 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.955 INFO:teuthology.orchestra.run.smithi066.stdout: "fail_fs": { 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "fail_fs", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.956 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.957 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.958 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.959 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.960 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.961 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator": { 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "orchestrator", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.962 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "cephadm", 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "rook", 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "test_orchestrator" 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Orchestrator backend", 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.963 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_perf_query", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.964 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.965 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.966 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.967 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.968 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "osd_support", 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.969 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.970 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.971 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.972 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.973 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.974 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "pg_autoscaler", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.975 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.976 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.977 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.978 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.979 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.980 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.981 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "threshold": { 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "threshold", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "3.0", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1.0", 2024-09-15T23:05:12.982 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "scaling threshold", 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "progress", 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.983 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_pg_recovery_event": { 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.984 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.985 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.986 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.987 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.988 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.989 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.990 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.991 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.992 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "max_completed_events": { 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_completed_events", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "50", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.993 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "sleep_interval": { 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "sleep_interval", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.994 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "prometheus", 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:12.995 INFO:teuthology.orchestra.run.smithi066.stdout: "cache": { 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "cache", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.996 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "exclude_perf_counters": { 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "exclude_perf_counters", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.997 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:12.998 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:12.999 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.000 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.001 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.002 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools": { 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.003 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "300", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.004 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "scrape_interval": { 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "scrape_interval", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15.0", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "::", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.006 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "9283", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.007 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "stale_cache_strategy": { 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stale_cache_strategy", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "log", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_behaviour": { 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_behaviour", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "default", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "default", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "error" 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "standby_error_status_code": { 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "standby_error_status_code", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.010 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "500", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "400", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "599", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_support", 2024-09-15T23:05:13.011 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.012 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.013 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.014 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.015 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.016 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_snap_create": { 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.018 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.019 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "trash_purge_schedule": { 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "trash_purge_schedule", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.020 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.021 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "restful", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "enable_auth": { 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enable_auth", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.022 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "key_file": { 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "key_file", 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.023 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.024 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.025 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.026 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.027 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.028 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.029 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.030 INFO:teuthology.orchestra.run.smithi066.stdout: "server_addr": { 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_addr", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.031 INFO:teuthology.orchestra.run.smithi066.stdout: "server_port": { 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "server_port", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.032 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rgw", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.033 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.034 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.038 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "5", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rook", 2024-09-15T23:05:13.039 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.040 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.041 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.042 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.043 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.044 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "storage_class": { 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "storage_class", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "local", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.045 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "selftest", 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.046 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.047 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.048 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.049 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.050 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.051 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "roption1": { 2024-09-15T23:05:13.052 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption1", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.053 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "roption2": { 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "roption2", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "xyz", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.054 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption1": { 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption1", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.055 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption2": { 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption2", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.056 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption3": { 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption3", 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "float", 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.057 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption4": { 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption4", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.058 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption5": { 2024-09-15T23:05:13.059 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption5", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.060 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption6": { 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption6", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.061 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "rwoption7": { 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rwoption7", 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.062 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "1", 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "42", 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.063 INFO:teuthology.orchestra.run.smithi066.stdout: "testkey": { 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testkey", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.064 INFO:teuthology.orchestra.run.smithi066.stdout: "testlkey": { 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testlkey", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.065 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "testnewline": { 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "testnewline", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.066 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snap_schedule", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "allow_m_granularity": { 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "allow_m_granularity", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.067 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "dump_on_update": { 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "dump_on_update", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.068 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.069 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.070 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.071 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.072 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.073 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "stats", 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.074 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.075 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.076 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.077 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.078 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.079 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "status", 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.080 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.081 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.082 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.083 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.084 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.085 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telegraf", 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.086 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "address": { 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "address", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.087 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "15", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.088 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.089 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.090 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.091 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.092 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.093 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.094 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.095 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "telemetry", 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_basic": { 2024-09-15T23:05:13.096 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_basic", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.097 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_crash": { 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_crash", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.098 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_device": { 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_device", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.099 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_ident": { 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_ident", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.100 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "channel_perf": { 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "channel_perf", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.101 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "contact": { 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "contact", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.102 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "description": { 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "description", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.103 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "device_url": { 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "device_url", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.104 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "enabled": { 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "enabled", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.105 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "24", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "8", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.106 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "last_opt_revision": { 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "last_opt_revision", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "1", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.107 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard": { 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.108 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "leaderboard_description": { 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "leaderboard_description", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.109 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.110 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.111 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.112 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.113 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.114 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "organization": { 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "organization", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.115 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "proxy": { 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "proxy", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.116 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "url": { 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "url", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.117 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "test_orchestrator", 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.118 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.119 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.120 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.121 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.122 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.123 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.124 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "volumes", 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.125 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.126 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.127 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.128 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.129 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.130 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "max_concurrent_clones": { 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "max_concurrent_clones", 2024-09-15T23:05:13.131 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "4", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.132 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "periodic_async_work": { 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "periodic_async_work", 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.133 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Periodically check for async work", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_delay": { 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.134 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "0", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.135 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "True", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix", 2024-09-15T23:05:13.136 INFO:teuthology.orchestra.run.smithi066.stdout: "can_run": true, 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "error_string": "", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "module_options": { 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "discovery_interval": { 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "discovery_interval", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "uint", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "100", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.138 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.138 INFO:teuthology.orchestra.run.smithi066.stdout: "identifier": { 2024-09-15T23:05:13.140 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "identifier", 2024-09-15T23:05:13.140 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.140 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.140 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "interval": { 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "interval", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "secs", 2024-09-15T23:05:13.141 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "60", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "log_level": { 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_level", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.142 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.143 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster": { 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.144 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_cluster_level": { 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_cluster_level", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "info", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.145 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [ 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "critical", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "debug", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "error", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "info", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "warning" 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "log_to_file": { 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "log_to_file", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "bool", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 1, 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "False", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_host": { 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_host", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.148 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_port": { 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_port", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "int", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "10051", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.149 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "zabbix_sender": { 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "zabbix_sender", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "str", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "level": "advanced", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "flags": 0, 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "min": "", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "max": "", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "enum_allowed": [], 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "desc": "", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "long_desc": "", 2024-09-15T23:05:13.150 INFO:teuthology.orchestra.run.smithi066.stdout: "tags": [], 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "see_also": [] 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "services": { 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "dashboard": "https://172.21.15.66:8443/" 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "always_on_modules": { 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "octopus": [ 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "balancer", 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "devicehealth", 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator", 2024-09-15T23:05:13.151 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscaler", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "progress", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_support", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "status", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "telemetry", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "volumes" 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "pacific": [ 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "balancer", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "devicehealth", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscaler", 2024-09-15T23:05:13.152 INFO:teuthology.orchestra.run.smithi066.stdout: "progress", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_support", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "status", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "telemetry", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "volumes" 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "quincy": [ 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "balancer", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "devicehealth", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscaler", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "progress", 2024-09-15T23:05:13.153 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_support", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "status", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "telemetry", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "volumes" 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "reef": [ 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "balancer", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "devicehealth", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscaler", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "progress", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_support", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "status", 2024-09-15T23:05:13.154 INFO:teuthology.orchestra.run.smithi066.stdout: "telemetry", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "volumes" 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "squid": [ 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "balancer", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "devicehealth", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "orchestrator", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "pg_autoscaler", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "progress", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "rbd_support", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "status", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "telemetry", 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: "volumes" 2024-09-15T23:05:13.155 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "last_failure_osd_epoch": 90, 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "active_clients": [ 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "devicehealth", 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2652356585 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.156 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "libcephsqlite", 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2340812870 2024-09-15T23:05:13.157 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "rbd_support", 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2080763704 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.158 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snap_schedule", 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 3228601710 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.159 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "snap_schedule", 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 418354605 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.160 INFO:teuthology.orchestra.run.smithi066.stdout: "name": "volumes", 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: "addrvec": [ 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: { 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v2", 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "172.21.15.66:0", 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 4274630787 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-15T23:05:13.161 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:05:13.163 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:12 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3598109269' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:05:13.163 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:12 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3598109269' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 msgr2=0x7fed880a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 0x7fed880a5960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00a990 tx=0x7fed8c005c70 comp rx=0 tx=0).stop 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 msgr2=0x7fed940a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 0x7fed940a32b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fed98005fd0 tx=0x7fed9800be40 comp rx=0 tx=0).stop 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 shutdown_connections 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fed880a34a0 0x7fed880a5960 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed940a37f0 0x7fed940a3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed94099870 0x7fed940a32b0 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fed98005fd0 tx=0x7fed9800be40 comp rx=0 tx=0).stop 2024-09-15T23:05:13.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 --2- 172.21.15.66:0/3598109269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed94094b60 0x7fed940aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 >> 172.21.15.66:0/3598109269 conn(0x7fed9400a1d0 msgr2=0x7fed94092bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:13.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 shutdown_connections 2024-09-15T23:05:13.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:11.681+0000 7feda3dfd640 1 -- 172.21.15.66:0/3598109269 wait complete. 2024-09-15T23:05:13.171 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T23:05:13.172 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T23:05:13.172 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:12 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3598109269' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:05:13.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:13 smithi087 ceph-mon[35290]: pgmap v627: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 85 op/s 2024-09-15T23:05:13.668 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:13.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:13 smithi184 ceph-mon[35203]: pgmap v627: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 85 op/s 2024-09-15T23:05:13.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:13 smithi066 ceph-mon[31185]: pgmap v627: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 85 op/s 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 2171, 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 2113, 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 40281787, 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 774364, 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 7, 2024-09-15T23:05:14.328 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.293539061, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.078783360, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.132084764, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.084824304, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2112, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.131928011, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000062465 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.329 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1991728, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 229312 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 959, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1233, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 96130080, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 947306, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:14.330 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.179316020, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.037693876, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.100377246, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.031500885, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1230, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.077018292, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000062616 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.331 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 642912 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1668, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1668, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 109505682, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 529601, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 5, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.204186760, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.039863273, 2024-09-15T23:05:14.332 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.105395485, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.048420377, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1667, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.085721870, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000051422 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:05:14.333 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 7101, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.194675970, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000027415 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.334 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.335 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 35664, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 375, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 35289, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-15T23:05:14.336 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 35127, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-15T23:05:14.337 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:14.338 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-15T23:05:14.339 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-15T23:05:14.340 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.341 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 81308, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 109, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 8, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-15T23:05:14.342 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 246874967, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 246866257, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 81308 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 13446, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 38298, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 24852, 2024-09-15T23:05:14.343 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 409, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 1062, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 653, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 35664, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 60631, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 24967, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 146892, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 215328 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-15T23:05:14.344 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.345 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.346 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.347 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.348 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.349 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-15T23:05:14.350 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.351 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.352 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.353 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-15T23:05:14.354 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.355 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.356 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 2, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 3374, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-15T23:05:14.357 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:14.358 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:14.359 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 741433, 2024-09-15T23:05:14.360 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 13666, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 216, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:14.361 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 57376977, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 581777, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-15T23:05:14.362 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 4335, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 4335, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4335, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 20.076853256, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.004631338 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4335, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 4336 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.363 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 4335, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 4335, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 2656, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1677, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-15T23:05:14.364 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:14.365 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-15T23:05:14.366 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 119, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 34, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 11, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 11, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-15T23:05:14.367 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:05:14.368 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 4794, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 245459867, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 4794, 2024-09-15T23:05:14.369 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4794, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 245459867, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:14.370 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 4335, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 242715181, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4335, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 242715181, 2024-09-15T23:05:14.372 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-15T23:05:14.373 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 4335, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 4335, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4335, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 4335, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.374 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-15T23:05:14.375 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x559bf2b38b40": { 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:14.376 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:14.377 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:15.281 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-15T23:05:15.282 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T23:05:15.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T23:05:15.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:15 smithi087 ceph-mon[35290]: pgmap v628: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-15T23:05:15.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:15 smithi184 ceph-mon[35203]: pgmap v628: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-15T23:05:15.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:15 smithi066 ceph-mon[31185]: pgmap v628: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 100 op/s 2024-09-15T23:05:15.780 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:16.393 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 0, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 2, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 0, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 0, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.001423438, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.000167159, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:16.394 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:16.395 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 3, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 280, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 480, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 285392, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.021981610, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.016368523, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.002526414, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 277, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.025599585, 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000092417 2024-09-15T23:05:16.396 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 285392 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 380, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 367, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1633632, 2024-09-15T23:05:16.397 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 226144, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 2, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.063981154, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.024556044, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.052479809, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 367, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.024792686, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000067555 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:16.398 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1633632, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 226144 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 0, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:16.399 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:16.400 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:16.401 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 148754, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 31, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:16.402 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 928, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 2, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:16.403 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 379, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1577494, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 379, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 379, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1577494, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:16.404 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:16.405 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:16.405 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:16.405 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:16.405 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:05:17.282 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-15T23:05:17.283 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-15T23:05:17.283 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T23:05:17.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T23:05:17.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:17 smithi087 ceph-mon[35290]: pgmap v629: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 87 op/s 2024-09-15T23:05:17.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:17 smithi184 ceph-mon[35203]: pgmap v629: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 87 op/s 2024-09-15T23:05:17.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:17 smithi066 ceph-mon[31185]: pgmap v629: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 87 op/s 2024-09-15T23:05:17.802 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:18.448 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:05:18.448 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 2641, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 2643, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 77171967, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 839839, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 8, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.336287364, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.084492679, 2024-09-15T23:05:18.449 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.113625996, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.119034547, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2641, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.146644903, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000055526 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:05:18.450 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1320, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1595, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 54869074, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 1150287, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 10, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.166524401, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.041915397, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.075076332, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.037616420, 2024-09-15T23:05:18.451 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1592, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.091132206, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000057243 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 731424 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.452 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 710, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 650, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 52393854, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 309597, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 5, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.133302243, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.038029802, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.104853967, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.006873063, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 650, 2024-09-15T23:05:18.453 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.058146278, 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000089455 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.454 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1995296, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 231040 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 6984, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.185974138, 2024-09-15T23:05:18.455 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000026628 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-15T23:05:18.456 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-15T23:05:18.457 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 38077, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 314, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 37763, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 37628, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-09-15T23:05:18.458 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-15T23:05:18.459 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:05:18.460 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-15T23:05:18.461 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:18.462 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:18.465 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:05:18.466 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 60007, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-15T23:05:18.467 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 87, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 6, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 185424720, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 185416010, 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-15T23:05:18.468 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 60007 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 14039, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 27744, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 13705, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 400, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 630, 2024-09-15T23:05:18.469 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 230, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 38077, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 45408, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 7331, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 126860, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 215328 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-15T23:05:18.470 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.471 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-15T23:05:18.472 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.473 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.474 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.475 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-15T23:05:18.476 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.477 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.478 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.479 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.480 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.481 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.482 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:18.483 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 4, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 3, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 3, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-15T23:05:18.484 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 4473, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:18.485 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:18.486 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:18.487 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:18.488 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 764841, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 14279, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:18.489 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 216, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 60465698, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 614849, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:18.490 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 4205, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 4205, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4205, 2024-09-15T23:05:18.491 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 35.202742386, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.008371639 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4205, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 4206 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 4205, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 4205, 2024-09-15T23:05:18.492 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 2573, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1630, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-15T23:05:18.493 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:18.494 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-15T23:05:18.495 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 119, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-15T23:05:18.496 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 34, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 11, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 11, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-15T23:05:18.497 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "osd-slow-ops": { 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 4667, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 183988496, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 4667, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4667, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 183988496, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.499 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:18.500 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 4205, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 181264879, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4205, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 181264879, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.501 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 4205, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 4205, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4205, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 4205, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:18.503 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x555731036b40": { 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-15T23:05:18.505 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:18.506 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:19.383 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-15T23:05:19.384 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T23:05:19.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T23:05:19.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:19 smithi087 ceph-mon[35290]: pgmap v630: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 94 op/s 2024-09-15T23:05:19.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:19 smithi184 ceph-mon[35203]: pgmap v630: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 94 op/s 2024-09-15T23:05:19.705 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:19 smithi066 ceph-mon[31185]: pgmap v630: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 94 op/s 2024-09-15T23:05:19.912 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 4, 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 4, 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 3024, 2024-09-15T23:05:21.195 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 448, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 0, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.003361425, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.000043993, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.002332839, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.004208270, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001402756 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.196 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 3, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 282, 2024-09-15T23:05:21.197 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 480, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 285744, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.020621920, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.015488271, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.002145051, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 279, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.031721358, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000113696 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.198 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 285744 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 378, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 367, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1631152, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 226976, 2024-09-15T23:05:21.199 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 2, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.068127647, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.025286972, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.055848895, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 366, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.042643372, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000116511 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:21.200 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1631152, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 226976 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 0, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:21.201 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:21.202 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:21.203 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 148754, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 31, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:21.204 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:21.205 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 928, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 2, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 381, 2024-09-15T23:05:21.206 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1577754, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 381, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 381, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1577754, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-15T23:05:21.207 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-15T23:05:21.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:21 smithi066 ceph-mon[31185]: pgmap v631: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 107 op/s 2024-09-15T23:05:21.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:21 smithi087 ceph-mon[35290]: pgmap v631: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 107 op/s 2024-09-15T23:05:21.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:21 smithi184 ceph-mon[35203]: pgmap v631: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 107 op/s 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-15T23:05:21.944 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-15T23:05:21.944 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T23:05:21.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T23:05:22.337 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 112405, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 112824, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 60787279, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 168559365, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 40, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 7.724433170, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 2.312628480, 2024-09-15T23:05:23.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 2.662891603, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 2.659728833, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 112824, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 9.265076123, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000082119 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 66135, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.011444835, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000173 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 95760, 2024-09-15T23:05:23.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 558960 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 361326, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 441478, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 117690496, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 365086682, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 19, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 20.686367370, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 8.059458969, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 12.129062235, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 3.034991256, 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:23.079 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 441480, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 45.485676485, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000103029 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 540162, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.099073512, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000183 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 628832, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 346208 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:23.080 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 130495, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 134969, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 45558448, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 136714431, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 231, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 12, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 8.690219538, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 3.015175492, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 3.106404359, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 2.473991748, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 134962, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 11.148088459, 2024-09-15T23:05:23.081 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000082601 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 86144, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.014530067, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000168 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 2083488, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 277728 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.082 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 163366, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 110.411120413, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000675851 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 34499, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 6.227578467, 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000180514 2024-09-15T23:05:23.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 147157, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 131278, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 131278, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 2281.709848208, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.017380748 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 15804, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 118, 2024-09-15T23:05:23.084 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 2, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 726, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 69, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 0, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 47820, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 4968, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 20575, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 22277, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 40719, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 36069, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 2, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 2, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 3, 2024-09-15T23:05:23.085 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 248203, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 192910, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 15391, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 796, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 11, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 197, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 161, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 0, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 181, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 27942, 2024-09-15T23:05:23.086 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 213, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 44119, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 198946, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 4, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 234, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 7, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 198946, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 1821, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 22, 2024-09-15T23:05:23.087 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 1799, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 197125, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 196, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 65946, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 41593, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 5, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 77011, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 15861, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 4977, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 32354 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-09-15T23:05:23.088 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 5045, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 8678, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 4785, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 5914, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 6751, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 127, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 17895, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 17768, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:23.089 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 17, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 163853, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 22, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 182, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 72, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 3, 2024-09-15T23:05:23.090 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 98430, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 9500, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 1, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 98429, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 9499, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 140, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 12, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 1, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 139, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 9, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-09-15T23:05:23.091 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 11, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 4194352, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 348955830, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 0, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7984, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 362.791710857, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.045439843 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 0 2024-09-15T23:05:23.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 27285, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 64719, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 37434, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 891, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 5976, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 5085, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 47820, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 109377, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 61557, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 2, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 42617, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 42615, 2024-09-15T23:05:23.093 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 241264, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 231712 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 153136, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 2191, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 147157, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 198, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 6306, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 10966, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 44.366292391, 2024-09-15T23:05:23.094 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.004045804 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 597, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 7.522900221, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.012601172 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 80377, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 1702.705942755, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.021183994 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.096 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.097 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:23.098 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.098 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.098 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 20, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.005842632, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000292131 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 81, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 5.106345879, 2024-09-15T23:05:23.099 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.063041307 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 20, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 7.699068855, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.384953442 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-09-15T23:05:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 11287, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 172.408458049, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.015274958 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 891, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.368365822, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.004902767 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 10587, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 181.756872706, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.017167929 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.101 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 132, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 23.716792537, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.179672670 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.102 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 13, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 16.420691603, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 1.263130123 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.032775041, 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.004682148 2024-09-15T23:05:23.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.104 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 8, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.020628698, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002578587 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 3, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.001725569, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000575189 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 16289, 2024-09-15T23:05:23.105 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 115.577145450, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.007095410 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 2, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 6, 2024-09-15T23:05:23.106 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 4, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 2, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 8240, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 4120, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 1179, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:23.107 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:23.108 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:23.109 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 2294644, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 23726, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 440, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 5, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:23.110 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 216, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 99242455, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 986369, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 7, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-09-15T23:05:23.111 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 245313, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 365058795, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 32, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 245306, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 245306, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 2124.033202004, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.008658708 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 7, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 245313, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 247204 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.112 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 245313, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 199574, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 45739, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 82, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 90, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 328, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 8294, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 196, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 69, 2024-09-15T23:05:23.113 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 35912, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 198978, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 150, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-09-15T23:05:23.114 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 5, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-09-15T23:05:23.115 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 119, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 40, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 12, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 12, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 2262, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 398, 2024-09-15T23:05:23.116 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 440 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 1, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 151520 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 10, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T23:05:23.117 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 5, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 6, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 35308, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 17658, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 175 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 604222, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 169544125, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 604222, 2024-09-15T23:05:23.118 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 604222, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 169544125, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:23.119 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 245313, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 367765975, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 245306, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 367765975, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.120 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 7, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 245313, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 245313, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 245306, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 245306, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.121 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 17768, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 2714536, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 17768, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 309, 2024-09-15T23:05:23.122 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 2714536, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x556144e2e960": { 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 98430, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 344761526, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:23.123 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 98430, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 7984, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 344761526, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:23.124 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-15T23:05:23.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:23 smithi087 ceph-mon[35290]: pgmap v632: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-15T23:05:23.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:23 smithi184 ceph-mon[35203]: pgmap v632: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-15T23:05:23.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:23 smithi066 ceph-mon[31185]: pgmap v632: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds.exported=181 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds.imported=213 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=5045 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=8678 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=20 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=13 2024-09-15T23:05:25.094 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=69 2024-09-15T23:05:25.094 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T23:05:25.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T23:05:25.317 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:25 smithi087 ceph-mon[35290]: pgmap v633: 129 pgs: 11 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 86 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 104 op/s 2024-09-15T23:05:25.402 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:05:25.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:25 smithi184 ceph-mon[35203]: pgmap v633: 129 pgs: 11 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 86 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 104 op/s 2024-09-15T23:05:25.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:25 smithi066 ceph-mon[31185]: pgmap v633: 129 pgs: 11 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 86 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 104 op/s 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 2657, 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2659, 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 118240504, 2024-09-15T23:05:27.153 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 844936, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 8, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.294752012, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.077557528, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.123601569, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.074308823, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 2657, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.116135869, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000043709 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.154 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 605, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 882, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 130202256, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 926038, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 10, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.127925962, 2024-09-15T23:05:27.155 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.021341275, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.086522900, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.014237864, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 880, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.047755611, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000054267 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.156 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3504, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 735808 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 1950, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 1891, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 99681244, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 705865, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.230513583, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.051328702, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.149598752, 2024-09-15T23:05:27.157 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.038530707, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1890, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.071120466, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000037629 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1993792, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 233952 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.158 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7648, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.179458060, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000023464 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:27.159 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 0, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 0, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 76520, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 5576, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 70944, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 68554, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 0, 2024-09-15T23:05:27.161 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 2, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 0, 2024-09-15T23:05:27.162 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 4, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 234, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 7, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:27.163 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 0, 2024-09-15T23:05:27.164 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 0 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 0, 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 0, 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 0, 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 0, 2024-09-15T23:05:27.165 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-09-15T23:05:27.166 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 0, 2024-09-15T23:05:27.167 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 0, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 0, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 0, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 98430, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 0, 2024-09-15T23:05:27.168 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 0, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 0, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 0, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 139, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 10, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 0, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 4194352, 2024-09-15T23:05:27.169 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 348955830, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 348955770, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 98430 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 28275, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 63832, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 35557, 2024-09-15T23:05:27.170 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 880, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 1523, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 643, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 76520, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 105712, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 29192, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 0, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 0, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 0, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 192200, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 215328 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.171 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.172 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.173 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-09-15T23:05:27.175 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-09-15T23:05:27.179 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.180 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.181 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.182 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.183 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.185 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.187 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:27.188 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 2, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 6, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 4, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 4, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-09-15T23:05:27.189 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 3986, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:27.190 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:27.191 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:27.192 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 1299821, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 28718, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 216, 2024-09-15T23:05:27.193 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 121523044, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 1207102, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-09-15T23:05:27.194 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 4739, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 26, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 4, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 4739, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 4739, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 21.613507012, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.004560773 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 0, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 4739, 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4740 2024-09-15T23:05:27.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 4739, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 4739, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 2886, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 1850, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-09-15T23:05:27.196 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 2, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:27.197 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-09-15T23:05:27.198 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 119, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 34, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 11, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 11, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-09-15T23:05:27.199 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 0, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 2, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 0 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 0, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 0 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-09-15T23:05:27.200 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 5208, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 347628609, 2024-09-15T23:05:27.201 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 5208, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 5208, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 347628609, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:27.202 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 4739, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 344813726, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 4739, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 344813726, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.203 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:27.204 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 4739, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 4739, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 4739, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 4739, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:27.205 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.206 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x556751ab6b40": { 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:27.207 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 0, 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 0, 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:27.208 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-15T23:05:27.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:27 smithi087 ceph-mon[35290]: pgmap v634: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 92 op/s 2024-09-15T23:05:27.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:27 smithi184 ceph-mon[35203]: pgmap v634: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 92 op/s 2024-09-15T23:05:27.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:27 smithi066 ceph-mon[31185]: pgmap v634: 129 pgs: 10 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 96 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 92 op/s 2024-09-15T23:05:28.949 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-15T23:05:28.949 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=7 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:28.950 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-15T23:05:28.950 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T23:05:28.950 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T23:05:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:05:29.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:29 smithi087 ceph-mon[35290]: pgmap v635: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 85 op/s 2024-09-15T23:05:29.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:29 smithi184 ceph-mon[35203]: pgmap v635: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 85 op/s 2024-09-15T23:05:29.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:29 smithi066 ceph-mon[31185]: pgmap v635: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 85 op/s 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 89002, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 89419, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 37006310, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 82161390, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 17, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 5.336576445, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 1.895947326, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 2.048379649, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 1.394324540, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 89418, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.557619795, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000050969 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 50727, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.008417213, 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000165 2024-09-15T23:05:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 2018112, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 253776 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 231876, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 300183, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 72730803, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 232278066, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 18, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 11.484072734, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 4.711422433, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 7.709914715, 2024-09-15T23:05:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 1.349789613, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 300179, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 17.155375759, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000057150 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 348349, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.066922218, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000192 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3504, 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 738464 2024-09-15T23:05:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 73430, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 80738, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 33385696, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 79715069, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 48, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 4.517470238, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 1.914372932, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 2.398301165, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.516489300, 2024-09-15T23:05:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 80738, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 3.849717883, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000047681 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 113298, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.017836313, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000157 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 84252, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 60.522552688, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000718351 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 18460, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.332509942, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000234697 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 91351, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 72672, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 72672, 2024-09-15T23:05:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 663.376341907, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.009128362 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 18679, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 6, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 559, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 61, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 0, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 22178, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 165, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 16191, 2024-09-15T23:05:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 5822, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 21939, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 17550, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 0, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 6, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 155606, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 116030, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 18496, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 873, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 496, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 0, 2024-09-15T23:05:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 0, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 279, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 12994, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 170, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 15529, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 107683, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 4, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 234, 2024-09-15T23:05:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 6, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 107683, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 525, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 525, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 107158, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 255, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 54848, 2024-09-15T23:05:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 41636, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 66558, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 10351, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 1787, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 22628 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 3292, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 9984, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 5484, 2024-09-15T23:05:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 6531, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 3836, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 61, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 9675, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 9614, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-09-15T23:05:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 17, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 74503, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 279, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 62, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 1, 2024-09-15T23:05:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 65399, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 65399, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 92, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 92, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 7, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 0, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 4194304, 2024-09-15T23:05:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 193202438, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 0, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 3417, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 387.615102957, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.113437255 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 0 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 12699, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 34223, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 21524, 2024-09-15T23:05:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 510, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 5929, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 5419, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 22178, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 55622, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 33444, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 0, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 25464, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 25464, 2024-09-15T23:05:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 200872, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 223520 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 99796, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 1237, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 91351, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 89, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 6251, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7493, 2024-09-15T23:05:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 63.617257414, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.008490225 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 71, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.512710562, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.007221275 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 42671, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 395.638466996, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.009271834 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 39, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.710698953, 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.018223050 2024-09-15T23:05:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 6501, 2024-09-15T23:05:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 11.772915839, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001810939 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 467, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 1.060661171, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002271223 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7498, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 169.767592072, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.022641716 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 61, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 7.172583042, 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.117583328 2024-09-15T23:05:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-09-15T23:05:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7871, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 13.123455858, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001667317 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 1, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 1, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 0, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 1, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 161, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 161, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 1121, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-15T23:05:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 1114745, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 8706, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 216, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 46050649, 2024-09-15T23:05:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 419407, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 0, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 132139, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 203538141, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 28, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 132139, 2024-09-15T23:05:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 132139, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 444.448893914, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003363495 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 0, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 132139, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 133298 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 132139, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 107980, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 24159, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-09-15T23:05:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 10, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 278, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 3697, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 178, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 60, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 19286, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 107683, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 20, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-09-15T23:05:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 119, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 34, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 12, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 12, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-09-15T23:05:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 1782, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 25, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 279 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 1, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 74222 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 0, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 5, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 19228, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 9614, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 394304, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 107606112, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 394304, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 394304, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 107606112, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 132139, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 204969384, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 132139, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 204969384, 2024-09-15T23:05:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 132139, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 132139, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 132139, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 132139, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 9614, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1431782, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 9614, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 280, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1431782, 2024-09-15T23:05:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x563d0b798960": { 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 65399, 2024-09-15T23:05:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 189008134, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 65399, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 3417, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 189008134, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:30.810 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-15T23:05:31.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:31 smithi087 ceph-mon[35290]: pgmap v636: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 74 op/s 2024-09-15T23:05:31.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:31 smithi184 ceph-mon[35203]: pgmap v636: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 74 op/s 2024-09-15T23:05:31.699 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:31 smithi066 ceph-mon[31185]: pgmap v636: 129 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 101 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 74 op/s 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds.exported=279 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds.imported=170 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=3292 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9984 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:31.794 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=61 2024-09-15T23:05:31.795 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T23:05:31.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T23:05:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:05:32.674 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-15T23:05:32.674 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 2724, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2666, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 132727927, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 953760, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 7, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.318825310, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.091631710, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.167241267, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.061369006, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 2665, 2024-09-15T23:05:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.157020248, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000058919 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1994720, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 236352 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 847, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 1130, 2024-09-15T23:05:32.676 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 193473157, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 919732, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 9, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.173501290, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.027304977, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.117189034, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.021758214, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1127, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.067079263, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000059520 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.677 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 650960 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 1784, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 1784, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 271610225, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 566495, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 6, 2024-09-15T23:05:32.678 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 5, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.285186137, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.033189717, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.195075573, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.045770629, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1783, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.062322883, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000034953 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-09-15T23:05:32.680 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7843, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.219405455, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000027974 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 0, 2024-09-15T23:05:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 98519, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 11916, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 86603, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 81495, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 1, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 0, 2024-09-15T23:05:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:05:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 0, 2024-09-15T23:05:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 0 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 0, 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 0, 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 0, 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 0, 2024-09-15T23:05:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:05:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 0, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 174244, 2024-09-15T23:05:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 128, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 16, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 222730060, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 594067979, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 594052603, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 174244 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 36601, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 96472, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 59871, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 1123, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 2502, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 1379, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 98519, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 162465, 2024-09-15T23:05:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 63946, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 261780, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 215328 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 0, 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-09-15T23:05:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-09-15T23:05:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-09-15T23:05:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 2, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 2, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 0, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 2, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 0, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 0, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 2600, 2024-09-15T23:05:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 1612578, 2024-09-15T23:05:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 37210, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 216, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 156915951, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 1537489, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 4881, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 21, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 3, 2024-09-15T23:05:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 4881, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 4881, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 32.290259105, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.006615500 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 0, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 4881, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4882 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 4881, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 4881, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 0, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-09-15T23:05:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 2998, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 1881, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 1, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-09-15T23:05:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-09-15T23:05:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 119, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 34, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 11, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 11, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 2, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 0 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-09-15T23:05:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 0 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 0, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 5351, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 597302925, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 5351, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 5351, 2024-09-15T23:05:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 597302925, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 4881, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 594462209, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 4881, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 594462209, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 4881, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 4881, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 4881, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 4881, 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x55e42cd78b40": { 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-09-15T23:05:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-15T23:05:32.723 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-15T23:05:33.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:33 smithi087 ceph-mon[35290]: pgmap v637: 129 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 108 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 49 op/s 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:33.440 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-15T23:05:33.440 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T23:05:33.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T23:05:33.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:33 smithi184 ceph-mon[35203]: pgmap v637: 129 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 108 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 49 op/s 2024-09-15T23:05:33.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:33 smithi066 ceph-mon[31185]: pgmap v637: 129 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 108 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 49 op/s 2024-09-15T23:05:33.822 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:05:34.516 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 78308, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 83320, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 29438310, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 129731596, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 15, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 6.763861664, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 2.789736959, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 2.280810754, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 1.514504633, 2024-09-15T23:05:34.517 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 83320, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 8.730172163, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000104778 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 64514, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.013880718, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000215 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 525616 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:34.518 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 291360, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 365884, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 93520895, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 276129677, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 19, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 8, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 18.164548890, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 7.813909584, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 11.401881708, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 2.004674272, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 365880, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 46.720265870, 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000127692 2024-09-15T23:05:34.519 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 431959, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.087297193, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000202 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 4112, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 128064 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 76941, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 74759, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 31476811, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 83708084, 2024-09-15T23:05:34.520 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 48, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 5.522043734, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 2.215885379, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 2.427085272, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 1.021267774, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 74758, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 8.233267276, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000110132 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.521 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 81203, 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.014595070, 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000179 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 2015680, 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 263072 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-15T23:05:34.522 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 84289, 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 86.628519910, 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001027755 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.523 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 16583, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3.718900317, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000224259 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 107047, 2024-09-15T23:05:34.524 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 87945, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 87945, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3294.121894143, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.037456613 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 19102, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 28, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 677, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 74, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-15T23:05:34.525 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 21639, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 3, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 5, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 21631, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 21634, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 29968, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 4, 2024-09-15T23:05:34.526 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 178532, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 135166, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 18759, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 1301, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 7, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 600, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 83, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 24914, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 154, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 11963, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:34.527 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 125344, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 6, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 125344, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 1070, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 1070, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 124274, 2024-09-15T23:05:34.528 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 275, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 64036, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 45671, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 81902, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 15723, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 2192, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 23877 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 2350, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 11467, 2024-09-15T23:05:34.529 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 6254, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 7668, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 5463, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 57, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 8458, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 8403, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-15T23:05:34.530 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 17, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 101266, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 83, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 74, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 2, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 81308, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-15T23:05:34.531 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 81308, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 109, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 109, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 8, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 246874967, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-09-15T23:05:34.532 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3773, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 218.971620513, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.058036475 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 12592, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 39232, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 26640, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 420, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 6855, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 6435, 2024-09-15T23:05:34.533 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 21639, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 64416, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 42777, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 27700, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 27700, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 212520, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223520 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 114538, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 4996, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 107047, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 166, 2024-09-15T23:05:34.534 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 10818, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 12313, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 131.449528332, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.010675670 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 324, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 7.199377155, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.022220299 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 46465, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2518.743396848, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.054207325 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:34.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.537 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:34.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.538 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.538 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.539 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 82, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 30.700987301, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.374402284 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.540 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 8919, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 78.228557436, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.008771000 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 407, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3.986676638, 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.009795274 2024-09-15T23:05:34.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 12359, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 459.519663702, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.037180974 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 55, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 28.554300314, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.519169096 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-15T23:05:34.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 7021, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 35.739406417, 2024-09-15T23:05:34.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.005090358 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-15T23:05:34.547 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 388, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 388, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1120, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-15T23:05:34.548 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:34.549 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:34.550 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 1095974, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 9075, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:34.551 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 216, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-15T23:05:34.552 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 45156209, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 414188, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 148181, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 259613166, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 32, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 148181, 2024-09-15T23:05:34.553 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 148181, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 700.889887642, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.004729957 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 148181, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 149611 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 148181, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 125764, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 22417, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-15T23:05:34.554 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 353, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 4126, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 231, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 2, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 74, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 16871, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:34.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 125344, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-15T23:05:34.556 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-15T23:05:34.557 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 119, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 34, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 2120, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 95, 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 365 2024-09-15T23:05:34.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 100950 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-15T23:05:34.559 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 5, 2024-09-15T23:05:34.560 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 16804, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 8403, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 446605, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 114211490, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:34.561 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 446605, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 446605, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 114211490, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:34.562 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 148181, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 260871977, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 148181, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 260871977, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.563 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 148181, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 148181, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 148181, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 148181, 2024-09-15T23:05:34.564 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 8403, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 1260591, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:34.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 8403, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 353, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1260591, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55e7b7e78960": { 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:34.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 81308, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 242680663, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 81308, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3773, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 242680663, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.567 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:34.568 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-15T23:05:35.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:35 smithi087 ceph-mon[35290]: pgmap v638: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 48 op/s 2024-09-15T23:05:35.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:35 smithi184 ceph-mon[35203]: pgmap v638: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 48 op/s 2024-09-15T23:05:35.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:35 smithi066 ceph-mon[31185]: pgmap v638: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 48 op/s 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds.exported=83 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds.imported=154 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=2350 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=11467 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:35.946 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=74 2024-09-15T23:05:35.946 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T23:05:35.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T23:05:36.236 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:05:37.146 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-15T23:05:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:37.146 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 208134, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 266645, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 76744146, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 200962096, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 15, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 12.256809524, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 5.044460776, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 9.841041497, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 1.045931118, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 266642, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 36.467246044, 2024-09-15T23:05:37.147 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000136764 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 356686, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.083048506, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000232 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 4768, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 527216 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 87263, 2024-09-15T23:05:37.148 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 83391, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 32231979, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 69056304, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 13, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 5.819692846, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 1.723726653, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 2.283527617, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 1.631725616, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 83392, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 8.848455195, 2024-09-15T23:05:37.149 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000106106 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 59692, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.011660157, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000195 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 2008720, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 255696 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 73189, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 76116, 2024-09-15T23:05:37.150 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 23706600, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 111846958, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 57, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 10, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 7.194611068, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 3.516445975, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 1.870975920, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 1.543973417, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 76113, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 7.927158916, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000104149 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:37.151 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 46027, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.008718919, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000189 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 5456, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 132352 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-15T23:05:37.152 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 71120, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 64.563845331, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000907815 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:37.153 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 18654, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4.363638000, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000233925 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 86231, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 85683, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 85683, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1825.587316671, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.021306295 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.154 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 548, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 40, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 415, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 45, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 23192, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 267, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 16259, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 6666, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 22807, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 9859, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 1, 2024-09-15T23:05:37.155 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 1, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 6, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 161046, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 128849, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 493, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 764, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 313, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 109, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 6235, 2024-09-15T23:05:37.156 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 138, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 8906, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 102295, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 6, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 102295, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 581, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:37.157 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 581, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 101714, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 322, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 46057, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 38362, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 56962, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 9245, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 958, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 21239 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-15T23:05:37.158 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 2826, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 8547, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 4707, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 6116, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 3657, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 54, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 9691, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 9638, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:37.159 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 17, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 76679, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 109, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 46, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-15T23:05:37.160 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 60007, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 60007, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 87, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 87, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 6, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-15T23:05:37.161 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 185424720, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3101, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 100.157226842, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.032298364 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 13620, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 28237, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 14617, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 431, 2024-09-15T23:05:37.162 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 5049, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 4618, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 23192, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 47810, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 24618, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 1, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 22956, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 22955, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 188952, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223520 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 92299, 2024-09-15T23:05:37.163 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 2575, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 86231, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 183, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 5842, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 7078, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 140.657536820, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.019872497 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 42, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 23.252910696, 2024-09-15T23:05:37.164 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.553640730 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 56812, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1264.124425457, 2024-09-15T23:05:37.165 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.022251010 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000099261, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000099261 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.166 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:37.167 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-15T23:05:37.168 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 37, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 13.337041673, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.360460585 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.169 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5868, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 31.488690639, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.005366170 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.170 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 410, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.818271687, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001995784 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 7032, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 329.338941466, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.046834320 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 53, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 7.176647717, 2024-09-15T23:05:37.172 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.135408447 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.173 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:37.174 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.175 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 8350, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 15.392751255, 2024-09-15T23:05:37.176 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001843443 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.177 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 4, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 3, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 351, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 351, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1213, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.178 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:37.179 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:37.180 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:37.181 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 1075515, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 9370, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:37.182 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 216, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 48690298, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 446557, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-15T23:05:37.183 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 126652, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 192746278, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 29, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 126652, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 126652, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 547.433962028, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.004322347 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-15T23:05:37.184 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 126652, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 127761 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 126652, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 102751, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 23901, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 363, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 3464, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 233, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-15T23:05:37.185 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 1, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 44, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 19330, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 102295, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-15T23:05:37.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-15T23:05:37.187 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 119, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 34, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-15T23:05:37.188 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 1549, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 133, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 319 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 76528 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-15T23:05:37.189 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 5, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 19275, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 9638, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 368582, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 99479633, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:37.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 368582, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 368582, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 99479633, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:37.191 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 126652, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 194206895, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 126652, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 194206895, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.192 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 126652, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 126652, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 126652, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 126652, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.193 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 9638, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 1463070, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 9638, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 363, 2024-09-15T23:05:37.194 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1463070, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55920cbbc960": { 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 60007, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 181230416, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:37.195 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 60007, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3101, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 181230416, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:37.196 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-15T23:05:37.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:37 smithi087 ceph-mon[35290]: pgmap v639: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 28 op/s 2024-09-15T23:05:37.661 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:37 smithi184 ceph-mon[35203]: pgmap v639: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 28 op/s 2024-09-15T23:05:37.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:37 smithi066 ceph-mon[31185]: pgmap v639: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 28 op/s 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds.exported=109 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds.imported=138 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=2826 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=8547 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:37.935 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=45 2024-09-15T23:05:37.935 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T23:05:37.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T23:05:38.221 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:05:38.776 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-15T23:05:38.776 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:38.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 134849, 2024-09-15T23:05:38.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 138317, 2024-09-15T23:05:38.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 59842290, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 280014704, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 55, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 12.413755630, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 5.054762601, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 3.855585520, 2024-09-15T23:05:38.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 3.362206554, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 138316, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 22.101036696, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000159786 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 111748, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.020769935, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000185 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.778 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 407066, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 582429, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 129063839, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 522854780, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 20, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 24.762042208, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 9.924305294, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 30.098246830, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 2.659583364, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 582426, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 78.132919798, 2024-09-15T23:05:38.779 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000134150 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 731581, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.143317113, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000195 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 4816, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 679024 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.780 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 190595, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 185295, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 84343672, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 246105605, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 8, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 14.778759548, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 5.173254488, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 4.656389994, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 4.502043474, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 185294, 2024-09-15T23:05:38.781 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 25.171400112, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000135845 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 115575, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.020298779, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000175 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 2026208, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 258672 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.782 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 156551, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 210.495978195, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001344584 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:38.783 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 44503, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 10.870975777, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000244275 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 211393, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 191620, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 191620, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3606.918160555, 2024-09-15T23:05:38.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.018823286 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 19631, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 282, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 1489, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 147, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 1, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 60226, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 3834, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 39544, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 16848, 2024-09-15T23:05:38.785 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 54747, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 80705, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 2, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 2, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 4, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 340081, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 286183, 2024-09-15T23:05:38.786 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 19197, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 640, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 32, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 125, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 1000, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 1, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 245, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 59005, 2024-09-15T23:05:38.787 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 222, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 50573, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 206493, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 6, 2024-09-15T23:05:38.788 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 206493, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 1734, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 1734, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 204759, 2024-09-15T23:05:38.789 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 169, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 82580, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 81757, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 1, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 117687, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 35279, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 5714, 2024-09-15T23:05:38.790 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 57124 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 6204, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 5119, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 2854, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 3740, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 10639, 2024-09-15T23:05:38.791 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 154, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 23351, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 23198, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-15T23:05:38.792 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 17, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 174527, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 249, 2024-09-15T23:05:38.793 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 158, 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 2, 2024-09-15T23:05:38.794 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 174244, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 86031, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 86031, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 88213, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 12290, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 242, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 114, 2024-09-15T23:05:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 114, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 128, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 8, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 16, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 222730060, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 594067979, 2024-09-15T23:05:38.796 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 9999, 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 450.475891327, 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.045052094 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.797 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 33811, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 97664, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 63853, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 1141, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 4780, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 3639, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 60226, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 170193, 2024-09-15T23:05:38.798 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 109967, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 2, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 58913, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 58911, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 336616, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223520 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-15T23:05:38.799 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 216622, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 6531, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 211393, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 251, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 13126, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 30767, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 265.070666442, 2024-09-15T23:05:38.800 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.008615421 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1269, 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 61.589159940, 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.048533616 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.801 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 92065, 2024-09-15T23:05:38.802 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2431.063810497, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.026405950 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000108237, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000108237 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-15T23:05:38.803 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.804 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.804 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.804 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.805 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:38.805 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.805 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.805 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.806 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 221, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 54.476662394, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.246500734 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.807 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 14884, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 335.124216522, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.022515736 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-15T23:05:38.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1107, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3.597379538, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003249665 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 30763, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 344.485924382, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.011198060 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.809 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 153, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 64.088341237, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.418878047 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.810 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.129936447, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.129936447 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.811 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-15T23:05:38.812 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.813 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 20389, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 47.291954919, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002319483 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.814 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 2, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 2, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-15T23:05:38.815 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 5454, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 2727, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1186, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:38.816 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:38.817 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:38.818 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 2787038, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 32240, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 216, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:38.819 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 124266158, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 1290569, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-15T23:05:38.820 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 270646, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 629908555, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 29, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 270646, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 270646, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3377.480220027, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.012479328 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 270646, 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 279099 2024-09-15T23:05:38.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 270646, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 207650, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 62996, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 150, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 3659, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 398, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 10399, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 217, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 1, 2024-09-15T23:05:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 147, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 46606, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 206496, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 5511, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:38.823 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 1, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-15T23:05:38.824 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 119, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 34, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 3861, 2024-09-15T23:05:38.825 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 1041, 2024-09-15T23:05:38.826 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 612 2024-09-15T23:05:38.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.826 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-15T23:05:38.826 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 174224 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-15T23:05:38.827 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 10, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 5, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 46395, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 23198, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 732506, 2024-09-15T23:05:38.828 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 207292939, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 732506, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 732506, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 207292939, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:38.829 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 270646, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 633413503, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 270646, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 633413503, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.830 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:38.831 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 270646, 2024-09-15T23:05:38.832 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 270646, 2024-09-15T23:05:38.832 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 270646, 2024-09-15T23:05:38.832 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 270646, 2024-09-15T23:05:38.832 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 23198, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 3525726, 2024-09-15T23:05:38.833 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 23198, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 398, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 3525726, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:38.834 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x5638364c4960": { 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 174244, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 589873675, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 174244, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 9999, 2024-09-15T23:05:38.835 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 589873675, 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:38.836 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-15T23:05:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:39 smithi184 ceph-mon[35203]: pgmap v640: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 21 op/s 2024-09-15T23:05:39.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:39 smithi184 ceph-mon[35203]: osdmap e120: 12 total, 12 up, 12 in 2024-09-15T23:05:39.491 INFO:tasks.check_counter:Daemon mds.i mds.exported=245 2024-09-15T23:05:39.491 INFO:tasks.check_counter:Daemon mds.i mds.imported=222 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=6204 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=5119 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:39.492 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=147 2024-09-15T23:05:39.492 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T23:05:39.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T23:05:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:39 smithi087 ceph-mon[35290]: pgmap v640: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 21 op/s 2024-09-15T23:05:39.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:39 smithi087 ceph-mon[35290]: osdmap e120: 12 total, 12 up, 12 in 2024-09-15T23:05:39.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:39 smithi066 ceph-mon[31185]: pgmap v640: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 21 op/s 2024-09-15T23:05:39.698 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:39 smithi066 ceph-mon[31185]: osdmap e120: 12 total, 12 up, 12 in 2024-09-15T23:05:39.771 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1005, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 947, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 56664375, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 407626, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 7, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-09-15T23:05:40.272 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.140109349, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.039203992, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.102782975, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.012859651, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 946, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.040633944, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000042953 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 1995712, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 237808 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1070, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1352, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 84430805, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 989941, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 8, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.145991025, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.032786471, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.068989306, 2024-09-15T23:05:40.274 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.033221949, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1350, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.069667889, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000051605 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 651584 2024-09-15T23:05:40.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 2569, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2571, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 51105541, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 817000, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.262416374, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.062683762, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.095701589, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.084754119, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2569, 2024-09-15T23:05:40.276 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.121611467, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000047338 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-09-15T23:05:40.277 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6947, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.202347931, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000029127 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.278 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.279 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-09-15T23:05:40.280 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 38550, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 907, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 37643, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 37253, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 1, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:05:40.281 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-09-15T23:05:40.282 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:05:40.283 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:05:40.284 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-09-15T23:05:40.285 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 65399, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-09-15T23:05:40.286 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 92, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 7, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 193202438, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 193196566, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 65399 2024-09-15T23:05:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 14270, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 33607, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 19337, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 464, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 910, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 446, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 38550, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 53417, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 14867, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-09-15T23:05:40.288 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 140520, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215328 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.289 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.290 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-09-15T23:05:40.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-09-15T23:05:40.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.294 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.296 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-09-15T23:05:40.297 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.298 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.299 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-09-15T23:05:40.300 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-09-15T23:05:40.301 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 2607, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:05:40.302 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-09-15T23:05:40.303 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-09-15T23:05:40.304 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 766563, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 14520, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:05:40.305 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 10216, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 216, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 61427168, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 623955, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.306 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 4167, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 4167, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4167, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 30.214391142, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.007250873 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-09-15T23:05:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4167, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4168 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 4167, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 4167, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 2557, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1608, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-09-15T23:05:40.308 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:05:40.309 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-09-15T23:05:40.310 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 120, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 35, 2024-09-15T23:05:40.311 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 10, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 10, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-09-15T23:05:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:05:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 4640, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 191756181, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 4640, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 4640, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 191756181, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.314 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 4167, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 189033551, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 4167, 2024-09-15T23:05:40.315 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 189033551, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:40.316 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 4167, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 4167, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 4167, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 4167, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.317 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:40.318 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.319 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55865c6b8b40": { 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-09-15T23:05:40.320 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-09-15T23:05:40.321 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-15T23:05:41.078 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-15T23:05:41.078 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-15T23:05:41.078 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-15T23:05:41.079 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-15T23:05:41.079 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-15T23:05:41.079 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:05:41.079 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:05:41.079 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-15T23:05:41.079 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T23:05:41.090 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T23:05:41.090 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T23:05:41.090 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:05:41.130 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-15T23:05:41.130 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:05:41.193 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:05:41.590 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:41.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:41 smithi087 ceph-mon[35290]: pgmap v642: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-15T23:05:41.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:41 smithi184 ceph-mon[35203]: pgmap v642: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-15T23:05:41.700 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:41 smithi066 ceph-mon[31185]: pgmap v642: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 11 op/s 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 -- 172.21.15.66:0/93090548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 msgr2=0x7f7f58105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/93090548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f58105920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009860 tx=0x7f7f4c02a3b0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 -- 172.21.15.66:0/93090548 shutdown_connections 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/93090548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58105f40 0x7f7f581063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/93090548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f58105920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/93090548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58100b30 0x7f7f58100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 -- 172.21.15.66:0/93090548 >> 172.21.15.66:0/93090548 conn(0x7f7f580fc7a0 msgr2=0x7f7f580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 -- 172.21.15.66:0/93090548 shutdown_connections 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.137+0000 7f7f5d8af640 1 -- 172.21.15.66:0/93090548 wait complete. 2024-09-15T23:05:42.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.138+0000 7f7f5d8af640 1 Processor -- start 2024-09-15T23:05:42.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 -- start start 2024-09-15T23:05:42.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:42.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f581a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:42.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58105f40 0x7f7f5819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:42.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58118560 con 0x7f7f58105f40 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7f581183e0 con 0x7f7f58100b30 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f5d8af640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f581186e0 con 0x7f7f58101450 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f56ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f56ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.66:38320/0 (socket says 172.21.15.66:38320) 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.139+0000 7f7f56ffd640 1 -- 172.21.15.66:0/1582320930 learned_addr learned my addr 172.21.15.66:0/1582320930 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f567fc640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f581a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f577fe640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58105f40 0x7f7f5819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f56ffd640 1 -- 172.21.15.66:0/1582320930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 msgr2=0x7f7f581a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f56ffd640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f581a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f56ffd640 1 -- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58105f40 msgr2=0x7f7f5819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f56ffd640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58105f40 0x7f7f5819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f56ffd640 1 -- 172.21.15.66:0/1582320930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5819ef90 con 0x7f7f58100b30 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.140+0000 7f7f567fc640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f581a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:05:42.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f56ffd640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800e9c0 tx=0x7f7f4800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:42.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800cde0 con 0x7f7f58100b30 2024-09-15T23:05:42.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f480035f0 con 0x7f7f58100b30 2024-09-15T23:05:42.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48010690 con 0x7f7f58100b30 2024-09-15T23:05:42.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5819f280 con 0x7f7f58100b30 2024-09-15T23:05:42.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.141+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f581ab570 con 0x7f7f58100b30 2024-09-15T23:05:42.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.143+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f58105920 con 0x7f7f58100b30 2024-09-15T23:05:42.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.144+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f7f480037a0 con 0x7f7f58100b30 2024-09-15T23:05:42.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.145+0000 7f7f5c8ad640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 0x7f7f400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:42.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.146+0000 7f7f567fc640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 0x7f7f400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:42.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.146+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9747+0+0 (secure 0 0 0) 0x7f7f480d0470 con 0x7f7f58100b30 2024-09-15T23:05:42.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.146+0000 7f7f567fc640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 0x7f7f400a58f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c02a9a0 tx=0x7f7f4c0058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:42.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.150+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f4809c980 con 0x7f7f58100b30 2024-09-15T23:05:42.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.434+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7f581ab8e0 con 0x7f7f58100b30 2024-09-15T23:05:42.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.435+0000 7f7f5c8ad640 1 -- 172.21.15.66:0/1582320930 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v120) ==== 81+0+946 (secure 0 0 0) 0x7f7f4809c280 con 0x7f7f58100b30 2024-09-15T23:05:42.436 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3471066820 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.436 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T23:05:42.436 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/4191727117 2024-09-16T22:35:35.887512+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2189919935 2024-09-16T22:35:35.887512+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1680944887 2024-09-16T22:36:00.281528+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2430511108 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3357213114 2024-09-16T22:35:35.887512+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3360541639 2024-09-16T22:35:35.887512+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3162528820 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1250063396 2024-09-16T22:36:00.281528+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1307325821 2024-09-16T22:36:00.281528+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1080608797 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/4222885037 2024-09-16T22:36:00.281528+0000 2024-09-15T23:05:42.437 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3964165811 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.438 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1080608797 2024-09-16T22:45:21.507897+0000 2024-09-15T23:05:42.438 INFO:teuthology.orchestra.run.smithi066.stderr:listed 16 entries 2024-09-15T23:05:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.438+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 msgr2=0x7f7f400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.438+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 0x7f7f400a58f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c02a9a0 tx=0x7f7f4c0058d0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.438+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 msgr2=0x7f7f581a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.438+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800e9c0 tx=0x7f7f4800ee80 comp rx=0 tx=0).stop 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 shutdown_connections 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f7f400a3430 0x7f7f400a58f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f58105f40 0x7f7f5819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f58101450 0x7f7f581a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 --2- 172.21.15.66:0/1582320930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f58100b30 0x7f7f581a46a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 >> 172.21.15.66:0/1582320930 conn(0x7f7f580fc7a0 msgr2=0x7f7f581038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.439+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 shutdown_connections 2024-09-15T23:05:42.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:42.440+0000 7f7f5d8af640 1 -- 172.21.15.66:0/1582320930 wait complete. 2024-09-15T23:05:43.218 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:05:43.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:05:43.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:05:43.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T23:05:43.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:05:43.378 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:05:43.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:05:43.430 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-15T23:05:43.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:43 smithi066 ceph-mon[31185]: pgmap v643: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-15T23:05:43.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:43 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1582320930' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:05:43.504 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:05:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:05:43.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:05:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:43 smithi087 ceph-mon[35290]: pgmap v643: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-15T23:05:43.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:43 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1582320930' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:05:43.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:05:43.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-15T23:05:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:43 smithi184 ceph-mon[35203]: pgmap v643: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-15T23:05:43.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:43 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1582320930' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:05:43.699 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T23:05:43.916 INFO:tasks.cephadm:Teardown begin 2024-09-15T23:05:43.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:05:43.916 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:05:44.340 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:45 smithi066 ceph-mon[31185]: pgmap v644: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 307 B/s wr, 11 op/s 2024-09-15T23:05:45.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:45 smithi066 ceph-mon[31185]: osdmap e121: 12 total, 12 up, 12 in 2024-09-15T23:05:45.473 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:45 smithi184 ceph-mon[35203]: pgmap v644: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 307 B/s wr, 11 op/s 2024-09-15T23:05:45.473 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:45 smithi184 ceph-mon[35203]: osdmap e121: 12 total, 12 up, 12 in 2024-09-15T23:05:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:45 smithi087 ceph-mon[35290]: pgmap v644: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 307 B/s wr, 11 op/s 2024-09-15T23:05:45.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:45 smithi087 ceph-mon[35290]: osdmap e121: 12 total, 12 up, 12 in 2024-09-15T23:05:45.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.916+0000 7ff009930640 1 -- 172.21.15.66:0/3929703186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004101de0 msgr2=0x7ff0041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:45.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.916+0000 7ff009930640 1 --2- 172.21.15.66:0/3929703186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004101de0 0x7ff0041021c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7feff4009900 tx=0x7feff402a410 comp rx=0 tx=0).stop 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 -- 172.21.15.66:0/3929703186 shutdown_connections 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 --2- 172.21.15.66:0/3929703186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004106f10 0x7ff00410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 --2- 172.21.15.66:0/3929703186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004102790 0x7ff0041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 --2- 172.21.15.66:0/3929703186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004101de0 0x7ff0041021c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 -- 172.21.15.66:0/3929703186 >> 172.21.15.66:0/3929703186 conn(0x7ff0040fd8c0 msgr2=0x7ff0040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 -- 172.21.15.66:0/3929703186 shutdown_connections 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 -- 172.21.15.66:0/3929703186 wait complete. 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 Processor -- start 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.917+0000 7ff009930640 1 -- start start 2024-09-15T23:05:45.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 0x7ff004198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004106f10 0x7ff00419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff004111f30 con 0x7ff004102790 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff004111db0 con 0x7ff004101de0 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff009930640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041120b0 con 0x7ff004106f10 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50898/0 (socket says 172.21.15.66:50898) 2024-09-15T23:05:45.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff002ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 0x7ff004198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 -- 172.21.15.66:0/1501394589 learned_addr learned my addr 172.21.15.66:0/1501394589 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0037fe640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004106f10 0x7ff00419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 -- 172.21.15.66:0/1501394589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004106f10 msgr2=0x7ff00419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004106f10 0x7ff00419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 -- 172.21.15.66:0/1501394589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 msgr2=0x7ff004198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 0x7ff004198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 -- 172.21.15.66:0/1501394589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00419d4c0 con 0x7ff004102790 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff002ffd640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 0x7ff004198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.918+0000 7ff0027fc640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7feff800d950 tx=0x7feff800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.919+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8017070 con 0x7ff004102790 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.919+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feff8009c30 con 0x7ff004102790 2024-09-15T23:05:45.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.919+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00419d7b0 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.919+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff800f6b0 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.919+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0041a5090 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.920+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0041021c0 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.921+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7feff80109d0 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.922+0000 7ff00892e640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 0x7fefec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.922+0000 7ff002ffd640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 0x7fefec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.922+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9731+0+0 (secure 0 0 0) 0x7feff80cfdc0 con 0x7ff004102790 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.922+0000 7ff002ffd640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 0x7fefec0a5870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feff4009230 tx=0x7feff40058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:45.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:45.926+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feff8009de0 con 0x7ff004102790 2024-09-15T23:05:46.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.142+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff00410a120 con 0x7ff004102790 2024-09-15T23:05:46.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.143+0000 7ff00892e640 1 -- 172.21.15.66:0/1501394589 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+12005 (secure 0 0 0) 0x7feff809bc90 con 0x7ff004102790 2024-09-15T23:05:46.144 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:05:46.145 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"btime":"2024-09-15T23:04:42:485338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":74,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:41.510710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:05:46.145 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 74 2024-09-15T23:05:46.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 msgr2=0x7fefec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:46.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 0x7fefec0a5870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feff4009230 tx=0x7feff40058d0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 msgr2=0x7ff004198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7feff800d950 tx=0x7feff800de10 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 shutdown_connections 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fefec0a33b0 0x7fefec0a5870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff004106f10 0x7ff00419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff004102790 0x7ff004198a50 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 --2- 172.21.15.66:0/1501394589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff004101de0 0x7ff004198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.145+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 >> 172.21.15.66:0/1501394589 conn(0x7ff0040fd8c0 msgr2=0x7ff0040fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.146+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 shutdown_connections 2024-09-15T23:05:46.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:46.146+0000 7ff009930640 1 -- 172.21.15.66:0/1501394589 wait complete. 2024-09-15T23:05:46.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:46 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1501394589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:46.483 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:46 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1501394589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:46.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:46 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1501394589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:46.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:05:47.115 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:47.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:47 smithi066 ceph-mon[31185]: pgmap v646: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-15T23:05:47.500 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:47 smithi087 ceph-mon[35290]: pgmap v646: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-15T23:05:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 -- 172.21.15.66:0/3318273057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f277010c2f0 msgr2=0x7f277010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 --2- 172.21.15.66:0/3318273057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f277010c2f0 0x7f277010e790 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2768009900 tx=0x7f276802a410 comp rx=0 tx=0).stop 2024-09-15T23:05:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 -- 172.21.15.66:0/3318273057 shutdown_connections 2024-09-15T23:05:47.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 --2- 172.21.15.66:0/3318273057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f277010c2f0 0x7f277010e790 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 --2- 172.21.15.66:0/3318273057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27701037a0 0x7f277010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 --2- 172.21.15.66:0/3318273057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 0x7f27701031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 -- 172.21.15.66:0/3318273057 >> 172.21.15.66:0/3318273057 conn(0x7f27700fc7d0 msgr2=0x7f27700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 -- 172.21.15.66:0/3318273057 shutdown_connections 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.573+0000 7f2775e79640 1 -- 172.21.15.66:0/3318273057 wait complete. 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 Processor -- start 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 -- start start 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 0x7f2770198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f277010c2f0 0x7f277019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f27701120f0 con 0x7f27701037a0 2024-09-15T23:05:47.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2770111f70 con 0x7f2770102df0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f2775e79640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2770112270 con 0x7f277010c2f0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f276effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f276effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50922/0 (socket says 172.21.15.66:50922) 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f276effd640 1 -- 172.21.15.66:0/2359583931 learned_addr learned my addr 172.21.15.66:0/2359583931 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f276f7fe640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 0x7f2770198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.574+0000 7f276ffff640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f277010c2f0 0x7f277019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 -- 172.21.15.66:0/2359583931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f277010c2f0 msgr2=0x7f277019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f277010c2f0 0x7f277019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 -- 172.21.15.66:0/2359583931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 msgr2=0x7f2770198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 0x7f2770198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 -- 172.21.15.66:0/2359583931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277019d5b0 con 0x7f27701037a0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276effd640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f275800d950 tx=0x7f275800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758017070 con 0x7f27701037a0 2024-09-15T23:05:47.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277019d8a0 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2758009c30 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27580047a0 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.575+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27701a5180 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.576+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27701031d0 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.577+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f2758004020 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.578+0000 7f276cff9640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 0x7f275c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.578+0000 7f276f7fe640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 0x7f275c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.578+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9731+0+0 (secure 0 0 0) 0x7f27580d0170 con 0x7f27701037a0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.579+0000 7f276f7fe640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 0x7f275c0a5870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2760005fd0 tx=0x7f2760009760 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:47.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.581+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2758020020 con 0x7f27701037a0 2024-09-15T23:05:47.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:47 smithi184 ceph-mon[35203]: pgmap v646: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 11 op/s 2024-09-15T23:05:47.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.794+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27701072a0 con 0x7f27701037a0 2024-09-15T23:05:47.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.795+0000 7f276cff9640 1 -- 172.21.15.66:0/2359583931 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+12005 (secure 0 0 0) 0x7f275809c690 con 0x7f27701037a0 2024-09-15T23:05:47.796 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:05:47.797 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":74,"btime":"2024-09-15T23:04:42:485338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2455952425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":2455952425},{"type":"v1","addr":"172.21.15.66:6835","nonce":2455952425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3213913697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3213913697},{"type":"v1","addr":"172.21.15.66:6837","nonce":3213913697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":74,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:42:54.256195+0000","modified":"2024-09-15T23:04:41.510710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24461,"mds_1":24442,"mds_2":24437,"mds_3":24427,"mds_4":24421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6839/2023001898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2023001898},{"type":"v1","addr":"172.21.15.66:6839","nonce":2023001898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6841/3123963280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6840","nonce":3123963280},{"type":"v1","addr":"172.21.15.66:6841","nonce":3123963280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/1400845283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1400845283},{"type":"v1","addr":"172.21.15.184:6833","nonce":1400845283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24395":{"gid":24395,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6833/3190263553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3190263553},{"type":"v1","addr":"172.21.15.87:6833","nonce":3190263553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6835/1324797641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1324797641},{"type":"v1","addr":"172.21.15.87:6835","nonce":1324797641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.184:6835/253738152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":253738152},{"type":"v1","addr":"172.21.15.184:6835","nonce":253738152}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.184:6837/2237794156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2237794156},{"type":"v1","addr":"172.21.15.184:6837","nonce":2237794156}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.87:6837/2256594812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2256594812},{"type":"v1","addr":"172.21.15.87:6837","nonce":2256594812}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.184:6839/2085772810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2085772810},{"type":"v1","addr":"172.21.15.184:6839","nonce":2085772810}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.87:6839/426418588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":426418588},{"type":"v1","addr":"172.21.15.87:6839","nonce":426418588}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24461,"qdb_cluster":[24461,24442,24437,24427,24421]},"id":1}]} 2024-09-15T23:05:47.797 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 74 2024-09-15T23:05:47.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 msgr2=0x7f275c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 0x7f275c0a5870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2760005fd0 tx=0x7f2760009760 comp rx=0 tx=0).stop 2024-09-15T23:05:47.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 msgr2=0x7f2770198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f275800d950 tx=0x7f275800de10 comp rx=0 tx=0).stop 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 shutdown_connections 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f275c0a33b0 0x7f275c0a5870 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f277010c2f0 0x7f277019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27701037a0 0x7f2770198b40 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 --2- 172.21.15.66:0/2359583931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2770102df0 0x7f2770198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.797+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 >> 172.21.15.66:0/2359583931 conn(0x7f27700fc7d0 msgr2=0x7f27700fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.798+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 shutdown_connections 2024-09-15T23:05:47.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:47.798+0000 7f2775e79640 1 -- 172.21.15.66:0/2359583931 wait complete. 2024-09-15T23:05:48.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:05:48.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:48 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2359583931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:48.521 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:48 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2359583931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:48.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:48 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2359583931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:05:48.697 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.173+0000 7f18a5acf640 1 -- 172.21.15.66:0/2316599098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0101de0 msgr2=0x7f18a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.173+0000 7f18a5acf640 1 --2- 172.21.15.66:0/2316599098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0101de0 0x7f18a01021c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f189002a410 comp rx=0 tx=0).stop 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.173+0000 7f18a5acf640 1 -- 172.21.15.66:0/2316599098 shutdown_connections 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 --2- 172.21.15.66:0/2316599098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0106f10 0x7f18a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 --2- 172.21.15.66:0/2316599098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 --2- 172.21.15.66:0/2316599098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0101de0 0x7f18a01021c0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 -- 172.21.15.66:0/2316599098 >> 172.21.15.66:0/2316599098 conn(0x7f18a00fd8c0 msgr2=0x7f18a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:49.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 -- 172.21.15.66:0/2316599098 shutdown_connections 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 -- 172.21.15.66:0/2316599098 wait complete. 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 Processor -- start 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.174+0000 7f18a5acf640 1 -- start start 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 0x7f18a0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0111f90 con 0x7f18a0106f10 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0111e10 con 0x7f18a0101de0 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f18a5acf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0112110 con 0x7f18a0102790 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 0x7f18a0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50948/0 (socket says 172.21.15.66:50948) 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189ffff640 1 -- 172.21.15.66:0/1184930163 learned_addr learned my addr 172.21.15.66:0/1184930163 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189effd640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 -- 172.21.15.66:0/1184930163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 msgr2=0x7f18a01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 -- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 msgr2=0x7f18a019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 -- 172.21.15.66:0/1184930163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a019d440 con 0x7f18a0101de0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189effd640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189ffff640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189f7fe640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 0x7f18a0198490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1890005940 tx=0x7f1890004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.175+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189003f030 con 0x7f18a0101de0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.176+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1890003ad0 con 0x7f18a0101de0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.176+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a019d6d0 con 0x7f18a0101de0 2024-09-15T23:05:49.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.176+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890035070 con 0x7f18a0101de0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.176+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a01a5010 con 0x7f18a0101de0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.177+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a01032c0 con 0x7f18a0101de0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.178+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f1890042030 con 0x7f18a0101de0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.178+0000 7f189cff9640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 0x7f18880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.179+0000 7f189effd640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 0x7f18880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.179+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9731+0+0 (secure 0 0 0) 0x7f18900f0ae0 con 0x7f18a0101de0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.179+0000 7f189effd640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 0x7f18880a5870 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f18a00fdd50 tx=0x7f1894008040 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:49.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.182+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18900bcfa0 con 0x7f18a0101de0 2024-09-15T23:05:49.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.366+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18a010a0f0 con 0x7f18a0101de0 2024-09-15T23:05:49.368 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:49 smithi066 ceph-mon[31185]: pgmap v647: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2024-09-15T23:05:49.368 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:49 smithi066 ceph-mon[31185]: osdmap e122: 12 total, 12 up, 12 in 2024-09-15T23:05:49.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.368+0000 7f189cff9640 1 -- 172.21.15.66:0/1184930163 <== mon.2 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+25696 (secure 0 0 0) 0x7f18900bc8a0 con 0x7f18a0101de0 2024-09-15T23:05:49.370 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-15T23:05:49.370 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":122,"fsid":"7d1c9c1c-73b2-11ef-bceb-c7b262605968","created":"2024-09-15T22:35:13.922077+0000","modified":"2024-09-15T23:05:49.180731+0000","last_up_change":"2024-09-15T22:42:03.282010+0000","last_in_change":"2024-09-15T22:41:39.490621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:38:16.784964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:42:50.396560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:42:52.518865+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:42:59.227216+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ceadf938-3e92-4e02-bf52-56073010f453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6803","nonce":1159962456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6805","nonce":1159962456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6809","nonce":1159962456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1159962456},{"type":"v1","addr":"172.21.15.66:6807","nonce":1159962456}]},"public_addr":"172.21.15.66:6803/1159962456","cluster_addr":"172.21.15.66:6805/1159962456","heartbeat_back_addr":"172.21.15.66:6809/1159962456","heartbeat_front_addr":"172.21.15.66:6807/1159962456","state":["exists","up"]},{"osd":1,"uuid":"c0556bc3-9d56-4289-b5c7-e121a7c3bcc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6801","nonce":2341073129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6803","nonce":2341073129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6807","nonce":2341073129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2341073129},{"type":"v1","addr":"172.21.15.87:6805","nonce":2341073129}]},"public_addr":"172.21.15.87:6801/2341073129","cluster_addr":"172.21.15.87:6803/2341073129","heartbeat_back_addr":"172.21.15.87:6807/2341073129","heartbeat_front_addr":"172.21.15.87:6805/2341073129","state":["exists","up"]},{"osd":2,"uuid":"30d6d931-c774-4f28-b5d8-a727dff41a5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6801","nonce":3684058507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6803","nonce":3684058507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6807","nonce":3684058507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3684058507},{"type":"v1","addr":"172.21.15.184:6805","nonce":3684058507}]},"public_addr":"172.21.15.184:6801/3684058507","cluster_addr":"172.21.15.184:6803/3684058507","heartbeat_back_addr":"172.21.15.184:6807/3684058507","heartbeat_front_addr":"172.21.15.184:6805/3684058507","state":["exists","up"]},{"osd":3,"uuid":"859cfec4-c8ab-405c-85a5-27dd929dfed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6811","nonce":2160125809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6813","nonce":2160125809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6817","nonce":2160125809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":2160125809},{"type":"v1","addr":"172.21.15.66:6815","nonce":2160125809}]},"public_addr":"172.21.15.66:6811/2160125809","cluster_addr":"172.21.15.66:6813/2160125809","heartbeat_back_addr":"172.21.15.66:6817/2160125809","heartbeat_front_addr":"172.21.15.66:6815/2160125809","state":["exists","up"]},{"osd":4,"uuid":"ac9282dd-6aa5-4a6f-923c-0d33cd51247b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6809","nonce":58379283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6811","nonce":58379283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6815","nonce":58379283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":58379283},{"type":"v1","addr":"172.21.15.87:6813","nonce":58379283}]},"public_addr":"172.21.15.87:6809/58379283","cluster_addr":"172.21.15.87:6811/58379283","heartbeat_back_addr":"172.21.15.87:6815/58379283","heartbeat_front_addr":"172.21.15.87:6813/58379283","state":["exists","up"]},{"osd":5,"uuid":"d89019ce-9967-40f3-9e23-c8f6a843d797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6809","nonce":1677940591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6811","nonce":1677940591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6815","nonce":1677940591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1677940591},{"type":"v1","addr":"172.21.15.184:6813","nonce":1677940591}]},"public_addr":"172.21.15.184:6809/1677940591","cluster_addr":"172.21.15.184:6811/1677940591","heartbeat_back_addr":"172.21.15.184:6815/1677940591","heartbeat_front_addr":"172.21.15.184:6813/1677940591","state":["exists","up"]},{"osd":6,"uuid":"acfbea05-26e8-46d7-a898-765aac29e742","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6819","nonce":1408845651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6821","nonce":1408845651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6825","nonce":1408845651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1408845651},{"type":"v1","addr":"172.21.15.66:6823","nonce":1408845651}]},"public_addr":"172.21.15.66:6819/1408845651","cluster_addr":"172.21.15.66:6821/1408845651","heartbeat_back_addr":"172.21.15.66:6825/1408845651","heartbeat_front_addr":"172.21.15.66:6823/1408845651","state":["exists","up"]},{"osd":7,"uuid":"2f4fb2a8-42c9-4e78-9f1f-1523f9ed93e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6817","nonce":1077446470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6819","nonce":1077446470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6823","nonce":1077446470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1077446470},{"type":"v1","addr":"172.21.15.87:6821","nonce":1077446470}]},"public_addr":"172.21.15.87:6817/1077446470","cluster_addr":"172.21.15.87:6819/1077446470","heartbeat_back_addr":"172.21.15.87:6823/1077446470","heartbeat_front_addr":"172.21.15.87:6821/1077446470","state":["exists","up"]},{"osd":8,"uuid":"bff2b15f-7378-4a0e-9c97-83b9d367c938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6817","nonce":2711654009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6819","nonce":2711654009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6823","nonce":2711654009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2711654009},{"type":"v1","addr":"172.21.15.184:6821","nonce":2711654009}]},"public_addr":"172.21.15.184:6817/2711654009","cluster_addr":"172.21.15.184:6819/2711654009","heartbeat_back_addr":"172.21.15.184:6823/2711654009","heartbeat_front_addr":"172.21.15.184:6821/2711654009","state":["exists","up"]},{"osd":9,"uuid":"1fae9263-8048-49be-aabd-a20fe2ff7153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6827","nonce":655656094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6829","nonce":655656094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6833","nonce":655656094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":655656094},{"type":"v1","addr":"172.21.15.66:6831","nonce":655656094}]},"public_addr":"172.21.15.66:6827/655656094","cluster_addr":"172.21.15.66:6829/655656094","heartbeat_back_addr":"172.21.15.66:6833/655656094","heartbeat_front_addr":"172.21.15.66:6831/655656094","state":["exists","up"]},{"osd":10,"uuid":"bf14352c-0b93-4188-af44-8ad4335c4e3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6825","nonce":1638725655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6827","nonce":1638725655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6831","nonce":1638725655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1638725655},{"type":"v1","addr":"172.21.15.87:6829","nonce":1638725655}]},"public_addr":"172.21.15.87:6825/1638725655","cluster_addr":"172.21.15.87:6827/1638725655","heartbeat_back_addr":"172.21.15.87:6831/1638725655","heartbeat_front_addr":"172.21.15.87:6829/1638725655","state":["exists","up"]},{"osd":11,"uuid":"dac66f9a-0a5d-40ca-85e7-f48d9aaee71a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6825","nonce":848932004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6827","nonce":848932004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6831","nonce":848932004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":848932004},{"type":"v1","addr":"172.21.15.184:6829","nonce":848932004}]},"public_addr":"172.21.15.184:6825/848932004","cluster_addr":"172.21.15.184:6827/848932004","heartbeat_back_addr":"172.21.15.184:6831/848932004","heartbeat_front_addr":"172.21.15.184:6829/848932004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:24.935947+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:37:49.785994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:13.935699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:38:39.376588+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:03.942329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:29.110579+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:39:53.866293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:19.665105+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:40:44.779471+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:10.300270+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:41:36.059030+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:42:01.359416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3471066820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6800/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6801/4191727117":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/2189919935":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/1680944887":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/2430511108":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/3357213114":"2024-09-16T22:35:35.887512+0000","172.21.15.66:0/3360541639":"2024-09-16T22:35:35.887512+0000","172.21.15.66:6800/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3162528820":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1250063396":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/1307325821":"2024-09-16T22:36:00.281528+0000","172.21.15.66:6800/1080608797":"2024-09-16T22:45:21.507897+0000","172.21.15.66:0/4222885037":"2024-09-16T22:36:00.281528+0000","172.21.15.66:0/3964165811":"2024-09-16T22:45:21.507897+0000","172.21.15.66:6801/1080608797":"2024-09-16T22:45:21.507897+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":33,"length":1}]},{"pool":4,"snaps":[{"begin":20,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":33,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":25,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:05:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 msgr2=0x7f18880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 0x7f18880a5870 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f18a00fdd50 tx=0x7f1894008040 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 msgr2=0x7f18a0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 0x7f18a0198490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1890005940 tx=0x7f1890004270 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 shutdown_connections 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f18880a33b0 0x7f18880a5870 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a0106f10 0x7f18a019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18a0102790 0x7f18a01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 --2- 172.21.15.66:0/1184930163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18a0101de0 0x7f18a0198490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 >> 172.21.15.66:0/1184930163 conn(0x7f18a00fd8c0 msgr2=0x7f18a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:49.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 shutdown_connections 2024-09-15T23:05:49.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:49.370+0000 7f18a5acf640 1 -- 172.21.15.66:0/1184930163 wait complete. 2024-09-15T23:05:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:49 smithi087 ceph-mon[35290]: pgmap v647: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2024-09-15T23:05:49.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:49 smithi087 ceph-mon[35290]: osdmap e122: 12 total, 12 up, 12 in 2024-09-15T23:05:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:49 smithi184 ceph-mon[35203]: pgmap v647: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2024-09-15T23:05:49.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:49 smithi184 ceph-mon[35203]: osdmap e122: 12 total, 12 up, 12 in 2024-09-15T23:05:50.068 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T23:05:50.368 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:50.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:50 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/1184930163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:50.599 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:50 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/1184930163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:50.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:50 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/1184930163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:05:50.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 -- 172.21.15.66:0/3400984629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9880102d40 msgr2=0x7f9880103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 --2- 172.21.15.66:0/3400984629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9880102d40 0x7f9880103120 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9870009900 tx=0x7f987002a4a0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 -- 172.21.15.66:0/3400984629 shutdown_connections 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 --2- 172.21.15.66:0/3400984629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988010c170 0x7f988010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 --2- 172.21.15.66:0/3400984629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880103660 0x7f988010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 --2- 172.21.15.66:0/3400984629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9880102d40 0x7f9880103120 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 -- 172.21.15.66:0/3400984629 >> 172.21.15.66:0/3400984629 conn(0x7f98800fc7a0 msgr2=0x7f98800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 -- 172.21.15.66:0/3400984629 shutdown_connections 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.843+0000 7f9884875640 1 -- 172.21.15.66:0/3400984629 wait complete. 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 Processor -- start 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 -- start start 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880102d40 0x7f9880198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9880103660 0x7f98801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9880111fd0 con 0x7f988010c170 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9880111e50 con 0x7f9880102d40 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.844+0000 7f9884875640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9880112150 con 0x7f9880103660 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50960/0 (socket says 172.21.15.66:50960) 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 -- 172.21.15.66:0/2858425223 learned_addr learned my addr 172.21.15.66:0/2858425223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987e59c640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880102d40 0x7f9880198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987dd9b640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9880103660 0x7f98801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 -- 172.21.15.66:0/2858425223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9880103660 msgr2=0x7f98801989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9880103660 0x7f98801989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 -- 172.21.15.66:0/2858425223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880102d40 msgr2=0x7f9880198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880102d40 0x7f9880198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 -- 172.21.15.66:0/2858425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988019d440 con 0x7f988010c170 2024-09-15T23:05:50.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f987ed9d640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f987800b990 tx=0x7f987800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878019070 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f987800cba0 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988019d730 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878007650 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.845+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98801a5010 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.846+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9880103120 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.847+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f987801c070 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.848+0000 7f986f7fe640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 0x7f98680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.848+0000 7f987e59c640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 0x7f98680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.849+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9715+0+0 (secure 0 0 0) 0x7f98780cf750 con 0x7f988010c170 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.849+0000 7f987e59c640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 0x7f98680a5870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9870005940 tx=0x7f98700058b0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:50.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:50.853+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f987809bd90 con 0x7f988010c170 2024-09-15T23:05:51.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.069+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9880107270 con 0x7f988010c170 2024-09-15T23:05:51.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.073+0000 7f986f7fe640 1 -- 172.21.15.66:0/2858425223 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f987809b690 con 0x7f988010c170 2024-09-15T23:05:51.074 INFO:teuthology.orchestra.run.smithi066.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:05:51.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.075+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 msgr2=0x7f98680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:51.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.075+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 0x7f98680a5870 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9870005940 tx=0x7f98700058b0 comp rx=0 tx=0).stop 2024-09-15T23:05:51.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.075+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 msgr2=0x7f988019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:51.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.075+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f987800b990 tx=0x7f987800be50 comp rx=0 tx=0).stop 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 shutdown_connections 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f98680a33b0 0x7f98680a5870 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988010c170 0x7f988019cd60 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9880103660 0x7f98801989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 --2- 172.21.15.66:0/2858425223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9880102d40 0x7f9880198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 >> 172.21.15.66:0/2858425223 conn(0x7f98800fc7a0 msgr2=0x7f98800fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 shutdown_connections 2024-09-15T23:05:51.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:51.076+0000 7f9884875640 1 -- 172.21.15.66:0/2858425223 wait complete. 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a[31181]: 2024-09-15T23:05:51.070+0000 7fc356cfd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: pgmap v649: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:05:51.434 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: osdmap e123: 12 total, 12 up, 12 in 2024-09-15T23:05:51.435 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mon[31185]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T23:05:51.600 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.600 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.600 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mds[64871]: -- 172.21.15.87:0/317190959 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e181191860 con 0x55e18116e800 2024-09-15T23:05:51.600 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mds[65176]: -- 172.21.15.87:0/2181187980 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624448db860 con 0x5624448b9400 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: starting mds.h at 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: pgmap v649: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:05:51.601 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: osdmap e123: 12 total, 12 up, 12 in 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mon[35290]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mds[64560]: -- 172.21.15.87:0/2279974880 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56547cb0f860 con 0x56547caed000 2024-09-15T23:05:51.602 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: starting mds.k at 2024-09-15T23:05:51.603 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.603 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.603 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-mds[65477]: -- 172.21.15.87:0/1871104082 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56409e1a1860 con 0x56409e17f400 2024-09-15T23:05:51.603 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:05:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: starting mds.b at 2024-09-15T23:05:51.673 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.673 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.673 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: starting mds.c at 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: pgmap v649: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2858425223' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: osdmap e123: 12 total, 12 up, 12 in 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mon[35203]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.674 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mds[65227]: -- 172.21.15.184:0/1193258083 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f796af7860 con 0x55f796ad5000 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: starting mds.i at 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mds[64327]: -- 172.21.15.184:0/2592243051 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56281ce3b860 con 0x56281ce18800 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: starting mds.l at 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.675 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.676 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-mds[64626]: -- 172.21.15.184:0/2395234348 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556bfc55860 con 0x5556bfc32800 2024-09-15T23:05:51.676 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:05:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: starting mds.f at 2024-09-15T23:05:51.698 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mds[72326]: -- 172.21.15.66:0/2083366716 <== mon.2 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617c5265860 con 0x5617c5243000 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: starting mds.a at 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-mds[71953]: -- 172.21.15.66:0/2644059931 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555dbde81860 con 0x555dbde5f000 2024-09-15T23:05:51.699 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:05:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: starting mds.g at 2024-09-15T23:05:52.168 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:05:52.432 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 -- 172.21.15.66:0/3514965334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c10c170 msgr2=0x7f548c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 --2- 172.21.15.66:0/3514965334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c10c170 0x7f548c10e610 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f5484009ca0 tx=0x7f548402a950 comp rx=0 tx=0).stop 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 -- 172.21.15.66:0/3514965334 shutdown_connections 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 --2- 172.21.15.66:0/3514965334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c10c170 0x7f548c10e610 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 --2- 172.21.15.66:0/3514965334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c103660 0x7f548c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 --2- 172.21.15.66:0/3514965334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c102d40 0x7f548c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.912+0000 7f5490942640 1 -- 172.21.15.66:0/3514965334 >> 172.21.15.66:0/3514965334 conn(0x7f548c0fc7a0 msgr2=0x7f548c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.913+0000 7f5490942640 1 -- 172.21.15.66:0/3514965334 shutdown_connections 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.913+0000 7f5490942640 1 -- 172.21.15.66:0/3514965334 wait complete. 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.913+0000 7f5490942640 1 Processor -- start 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.913+0000 7f5490942640 1 -- start start 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.913+0000 7f5490942640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c102d40 0x7f548c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c10c170 0x7f548c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f548c111fb0 con 0x7f548c103660 2024-09-15T23:05:52.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f548c111e30 con 0x7f548c102d40 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f548c112130 con 0x7f548c10c170 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f548a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c102d40 0x7f548c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50068/0 (socket says 172.21.15.66:50068) 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 -- 172.21.15.66:0/3002438244 learned_addr learned my addr 172.21.15.66:0/3002438244 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f548ad9d640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c10c170 0x7f548c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 -- 172.21.15.66:0/3002438244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c10c170 msgr2=0x7f548c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c10c170 0x7f548c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 -- 172.21.15.66:0/3002438244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c102d40 msgr2=0x7f548c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c102d40 0x7f548c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 -- 172.21.15.66:0/3002438244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c19d380 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5483fff640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f547400c970 tx=0x7f547400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474007bb0 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5474007d50 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c19d670 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.914+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474018730 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.915+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c1a4f50 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.915+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c103120 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.917+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f547400f450 con 0x7f548c103660 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.917+0000 7f54837fe640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 0x7f54780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.918+0000 7f548a59c640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 0x7f54780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.918+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 10117+0+0 (secure 0 0 0) 0x7f54740d03a0 con 0x7f548c103660 2024-09-15T23:05:52.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.918+0000 7f548a59c640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 0x7f54780a5870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f547c009990 tx=0x7f547c009110 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:52.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:52.922+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5474014030 con 0x7f548c103660 2024-09-15T23:05:53.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:53.132+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f548c1a5240 con 0x7f548c103660 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: pgmap v651: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6832/473536698,v1:172.21.15.87:6833/473536698] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6835/3019301964,v1:172.21.15.87:6839/3019301964] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6836/1851564178,v1:172.21.15.87:6838/1851564178] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.87:6834/2564250238,v1:172.21.15.87:6837/2564250238] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6832/1497004674,v1:172.21.15.184:6834/1497004674] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6833/4247304866,v1:172.21.15.184:6835/4247304866] up:boot 2024-09-15T23:05:53.134 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6836/3155627794,v1:172.21.15.184:6837/3155627794] up:boot 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.184:6838/1506659909,v1:172.21.15.184:6839/1506659909] up:boot 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6838/3243084931,v1:172.21.15.66:6840/3243084931] up:boot 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: mds.? [v2:172.21.15.66:6839/2919522182,v1:172.21.15.66:6841/2919522182] up:boot 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:05:53.135 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:53 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:05:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: pgmap v651: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T23:05:53.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6832/473536698,v1:172.21.15.87:6833/473536698] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6835/3019301964,v1:172.21.15.87:6839/3019301964] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6836/1851564178,v1:172.21.15.87:6838/1851564178] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.87:6834/2564250238,v1:172.21.15.87:6837/2564250238] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6832/1497004674,v1:172.21.15.184:6834/1497004674] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6833/4247304866,v1:172.21.15.184:6835/4247304866] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6836/3155627794,v1:172.21.15.184:6837/3155627794] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.184:6838/1506659909,v1:172.21.15.184:6839/1506659909] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6838/3243084931,v1:172.21.15.66:6840/3243084931] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: mds.? [v2:172.21.15.66:6839/2919522182,v1:172.21.15.66:6841/2919522182] up:boot 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:05:53.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:05:53.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:53 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:05:53.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: pgmap v651: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6832/473536698,v1:172.21.15.87:6833/473536698] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6835/3019301964,v1:172.21.15.87:6839/3019301964] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6836/1851564178,v1:172.21.15.87:6838/1851564178] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.87:6834/2564250238,v1:172.21.15.87:6837/2564250238] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6832/1497004674,v1:172.21.15.184:6834/1497004674] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6833/4247304866,v1:172.21.15.184:6835/4247304866] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6836/3155627794,v1:172.21.15.184:6837/3155627794] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.184:6838/1506659909,v1:172.21.15.184:6839/1506659909] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6838/3243084931,v1:172.21.15.66:6840/3243084931] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: mds.? [v2:172.21.15.66:6839/2919522182,v1:172.21.15.66:6841/2919522182] up:boot 2024-09-15T23:05:53.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:05:53.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:53 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:05:54.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.083+0000 7f54837fe640 1 -- 172.21.15.66:0/3002438244 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f547409c6e0 con 0x7f548c103660 2024-09-15T23:05:54.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 msgr2=0x7f54780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:54.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 0x7f54780a5870 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f547c009990 tx=0x7f547c009110 comp rx=0 tx=0).stop 2024-09-15T23:05:54.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 msgr2=0x7f548c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:54.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f547400c970 tx=0x7f547400cd70 comp rx=0 tx=0).stop 2024-09-15T23:05:54.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 shutdown_connections 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f54780a33b0 0x7f54780a5870 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f548c10c170 0x7f548c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f548c103660 0x7f548c198910 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 --2- 172.21.15.66:0/3002438244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f548c102d40 0x7f548c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 >> 172.21.15.66:0/3002438244 conn(0x7f548c0fc7a0 msgr2=0x7f548c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:54.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.086+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 shutdown_connections 2024-09-15T23:05:54.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:54.087+0000 7f5490942640 1 -- 172.21.15.66:0/3002438244 wait complete. 2024-09-15T23:05:54.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:54 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:05:54.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:54 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:05:54.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:54 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:05:54.796 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:05:55.065 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:55.339 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: pgmap v652: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T23:05:55.339 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:05:55.339 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:05:55.339 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: Cluster is now healthy 2024-09-15T23:05:55.340 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:05:55.340 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: fsmap 12 up:standby 2024-09-15T23:05:55.340 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:55 smithi066 ceph-mon[31185]: osdmap e124: 12 total, 12 up, 12 in 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: pgmap v652: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: Cluster is now healthy 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: fsmap 12 up:standby 2024-09-15T23:05:55.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:55 smithi087 ceph-mon[35290]: osdmap e124: 12 total, 12 up, 12 in 2024-09-15T23:05:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: pgmap v652: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-15T23:05:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:05:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:05:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: Cluster is now healthy 2024-09-15T23:05:55.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/3002438244' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:05:55.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: fsmap 12 up:standby 2024-09-15T23:05:55.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:55 smithi184 ceph-mon[35203]: osdmap e124: 12 total, 12 up, 12 in 2024-09-15T23:05:55.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/1129640813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 msgr2=0x7fc9a8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/1129640813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a8100ee0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc990009930 tx=0x7fc99002a420 comp rx=0 tx=0).stop 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/1129640813 shutdown_connections 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/1129640813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 0x7fc9a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/1129640813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a8100ee0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/1129640813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/1129640813 >> 172.21.15.66:0/1129640813 conn(0x7fc9a80fc7a0 msgr2=0x7fc9a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/1129640813 shutdown_connections 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/1129640813 wait complete. 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.565+0000 7fc9ae0ed640 1 Processor -- start 2024-09-15T23:05:55.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 -- start start 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 0x7fc9a810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8111fa0 con 0x7fc9a8100a80 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8111e20 con 0x7fc9a8106a80 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9ae0ed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8112120 con 0x7fc9a8101420 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50082/0 (socket says 172.21.15.66:50082) 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9a77fe640 1 -- 172.21.15.66:0/2587091404 learned_addr learned my addr 172.21.15.66:0/2587091404 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9a6ffd640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 0x7fc9a810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.566+0000 7fc9a7fff640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 -- 172.21.15.66:0/2587091404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 msgr2=0x7fc9a810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 0x7fc9a810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 -- 172.21.15.66:0/2587091404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 msgr2=0x7fc9a810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 -- 172.21.15.66:0/2587091404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a81a6900 con 0x7fc9a8100a80 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a7fff640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a77fe640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c890 tx=0x7fc99800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998004220 con 0x7fc9a8100a80 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a81a6bf0 con 0x7fc9a8100a80 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9980043c0 con 0x7fc9a8100a80 2024-09-15T23:05:55.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998004a00 con 0x7fc9a8100a80 2024-09-15T23:05:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.567+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81a7150 con 0x7fc9a8100a80 2024-09-15T23:05:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.568+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8100ee0 con 0x7fc9a8100a80 2024-09-15T23:05:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.569+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7fc9980079b0 con 0x7fc9a8100a80 2024-09-15T23:05:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.570+0000 7fc9a4ff9640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 0x7fc9940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.570+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 10117+0+0 (secure 0 0 0) 0x7fc9980cffb0 con 0x7fc9a8100a80 2024-09-15T23:05:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.570+0000 7fc9a6ffd640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 0x7fc9940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.571+0000 7fc9a6ffd640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 0x7fc9940a5870 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc990009900 tx=0x7fc9900058d0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.574+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc998014030 con 0x7fc9a8100a80 2024-09-15T23:05:55.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:55.749+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9a8108ff0 con 0x7fc9a8100a80 2024-09-15T23:05:56.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.085+0000 7fc9a4ff9640 1 -- 172.21.15.66:0/2587091404 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) ==== 181+0+0 (secure 0 0 0) 0x7fc99809c350 con 0x7fc9a8100a80 2024-09-15T23:05:56.087 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:05:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 msgr2=0x7fc9940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 0x7fc9940a5870 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc990009900 tx=0x7fc9900058d0 comp rx=0 tx=0).stop 2024-09-15T23:05:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 msgr2=0x7fc9a810e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c890 tx=0x7fc99800cd50 comp rx=0 tx=0).stop 2024-09-15T23:05:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 shutdown_connections 2024-09-15T23:05:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7fc9940a33b0 0x7fc9940a5870 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8106a80 0x7fc9a810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a8101420 0x7fc9a810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 --2- 172.21.15.66:0/2587091404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9a8100a80 0x7fc9a810e3e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.089+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 >> 172.21.15.66:0/2587091404 conn(0x7fc9a80fc7a0 msgr2=0x7fc9a80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.090+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 shutdown_connections 2024-09-15T23:05:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:56.090+0000 7fc9ae0ed640 1 -- 172.21.15.66:0/2587091404 wait complete. 2024-09-15T23:05:56.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:56 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:56 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:56.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:56 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:56.945 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:05:57.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:57 smithi066 ceph-mon[31185]: pgmap v654: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-15T23:05:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:57 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:57.199 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:57 smithi066 ceph-mon[31185]: osdmap e125: 12 total, 12 up, 12 in 2024-09-15T23:05:57.213 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:57 smithi087 ceph-mon[35290]: pgmap v654: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-15T23:05:57.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:57 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:57.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:57 smithi087 ceph-mon[35290]: osdmap e125: 12 total, 12 up, 12 in 2024-09-15T23:05:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:57 smithi184 ceph-mon[35203]: pgmap v654: 129 pgs: 129 active+clean; 2.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-15T23:05:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:57 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/2587091404' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:57.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:57 smithi184 ceph-mon[35203]: osdmap e125: 12 total, 12 up, 12 in 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 -- 172.21.15.66:0/3897171248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 msgr2=0x7f0e141031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/3897171248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e141031d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009900 tx=0x7f0e0402a410 comp rx=0 tx=0).stop 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 -- 172.21.15.66:0/3897171248 shutdown_connections 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/3897171248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e1410c2f0 0x7f0e1410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/3897171248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e141037a0 0x7f0e1410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/3897171248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e141031d0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 -- 172.21.15.66:0/3897171248 >> 172.21.15.66:0/3897171248 conn(0x7f0e140fc7d0 msgr2=0x7f0e140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:57.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 -- 172.21.15.66:0/3897171248 shutdown_connections 2024-09-15T23:05:57.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 -- 172.21.15.66:0/3897171248 wait complete. 2024-09-15T23:05:57.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.727+0000 7f0e19e0a640 1 Processor -- start 2024-09-15T23:05:57.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 -- start start 2024-09-15T23:05:57.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:57.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 0x7f0e14198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1410c2f0 0x7f0e1419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0e141120f0 con 0x7f0e14102df0 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14111f70 con 0x7f0e1410c2f0 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e19e0a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14112270 con 0x7f0e141037a0 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50104/0 (socket says 172.21.15.66:50104) 2024-09-15T23:05:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 -- 172.21.15.66:0/965116024 learned_addr learned my addr 172.21.15.66:0/965116024 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e13fff640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1410c2f0 0x7f0e1419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e0bfff640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 0x7f0e14198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 -- 172.21.15.66:0/965116024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 msgr2=0x7f0e14198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 0x7f0e14198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 -- 172.21.15.66:0/965116024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1410c2f0 msgr2=0x7f0e1419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1410c2f0 0x7f0e1419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 -- 172.21.15.66:0/965116024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1419d5c0 con 0x7f0e14102df0 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e0bfff640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 0x7f0e14198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:05:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.728+0000 7f0e137fe640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f0e04006010 tx=0x7f0e040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.729+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0403f030 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.729+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e04003ce0 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.729+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1419d850 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.729+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04035070 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.729+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e141a5190 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.730+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e141031d0 con 0x7f0e14102df0 2024-09-15T23:05:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.731+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f0e04042030 con 0x7f0e14102df0 2024-09-15T23:05:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.732+0000 7f0e117fa640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 0x7f0e000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.732+0000 7f0e0bfff640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 0x7f0e000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.732+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9400+0+0 (secure 0 0 0) 0x7f0e040f0620 con 0x7f0e14102df0 2024-09-15T23:05:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.732+0000 7f0e0bfff640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 0x7f0e000a58f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e1410d730 tx=0x7f0dfc00b5f0 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.736+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e040bcd50 con 0x7f0e14102df0 2024-09-15T23:05:57.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:57.934+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0e141072c0 con 0x7f0e14102df0 2024-09-15T23:05:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.091+0000 7f0e117fa640 1 -- 172.21.15.66:0/965116024 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) ==== 169+0+0 (secure 0 0 0) 0x7f0e040bc650 con 0x7f0e14102df0 2024-09-15T23:05:58.092 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data' removed 2024-09-15T23:05:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 msgr2=0x7f0e000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 0x7f0e000a58f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e1410d730 tx=0x7f0dfc00b5f0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 msgr2=0x7f0e14198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f0e04006010 tx=0x7f0e040042f0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 shutdown_connections 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f0e000a3430 0x7f0e000a58f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e1410c2f0 0x7f0e1419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e141037a0 0x7f0e14198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 --2- 172.21.15.66:0/965116024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0e14102df0 0x7f0e14198610 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.095+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 >> 172.21.15.66:0/965116024 conn(0x7f0e140fc7d0 msgr2=0x7f0e140fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.096+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 shutdown_connections 2024-09-15T23:05:58.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:58.096+0000 7f0e19e0a640 1 -- 172.21.15.66:0/965116024 wait complete. 2024-09-15T23:05:58.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:58 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:58.198 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:58 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:58.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:58 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:58.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:58 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:58 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:58.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:58 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:05:58.760 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T23:05:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: pgmap v656: 97 pgs: 97 active+clean; 733 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:05:59.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: osdmap e126: 12 total, 12 up, 12 in 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.351 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:05:59 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.357 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: pgmap v656: 97 pgs: 97 active+clean; 733 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:05:59.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: osdmap e126: 12 total, 12 up, 12 in 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:05:59 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: pgmap v656: 97 pgs: 97 active+clean; 733 MiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/965116024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: osdmap e126: 12 total, 12 up, 12 in 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:05:59.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.451 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:05:59 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 -- 172.21.15.66:0/2284400083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102ef0 msgr2=0x7f013c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 --2- 172.21.15.66:0/2284400083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102ef0 0x7f013c10da40 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0134009ca0 tx=0x7f013402a950 comp rx=0 tx=0).stop 2024-09-15T23:05:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 -- 172.21.15.66:0/2284400083 shutdown_connections 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 --2- 172.21.15.66:0/2284400083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102ef0 0x7f013c10da40 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 --2- 172.21.15.66:0/2284400083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c102570 0x7f013c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 --2- 172.21.15.66:0/2284400083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c100e20 0x7f013c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 -- 172.21.15.66:0/2284400083 >> 172.21.15.66:0/2284400083 conn(0x7f013c0fc7d0 msgr2=0x7f013c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 -- 172.21.15.66:0/2284400083 shutdown_connections 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.840+0000 7f014282c640 1 -- 172.21.15.66:0/2284400083 wait complete. 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 Processor -- start 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 -- start start 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c100e20 0x7f013c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c102ef0 0x7f013c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1120a0 con 0x7f013c102570 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f013c111f20 con 0x7f013c102ef0 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f014282c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f013c112220 con 0x7f013c100e20 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f013b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f013b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50116/0 (socket says 172.21.15.66:50116) 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f013b7fe640 1 -- 172.21.15.66:0/962799377 learned_addr learned my addr 172.21.15.66:0/962799377 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.841+0000 7f013bfff640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c100e20 0x7f013c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f0140dc9640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c102ef0 0x7f013c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 -- 172.21.15.66:0/962799377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c100e20 msgr2=0x7f013c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c100e20 0x7f013c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 -- 172.21.15.66:0/962799377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c102ef0 msgr2=0x7f013c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c102ef0 0x7f013c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 -- 172.21.15.66:0/962799377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c19d430 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f013b7fe640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f013000c890 tx=0x7f013000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130004220 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01300043c0 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c19d720 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300049e0 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.842+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c1a5000 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.843+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c101200 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.844+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 138486+0+0 (secure 0 0 0) 0x7f01300079b0 con 0x7f013c102570 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.845+0000 7f01397fa640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 0x7f01240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.846+0000 7f013bfff640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 0x7f01240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.846+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8754+0+0 (secure 0 0 0) 0x7f01300cfed0 con 0x7f013c102570 2024-09-15T23:05:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.846+0000 7f013bfff640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 0x7f01240a5870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f012c009bd0 tx=0x7f012c005f90 comp rx=0 tx=0).ready entity=mgr.15312 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:05:59.850+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0130014030 con 0x7f013c102570 2024-09-15T23:06:00.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.051+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f013c1997e0 con 0x7f013c102570 2024-09-15T23:06:00.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.099+0000 7f01397fa640 1 -- 172.21.15.66:0/962799377 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v127) ==== 178+0+0 (secure 0 0 0) 0x7f013009c760 con 0x7f013c102570 2024-09-15T23:06:00.100 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'cephfs_data_ec' removed 2024-09-15T23:06:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.102+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 msgr2=0x7f01240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.102+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 0x7f01240a5870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f012c009bd0 tx=0x7f012c005f90 comp rx=0 tx=0).stop 2024-09-15T23:06:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.102+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 msgr2=0x7f013c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:00.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.102+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f013000c890 tx=0x7f013000cd50 comp rx=0 tx=0).stop 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 shutdown_connections 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:6800/1388370487,v1:172.21.15.66:6801/1388370487] conn(0x7f01240a33b0 0x7f01240a5870 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f013c102ef0 0x7f013c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f013c102570 0x7f013c1989c0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 --2- 172.21.15.66:0/962799377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f013c100e20 0x7f013c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:00.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.103+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 >> 172.21.15.66:0/962799377 conn(0x7f013c0fc7d0 msgr2=0x7f013c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:00.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.104+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 shutdown_connections 2024-09-15T23:06:00.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-15T23:06:00.105+0000 7f014282c640 1 -- 172.21.15.66:0/962799377 wait complete. 2024-09-15T23:06:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T23:06:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T23:06:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T23:06:00.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T23:06:00.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:06:00.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:00 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T23:06:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T23:06:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T23:06:00.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T23:06:00.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:06:00.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:00 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.448 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi184 to 176.0M 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi184 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: Unable to set osd_memory_target on smithi087 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:00.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:00.918 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:00.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:01.024 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T23:06:01.025 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:06:01.049 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:06:01.071 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:06:01.089 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T23:06:01.089 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T23:06:01.089 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a 2024-09-15T23:06:01.103 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:06:00.775+0000 7f8532eb1640 -1 client.15360: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:06:00.777+0000 7f8532eb1640 -1 client.15360: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Exception in thread Thread-25: 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: Traceback (most recent call last): 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.run() 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/lib64/python3.9/threading.py", line 1306, in run 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.function(*self.args, **self.kwargs) 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: File "/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py", line 355, in create_scheduled_snapshot 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: self.prune_snapshots(sched) 2024-09-15T23:06:01.104 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: UnboundLocalError: local variable 'sched' referenced before assignment 2024-09-15T23:06:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: pgmap v658: 33 pgs: 33 active+clean; 733 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:06:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:06:01.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: osdmap e127: 12 total, 12 up, 12 in 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:01.350 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:01 smithi087 ceph-mon[35290]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: pgmap v658: 33 pgs: 33 active+clean; 733 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:06:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:06:01.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: osdmap e127: 12 total, 12 up, 12 in 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:01.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:01 smithi184 ceph-mon[35203]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: pgmap v658: 33 pgs: 33 active+clean; 733 MiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='client.? 172.21.15.66:0/962799377' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: osdmap e127: 12 total, 12 up, 12 in 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.449 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 172.21.15.66:0/2121768994' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-mon[31185]: from='mgr.15312 ' entity='mgr.x' 2024-09-15T23:06:01.450 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 systemd[1]: Stopping Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a[31181]: 2024-09-15T23:06:01.589+0000 7fc35c508640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a[31181]: 2024-09-15T23:06:01.589+0000 7fc35c508640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T23:06:01.949 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:01 smithi066 podman[133874]: 2024-09-15 23:06:01.622892922 +0000 UTC m=+0.168735649 container died 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T23:06:02.601 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 podman[133874]: 2024-09-15 23:06:02.37374238 +0000 UTC m=+0.919585110 container cleanup 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T23:06:02.601 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 bash[133874]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a 2024-09-15T23:06:02.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T23:06:02.901 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 podman[133884]: 2024-09-15 23:06:02.600430602 +0000 UTC m=+0.967927784 container remove 9bfafe6850e3543ab4c7ac4068c8e7504774c70a0dfbc23e16e2a42a13f3a554 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:06:02.901 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T23:06:02.901 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 systemd[1]: Stopped Ceph mon.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T23:06:02.901 INFO:journalctl@ceph.mon.a.smithi066.stdout:Sep 15 23:06:02 smithi066 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.a.service: Consumed 31.117s CPU time. 2024-09-15T23:06:02.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:02.931 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T23:06:02.931 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T23:06:02.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.b 2024-09-15T23:06:03.349 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:02 smithi087 systemd[1]: Stopping Ceph mon.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:03.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b[35286]: 2024-09-15T23:06:03.363+0000 7fec29f7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:03.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b[35286]: 2024-09-15T23:06:03.363+0000 7fec29f7a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:06:03.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:03 smithi087 podman[73819]: 2024-09-15 23:06:03.425083009 +0000 UTC m=+0.227933441 container died 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T23:06:04.849 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:04 smithi087 podman[73819]: 2024-09-15 23:06:04.658309479 +0000 UTC m=+1.461159910 container cleanup 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-15T23:06:04.850 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:04 smithi087 bash[73819]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b 2024-09-15T23:06:05.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T23:06:05.159 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:04 smithi087 podman[73831]: 2024-09-15 23:06:04.906789725 +0000 UTC m=+1.482432553 container remove 2f36e97dac4a59eb16356d93411ff6675c80be5e0dd29ed5c9cb8167341880b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-15T23:06:05.159 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:05 smithi087 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-15T23:06:05.159 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:05 smithi087 systemd[1]: Stopped Ceph mon.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T23:06:05.159 INFO:journalctl@ceph.mon.b.smithi087.stdout:Sep 15 23:06:05 smithi087 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.b.service: Consumed 18.037s CPU time. 2024-09-15T23:06:05.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:05.189 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T23:06:05.190 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T23:06:05.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.c 2024-09-15T23:06:05.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:05 smithi184 systemd[1]: Stopping Ceph mon.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:05.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c[35199]: 2024-09-15T23:06:05.578+0000 7f18c6b8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:05.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c[35199]: 2024-09-15T23:06:05.578+0000 7f18c6b8e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:06:05.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:05 smithi184 podman[72992]: 2024-09-15 23:06:05.712125152 +0000 UTC m=+0.265054831 container died c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:06:06.365 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:06 smithi184 podman[72992]: 2024-09-15 23:06:06.121335587 +0000 UTC m=+0.674265265 container cleanup c05aed957d188597d222e8925bd7f980edb98c3cba26088234e341897256406f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T23:06:06.365 INFO:journalctl@ceph.mon.c.smithi184.stdout:Sep 15 23:06:06 smithi184 bash[72992]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mon-c 2024-09-15T23:06:06.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T23:06:06.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:06.628 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T23:06:06.628 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T23:06:06.628 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x 2024-09-15T23:06:06.949 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:06 smithi066 systemd[1]: Stopping Ceph mgr.x for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:07.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:06:07.095+0000 7f85d06d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:07.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x[31410]: 2024-09-15T23:06:07.095+0000 7f85d06d2640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-15T23:06:07.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:07 smithi066 podman[133991]: 2024-09-15 23:06:07.127140791 +0000 UTC m=+0.293134431 container died fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:06:08.448 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:08 smithi066 podman[133991]: 2024-09-15 23:06:08.188577839 +0000 UTC m=+1.354571464 container cleanup fba3a00f4f8909fb71aa8c40adb76495100fc292eb4e1af2c2d01638900a54b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T23:06:08.449 INFO:journalctl@ceph.mgr.x.smithi066.stdout:Sep 15 23:06:08 smithi066 bash[133991]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-x 2024-09-15T23:06:08.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T23:06:08.653 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:08.654 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T23:06:08.654 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T23:06:08.654 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.y 2024-09-15T23:06:09.008 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 23:06:08 smithi087 systemd[1]: Stopping Ceph mgr.y for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:09.312 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 23:06:09 smithi087 podman[73943]: 2024-09-15 23:06:09.00797858 +0000 UTC m=+0.158958675 container died 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T23:06:09.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 23:06:09 smithi087 podman[73943]: 2024-09-15 23:06:09.418987623 +0000 UTC m=+0.569967719 container cleanup 7690ab5b97f0f8df22e8c79ca25acb73248872e61484f6835e6d1731c81f386d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T23:06:09.599 INFO:journalctl@ceph.mgr.y.smithi087.stdout:Sep 15 23:06:09 smithi087 bash[73943]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-y 2024-09-15T23:06:09.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T23:06:09.874 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:09.874 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T23:06:09.874 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T23:06:09.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.z 2024-09-15T23:06:10.172 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 23:06:09 smithi184 systemd[1]: Stopping Ceph mgr.z for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:10.520 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 23:06:10 smithi184 podman[73114]: 2024-09-15 23:06:10.232791594 +0000 UTC m=+0.163033420 container died 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:06:10.896 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 23:06:10 smithi184 podman[73114]: 2024-09-15 23:06:10.627395803 +0000 UTC m=+0.557637630 container cleanup 7114bdee623f454737b8fcd3a3b45ad2f59becd1f387f9d537f1c72909b02bc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-15T23:06:10.896 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Sep 15 23:06:10 smithi184 bash[73114]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mgr-z 2024-09-15T23:06:11.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T23:06:11.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:11.062 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T23:06:11.062 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T23:06:11.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.0 2024-09-15T23:06:11.394 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:11 smithi066 systemd[1]: Stopping Ceph osd.0 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:11.699 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T23:06:11.392+0000 7fdf2a8ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:11.699 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T23:06:11.392+0000 7fdf2a8ec640 -1 osd.0 127 *** Got signal Terminated *** 2024-09-15T23:06:11.699 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0[45280]: 2024-09-15T23:06:11.392+0000 7fdf2a8ec640 -1 osd.0 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:17.227 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:16 smithi066 podman[134112]: 2024-09-15 23:06:16.956354905 +0000 UTC m=+5.685137370 container died 4982a4fdf14fde683a1aa91ea27b89a4b9f3ccc146ed97bc10f109855bfb3b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:17.699 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:17 smithi066 podman[134112]: 2024-09-15 23:06:17.43764948 +0000 UTC m=+6.166431949 container cleanup 4982a4fdf14fde683a1aa91ea27b89a4b9f3ccc146ed97bc10f109855bfb3b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T23:06:17.699 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:17 smithi066 bash[134112]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0 2024-09-15T23:06:18.825 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:18 smithi066 podman[134128]: 2024-09-15 23:06:18.498286183 +0000 UTC m=+1.534756636 container remove 4982a4fdf14fde683a1aa91ea27b89a4b9f3ccc146ed97bc10f109855bfb3b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T23:06:19.111 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:18 smithi066 podman[134223]: 2024-09-15 23:06:18.728140926 +0000 UTC m=+0.016915190 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:19.111 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:18 smithi066 podman[134223]: 2024-09-15 23:06:18.832579603 +0000 UTC m=+0.121353920 container create 8a5ff46e0a18ce34e58f41ed91de19297510f06b117b6def74918fa12d2342c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T23:06:19.111 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:19 smithi066 podman[134223]: 2024-09-15 23:06:19.110180172 +0000 UTC m=+0.398954431 container init 8a5ff46e0a18ce34e58f41ed91de19297510f06b117b6def74918fa12d2342c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T23:06:19.449 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:19 smithi066 podman[134223]: 2024-09-15 23:06:19.11385497 +0000 UTC m=+0.402629222 container start 8a5ff46e0a18ce34e58f41ed91de19297510f06b117b6def74918fa12d2342c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-15T23:06:19.449 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:19 smithi066 podman[134223]: 2024-09-15 23:06:19.193560875 +0000 UTC m=+0.482335145 container attach 8a5ff46e0a18ce34e58f41ed91de19297510f06b117b6def74918fa12d2342c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T23:06:19.881 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 15 23:06:19 smithi066 podman[134223]: 2024-09-15 23:06:19.523042565 +0000 UTC m=+0.811816817 container died 8a5ff46e0a18ce34e58f41ed91de19297510f06b117b6def74918fa12d2342c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:20.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T23:06:20.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:20.361 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T23:06:20.361 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T23:06:20.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.1 2024-09-15T23:06:20.692 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:20 smithi087 systemd[1]: Stopping Ceph osd.1 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:21.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T23:06:20.690+0000 7f3cfe6f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:21.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T23:06:20.690+0000 7f3cfe6f9640 -1 osd.1 127 *** Got signal Terminated *** 2024-09-15T23:06:21.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1[39756]: 2024-09-15T23:06:20.690+0000 7f3cfe6f9640 -1 osd.1 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:26.559 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:26 smithi087 podman[74080]: 2024-09-15 23:06:26.257453893 +0000 UTC m=+5.687776688 container died 11b09f58c7dc2f2936de86d28a4335aba2799d78dc6b72dda4ca204386e9a11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-15T23:06:26.849 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:26 smithi087 podman[74080]: 2024-09-15 23:06:26.63240797 +0000 UTC m=+6.062730763 container cleanup 11b09f58c7dc2f2936de86d28a4335aba2799d78dc6b72dda4ca204386e9a11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:26.849 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:26 smithi087 bash[74080]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1 2024-09-15T23:06:27.226 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:26 smithi087 podman[74096]: 2024-09-15 23:06:26.91716092 +0000 UTC m=+0.653561709 container remove 11b09f58c7dc2f2936de86d28a4335aba2799d78dc6b72dda4ca204386e9a11f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T23:06:27.496 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.128506752 +0000 UTC m=+0.015546843 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:27.497 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.260108385 +0000 UTC m=+0.147148512 container create 0bda199e572ba927cbd2825644b57accb8912f1bfb1823ee329ebe805403b16d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:27.497 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.496118778 +0000 UTC m=+0.383158873 container init 0bda199e572ba927cbd2825644b57accb8912f1bfb1823ee329ebe805403b16d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T23:06:27.783 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.499610127 +0000 UTC m=+0.386650217 container start 0bda199e572ba927cbd2825644b57accb8912f1bfb1823ee329ebe805403b16d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T23:06:27.783 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.629291657 +0000 UTC m=+0.516331755 container attach 0bda199e572ba927cbd2825644b57accb8912f1bfb1823ee329ebe805403b16d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T23:06:28.099 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 15 23:06:27 smithi087 podman[74186]: 2024-09-15 23:06:27.78306894 +0000 UTC m=+0.670109035 container died 0bda199e572ba927cbd2825644b57accb8912f1bfb1823ee329ebe805403b16d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-15T23:06:28.621 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T23:06:28.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:28.662 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T23:06:28.662 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T23:06:28.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.2 2024-09-15T23:06:28.991 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:28 smithi184 systemd[1]: Stopping Ceph osd.2 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:29.422 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T23:06:28.990+0000 7feb4a448640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:29.422 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T23:06:28.990+0000 7feb4a448640 -1 osd.2 127 *** Got signal Terminated *** 2024-09-15T23:06:29.422 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2[40199]: 2024-09-15T23:06:28.990+0000 7feb4a448640 -1 osd.2 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:34.732 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:34 smithi184 podman[73251]: 2024-09-15 23:06:34.445599144 +0000 UTC m=+5.562484575 container died 4de269d65f1513fb21e0b47a8a5da770a9370d51b81994e732092387653feb4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T23:06:35.117 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:34 smithi184 podman[73251]: 2024-09-15 23:06:34.815013849 +0000 UTC m=+5.931899278 container cleanup 4de269d65f1513fb21e0b47a8a5da770a9370d51b81994e732092387653feb4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:06:35.117 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:34 smithi184 bash[73251]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2 2024-09-15T23:06:35.422 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73267]: 2024-09-15 23:06:35.116516484 +0000 UTC m=+0.660239509 container remove 4de269d65f1513fb21e0b47a8a5da770a9370d51b81994e732092387653feb4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T23:06:35.746 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73358]: 2024-09-15 23:06:35.384148395 +0000 UTC m=+0.015967821 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:35.746 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73358]: 2024-09-15 23:06:35.493163274 +0000 UTC m=+0.124982699 container create 0ab04235ca5b74e7e006ac87ea982d61b72eb333b0e0d107c6bca6cdf97a6181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T23:06:35.746 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73358]: 2024-09-15 23:06:35.745715513 +0000 UTC m=+0.377534938 container init 0ab04235ca5b74e7e006ac87ea982d61b72eb333b0e0d107c6bca6cdf97a6181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:06:36.091 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73358]: 2024-09-15 23:06:35.749095938 +0000 UTC m=+0.380915371 container start 0ab04235ca5b74e7e006ac87ea982d61b72eb333b0e0d107c6bca6cdf97a6181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T23:06:36.091 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:35 smithi184 podman[73358]: 2024-09-15 23:06:35.854275348 +0000 UTC m=+0.486094792 container attach 0ab04235ca5b74e7e006ac87ea982d61b72eb333b0e0d107c6bca6cdf97a6181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T23:06:36.367 INFO:journalctl@ceph.osd.2.smithi184.stdout:Sep 15 23:06:36 smithi184 podman[73358]: 2024-09-15 23:06:36.090570855 +0000 UTC m=+0.722390283 container died 0ab04235ca5b74e7e006ac87ea982d61b72eb333b0e0d107c6bca6cdf97a6181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:36.743 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T23:06:36.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:36.783 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T23:06:36.783 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T23:06:36.784 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.3 2024-09-15T23:06:37.119 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:36 smithi066 systemd[1]: Stopping Ceph osd.3 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:37.449 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:37 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:37.117+0000 7f8724253640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:37.449 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:37 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:37.117+0000 7f8724253640 -1 osd.3 127 *** Got signal Terminated *** 2024-09-15T23:06:37.449 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:37 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:37.117+0000 7f8724253640 -1 osd.3 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:38.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:37.750+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:38.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:37.896+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:39.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:38.731+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:39.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:38.861+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:39.172 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:38.802+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:39.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:39 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:39.562+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:40.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:39 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:39.683+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:40.172 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:39.793+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:40.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:39.867+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:40.448 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:40.002+0000 7f871c861640 -1 osd.3 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.575187+0000 front 2024-09-15T23:06:14.575229+0000 (oldest deadline 2024-09-15T23:06:39.875316+0000) 2024-09-15T23:06:40.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:40.782+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:40.922 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:40.835+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:40.923 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:40.619+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:40.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:40 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:40.524+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:41.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:40 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:40.671+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:41.448 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:41 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:41.021+0000 7f871c861640 -1 osd.3 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.575187+0000 front 2024-09-15T23:06:14.575229+0000 (oldest deadline 2024-09-15T23:06:39.875316+0000) 2024-09-15T23:06:41.881 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:41.603+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:41.881 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:41.733+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:41.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:41 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:41.532+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:42.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:41 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:41.628+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:42.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:41.879+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:42.448 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:42 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3[52001]: 2024-09-15T23:06:42.037+0000 7f871c861640 -1 osd.3 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.575187+0000 front 2024-09-15T23:06:14.575229+0000 (oldest deadline 2024-09-15T23:06:39.875316+0000) 2024-09-15T23:06:42.910 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:42.641+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:42.910 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:42.686+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:42.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:42 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:42.569+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:42.949 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:42 smithi066 podman[134324]: 2024-09-15 23:06:42.631796626 +0000 UTC m=+5.629030510 container died 07e8f4530060260ec737213310c500601808c101219b8c4a3d061ce0f6bb5e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T23:06:43.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:42 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:42.649+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:43.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:42.909+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:43.420 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:43 smithi066 podman[134324]: 2024-09-15 23:06:43.134958871 +0000 UTC m=+6.132192754 container cleanup 07e8f4530060260ec737213310c500601808c101219b8c4a3d061ce0f6bb5e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T23:06:43.420 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:43 smithi066 bash[134324]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3 2024-09-15T23:06:43.699 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:43 smithi066 podman[134339]: 2024-09-15 23:06:43.420103722 +0000 UTC m=+0.775620427 container remove 07e8f4530060260ec737213310c500601808c101219b8c4a3d061ce0f6bb5e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T23:06:43.699 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:43 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:43.599+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:43.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:43.641+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:43.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:43.610+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:44.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:43 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:43.655+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:44.104 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:43 smithi066 podman[134428]: 2024-09-15 23:06:43.659853425 +0000 UTC m=+0.016769947 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:44.104 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:43 smithi066 podman[134428]: 2024-09-15 23:06:43.988045242 +0000 UTC m=+0.344961748 container create 05d60f5913e7237aa01052a36b24703c974f7f72b87c79b256848868b4c82418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T23:06:44.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:43.927+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:44.440 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:44 smithi066 podman[134428]: 2024-09-15 23:06:44.240526629 +0000 UTC m=+0.597443139 container init 05d60f5913e7237aa01052a36b24703c974f7f72b87c79b256848868b4c82418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T23:06:44.441 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:44 smithi066 podman[134428]: 2024-09-15 23:06:44.244020425 +0000 UTC m=+0.600936935 container start 05d60f5913e7237aa01052a36b24703c974f7f72b87c79b256848868b4c82418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:06:44.441 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:44 smithi066 podman[134428]: 2024-09-15 23:06:44.34057959 +0000 UTC m=+0.697496113 container attach 05d60f5913e7237aa01052a36b24703c974f7f72b87c79b256848868b4c82418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T23:06:44.699 INFO:journalctl@ceph.osd.3.smithi066.stdout:Sep 15 23:06:44 smithi066 podman[134428]: 2024-09-15 23:06:44.440615735 +0000 UTC m=+0.797532253 container died 05d60f5913e7237aa01052a36b24703c974f7f72b87c79b256848868b4c82418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:06:44.699 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:44 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:44.612+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:44.895 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:44.646+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:44.895 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:44.613+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:45.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T23:06:45.083 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:45.083 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T23:06:45.083 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T23:06:45.084 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.4 2024-09-15T23:06:45.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:44 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:44.698+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:45.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:44.894+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:45.413 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:45 smithi087 systemd[1]: Stopping Ceph osd.4 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:45.674 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:45 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:45.411+0000 7fbf2e6fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:45.674 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:45 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:45.411+0000 7fbf2e6fa640 -1 osd.4 127 *** Got signal Terminated *** 2024-09-15T23:06:45.674 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:45 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:45.411+0000 7fbf2e6fa640 -1 osd.4 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:45.858 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:45.628+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:45.858 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:45.583+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:45.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:45 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:45.601+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:46.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:45 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:45.673+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:46.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:45.856+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:46.855 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:46.673+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:46.855 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:46.542+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:46.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:46 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:46.560+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:46.959 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:46 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:46.715+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:46.960 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:46 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:46.672+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:46.960 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:46 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:46.672+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:47.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:46.881+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:47.349 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:46 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:46.958+0000 7fbf26d08640 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.495627+0000 front 2024-09-15T23:06:21.495534+0000 (oldest deadline 2024-09-15T23:06:46.795637+0000) 2024-09-15T23:06:47.874 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:47 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:47.504+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:47.874 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:47 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:47.641+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:47.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:47 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:47.549+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:47.966 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:47 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:47.738+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:47.966 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:47 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:47.638+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:47.966 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:47 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:47.638+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:48.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:47 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:47.872+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:48.349 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:47 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:47.964+0000 7fbf26d08640 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.495627+0000 front 2024-09-15T23:06:21.495534+0000 (oldest deadline 2024-09-15T23:06:46.795637+0000) 2024-09-15T23:06:48.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:48 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:48.718+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:48.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:48 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:48.590+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:48.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:48 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:48.590+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:48.901 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:48 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:48.659+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:48.901 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:48 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:48.492+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:48.902 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:48 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:48.492+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:48.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:48 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:48.599+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:48.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:48 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:48.599+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:49.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:48 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:48.900+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:49.349 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:48 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:48.916+0000 7fbf26d08640 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.495627+0000 front 2024-09-15T23:06:21.495534+0000 (oldest deadline 2024-09-15T23:06:46.795637+0000) 2024-09-15T23:06:49.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:49 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:49.744+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:49.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:49 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:49.595+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:49.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:49 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:49.595+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:49.868 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:49 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:49.669+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:49.868 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:49 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:49.486+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:49.868 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:49 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:49.486+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:49.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:49 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:49.635+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:49.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:49 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:49.635+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:50.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:49 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:49.866+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:50.349 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:49 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4[46497]: 2024-09-15T23:06:49.876+0000 7fbf26d08640 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.495627+0000 front 2024-09-15T23:06:21.495534+0000 (oldest deadline 2024-09-15T23:06:46.795637+0000) 2024-09-15T23:06:50.901 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:50 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:50.718+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:50.901 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:50 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:50.480+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:50.901 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:50 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:50.480+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:50.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:50 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:50.666+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:50.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:50 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:50.666+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:50.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:50 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:50.631+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:50.992 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:50 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:50.766+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:50.993 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:50 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:50.629+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:50.993 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:50 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:50.629+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:51.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:50 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:50.899+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:51.255 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:50 smithi087 podman[74289]: 2024-09-15 23:06:50.992395564 +0000 UTC m=+5.701749999 container died 978d2646da41b21fa3bf166def13846a6c54f424f32f80868d29c88293dc5eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:06:51.596 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:51 smithi087 podman[74289]: 2024-09-15 23:06:51.336589183 +0000 UTC m=+6.045943614 container cleanup 978d2646da41b21fa3bf166def13846a6c54f424f32f80868d29c88293dc5eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:06:51.597 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:51 smithi087 bash[74289]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4 2024-09-15T23:06:51.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:51.740+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:51.849 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:51 smithi087 podman[74318]: 2024-09-15 23:06:51.638324385 +0000 UTC m=+0.646182602 container remove 978d2646da41b21fa3bf166def13846a6c54f424f32f80868d29c88293dc5eb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T23:06:51.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:51.594+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:51.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:51 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:51.594+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:51.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:51.684+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:51.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:51.684+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:51.903 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:51.440+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:51.903 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:51.440+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:51.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:51.636+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:51.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:51.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:51.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:51 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:51.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:52.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:51 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:51.898+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:52.291 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:51 smithi087 podman[74402]: 2024-09-15 23:06:51.894226397 +0000 UTC m=+0.015805308 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:52.291 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:52 smithi087 podman[74402]: 2024-09-15 23:06:52.013947798 +0000 UTC m=+0.135526694 container create e3c1f7dc00405479d080f5a12b71443b14ee9c86dc2363a5e2c467446da475fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T23:06:52.291 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:52 smithi087 podman[74402]: 2024-09-15 23:06:52.290658961 +0000 UTC m=+0.412237867 container init e3c1f7dc00405479d080f5a12b71443b14ee9c86dc2363a5e2c467446da475fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:06:52.600 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:52 smithi087 podman[74402]: 2024-09-15 23:06:52.294055022 +0000 UTC m=+0.415633920 container start e3c1f7dc00405479d080f5a12b71443b14ee9c86dc2363a5e2c467446da475fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T23:06:52.600 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:52 smithi087 podman[74402]: 2024-09-15 23:06:52.391705564 +0000 UTC m=+0.513284468 container attach e3c1f7dc00405479d080f5a12b71443b14ee9c86dc2363a5e2c467446da475fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T23:06:52.600 INFO:journalctl@ceph.osd.4.smithi087.stdout:Sep 15 23:06:52 smithi087 podman[74402]: 2024-09-15 23:06:52.484439751 +0000 UTC m=+0.606018649 container died e3c1f7dc00405479d080f5a12b71443b14ee9c86dc2363a5e2c467446da475fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T23:06:52.667 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:52 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:52.392+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:52.668 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:52 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:52.392+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:52.922 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:52 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:52.915+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:52.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:52 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:52.666+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:52.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:52 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:52.666+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:52.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:52.623+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:52.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:52.631+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:52.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:52.631+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:53.054 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:52 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:52.641+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:53.054 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:52 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:52.641+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:53.054 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:52 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:52.718+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:53.069 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T23:06:53.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:06:53.151 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T23:06:53.151 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T23:06:53.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.5 2024-09-15T23:06:53.445 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 systemd[1]: Stopping Ceph osd.5 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:06:53.445 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:53.381+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:53.445 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:53.381+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:53.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:53.443+0000 7f69c028f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:06:53.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:53.443+0000 7f69c028f640 -1 osd.5 127 *** Got signal Terminated *** 2024-09-15T23:06:53.923 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:53.443+0000 7f69c028f640 -1 osd.5 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:06:53.923 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:53.616+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:53.923 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:53.616+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:53.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:53 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:53.607+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:53.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:53 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:53.585+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:53.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:53 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:53.585+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:54.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:53 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:53.743+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:54.100 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:53 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:53.620+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:54.100 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:53 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:53.620+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:54.381 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:53 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:53.934+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:54.672 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:54 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:54.622+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:54.672 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:54 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:54.622+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:54.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:54 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:54.380+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:54.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:54 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:54.380+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:54.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:54 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:54.740+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:54.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:54 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:54.582+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:54.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:54 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:54.582+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:54.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:54 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:54.593+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:54.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:54 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:54.594+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:54.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:54 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:54.594+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:54.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:54 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:54.594+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:06:55.351 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:54 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:54.938+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:55.647 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:55 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:55.349+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:55.648 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:55 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:55.349+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:55.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:55 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:55.784+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:55.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:55 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:55.549+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:55.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:55 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:55.549+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:55.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:55 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:55.646+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:55.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:55 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:55.646+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:55.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:55.578+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:55.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:55.578+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:06:55.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:55.621+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:55.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:55.621+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:55.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:55.621+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:06:56.333 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:55 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:55.933+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:56.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:56.332+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:56.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:56.332+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:56.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:56 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:56.784+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:56.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:56 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:56.784+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:06:56.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:56 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:56.546+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:56.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:56 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:56.546+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:56.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:56.624+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:56.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:56.624+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:06:56.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:56.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:56.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:56.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:56.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:56 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:56.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:06:57.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:56.898+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:57.172 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:56.682+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:57.173 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:56 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:56.682+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:57.642 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:57.291+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:57.642 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:57.291+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:57.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:57 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:57.734+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:57.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:57 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:57.734+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:06:57.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:57 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:57.529+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:57.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:57 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:57.529+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:57.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:57 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:57.529+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:06:57.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:57.641+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.809388+0000 front 2024-09-15T23:06:15.809254+0000 (oldest deadline 2024-09-15T23:06:40.509062+0000) 2024-09-15T23:06:57.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:57.641+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:21.610161+0000 front 2024-09-15T23:06:21.610192+0000 (oldest deadline 2024-09-15T23:06:51.511606+0000) 2024-09-15T23:06:57.902 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5[46639]: 2024-09-15T23:06:57.641+0000 7f69b889d640 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.512131+0000 front 2024-09-15T23:06:31.512110+0000 (oldest deadline 2024-09-15T23:06:56.812112+0000) 2024-09-15T23:06:57.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:57.628+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:57.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:57.628+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:06:57.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:57.535+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:57.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:57.535+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:57.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:57 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:57.535+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:06:58.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:57 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:57.901+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:58.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:58.301+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:58.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:58.301+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:58.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:58.779+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:58.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:58.779+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:06:58.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:58.534+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:58.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:58.534+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:58.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:58 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:58.534+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:06:58.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:58.671+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:58.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:58.671+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:06:58.950 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:58.490+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:58.950 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:58.490+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:58.950 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:58 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:58.490+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:06:59.172 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:58 smithi184 podman[73476]: 2024-09-15 23:06:58.889057576 +0000 UTC m=+5.547277646 container died 4615904c0808ca0599e946923f381d5a935b99350b5cc4b9262ea0eb44d05bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:59.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:58.918+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:06:59.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:58 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:58.918+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:06:59.571 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:59 smithi184 podman[73476]: 2024-09-15 23:06:59.302359735 +0000 UTC m=+5.960579804 container cleanup 4615904c0808ca0599e946923f381d5a935b99350b5cc4b9262ea0eb44d05bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:06:59.571 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:59 smithi184 bash[73476]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5 2024-09-15T23:06:59.571 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:59.331+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:06:59.571 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:06:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:06:59.331+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:06:59.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:59.750+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:06:59.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:06:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:06:59.750+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:06:59.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:59.524+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:06:59.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:59.524+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:06:59.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:06:59 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:06:59.524+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:06:59.922 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:59 smithi184 podman[73491]: 2024-09-15 23:06:59.570549718 +0000 UTC m=+0.678681506 container remove 4615904c0808ca0599e946923f381d5a935b99350b5cc4b9262ea0eb44d05bbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T23:06:59.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:59.720+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:06:59.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:06:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:06:59.720+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:06:59.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:59.497+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:06:59.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:59.497+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:06:59.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:06:59 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:06:59.497+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:00.299 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:59.944+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:00.300 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:06:59 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:06:59.944+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:00.300 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:06:59 smithi184 podman[73576]: 2024-09-15 23:06:59.876175575 +0000 UTC m=+0.016026887 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:00.300 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:07:00 smithi184 podman[73576]: 2024-09-15 23:07:00.038071299 +0000 UTC m=+0.177922600 container create cc3f92ca17b75942100fc318c2676d09b4b73498746d9741bb680da091a5bcbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:07:00.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:00.367+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:00.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:00.367+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:00.672 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:07:00 smithi184 podman[73576]: 2024-09-15 23:07:00.299214769 +0000 UTC m=+0.439066066 container init cc3f92ca17b75942100fc318c2676d09b4b73498746d9741bb680da091a5bcbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T23:07:00.673 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:07:00 smithi184 podman[73576]: 2024-09-15 23:07:00.303332317 +0000 UTC m=+0.443183621 container start cc3f92ca17b75942100fc318c2676d09b4b73498746d9741bb680da091a5bcbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:00.673 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:07:00 smithi184 podman[73576]: 2024-09-15 23:07:00.374126858 +0000 UTC m=+0.513978173 container attach cc3f92ca17b75942100fc318c2676d09b4b73498746d9741bb680da091a5bcbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T23:07:00.673 INFO:journalctl@ceph.osd.5.smithi184.stdout:Sep 15 23:07:00 smithi184 podman[73576]: 2024-09-15 23:07:00.498942923 +0000 UTC m=+0.638794230 container died cc3f92ca17b75942100fc318c2676d09b4b73498746d9741bb680da091a5bcbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:07:00.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:00.720+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:00.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:00.720+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:00.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:00.537+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:00.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:00.537+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:00.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:00 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:00.537+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:00.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:00.727+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:00.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:00.727+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:00.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:00.545+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:00.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:00.545+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:00.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:00.545+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:01.069 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:00.953+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:01.070 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:00 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:00.953+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:01.089 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T23:07:01.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:01.126 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T23:07:01.126 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T23:07:01.127 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.6 2024-09-15T23:07:01.448 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 systemd[1]: Stopping Ceph osd.6 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:01.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:01 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:01.370+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:01.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:01 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:01.370+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:01.762 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:01.551+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:01.762 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:01.551+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:01.762 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:01.551+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:01.763 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:01.454+0000 7f928cb5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:01.763 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:01.454+0000 7f928cb5f640 -1 osd.6 127 *** Got signal Terminated *** 2024-09-15T23:07:01.763 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:01.454+0000 7f928cb5f640 -1 osd.6 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:01.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:01.672+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:01.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:01.672+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:01.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:01.489+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:01.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:01.489+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:01.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:01 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:01.489+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:02.198 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:01.761+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:02.199 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:01 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:01.761+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:02.326 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:01 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:01.923+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:02.327 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:01 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:01.923+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:02.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:02.325+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:02.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:02.325+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:02.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:02.709+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:02.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:02.709+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:02.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:02.514+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:02.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:02.514+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:02.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:02 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:02.514+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:02.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:02.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:02.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:02.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:02.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:02.578+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:02.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:02.724+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:02.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:02 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:02.724+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:03.348 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:02.925+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:03.348 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:02 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:02.925+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:03.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:03 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:03.347+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:03.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:03 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:03.347+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:03.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:03.723+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:03.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:03.723+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:03.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:03.723+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:03.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:03.501+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:03.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:03.501+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:03.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:03.501+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:03.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:03 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:03.725+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:03.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:03 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:03.725+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:03.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:03 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:03.571+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:03.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:03 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:03.571+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:03.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:03 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:03.571+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:04.395 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:03 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:03.928+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:04.395 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:03 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:03.928+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:04.395 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:03 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:03.928+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:04.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:04 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:04.394+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:04.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:04 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:04.394+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:04.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:04.692+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:04.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:04.692+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:04.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:04.692+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:04.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:04.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:04.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:04.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:04.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:04.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:04.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:04 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:04.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:04.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:04 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:04.746+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:04.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:04 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:04.746+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:04.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:04 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:04.583+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:04.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:04 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:04.583+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:04.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:04 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:04.583+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:05.401 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:04 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:04.953+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:05.401 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:04 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:04.953+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:05.401 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:04 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:04.953+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:05.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:05.400+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:05.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:05.400+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:05.791 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:05.536+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:05.791 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:05.536+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:05.791 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:05.536+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:05.791 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:05.536+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:05.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:05.661+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:05.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:05.661+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:05.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:05.661+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:05.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:05.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:05.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:05.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:05.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:05.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:05.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:05 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:05.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:06.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:05.907+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:06.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:05.907+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:06.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:05 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:05.907+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:06.198 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:05.790+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.926498+0000 front 2024-09-15T23:06:24.926475+0000 (oldest deadline 2024-09-15T23:06:49.626546+0000) 2024-09-15T23:07:06.199 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:05 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6[58632]: 2024-09-15T23:07:05.790+0000 7f928516d640 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:32.527940+0000 front 2024-09-15T23:06:32.527976+0000 (oldest deadline 2024-09-15T23:06:55.427882+0000) 2024-09-15T23:07:06.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:06 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:06.367+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:06.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:06 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:06.367+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:06.695 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:06.424+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:06.695 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:06.424+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:06.696 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:06.424+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:06.696 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:06.424+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:06.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:06 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:06.576+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:06.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:06 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:06.576+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:06.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:06 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:06.576+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:06.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:06 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:06.576+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:07.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:06.694+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:07.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:06.694+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:07.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:06 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:06.694+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:07.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:06 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:06.878+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:07.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:06 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:06.878+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:07.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:06 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:06.878+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:07.374 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:07 smithi066 podman[134530]: 2024-09-15 23:07:07.066141538 +0000 UTC m=+5.734357235 container died 92419b690c7dbb9b3f9d07529d1525ef52b698d62f8066a8cab7f494f826c893 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T23:07:07.627 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:07 smithi066 podman[134530]: 2024-09-15 23:07:07.573020448 +0000 UTC m=+6.241236203 container cleanup 92419b690c7dbb9b3f9d07529d1525ef52b698d62f8066a8cab7f494f826c893 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:07:07.627 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:07 smithi066 bash[134530]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6 2024-09-15T23:07:07.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:07 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:07.345+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:07.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:07 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:07.345+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:07.733 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:07.447+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:07.733 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:07.447+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:07.734 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:07.447+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:07.734 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:07.447+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:07.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:07 smithi066 podman[134544]: 2024-09-15 23:07:07.807945954 +0000 UTC m=+0.737086110 container remove 92419b690c7dbb9b3f9d07529d1525ef52b698d62f8066a8cab7f494f826c893 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T23:07:07.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:07.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:07.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:07.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:07.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:07.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:07.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:07 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:07.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:08.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:07.732+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:08.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:07.732+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:08.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:07 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:07.732+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:08.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:07 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:07.855+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:08.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:07 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:07.855+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:08.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:07 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:07.855+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:08.449 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.141967795 +0000 UTC m=+0.113386524 container create ac29f46e5aa6d3e0677399218d461ea3cde784f346f6acd3690ebfe006cffb6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T23:07:08.449 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.045093988 +0000 UTC m=+0.016512720 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:08.449 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.386354678 +0000 UTC m=+0.357773408 container init ac29f46e5aa6d3e0677399218d461ea3cde784f346f6acd3690ebfe006cffb6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-15T23:07:08.449 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.389945615 +0000 UTC m=+0.361364345 container start ac29f46e5aa6d3e0677399218d461ea3cde784f346f6acd3690ebfe006cffb6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:07:08.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:08.370+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:08.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:08.370+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:08.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:08.370+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:08.709 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:08.431+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:08.709 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:08.431+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:08.709 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:08.431+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:08.709 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:08.431+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:08.948 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.469583995 +0000 UTC m=+0.441002725 container attach ac29f46e5aa6d3e0677399218d461ea3cde784f346f6acd3690ebfe006cffb6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:07:08.949 INFO:journalctl@ceph.osd.6.smithi066.stdout:Sep 15 23:07:08 smithi066 podman[134636]: 2024-09-15 23:07:08.583066912 +0000 UTC m=+0.554485642 container died ac29f46e5aa6d3e0677399218d461ea3cde784f346f6acd3690ebfe006cffb6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T23:07:08.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:08 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:08.597+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:08.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:08 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:08.597+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:08.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:08 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:08.597+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:08.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:08 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:08.598+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:09.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:08.707+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:09.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:08.707+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:09.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:08.707+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:09.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:08.897+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:09.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:08.897+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:09.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:08 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:08.897+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:09.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T23:07:09.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:09.324 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T23:07:09.324 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T23:07:09.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.7 2024-09-15T23:07:09.649 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 systemd[1]: Stopping Ceph osd.7 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:09.649 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:09.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:09.649 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:09.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:09.650 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:09.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:09.650 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:09.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:09.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:09.387+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:09.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:09.387+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:09.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:09.387+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:09.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:09 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:09.581+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:09.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:09 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:09.581+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:09.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:09 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:09.581+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:09.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:09 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:09.581+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:10.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.647+0000 7f4602031640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:10.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.647+0000 7f4602031640 -1 osd.7 127 *** Got signal Terminated *** 2024-09-15T23:07:10.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.647+0000 7f4602031640 -1 osd.7 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:10.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.715+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:10.100 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.715+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:10.100 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:09 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:09.715+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:10.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:09.910+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:10.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:09.910+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:10.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:09 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:09.910+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:10.760 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:10.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:10.761 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:10.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:10.761 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:10.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:10.761 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:10.474+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:10.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:10.426+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:10.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:10.426+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:10.923 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:10.426+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:10.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:10.582+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:10.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:10.582+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:10.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:10.582+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:10.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:10 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:10.582+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:11.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:10.759+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:11.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:10.759+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:11.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:10 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:10.759+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:11.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:10.946+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:11.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:10.946+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:11.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:10 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:10.946+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:11.759 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:11.465+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:11.760 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:11.465+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:11.760 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:11.465+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:11.760 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:11.465+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:11.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:11.434+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:11.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:11.434+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:11.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:11.434+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:11.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:11.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:11.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:11.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:11.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:11.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:11.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:11.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:11.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:11 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:11.624+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:12.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:11.758+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:12.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:11.758+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:12.100 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:11.758+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:12.100 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:11 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:11.758+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:50.411681+0000 front 2024-09-15T23:06:50.411709+0000 (oldest deadline 2024-09-15T23:07:11.511924+0000) 2024-09-15T23:07:12.387 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:11.958+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:12.387 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:11.958+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:12.387 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:11.958+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:12.388 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:11 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:11.958+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:12.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:12.386+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:12.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:12.386+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:12.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:12.386+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:12.777 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:12.428+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:12.777 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:12.428+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:12.777 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:12.428+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:12.777 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:12.428+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:12.777 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:12.428+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:12.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:12 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:12.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:12.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:12 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:12.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:12.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:12 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:12.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:12.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:12 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:12.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:12.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:12 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:12.628+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:13.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:12.775+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:13.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:12.775+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:13.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:12.775+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:13.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:12.775+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:50.411681+0000 front 2024-09-15T23:06:50.411709+0000 (oldest deadline 2024-09-15T23:07:11.511924+0000) 2024-09-15T23:07:13.413 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:12.969+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:13.413 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:12.969+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:13.413 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:12.969+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:13.413 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:12 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:12.969+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:13.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:13.412+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:13.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:13.412+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:13.673 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:13.412+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:13.673 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:13.412+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:13.747 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:13.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:13.748 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:13.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:13.748 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:13.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:13.748 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:13.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:13.748 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:13.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:13.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:13 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:13.670+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:13.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:13 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:13.670+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:13.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:13 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:13.670+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:13.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:13 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:13.670+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:13.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:13 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:13.670+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:14.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:13.746+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.207584+0000 front 2024-09-15T23:06:24.207614+0000 (oldest deadline 2024-09-15T23:06:46.507748+0000) 2024-09-15T23:07:14.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:13.746+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:31.209326+0000 front 2024-09-15T23:06:31.208629+0000 (oldest deadline 2024-09-15T23:06:55.809273+0000) 2024-09-15T23:07:14.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:13.746+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:39.910163+0000 front 2024-09-15T23:06:39.910188+0000 (oldest deadline 2024-09-15T23:07:02.810325+0000) 2024-09-15T23:07:14.099 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:13 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7[53433]: 2024-09-15T23:07:13.746+0000 7f45fe647640 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:50.411681+0000 front 2024-09-15T23:06:50.411709+0000 (oldest deadline 2024-09-15T23:07:11.511924+0000) 2024-09-15T23:07:14.379 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:13.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:14.380 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:13.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:14.380 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:13.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:14.380 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:13 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:13.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:14.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:14.379+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:14.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:14.379+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:14.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:14.379+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:14.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:14 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:14.379+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:14.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:14 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:14.440+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:14.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:14 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:14.440+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:14.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:14 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:14.440+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:14.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:14 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:14.440+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:14.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:14 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:14.440+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:14.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:14 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:14.657+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:14.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:14 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:14.657+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:14.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:14 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:14.657+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:14.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:14 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:14.657+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:14.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:14 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:14.657+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:15.398 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:15.003+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:15.398 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:15.003+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:15.398 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:15.003+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:15.398 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:15.003+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:15.566 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:15 smithi087 podman[74505]: 2024-09-15 23:07:15.243391273 +0000 UTC m=+5.725695635 container died 6a9931035a7a0a9c819fbc72d664a428fc52b129eae3863e247215c6467268f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:15.566 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:15.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:15.566 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:15.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:15.567 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:15.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:15.567 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:15.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:15.567 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:15 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:15.467+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:15.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:15.397+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:15.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:15.397+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:15.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:15.397+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:15.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:15 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:15.397+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:15.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:15 smithi087 podman[74505]: 2024-09-15 23:07:15.681671259 +0000 UTC m=+6.163975666 container cleanup 6a9931035a7a0a9c819fbc72d664a428fc52b129eae3863e247215c6467268f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-15T23:07:15.849 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:15 smithi087 bash[74505]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7 2024-09-15T23:07:15.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:15 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:15.668+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:15.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:15 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:15.668+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:15.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:15 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:15.668+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:15.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:15 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:15.668+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:15.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:15 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:15.668+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:16.290 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:15 smithi087 podman[74522]: 2024-09-15 23:07:15.882814883 +0000 UTC m=+0.634823878 container remove 6a9931035a7a0a9c819fbc72d664a428fc52b129eae3863e247215c6467268f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:16.383 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:16.037+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:16.383 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:16.037+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:16.383 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:16.037+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:16.383 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:16.037+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:16.599 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.192761005 +0000 UTC m=+0.015876978 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:16.599 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.378106098 +0000 UTC m=+0.201222072 container create 6bc1cecb4a9991dcbf6d3910bbde2a4588fa3b244a07e849fead9dddac6c4375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T23:07:16.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:16.472+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:16.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:16.472+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:16.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:16.472+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:16.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:16.472+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:16.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:16.472+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:16.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:16.382+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:16.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:16.382+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:16.673 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:16.382+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:16.673 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:16 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:16.382+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:16.930 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.736159624 +0000 UTC m=+0.559275596 container init 6bc1cecb4a9991dcbf6d3910bbde2a4588fa3b244a07e849fead9dddac6c4375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T23:07:16.930 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.739355901 +0000 UTC m=+0.562471873 container start 6bc1cecb4a9991dcbf6d3910bbde2a4588fa3b244a07e849fead9dddac6c4375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-15T23:07:16.930 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.819275859 +0000 UTC m=+0.642391831 container attach 6bc1cecb4a9991dcbf6d3910bbde2a4588fa3b244a07e849fead9dddac6c4375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True) 2024-09-15T23:07:16.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:16.696+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:16.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:16.696+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:16.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:16.696+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:16.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:16.696+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:16.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:16 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:16.696+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:17.273 INFO:journalctl@ceph.osd.7.smithi087.stdout:Sep 15 23:07:16 smithi087 podman[74609]: 2024-09-15 23:07:16.929360598 +0000 UTC m=+0.752476581 container died 6bc1cecb4a9991dcbf6d3910bbde2a4588fa3b244a07e849fead9dddac6c4375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:07:17.391 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:17.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:17.391 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:17.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:17.391 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:17.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:17.391 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:17.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:17.582 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:17.496+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:17.582 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:17.496+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:17.582 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:17.496+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:17.582 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:17.496+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:17.582 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:17 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:17.496+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:17.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T23:07:17.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:17.640 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T23:07:17.640 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T23:07:17.641 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.8 2024-09-15T23:07:17.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.390+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:17.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.390+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:17.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.390+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:17.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.390+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:17.922 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 systemd[1]: Stopping Ceph osd.8 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:18.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:17.726+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:18.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:17.726+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:18.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:17.726+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:18.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:17.726+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:18.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:17 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:17.726+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:18.356 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:18.050+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:18.356 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:18.050+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:18.356 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:18.050+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:18.356 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:18.050+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:18.356 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.963+0000 7fd65a4d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:18.357 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.963+0000 7fd65a4d0640 -1 osd.8 127 *** Got signal Terminated *** 2024-09-15T23:07:18.357 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:17 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:17.963+0000 7fd65a4d0640 -1 osd.8 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:18.357 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:18.354+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:18.357 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:18.354+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:18.641 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:18.354+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:18.641 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:18 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:18.354+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:18.803 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:18.456+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:18.803 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:18.456+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:18.804 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:18.456+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:18.804 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:18.456+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:18.804 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:18 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:18.456+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:19.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:18.768+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:19.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:18.768+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:19.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:18.768+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:19.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:18.768+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:19.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:18 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:18.768+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:19.307 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:19.010+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:19.307 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:19.010+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:19.307 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:19.010+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:19.307 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:19.010+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:19.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:19.306+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:19.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:19.306+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:19.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:19.306+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:19.672 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:19 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:19.306+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:19.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:19.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:19.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:19.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:19.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:19.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:19.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:19.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:19.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:19 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:19.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:20.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:19.766+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:20.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:19.766+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:20.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:19.766+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:20.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:19.766+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:20.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:19 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:19.766+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:20.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:20.269+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:20.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:20.269+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:20.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:20.269+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:20.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:20.269+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:20.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:20.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:20.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:20.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:20.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:20.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:20.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:20.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:20.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:20.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:20.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:20.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:20.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:20.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:20 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:20.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:21.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:20.731+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:21.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:20.731+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:21.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:20.731+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:21.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:20.731+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:21.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:20 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:20.731+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:21.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:21.231+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:21.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:21.231+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:21.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:21.231+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:21.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:21.231+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:21.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:21.231+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.881596+0000 front 2024-09-15T23:06:55.881621+0000 (oldest deadline 2024-09-15T23:07:20.581630+0000) 2024-09-15T23:07:21.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:21.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:21.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:21.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:21.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:21.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:21.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:21.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:21.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:21.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:21 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:21.460+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:22.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:21 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:21.749+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:22.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:22.236+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.776162+0000 front 2024-09-15T23:06:15.776110+0000 (oldest deadline 2024-09-15T23:06:38.676235+0000) 2024-09-15T23:07:22.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:22.236+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:23.977465+0000 front 2024-09-15T23:06:23.977481+0000 (oldest deadline 2024-09-15T23:06:48.077228+0000) 2024-09-15T23:07:22.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:22.236+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.979779+0000 front 2024-09-15T23:06:41.979808+0000 (oldest deadline 2024-09-15T23:07:07.879587+0000) 2024-09-15T23:07:22.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:22.236+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.980544+0000 front 2024-09-15T23:06:48.980525+0000 (oldest deadline 2024-09-15T23:07:12.480484+0000) 2024-09-15T23:07:22.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8[53402]: 2024-09-15T23:07:22.236+0000 7fd656ae6640 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.881596+0000 front 2024-09-15T23:06:55.881621+0000 (oldest deadline 2024-09-15T23:07:20.581630+0000) 2024-09-15T23:07:22.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:22.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:22.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:22.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:22.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:21 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:21.995+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:22.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:22.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:22.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:22.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:22.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:22.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:22 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:22.419+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:23.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:23.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:23.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:23.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:23.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:23.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:22 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:22.717+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:23.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:22.985+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:23.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:22.985+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:23.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:22.985+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:23.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:22.985+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:23.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:22 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:22.985+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:23.807 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:23 smithi184 podman[73682]: 2024-09-15 23:07:23.519002597 +0000 UTC m=+5.676389594 container died 9fd3d32560b3ff06d8d85c74f85299ea0536267e72cde4faac1cbd5d7f79d2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:23.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:23 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:23.468+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:24.165 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:23 smithi184 podman[73682]: 2024-09-15 23:07:23.896389773 +0000 UTC m=+6.053776762 container cleanup 9fd3d32560b3ff06d8d85c74f85299ea0536267e72cde4faac1cbd5d7f79d2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:07:24.165 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:23 smithi184 bash[73682]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8 2024-09-15T23:07:24.165 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:24.016+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:24.165 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:24.016+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:24.166 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:24.016+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:24.166 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:24.016+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:24.166 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:24.016+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:24.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:23 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:23.733+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:24.422 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73707]: 2024-09-15 23:07:24.164533602 +0000 UTC m=+0.640707753 container remove 9fd3d32560b3ff06d8d85c74f85299ea0536267e72cde4faac1cbd5d7f79d2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T23:07:24.826 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73795]: 2024-09-15 23:07:24.426879152 +0000 UTC m=+0.016191015 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:24.826 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73795]: 2024-09-15 23:07:24.557068998 +0000 UTC m=+0.146380902 container create fdecd6604596c38255d9972f3589a77a2767fcfecb667776cbed6a99d064e5ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T23:07:24.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:24.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:24.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:24.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:24.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:24.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:24 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:24.433+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:24.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:24 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:24.697+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:25.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:25 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:25.060+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:25.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:25 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:25.060+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:25 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:25.060+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:25 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:25.060+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:25 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:25.060+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73795]: 2024-09-15 23:07:24.826048702 +0000 UTC m=+0.415360563 container init fdecd6604596c38255d9972f3589a77a2767fcfecb667776cbed6a99d064e5ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73795]: 2024-09-15 23:07:24.829653064 +0000 UTC m=+0.418964935 container start fdecd6604596c38255d9972f3589a77a2767fcfecb667776cbed6a99d064e5ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:24 smithi184 podman[73795]: 2024-09-15 23:07:24.90104577 +0000 UTC m=+0.490357649 container attach fdecd6604596c38255d9972f3589a77a2767fcfecb667776cbed6a99d064e5ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T23:07:25.173 INFO:journalctl@ceph.osd.8.smithi184.stdout:Sep 15 23:07:25 smithi184 podman[73795]: 2024-09-15 23:07:25.016210467 +0000 UTC m=+0.605522332 container died fdecd6604596c38255d9972f3589a77a2767fcfecb667776cbed6a99d064e5ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T23:07:25.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T23:07:25.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:25.726 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T23:07:25.726 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T23:07:25.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.9 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:25.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:25 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:25.403+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:25.675+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:25.949 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:25 smithi066 systemd[1]: Stopping Ceph osd.9 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:26.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:26 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:26.077+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:26.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:26 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:26.077+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:26.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:26 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:26.077+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:26.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:26 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:26.077+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:26.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:26 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:26.077+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:26.448 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.041+0000 7f454ebd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:26.448 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.041+0000 7f454ebd0640 -1 osd.9 127 *** Got signal Terminated *** 2024-09-15T23:07:26.449 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.041+0000 7f454ebd0640 -1 osd.9 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:26.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:26 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:26.417+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:27.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:26 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:26.718+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:27.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:27.039+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:27.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:27.039+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:27.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:27.039+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:27.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:27.039+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:27.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:27 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:27.039+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:27.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:27.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:27.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:27.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:27.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:27.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:27 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:27.443+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:28.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:28.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:28.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:28.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:28.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:28.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:27 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:27.714+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:28.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:28.064+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:28.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:28.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:28.599 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:28.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:28.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:28.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:28.600 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:28 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:28.488+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:29.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:28 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:28.729+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:29.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:29.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:29.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:29.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:29.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:29.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:29 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:29.085+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:29.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:29.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:29 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:29.481+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:30.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:29 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:29.740+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:30.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:30.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:30.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:30.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:30.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:30.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:30 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:30.046+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:30.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:30.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:30.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:30.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:30.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:30.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:30.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:30 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:30.452+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:14.474494+0000 front 2024-09-15T23:06:14.474760+0000 (oldest deadline 2024-09-15T23:06:39.174617+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:25.076067+0000 front 2024-09-15T23:06:25.075890+0000 (oldest deadline 2024-09-15T23:06:48.575892+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:28.576490+0000 front 2024-09-15T23:06:28.576556+0000 (oldest deadline 2024-09-15T23:06:54.476467+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:41.279174+0000 front 2024-09-15T23:06:41.279479+0000 (oldest deadline 2024-09-15T23:07:05.379256+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:45.880334+0000 front 2024-09-15T23:06:45.880486+0000 (oldest deadline 2024-09-15T23:07:11.180398+0000) 2024-09-15T23:07:31.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:30 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-15T23:07:30.721+0000 7f454b1e6640 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:52.881600+0000 front 2024-09-15T23:06:52.881524+0000 (oldest deadline 2024-09-15T23:07:21.682087+0000) 2024-09-15T23:07:31.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:31.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:31.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:31.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:31.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:31.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:31 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:31.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:31.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:31.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:31 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:31.475+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:31.860 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:31 smithi066 podman[134737]: 2024-09-15 23:07:31.536046646 +0000 UTC m=+5.613409202 container died ee529a740ccd9babf36779f10eba1705fe6fd504c3c0cfcd682b22c8119c897f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T23:07:32.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134737]: 2024-09-15 23:07:32.051071018 +0000 UTC m=+6.128433616 container cleanup ee529a740ccd9babf36779f10eba1705fe6fd504c3c0cfcd682b22c8119c897f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:07:32.198 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 bash[134737]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9 2024-09-15T23:07:32.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:32.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:32.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:32.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:32.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:32.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:32.067+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:32.676 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134753]: 2024-09-15 23:07:32.260738894 +0000 UTC m=+0.721901836 container remove ee529a740ccd9babf36779f10eba1705fe6fd504c3c0cfcd682b22c8119c897f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T23:07:32.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:32.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:32.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:32.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:32.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:32.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:32.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:32 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:32.523+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:32.947 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134840]: 2024-09-15 23:07:32.579072015 +0000 UTC m=+0.016632522 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:32.948 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134840]: 2024-09-15 23:07:32.719903728 +0000 UTC m=+0.157464225 container create 4c5f858d5dc9484d3a6257a0289a0e5357ba426cd55693183539eb1104beddcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:07:33.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134840]: 2024-09-15 23:07:32.947516987 +0000 UTC m=+0.385077485 container init 4c5f858d5dc9484d3a6257a0289a0e5357ba426cd55693183539eb1104beddcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T23:07:33.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:32 smithi066 podman[134840]: 2024-09-15 23:07:32.950922621 +0000 UTC m=+0.388483121 container start 4c5f858d5dc9484d3a6257a0289a0e5357ba426cd55693183539eb1104beddcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:07:33.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:33 smithi066 podman[134840]: 2024-09-15 23:07:33.030758639 +0000 UTC m=+0.468319136 container attach 4c5f858d5dc9484d3a6257a0289a0e5357ba426cd55693183539eb1104beddcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-15T23:07:33.199 INFO:journalctl@ceph.osd.9.smithi066.stdout:Sep 15 23:07:33 smithi066 podman[134840]: 2024-09-15 23:07:33.151179985 +0000 UTC m=+0.588740482 container died 4c5f858d5dc9484d3a6257a0289a0e5357ba426cd55693183539eb1104beddcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:07:33.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:33.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:33.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:33.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:33.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:33.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:33 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:33.047+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:33.745 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T23:07:33.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:33.786 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T23:07:33.786 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T23:07:33.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.10 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:33.814 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:33.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:34.099 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:33 smithi087 systemd[1]: Stopping Ceph osd.10 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:34.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:34.471 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.108+0000 7f05e1b1a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:34.471 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.108+0000 7f05e1b1a640 -1 osd.10 127 *** Got signal Terminated *** 2024-09-15T23:07:34.471 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.108+0000 7f05e1b1a640 -1 osd.10 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:34.471 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:34.472 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:34 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:34.470+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:35.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:35.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:35.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:35.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:35.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:35.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:34 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:34.996+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:35.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:35.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:35.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:35.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:35.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:35.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:35.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:35 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:35.493+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:36.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:36.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:36.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:36.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:36.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:36.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:36 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:36.006+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:36.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:36.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:36 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:36.503+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:37.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:37.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:37.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:37.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:37.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:37.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:37 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.023+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:37.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:37.852 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:37 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:37.494+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:38.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:38.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:38.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:38.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:38.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:38.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:38.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:38 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:37.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:38.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.301133+0000 front 2024-09-15T23:06:15.301175+0000 (oldest deadline 2024-09-15T23:06:37.001277+0000) 2024-09-15T23:07:38.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6804 osd.1 since back 2024-09-15T23:06:24.903833+0000 front 2024-09-15T23:06:24.903884+0000 (oldest deadline 2024-09-15T23:06:46.604018+0000) 2024-09-15T23:07:38.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.307128+0000 front 2024-09-15T23:06:33.307116+0000 (oldest deadline 2024-09-15T23:06:56.806915+0000) 2024-09-15T23:07:38.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:42.008646+0000 front 2024-09-15T23:06:42.008772+0000 (oldest deadline 2024-09-15T23:07:03.708723+0000) 2024-09-15T23:07:38.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:47.809684+0000 front 2024-09-15T23:06:47.809701+0000 (oldest deadline 2024-09-15T23:07:11.909808+0000) 2024-09-15T23:07:38.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:55.411110+0000 front 2024-09-15T23:06:55.411097+0000 (oldest deadline 2024-09-15T23:07:19.510805+0000) 2024-09-15T23:07:38.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:38 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10[60001]: 2024-09-15T23:07:38.516+0000 7f05de130640 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:04.811885+0000 front 2024-09-15T23:07:04.811927+0000 (oldest deadline 2024-09-15T23:07:27.711572+0000) 2024-09-15T23:07:39.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:39.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:39.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:39.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:39.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:39.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:39.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:39 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:39.013+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:39.868 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:39 smithi087 podman[74724]: 2024-09-15 23:07:39.609985539 +0000 UTC m=+5.626941246 container died ce1d0b9042569abb7618646d1ca20cb10ef2c3a7bb198d7c4eaefa2c807543bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-15T23:07:40.152 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:39 smithi087 podman[74724]: 2024-09-15 23:07:39.950157101 +0000 UTC m=+5.967112797 container cleanup ce1d0b9042569abb7618646d1ca20cb10ef2c3a7bb198d7c4eaefa2c807543bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T23:07:40.152 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:39 smithi087 bash[74724]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10 2024-09-15T23:07:40.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:40.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.028+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:40.563 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74744]: 2024-09-15 23:07:40.151761218 +0000 UTC m=+0.538530064 container remove ce1d0b9042569abb7618646d1ca20cb10ef2c3a7bb198d7c4eaefa2c807543bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:07:40.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.465419798 +0000 UTC m=+0.015637974 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:40.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.577501167 +0000 UTC m=+0.127719388 container create 0fa7e12a9feb70de1180d03174a3df708a844b0317733fee78a9f157960a4a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:07:40.849 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.804910616 +0000 UTC m=+0.355128800 container init 0fa7e12a9feb70de1180d03174a3df708a844b0317733fee78a9f157960a4a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-15T23:07:40.850 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.808444451 +0000 UTC m=+0.358662635 container start 0fa7e12a9feb70de1180d03174a3df708a844b0317733fee78a9f157960a4a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T23:07:41.283 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.879641473 +0000 UTC m=+0.429859668 container attach 0fa7e12a9feb70de1180d03174a3df708a844b0317733fee78a9f157960a4a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:41.283 INFO:journalctl@ceph.osd.10.smithi087.stdout:Sep 15 23:07:40 smithi087 podman[74830]: 2024-09-15 23:07:40.99756249 +0000 UTC m=+0.547780673 container died 0fa7e12a9feb70de1180d03174a3df708a844b0317733fee78a9f157960a4a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:07:41.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:41.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:41.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:41.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:41.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:41.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:41.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:40 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:40.998+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:41.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T23:07:41.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:41.678 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T23:07:41.678 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T23:07:41.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.11 2024-09-15T23:07:41.983 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:41 smithi184 systemd[1]: Stopping Ceph osd.11 for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:42.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:41.981+0000 7fdca413f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:42.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:41.981+0000 7fdca413f640 -1 osd.11 127 *** Got signal Terminated *** 2024-09-15T23:07:42.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:41 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:41.981+0000 7fdca413f640 -1 osd.11 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:07:42.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:42.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:42.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:42.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:42.424 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:42.424 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:42.424 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:42 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:42.030+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:43.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:43.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:43.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:43.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:43.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:43.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:43.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:43 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:43.065+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:44.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:44.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:44.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:44.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:44.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.018+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:44.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.019+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:44.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:44 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:44.019+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:45.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:45.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:45.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:45.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:45.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:45.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:45.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:45.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:45 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:45.035+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6820 osd.8 since back 2024-09-15T23:07:22.555596+0000 front 2024-09-15T23:07:22.555576+0000 (oldest deadline 2024-09-15T23:07:44.255534+0000) 2024-09-15T23:07:46.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-15T23:06:15.446560+0000 front 2024-09-15T23:06:15.446578+0000 (oldest deadline 2024-09-15T23:06:37.746496+0000) 2024-09-15T23:07:46.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-09-15T23:06:33.549319+0000 front 2024-09-15T23:06:33.549304+0000 (oldest deadline 2024-09-15T23:06:58.849356+0000) 2024-09-15T23:07:46.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6814 osd.3 since back 2024-09-15T23:06:38.849806+0000 front 2024-09-15T23:06:38.850033+0000 (oldest deadline 2024-09-15T23:07:02.949781+0000) 2024-09-15T23:07:46.422 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6812 osd.4 since back 2024-09-15T23:06:48.751070+0000 front 2024-09-15T23:06:48.751054+0000 (oldest deadline 2024-09-15T23:07:11.651062+0000) 2024-09-15T23:07:46.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2024-09-15T23:06:58.052371+0000 front 2024-09-15T23:06:58.052409+0000 (oldest deadline 2024-09-15T23:07:21.552596+0000) 2024-09-15T23:07:46.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.66:6822 osd.6 since back 2024-09-15T23:07:05.653662+0000 front 2024-09-15T23:07:05.653730+0000 (oldest deadline 2024-09-15T23:07:27.353632+0000) 2024-09-15T23:07:46.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.87:6820 osd.7 since back 2024-09-15T23:07:13.755059+0000 front 2024-09-15T23:07:13.754998+0000 (oldest deadline 2024-09-15T23:07:37.254859+0000) 2024-09-15T23:07:46.423 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:46 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11[59940]: 2024-09-15T23:07:46.034+0000 7fdca0755640 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.184:6820 osd.8 since back 2024-09-15T23:07:22.555596+0000 front 2024-09-15T23:07:22.555576+0000 (oldest deadline 2024-09-15T23:07:44.255534+0000) 2024-09-15T23:07:47.883 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:47 smithi184 podman[73901]: 2024-09-15 23:07:47.614267759 +0000 UTC m=+5.737099853 container died e0145b02754d44bb326f56962ff0c1fcc2de1c0adc492c566fb6940c075af397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:07:48.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:47 smithi184 podman[73901]: 2024-09-15 23:07:47.981706243 +0000 UTC m=+6.104538405 container cleanup e0145b02754d44bb326f56962ff0c1fcc2de1c0adc492c566fb6940c075af397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T23:07:48.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:47 smithi184 bash[73901]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11 2024-09-15T23:07:48.592 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[73916]: 2024-09-15 23:07:48.282835939 +0000 UTC m=+0.667033341 container remove e0145b02754d44bb326f56962ff0c1fcc2de1c0adc492c566fb6940c075af397 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T23:07:48.869 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[74005]: 2024-09-15 23:07:48.494669605 +0000 UTC m=+0.015882849 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:07:48.870 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[74005]: 2024-09-15 23:07:48.650599598 +0000 UTC m=+0.171812841 container create 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T23:07:48.870 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[74005]: 2024-09-15 23:07:48.869363214 +0000 UTC m=+0.390576457 container init 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T23:07:49.172 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[74005]: 2024-09-15 23:07:48.872606716 +0000 UTC m=+0.393819960 container start 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:07:49.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:48 smithi184 podman[74005]: 2024-09-15 23:07:48.961009651 +0000 UTC m=+0.482222903 container attach 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T23:07:49.173 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:49 smithi184 podman[74005]: 2024-09-15 23:07:49.073573354 +0000 UTC m=+0.594786601 container died 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:07:49.613 INFO:journalctl@ceph.osd.11.smithi184.stdout:Sep 15 23:07:49 smithi184 podman[74028]: 2024-09-15 23:07:49.597179192 +0000 UTC m=+0.517421816 container remove 5feb0cbe842ddd8105dfeb0842547a3392728e6bbed198c31f21ac9228b78cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD) 2024-09-15T23:07:49.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T23:07:49.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:49.656 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T23:07:49.657 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T23:07:49.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.a 2024-09-15T23:07:49.948 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:49 smithi066 systemd[1]: Stopping Ceph mds.a for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:50.218 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:49 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: 2024-09-15T23:07:49.952+0000 7f782415c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:50.218 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:49 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a[72322]: 2024-09-15T23:07:49.952+0000 7f782415c640 -1 mds.a *** got signal Terminated *** 2024-09-15T23:07:51.699 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:51 smithi066 podman[134943]: 2024-09-15 23:07:51.457118091 +0000 UTC m=+1.594396879 container died 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T23:07:52.198 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:51 smithi066 podman[134943]: 2024-09-15 23:07:51.911135283 +0000 UTC m=+2.048414100 container cleanup 5d5fb2ff6a51b362124fc94997ab7e51bff4bb85cb2e6d9841dfe31fe8278475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T23:07:52.199 INFO:journalctl@ceph.mds.a.smithi066.stdout:Sep 15 23:07:51 smithi066 bash[134943]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-a 2024-09-15T23:07:52.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T23:07:52.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:52.379 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T23:07:52.379 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T23:07:52.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.d 2024-09-15T23:07:52.949 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:52 smithi066 systemd[1]: Stopping Ceph mds.d for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:52.949 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d[71129]: 2024-09-15T23:07:52.698+0000 7f503f706640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:52.949 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:52 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d[71129]: 2024-09-15T23:07:52.698+0000 7f503f706640 -1 mds.d *** got signal Terminated *** 2024-09-15T23:07:54.492 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:54 smithi066 podman[135076]: 2024-09-15 23:07:54.226493114 +0000 UTC m=+1.627015019 container died 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T23:07:54.949 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:54 smithi066 podman[135076]: 2024-09-15 23:07:54.59864512 +0000 UTC m=+1.999167024 container cleanup 774c9c33b538493a8b6990740f33073648b1af31514b4f5a28b5e60828bcd3ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-15T23:07:54.949 INFO:journalctl@ceph.mds.d.smithi066.stdout:Sep 15 23:07:54 smithi066 bash[135076]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-d 2024-09-15T23:07:55.241 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T23:07:55.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:07:55.277 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T23:07:55.277 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T23:07:55.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.g 2024-09-15T23:07:55.612 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:55 smithi066 systemd[1]: Stopping Ceph mds.g for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:07:55.948 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: 2024-09-15T23:07:55.610+0000 7fba6e652640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:07:55.948 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:55 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g[71949]: 2024-09-15T23:07:55.610+0000 7fba6e652640 -1 mds.g *** got signal Terminated *** 2024-09-15T23:07:59.737 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:59 smithi066 podman[135200]: 2024-09-15 23:07:59.457048419 +0000 UTC m=+3.948576133 container died 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T23:08:00.199 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:59 smithi066 podman[135200]: 2024-09-15 23:07:59.818932181 +0000 UTC m=+4.310459885 container cleanup 1a9688d4680f084b059dbc54e65a473570554d486e370cd5f235085256889528 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-15T23:08:00.199 INFO:journalctl@ceph.mds.g.smithi066.stdout:Sep 15 23:07:59 smithi066 bash[135200]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-g 2024-09-15T23:08:00.407 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T23:08:00.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:00.442 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T23:08:00.443 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T23:08:00.443 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.j 2024-09-15T23:08:00.786 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:00 smithi066 systemd[1]: Stopping Ceph mds.j for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:00.786 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j[70716]: 2024-09-15T23:08:00.747+0000 7f128a60b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:00.786 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:00 smithi066 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j[70716]: 2024-09-15T23:08:00.747+0000 7f128a60b640 -1 mds.j *** got signal Terminated *** 2024-09-15T23:08:02.966 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:02 smithi066 podman[135322]: 2024-09-15 23:08:02.703283992 +0000 UTC m=+2.043346648 container died 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:08:03.324 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:03 smithi066 podman[135322]: 2024-09-15 23:08:03.056337259 +0000 UTC m=+2.396399904 container cleanup 7c36941ba55cc112eb313a870a6c80693af10cee013b8bb567e4afe5d12d1933 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T23:08:03.324 INFO:journalctl@ceph.mds.j.smithi066.stdout:Sep 15 23:08:03 smithi066 bash[135322]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-j 2024-09-15T23:08:03.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T23:08:03.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:03.475 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T23:08:03.475 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T23:08:03.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.b 2024-09-15T23:08:03.776 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:03 smithi087 systemd[1]: Stopping Ceph mds.b for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:04.031 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T23:08:03.775+0000 7fe082d96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:04.031 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:03 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b[65473]: 2024-09-15T23:08:03.775+0000 7fe082d96640 -1 mds.b *** got signal Terminated *** 2024-09-15T23:08:07.446 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:07 smithi087 podman[74933]: 2024-09-15 23:08:07.165268768 +0000 UTC m=+3.500211428 container died 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T23:08:07.835 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:07 smithi087 podman[74933]: 2024-09-15 23:08:07.533977216 +0000 UTC m=+3.868919881 container cleanup 23a24a60cb3a8fd8e7df7027f8545daeb4fda722362c417187b3769f69435978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:08:07.835 INFO:journalctl@ceph.mds.b.smithi087.stdout:Sep 15 23:08:07 smithi087 bash[74933]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-b 2024-09-15T23:08:07.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T23:08:08.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:08.000 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T23:08:08.000 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T23:08:08.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.e 2024-09-15T23:08:08.099 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:08 smithi087 systemd[1]: Stopping Ceph mds.e for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:08.599 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: 2024-09-15T23:08:08.320+0000 7f3fc08a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:08.599 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:08 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e[64867]: 2024-09-15T23:08:08.320+0000 7f3fc08a2640 -1 mds.e *** got signal Terminated *** 2024-09-15T23:08:11.496 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:11 smithi087 podman[75066]: 2024-09-15 23:08:11.167899733 +0000 UTC m=+2.953502273 container died 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T23:08:11.496 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:11 smithi087 podman[75066]: 2024-09-15 23:08:11.495648143 +0000 UTC m=+3.281250679 container cleanup 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-15T23:08:11.849 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:11 smithi087 bash[75066]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e 2024-09-15T23:08:11.849 INFO:journalctl@ceph.mds.e.smithi087.stdout:Sep 15 23:08:11 smithi087 podman[75078]: 2024-09-15 23:08:11.696715209 +0000 UTC m=+0.530403582 container remove 15f3b72c397532ad013dcd7f865fd13913505d87595b74d642ccd6312adc665a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:08:11.900 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T23:08:11.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:11.934 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T23:08:11.935 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T23:08:11.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.h 2024-09-15T23:08:12.252 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:12 smithi087 systemd[1]: Stopping Ceph mds.h for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:12.599 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: 2024-09-15T23:08:12.248+0000 7f6034ac6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:12.599 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:12 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h[65172]: 2024-09-15T23:08:12.248+0000 7f6034ac6640 -1 mds.h *** got signal Terminated *** 2024-09-15T23:08:15.349 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 podman[75185]: 2024-09-15 23:08:15.166424356 +0000 UTC m=+3.016380374 container died 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:08:15.701 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 podman[75185]: 2024-09-15 23:08:15.507723159 +0000 UTC m=+3.357679215 container cleanup 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T23:08:15.701 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 bash[75185]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h 2024-09-15T23:08:15.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T23:08:15.951 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 podman[75198]: 2024-09-15 23:08:15.700337934 +0000 UTC m=+0.534622184 container remove 64396dc5cdff9c47cf909081f072c22fac22e1540db83785eb66afcc4c1dc9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T23:08:15.951 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-15T23:08:15.951 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 systemd[1]: Stopped Ceph mds.h for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T23:08:15.951 INFO:journalctl@ceph.mds.h.smithi087.stdout:Sep 15 23:08:15 smithi087 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.h.service: Consumed 4min 39.680s CPU time. 2024-09-15T23:08:15.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:15.962 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T23:08:15.962 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T23:08:15.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.k 2024-09-15T23:08:16.295 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:16 smithi087 systemd[1]: Stopping Ceph mds.k for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:16.599 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: 2024-09-15T23:08:16.294+0000 7f587c1bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:16.599 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:16 smithi087 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k[64556]: 2024-09-15T23:08:16.294+0000 7f587c1bf640 -1 mds.k *** got signal Terminated *** 2024-09-15T23:08:19.446 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:19 smithi087 podman[75307]: 2024-09-15 23:08:19.160857908 +0000 UTC m=+2.987716474 container died ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T23:08:19.796 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:19 smithi087 podman[75307]: 2024-09-15 23:08:19.527875057 +0000 UTC m=+3.354733619 container cleanup ea727a24ee260ecab99c2e2eda7c30fc991d28534f09268bb6321963864fa6ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T23:08:19.796 INFO:journalctl@ceph.mds.k.smithi087.stdout:Sep 15 23:08:19 smithi087 bash[75307]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-k 2024-09-15T23:08:19.918 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T23:08:19.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:19.952 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T23:08:19.952 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T23:08:19.952 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.c 2024-09-15T23:08:20.256 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:20 smithi184 systemd[1]: Stopping Ceph mds.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:20.509 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: 2024-09-15T23:08:20.254+0000 7fecea685640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:20.509 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:20 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c[64923]: 2024-09-15T23:08:20.254+0000 7fecea685640 -1 mds.c *** got signal Terminated *** 2024-09-15T23:08:23.672 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:23 smithi184 podman[74107]: 2024-09-15 23:08:23.335253455 +0000 UTC m=+3.184225989 container died 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-15T23:08:23.956 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:23 smithi184 podman[74107]: 2024-09-15 23:08:23.75441083 +0000 UTC m=+3.603383363 container cleanup 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T23:08:23.956 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:23 smithi184 bash[74107]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c 2024-09-15T23:08:24.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T23:08:24.211 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:23 smithi184 podman[74131]: 2024-09-15 23:08:23.955472012 +0000 UTC m=+0.617152707 container remove 1cc1dcd43311ef3951d9e06dcda02805bd31a01f8109a4b4a36639a6016e30ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:08:24.211 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:24 smithi184 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-15T23:08:24.212 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:24 smithi184 systemd[1]: Stopped Ceph mds.c for 7d1c9c1c-73b2-11ef-bceb-c7b262605968. 2024-09-15T23:08:24.212 INFO:journalctl@ceph.mds.c.smithi184.stdout:Sep 15 23:08:24 smithi184 systemd[1]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.c.service: Consumed 6min 13.630s CPU time. 2024-09-15T23:08:24.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:24.226 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T23:08:24.226 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T23:08:24.226 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.f 2024-09-15T23:08:24.526 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:24 smithi184 systemd[1]: Stopping Ceph mds.f for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:24.922 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: 2024-09-15T23:08:24.524+0000 7fbaff3e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:24.922 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:24 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f[64622]: 2024-09-15T23:08:24.524+0000 7fbaff3e3640 -1 mds.f *** got signal Terminated *** 2024-09-15T23:08:27.593 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:27 smithi184 podman[74240]: 2024-09-15 23:08:27.337598883 +0000 UTC m=+2.891748314 container died f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-15T23:08:27.922 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:27 smithi184 podman[74240]: 2024-09-15 23:08:27.699766828 +0000 UTC m=+3.253916258 container cleanup f28044854e413650283681fc31869f4915332280123b80f52c61db4b5f7c066a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T23:08:27.922 INFO:journalctl@ceph.mds.f.smithi184.stdout:Sep 15 23:08:27 smithi184 bash[74240]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-f 2024-09-15T23:08:28.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T23:08:28.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:28.119 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T23:08:28.119 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T23:08:28.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.i 2024-09-15T23:08:28.672 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:28 smithi184 systemd[1]: Stopping Ceph mds.i for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:28.672 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: 2024-09-15T23:08:28.428+0000 7f9e37d6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:28.672 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:28 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i[65223]: 2024-09-15T23:08:28.428+0000 7f9e37d6b640 -1 mds.i *** got signal Terminated *** 2024-09-15T23:08:31.672 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:31 smithi184 podman[74362]: 2024-09-15 23:08:31.336307701 +0000 UTC m=+3.004513320 container died ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T23:08:31.971 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:31 smithi184 podman[74362]: 2024-09-15 23:08:31.794838805 +0000 UTC m=+3.463044418 container cleanup ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:08:31.971 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:31 smithi184 bash[74362]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i 2024-09-15T23:08:32.221 INFO:journalctl@ceph.mds.i.smithi184.stdout:Sep 15 23:08:31 smithi184 podman[74373]: 2024-09-15 23:08:31.971020819 +0000 UTC m=+0.605667099 container remove ffdae38b5d48ab7d5b68fed8d88e388f2347b36307eec2fed8dc9264e5e1c589 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T23:08:32.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T23:08:32.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:32.257 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T23:08:32.257 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T23:08:32.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.l 2024-09-15T23:08:32.580 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:32 smithi184 systemd[1]: Stopping Ceph mds.l for 7d1c9c1c-73b2-11ef-bceb-c7b262605968... 2024-09-15T23:08:32.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: 2024-09-15T23:08:32.579+0000 7f15b018e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:08:32.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:32 smithi184 ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l[64323]: 2024-09-15T23:08:32.579+0000 7f15b018e640 -1 mds.l *** got signal Terminated *** 2024-09-15T23:08:35.672 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:35 smithi184 podman[74484]: 2024-09-15 23:08:35.397579906 +0000 UTC m=+2.927278900 container died 175baf2129576c32a35207e64e0fa3487258052de6160ee4f5f1c9acb69650ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:08:36.127 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:35 smithi184 podman[74484]: 2024-09-15 23:08:35.715314745 +0000 UTC m=+3.245013710 container cleanup 175baf2129576c32a35207e64e0fa3487258052de6160ee4f5f1c9acb69650ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:08:36.128 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:35 smithi184 bash[74484]: ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l 2024-09-15T23:08:36.128 INFO:journalctl@ceph.mds.l.smithi184.stdout:Sep 15 23:08:35 smithi184 podman[74496]: 2024-09-15 23:08:35.907962706 +0000 UTC m=+0.498071647 container remove 175baf2129576c32a35207e64e0fa3487258052de6160ee4f5f1c9acb69650ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T23:08:36.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7d1c9c1c-73b2-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T23:08:36.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:08:36.186 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T23:08:36.186 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:08:36.397 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:08:39.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:08:39.306 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:08:41.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:08:42.174 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:08:44.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:08:44.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:08:44.734 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:08:44.762 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T23:08:44.764 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi066/crash 2024-09-15T23:08:44.766 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:08:44.797 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:08:44.798 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:08:44.799 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi087/crash 2024-09-15T23:08:44.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:08:44.843 INFO:teuthology.orchestra.run.smithi087.stderr:tar: /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:08:44.843 INFO:teuthology.orchestra.run.smithi087.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:08:44.845 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi184/crash 2024-09-15T23:08:44.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:08:44.889 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:08:44.889 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:08:44.890 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T23:08:44.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T23:08:44.988 INFO:teuthology.orchestra.run.smithi066.stdout:2024-09-15T22:48:44.927075+0000 mds.i (mds.1) 8 : cluster [WRN] Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details 2024-09-15T23:08:44.988 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-15T23:08:44.988 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[SEC\]' /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T23:08:45.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]' /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T23:08:45.108 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[WRN\]' /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T23:08:45.185 INFO:teuthology.orchestra.run.smithi066.stdout:2024-09-15T22:48:44.927075+0000 mds.i (mds.1) 8 : cluster [WRN] Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details 2024-09-15T23:08:45.185 INFO:tasks.cephadm:Compressing logs... 2024-09-15T23:08:45.185 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:08:45.228 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:08:45.230 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr: -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T23:08:45.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T23:08:45.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:08:45.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T23:08:45.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T23:08:45.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T23:08:45.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T23:08:45.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T23:08:45.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:08:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-15T23:08:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T23:08:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T23:08:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T23:08:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:08:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T23:08:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T23:08:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T23:08:45.282 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:08:45.282 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T23:08:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:08:45.287 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-15T23:08:45.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-15T23:08:45.287 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.a.log: --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T23:08:45.288 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T23:08:45.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T23:08:45.289 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T23:08:45.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.x.log: /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:08:45.289 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 87.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:08:45.347 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.1% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:08:45.379 INFO:teuthology.orchestra.run.smithi184.stderr: 90.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:08:45.380 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:08:45.410 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.1% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:08:45.416 INFO:teuthology.orchestra.run.smithi087.stderr: 90.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:08:45.419 INFO:teuthology.orchestra.run.smithi066.stderr: 94.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T23:08:45.428 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:08:45.448 INFO:teuthology.orchestra.run.smithi066.stderr: 84.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:08:45.448 INFO:teuthology.orchestra.run.smithi087.stderr: 92.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T23:08:45.464 INFO:teuthology.orchestra.run.smithi184.stderr: 87.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:08:45.482 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T23:08:45.507 INFO:teuthology.orchestra.run.smithi066.stderr: 94.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T23:08:45.509 INFO:teuthology.orchestra.run.smithi184.stderr: 90.9% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:08:45.530 INFO:teuthology.orchestra.run.smithi066.stderr: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:08:45.568 INFO:teuthology.orchestra.run.smithi066.stderr: 90.3% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:08:45.598 INFO:teuthology.orchestra.run.smithi087.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:08:45.669 INFO:teuthology.orchestra.run.smithi066.stderr: 90.9% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:08:46.077 INFO:teuthology.orchestra.run.smithi087.stderr: 90.8% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:08:46.323 INFO:teuthology.orchestra.run.smithi066.stderr: 90.3% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T23:08:51.144 INFO:teuthology.orchestra.run.smithi066.stderr: 95.3% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T23:08:53.391 INFO:teuthology.orchestra.run.smithi066.stderr: 90.3% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T23:09:00.848 INFO:teuthology.orchestra.run.smithi066.stderr: 95.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T23:09:13.889 INFO:teuthology.orchestra.run.smithi184.stderr: 91.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T23:09:17.347 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T23:10:23.704 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T23:10:25.169 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T23:11:33.777 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T23:11:35.392 INFO:teuthology.orchestra.run.smithi087.stderr: 91.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T23:11:40.591 INFO:teuthology.orchestra.run.smithi087.stderr: 95.4% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T23:11:48.859 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T23:11:48.862 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-15T23:11:48.862 INFO:teuthology.orchestra.run.smithi066.stderr:real 3m3.620s 2024-09-15T23:11:48.862 INFO:teuthology.orchestra.run.smithi066.stderr:user 4m54.760s 2024-09-15T23:11:48.862 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m10.194s 2024-09-15T23:12:00.451 INFO:teuthology.orchestra.run.smithi184.stderr: 95.2% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T23:12:40.631 INFO:teuthology.orchestra.run.smithi087.stderr: 95.5% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T23:13:29.550 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T23:15:29.417 INFO:teuthology.orchestra.run.smithi087.stderr: 91.8% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T23:18:27.618 INFO:teuthology.orchestra.run.smithi087.stderr: 92.0% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T23:23:07.024 INFO:teuthology.orchestra.run.smithi087.stderr: 94.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T23:24:22.048 INFO:teuthology.orchestra.run.smithi087.stderr: 94.8% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T23:24:22.049 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-09-15T23:24:22.050 INFO:teuthology.orchestra.run.smithi087.stderr:real 15m36.803s 2024-09-15T23:24:22.050 INFO:teuthology.orchestra.run.smithi087.stderr:user 8m3.440s 2024-09-15T23:24:22.050 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m23.446s 2024-09-15T23:24:31.736 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T23:28:44.493 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T23:30:44.656 INFO:teuthology.orchestra.run.smithi184.stderr: 91.9% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T23:36:56.333 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T23:38:02.256 INFO:teuthology.orchestra.run.smithi184.stderr: 94.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T23:42:01.963 INFO:teuthology.orchestra.run.smithi184.stderr: 94.6% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T23:44:16.932 INFO:teuthology.orchestra.run.smithi184.stderr: 94.2% -- replaced with /var/log/ceph/7d1c9c1c-73b2-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T23:44:16.965 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-15T23:44:16.966 INFO:teuthology.orchestra.run.smithi184.stderr:real 35m31.720s 2024-09-15T23:44:16.966 INFO:teuthology.orchestra.run.smithi184.stderr:user 11m39.463s 2024-09-15T23:44:16.966 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m36.764s 2024-09-15T23:44:16.966 INFO:tasks.cephadm:Archiving logs... 2024-09-15T23:44:16.968 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi066/log 2024-09-15T23:44:16.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:45:05.854 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi087/log 2024-09-15T23:45:05.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:46:20.068 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi184/log 2024-09-15T23:46:20.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:48:06.312 INFO:tasks.cephadm:Removing cluster... 2024-09-15T23:48:06.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force 2024-09-15T23:48:06.528 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:48:07.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force 2024-09-15T23:48:07.395 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:48:08.172 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7d1c9c1c-73b2-11ef-bceb-c7b262605968 --force 2024-09-15T23:48:08.612 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 7d1c9c1c-73b2-11ef-bceb-c7b262605968 2024-09-15T23:48:09.537 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T23:48:09.537 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:48:09.559 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:48:09.578 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:48:09.595 INFO:tasks.cephadm:Teardown complete 2024-09-15T23:48:09.595 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T23:48:09.609 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T23:48:09.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:48:09.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:48:09.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:48:09.961 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T23:48:09.972 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T23:48:09.972 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:48:09.975 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:48:09.978 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:48:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:48:09.993 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:48:09.993 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:48:10.004 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:48:10.004 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-15T23:48:10.004 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 7 377 65 +428us[ +433us] +/- 60ms 2024-09-15T23:48:10.005 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -1201us[-1201us] +/- 61ms 2024-09-15T23:48:10.005 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 64 +881us[ +881us] +/- 69ms 2024-09-15T23:48:10.005 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:48:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:48:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-15T23:48:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +369us[ +394us] +/- 61ms 2024-09-15T23:48:10.014 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -1205us[-1180us] +/- 61ms 2024-09-15T23:48:10.014 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +866us[ +891us] +/- 70ms 2024-09-15T23:48:10.014 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:48:10.052 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:48:10.052 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-09-15T23:48:10.052 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 +396us[ +390us] +/- 60ms 2024-09-15T23:48:10.053 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1195us[-1200us] +/- 61ms 2024-09-15T23:48:10.053 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 65 +901us[ +895us] +/- 69ms 2024-09-15T23:48:10.053 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:48:10.073 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T23:48:10.084 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T23:48:10.084 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T23:48:10.094 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:48:10.271 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:48:10.397 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:48:10.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:48:10.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:10.546 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:48:10.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:10.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:48:10.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:10.607 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T23:48:10.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T23:48:10.629 INFO:teuthology.task.internal:Duration was 4838.985735 seconds 2024-09-15T23:48:10.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T23:48:10.639 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T23:48:10.639 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:48:10.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:48:10.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:48:10.704 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:48:10.705 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:48:10.707 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:48:11.237 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T23:48:11.237 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-15T23:48:11.237 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:48:11.261 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-15T23:48:11.261 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:48:11.302 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-09-15T23:48:11.302 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:48:11.327 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T23:48:11.327 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:48:11.330 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:48:11.345 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:48:11.397 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T23:48:11.397 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:48:11.400 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:48:11.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:48:13.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T23:48:13.250 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T23:48:13.250 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:48:13.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:48:13.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:48:13.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T23:48:13.352 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.385 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-15T23:48:13.386 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-15T23:48:13.431 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-09-15T23:48:13.454 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:13.469 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:13.485 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:48:13.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:48:13.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T23:48:13.514 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T23:48:13.515 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi066 2024-09-15T23:48:13.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:48:13.595 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi087 2024-09-15T23:48:13.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:48:13.635 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906260/remote/smithi184 2024-09-15T23:48:13.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:48:13.679 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T23:48:13.679 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:48:13.682 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:48:13.684 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:48:13.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T23:48:13.752 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T23:48:13.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T23:48:13.763 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T23:48:13.764 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:48:13.766 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:48:13.769 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:48:13.779 INFO:teuthology.orchestra.run.smithi066.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:48 /home/ubuntu/cephtest 2024-09-15T23:48:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:48 /home/ubuntu/cephtest 2024-09-15T23:48:13.787 INFO:teuthology.orchestra.run.smithi184.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:48 /home/ubuntu/cephtest 2024-09-15T23:48:13.788 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T23:48:13.800 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T23:48:13.895 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} duration: 4838.985735416412 failure_reason: '"2024-09-15T22:48:44.927075+0000 mds.i (mds.1) 8 : cluster [WRN] Scrub error on inode 0x2000000163c (/volumes/qa/sv_1/9623457f-b6b7-45df-8f7b-fed8f4e559f1/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-33) see mds.i log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-15T23:48:13.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:48:13.986 INFO:teuthology.run:FAIL